SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
Open accessAbstract
Generating talking head videos through a face image and a piece of speech audio still contains many challenges. i.e., unnatural head movement, distorted expression, and identity modification. We argue that these issues are mainly caused by learning from the coupled 2D motion fields. On the other hand, explicitly using 3D information also suffers problems of stiff expression and incoherent video. We present SadTalker, which generates 3D motion coefficients (head pose, expression) of the 3DMM from audio and implicitly modulates a novel 3D-aware face render for talking head generation. To learn the realistic motion coefficients, we explicitly model the connections between audio and different types of motion coefficients individually. Precisely, we present ExpNet to learn the accurate facial expression from audio by distilling both coefficients and 3D-rendered faces. As for the head pose, we design PoseVAE via a conditional VAE to synthesize head motion in different styles. Finally, the generated 3D motion coefficients are mapped to the unsupervised 3D keypoints space of the proposed face render to synthesize the final video. We conducted extensive experiments to demonstrate the superiority of our method in terms of motion and video quality.11The code and demo videos are available at https://sadtalker.github.io.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
SadTalker first extracts 3DMM coefficients from audio and then renders the face in a 3D-aware manner.
“SadTalker [44] first extracts 3DMM coefficients from audio and then renders the face in a 3D-aware manner.”
From MoCha: Towards Movie-Grade Talking Character Synthesis (2025) · cites this paper as [44]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067 · see citing works
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365 · see citing works
ArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781 · see citing works
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. R. (1999) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/311535.311556 · Cited by 4,695 · see citing works
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
Saharia, C., Chan, W., Saxena, S., Li, L., Whang, J., Denton, E., Ghasemipour, S. K. S., Ayan, B. K., Mahdavi, S. S., Lopes, R. G., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.11487 · Cited by 2,528 · see citing works
Hierarchical Text-Conditional Image Generation with CLIP Latents
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06125 · Cited by 2,511 · cited 1× · see citing works
“Both visible and invisible video watermarks will be inserted into the produced video for generated content identification similar to Dall-E [30] and Imagen [32].”
MethodVoxCeleb: A Large-Scale Speaker Identification Dataset
Nagrani, A., Chung, J. S., & Zisserman, A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-950 · Cited by 2,210 · see citing works
Tutorial on Variational Autoencoders
Doersch, C. (2016) · arXiv · doi:10.48550/arxiv.1606.05908 · Cited by 1,470 · see citing works
A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild
Prajwal, K. R., Mukhopadhyay, R., Namboodiri, V. P., & Jawahar, C. V. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413532 · Cited by 897 · see citing works
Accurate 3D Face Reconstruction With Weakly-Supervised Learning: From Single Image to Image Set
Deng, Y., Yang, J., Xu, S., Chen, D., Jia, Y., & Tong, X. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00038 · Cited by 776 · see citing works
Kim, H., Garrido, P., Tewari, A., Xu, W., Thies, J., Nießner, M., Pérez, P., Richardt, C., Zollhöfer, M., & Theobalt, C. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201283 · Cited by 692 · see citing works
Fine-Grained Head Pose Estimation Without Keypoints
Ruiz, N., Chong, E., & Rehg, J. M. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00281 · Cited by 659 · see citing works
A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD)
Narvekar, N., & Karam, L. J. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2131660 · Cited by 595 · see citing works
First Order Motion Model for Image Animation
Siarohin, A., Lathuilière, S., Tulyakov, S., Ricci, E., & Sebe, N. (2020) · arXiv · doi:10.48550/arxiv.2003.00196 · Cited by 585 · see citing works
Towards Real-World Blind Face Restoration with Generative Facial Prior
Wang, X., Li, Y., Zhang, H., & Shan, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00905 · Cited by 564 · see citing works
Self-citationGANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Bynagari, N. B. (2019) · Asian Journal of Applied Science and Engineering · doi:10.18034/ajase.v8i1.9 · Cited by 514 · see citing works
One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing
Wang, T.-C., Mallya, A., & Liu, M.-Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00991 · Cited by 468 · see citing works
Hierarchical Cross-Modal Talking Face Generation With Dynamic Pixel-Wise Loss
Chen, L., Maddox, R. K., Duan, Z., & Xu, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00802 · Cited by 437 · see citing works
Zhou, Y., Han, X., Shechtman, E., Echevarria, J., Kalogerakis, E., & Li, D. (2020) · ACM Transactions on Graphics · doi:10.1145/3414685.3417774 · Cited by 403 · see citing works
Neural Voice Puppetry: Audio-Driven Facial Reenactment
Thies, J., Elgharib, M. A., Tewari, A., Theobalt, C., & Nießner, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58517-4_42 · Cited by 397 · see citing works
AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis
Guo, Y., Chen, K., Liang, S., Liu, Y.-J., Bao, H., & Zhang, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00573 · Cited by 384 · see citing works
Self-citationPose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation
Zhou, H., Sun, Y., Wu, W., Loy, C. C., Wang, X., & Liu, Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00416 · Cited by 377 · see citing works
Self-citationFlow-guided One-shot Talking Face Generation with a High-resolution Audio-visual Dataset
Zhang, Z., Li, L., Ding, Y., & Fan, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00366 · Cited by 368 · see citing works
Learning Individual Styles of Conversational Gesture
Ginosar, S., Bar, A., Kohavi, G., Chan, C., Owens, A., & Malik, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00361 · Cited by 341 · see citing works
FaceFormer: Speech-Driven 3D Facial Animation with Transformers
Fan, Y., Lin, Z., Saito, J., Wang, W., & Komura, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01821 · Cited by 266 · see citing works
Motion Representations for Articulated Animation
Siarohin, A., Woodford, O. J., Ren, J., Chai, M., & Tulyakov, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01344 · Cited by 260 · see citing works
Few-shot Video-to-Video SynthesisPreprint
Wang, T.-C., Liu, M.-Y., Tao, A., Liu, G., Kautz, J., & Catanzaro, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12713 · Cited by 235 · see citing works
Thin-Plate Spline Motion Model for Image Animation
Zhao, J. M., & Zhang, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00364 · Cited by 232 · see citing works
Audio-Driven Emotional Video Portraits
Ji, X., Zhou, H., Wang, K., Wu, W., Loy, C. C., Cao, X., & Xu, F. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01386 · Cited by 223 · see citing works
PIRenderer: Controllable Portrait Image Generation via Semantic Neural Rendering
Ren, Y., Li, G., Chen, Y., Li, T. H., & Liu, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01350 · Cited by 211 · see citing works
HeadNeRF: A Realtime NeRF-based Parametric Head Model
Hong, Y., Peng, B., Xiao, H., Liu, L., & Zhang, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01973 · Cited by 207 · see citing works
CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior
Xing, J., Xia, M., Zhang, Y., Cun, X., Wang, J., & Wong, T. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01229 · Cited by 197 · see citing works
Self-citationDepth-Aware Generative Adversarial Network for Talking Head Video Generation
Hong, F.-T., Zhang, L., Shen, L., & Xu, D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00339 · Cited by 190 · see citing works
StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN
Yin, F., Zhang, Y., Cun, X., Cao, M., Fan, Y., Wang, X., Bai, Q., Wu, B., Wang, J., & Yang, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19790-1_6 · Cited by 180 · see citing works
Self-citationLu, Y., Chai, J., & Cao, X. (2021) · ACM Transactions on Graphics · doi:10.1145/3478513.3480484 · Cited by 174 · see citing works
Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion
Wang, S., Li, L., Ding, Y., Fan, C., & Yu, X. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/152 · Cited by 169 · see citing works
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model
Ji, X., Zhou, H., Wang, K., Wu, Q., Wu, W., Xu, F., & Cao, X. (2022) · Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings · doi:10.1145/3528233.3530745 · Cited by 155 · see citing works
Towards Automatic Face-to-Face Translation
R, P. K., Mukhopadhyay, R., Philip, J., Jha, A., Namboodiri, V. P., & Jawahar, C. V. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3351066 · Cited by 151 · see citing works
FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning
Zhang, C., Zhao, Y., Huang, Y., Zeng, M., Ni, S., Budagavi, M., & Guo, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00384 · Cited by 140 · see citing works
HeadGAN: One-shot Neural Head Synthesis and Editing
Doukas, M. C., Zafeiriou, S., & Sharmanska, V. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01413 · Cited by 117 · see citing works
One-Shot Talking Face Generation from Single-Speaker Audio-Visual Correlation Learning
Wang, S., Li, L., Ding, Y., & Yu, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20154 · Cited by 115 · see citing works
VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild
Cheng, K., Cun, X., Zhang, Y., Xia, M., Yin, F., Zhu, M., Wang, X., Wang, J., & Wang, N. (2022) · SIGGRAPH Asia Conference Papers · doi:10.1145/3550469.3555399 · Cited by 112 · see citing works
Self-citationPhotorealistic Audio-driven Video Portraits
Wen, X. L., Wang, M., Richardt, C., Chen, Z.-Y., & Hu, S. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3023573 · Cited by 81 · see citing works
DPE: Disentanglement of Pose and Expression for General Video Portrait Editing
Pang, Y., Zhang, Y., Quan, W., Fan, Y., Cun, X., Shan, Y., & Dong-ming Yan, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00049 · Cited by 56 · see citing works
Self-citationLatent Image Animator: Learning to Animate Images via Latent Space NavigationPreprint
Wang, Y., Yang, D., Brémond, F., & Dantcheva, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.09043 · Cited by 52 · see citing works
Implicit Warping for Animation with Image SetsPreprint
Mallya, A., Wang, T.-C., & Liu, M.-Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.01794 · Cited by 12 · see citing works
Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from VideosPreprint
Filntisis, P. P., Retsinas, G., Papantoniou, F. P., Katsamanis, A., Roussos, A., & Maragos, P. A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.11094 · Cited by 7 · see citing works
Flagged first, then by citations
2 of the 50 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. Image-to-image translation with conditional adversarial net- works. CVPR, 2017. 14
- Diederik P Kingma and Jimmy Ba. A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014. 5 · arXiv
- Siyao Li, Yu Weijiang, Gu Tianpei, Lin Chunze, Wang Quan, Qian Chen, Loy Chen Change, and Liu Ziwei. Bailando: 3d dance generation via actor-critic gpt with choreographic memory. In CVPR, 2022. 5
- Yuanxun Lu, Jinxiang Chai, and Xun Cao. Live speech por- traits: real-time photorealistic talking-head animation. ACM Transactions on Graphics (TOG), 2021. 3
- Pingchuan Ma, Yujiang Wang, Stavros Petridis, Jie Shen, and Maja Pantic. Training strategies for improved lip-reading. In ICASSP, 2022. 13
- Yang Zhou, Xintong Han, Eli Shechtman, Jose Echevar- ria, Evangelos Kalogerakis, and Dingzeyu Li. Makelttalk: speaker-aware talking-head animation. ACM Transactions on Graphics (TOG), 2020. 2, 3, 5, 6, 7, 8, 12
Cited by
Sorted by citations
PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding
Li, Z., Cao, M., Wang, X., Qi, Z., Cheng, M., & Shan, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00825 · Cited by 161 · see citing works
Self-citationEvalCrafter: Benchmarking and Evaluating Large Video Generation Models
Liu, Y., Cun, X., Liu, X., Wang, X., Zhang, Y., Chen, H., Liu, Y., Zeng, T., Chan, R., & Shan, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02090 · Cited by 121 · see citing works
Self-citationTian, L., Wang, Q. J., Zhang, B., & Bo, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73010-8_15 · Cited by 112 · see citing works
Tian, L., Wang, Q., Zhang, B., & Bo, L. (2024) · arXiv · doi:10.48550/arxiv.2402.17485 · Cited by 92 · see citing works
Sun, Z., Lv, T. S., Ye, S., Lin, M. G., Sheng, J., Wen, Y., Yu, M., & Liu, Y. (2024) · ACM Transactions on Graphics · doi:10.1145/3658221 · Cited by 98 · see citing works
SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis
Peng, Z., Hu, W., Shi, Y., Zhu, X., Zhang, X., Zhao, H., He, J., Liu, H., & Fan, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00070 · Cited by 83 · see citing works
Xu, T., Liu, Y., Jin, Y., Qu, Y.-Y., Bai, J., Zhang, W., & Zhou, Y. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13530 · Cited by 95 · see citing works
Self-citationEchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditions
Chen, Z., Cao, J., Chen, Z., Li, Y., & Ma, C. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i3.32241 · Cited by 79 · see citing works
Deep learning for visual speech analysis: A survey
Sheng, C., Kuang, G., Bai, L., Hou, C., Guo, Y., Xu, X., Pietikäinen, M., & Liu, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3376710 · Cited by 64 · see citing works
Self-citationGaussianTalker: Real-Time Talking Head Synthesis with 3D Gaussian Splatting
Cho, K., Lee, J., Yoon, H., Hong, Y., Ko, J., Ahn, S., & Kim, S. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681627 · Cited by 55 · see citing works
Chen, J., Liu, Y., Wang, J., Zeng, A., Li, Y., & Chen, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00702 · Cited by 56 · see citing works
Deepfakes as a threat to a speaker and facial recognition: An overview of tools and attack vectors
Firc, A., Malinka, K., & Hanáček, P. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e15090 · Cited by 54 · see citing works
Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation
Ma, Y., Liu, H., Wang, H., Pan, H., He, Y., Yuan, J., Zeng, A., Cai, C., Shum, H., Liu, W., et al. (2024) · SIGGRAPH Asia Conference Papers · doi:10.1145/3680528.3687587 · Cited by 53 · see citing works
Depth-Aware Test-Time Training for Zero-Shot Video Object Segmentation
Liu, W., Shen, X., Li, H., Bi, X., Лю, Б., Pun, C., & Cun, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01818 · Cited by 43 · see citing works
Self-citationMedia2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance
Zhao, Q., Long, P., Zhang, Q., Qin, D., Liang, H., Zhang, L., Zhang, Y., Jingyi Yu, A., & Xu, L. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657413 · Cited by 47 · see citing works
Self-citationEDTalk: Efficient Disentanglement for Emotional Talking Head Synthesis
Tan, S., Ji, B., Bi, M., & Pan, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72658-3_23 · Cited by 45 · see citing works
Video and Audio Deepfake Datasets and Open Issues in Deepfake Technology: Being Ahead of the Curve
Akhtar, Z., Pendyala, T. L., & Athmakuri, V. S. (2024) · Forensic Sciences · doi:10.3390/forensicsci4030021 · Cited by 40 · see citing works
PortraitBooth: A Versatile Portrait Model for Fast Identity-Preserved Personalization
Xu, P., Zhu, J., Jiang, B., Tai, Y. Y., Luo, D., Zhang, J., Lin, W., Jin, T., Wang, C., & Ji, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02557 · Cited by 38 · see citing works
A Survey on Generative AI and LLM for Video Generation, Understanding, and StreamingPreprint
Zhou, P., Wang, L., Liu, Z., Hao, Y., Hui, P., Tarkoma, S., & Kangasharju, J. (2024) · doi:10.36227/techrxiv.171172801.19993069/v1 · Cited by 63 · see citing works
LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generation
Zhi, Y., Cun, X., Chen, X., Shen, X., Guo, W. Q., Huang, S., & Gao, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01902 · Cited by 34 · see citing works
Self-citationEMOPortraits: Emotion-Enhanced Multimodal One-Shot Head Avatars
Drobyshev, N., Casademunt, A. B., Vougioukas, K., Landgraf, Z., Petridis, S., & Pantić, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00812 · Cited by 33 · see citing works
Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer
Cui, J., Li, H., Zhan, Y., Shang, H. L., Cheng, K., Ma, Y., Mu, S., Zhou, H., Wang, J., & Zhu, S. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01964 · Cited by 34 · see citing works
Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer
Cui, J., Li, H., Zhan, Y., Shang, H., Cheng, K., Ma, Y., Mu, S., Zhou, H., Wang, J., & Zhu, S. (2024) · arXiv · doi:10.48550/arxiv.2412.00733 · Cited by 32 · see citing works
Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Style
Tan, S., Ji, B., & Pan, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28313 · Cited by 30 · see citing works
Deepfake Generation and Detection: A Benchmark and Survey
Pei, G., Zhang, J., Hu, M., Zhang, Z., Wang, C., Wu, Y., Zhai, G., Yang, J. J., & Tao, D. (2026) · ACM Computing Surveys · doi:10.1145/3801962 · Cited by 113 · see citing works
Tan, S., Ji, B., & Pan, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02486 · Cited by 26 · see citing works
Make-Your-Anchor: A Diffusion-based 2D Avatar Generation Framework
Huang, Z., Tang, F., Zhang, Y., Cun, X., Cao, J., Li, J., & Lee, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00668 · Cited by 27 · see citing works
Self-citationNtire 2025 Xgc Quality Assessment Challenge: Methods and Results
Liu, X., Min, X., Qiang, H., Zhang, X., Guo, J., Zhai, G., Wang, S., Zhou, Y., Lü, L., Li, J., et al. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00128 · Cited by 26 · see citing works
Self-citationInie, N., Falk, J., & Selvan, R. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714227 · Cited by 26 · see citing works
Singh, S., & Dhumane, A. (2025) · MethodsX · doi:10.1016/j.mex.2025.103632 · Cited by 24 · see citing works
TellMeTalk: Multimodal-driven talking face video generation
Li, P., Zhao, H., Liu, Q., Tang, P., & Zhang, L. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2023.109049 · Cited by 22 · see citing works
Human Motion Video Generation: A Survey
Xue, H., Luo, X., Hu, Z., Zhang, X., Xiang, X., Dai, Y., Liu, J., Zhang, Z., Li, M., Yang, J. J., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3594034 · Cited by 24 · see citing works
Niu, M., Cun, X., Wang, X., Zhang, Y., Shan, Y., & Zheng, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72655-2_7 · Cited by 21 · see citing works
Self-citationMODA: Mapping-Once Audio-driven Portrait Animation with Dual Attentions
Liu, Y., Lin, L., Yu, F., Zhou, C., & Li, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02104 · Cited by 20 · see citing works
AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding
Liu, T., Chen, F., Fan, S., Du, C., Chen, Q., Chen, X., & Yu, K. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681198 · Cited by 21 · see citing works
Deepfakes in digital media forensics: Generation, AI-based detection and challenges
Bendiab, G., Haiouni, H., Moulas, I., & Shiaeles, S. N. (2024) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2024.103935 · Cited by 22 · see citing works
TalkCLIP: Talking Head Generation with Text-Guided Expressive Speaking Styles
Ma, Y., Wang, S., Ding, Y., Ma, B., Lv, T., Fan, C., Hu, Z., Deng, Z., & Yu, X. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3581808 · Cited by 29 · see citing works
Thqa: A Perceptual Quality Assessment Database for Talking Heads
Zhou, Y., Zhang, Z., Sun, W., Liu, X., Min, X., Wang, Z., Zhang, X.-P. S., & Zhai, G. (2024) · Proceedings - International Conference on Image Processing · doi:10.1109/icip51287.2024.10647507 · Cited by 18 · see citing works
Application of a 3D Talking Head as Part of Telecommunication AR, VR, MR System: Systematic Review
Christoff, N., Neshov, N. N., Tonchev, K., & Manolova, A. H. (2023) · Electronics · doi:10.3390/electronics12234788 · Cited by 17 · see citing works
Audio-Driven Facial Animation with Deep Learning: A Survey
Jiang, D., Chang, J. M., You, L., Bian, S., Kosk, R., & Maguire, G. (2024) · Information · doi:10.3390/info15110675 · Cited by 20 · see citing works
"AI Afterlife" as Digital Legacy: Perceptions, Expectations, and Concerns
Lei, Y., Ma, S., Sun, Y., & Ma, X. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713933 · Cited by 16 · see citing works
ToonTalker: Cross-Domain Face Reenactment
Gong, Y., Zhang, Y., Cun, X., Yin, F., Fan, Y., Wang, X., Wu, B., & Yang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00707 · Cited by 17 · see citing works
Self-citationCVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformer
Ma, H., Zhang, T., Sun, S., Yan, X., Han, K., & Xie, X. S. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00602 · Cited by 17 · see citing works
FaceChain-ImagineID: Freely Crafting High-Fidelity Diverse Talking Faces from Disentangled Audio
Xu, C., Liu, Y., Xing, J., Wang, W., Sun, M., Dan, J., Huang, T., Li, S., Cheng, Z.-Q., Tai, Y. Y., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00129 · Cited by 19 · see citing works
LAM: Large Avatar Model for One-shot Animatable Gaussian Head
He, Y., Gu, X., Ye, X. W., Xu, C., Zhao, Z., Dong, Y., Yuan, W., Dong, Z., & Bo, L. (2025) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3721238.3730706 · Cited by 17 · see citing works
Wav2Lip‐HR: Synthesising clear high‐resolution talking head in the wild
Liang, C., Wang, Q., Chen, Y., & Tang, M. (2023) · Computer Animation and Virtual Worlds · doi:10.1002/cav.2226 · Cited by 15 · see citing works
Wu, S., Haque, K. I., & Yumak, Z. (2024) · Motion in Games · doi:10.1145/3677388.3696320 · Cited by 15 · see citing works
EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation
Meng, R., Zhang, X., Li, Y., & Ma, C. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00516 · Cited by 17 · see citing works
Sonic: Shifting Focus to Global Audio Perception in Portrait Animation
Ji, X., Hu, X., Xu, Z., Zhu, J., Lin, C., He, Q., Zhang, J., Luo, D., Chen, Y., Lin, Q., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00027 · Cited by 21 · see citing works
Stochastic Latent Talking Face Generation Toward Emotional Expressions and Head Poses
Sheng, Z., Nie, L., Zhang, M., Chang, X., & Yan, Y. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3311039 · Cited by 16 · see citing works
CorrTalk: Correlation Between Hierarchical Speech and Facial Activity Variances for 3D Animation
Chu, Z., Guo, K., Xing, X., Lan, Y., Cai, B., & Xu, X. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3386836 · Cited by 13 · see citing works
Increasing Importance of Joint Analysis of Audio and Video in Computer Vision: A Survey
Shahabaz, A., & Sarkar, S. (2024) · IEEE Access · doi:10.1109/access.2024.3391817 · Cited by 13 · see citing works
FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesis
Wang, M., Wang, Q., Jiang, F., Fan, Y., Zhang, Y., Qi, Y., Zhao, K., & Xu, M. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755217 · Cited by 15 · see citing works
Self-citationAdapter-Based Incremental Learning for Face Forgery Detection
Gao, C., Xu, Q., Qiao, P., Xu, K., Qian, X., & Dou, Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446543 · Cited by 12 · see citing works
Tan, S., Ji, B., Ding, Y., & Pan, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28314 · Cited by 12 · see citing works
Lin, J., Chen, E., Gurung, A., & Koedinger, K. R. (2024) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3657604.3664720 · Cited by 14 · see citing works
Driving Animatronic Robot Facial Expression From Speech
Li, B., Li, H., & Liu, H. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801970 · Cited by 12 · see citing works
Han, L., Fang, J., Xie, C., Liao, M., & Zhang, Y. (2025) · Journal of Business Ethics · doi:10.1007/s10551-025-06061-2 · Cited by 14 · see citing works
Self-citationAVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation
Sun, Y., Chu, W., Zhou, H., Wang, K., & Koike, H. (2024) · IEEE Access · doi:10.1109/access.2024.3390182 · Cited by 14 · see citing works
Audio-Semantic Enhanced Pose-Driven Talking Head Generation
Liu, M., Li, D., Li, Y., Song, X., & Nie, L. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3414412 · Cited by 11 · see citing works
Vivid-persona: customizable persona tool with interactive and immersive experiences
Zhou, L., Yan, F., Ding, S., Cheng, Y., Yan, B., Zhu, W., Bao, S., Wang, J., & Song, S. (2024) · Journal of Engineering Design · doi:10.1080/09544828.2024.2383543 · Cited by 11 · see citing works
Faces that Speak: Jointly Synthesising Talking Face and Speech from Text
Jang, Y., Kim, J., Ahn, J., Kwak, D., Yang, H.-S., Ju, Y.-C., Kim, I.-H., Kim, B.-Y., & Chung, J. S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00842 · Cited by 11 · see citing works
EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Head
He, Q., Ji, X., Gong, Y., Lu, Y., Diao, Z., Huang, L., Yao, Y., Zhu, S., Ma, Z., Xu, S., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72998-0_4 · Cited by 11 · see citing works
Learn2Talk: 3D Talking Face Learns From 2D Talking Face
Zhuang, Y., Cheng, B., Cheng, Y., Jin, Y., Liu, R., Li, C., Cheng, X., Liao, J., & Lin, J. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3476275 · Cited by 12 · see citing works
Ensuring privacy in face recognition: a survey on data generation, inference and storage
Sun, Z., & Liu, Z. (2025) · Discover Applied Sciences · doi:10.1007/s42452-025-06987-2 · Cited by 12 · see citing works
Adaptive Super Resolution for One-Shot Talking-Head Generation
Song, L., Liu, P., Yin, G., & Xu, C. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446837 · Cited by 10 · see citing works
3D facial modeling, animation, and rendering for digital humans: A survey
Zhang, Y., Su, R., Yu, J., & Li, R. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128168 · Cited by 10 · see citing works
Self-citationSegTalker: Segmentation-based Talking Face Generation with Mask-guided Local Editing
Xiong, L., Cheng, X., Tan, J., Wu, X., Li, X., Zhu, L., Ma, F., Li, M., Xu, H., & Hu, Z. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681108 · Cited by 10 · see citing works
Beyond Talking – Generating Holistic 3D Human Dyadic Motion for Communication
Sun, M., Xu, C., Jiang, X., Liu, Y., Sun, B., & Huang, R. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02300-7 · Cited by 12 · see citing works
VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior
Sun, X., Zhang, L., Zhu, H., Zhang, P., Zhang, B., Ji, X., Zhou, K., Gao, D., Bo, L., & Cao, X. (2025) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv66043.2025.00071 · Cited by 22 · see citing works
SingingHead: A Large-Scale 4D Dataset for Singing Head Animation
Wu, S., Li, Y., Zhang, W., Jia, J., Zhu, Y., Yan, Y., Zhai, G., & Yang, X. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3623560 · Cited by 10 · see citing works
Self-citationChatASD: LLM-Based AI Therapist for ASD
Ren, X., Bai, Y., Duan, H., Fan, L., Fei, E., Wu, G., RAY, P. K., Hu, M., Yan, C., & Zhai, G. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-3626-3_23 · Cited by 9 · see citing works
InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation
Wang, Y., Guo, J., Bai, J., Yu, R., He, T., Tan, X., Sun, X., & Bian, J. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i8.32877 · Cited by 14 · see citing works
FG-EmoTalk: Talking Head Video Generation with Fine-Grained Controllable Facial Expressions
Sun, Z., Xuan, Y., Liu, F., & Xiang, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28309 · Cited by 10 · see citing works
ARTalk: Speech-Driven 3D Head Animation via Autoregressive Model
Chu, X., Goswami, N., Cui, Z., Wang, H., & Harada, T. (2025) · SIGGRAPH Asia Conference Papers · doi:10.1145/3757377.3763955 · Cited by 8 · see citing works
OSM-Net: One-to-Many One-Shot Talking Head Generation With Spontaneous Head Motions
Liu, J., Wang, X., Fu, X., Chai, Y., Cai, Y., Dai, J., & Han, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3394850 · Cited by 8 · see citing works
Self-citationTALK-Act: Enhance Textural-Awareness for 2D Speaking Avatar Reenactment with Diffusion Model
Guan, J., Yang, Q., Wang, K., Zhou, H., He, S., Xu, Z., Feng, H., Ding, E., Wang, J., Xie, H., et al. (2024) · SIGGRAPH Asia Conference Papers · doi:10.1145/3680528.3687571 · Cited by 8 · see citing works
Multimodal Feature-Guided Audio-Driven Emotional Talking Face Generation
Wang, X., Huo, Y., Liu, Y., Guo, X., Yan, F., & Zhao, G. (2025) · Electronics · doi:10.3390/electronics14132684 · Cited by 8 · see citing works
Self-citationVTutor: An Animated Pedagogical Agent SDK that Provide Real Time Multi-model Feedback
Chen, E., Lin, C.-Y., Huang, Y.-K., Tang, X., Xi, A., Lin, J., & Koedinger, K. R. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-99267-4_19 · Cited by 7 · see citing works
MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animation
Lin, Y., Fung, H., Xu, J., Ren, Z., Lau, A. S. M., Yin, G., & Li, X. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02444 · Cited by 7 · see citing works
Choi, J., Park, S. J., Kim, M., & Ro, Y. M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02580 · Cited by 7 · see citing works
ReSyncer: Rewiring Style-Based Generator for Unified Audio-Visually Synced Facial Performer
Guan, J., Xu, Z., Zhou, H., Wang, K., He, S., Zhang, Z., Liang, B., Feng, H., Ding, E., Liu, J., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72940-9_20 · Cited by 7 · see citing works
HyperLips: hyper control lips with high resolution decoder for talking face generation
Chen, Y., Yao, Y., Li, Z., Wang, W., Zhang, Y., Yang, H. S., & Wen, X. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05914-z · Cited by 9 · see citing works
Self-citationINFP: Audio-Driven Interactive Head Generation in Dyadic Conversations
Zhu, Y., Zhang, L., Rong, Z., Hu, T., Liang, S., & Ge, Z. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00997 · Cited by 10 · see citing works
Haque, K. I., Wu, S., & Yumak, Z. (2025) · Computers & Graphics · doi:10.1016/j.cag.2025.104358 · Cited by 6 · see citing works
Ditto: Motion-Space Diffusion for Controllable Realtime Talking Head Synthesis
Li, T., Zheng, R., Yang, M., Chen, J., & Yang, M. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755075 · Cited by 15 · see citing works
Learning Dynamic Tetrahedra for High-Quality Talking Head Synthesis
Zhang, Z., Zheng, R., Li, B., Han, C., Li, T., Wang, M., Guo, T., Chen, J., Liu, Z., & Yang, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00498 · Cited by 6 · see citing works
VividWav2Lip: High-Fidelity Facial Animation Generation Based on Speech-Driven Lip Synchronization
Liu, L., Wang, J., Chen, S., & Li, Z. (2024) · Electronics · doi:10.3390/electronics13183657 · Cited by 6 · see citing works
Chen, L., Bao, W., Lei, S., Tang, B., Wu, Z., Kang, S., Huang, H., & Meng, H. M. L. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3535287 · Cited by 10 · see citing works
EmoSpeaker: One-Shot Fine-Grained Emotion-Controlled Talking Face Generation
Feng, G., Cheng, H., Li, Y., Ma, Z., Li, C., Qian, Z., Miao, Q., & Pun, C. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3651074 · Cited by 6 · see citing works
uTalk: Bridging the Gap Between Humans and AI
Azzuni, H., Jamal, S., & Saddik, A. E. (2024) · International Conference on Consumer Electronics · doi:10.1109/icce59016.2024.10444441 · Cited by 6 · see citing works
Huang, Z., Zhou, Z., Cao, J., Ma, Y., Chen, Y., Rao, Z., Xu, Z., Wang, H., Lin, Q., Zhou, Y., et al. (2025) · SIGGRAPH Asia Conference Papers · doi:10.1145/3757377.3763861 · Cited by 5 · see citing works
Ma, Y., Yan, Z., Liu, H., Wang, H., Pan, H., He, Y., Yuan, J., Zeng, A., Cai, C., Shum, H., et al. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02685-z · Cited by 7 · see citing works
Semantic-aware hyper-space deformable neural radiance fields for facial avatar reconstruction
Jin, K., Gu, X., Wang, Z., Kuang, Z., Wu, Z., Tan, M., & Yu, J. (2024) · Pattern Recognition Letters · doi:10.1016/j.patrec.2024.08.004 · Cited by 5 · see citing works
HeadsetOff: Enabling Photorealistic Video Conferencing on Economical VR Headsets
Jin, Y., Duan, X., Wang, F., & Liu, X. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681432 · Cited by 5 · see citing works
Self-citationDEGSTalk: Decomposed Per-Embedding Gaussian Fields for Hair-Preserving Talking Face Synthesis
Deng, Y., Zheng, D., Xie, J., Wang, J., Xie, W., Shen, L., & Song, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890278 · Cited by 5 · see citing works
SemConf: A System for Multiparty Semantic Video Conferencing
Duan, X., Jin, Y., Zhang, L., & Wang, F. (2025) · doi:10.1145/3712678.3721884 · Cited by 5 · see citing works
Self-citationLarge Generative Model-Assisted Talking-Face Semantic Communication System
Jiang, F., Tu, S., Dong, L., Pan, C., Wang, J., & You, X. (2025) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2025.3623167 · Cited by 5 · see citing works
FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Model
Yao, Z., Cheng, X., & Huang, Z. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681238 · Cited by 5 · see citing works
Liu, X., Liu, Z., & Bi, C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889538 · Cited by 5 · see citing works
- Authors
- Zhang, W., Cun, X., Wang, X., Zhang, Y., Shen, X., Guo, Y., Shan, Y., & Wang, F.
- Affiliations
- Xi'an Jiaotong University (CN)
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence
- Ant Group (China) (CN)
- Tencent (China) (CN)
- Venue
- 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2023-06
- Pages
- 8652-8661
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4386072021
- Cited by
- 336
- References
- 50
- Citations by year
- 2026: 86 · 2025: 131 · 2024: 105 · 2023: 14
- FWCI
- 35.93
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
- arXiv (Cornell University)
- Funders
- National Key Research and Development Program of China (2022YFB3303800)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- talking head generation, audio-driven face animation, facial expression synthesis, stylized animation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
