The DOI matches its Crossref record; 48 of the 50 references it cites were found in a registry or an index.
SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
Open accessAbstract
Generating talking head videos through a face image and a piece of speech audio still contains many challenges. i.e., unnatural head movement, distorted expression, and identity modification. We argue that these issues are mainly caused by learning from the coupled 2D motion fields. On the other hand, explicitly using 3D information also suffers problems of stiff expression and incoherent video. We present SadTalker, which generates 3D motion coefficients (head pose, expression) of the 3DMM from audio and implicitly modulates a novel 3D-aware face render for talking head generation. To learn the realistic motion coefficients, we explicitly model the connections between audio and different types of motion coefficients individually. Precisely, we present ExpNet to learn the accurate facial expression from audio by distilling both coefficients and 3D-rendered faces. As for the head pose, we design PoseVAE via a conditional VAE to synthesize head motion in different styles. Finally, the generated 3D motion coefficients are mapped to the unsupervised 3D keypoints space of the proposed face render to synthesize the final video. We conducted extensive experiments to demonstrate the superiority of our method in terms of motion and video quality.11The code and demo videos are available at https://sadtalker.github.io.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“SadTalker [44] first extracts 3DMM coefficients from audio and then renders the face in a 3D-aware manner.”
From MoCha: Towards Movie-Grade Talking Character Synthesis (2025) · cites this paper as [44]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365
ArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. R. (1999) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/311535.311556 · Cited by 4,695
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
Saharia, C., Chan, W., Saxena, S., Li, L., Whang, J., Denton, E., Ghasemipour, S. K. S., Ayan, B. K., Mahdavi, S. S., Lopes, R. G., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.11487 · Cited by 2,528
Hierarchical Text-Conditional Image Generation with CLIP Latents
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06125 · Cited by 2,511 · cited 1×
“Both visible and invisible video watermarks will be inserted into the produced video for generated content identification similar to Dall-E [30] and Imagen [32].”
MethodVoxCeleb: A Large-Scale Speaker Identification Dataset
Nagrani, A., Chung, J. S., & Zisserman, A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-950 · Cited by 2,210
Tutorial on Variational Autoencoders
Doersch, C. (2016) · arXiv · doi:10.48550/arxiv.1606.05908 · Cited by 1,470
A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild
Prajwal, K. R., Mukhopadhyay, R., Namboodiri, V. P., & Jawahar, C. V. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413532 · Cited by 897
Research works printed but not linked: 3
- kingma, 2014, A method for stochastic optimization, ArXiv Preprint
- seitzer, 2020, pytorch-fid FID Score for PyTorch
- li, 0, Bailando: 3d dance generation via actor-critic gpt with choreographic memory, CVPR
Cited by
Sorted by citations
PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding
Li, Z., Cao, M., Wang, X., Qi, Z., Cheng, M., & Shan, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00825 · Cited by 233
Self-citationEvalCrafter: Benchmarking and Evaluating Large Video Generation Models
Liu, Y., Cun, X., Liu, X., Wang, X., Zhang, Y., Chen, H., Liu, Y., Zeng, T., Chan, R., & Shan, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02090 · Cited by 219
Self-citationTian, L., Wang, Q. J., Zhang, B., & Bo, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73010-8_15 · Cited by 211
Tian, L., Wang, Q., Zhang, B., & Bo, L. (2024) · arXiv · doi:10.48550/arxiv.2402.17485 · Cited by 92
Sun, Z., Lv, T. S., Ye, S., Lin, M. G., Sheng, J., Wen, Y., Yu, M., & Liu, Y. (2024) · ACM Transactions on Graphics · doi:10.1145/3658221 · Cited by 98
SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis
Peng, Z., Hu, W., Shi, Y., Zhu, X., Zhang, X., Zhao, H., He, J., Liu, H., & Fan, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00070 · Cited by 83
Xu, T., Liu, Y., Jin, Y., Qu, Y.-Y., Bai, J., Zhang, W., & Zhou, Y. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13530 · Cited by 113
Self-citationEchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditions
Chen, Z., Cao, J., Chen, Z., Li, Y., & Ma, C. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i3.32241 · Cited by 173
Deep learning for visual speech analysis: A survey
Sheng, C., Kuang, G., Bai, L., Hou, C., Guo, Y., Xu, X., Pietikäinen, M., & Liu, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3376710 · Cited by 64
Self-citationGaussianTalker: Real-Time Talking Head Synthesis with 3D Gaussian Splatting
Cho, K., Lee, J., Yoon, H., Hong, Y., Ko, J., Ahn, S., & Kim, S. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681627 · Cited by 55
Chen, J., Liu, Y., Wang, J., Zeng, A., Li, Y., & Chen, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00702 · Cited by 70
Deepfakes as a threat to a speaker and facial recognition: An overview of tools and attack vectors
Firc, A., Malinka, K., & Hanáček, P. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e15090 · Cited by 58
Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation
Ma, Y., Liu, H., Wang, H., Pan, H., He, Y., Yuan, J., Zeng, A., Cai, C., Shum, H., Liu, W., et al. (2024) · SIGGRAPH Asia Conference Papers · doi:10.1145/3680528.3687587 · Cited by 118
Depth-Aware Test-Time Training for Zero-Shot Video Object Segmentation
Liu, W., Shen, X., Li, H., Bi, X., Лю, Б., Pun, C., & Cun, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01818 · Cited by 45
Self-citationMedia2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance
Zhao, Q., Long, P., Zhang, Q., Qin, D., Liang, H., Zhang, L., Zhang, Y., Jingyi Yu, A., & Xu, L. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657413 · Cited by 47
Self-citationEDTalk: Efficient Disentanglement for Emotional Talking Head Synthesis
Tan, S., Ji, B., Bi, M., & Pan, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72658-3_23 · Cited by 45
Video and Audio Deepfake Datasets and Open Issues in Deepfake Technology: Being Ahead of the Curve
Akhtar, Z., Pendyala, T. L., & Athmakuri, V. S. (2024) · Forensic Sciences · doi:10.3390/forensicsci4030021 · Cited by 45
PortraitBooth: A Versatile Portrait Model for Fast Identity-Preserved Personalization
Xu, P., Zhu, J., Jiang, B., Tai, Y. Y., Luo, D., Zhang, J., Lin, W., Jin, T., Wang, C., & Ji, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02557 · Cited by 54
A Survey on Generative AI and LLM for Video Generation, Understanding, and StreamingPreprint
Zhou, P., Wang, L., Liu, Z., Hao, Y., Hui, P., Tarkoma, S., & Kangasharju, J. (2024) · doi:10.36227/techrxiv.171172801.19993069/v1 · Cited by 93
LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generation
Zhi, Y., Cun, X., Chen, X., Shen, X., Guo, W. Q., Huang, S., & Gao, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01902 · Cited by 44
Self-citationEMOPortraits: Emotion-Enhanced Multimodal One-Shot Head Avatars
Drobyshev, N., Casademunt, A. B., Vougioukas, K., Landgraf, Z., Petridis, S., & Pantić, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00812 · Cited by 33
Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer
Cui, J., Li, H., Zhan, Y., Shang, H. L., Cheng, K., Ma, Y., Mu, S., Zhou, H., Wang, J., & Zhu, S. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01964 · Cited by 85
Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer
Cui, J., Li, H., Zhan, Y., Shang, H., Cheng, K., Ma, Y., Mu, S., Zhou, H., Wang, J., & Zhu, S. (2024) · arXiv · doi:10.48550/arxiv.2412.00733 · Cited by 32
Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Style
Tan, S., Ji, B., & Pan, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28313 · Cited by 41
Deepfake Generation and Detection: A Benchmark and Survey
Pei, G., Zhang, J., Hu, M., Zhang, Z., Wang, C., Wu, Y., Zhai, G., Yang, J. J., & Tao, D. (2026) · ACM Computing Surveys · doi:10.1145/3801962 · Cited by 185
Tan, S., Ji, B., & Pan, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02486 · Cited by 26
Make-Your-Anchor: A Diffusion-based 2D Avatar Generation Framework
Huang, Z., Tang, F., Zhang, Y., Cun, X., Cao, J., Li, J., & Lee, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00668 · Cited by 32
Self-citationNtire 2025 Xgc Quality Assessment Challenge: Methods and Results
Liu, X., Min, X., Qiang, H., Zhang, X., Guo, J., Zhai, G., Wang, S., Zhou, Y., Lü, L., Li, J., et al. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00128 · Cited by 26
Self-citationInie, N., Falk, J., & Selvan, R. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714227 · Cited by 35
Singh, S., & Dhumane, A. (2025) · MethodsX · doi:10.1016/j.mex.2025.103632 · Cited by 24
TellMeTalk: Multimodal-driven talking face video generation
Li, P., Zhao, H., Liu, Q., Tang, P., & Zhang, L. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2023.109049 · Cited by 22
Human Motion Video Generation: A Survey
Xue, H., Luo, X., Hu, Z., Zhang, X., Xiang, X., Dai, Y., Liu, J., Zhang, Z., Li, M., Yang, J. J., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3594034 · Cited by 29
Niu, M., Cun, X., Wang, X., Zhang, Y., Shan, Y., & Zheng, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72655-2_7 · Cited by 21
Self-citationMODA: Mapping-Once Audio-driven Portrait Animation with Dual Attentions
Liu, Y., Lin, L., Yu, F., Zhou, C., & Li, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02104 · Cited by 20
AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding
Liu, T., Chen, F., Fan, S., Du, C., Chen, Q., Chen, X., & Yu, K. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681198 · Cited by 21
Deepfakes in digital media forensics: Generation, AI-based detection and challenges
Bendiab, G., Haiouni, H., Moulas, I., & Shiaeles, S. N. (2024) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2024.103935 · Cited by 24
TalkCLIP: Talking Head Generation with Text-Guided Expressive Speaking Styles
Ma, Y., Wang, S., Ding, Y., Ma, B., Lv, T., Fan, C., Hu, Z., Deng, Z., & Yu, X. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3581808 · Cited by 29
Thqa: A Perceptual Quality Assessment Database for Talking Heads
Zhou, Y., Zhang, Z., Sun, W., Liu, X., Min, X., Wang, Z., Zhang, X.-P. S., & Zhai, G. (2024) · Proceedings - International Conference on Image Processing · doi:10.1109/icip51287.2024.10647507 · Cited by 18
Application of a 3D Talking Head as Part of Telecommunication AR, VR, MR System: Systematic Review
Christoff, N., Neshov, N. N., Tonchev, K., & Manolova, A. H. (2023) · Electronics · doi:10.3390/electronics12234788 · Cited by 21
Audio-Driven Facial Animation with Deep Learning: A Survey
Jiang, D., Chang, J. M., You, L., Bian, S., Kosk, R., & Maguire, G. (2024) · Information · doi:10.3390/info15110675 · Cited by 23
"AI Afterlife" as Digital Legacy: Perceptions, Expectations, and Concerns
Lei, Y., Ma, S., Sun, Y., & Ma, X. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713933 · Cited by 30
ToonTalker: Cross-Domain Face Reenactment
Gong, Y., Zhang, Y., Cun, X., Yin, F., Fan, Y., Wang, X., Wu, B., & Yang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00707 · Cited by 17
Self-citationCVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformer
Ma, H., Zhang, T., Sun, S., Yan, X., Han, K., & Xie, X. S. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00602 · Cited by 17
FaceChain-ImagineID: Freely Crafting High-Fidelity Diverse Talking Faces from Disentangled Audio
Xu, C., Liu, Y., Xing, J., Wang, W., Sun, M., Dan, J., Huang, T., Li, S., Cheng, Z.-Q., Tai, Y. Y., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00129 · Cited by 20
LAM: Large Avatar Model for One-shot Animatable Gaussian Head
He, Y., Gu, X., Ye, X. W., Xu, C., Zhao, Z., Dong, Y., Yuan, W., Dong, Z., & Bo, L. (2025) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3721238.3730706 · Cited by 17
Wav2Lip‐HR: Synthesising clear high‐resolution talking head in the wild
Liang, C., Wang, Q., Chen, Y., & Tang, M. (2023) · Computer Animation and Virtual Worlds · doi:10.1002/cav.2226 · Cited by 16
Wu, S., Haque, K. I., & Yumak, Z. (2024) · Motion in Games · doi:10.1145/3677388.3696320 · Cited by 23
EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation
Meng, R., Zhang, X., Li, Y., & Ma, C. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00516 · Cited by 17
Sonic: Shifting Focus to Global Audio Perception in Portrait Animation
Ji, X., Hu, X., Xu, Z., Zhu, J., Lin, C., He, Q., Zhang, J., Luo, D., Chen, Y., Lin, Q., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00027 · Cited by 21
Stochastic Latent Talking Face Generation Toward Emotional Expressions and Head Poses
Sheng, Z., Nie, L., Zhang, M., Chang, X., & Yan, Y. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3311039 · Cited by 16
CorrTalk: Correlation Between Hierarchical Speech and Facial Activity Variances for 3D Animation
Chu, Z., Guo, K., Xing, X., Lan, Y., Cai, B., & Xu, X. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3386836 · Cited by 13
Increasing Importance of Joint Analysis of Audio and Video in Computer Vision: A Survey
Shahabaz, A., & Sarkar, S. (2024) · IEEE Access · doi:10.1109/access.2024.3391817 · Cited by 13
FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesis
Wang, M., Wang, Q., Jiang, F., Fan, Y., Zhang, Y., Qi, Y., Zhao, K., & Xu, M. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755217 · Cited by 57
Self-citationAdapter-Based Incremental Learning for Face Forgery Detection
Gao, C., Xu, Q., Qiao, P., Xu, K., Qian, X., & Dou, Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446543 · Cited by 12
Tan, S., Ji, B., Ding, Y., & Pan, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28314 · Cited by 12
Lin, J., Chen, E., Gurung, A., & Koedinger, K. R. (2024) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3657604.3664720 · Cited by 14
Driving Animatronic Robot Facial Expression From Speech
Li, B., Li, H., & Liu, H. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801970 · Cited by 12
Han, L., Fang, J., Xie, C., Liao, M., & Zhang, Y. (2025) · Journal of Business Ethics · doi:10.1007/s10551-025-06061-2 · Cited by 14
Self-citationAVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation
Sun, Y., Chu, W., Zhou, H., Wang, K., & Koike, H. (2024) · IEEE Access · doi:10.1109/access.2024.3390182 · Cited by 17
Audio-Semantic Enhanced Pose-Driven Talking Head Generation
Liu, M., Li, D., Li, Y., Song, X., & Nie, L. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3414412 · Cited by 11
Vivid-persona: customizable persona tool with interactive and immersive experiences
Zhou, L., Yan, F., Ding, S., Cheng, Y., Yan, B., Zhu, W., Bao, S., Wang, J., & Song, S. (2024) · Journal of Engineering Design · doi:10.1080/09544828.2024.2383543 · Cited by 13
Faces that Speak: Jointly Synthesising Talking Face and Speech from Text
Jang, Y., Kim, J., Ahn, J., Kwak, D., Yang, H.-S., Ju, Y.-C., Kim, I.-H., Kim, B.-Y., & Chung, J. S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00842 · Cited by 11
EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Head
He, Q., Ji, X., Gong, Y., Lu, Y., Diao, Z., Huang, L., Yao, Y., Zhu, S., Ma, Z., Xu, S., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72998-0_4 · Cited by 11
Learn2Talk: 3D Talking Face Learns From 2D Talking Face
Zhuang, Y., Cheng, B., Cheng, Y., Jin, Y., Liu, R., Li, C., Cheng, X., Liao, J., & Lin, J. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3476275 · Cited by 17
Ensuring privacy in face recognition: a survey on data generation, inference and storage
Sun, Z., & Liu, Z. (2025) · Discover Applied Sciences · doi:10.1007/s42452-025-06987-2 · Cited by 12
Adaptive Super Resolution for One-Shot Talking-Head Generation
Song, L., Liu, P., Yin, G., & Xu, C. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446837 · Cited by 10
3D facial modeling, animation, and rendering for digital humans: A survey
Zhang, Y., Su, R., Yu, J., & Li, R. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128168 · Cited by 13
Self-citationSegTalker: Segmentation-based Talking Face Generation with Mask-guided Local Editing
Xiong, L., Cheng, X., Tan, J., Wu, X., Li, X., Zhu, L., Ma, F., Li, M., Xu, H., & Hu, Z. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681108 · Cited by 10
Beyond Talking – Generating Holistic 3D Human Dyadic Motion for Communication
Sun, M., Xu, C., Jiang, X., Liu, Y., Sun, B., & Huang, R. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02300-7 · Cited by 16
VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior
Sun, X., Zhang, L., Zhu, H., Zhang, P., Zhang, B., Ji, X., Zhou, K., Gao, D., Bo, L., & Cao, X. (2025) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv66043.2025.00071 · Cited by 22
SingingHead: A Large-Scale 4D Dataset for Singing Head Animation
Wu, S., Li, Y., Zhang, W., Jia, J., Zhu, Y., Yan, Y., Zhai, G., & Yang, X. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3623560 · Cited by 10
Self-citationChatASD: LLM-Based AI Therapist for ASD
Ren, X., Bai, Y., Duan, H., Fan, L., Fei, E., Wu, G., RAY, P. K., Hu, M., Yan, C., & Zhai, G. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-3626-3_23 · Cited by 9
InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation
Wang, Y., Guo, J., Bai, J., Yu, R., He, T., Tan, X., Sun, X., & Bian, J. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i8.32877 · Cited by 25
FG-EmoTalk: Talking Head Video Generation with Fine-Grained Controllable Facial Expressions
Sun, Z., Xuan, Y., Liu, F., & Xiang, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28309 · Cited by 10
ARTalk: Speech-Driven 3D Head Animation via Autoregressive Model
Chu, X., Goswami, N., Cui, Z., Wang, H., & Harada, T. (2025) · SIGGRAPH Asia Conference Papers · doi:10.1145/3757377.3763955 · Cited by 8
OSM-Net: One-to-Many One-Shot Talking Head Generation With Spontaneous Head Motions
Liu, J., Wang, X., Fu, X., Chai, Y., Cai, Y., Dai, J., & Han, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3394850 · Cited by 8
Self-citationTALK-Act: Enhance Textural-Awareness for 2D Speaking Avatar Reenactment with Diffusion Model
Guan, J., Yang, Q., Wang, K., Zhou, H., He, S., Xu, Z., Feng, H., Ding, E., Wang, J., Xie, H., et al. (2024) · SIGGRAPH Asia Conference Papers · doi:10.1145/3680528.3687571 · Cited by 14
Multimodal Feature-Guided Audio-Driven Emotional Talking Face Generation
Wang, X., Huo, Y., Liu, Y., Guo, X., Yan, F., & Zhao, G. (2025) · Electronics · doi:10.3390/electronics14132684 · Cited by 8
Self-citationVTutor: An Animated Pedagogical Agent SDK that Provide Real Time Multi-model Feedback
Chen, E., Lin, C.-Y., Huang, Y.-K., Tang, X., Xi, A., Lin, J., & Koedinger, K. R. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-99267-4_19 · Cited by 7
MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animation
Lin, Y., Fung, H., Xu, J., Ren, Z., Lau, A. S. M., Yin, G., & Li, X. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02444 · Cited by 7
Choi, J., Park, S. J., Kim, M., & Ro, Y. M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02580 · Cited by 9
ReSyncer: Rewiring Style-Based Generator for Unified Audio-Visually Synced Facial Performer
Guan, J., Xu, Z., Zhou, H., Wang, K., He, S., Zhang, Z., Liang, B., Feng, H., Ding, E., Liu, J., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72940-9_20 · Cited by 7
HyperLips: hyper control lips with high resolution decoder for talking face generation
Chen, Y., Yao, Y., Li, Z., Wang, W., Zhang, Y., Yang, H. S., & Wen, X. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05914-z · Cited by 9
Self-citationINFP: Audio-Driven Interactive Head Generation in Dyadic Conversations
Zhu, Y., Zhang, L., Rong, Z., Hu, T., Liang, S., & Ge, Z. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00997 · Cited by 10
Haque, K. I., Wu, S., & Yumak, Z. (2025) · Computers & Graphics · doi:10.1016/j.cag.2025.104358 · Cited by 9
Ditto: Motion-Space Diffusion for Controllable Realtime Talking Head Synthesis
Li, T., Zheng, R., Yang, M., Chen, J., & Yang, M. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755075 · Cited by 32
Learning Dynamic Tetrahedra for High-Quality Talking Head Synthesis
Zhang, Z., Zheng, R., Li, B., Han, C., Li, T., Wang, M., Guo, T., Chen, J., Liu, Z., & Yang, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00498 · Cited by 9
VividWav2Lip: High-Fidelity Facial Animation Generation Based on Speech-Driven Lip Synchronization
Liu, L., Wang, J., Chen, S., & Li, Z. (2024) · Electronics · doi:10.3390/electronics13183657 · Cited by 6
Chen, L., Bao, W., Lei, S., Tang, B., Wu, Z., Kang, S., Huang, H., & Meng, H. M. L. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3535287 · Cited by 12
EmoSpeaker: One-Shot Fine-Grained Emotion-Controlled Talking Face Generation
Feng, G., Cheng, H., Li, Y., Ma, Z., Li, C., Qian, Z., Miao, Q., & Pun, C. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3651074 · Cited by 6
uTalk: Bridging the Gap Between Humans and AI
Azzuni, H., Jamal, S., & Saddik, A. E. (2024) · International Conference on Consumer Electronics · doi:10.1109/icce59016.2024.10444441 · Cited by 6
Huang, Z., Zhou, Z., Cao, J., Ma, Y., Chen, Y., Rao, Z., Xu, Z., Wang, H., Lin, Q., Zhou, Y., et al. (2025) · SIGGRAPH Asia Conference Papers · doi:10.1145/3757377.3763861 · Cited by 7
Ma, Y., Yan, Z., Liu, H., Wang, H., Pan, H., He, Y., Yuan, J., Zeng, A., Cai, C., Shum, H., et al. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02685-z · Cited by 47
Semantic-aware hyper-space deformable neural radiance fields for facial avatar reconstruction
Jin, K., Gu, X., Wang, Z., Kuang, Z., Wu, Z., Tan, M., & Yu, J. (2024) · Pattern Recognition Letters · doi:10.1016/j.patrec.2024.08.004 · Cited by 5
HeadsetOff: Enabling Photorealistic Video Conferencing on Economical VR Headsets
Jin, Y., Duan, X., Wang, F., & Liu, X. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681432 · Cited by 5
Self-citationDEGSTalk: Decomposed Per-Embedding Gaussian Fields for Hair-Preserving Talking Face Synthesis
Deng, Y., Zheng, D., Xie, J., Wang, J., Xie, W., Shen, L., & Song, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890278 · Cited by 5
SemConf: A System for Multiparty Semantic Video Conferencing
Duan, X., Jin, Y., Zhang, L., & Wang, F. (2025) · doi:10.1145/3712678.3721884 · Cited by 5
Self-citationLarge Generative Model-Assisted Talking-Face Semantic Communication System
Jiang, F., Tu, S., Dong, L., Pan, C., Wang, J., & You, X. (2025) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2025.3623167 · Cited by 5
FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Model
Yao, Z., Cheng, X., & Huang, Z. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681238 · Cited by 5
Liu, X., Liu, Z., & Bi, C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889538 · Cited by 5
Metadata
- Authors
- Zhang, W., Cun, X., Wang, X., Zhang, Y., Shen, X., Guo, Y., Shan, Y., & Wang, F.
- Affiliations
- Xi'an Jiaotong University (CN)
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence
- Ant Group (China) (CN)
- Tencent (China) (CN)
- Venue
- 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2023-06
- Pages
- 8652-8661
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4386072021
- Cited by
- 336
- References
- 50
- Citations by year
- 2026: 86 · 2025: 131 · 2024: 105 · 2023: 14
- FWCI
- 35.93
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
- arXiv (Cornell University)
- Funders
- National Key Research and Development Program of China (2022YFB3303800)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- talking head generation, audio-driven face animation, facial expression synthesis, stylized animation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
