The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Text-based editing of talking-head video
Open accessAbstract
Editing talking-head video to change the speech content or to remove filler words is challenging. We propose a novel method to edit talking-head video based on its transcript to produce a realistic output video in which the dialogue of the speaker has been modified, while maintaining a seamless audio-visual flow (i.e. no jump cuts). Our method automatically annotates an input talking-head video with phonemes, visemes, 3D face pose and geometry, reflectance, expression and scene illumination per frame. To edit a video, the user has to only edit the transcript, and an optimization strategy then chooses segments of the input corpus as base material. The annotated parameters corresponding to the selected segments are seamlessly stitched together and used to produce an intermediate video representation in which the lower half of the face is rendered with a parametric face model. Finally, a recurrent video generation network transforms this representation to a photorealistic video that matches the edited transcript. We demonstrate a large variety of edits, such as the addition, removal, and alteration of words, as well as convincing language translation and full sentence synthesis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 20,507
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Binary Codes capable of currecting deletions, insertions, and reversals
Levenshtein, V. I. (1965) · Soviet physics. Doklady · Cited by 10,387
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. R. (1999) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/311535.311556 · Cited by 4,695
Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791
TIMIT Acoustic-Phonetic Continuous Speech Corpus
Garofolo, J. S., Lamel, L. F., Fisher, W. M., Pallett, D. S., Dahlgren, N. L., Zue, V. W., & Fiscus, J. G. (2020) · Americanae (AECID Library) · doi:10.35111/17gk-bn40 · Cited by 2,509
Flagged first, then by citations
Research works printed but not linked: 10
- Chan Caroline, 2018, Efros
- Dou Pengfei, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
- Genova Kyle, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
- Ian J. Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems. Ian J. Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems.
- Karras Tero, 2018, International Conference on Learning Representations (ICLR).
- 10.1145/3197517.3201283 · DOI
- Levenshtein Vladimir I, Soviet physics doklady
- Ochshorn Robert, 2016, Gentle: A Forced Aligner. https://lowerquality.com/gentle/.
- Ting-Chun Wang Ming-Yu Liu Jun-Yan Zhu Andrew Tao Jan Kautz and Bryan Catanzaro. 2018b. High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs. In CVPR. Ting-Chun Wang Ming-Yu Liu Jun-Yan Zhu Andrew Tao Jan Kautz and Bryan Catanzaro. 2018b. High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs. In CVPR.
- Wiles O., European Conference on Computer Vision.
Cited by
Sorted by citations
Items 101–200 of 272
Cross-Domain and Disentangled Face Manipulation With 3D Guidance
Wang, C., Chai, M., He, M., Chen, D., & Liao, J. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3139913 · Cited by 22
Towards Generating Ultra-High Resolution Talking-Face Videos with Lip synchronization
Gupta, A., Mukhopadhyay, R., Balachandra, S., Khan, F. F., Namboodiri, V. P., & Jawahar, C. V. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00518 · Cited by 22
Adversarial Learning of Deepfakes in Accounting
Schreyer, M., Sattarov, T., Reimer, B., & Borth, D. (2019) · Alexandria (UniSG) (University of St.Gallen) · doi:10.48550/arxiv.1910.03810 · Cited by 39
One-Shot Free-View Neural Talking-Head Synthesis for Video ConferencingPreprint
Wang, T.-C., Mallya, A., & Liu, M.-Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.15126 · Cited by 22
Forbidden knowledge in machine learning reflections on the limits of research and publication
Hagendorff, T. (2020) · AI & Society · doi:10.1007/s00146-020-01045-4 · Cited by 25
Speech2Video Synthesis with 3D Skeleton Regularization and Expressive Body Poses
Liao, M., Zhang, S., Wang, P., Zhu, H., Zuo, X., & Yang, R. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69541-5_19 · Cited by 21
Fine-Grained Open-Set Deepfake Detection via Unsupervised Domain Adaptation
Zhou, X., Han, H., Shan, S., & Chen, X. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3435440 · Cited by 22
TACR-Net: Editing on Deep Video and Voice Portraits
Song, L., Liu, B., Yin, G., Dong, X., Zhang, Y., & Bai, J.-X. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475196 · Cited by 20
Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model
Chen, X., Song, X., Jing, L., Li, S., Hu, L., & Nie, L. (2023) · ACM Transactions on Information Systems · doi:10.1145/3606368 · Cited by 21
Deepfakes in digital media forensics: Generation, AI-based detection and challenges
Bendiab, G., Haiouni, H., Moulas, I., & Shiaeles, S. N. (2024) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2024.103935 · Cited by 24
Ng, Y.-L. (2023) · Current Psychology · doi:10.1007/s12144-022-03621-x · Cited by 19
Predicting Personalized Head Movement From Short Video and Speech Signal
Yi, R., Ye, Z., Sun, Z., Zhang, J., Zhang, G., Wan, P., Bao, H., & Liu, Y. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3207606 · Cited by 19
Capsule-Forensics Networks for Deepfake Detection
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2022) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-030-87664-7_13 · Cited by 21
Synthesis-Assisted Video Prototyping From a Document
Chi, P., Dong, T., Frueh, C., Colonna, B., Kwatra, V., & Essa, I. A. (2022) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3526113.3545676 · Cited by 18
Zubair, T., Raquib, A., & Qadir, J. (2019) · ICR Journal · doi:10.52282/icr.v10i2.42 · Cited by 25
Learning to Cut by Watching Movies
Pardo, A., Heilbron, F. C., Alcázar, J. L., Thabet, A., & Ghanem, B. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00678 · Cited by 19
Generation of virtual digital human for customer service industry
Sun, Y., Sun, Z., Wen, Y., Ye, S., Lv, T., Yu, M., Yi, R., Gao, L., & Liu, Y. (2023) · Computers & Graphics · doi:10.1016/j.cag.2023.07.018 · Cited by 18
Application of a 3D Talking Head as Part of Telecommunication AR, VR, MR System: Systematic Review
Christoff, N., Neshov, N. N., Tonchev, K., & Manolova, A. H. (2023) · Electronics · doi:10.3390/electronics12234788 · Cited by 21
Creative AI: From Expressive Mimicry to Critical Inquiry
Forbes, A. G. (2020) · Artnodes · doi:10.7238/a.v0i26.3370 · Cited by 24
Deepfake: An Endanger to Cyber Security
Sudhakar, K. V. S., & Shanthi, M. (2023) · International Conference on Sustainable Computing and Smart Systems (ICSCSS) · doi:10.1109/icscss57650.2023.10169246 · Cited by 16
CA-Wav2Lip: Coordinate Attention-based Speech To Lip Synthesis In The Wild
Wang, K.-C., Zhang, J., Huang, J., Li, Q. L., Sun, M.-T., Sakai, K., & Ku, W. (2023) · IEEE International Conference on Smart Computing · doi:10.1109/smartcomp58114.2023.00018 · Cited by 16
MusicFace: Music-driven expressive singing face synthesis
Liu, P., Deng, W., Li, H., Wang, J., Zheng, Y., Ding, Y., Gu, X. D., & Zeng, M. (2023) · Computational Visual Media · doi:10.1007/s41095-023-0343-7 · Cited by 16
StyleTalk++: A Unified Framework for Controlling the Speaking Styles of Talking Heads
Wang, S., Ma, Y., Ding, Y., Hu, Z., Fan, C., Lv, T., Deng, Z., & Yu, X. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3357808 · Cited by 16
Elgharib, M. A., Mendiratta, M., Thies, J., Nießner, M., Seidel, H., Tewari, A., Golyanik, V., & Theobalt, C. (2020) · ACM Transactions on Graphics · doi:10.1145/3414685.3417808 · Cited by 16
Self-citationWrite‐An‐Animation: High‐level Text‐based Animation Editing with Character‐Scene Interaction
Zhang, J., Xu, X., Shen, Z., Huang, Z., Zhao, Y., Cao, Y., Wan, P., & Wang, M. (2021) · Computer Graphics Forum · doi:10.1111/cgf.14415 · Cited by 15
Generating Talking Face With Controllable Eye Movements by Disentangled Blinking Feature
Liu, S., & Hao, J. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3199412 · Cited by 16
StyleIPSB: Identity-Preserving Semantic Basis of StyleGAN for High Fidelity Face Swapping
Jiang, D., Song, D., Tong, R., & Tang, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00042 · Cited by 15
Countering the complex, multifaceted nature of nude and sexually explicit deepfakes: an Augean task?
Maras, M., & Logie, K. (2024) · Crime Science · doi:10.1186/s40163-024-00226-6 · Cited by 18
AI-Driven Text-to-Multimedia Content Generation: Enhancing Modern Content Creation
Jadhav, D., Agrawal, S., Jagdale, S., Salunkhe, P., & Salunkhe, R. (2024) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac61858.2024.10714771 · Cited by 18
StableFace: Analyzing and Improving Motion Stability for Talking Face Generation
Ling, J., Tan, X., Chen, L., Li, R., Zhang, Y., Zhao, S., & Song, L. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3333552 · Cited by 19
Large-scale multilingual audio visual dubbingPreprint
Yang, Y., Shillingford, B., Assael, Y., Wang, M., Liu, W., Chen, Y., Zhang, Y., Sezener, E., Cobo, L. C., Denil, M., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.03530 · Cited by 18
VideoDiff: Human-AI Video Co-Creation with Alternatives
Huh, M., Li, D., Pimmel, K., Shin, H. V., Pavel, A., & Dontcheva, M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713417 · Cited by 15
Record Once, Post Everywhere: Automatic Shortening of Audio Stories for Social Media
Wang, B. K., Jin, Z., & Mysore, G. J. (2022) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3526113.3545680 · Cited by 18
Self-citationReactFace: Online Multiple Appropriate Facial Reaction Generation in Dyadic Interactions
Luo, C. X., Song, S., Xie, W., Spitale, M., Ge, Z., Shen, L., & Güneş, H. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3490613 · Cited by 34
More than Words: In-the-Wild Visually-Driven Prosody for Text-to-Speech
Hassid, M., Ramanovich, M. T., Shillingford, B., Wang, M., Ye, J., & Remez, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01033 · Cited by 13
Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesis
Song, L., Wu, W., Fu, C., Loy, C. C., & He, R. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3210002 · Cited by 14
M3L: Language-based Video Editing via Multi-Modal Multi-Level Transformers
Fu, T.-J., Wang, X. E., Grafton, S. T., Eckstein, M. P., & Wang, W. Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01026 · Cited by 13
Few-shot forgery detection via Guided Adversarial Interpolation
Qiu, H., Chen, S., Gan, B., Wang, K., Shi, H., Shao, J., & Liu, Z. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109863 · Cited by 13
Yu, C.-M., Chang, C.-T., & Ti, Y.-W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.12184 · Cited by 21
A Survey on Face‐Swapping Methods for Identity Manipulation in Deepfake Applications
Dhanyalakshmi, R., Stoian, G., Dănciulescu, D., & Hemanth, D. J. (2025) · IET Image Processing · doi:10.1049/ipr2.70132 · Cited by 12
Lotus: Creating Short Videos From Long Videos With Abstractive and Extractive Summarization
Barua, A., Benharrak, K., Chen, M., Huh, M., & Pavel, A. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712090 · Cited by 24
One-shot motion talking head generation with audio-driven model
Tang, P., Zhao, H., Meng, W., & Wang, Y. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129344 · Cited by 12
An Overview of Deepfake: The Sword of Damocles in AI
Tong, X., Wang, L., Pan, X., & Wang, J. G. (2020) · 2020 International Conference on Computer Vision, Image and Deep Learning (CVIDL) · doi:10.1109/cvidl51233.2020.00-88 · Cited by 12
AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head SynthesisPreprint
Guo, Y., Chen, K., Liang, S., Liu, Y., Bao, H., & Zhang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11078 · Cited by 12
Visual dubbing pipeline with localized lip-sync and two-pass identity transfer
Patel, D., Zouaghi, H., Mudur, S. P., Paquette, E., Laforest, S., Rouillard, M., & Popa, T. (2022) · Computers & Graphics · doi:10.1016/j.cag.2022.11.005 · Cited by 11
Multilingual video dubbing—a technology review and current challenges
Bigioi, D., & Corcoran, P. (2023) · Frontiers in Signal Processing · doi:10.3389/frsip.2023.1230755 · Cited by 20
Faces that Speak: Jointly Synthesising Talking Face and Speech from Text
Jang, Y., Kim, J., Ahn, J., Kwak, D., Yang, H.-S., Ju, Y.-C., Kim, I.-H., Kim, B.-Y., & Chung, J. S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00842 · Cited by 11
A Survey of Audio Synthesis and Lip-syncing for Synthetic Video Generation
Kadam, A., Rane, S., Mishra, A., Sahu, S., Singh, S. K., & Pathak, S. (2021) · EAI Endorsed Transactions on Creative Technologies · doi:10.4108/eai.14-4-2021.169187 · Cited by 11
Context-Aware Talking-Head Video Editing
Yang, S., Wang, W., Ling, J., Peng, B., Tan, X., & Dong, J. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611765 · Cited by 11
MFR-Net: Multi-faceted Responsive Listening Head Generation via Denoising Diffusion Model
Liu, J., Wang, X., Fu, X., Chai, Y., Cai, Y., Dai, J., & Han, J. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612123 · Cited by 16
FaceCLIP: Facial Image-to-Video Translation via a Brief Text Description
Guo, J., Manukyan, H., Yang, C., Wang, C., Khachatryan, L., Navasardyan, S., Song, S., Shi, H., & Huang, G. M. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3330920 · Cited by 11
Energy-efficient data collection in UAV-assisted semantic awareness IoT network
Xie, P., Sun, H., Li, F., Gao, X., Xing, L., & Ma, H. (2024) · Internet of Things · doi:10.1016/j.iot.2024.101262 · Cited by 10
3D facial modeling, animation, and rendering for digital humans: A survey
Zhang, Y., Su, R., Yu, J., & Li, R. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128168 · Cited by 13
InvertAvatar: Incremental GAN Inversion for Generalized Head Avatars
Zhao, X., Sun, J., Wang, L., Suo, J., & Liu, Y. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657478 · Cited by 10
Unsupervised learning of style-aware facial animation from real acting performances
Paier, W., Hilsmann, A., & Eisert, P. (2023) · Graphical Models · doi:10.1016/j.gmod.2023.101199 · Cited by 10
Whodunit: Detection and Attribution of Synthetic Images by Leveraging Model-specific Fingerprints
Wißmann, A., Zeiler, S., Nickel, R. M., & Kolossa, D. (2024) · ACM International Workshop on Multimedia AI against Disinformation (MAD) · doi:10.1145/3643491.3660280 · Cited by 10
Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation ApproachPreprint
Liu, Y., Nadai, M. D., Cai, D., Li, H., Alameda-Pineda, X., Sebe, N., & Lepri, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.04200 · Cited by 9
Unsupervised Audiovisual Synthesis via Exemplar AutoencodersPreprint
Deng, K., Bansal, A., & Ramanan, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04463 · Cited by 12
VR+HD: Video Semantic Reconstruction From Spatio-Temporal Scene Graphs
Li, C., Duan, Y., Du, Q., Sun, S., Deng, X., & Tao, X. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3323654 · Cited by 8
Generating dynamic lip-syncing using target audio in a multimedia environment
Pawar, D., Borde, P. L., & Yannawar, P. L. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100084 · Cited by 8
VideoMap: Supporting Video Exploration, Brainstorming, and Prototyping in the Latent Space
Lin, D. C.-E., Heilbron, F. C., Lee, J., Wang, O., & Martelaro, N. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656192 · Cited by 8
A new face image manipulation reveal scheme based on face detection and image watermarking
Salih, Z. A., Thabit, R., Zidan, K. A., & Khoo, B. E. (2022) · IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET) · doi:10.1109/iicaiet55139.2022.9936838 · Cited by 10
OSM-Net: One-to-Many One-Shot Talking Head Generation With Spontaneous Head Motions
Liu, J., Wang, X., Fu, X., Chai, Y., Cai, Y., Dai, J., & Han, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3394850 · Cited by 8
DIM: Dyadic Interaction Modeling for Social Behavior Generation
Tran, M., Chang, D., Siniukov, M., & Soleymani, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72913-3_27 · Cited by 8
Deepfake videos: synthesis and detection techniques – a survey
Saif, S., & Tehsin, S. (2021) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-210625 · Cited by 9
Robust Deepfake on Unrestricted Media: Generation and Detection
Le, T.-N., Nguyen, H. H., Yamagishi, J., & Echizen, I. (2022) · Studies in autonomic, data-driven and industrial computing · doi:10.1007/978-981-19-1524-6_4 · Cited by 14
Generalizing Interactive Backpropagating Refinement for Dense Prediction Networks
Lin, F., Price, B. L., & Martinez, T. R. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00085 · Cited by 8
Match Cutting: Finding Cuts with Smooth Visual Transitions
Chen, B., Ziai, A., Tucker, R. S., & Xie, Y. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00215 · Cited by 13
Expressive Talking Head Video Encoding in StyleGAN2 Latent Space
Oorloff, T., & Yacoob, Y. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00322 · Cited by 8
Intuitive Facial Animation Editing Based On A Generative RNN Framework
Berson, E., Soladié, C., & Stoiber, N. (2020) · Computer Graphics Forum · doi:10.1111/cgf.14117 · Cited by 8
Revisiting face forgery detection towards generalization
Peng, C., Chen, T., Liu, D., Guo, H., Wang, N., & Gao, X. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107310 · Cited by 7
Su, P.-C., Huang, B.-H., & Kuo, T.-Y. (2024) · Electronics · doi:10.3390/electronics13040804 · Cited by 8
Parallel and High-Fidelity Text-to-Lip Generation
Liu, J., Zhu, Z., Ren, Y., Huang, W., Huai, B., Yuan, N. J., & Zhao, Z. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20066 · Cited by 7
A Comparative Analysis of Deep Fake Techniques
Chaudhary, S., Saifi, R., Chauhan, N., & Agarwal, R. (2021) · International Conference on Advances in Computing, Communication Control and Networking (ICAC3N) · doi:10.1109/icac3n53548.2021.9725392 · Cited by 8
Rescribe: Authoring and Automatically Editing Audio DescriptionsPreprint
Pavel, A., Reyes, G., & Bigham, J. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03667 · Cited by 7
Understanding the Landscape of Online Deception
Hage, H., Aïmeur, E., & Guedidi, A. (2020) · Advances in Media, Entertainment, and the Arts · doi:10.4018/978-1-7998-2543-2.ch014 · Cited by 7
IIN-FFD: Intra-Inter Network for Face Forgery Detection
Zhou, Q., Zhou, Z., Bao, Z., Niu, W., & Liu, Y. (2024) · Tsinghua Science & Technology · doi:10.26599/tst.2024.9010022 · Cited by 7
A Survey of Artificial Intelligence Techniques on MOOC of Legal Education
Weng, Y., Liang, X., Duan, H., Gu, S., Wang, N., & Wang, Z. (2020) · Communications in computer and information science · doi:10.1007/978-981-15-5390-5_3 · Cited by 6
Talking Faces: Audio-to-Video Face Generation
Wang, Y., Song, L., Wu, W., Qian, C., He, R., & Loy, C. C. (2022) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-030-87664-7_8 · Cited by 6
Automated Dubbing and Facial Synchronization using Deep Learning
Bazaz, S. A., Subhani, A., & Hadi, S. Z. A. (2022) · doi:10.1109/icai55435.2022.9773697 · Cited by 6
ReenactArtFace: Artistic Face Image Reenactment
Qu, L., Shang, J., Han, X., & Fu, H. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3253184 · Cited by 6
Data-Driven Advancements in Lip Motion Analysis: A Review
Torrie, S. A., Sumsion, A. W., Lee, D.-J., & Sun, Z. (2023) · Electronics · doi:10.3390/electronics12224698 · Cited by 6
FlexLip: A Controllable Text-to-Lip System
Oneaţă, D., Lőrincz, B., Stan, A., & Cucu, H. (2022) · Sensors · doi:10.3390/s22114104 · Cited by 5
A Neural Lip-Sync Framework for Synthesizing Photorealistic Virtual News Anchors
Zheng, R., Zhou, Z., Song, B., & Ji, C. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412187 · Cited by 7
Human Centered Computing in Digital Persona Generation
Ramachandra, N. U., Ahuja, M., Rao, R. M., & Dubash, N. (2021) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-82565-2_32 · Cited by 5
Ownership and Creativity in Generative ModelsPreprint
Avrahami, O., & Tamir, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.01516 · Cited by 8
A survey on deep learning based reenactment methods for deepfake applications
Dhanyalakshmi, R., Popirlan, C. I., & Hemanth, D. J. (2024) · IET Image Processing · doi:10.1049/ipr2.13201 · Cited by 7
Ma, Y., Yan, Z., Liu, H., Wang, H., Pan, H., He, Y., Yuan, J., Zeng, A., Cai, C., Shum, H., et al. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02685-z · Cited by 47
NPVForensics: Learning VA correlations in non-critical phoneme–viseme regions for deepfake detection
Chen, Y., Yu, Y., Ni, R., Li, H., Wang, W., & Zhao, Y. (2025) · Image and Vision Computing · doi:10.1016/j.imavis.2025.105461 · Cited by 8
Frequency forensics for deep fake face detection using dual residual networks
Sharafudeen, M., & S, V. C. S. (2025) · Multimedia Tools and Applications · doi:10.1007/s11042-025-20897-w · Cited by 5
A review of generative models for virtual human motion driving
Wang, P., Peng, H., Mao, S., Wang, S., & Tang, J. (2025) · Science China Information Sciences · doi:10.1007/s11432-023-4284-x · Cited by 4
RetrieverTTS: Modeling Decomposed Factors for Text-Based Speech Insertion
Yin, D., Tang, C., Liu, Y., Wang, X., Zhao, Z., Zhao, Y., Xiong, Z., Zhao, S., & Luo, C. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-245 · Cited by 9
Virtual Human Talking-Head Generation
Song, W., He, Q., & Chen, G. (2023) · Asia Conference on Algorithms, Computing and Machine Learning (CACML) · doi:10.1145/3590003.3590004 · Cited by 4
Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration
Tang, C., Luo, C., Zhao, Z., Yin, D., Zhao, Y., & Zeng, W. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-189 · Cited by 4
Chen, Y., & Xiong, S. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113193 · Cited by 3
Review of Recent Trends in Face Image Authentication (FIA) Techniques and Their Limitations
Jawad, A. H., Thabit, R., & Zidan, K. A. (2024) · Al-Iraqia Journal of Scientific Engineering Research · doi:10.58564/ijser.3.3.2024.236 · Cited by 2
Sun, Y. G., Zheng, J. P., Lyn, L., Zhao, H., Li, J., Tan, Y., Liu, X., & Li, Y. (2023) · Electronics · doi:10.3390/electronics12112353 · Cited by 3
Pengembangan Media Pembelajaran Talking Head Video Beranimasi
Hidayat, M. F., & Syofyan, R. (2023) · Jurnal Ecogen · doi:10.24036/jmpe.v6i2.14699 · Cited by 3
SIDGAN: High-Resolution Dubbed Video Generation via Shift-Invariant Learning
Muaz, U., Jang, W., Tripathi, R., Mani, S., Ouyang, W., Gadde, R. T., Geçer, B., Elizondo, S., Madad, R., & Nair, N. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00720 · Cited by 3
Audio-to-Deep-Lip: Speaking lip synthesis based on 3D landmarks
Fang, H., Weng, D., Tian, Z., Yin, M., & Lu, X. (2024) · Computers & Graphics · doi:10.1016/j.cag.2024.103925 · Cited by 3
Metadata
- Authors
- Fried, O., Tewari, A., Zollhöfer, M., Finkelstein, A., Shechtman, E., Goldman, D. B., Genova, K., Jin, Z., Theobalt, C., & Agrawala, M.
- Affiliations
- Stanford University (US)
- Max Planck Institute for Informatics (DE)
- Princeton University (US)
- Adobe Systems (United States) (US)
- ORCID
- Venue
- ACM Transactions on Graphics
- Published
- 2019-07-12
- Volume
- 38
- Issue
- 4
- Pages
- 1-14
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2948284812
- Cited by
- 270
- References
- 73
- Citations by year
- 2026: 14 · 2025: 30 · 2024: 36 · 2023: 51 · 2022: 46 · 2021: 47 · 2020: 39 · 2019: 7
- FWCI
- 15.55
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Transactions on Graphics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Adobe Systems
- European Research Council (Consolidator Grant 4DRepLy #770784)
- Princeton University
- Brown Institute for Media Innovation
- National Science Foundation (NSF GRFP #DGE-1656466)
- Office of the Dean for Research, Princeton University
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- speech modification, face geometry, reflectance estimation, facial expression estimation, video generation, speech translation, speech synthesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
