The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Text-based editing of talking-head video
Open accessAbstract
Editing talking-head video to change the speech content or to remove filler words is challenging. We propose a novel method to edit talking-head video based on its transcript to produce a realistic output video in which the dialogue of the speaker has been modified, while maintaining a seamless audio-visual flow (i.e. no jump cuts). Our method automatically annotates an input talking-head video with phonemes, visemes, 3D face pose and geometry, reflectance, expression and scene illumination per frame. To edit a video, the user has to only edit the transcript, and an optimization strategy then chooses segments of the input corpus as base material. The annotated parameters corresponding to the selected segments are seamlessly stitched together and used to produce an intermediate video representation in which the lower half of the face is rendered with a parametric face model. Finally, a recurrent video generation network transforms this representation to a photorealistic video that matches the edited transcript. We demonstrate a large variety of edits, such as the addition, removal, and alteration of words, as well as convincing language translation and full sentence synthesis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 20,507
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Binary Codes capable of currecting deletions, insertions, and reversals
Levenshtein, V. I. (1965) · Soviet physics. Doklady · Cited by 10,387
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. R. (1999) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/311535.311556 · Cited by 4,695
Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791
TIMIT Acoustic-Phonetic Continuous Speech Corpus
Garofolo, J. S., Lamel, L. F., Fisher, W. M., Pallett, D. S., Dahlgren, N. L., Zue, V. W., & Fiscus, J. G. (2020) · Americanae (AECID Library) · doi:10.35111/17gk-bn40 · Cited by 2,509
Research works printed but not linked: 10
- Chan Caroline, 2018, Efros
- Dou Pengfei, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
- Genova Kyle, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
- Ian J. Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems. Ian J. Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems.
- Karras Tero, 2018, International Conference on Learning Representations (ICLR).
- 10.1145/3197517.3201283 · DOI
- Levenshtein Vladimir I, Soviet physics doklady
- Ochshorn Robert, 2016, Gentle: A Forced Aligner. https://lowerquality.com/gentle/.
- Ting-Chun Wang Ming-Yu Liu Jun-Yan Zhu Andrew Tao Jan Kautz and Bryan Catanzaro. 2018b. High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs. In CVPR. Ting-Chun Wang Ming-Yu Liu Jun-Yan Zhu Andrew Tao Jan Kautz and Bryan Catanzaro. 2018b. High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs. In CVPR.
- Wiles O., European Conference on Computer Vision.
Cited by
Sorted by citations
Items 201–272 of 272
Nußbaumer, D., Mair, B., Schön, S., Edelsbrunner, S., & Ebner, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-61672-3_15 · Cited by 3
Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale
Agarwal, A., Sen, B., Mukhopadhyay, R., Namboodiri, V. P., & Jawahar, C. V. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00225 · Cited by 3
Huang, H., Wu, Z., Kang, S., Dai, D., Jia, J., Fu, T., Tuo, D., Lei, G., Liu, P., Su, D., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.11610 · Cited by 3
Automatic Non-Linear Video Editing TransferPreprint
Frey, N., Chi, P., Yang, W., & Essa, I. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.06988 · Cited by 3
TH-Mamba: Spatial-Temporal Correlation Learning for Mamba-Based Talking Head Generation
Xu, X., Yu, Z., Jiang, K., Feng, X., & Lin, C. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3596747 · Cited by 2
AI killed the Video Star. Audio-Driven Diffusion Model for Expressive Talking Head Generation
Chopin, B., Dhamija, T., Balaji, P., Wang, Y., & Dantcheva, A. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02766-7 · Cited by 2
A Review on Talk-able Facial Construction
Dubey, R., & Doshi, N. (2023) · IEEE International Conference for Convergence in Technology (I2CT) · doi:10.1109/i2ct57861.2023.10126149 · Cited by 2
MIM-ViT: Deepfake Detection Using Masked Image Modelling and Vision Transformer
Kavthekar, S., Vaidya, S., Pujari, V., & Mane, S. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-3180-0_1 · Cited by 2
Li, Z., Teng, Z., Zhang, B., & Jianping Fan, B. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680737 · Cited by 2
AMIS: An Audiovisual Dataset for Multimodal XR Research
Bhattacharya, A., Cardoso, L. F. D. S., Schleising, A., Rendle, G., Kreskowski, A., Immohr, F., Rao, R. R. R., Broll, W., & Raake, A. (2025) · ACM Multimedia Systems Conference (MMSys) · doi:10.1145/3712676.3718344 · Cited by 2
Xu, H., Jin, S., Wang, Z., Ba, Z., & Wei, T. (2025) · Chinese Journal of Electronics · doi:10.23919/cje.2024.00.095 · Cited by 4
Intelligent tools for creative graphics
Shamir, A., Mitra, N. J., Umetani, N., & Koyama, Y. (2020) · ACM SIGGRAPH Courses · doi:10.1145/3388769.3407498 · Cited by 2
LIFI: Towards Linguistically Informed Frame Interpolation
Mathur, A. N., Batra, D., Kumar, Y., Shah, R. R., Chen, C., & Zimmermann, R. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413998 · Cited by 1
Towards a Typology of Intentionally Inaccurate Representations of Reality in Media Content
Davis, M. J., & Fors, P. (2020) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-62803-1_23 · Cited by 2
F2RPC: Fake to Real Portrait Control From a Virtual Character
Kang, S., Kim, M., & Shim, H. (2023) · IEEE Access · doi:10.1109/access.2023.3306836 · Cited by 2
Language-focused Deepfake Detection Using Phonemes, Mouth Movements, and Video Features
Krause, J., Inácio, A. D. S., & Lopes, H. S. (2023) · IEEE Latin American Conference on Computational Intelligence (LA-CCI) · doi:10.1109/la-cci58595.2023.10409327 · Cited by 2
Cospeech body motion generation using a transformer
Lu, Z., He, Z., Hong, J., & Ping, G. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05769-4 · Cited by 1
Media Forensics and Deepfake-Systematic Survey
Nadeem Jabbar, C. H., Saghir, A., Meer, A. A., Sahi, S., Hassan, B., & Yasir, S. M. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-77617-5_24 · Cited by 6
Benharrak, K., Peng, P., & Pavel, A. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747795 · Cited by 3
A Survey of Talking Head Synthesis Techniques: Portrait Generation, Driving Mechanisms, and Editing
Meng, M., Zhao, Y., Zhang, B., Zhu, Y., Shi, W., Wen, Z., & Fan, Z. (2025) · ACM Computing Surveys · doi:10.1145/3785656 · Cited by 8
A Large-scale Universal Evaluation Benchmark For Face Forgery Detection
Lou, H., Feng, Z., Geng, J., Liu, E., Cheng, L., Lei, J., Song, J., Song, M., & 贝毅君 (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3758194 · Cited by 1
Hybrid CNN-LSTM Architecture for Accurate Deepfake Video Detection
Rahul Sri, S., Rohan Ubendra, M., Saran, S., Nithya, S., Malleswari, M., & Manigandan, S. K. (2026) · International Conference on Inventive Research in Computing Applications (ICIRCA) · doi:10.1109/icirca69024.2026.11570604 · Cited by 1
Extreme-scale Talking-Face Video Upsampling with Audio-Visual Priors
Hegde, S. B., Mukhopadhyay, R., Namboodiri, V. P., & Jawahar, C. V. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548080 · Cited by 1
An Improved Seq-Deepfake Detection Method
Deng, Z., You, K., Yang, R., Hu, X., & Chen, Y. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-0903-8_21 · Cited by 1
Understanding the Landscape of Online Deception
Hage, H., Aı̈meur, E., & Guedidi, A. (2020) · IGI Global eBooks · doi:10.4018/978-1-7998-7291-7.ch003 · Cited by 2
Goyal, S., Uppal, S., Bhagat, S., Goel, D., Mali, S., Yu, Y., Yin, Y., & Shah, R. R. (2022) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3551626.3564976 · Cited by 1
Video Exploration via Video-Specific Autoencoders.Preprint
Wang, K., Ramanan, D., & Bansal, A. (2021) · arXiv (Cornell University) · Cited by 1
Review Paper on “Real time Speech-Driven Facial Animation Using GANs”
Kshirsagar, M., Hoite, B. B., Sonawane, P., & Malpure, P. (2021) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-989
Instrumeteor: Authoring tool for Guitar Performance Video
Atarashi, Y. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451521
High-Speed and High-Quality Text-to-Lip Generation.Preprint
Liu, J., Zhu, Z., Ren, Y., & Zhao, Z. (2021) · arXiv (Cornell University)
Fake image and video detection using capsule network
Smitha, P. B., Naik, V. S., Deepika, R., Chaithra, K. N., & Kumar, B. G. S. (2021)
Automatic Wave To Lip Syncing And Voice Dubbing Using Machine Learning
Vignesh, C. R. R. (2021) · i-manager’s Journal on Pattern Recognition · doi:10.26634/jpr.8.1.18157
Enhancement of Input Error Correction Using Efficient Search in Voice User Interface (Vui)Preprint
Sarwar, N., Arif, B., Azam, M., Ahmad, N., & Sabah, F. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4181214
Scaling Neural Face Synthesis to High FPS and Low Latency by Neural Caching
Yu, F., Fels, S., & Rhodin, H. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00347
Free-View Expressive Talking Head Video Editing
Huang, Y., Iizuka, S., & Fukui, K. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095745
Audio-Driven High Definetion and Lip-Synchronized Talking Face Generation Based on Face Reenactment
Wang, X., Zhang, Y., He, W., Wang, Y., Li, M., Wang, Y.-C., Zhang, J., Zhou, S., & Zhang, Z. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097270
Speech and Text-Based Motion Generation and Matching System
Shin, J., Park, J., & Kang, S. (2023) · International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC) · doi:10.1109/itc-cscc58803.2023.10212502
A Survey on Talking Head Generation: The Methods, Status and ChallengesPreprint
Cai, Y., Qiao, P., & Li, D. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4576782
ELEGANT: End-to-end Language Grounded Speech Denoiser for Efficient Generation of Talking Face
Chai, A.-F., Rajanala, S., Pal, A., Phan, R. C. ‐., & Ting, C. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317456
Facial Parameter Splicing: A Novel Approach to Efficient Talking Face Generation
Chen, X., Chen, K., Mao, Y., Zhou, L., & You, W. (2023) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3595916.3626364
LingoFusion: An Automatic Video Dubbing Suite using Artificial Intelligence
Panika, L., Gracy, A., Mathur, S., Reddy, S. H., & Sahu, T. (2024) · International Journal of Research Publication and Reviews · doi:10.55248/gengpi.5.0124.0113 · Cited by 1
Semi-supervised Speech-driven 3D Facial Animation via Cross-modal Encoding
Yang, P., Wei, H., Zhong, Y., & Wang, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01923
Langscape - A Dubbing Automation System
(2024) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets53510
Face Reenactment Based on Motion Field Representation
Zheng, S., Chen, J., Yang, Z., Chen, T., & Lu, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-1417-9_33
Controllable Talking Head Synthesis by Equivariant Data Augmentation for Spatial Coordinates
Ding, W., Huang, D., Zheng, Z., Wang, T., Yan, L., Yang, X., & Li, P. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-1151-5_25
DFNeRF: Disentangled Facial Neural Radiance Fields for Text-based Editing of Free-view Talking Head
Chen, B., Li, X., Wang, X., Zhang, Q., & Wang, H. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889463
SmartNet: One-shot Talking Head Synthesis via Subtle Motion and Appearance Compensation
Hu, W., Ji, Y., Zeng, A., Pan, D., Zhang, Y., & Zhang, H. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887604
Multi-Branch Collaborative Learning Network for Video Quality Assessment in Industrial Video Search
Tang, H., Zhang, Z., Li, Z., Zhang, Z., Wu, X., Gao, L. P., Cheng, S., & Yin, D. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3690624.3709408 · Cited by 2
Wang, M., Xia, G., Jin, Z., Yang, P., & Sun, Y. (2025) · Multimedia Systems · doi:10.1007/s00530-025-01779-5
Self-citationRehabilitation training method for motor dysfunction based on video stream matching
Hong, Y. (2025) · Nonlinear Engineering · doi:10.1515/nleng-2024-0082
Ji, Y., Hu, W., Gan, G.-L., Long, Z., Zhang, Y., Zeng, A., & Zhang, H. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3596239
Speech-Driven 3D Facial Animation with Regional Attention for Style Capture
Yang, B. L., Pan, J., Nan, F., & Wu, J. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0100-7_1
Smooth Online Multiple Appropriate Facial Reaction Generation
Xie, W., Yan, C., Song, S., Yu, Z., Shen, L., & Cui, L. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755716
AI System for Arabic Deepfake Detection
Albishri, M., & Asiri, F. (2025) · International Conference on Electrical, Communication, and Computer Engineering (ICECCE) · doi:10.1109/icecce67514.2025.11257960
Audio-Guided Video Scene Editing
Shen, K., Quan, R., Zhu, L., Zheng, D., Xiao, J. H., & Yang, Y. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02640-y · Cited by 6
Lee, S., Park, J., & Kwon, J. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3664208
Spot the Fake: Vision Transformers in the Fight Against DeepFakes
Pandya, K., & DAHIYA, V. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-17837-4_24
Express4D: Expressive, Friendly, and Extensible 4D Facial Motion Generation Benchmark
Aloni, Y., Shalev-Arkushin, R., Shafir, Y., Tevet, G., Fried, O., & Bermano, A. H. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00056 · Cited by 1
Self-citationSuperior and Pragmatic Talking Face Generation with Teacher-Student Framework
Liang, C., Jiang, J., Zhong, T., Lin, G., Rong, Z., Zhu, Y., Yang, J., & Chen, X. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00213
Rewriting Video: Text-Driven Reauthoring of Video Footage
Wang, S., Truong, A., Chilton, L., & Li, D. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789098 · Cited by 1
Text-to-Movie authoring of anatomy lessons
Murukutla, V. A. (2021) · doi:10.70675/9dfce79ez5c15z4e6fzb41dzea5440700a88
Leveraging Neural Networks for 3D Facial Animation Editing
Berson, E. (2021) · theses.fr (ABES) · doi:10.70675/ada96a82zfc55z4ec5z890ezec13d5d5af28
Video Deepfake Detection: Challenges and Recent Trends
Koutlis, C., Pianese, A., Cozzolino, D., Schinas, M., Mylonas, S., Verdoliva, L., & Papadopoulos, S. (2026) · Springer eBooks · doi:10.1007/978-3-032-11782-3_8
Attention to Neural Plagiarism: Diffusion Models Can Plagiarize Your Copyrighted Images!
Zou, Z., Gong, B., & Wang, L. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01817
An Implicit Motion Guided Latent Completion Framework for Audio-Driven Talking Head Synthesis
Li, X. O., Huang, X., & Luo, X. (2026) · Textile & Leather Review · doi:10.31881/tlr.2026.2607
The Role of Presentation Styles in Countering Misinformation on Short Video Platforms CSCW039
Gunasekara, S., Sew, C., Pareek, S., Kelly, R., Kostakos, V., & Gonçalves, J. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3788075
Li, M., Liang, G., Zhao, K., Chen, L., Chen, J., & Liu, J. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134992
CapSmith: Contextual Refinement of Additive Text Captions for Video Storytelling
Hwang, S., Chou, J.-P., & Truong, A. (2026) · Creativity and Cognition · doi:10.1145/3803784.3807559
Co-Edit: Human-AI Collaborative Video Editing With RAG-Based B-Roll Narrative
Wang, S., Qiao, Y., Wang, Z., Xu, M., & Lai, Y. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2695433
Shu, Z., Nose, T., & Ito, A. (2026) · IEEE Access · doi:10.1109/access.2026.3744324
Liu, J., Liu, K., Li, J., Yi, X., & Cao, Y. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11730078
Metadata
- Authors
- Fried, O., Tewari, A., Zollhöfer, M., Finkelstein, A., Shechtman, E., Goldman, D. B., Genova, K., Jin, Z., Theobalt, C., & Agrawala, M.
- Affiliations
- Stanford University (US)
- Max Planck Institute for Informatics (DE)
- Princeton University (US)
- Adobe Systems (United States) (US)
- ORCID
- Venue
- ACM Transactions on Graphics
- Published
- 2019-07-12
- Volume
- 38
- Issue
- 4
- Pages
- 1-14
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2948284812
- Cited by
- 270
- References
- 73
- Citations by year
- 2026: 14 · 2025: 30 · 2024: 36 · 2023: 51 · 2022: 46 · 2021: 47 · 2020: 39 · 2019: 7
- FWCI
- 15.55
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Transactions on Graphics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Adobe Systems
- European Research Council (Consolidator Grant 4DRepLy #770784)
- Princeton University
- Brown Institute for Media Innovation
- National Science Foundation (NSF GRFP #DGE-1656466)
- Office of the Dean for Research, Princeton University
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- speech modification, face geometry, reflectance estimation, facial expression estimation, video generation, speech translation, speech synthesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
