CoChat
Sign Up
PreprintCited by 19Digital Media Forensic DetectionGenerative Adversarial Networks and Image SynthesisFace recognition and analysis

The DOI matches its DataCite record.

Deepfake Generation and Detection: A Benchmark and Survey

Open access
Pei, Gan, Zhang, Jiangning, Hu, Menghan, Zhang, Zhenyu, Wang, Chengjie, Wu, Yunsheng, Zhai, Guangtao, Yang, Jian, Tao, Dacheng·2024·arXiv
DOI 10.48550/arxiv.2403.17881arXiv 2403.17881
Open this paper in CoChat — free accountOpen PDF

Abstract

Deepfake is a technology dedicated to creating highly realistic facial images and videos under specific conditions, which has significant application potential in fields such as entertainment, movie production, digital human creation, to name a few. With the advancements in deep learning, techniques primarily represented by Variational Autoencoders and Generative Adversarial Networks have achieved impressive generation results. More recently, the emergence of diffusion models with powerful generation capabilities has sparked a renewed wave of research. In addition to deepfake generation, corresponding detection technologies continuously evolve to regulate the potential misuse of deepfakes, such as for privacy invasion and phishing attacks. This survey comprehensively reviews the latest developments in deepfake generation and detection, summarizing and analyzing current state-of-the-arts in this rapidly evolving field. We first unify task definitions, comprehensively introduce datasets and metrics, and discuss developing technologies. Then, we discuss the development of several related sub-fields and focus on researching four representative deepfake fields: face swapping, face reenactment, talking face generation, and facial attribute editing, as well as forgery detection. Subsequently, we comprehensively benchmark representative methods on popular datasets for each field, fully evaluating the latest and influential published works. Finally, we analyze challenges and future research directions of the discussed fields.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2403.17881

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Current survey papers provide extensive taxonomies and theoretical discussions but lack empirical evaluations that would enable researchers to understand the relative strengths and limitations of different approaches.

    “While current survey papers [5, 7, 9, 15] provide extensive taxonomies and theoretical discussions, they lack empirical evaluations that would enable researchers to understand the relative strengths and limitations of different approaches.”

    From Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness (2026) · cites this paper as [15]

    The paper provides taxonomies and technical discussion, but it does not lack empirical evaluation. Section 4, “Benchmark Results” (page unavailable), evaluates representative methods on widely used datasets and compares their performance using results from the original papers. (LLM, conf=0.90)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

  • Existing surveys fail to examine how detectors perform when facing new data types, unseen manipulation techniques, or emerging generator architectures.

    “While surveys report impressive within-domain accuracies, they fail to examine how these same detectors perform when facing new data types, unseen manipulation techniques, or emerging generator architectures [5, 7, 9, 15].”

    From Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness (2026) · cites this paper as [15]

    The Introduction says earlier surveys lack discussion of new technologies, especially diffusion-based image and video generation. It does not establish that surveys fail to examine detector performance on new data types or unseen manipulations; indeed, Section 4.3 of this survey reports cross-dataset detector evaluations. The claim is supported only as to the gap concerning emerging generation methods. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

  • Current survey papers primarily focus on reviewing detection methods based on their accuracy performance within the same dataset (within-domain evaluation), which achieves high accuracy often exceeding 95%.

    “Current survey papers [5-9, 15, 15, 16] primarily focus on reviewing detection methods based on their accuracy performance within the same dataset (within-domain evaluation), which achieves high accuracy (often exceeding 95%).”

    From Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness (2026) · cites this paper as [15]

    Section 4.3 and Table 14 report within-dataset FF++ detection accuracy, often above 95% on the HQ test set. But Section 4.3 also reviews cross-dataset results in Table 15, and the paper does not establish that current surveys primarily focus on within-domain accuracy. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

  • However, they may become less effective for DM-based images that can preserve semantic content in images and struggle with low-quality fake images or images applied distortion techniques.

    “However, they may become less effective for DM-based images that can preserve semantic content in images [102] and struggle with low-quality fake images or images applied distortion techniques [156].”

    From Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness (2026) · cites this paper as [156]

    Section 5 (Future Prospects; page unavailable) says detectors targeting features of particular forgery methods have limited generalization as forgery techniques evolve. Section 3.1.4 (Facial Attribute Editing; page unavailable) describes a diffusion-based method that preserves facial identity during editing. The paper does not establish that detectors become less effective specifically for diffusion-model images because they preserve semantic content. The low-quality and distorted-image clause is attributed to [156], not this source. (LLM, conf=0.76)

    Experimental — accuracy not yet measured

  • While existing surveys have extensively reviewed deepfake detection methods from theoretical and architectural perspectives, there remains a critical gap in systematic empirical evaluations of these methods under diverse evaluation protocols.

    “While existing surveys have extensively reviewed deepfake detection methods from theoretical and architectural perspectives [5-7, 15, 15, 25], there remains a critical gap in systematic empirical evaluations of these methods under diverse evaluation protocols.”

    From Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness (2026) · cites this paper as [15]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Still being checked.

Research works printed but not linked: 219

  1. Abdal, R., Lee, H.Y., Zhu, P., Chai, M., Siarohin, A., Wonka, P., Tulyakov, S.: 3davatargan: Bridging domains for personalized editable avatars. In: CVPR (2023) 6, 15
  2. Afouras, T., Chung, J.S., Senior, A., Vinyals, O., Zisser- man, A.: Deep audio-visual speech recognition. TPAMI (2018) 5, 11
  3. Afouras, T., Chung, J.S., Zisserman, A.: Lrs3-ted: a large-scale dataset for visual speech recognition. arXiv (2018) 5
  4. Agarwal, M., Mukhopadhyay, R., Namboodiri, V.P., Jawahar, C.: Audio-visual face reenactment. In: WACV (2023) 17
  5. Agarwal, S., Farid, H.: Detecting deep-fake videos from aural and oral dynamics. In: CVPR (2021) 14
  6. Aneja, S., Thies, J., Dai, A., Nießner, M.: Clipface: Text- guided editing of textured 3d morphable models. In: SIGGRAPH (2023) 12
  7. Ba, Z., Liu, Q., Liu, Z., Wu, S., Lin, F., Lu, L., Ren, K.: Exposing the deception: Uncovering more forgery clues for deepfake detection. In: AAAI (2024) 13, 14
  8. Bao, J., Chen, D., Wen, F., Li, H., Hua, G.: Cvae-gan: fine-grained image generation through asymmetric train- ing. In: ICCV (2017) 4, 8
  9. Bao, J., Chen, D., Wen, F., Li, H., Hua, G.: Towards open-set identity preserving face synthesis. In: CVPR (2018) 7, 8
  10. Barattin, S., Tzelepis, C., Patras, I., Sebe, N.: Attribute- preserving face dataset anonymization via latent code optimization. In: CVPR (2023) 1, 7
  11. Bińkowski, M., Sutherland, D.J., Arbel, M., Gretton, A.: Demystifying mmd gans. In: ICLR (2018) 5, 16
  12. Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P., Nayar, S.K.: Face swapping: automatically replacing faces in photographs. In: SIGGRAPH (2008) 7
  13. Blattmann, A., Dockhorn, T., Kulal, S., Mendelevitch, D., Kilian, M., Lorenz, D., Levi, Y., English, Z., Voleti, V., Letts, A., et al.: Stable video diffusion: Scaling latent video diffusion models to large datasets. arXiv (2023) 1, 2, 4, 9
  14. Bounareli, S., Tzelepis, C., Argyriou, V., Patras, I.: One- shot neural face reenactment via finding directions in gan's latent space. IJCV (2024) 9, 10
  15. Bounareli, S., Tzelepis, C., Argyriou, V., Patras, I., Tz- imiropoulos, G.: Hyperreenact: one-shot reenactment via jointly learning to refine and retarget faces. In: ICCV (2023) 1, 9, 10, 17
  16. Burgos-Artizzu, X.P., Perona, P., Dollár, P.: Robust face landmark estimation under occlusion. In: ICCV (2013) 7
  17. Cai, Q., Ma, M., Wang, C., Li, H.: Image neural style transfer: A review. Computers and Electrical Engineering (2023) 6
  18. Cao, J., Ma, C., Yao, T., Chen, S., Ding, S., Yang, X.: End-to-end reconstruction-classification learning for face forgery detection. In: CVPR (2022) 13, 14, 18
  19. Chai, L., Bau, D., Lim, S.N., Isola, P.: What makes fake images detectable? understanding properties that generalize. In: ECCV (2020) 13
  20. Chan, E.R., Lin, C.Z., Chan, M.A., Nagano, K., Pan, B., De Mello, S., Gallo, O., Guibas, L.J., Tremblay, J., Khamis, S., et al.: Efficient geometry-aware 3d generative adversarial networks. In: CVPR (2022) 11, 15
  21. Chang, H., Lu, J., Yu, F., Finkelstein, A.: Pairedcyclegan: Asymmetric style transfer for applying and removing makeup. In: CVPR (2018) 6, 16
  22. Chaudhuri, B., Vesdapunt, N., Shapiro, L., Wang, B.: Personalized face modeling for improved face reconstruc- tion and motion retargeting. In: ECCV (2020) 6
  23. Chaudhuri, B., Vesdapunt, N., Wang, B.: Joint face detection and facial motion retargeting for multiple faces. In: CVPR (2019) 5
  24. Chen, B., Hu, S., Chen, Q., Du, C., Yi, R., Qian, Y., Chen, X.: Gstalker: Real-time audio-driven talking face generation via deformable gaussian splatting. arXiv (2024) 11
  25. Chen, H.J., Hui, K.M., Wang, S.Y., Tsao, L.W., Shuai, H.H., Cheng, W.H.: Beautyglow: On-demand makeup transfer framework with reversible generative network. In: CVPR (2019) 16
  26. Chen, L., Li, Z., Maddox, R.K., Duan, Z., Xu, C.: Lip movements generation at a glance. In: ECCV (2018) 5, 10, 11, 16
  27. Chen, L., Maddox, R.K., Duan, Z., Xu, C.: Hierarchical cross-modal talking face generation with dynamic pixel- wise loss. In: CVPR (2019) 6, 10, 11, 16
  28. Chen, R., Chen, X., Ni, B., Ge, Y.: Simswap: An efficient framework for high fidelity face swapping. In: ACM MM (2020) 7, 8, 17
  29. Chen, X., Dong, C., Ji, J., Cao, J., Li, X.: Image manip- ulation detection by multi-view multi-scale supervision. In: ICCV (2021) 5
  30. Chen, Z., Lin, J., Zhou, T., Wu, F.: Sequential gating ensemble network for noise robust multiscale face restora- tion. IEEE transactions on cybernetics (2019) 6, 15
  31. Cho, K., Lee, J., Yoon, H., Hong, Y., Ko, J., Ahn, S., Kim, S.: Gaussiantalker: Real-time high-fidelity talking head synthesis with audio-driven 3d gaussian splatting. arXiv (2024) 11
  32. Choi, J., Kim, T., Jeong, Y., Baek, S., Choi, J.: Exploit- ing style latent flows for generalizing deepfake detection video detection. In: CVPR (2024) 13, 14
  33. Cozzolino, D., Pianese, A., Nießner, M., Verdoliva, L.: Audio-visual person-of-interest deepfake detection. In: CVPR (2023) 13
  34. Cui, K., Wu, R., Zhan, F., Lu, S.: Face transformer: Towards high fidelity and accurate face swapping. In: CVPR (2023) 7, 9
  35. Dalva, Y., Altındiş, S.F., Dundar, A.: Vecgan: Image- to-image translation with interpretable latent directions. In: ECCV (2022) 12
  36. Dang, H., Liu, F., Stehouwer, J., Liu, X., Jain, A.K.: On the detection of digital face manipulation. In: CVPR (2020) 14, 15
  37. Deng, J., Guo, J., Xue, N., Zafeiriou, S.: Arcface: Addi- tive angular margin loss for deep face recognition. In: CVPR (2019) 16
  38. Deng, Y., Yang, J., Xu, S., Chen, D., Jia, Y., Tong, X.: Accurate 3d face reconstruction with weakly-supervised learning: From single image to image set. In: CVPR (2019) 16
  39. Ding, Z., Zhang, X., Xia, Z., Jebe, L., Tu, Z., Zhang, X.: Diffusionrig: Learning personalized priors for facial appearance editing. In: CVPR (2023) 12, 13
  40. Dolhansky, B., Bitton, J., Pflaum, B., Lu, J., Howes, R., Wang, M., Ferrer, C.C.: The deepfake detection challenge (dfdc) dataset. arXiv (2020) 5, 18
  41. Dolhansky, B., Howes, R., Pflaum, B., Baram, N., Ferrer, C.C.: The deepfake detection challenge (dfdc) preview dataset. arXiv (2019) 5
  42. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al.: An image is worth 16x16 words: Transformers for image recognition at scale. In: ICLR (2021) 4
  43. Dou, P., Shah, S.K., Kakadiaris, I.A.: End-to-end 3d face reconstruction with deep neural networks. In: CVPR (2017) 6
  44. Doukas, M.C., Ververas, E., Sharmanska, V., Zafeiriou, S.: Free-headgan: Neural talking head synthesis with explicit gaze control. TPAMI (2023) 9, 16, 17
  45. Doukas, M.C., Zafeiriou, S., Sharmanska, V.: Headgan: One-shot neural head synthesis and editing. In: ICCV (2021) 9
  46. Du, C., Chen, Q., He, T., Tan, X., Chen, X., Yu, K., Zhao, S., Bian, J.: Dae-talker: High fidelity speech-driven talking face generation with diffusion autoencoder. In: ACM MM (2023) 11
  47. Fan, B., Wang, L., Soong, F.K., Xie, L.: Photo-real talking head with deep bidirectional lstm. In: ICASSP (2015) 6, 10
  48. Feng, C., Chen, Z., Owens, A.: Self-supervised video forensics by audio-visual anomaly detection. In: CVPR (2023) 13
  49. Feng, J., Singhal, P.: 3d face style transfer with a hybrid solution of nerf and mesh rasterization. In: WACV (2024) 6
  50. Feng, M., Gilani, S.Z., Wang, Y., Mian, A.: 3d face recon- struction from light field images: A model-free approach. In: ECCV (2018) 6
  51. Frank, J., Eisenhofer, T., Schönherr, L., Fischer, A., Kolossa, D., Holz, T.: Leveraging frequency analysis for deep fake image recognition. In: ICML (2020) 14
  52. Fu, H., Wang, Z., Gong, K., Wang, K., Chen, T., Li, H., Zeng, H., Kang, W.: Mimic: Speaking style disentangle- ment for speech-driven 3d facial animation. In: AAAI (2024) 10
  53. Gan, Y., Yang, Z., Yue, X., Sun, L., Yang, Y.: Efficient emotional adaptation for audio-driven talking-head gen- eration. In: ICCV (2023) 10, 11, 18
  54. Gao, G., Huang, H., Fu, C., Li, Z., He, R.: Information bottleneck disentanglement for identity swapping. In: CVPR (2021) 8
  55. Gao, K., Gao, Y., He, H., Lu, D., Xu, L., Li, J.: Nerf: Neu- ral radiance field in 3d vision, a comprehensive review. arXiv (2022) 2, 5
  56. Gao, Y., Wei, F., Bao, J., Gu, S., Chen, D., Wen, F., Lian, Z.: High-fidelity and arbitrary face editing. In: CVPR (2021) 12, 18
  57. Gao, Y., Zhou, Y., Wang, J., Li, X., Ming, X., Lu, Y.: High-fidelity and freely controllable talking head video generation. In: CVPR (2023) 9, 17
  58. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: NeurIPS (2014) 2, 4, 5
  59. Gu, Q., Wang, G., Chiu, M.T., Tai, Y.W., Tang, C.K.: Ladn: Local adversarial disentangling network for facial makeup and de-makeup. In: ICCV (2019) 6, 16
  60. Gu, Z., Chen, Y., Yao, T., Ding, S., Li, J., Ma, L.: Delving into the local: Dynamic inconsistency learning for deepfake video detection. In: AAAI (2022) 13, 14
  61. Guo, D., Sim, T.: Digital face makeup by example. In: CVPR (2009) 15
  62. Guo, X., Liu, X., Ren, Z., Grosz, S., Masi, I., Liu, X.: Hierarchical fine-grained image forgery detection and localization. In: CVPR (2023) 14, 15
  63. Guo, Y., Chen, K., Liang, S., Liu, Y.J., Bao, H., Zhang, J.: Ad-nerf: Audio driven neural radiance fields for talk- ing head synthesis. In: ICCV (2021) 11
  64. Guo, Y., Yang, C., Rao, A., Wang, Y., Qiao, Y., Lin, D., Dai, B.: Animatediff: Animate your personalized text- to-image diffusion models without specific tuning. In: ICLR (2024) 1, 2, 4
  65. Guo, Y., Zhang, L., Hu, Y., He, X., Gao, J.: Ms-celeb-1m: A dataset and benchmark for large-scale face recognition. In: ECCV (2016) 7
  66. Guo, Y., Zhen, C., Yan, P.: Controllable guide-space for generalizable face forgery detection. In: ICCV (2023) 15, 18
  67. Gupta, A., Yu, L., Sohn, K., Gu, X., Hahn, M., Fei-Fei, L., Essa, I., Jiang, L., Lezama, J.: Photorealistic video generation with diffusion models. arXiv (2023) 4
  68. Gururani, S., Mallya, A., Wang, T.C., Valle, R., Liu, M.Y.: Space: Speech-driven portrait animation with con- trollable expression. In: ICCV (2023) 10, 11, 18
  69. Ha, S., Kersner, M., Kim, B., Seo, S., Kim, D.: Mari- onette: Few-shot face reenactment preserving identity of unseen targets. In: AAAI (2020) 9, 16
  70. Haliassos, A., Mira, R., Petridis, S., Pantic, M.: Lever- aging real talking faces via self-supervision for robust forgery detection. In: CVPR (2022) 2, 13, 18
  71. Haliassos, A., Vougioukas, K., Petridis, S., Pantic, M.: Lips don't lie: A generalisable and robust approach to face forgery detection. In: CVPR (2021) 14, 18
  72. Han, S., Lin, C., Shen, C., Wang, Q., Guan, X.: Inter- preting adversarial examples in deep learning: A review. CSUR (2023) 6
  73. Han, Y., Zhang, J., Zhu, J., Li, X., Ge, Y., Li, W., Wang, C., Liu, Y., Liu, X., Tai, Y.: A generalist facex via learning unified facial representation. arXiv (2023) 6, 7, 8
  74. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR (2016) 4
  75. Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., Hochreiter, S.: Gans trained by a two time-scale update rule converge to a local nash equilibrium. In: NeurIPS (2017) 5, 16
  76. Ho, J., Jain, A., Abbeel, P.: Denoising diffusion proba- bilistic models. In: NeurIPS (2020) 2, 4, 5
  77. Hsu, G.S., Tsai, C.H., Wu, H.Y.: Dual-generator face reenactment. In: CVPR (2022) 1, 9, 17
  78. Hu, J., Liao, X., Liang, J., Zhou, W., Qin, Z.: Finfer: Frame inference-based deepfake detection for high-visual- quality videos. In: AAAI (2022) 14, 15 100.
  79. Hu, L., Gao, X., Zhang, P., Sun, K., Zhang, B., Bo, L.: Animate anyone: Consistent and controllable image-to- video synthesis for character animation. arXiv (2023) 15 101. Hu, X., Ma, P., Mai, Z., Peng, S., Yang, Z., Wang, L.: Face hallucination from low quality images using definition-scalable inference. PR (2019) 15 102. Huang, B., Wang, Z., Yang, J., Ai, J., Zou, Q., Wang, Q., Ye, D.: Implicit identity driven deepfake face swapping detection. In: CVPR (2023) 5, 14, 15 103.
  80. Huang, G.B., Mattar, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: A database forstudying face recognition in unconstrained environments. In: Workshop on faces in'Real-Life'Images: detection, alignment, and recognition (2008) 5 104. Huang, H., He, R., Sun, Z., Tan, T.: Wavelet-srnet: A wavelet-based cnn for multi-scale face super resolution. In: ICCV (2017) 6, 15 105.
  81. Huang, Z., Chan, K.C., Jiang, Y., Liu, Z.: Collaborative diffusion for multi-modal face generation and editing. In: CVPR (2023) 12 107. Hur, J., Choi, J., Han, G., Lee, D.J., Kim, J.: Expanding expressiveness of diffusion models with limited data via self-distillation based fine-tuning. In: WACV (2024) 6, 15 108.
  82. Hwang, S., Hyung, J., Kim, D., Kim, M.J., Choo, J.: Faceclipnerf: Text-driven 3d face manipulation using deformable neural radiance fields. In: ICCV (2023) 5 109.
  83. Irshad, M.Z., Zakharov, S., Liu, K., Guizilini, V., Kollar, T., Gaidon, A., Kira, Z., Ambrus, R.: Neo 360: Neural fields for sparse view synthesis of outdoor scenes. In: ICCV (2023) 5 111.
  84. Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to- image translation with conditional adversarial networks. In: ICCV (2017) 4 112. Jain, R., Singh, K.K., Hemani, M., Lu, J., Sarkar, M., Ceylan, D., Krishnamurthy, B.: Vgflow: Visibility guided flow network for human reposing. In: CVPR (2023) 15 113. Ji, X., Zhou, H., Wang, K., Wu, W., Loy, C.C., Cao, X., Xu, F.: Audio-driven emotional video portraits. In: CVPR (2021) 11 114. Jiang, D., Song, D., Tong, R., Tang, M.: Styleipsb: Identity-preserving semantic basis of stylegan for high fidelity face swapping. In: CVPR (2023) 8, 17 115.
  85. Jiang, K., Chen, S.Y., Liu, F.L., Fu, H., Gao, L.: Nerf- faceediting: Disentangled face editing in neural radiance fields. In: SIGGRAPH (2022) 2, 12 116.
  86. Jiang, K., Wang, Z., Yi, P., Wang, G., Gu, K., Jiang, J.: Atmfn: Adaptive-threshold-based multi-model fusion network for compressed face hallucination. TMM (2019) 6 117. Jiang, L., Li, R., Wu, W., Qian, C., Loy, C.C.: Deeperforensics-1.0: A large-scale dataset for real-world face forgery detection. In: CVPR (2020) 5, 18 118.
  87. Jiang, L., Zhang, J., Deng, B., Li, H., Liu, L.: 3d face reconstruction with geometry details from a single image. TIP (2018) 6 119. Jiang, W., Liu, S., Gao, C., Cao, J., He, R., Feng, J., Yan, S.: Psgan: Pose and expression robust spatial-aware gan for customizable makeup transfer. In: CVPR (2020) 6, 16 120.
  88. Jiang, Y., Jiang, L., Yang, S., Loy, C.C.: Scenimefy: Learning to craft anime scene via semi-supervised image- to-image translation. In: ICCV (2023) 6, 15 121.
  89. Jo, Y., Park, J.: Sc-fegan: Face editing generative adver- sarial network with user's sketch and color. In: ICCV (2019) 12 122.
  90. Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: ECCV (2016) 5 123.
  91. Karras, J., Holynski, A., Wang, T.C., Kemelmacher- Shlizerman, I.: Dreampose: Fashion image-to-video syn- thesis via stable diffusion. In: ICCV (2023) 11 124.
  92. Karras, T., Aila, T., Laine, S., Lehtinen, J.: Progres- sive growing of gans for improved quality, stability, and variation. In: ICLR (2018) 5 125.
  93. Karras, T., Laine, S., Aila, T.: A style-based genera- tor architecture for generative adversarial networks. In: CVPR (2019) 1, 2, 4, 5, 12 126.
  94. Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., Aila, T.: Analyzing and improving the image quality of stylegan. In: CVPR (2020) 1, 4 127.
  95. Kellnhofer, P., Recasens, A., Stent, S., Matusik, W., Torralba, A.: Gaze360: Physically unconstrained gaze estimation in the wild. In: ICCV (2019) 9, 17 128.
  96. Kemelmacher-Shlizerman, I., Basri, R.: 3d face recon- struction from a single image using a single reference face shape. TPAMI (2010) 6 129.
  97. Kerbl, B., Kopanas, G., Leimkühler, T., Drettakis, G.: 3d gaussian splatting for real-time radiance field rendering. ACM TOG (2023) 11 130. Khalid, H., Tariq, S., Kim, M., Woo, S.S.: Fakeavceleb: A novel audio-video multimodal deepfake dataset. NeurIPS (2021) 5, 14 131.
  98. Kim, G., Shim, H., Kim, H., Choi, Y., Kim, J., Yang, E.: Diffusion video autoencoders: Toward temporally consis- tent face video editing via disentangled video encoding. In: CVPR (2023) 12, 18 132.
  99. Kim, H., Elgharib, M., Zollhöfer, M., Seidel, H.P., Beeler, T., Richardt, C., Theobalt, C.: Neural style-preserving visual dubbing. ACM TOG (2019) 9 133. Kim, H., Garrido, P., Tewari, A., Xu, W., Thies, J., Niess- ner, M., Pérez, P., Richardt, C., Zollhöfer, M., Theobalt, C.: Deep video portraits. ACM TOG (2018) 9 134. Kim, J., Lee, J., Zhang, B.T.: Smooth-swap: a simple enhancement for face-swapping with smoothness. In: CVPR (2022) 7, 8 135.
  100. Kim, K., Kim, Y., Cho, S., Seo, J., Nam, J., Lee, K., Kim, S., Lee, K.: Diffface: Diffusion-based face swapping with facial guidance. arXiv (2022) 7, 8 136.
  101. Ko, S., Dai, B.R.: Multi-laplacian gan with edge en- hancement for face super resolution. In: ICPR (2021) 6 138. Korshunov, P., Marcel, S.: Deepfakes: a new threat to face recognition? assessment and detection. arXiv (2018) 5, 14 139.
  102. Korshunova, I., Shi, W., Dambre, J., Theis, L.: Fast face-swap using convolutional neural networks. In: ICCV (2017) 9 140.
  103. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NeurIPS (2012) 4, 16 142.
  104. Kwon, P., You, J., Nam, G., Park, S., Chae, G.: Kodf: A large-scale korean deepfake detection dataset. In: ICCV (2021) 5 143. Le, B.M., Woo, S.S.: Quality-agnostic deepfake detection with intra-model collaborative learning. In: ICCV (2023) 5 144. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient- based learning applied to document recognition. Pro- ceedings of the IEEE (1998) 4 145.
  105. Lee, D., Kim, C., Yu, S., Yoo, J., Park, G.M.: Radio: Reference-agnostic dubbing video synthesis. In: WACV (2024) 10, 11 146.
  106. Lei, B., Yu, K., Feng, M., Cui, M., Xie, X.: Diffusion- gan3d: Boosting text-guided 3d generation and domain adaption by combining 3d gans and diffusion priors. arXiv (2023) 15 147. Li, C., Zhou, K., Lin, S.: Simulating makeup through physics-based manipulation of intrinsic image layers. In: CVPR (2015) 15 148. Li, D., Zhao, K., Wang, W., Peng, B., Zhang, Y., Dong, J., Tan, T.: Ae-nerf: Audio enhanced neural radiance field for few shot talking head synthesis. In: AAAI (2024) 11 149. Li, J., Li, Z., Cao, J., Song, X., He, R.: Faceinpainter: High fidelity face adaptation to heterogeneous domains. In: CVPR (2021) 7, 17 150.
  107. Li, J., Xie, H., Li, J., Wang, Z., Zhang, Y.: Frequency- aware discriminative feature learning supervised by single-center loss for face forgery detection. In: CVPR (2021) 2, 14, 18 151.
  108. Li, J., Zhang, J., Bai, X., Zheng, J., Ning, X., Zhou, J., Gu, L.: Talkinggaussian: Structure-persistent 3d talking head synthesis via gaussian splatting. arXiv (2024) 11 152. Li, L., Bao, J., Yang, H., Chen, D., Wen, F.: Faceshifter: Towards high fidelity and occlusion aware face swapping. CVPR (2020) 7, 8, 14, 17 153.
  109. Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., Guo, B.: Face x-ray for more general face forgery detection. In: CVPR (2020) 14, 18 154.
  110. Li, W., Zhang, L., Wang, D., Zhao, B., Wang, Z., Chen, M., Zhang, B., Wang, Z., Bo, L., Li, X.: One-shot high- fidelity talking-head synthesis with deformable neural radiance field. In: CVPR (2023) 9, 10, 16, 17 156.
  111. Li, Y., Ma, C., Yan, Y., Zhu, W., Yang, X.: 3d-aware face swapping. In: CVPR (2023) 7 158. Li, Y., Yang, X., Sun, P., Qi, H., Lyu, S.: Celeb-df: A large-scale challenging dataset for deepfake forensics. In: CVPR (2020) 5, 18 159.
  112. Liang, B., Pan, Y., Guo, Z., Zhou, H., Hong, Z., Han, X., Han, J., Liu, J., Ding, E., Wang, J.: Expressive talking head generation with granular audio-visual control. In: CVPR (2022) 10, 11, 17 160.
  113. Lin, J., Yuan, Y., Shao, T., Zhou, K.: Towards high- fidelity 3d face reconstruction from in-the-wild images using graph convolutional networks. In: CVPR (2020) 6 161. Lin, Y., Wang, S., Lin, Q., Tang, F.: Face swapping under large pose variations: A 3d model based approach. In: ICME (2012) 7 162. Liu, F., Yu, L., Xie, H., Liu, C., Ding, Z., Yang, Q., Zhang, Y.: High fidelity face swapping via semantics disentanglement and structure enhancement. In: ACM MM (2023) 7, 8 163.
  114. Liu, J., Huang, H., Jin, C., He, R.: Portrait diffu- sion: Training-free face stylization with chain-of-painting. arXiv (2023) 6, 15 164.
  115. Liu, J., Wang, Q., Fan, H., Wang, Y., Tang, Y., Qu, L.: Residual denoising diffusion models. In: CVPR (2024) 4 165. Liu, K., Perov, I., Gao, D., Chervoniy, N., Zhou, W., Zhang, W.: Deepfacelab: Integrated, flexible and exten- sible face-swapping framework. PR (2023) 7, 8 166.
  116. Liu, R., Ma, B., Zhang, W., Hu, Z., Fan, C., Lv, T., Ding, Y., Cheng, X.: Towards a simultaneous and granular identity-expression control in personalized face genera- tion. arXiv (2024) 1, 7, 8 167.
  117. Liu, S., Jiang, W., Gao, C., He, R., Feng, J., Li, B., Yan, S.: Psgan++: robust detail-preserving makeup transfer and removal. TPAMI (2021) 6, 16 168.
  118. Liu, Y., Hu, B., Huang, J., Tai, Y.W., Tang, C.K.: In- stance neural radiance field. In: ICCV (2023) 5 169. Liu, Y., Li, Q., Deng, Q., Sun, Z., Yang, M.H.: Gan-based facial attribute manipulation. TPAMI (2023) 2 170. Liu, Z., Hu, H., Lin, Y., Yao, Z., Xie, Z., Wei, Y., Ning, J., Cao, Y., Zhang, Z., Dong, L., et al.: Swin transformer v2: Scaling up capacity and resolution. In: CVPR (2022) 5 171. Liu, Z., Li, M., Zhang, Y., Wang, C., Zhang, Q., Wang, J., Nie, Y.: Fine-grained face swapping via regional gan inversion. In: CVPR (2023) 8 172. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., Guo, B.: Swin transformer: Hierarchical vision transformer using shifted windows. In: ICCV (2021) 4, 5, 9 173.
  119. Liu, Z., Luo, P., Wang, X., Tang, X.: Deep learning face attributes in the wild. In: ICCV (2015) 5 174. Liu, Z., Mao, H., Wu, C.Y., Feichtenhofer, C., Darrell, T., Xie, S.: A convnet for the 2020s. In: CVPR (2022) 4 175. Liu, Z., Qi, X., Torr, P.H.: Global texture enhancement for fake face detection in the wild. In: CVPR (2020) 13, 14 176.
  120. Lu, T., Wang, J., Jiang, J., Zhang, Y.: Global-local fu- sion network for face super-resolution. Neurocomputing (2020) 15 177. Ma, Y., He, Y., Cun, X., Wang, X., Shan, Y., Li, X., Chen, Q.: Follow your pose: Pose-guided text-to-video generation using pose-free videos. arXiv (2023) 4, 6, 15 178.
  121. Ma, Y., Wang, S., Ding, Y., Ma, B., Lv, T., Fan, C., Hu, Z., Deng, Z., Yu, X.: Talkclip: Talking head generation with text-guided expressive speaking styles. arXiv (2023) 10, 18 179.
  122. Ma, Y., Zhang, S., Wang, J., Wang, X., Zhang, Y., Deng, Z.: Dreamtalk: When expressive talking head generation meets diffusion probabilistic models. arXiv (2023) 1, 11, 18 180.
  123. Maninchedda, F., Oswald, M.R., Pollefeys, M.: Fast 3d reconstruction of faces with glasses. In: CVPR (2017) 6 181.
  124. Masi, I., Killekar, A., Mascarenhas, R.M., Gurudatt, S.P., AbdAlmageed, W.: Two-branch recurrent network for isolating deepfakes in videos. In: ECCV (2020) 14, 18 182.
  125. Melnik, A., Miasayedzenkau, M., Makaravets, D., Pirsh- tuk, D., Akbulut, E., Holzmann, D., Renusch, T., Re- ichert, G., Ritter, H.: Face generation and editing with stylegan: A survey. TPAMI (2024) 2 185.
  126. Milborrow, S., Morkel, J., Nicolls, F.: The muct land- marked face database. PRASA (2010) 7 187. Mildenhall, B., Srinivasan, P., Tancik, M., Barron, J., Ramamoorthi, R., Ng, R.: Nerf: Representing scenes as neural radiance fields for view synthesis. In: ECCV (2020) 2, 5, 12 188.
  127. Min, Z., Zhuang, B., Schulter, S., Liu, B., Dunn, E., Chandraker, M.: Neurocs: Neural nocs supervision for monocular 3d object localization. In: CVPR (2023) 5 189.
  128. Mirza, M., Osindero, S.: Conditional generative adver- sarial nets. arXiv (2014) 4 192. Moniz, J.R.A., Beckham, C., Rajotte, S., Honari, S., Pal, C.: Unsupervised depth estimation, 3d face rotation and replacement. In: NeurIPS (2018) 8 193.
  129. Moore, S., Bowden, R.: Multi-view pose and facial ex- pression recognition. In: BMVC (2010) 5, 9 194.
  130. Morales, A., Piella, G., Sukno, F.M.: Survey on 3d face reconstruction from uncalibrated images. Computer Science Review (2021) 6 195.
  131. Moser, B.B., Raue, F., Frolov, S., Palacio, S., Hees, J., Dengel, A.: Hitchhiker's guide to super-resolution: Intro- duction and recent advances. TPAMI (2023) 6 197. Moser, B.B., Shanbhag, A.S., Raue, F., Frolov, S., Palacio, S., Dengel, A.: Diffusion models, image super- resolution and everything: A survey. In: AAAI (2024) 6 198.
  132. Narayan, K., Agarwal, H., Thakral, K., Mittal, S., Vatsa, M., Singh, R.: Df-platter: multi-face heterogeneous deep- fake dataset. In: CVPR (2023) 5 201. Natsume, R., Yatagawa: Rsgan: face swapping and edit- ing using face and hair representation in latent spaces. In: SIGGRAPH (2018) 6, 7, 8 202.
  133. Nguyen, H.H., Yamagishi, J., Echizen, I.: Capsule- forensics: Using capsule networks to detect forged images and videos. In: ICASSP (2019) 13 203.
  134. Nirkin, Y., Keller, Y., Hassner, T.: Fsgan: Subject ag- nostic face swapping and reenactment. In: ICCV (2019) 7, 8 204.
  135. Nirkin, Y., Keller, Y., Hassner, T.: Fsganv2: Improved subject agnostic face swapping and reenactment. TPAMI (2022) 7 205.
  136. Nirkin, Y., Wolf, L., Keller, Y., Hassner, T.: Deepfake detection based on discrepancies between faces and their context. TPAMI (2021) 13, 14 207.
  137. Oorloff, T., Yacoob, Y.: Robust one-shot face video re- enactment using hybrid latent spaces of stylegan2. In: ICCV (2023) 9, 10 208.
  138. Ozkan, S., Ozay, M., Robinson, T.: Conceptual and hier- archical latent space decomposition for face editing. In: ICCV (2023) 12 209. Pan, Y., Tang, J., Tjahjadi, T.: Lpsrgan: Generative adversarial networks for super-resolution of license plate image. Neurocomputing (2024) 15 210. Pang, Y., Zhang, Y., Quan, W., Fan, Y., Cun, X., Shan, Y., Yan, D.m.: Dpe: Disentanglement of pose and ex- pression for general video portrait editing. In: CVPR (2023) 2 211.
  139. Parkhi, O., Vedaldi, A., Zisserman, A.: Deep face recog- nition. In: BMVC (2015) 5 212. Peng, C., Miao, Z., Liu, D., Wang, N., Hu, R., Gao, X.: Where deepfakes gaze at? spatial-temporal gaze incon- sistency analysis for video face forgery detection. TIFS (2024) 13, 14 213.
  140. Peng, X., Zhu, J., Jiang, B., Tai, Y., Luo, D., Zhang, J., Lin, W., Jin, T., Wang, C., Ji, R.: Portraitbooth: A versatile portrait model for fast identity-preserved personalization. In: CVPR (2024) 6 214.
  141. Peng, Z., Hu, W., Shi, Y., Zhu, X., Zhang, X., Zhao, H., He, J., Liu, H., Fan, Z.: Synctalk: The devil is in the synchronization for talking head synthesis. In: CVPR'24 (2024) 11 215. Peng, Z., Wu, H., Song, Z., Xu, H., Zhu, X., He, J., Liu, H., Fan, Z.: Emotalk: Speech-driven emotional dis- entanglement for 3d face animation. In: ICCV (2023) 11 216. Pérez, J.C., Nguyen-Phuoc, T., Cao, C., Sanakoyeu, A., Simon, T., Arbeláez, P., Ghanem, B., Thabet, A., Pumarola, A.: Styleavatar: Stylizing animatable head avatars. In: WACV (2024) 6 217.
  142. Prajwal, K., Mukhopadhyay, R., Namboodiri, V.P., Jawa- har, C.: A lip sync expert is all you need for speech to lip generation in the wild. In: ACM MM (2020) 5, 10, 11, 16 218.
  143. Preechakul, K., Chatthee, N., Wizadwongsa, S., Suwa- janakorn, S.: Diffusion autoencoders: Toward a meaning- ful and decodable representation. In: CVPR (2022) 12, 18 219.
  144. Qian, Y., Yin, G., Sheng, L., Chen, Z., Shao, J.: Thinking in frequency: Face forgery detection by mining frequency- aware clues. In: ECCV (2020) 2, 14, 18 220.
  145. Ren, X., Chen, X., Yao, P., Shum, H.Y., Wang, B.: Reinforced disentanglement for face swapping without skip connection. In: ICCV (2023) 7, 8, 17 221.
  146. Richie, C., Warburton, S., Carter, M.: Audiovisual database of spoken american english. LDC (2009) 11 222. Rochow, A., Schwarz, M., Behnke, S.: Fsrt: Facial scene representation transformer for face reenactment from factorized appearance, head-pose, and facial expression features. In: CVPR (2024) 9 223.
  147. Rombach, R., Blattmann, A., Lorenz, D., Esser, P., Om- mer, B.: High-resolution image synthesis with latent diffusion models. In: CVPR (2022) 2, 4 224.
  148. Rosberg, F., Aksoy, E.E., Alonso-Fernandez, F., Englund, C.: Facedancer: pose-and occlusion-aware high fidelity face swapping. In: WACV (2023) 8 225.
  149. Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., Nießner, M.: Faceforensics++: Learning to detect manipulated facial images. In: ICCV (2019) 5, 17, 18 226.
  150. Ruiz, N., Chong, E., Rehg, J.M.: Fine-grained head pose estimation without keypoints. In: CVPR (2018) 5, 16 227.
  151. Sharma, P., Tewari, A., Du, Y., Zakharov, S., Ambrus, R.A., Gaidon, A., Freeman, W.T., Durand, F., Tenen- baum, J.B., Sitzmann, V.: Neural groundplans: Persis- tent neural scene representations from a single image. In: ICLR (2023) 5 229. Sharma, S., Kumar, V.: 3d face reconstruction in deep learning era: A survey. ACME (2022) 6 230. Shen, S., Li, W., Zhu, Z., Duan, Y., Zhou, J., Lu, J.: Learning dynamic facial radiance fields for few-shot talk- ing head synthesis. In: ECCV (2022) 10, 11 231.
  152. Shen, W., Liu, R.: Learning residual images for face attribute manipulation. In: CVPR (2017) 12 232. Shen, Y., Gu, J., Tang, X., Zhou, B.: Interpreting the latent space of gans for semantic face editing. In: CVPR (2020) 12 233.
  153. Shi, Y., Li, G., Cao, Q., Wang, K., Lin, L.: Face hallu- cination by attentive sequence optimization with rein- forcement learning. TPAMI (2019) 6 235. Shiohara, K., Yamasaki, T.: Detecting deepfakes with self-blended images. In: CVPR (2022) 13, 14, 18 236.
  154. Shiohara, K., Yang, X., Taketomi, T.: Blendface: Re- designing identity encoders for face-swapping. In: ICCV (2023) 1, 7, 8 237.
  155. Shu, C., Wu, H., Zhou, H., Liu, J., Hong, Z., Ding, C., Han, J., Liu, J., Ding, E., Wang, J.: Few-shot head swapping in the wild. In: CVPR (2022) 5 238.
  156. Sohl-Dickstein, J., Weiss, E., Maheswaranathan, N., Gan- guli, S.: Deep unsupervised learning using nonequilibrium thermodynamics. In: ICML (2015) 4 239.
  157. Sohn, K., Lee, H., Yan, X.: Learning structured output representation using deep conditional generative models. In: NeurIPS (2015) 1, 4 240.
  158. Stypułkowski, M., Vougioukas, K., He, S., Zięba, M., Petridis, S., Pantic, M.: Diffused heads: Diffusion models beat gans on talking-face generation. In: WACV (2024) 11 241. Sun, J., Deng, Q., Li, Q., Sun, M., Ren, M., Sun, Z.: Any- face: Free-style text-to-face synthesis and manipulation. In: CVPR (2022) 2, 12, 18 242.
  159. Sun, J., Li, Q., Wang, W., Zhao, J., Sun, Z.: Multi- caption text-to-face synthesis: Dataset and algorithm. In: ACM MM (2021) 5 243.
  160. Sun, J., Wang, X., Zhang, Y., Li, X., Zhang, Q., Liu, Y., Wang, J.: Fenerf: Face editing in neural radiance fields. In: CVPR (2022) 12, 18 244.
  161. Sun, Q., Tewari, A., Xu, W., Fritz, M., Theobalt, C., Schiele, B.: A hybrid model for identity obfuscation by face replacement. In: ECCV (2018) 6, 7, 8 245.
  162. Sun, Z., Chen, Y., Xiong, S.: Ssat: A symmetric semantic- aware transformer network for makeup transfer and re- moval. In: AAAI (2022) 16 246.
  163. Sunkavalli, K., Johnson, M.K., Matusik, W., Pfister, H.: Multi-scale image harmonization. ACM TOG (2010) 7 248. Tan, C., Zhao, Y., Wei, S., Gu, G., Liu, P., Wei, Y.: Frequency-aware deepfake detection: Improving general- izability through frequency space domain learning. In: AAAI (2024) 14 249. Tan, C., Zhao, Y., Wei, S., Gu, G., Wei, Y.: Learning on gradients: Generalized artifacts representation for gan- generated images detection. In: CVPR (2023) 2, 5, 13, 14 250.
  164. Tan, S., Ji, B., Pan, Y.: Emmn: Emotional motion mem- ory network for audio-driven emotional talking face gen- eration. In: ICCV (2023) 10, 18 251.
  165. Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., Nießner, M.: Face2face: Real-time face capture and reen- actment of rgb videos. In: CVPR (2016) 9 252. Tian, L., Wang, Q., Zhang, B., Bo, L.: Emo: Emote por- trait alive-generating expressive portrait videos with au- dio2video diffusion model under weak conditions. arXiv (2024) 11 253. Tripathy, S., Kannala, J., Rahtu, E.: Icface: Interpretable and controllable face reenactment using gans. In: WACV (2020) 9, 10 254.
  166. Tulsiani, S., Zhou, T., Efros, A.A., Malik, J.: Multi-view supervision for single-view reconstruction via differen- tiable ray consistency. In: CVPR (2017) 6 255. Van Den Oord, A., Vinyals, O., et al.: Neural discrete representation learning. In: NeurIPS (2017) 1, 4 256.
  167. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: At- tention is all you need. In: NeurIPS (2017) 4 257.
  168. Vyas, K., Pareek, P., Jayaswal, R., Patil, S.: Analysing the landscape of deep fake detection: A survey. IJISAE (2024) 2 258. Wang, H., Wang, Y., Zhou, Z., Ji, X., Gong, D., Zhou, J., Li, Z., Liu, W.: Cosface: Large margin cosine loss for deep face recognition. In: CVPR (2018) 5, 16 259.
  169. Wang, J., Qian, X., Zhang, M., Tan, R.T., Li, H.: Seeing what you said: Talking face generation guided by a lip reading expert. In: CVPR (2023) 10, 11 260.
  170. Wang, J., Wu, Z., Ouyang, W., Han, X., Chen, J., Jiang, Y.G., Li, S.N.: M2tr: Multi-modal multi-scale transform- ers for deepfake detection. In: ICML (2022) 5, 14, 18 261.
  171. Wang, J., Zhao, K., Zhang, S., Zhang, Y., Shen, Y., Zhao, D., Zhou, J.: Lipformer: High-fidelity and general- izable talking face generation with a pre-learned facial codebook. In: CVPR (2023) 10, 11 262.
  172. Wang, J., Zhao, Y., Fan, H., Xu, T., Li, Q., Li, S., Liu, L.: Memory-augmented contrastive learning for talking head generation. In: ICASSP (2023) 5, 10, 17 263.
  173. Wang, K., Wu, Q., Song, L., Yang, Z., Wu, W., Qian, C., He, R., Qiao, Y., Loy, C.C.: Mead: A large-scale audio- visual dataset for emotional talking-face generation. In: ECCV (2020) 5, 17 264.
  174. Wang, Q., Liu, L., Hua, M., Zhu, P., Zuo, W., Hu, Q., Lu, H., Cao, B.: Hs-diffusion: Semantic-mixing diffusion for head swapping. arXiv (2023) 6 265. Wang, R., Juefei-Xu, F., Ma, L., Xie, X., Huang, Y., Wang, J., Liu, Y.: Fakespotter: a simple yet robust base- line for spotting ai-synthesized fake faces. In: IJCAI (2021) 15 266. Wang, S., Ma, Y., Ding, Y., Hu, Z., Fan, C., Lv, T., Deng, Z., Yu, X.: Styletalk++: A unified framework for controlling the speaking styles of talking heads. TPAMI (2024) 11 267. Wang, T., Chow, K.P.: Noise based deepfake detection via multi-head relative-interaction. In: AAAI (2023) 13, 14 268.
  175. Wang, T., Li, L., Lin, K., Lin, C.C., Yang, Z., Zhang, H., Liu, Z., Wang, L.: Disco: Disentangled control for referring human dance generation in real world. In: CVPR (2024) 6 269. Wang, T., Li, Z., Liu, R., Wang, Y., Nie, L.: An efficient attribute-preserving framework for face swapping. TMM (2024) 7 270. Wang, T.C., Mallya, A., Liu, M.Y.: One-shot free-view neural talking-head synthesis for video conferencing. In: CVPR (2021) 5 271. Wang, W., Xie, E., Li, X., Fan, D.P., Song, K., Liang, D., Lu, T., Luo, P., Shao, L.: Pyramid vision transformer: A versatile backbone for dense prediction without con- volutions. In: ICCV (2021) 5 272. Wang, Y., Chen, X., Zhu, J., Chu, W., Tai, Y., Wang, C., Li, J., Wu, Y., Huang, F., Ji, R.: Hififace: 3d shape and semantic prior guided high fidelity face swapping. In: IJCAI (2021) 7, 8, 17 273.
  176. Wang, Y., Ma, X., Chen, X., Dantcheva, A., Dai, B., Qiao, Y.: Leo: Generative latent image animator for human video synthesis. arXiv (2023) 6, 11, 15 274.
  177. Wei, H., Yang, Z., Wang, Z.: Aniportrait: Audio-driven synthesis of photorealistic portrait animation. arXiv (2024) 11 276. Wen, B., Zhu, Y., Subramanian, R., Ng, T.T., Shen, X., Winkler, S.: Coverage-a novel database for copy-move forgery detection. In: ICIP (2016) 14 277.
  178. Wenmin Huang, W.L., Jiwu Huang, X.C.: Sdgan: Dis- entangling semantic manipulation for facial attribute editing. In: AAAI (2024) 12 278.
  179. Wiles, O., Koepke, A., Zisserman, A.: X2face: A network for controlling face generation using images, audio, and pose codes. In: ECCV (2018) 9 279. Wu, X., Hu, P., Wu, Y., Lyu, X., Cao, Y.P., Shan, Y., Yang, W., Sun, Z., Qi, X.: Speech2lip: High-fidelity speech to lip generation by learning from a short video. In: ICCV (2023) 10 280. Xia, W., Yang, Y., Xue, J.H., Wu, B.: Tedigan: Text- guided diverse face image generation and manipulation. In: CVPR (2021) 5 281. Xing, Y., Tewari, R., Mendonca, P.: A self-supervised bootstrap method for single-image 3d face reconstruction. In: WACV (2019) 6 282. Xu, C., Zhang, J., Han, Y., Tian, G., Zeng, X., Tai, Y., Wang, Y., Wang, C., Liu, Y.: Designing one uni- fied framework for high-fidelity face reenactment and swapping. In: ECCV (2022) 8 283. Xu, C., Zhang, J., Hua, M., He, Q., Yi, Z., Liu, Y.: Region-aware face swapping. In: CVPR (2022) 1, 7, 17 284.
  180. Xu, C., Zhu, J., Zhang, J., Han, Y., Chu, W., Tai, Y., Wang, C., Xie, Z., Liu, Y.: High-fidelity generalized emo- tional talking face generation with multi-modal emotion space learning. In: CVPR (2023) 10, 11, 18 285.
  181. Xu, C., Zhu, S., Zhu, J., Huang, T., Zhang, J., Tai, Y., Liu, Y.: Multimodal-driven talking face generation via a unified diffusion-based generator. CoRR (2023) 11 286. Xu, J., Motamed, S., Vaddamanu, P., Wu, C.H., Haene, C., Bazin, J.C., De la Torre, F.: Personalized face inpaint- ing with diffusion models by parallel visual attention. In: WACV (2024) 6 287. Xu, S., Chen, G., Guo, Y.X., Yang, J., Li, C., Zang, Z., Zhang, Y., Tong, X., Guo, B.: Vasa-1: Lifelike audio- driven talking faces generated in real time. arXiv (2024) 11 288. Xu, S., Li, L., Shen, L., Men, Y., Lian, Z.: Your3demoji: Creating personalized emojis via one-shot 3d-aware car- toon avatar synthesis. In: SIGGRAPH (2022) 6, 15 289.
  182. Xu, Y., Deng, B., Wang, J., Jing, Y., Pan, J., He, S.: High-resolution face swapping via latent semantics dis- entanglement. In: CVPR (2022) 6, 7, 17 290.
  183. Xu, Y., Liang, J., Sheng, L., Zhang, X.Y.: Towards generalizable deepfake video detection with thumbnail layout and graph reasoning. IJCV (2024) 13, 14 291.
  184. Xu, Y., Yin, Y., Jiang, L., Wu, Q., Zheng, C., Loy, C.C., Dai, B., Wu, W.: Transeditor: Transformer-based dual- space gan for highly controllable facial editing. In: CVPR (2022) 12 292. Xu, Z., Zhang, J., Liew, J.H., Yan, H., Liu, J.W., Zhang, C., Feng, J., Shou, M.Z.: Magicanimate: Temporally consistent human image animation using diffusion model. In: CVPR (2024) 6 293. Xu, Z., Zhou, H., Hong, Z., Liu, Z., Liu, J., Guo, Z., Han, J., Liu, J., Ding, E., Wang, J.: Styleswap: Style-based generator empowers robust face swapping. In: ECCV (2022) 7, 8, 17 294.
  185. Xue, H., Ling, J., Tang, A., Song, L., Xie, R., Zhang, W.: High-fidelity face reenactment via identity-matched correspondence learning. TOMM (2023) 9 295. Yan, Q., Guo, C., Zhao, J., Dai, Y., Loy, C.C., Li, C.: Beautyrec: Robust, efficient, and component-specific makeup transfer. In: CVPR (2023) 6, 16 296.
  186. Yang, C., He, W., Xu, Y., Gao, Y.: Elegant: Exquisite and locally editable gan for makeup transfer. In: ECCV (2022) 6, 16 297.
  187. Yang, K., Chen, K., Guo, D., Zhang, S.H., Guo, Y.C., Zhang, W.: Face2face ρ: Real-time high-resolution one- shot face reenactment. In: ECCV (2022) 9 298. Yang, P., Zhou, S., Tao, Q., Loy, C.C.: Pgdiff: Guiding diffusion models for versatile face restoration via partial guidance. In: NeurIPS (2024) 6 299. Yang, S., Jiang, L., Liu, Z., Loy, C.C.: Vtoonify: Control- lable high-resolution portrait video style transfer. ACM TOG (2022) 6 300. Yang, S., Wang, W., Lan, Y., Fan, X., Peng, B., Yang, L., Dong, J.: Learning dense correspondence for nerf-based face reenactment. In: AAAI (2024) 9, 10 301.
  188. Yang, X., Li, Y., Lyu, S.: Exposing deep fakes using inconsistent head poses. In: ICASSP (2019) 5, 13, 14 303.
  189. Yang, Y., Yang, Y., Guo, H., Xiong, R., Wang, Y., Liao, Y.: Urbangiraffe: Representing urban scenes as compo- sitional generative neural feature fields. arXiv (2023) 5 304. Yang, Z., Liang, J., Xu, Y., Zhang, X.Y., He, R.: Masked relation learning for deepfake detection. TIFS (2023) 2, 13, 14, 18 305.
  190. Yao, X., Newson, A., Gousseau, Y., Hellier, P.: A latent transformer for disentangled face editing in images and videos. In: ICCV (2021) 12 306.
  191. Ye, Z., Zhong, T., Ren, Y., Yang, J., Li, W., Huang, J., Jiang, Z., He, J., Huang, R., Liu, J., et al.: Real3d- portrait: One-shot realistic 3d talking portrait synthesis. In: ICLR (2024) 11 307. Yildirim, A.B., Pehlivan, H., Bilecen, B.B., Dundar, A.: Diverse inpainting and editing with gan inversion. In: ICCV (2023) 6 308. Yin, Q., Lu, W., Li, B., Huang, J.: Dynamic difference learning with spatio-temporal correlation for deepfake video detection. TIFS (2023) 2, 13, 18 309.
  192. Yoo, S.M., Choi, T.M., Choi, J.W., Kim, J.H.: Fastswap: A lightweight one-stage framework for real-time face swapping. In: WACV (2023) 8 310. Yu, C., Lu, G., Zeng, Y., Sun, J., Liang, X., Li, H., Xu, Z., Xu, S., Zhang, W., Xu, H.: Towards high-fidelity text-guided 3d face generation and manipulation using only images. In: ICCV (2023) 12, 18 311.
  193. Yu, H., Qu, Z., Yu, Q., Chen, J., Jiang, Z., Chen, Z., Zhang, S., Xu, J., Wu, F., Lv, C., et al.: Gaussiantalker: Speaker-specific talking head synthesis via 3d gaussian splatting. arXiv (2024) 11 312. Yu, L., Xie, H., Zhang, Y.: Multimodal learning for tem- porally coherent talking face generation with articulator synergy. TMM (2021) 11 313. Yu, N., Davis, L.S., Fritz, M.: Attributing fake images to gans: Learning and analyzing gan fingerprints. In: ICCV (2019) 15 314. Yu, W.Y., Po, L.M., Cheung, R.C., Zhao, Y., Xue, Y., Li, K.: Bidirectionally deformable motion modulation for video-based human pose transfer. In: ICCV (2023) 6 315. Yu, Z., Yin, Z., Zhou, D., Wang, D., Wong, F., Wang, B.: Talking head generation with probabilistic audio-to- visual diffusion priors. In: ICCV (2023) 11 316.
  194. Yuan, G., Li, M., Zhang, Y., Zheng, H.: Reliableswap: Boosting general face swapping via reliable supervision. arXiv (2023) 9 318.
  195. Zakharov, E., Ivakhnenko, A., Shysheya, A., Lempitsky, V.: Fast bi-layer neural synthesis of one-shot realistic head avatars. In: ECCV (2020) 9 319.
  196. Zakharov, E., Shysheya, A., Burkov, E., Lempitsky, V.: Few-shot adversarial learning of realistic neural talking head models. In: CVPR (2019) 9 320. Zeng, H., Zhang, W., Fan, C., Lv, T., Wang, S., Zhang, Z., Ma, B., Li, L., Ding, Y., Yu, X.: Flowface: Semantic flow-guided shape-aware face swapping. In: AAAI (2023) 7, 8, 17 321.
  197. Zeng, X., Pan, Y., Wang, M., Zhang, J., Liu, Y.: Realistic face reenactment via self-supervised disentangling of identity and pose. In: AAAI (2020) 10 322.
  198. Zhai, Y., Luan, T., Doermann, D., Yuan, J.: Towards generic image manipulation detection with weakly- supervised self-consistency learning. In: ICCV (2023) 14 324. Zhang, B., Qi, C., Zhang, P., Zhang, B., Wu, H., Chen, D., Chen, Q., Wang, Y., Wen, F.: Metaportrait: Identity- preserving talking head generation with fast personalized adaptation. In: CVPR (2023) 9, 10 325.
  199. Zhang, B., Zhang, X., Cheng, N., Yu, J., Xiao, J., Wang, J.: Emotalker: Emotionally editable talking face genera- tion via diffusion model. In: ICASSP (2024) 11 326. Zhang, C., Wang, C., Zhao, Y., Cheng, S., Luo, L., Guo, X.: Dr2: Disentangled recurrent representation learning for data-efficient speech video synthesis. In: WACV (2024) 1, 10, 11 327.
  200. Zhang, H., DAI, T., Xu, Y., Tai, Y.W., Tang, C.K.: Facednerf: Semantics-driven face reconstruction, prompt editing and relighting with diffusion models. In: NIPS (2024) 12 328. Zhang, H., Ren, Y., Chen, Y., Li, G., Li, T.H.: Exploiting multiple guidance from 3dmm for face reenactment. In: AAAIW (2023) 10 329. Zhang, J., Li, X., Li, J., Liu, L., Xue, Z., Zhang, B., Jiang, Z., Huang, T., Wang, Y., Wang, C.: Rethinking mobile block for efficient attention-based models. In: ICCV (2023) 4 330. Zhang, J., Li, X., Wan, Z., Wang, C., Liao, J.: Fdnerf: Few-shot dynamic neural radiance fields for face recon- struction and expression editing. In: SIGGRAPH (2022) 2, 12, 18 331.

200 of 219 shown

Cited by

Sorted by citations

Related

Metadata

Authors
Pei, G., Zhang, J., Hu, M., Zhang, Z., Wang, C., Wu, Y., Zhai, G., Yang, J., & Tao, D.
Affiliations
  • East China Normal University (CN)
  • Tencent (China) (CN)
  • Nanjing University (CN)
  • Shanghai Jiao Tong University (CN)
  • The University of Sydney (AU)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2403.17881
arXiv
2403.17881
OpenAlex
W4393248146
Cited by
17
References
0
Citations by year
2026: 4 · 2025: 7 · 2024: 6
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • DR-NTU (Nanyang Technological University) (submittedVersion)
  • arXiv (Cornell University)
Funders
National Natural Science Foundation of China (62371189)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
Keywords
deepfake generation, deepfake detection, face swapping, face reenactment, talking face generation, facial attribute editing, image forgery detection, generative adversarial networks, diffusion models, variational autoencoder, benchmark dataset, privacy violations, phishing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review