Deepfakes Generation and Detection: A Short Survey
Open accessThe DOI matches its Crossref record; 165 of the 165 references it cites were found in a registry or an index.
Abstract
Advancements in deep learning techniques and the availability of free, large databases have made it possible, even for non-technical people, to either manipulate or generate realistic facial samples for both benign and malicious purposes. DeepFakes refer to face multimedia content, which has been digitally altered or synthetically created using deep neural networks. The paper first outlines the readily available face editing apps and the vulnerability (or performance degradation) of face recognition systems under various face manipulations. Next, this survey presents an overview of the techniques and works that have been carried out in recent years for deepfake and face manipulations. Especially, four kinds of deepfake or face manipulations are reviewed, i.e., identity swap, face reenactment, attribute manipulation, and entire face synthesis. For each category, deepfake or face manipulation generation methods as well as those manipulation detection methods are detailed. Despite significant progress based on traditional and advanced computer vision, artificial intelligence, and physics, there is still a huge arms race surging up between attackers/offenders/adversaries (i.e., DeepFake generation methods) and defenders (i.e., DeepFake detection methods). Thus, open challenges and potential research directions are also discussed. This paper is expected to aid the readers in comprehending deepfake generation and detection mechanisms, together with open issues and future directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

![Figure 2 Real and fake examples of each deepfake/face manipulation group. The fake sample in “Entire face synthesis” group is obtained from the method in [81].](https://figures.cochat.ai/paper-figures/aa157253f83342388959ec0e30dd9e41/deepfakes-generation-and-detection-a-short-survey-figure-2.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“As highlighted by Akhtar (2023), there is a continuous arms race between the creators of deepfake generation methods and the developers of detection techniques.”
From Deepfake forensics: a survey of digital forensic methods for multimodal deepfake identification on social media (2024) · cites this paper as Akhtar (2023)
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The size of the DFD benchmark datasets further increased to over 100,000 videos in each dataset including DF-Platter in 2023 [8,9].”
From A Comprehensive Review of DeepFake Detection Using Advanced Machine Learning and Fusion Methods (2023) · cites this paper as [8]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2019) · arXiv · doi:10.48550/arxiv.1912.04958 · Cited by 6,332
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294 · cited 1×
“For deepfake detection framework’s interpretability and dependability, various advanced combinations of techniques such as fuzzy inference systems [187], layer-wise relevance propagation [188], and the Neural Additive Model [189] could be helpful.”
MethodStarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
VGGFace2: A Dataset for Recognising Faces across Pose and Age
Cao, Q., Shen, L., Xie, W., Parkhi, O. M., & Zisserman, A. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00020 · Cited by 3,032
The FERET database and evaluation procedure for face-recognition algorithms
Phillips, P. J., Wechsler, H., Huang, J., & Rauss, P. J. (1998) · Image and Vision Computing · doi:10.1016/s0262-8856(97)00070-x · Cited by 2,431
VoxCeleb2: Deep Speaker Recognition
Chung, J. S., Nagrani, A., & Zisserman, A. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1929 · Cited by 2,256
VoxCeleb: A Large-Scale Speaker Identification Dataset
Nagrani, A., Chung, J. S., & Zisserman, A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-950 · Cited by 2,210
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
StarGAN v2: Diverse Image Synthesis for Multiple Domains
Choi, Y., Uh, Y., Yoo, J., & Ha, J.-W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00821 · Cited by 1,663
Reliable Crowdsourcing and Deep Locality-Preserving Learning for Expression Recognition in the Wild
Li, S., Deng, W., & Du, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.277 · Cited by 1,470
Deepfake Video Detection Using Recurrent Neural Networks
Guera, D., & Delp, E. J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639163 · Cited by 1,285 · cited 2×
“Deepfak s can also be used for destructive applications such as the use of fake pornogr phic vide s to damag a p rson’s reputation or to blackmail them [20], manipulating elections [21], creating warmongering situations [22], generating political or religious unrest via fake speeches [23], causing chaos in financial m…”
BackgroundDeepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
CNN-Generated Images Are Surprisingly Easy to Spot… for Now
Wang, S.-Y., Wang, O., Zhang, R., Owens, A., & Efros, A. A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00872 · Cited by 1,210
A Survey of Fake News: Fundamental Theories, Detection Methods, and Opportunities
Zhou, X., & Zafarani, R. (2021) · ACM Computing Surveys · doi:10.1145/3395046 · Cited by 1,184 · cited 2×
“There exist some review papers on this topic (e.g., [5,24,47,48]), but they are focused mainly on deepfake or synthetic samples using generative adversarial networks.”
BackgroundTraining Generative Adversarial Networks with Limited Data
Karras, T., Aittala, M., Hellsten, J., Laine, S., Lehtinen, J., & Aila, T. (2020) · arXiv · doi:10.48550/arxiv.2006.06676 · Cited by 1,170
300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.59 · Cited by 1,119
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
Multi-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019 · cited 2×
“[77] Multi-attentional FaceForensics++ [90] DFDC [3] Acc = 97.”
MethodEnergy-based Generative Adversarial Network
Zhao, J., Mathieu, M., & LeCun, Y. (2016) · arXiv · doi:10.48550/arxiv.1609.03126 · Cited by 912 · cited 1×
“This consists of generating entire non-existent face images [113–115].”
BackgroundThe Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863 · cited 3×
“There exist some review papers on this topic (e.g., [5,24,47,48]), but they are focused mainly on deepfake or synthetic samples using generative adversarial networks.”
BackgroundThe Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2020) · arXiv · doi:10.48550/arxiv.2004.11138 · Cited by 863 · cited 3×
“There exist some review papers on this topic (e.g., [5,24,47,48]), but they are focused mainly on deepfake or synthetic samples using generative adversarial networks.”
BackgroundAlias-Free Generative Adversarial Networks
Karras, T., Aittala, M., Laine, S., Härkönen, E., Hellsten, J., Lehtinen, J., & Aila, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12423 · Cited by 840
AttGAN: Facial attribute editing by only changing what you want
He, Z., Zuo, W., Kan, M., Shan, S., & Chen, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2916751 · Cited by 833 · cited 2×
“, FaceApp [6], ZAO [7], Face Swap Live [8], Deepfake web [9], AgingBooth [10], PotraitPro Studio [11], Reface [12], Audacity [13], Soundforge [14], Adobe Photoshop [15]), and Deep Neural network (DNN) source codes [16,17] have enabled even non-experts and non-technical people to”
BackgroundExploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824 · cited 1×
“[89] using visual features with logistic regression and MLP; Rossler et al.”
MethodExposing DeepFake Videos By Detecting Face Warping Artifacts
Li, Y., & Lyu, S. (2018) · arXiv · doi:10.48550/arxiv.1811.00656 · Cited by 785 · cited 1×
“Also, warping artifacts [63], eye blinking [64], optical flow with CNNs [65], heart rate [66], image quality [28], local image textures [37], long short-term memory (LSTM) and recurrent neural network (RNN) [67], multi-LSTM and blockchain [68], clustering [69], context [70], compression artifacts [71], metric learning…”
MethodRobust Face Landmark Estimation under Occlusion
Burgos-Artizzu, X. P., Perona, P., & Dollar, P. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.191 · Cited by 775
On the Detection of Digital Face Manipulation
Dang, H., Liu, F., Stehouwer, J., Liu, X., & Jain, A. K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00582 · Cited by 764
LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speech
Zen, H., Dang, V., Clark, R., Zhang, Y., Weiss, R. J., Jia, Y., Chen, Z., & Wu, Y. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2441 · Cited by 752
FSGAN: Subject Agnostic Face Swapping and Reenactment
Nirkin, Y., Keller, Y., & Hassner, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00728 · Cited by 706 · cited 2×
“…landmark converter with geometry-aware generator, GANs, and task-agnostic GANs-based schemes were designed by Kim et al. [83], Nirkin et al. [84], Zhang et al. [85], Doukas et al. [86], and Cao et al. [87], respectively. task-agnostic GANs-based schemes by Kim et al. [83], Nirkin et al.…”
MethodFew-Shot Adversarial Learning of Realistic Neural Talking Head Models
Zakharov, E., Shysheya, A., Burkov, E., & Lempitsky, V. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00955 · Cited by 687 · cited 2×
“…[10], PotraitPro Studio [11], Reface [12], Audacity [13], Soundforge [14], Adobe Photoshop [15]), and Deep Neural network (DNN) source codes [16,17] have enabled even non-experts and non-technical people to [26], but also deepfakes are successfully being misused by cybercriminals in the real world.”
BackgroundDeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599
Multi-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549
Kietzmann, J., Lee, L. W., McCarthy, I. P., & Kietzmann, T. C. (2020) · Business Horizons · doi:10.1016/j.bushor.2019.11.006 · Cited by 504 · cited 1×
“[23], causing chaos in financial markets [24], or identity theft [25].”
BackgroundOpportunities and Challenges in Explainable Artificial Intelligence (XAI): A Survey
Das, A., & Rad, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11371 · Cited by 504
Fast Face-Swap Using Convolutional Neural Networks
Korshunova, I., Shi, W., Dambre, J., & Theis, L. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.397 · Cited by 501
Kim, H., Garrido, P., Tewari, A., Xu, W., Thies, J., Niessner, M., Pérez, P., Richardt, C., Zollhöfer, M., & Theobalt, C. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201283 · Cited by 475 · cited 2×
“…and task-agnostic GANs-based schemes were designed by Kim et al. [83], Nirkin et al. [84], Zhang et al. [85], Doukas et al. [86], and Cao et al. [87], respectively. task-agnostic GANs-based schemes by Kim et al. [83], Nirkin et al. [84], Zhang et al. [85], Doukas et al. [86], and respectively.”
MethodLabeled Faces in the Wild: A Survey
Learned-Miller, E., Huang, G. B., RoyChowdhury, A., Li, H., & Hua, G. (2016) · Advances in Face Detection and Facial Image Analysis · doi:10.1007/978-3-319-25958-1_8 · Cited by 457
Recurrent convolutional strategies for face manipulation detection in videos
Sabir, E., Cheng, J., Jaiswal, A., AbdAlmageed, W., Masi, I., & Natarajan, P. (2019) · arXiv · doi:10.48550/arxiv.1905.00582 · Cited by 443 · cited 2×
“[89] using visual features with logistic regression and MLP; Rossler mesoscopic, steganalysis, and CNN features; Sabir et al. [91] using RNN; 65] using Optical Flow + CNNs; Kumar et al. [92] using multistream CNNs; .”
MethodThe deepfake detection challenge (dfdc) dataset
Dolhansky, B., Bitton, J., Pflaum, B., Lu, J., Howes, R., Wang, M., & Ferrer, C. C. (2020) · arXiv · doi:10.48550/arxiv.2006.07397 · Cited by 427 · cited 4×
“[167] DFT + CNNs Deepfake-in-the-wild [168] Celeb-DF [142] DFDC [3] Acc = 78.”
BackgroundInfluentialDeepfake Video Detection through Optical Flow Based CNN
Amerini, I., Galteri, L., Caldelli, R., & Del Bimbo, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00152 · Cited by 424 · cited 10×
“Face reenactment detection methods were designed by Cozzolino et al. [88] using CNNs; Matern et al. [89] using visual features with logistic regression and MLP; Rossler et al. [90] using mesoscopic, steganalysis, and CNN features; Sabir et al. [91] using RNN; Amerini et al. [65] using Optical Flow + CNNs; Kumar et al.…”
MethodInfluentialSimSwap: An Efficient Framework For High Fidelity Face Swapping
Chen, R., Chen, X., Ni, B., & Ge, Y. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413630 · Cited by 418 · cited 1×
“Other interesting face swamping methods can be seen in [28,57–61].”
MethodTalking Face Generation by Adversarially Disentangled Audio-Visual Representation
Zhou, H., Liu, Y., Liu, Z., Luo, P., & Wang, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019299 · Cited by 416
STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editing
Liu, M., Ding, Y., Xia, M., Liu, X., Ding, E., Zuo, W., & Wen, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00379 · Cited by 394
TediGAN: Text-Guided Diverse Face Image Generation and Manipulation
Xia, W., Yang, Y., Xue, J.-H., & Wu, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00229 · Cited by 376
M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection
Wang, J., Wu, Z., Ouyang, W., Han, X., Chen, J., Jiang, Y.-G., & Li, S.-N. (2022) · Proceedings of the 2022 International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531415 · Cited by 368 · cited 1×
“…(LSTM) and recurrent neural network (RNN) [67], multi-LSTM and blockchain [68], clustering [69], context [70], compression artifacts [71], metric learning [72], CNN ensemble [73], Identity-aware [74], transformers [75], audio-visual dissonance [76], and multi-attentional [77] features were used.”
MethodDo GANs leave artificial fingerprints?
Marra, F., Gragnaniello, D., Verdoliva, L., & Poggi, G. (2019) · 2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2019.00103 · Cited by 361
A U-Net Based Discriminator for Generative Adversarial Networks
Schonfeld, E., Schiele, B., & Khoreva, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00823 · Cited by 341
Detecting GAN generated Fake Images using Co-occurrence Matrices
Nataraj, L., Mohammed, T. M., Manjunath, B. S., Chandrasekaran, S., Flenner, A., Bappy, J. H., & Roy-Chowdhury, A. K. (2019) · Electronic Imaging · doi:10.2352/issn.2470-1173.2019.5.mwsf-532 · Cited by 331
DeepFake Detection Based on Discrepancies Between Faces and Their Context
Nirkin, Y., Wolf, L., Keller, Y., & Hassner, T. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3093446 · Cited by 312
The current state of fake news: challenges and opportunities
Figueira, Á., & Oliveira, L. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.11.106 · Cited by 293 · cited 1×
“[23], causing chaos in financial markets [24], or identity theft [25].”
BackgroundThe First Facial Landmark Tracking in-the-Wild Challenge: Benchmark and Results
Shen, J., Zafeiriou, S., Chrysos, G. G., Kossaifi, J., Tzimiropoulos, G., & Pantic, M. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.132 · Cited by 292
Advancing High Fidelity Identity Swapping for Forgery Detection
Li, L., Bao, J., Yang, H., Chen, D., & Wen, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00512 · Cited by 288
On Face Segmentation, Face Swapping, and Face Perception
Nirkin, Y., Masi, I., Tran Tuan, A., Hassner, T., & Medioni, G. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00024 · Cited by 285
Ferrara, M., Franco, A., & Maltoni, D. (2014) · IEEE International Joint Conference on Biometrics · doi:10.1109/btas.2014.6996240 · Cited by 278 · cited 2×
“…autoencoder (VAE) + GANs [100], multi-domain Moreover, spatial attention in GANs [99], variational autoencoder (VAE) + GANs [100], multi-domain GANs [101], geometry-aware GANs [102], mask-guided GANs [103], 3D face morphable model [104], and GIMP animation [105] based methods have been designed.”
BackgroundMethodEditing in Style: Uncovering the Local Semantics of GANs
Collins, E., Bala, R., Price, B., & Susstrunk, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00581 · Cited by 268
FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Faces
Wang, R., Juefei-Xu, F., Ma, L., Xie, X., Huang, Y., Wang, J., & Liu, Y. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/476 · Cited by 250 · cited 1×
“While GAN fingerprint + CNNs [125], PRNU [126], co-occurrence matrices [127], neuron behaviors [128], incremental learning + CNNs [129], and self-attention mechanism [130] were also utilized.”
MethodNot made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization
Chugh, K., Gupta, P., Dhall, A., & Subramanian, R. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413700 · Cited by 225 · cited 1×
“…(LSTM) and recurrent neural network (RNN) [67], multi-LSTM and blockchain [68], clustering [69], context [70], compression artifacts [71], metric learning [72], CNN ensemble [73], Identity-aware [74], transformers [75], audio-visual dissonance [76], and multi-attentional [77] features were used.”
MethodID-Reveal: Identity-aware DeepFake Video Detection
Cozzolino, D., Rossler, A., Thies, J., Niesner, M., & Verdoliva, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01483 · Cited by 221 · cited 2×
“Also, warping artifacts [63], eye blinking [64], optical flow with CNNs [65], heart rate [66], image quality [28], local image textures [37], long short-term memory (LSTM) and recurrent neural network (RNN) [67], multi-LSTM and blockchain [68], clustering [69], context [70], compression artifacts [71], metric learning…”
MethodDetecting GAN-Generated Imagery Using Saturation Cues
McCloskey, S., & Albright, M. (2019) · 2019 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2019.8803661 · Cited by 220
Deepfakes: Deceptions, mitigations, and opportunities
Mustak, M., Salminen, J., Mäntymäki, M., Rahman, A., & Dwivedi, Y. K. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2022.113368 · Cited by 209 · cited 2×
“Moreover, most survey articles (e.g., [4,49,50]) were mainly written from an academic point of view and not from a practical development point of view.”
BackgroundAdversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examples
Hussain, S., Neekhara, P., Jere, M., Koushanfar, F., & McAuley, J. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00339 · Cited by 204 · cited 2×
“Recent studies have shown that deep learning-based deepfake and face manipulation detection methods are vulnerable to adversarial examples [44].”
BackgroundFENeRF: Face Editing in Neural Radiance Fields
Sun, J., Wang, X., Zhang, Y., Li, X., Zhang, Q., Liu, Y., & Wang, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00752 · Cited by 197
ELEGANT: Exchanging Latent Encodings with GAN for Transferring Multiple Face Attributes
Xiao, T., Hong, J., & Ma, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_11 · Cited by 196
Anticipating and Addressing the Ethical Implications of Deepfakes in the Context of Elections
Diakopoulos, N., & Johnson, D. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3474183 · Cited by 194
Anticipating and addressing the ethical implications of deepfakes in the context of elections
Diakopoulos, N., & Johnson, D. (2021) · New Media & Society · doi:10.1177/1461444820925811 · Cited by 192 · cited 1×
“…them [20], Therefore, there is a crucial gap between academic deepfake solutions and real-world scenarios or requirements. manipulating elections [21], creating warmongering situations [22], generating political or religious unrest via fake speeches For instance, the fore-going works are usually…”
BackgroundCountering Malicious DeepFakes: Survey, Battleground, and Horizon
Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01606-8 · Cited by 191 · cited 3×
“, [5,24,47,48]), but they are focused mainly on deepfake or synthetic samples using generative adversarial networks.”
BackgroundDeepfake generation and detection, a survey
Zhang, T. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11733-y · Cited by 176 · cited 2×
“Moreover, most survey articles (e.g., [4,49,50]) were mainly written from an academic point of view and not from a practical development point of view.”
BackgroundDetecting Photoshopped Faces by Scripting Photoshop
Wang, S.-Y., Wang, O., Zhang, R., Owens, A., & Efros, A. A. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01017 · Cited by 172
Fake face detection via adaptive manipulation traces extraction network
Guo, Z., Yang, G., Chen, J., & Sun, X. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103170 · Cited by 165
Vulnerability assessment and detection of Deepfake videos
Korshunov, P., & Marcel, S. (2019) · 2019 International Conference on Biometrics (ICB) · doi:10.1109/icb45273.2019.8987375 · Cited by 162 · cited 4×
“[28], 50–99% under morphing [29], 17.08% under makeup manipulation [30], 17.05–99.77% under partial face tampering [31], 40–74% Thus, this paper provides a concise but comprehensive overview from both theoretical and practical points of view to furnish the reader with an intellectual grasp as well…”
BackgroundMethodInfluentialAISHELL-3: A Multi-Speaker Mandarin TTS Corpus
Shi, Y., Bu, H., Xu, X., Zhang, S., & Li, M. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-755 · Cited by 160
Generative Adversarial Network with Spatial Attention for Face Attribute Editing
Zhang, G., Kan, M., Shan, S., & Chen, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_26 · Cited by 159 · cited 1×
“Moreover, spatial attention in GANs [99], variational autoencoder (VAE) + GANs [100], multi-domain GANs [101], geometry-aware GANs [102], mask-guided GANs [103], 3D face morphable model [104], and GIMP animation [105] based methods have been designed.”
MethodIncremental learning for the detection and classification of GAN-generated images
Marra, F., Saltori, C., Boato, G., & Verdoliva, L. (2019) · 2019 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs47025.2019.9035099 · Cited by 154
Detecting Facial Retouching Using Supervised Deep Learning
Bharati, A., Singh, R., Vatsa, M., & Bowyer, K. W. (2016) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2561898 · Cited by 140 · cited 1×
“The Deep Boltzmann machine by Bharati et al. [106], CNN by Dang et al. [107], LBP + landmarks + CNNs by Rathgeb et al. [108], adaptive manipulation traces by Guo et al. [109], encoder-decoder by Mazaheri et al. [110], facial boundary features by Kim et al. [111], and PRNU by Scherhag et al. [112]…”
MethodRSGAN: face swapping and editing using face and hair representation in latent spaces
Natsume, R., Yatagawa, T., & Morishima, S. (2018) · ACM SIGGRAPH 2018 Posters · doi:10.1145/3230744.3230818 · Cited by 140 · cited 2×
“[56] proposed a region-separative generative adversarial network (RSGAN) for face swapping and editing.”
BackgroundMethodScherhag, U., Nautsch, A., Rathgeb, C., Gomez‐Barrero, M., Veldhuis, R. N. J., Spreeuwers, L., Schils, M., Maltoni, D., Grother, P. J., Marcel, S., et al. (2017) · International Conference of the Biometrics Special Interest Group (BIOSIG) · doi:10.23919/biosig.2017.8053499 · Cited by 138 · cited 1×
“For instance, studies have shown that AFRS’s error rates can reach up to 95% under deepfakes [28], 50–99% under morphing [29], 17.”
BackgroundImproving Generalization by Commonality Learning in Face Forgery Detection
Yu, P., Fei, J., Xia, Z., Zhou, Z., & Weng, J. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3146781 · Cited by 131
Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editing
Kim, H., Choi, Y., Kim, J., Yoo, S., & Uh, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00091 · Cited by 130
Арсеньевич, П. К. (2020) · Advanced sciences and technologies for security applications · doi:10.1007/978-3-030-35746-7_3 · Cited by 126 · cited 2×
“Deepfak s can also be used for destructive applications such as the use of fake pornogr phic vide s to damag a p rson’s reputation or to blackmail them [20], manipulating elections [21], creating warmongering situations [22], generating political or religious unrest via fake speeches [23], causing chaos in financial m…”
BackgroundDetection of Face Morphing Attacks Based on PRNU Analysis
Scherhag, U., Debiasi, L., Rathgeb, C., Busch, C., & Uhl, A. (2019) · IEEE Transactions on Biometrics, Behavior, and Identity Science · doi:10.1109/tbiom.2019.2942395 · Cited by 121 · cited 1×
“…machine by Bharati et al. [106], CNN by Dang et al. [107], LBP + landmarks + CNNs by Rathgeb et al. [108], adaptive manipulation traces by Guo et al. [109], encoder-decoder by Mazaheri et al. [110], facial boundary features by Kim et al. [111], and PRNU by Scherhag et al. [112] were exploited.”
BackgroundFReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning
Kim, M., Tariq, S., & Woo, S. S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00111 · Cited by 118
Attacks on state-of-the-art face recognition using attentional adversarial attack generative network
Yang, L., Song, Q., & Wu, Y. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09604-z · Cited by 116 · cited 2×
“82% under adversarial examples [33], and 67% under GANs generated synthetic samples [34].”
BackgroundInterpretable and Trustworthy Deepfake Detection via Dynamic Prototypes
Trinh, L., Tsang, M., Rambhatla, S., & Liu, Y. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00202 · Cited by 115 · cited 1×
“, [78]) and generalization capability (e.”
Face image manipulation detection based on a convolutional neural network
Dang, L. M., Hassan, S. I., Im, S., & Moon, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.04.005 · Cited by 114 · cited 1×
“The Deep Boltzmann machine by Bharati et al. [106], CNN by Dang et al. [107], LBP + landmarks + CNNs by Rathgeb et al. [108], adaptive manipulation traces by Guo et al. [109], encoder-decoder by Mazaheri et al. [110], facial boundary features by Kim et al. [111], and PRNU by Scherhag et al. [112]…”
MethodPredicting Heart Rate Variations of Deepfake Videos using Neural ODE
Fernandes, S., Raj, S., Ortiz, E., Vintila, I., Salter, M., Urosevic, G., & Jha, S. K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00213 · Cited by 112 · cited 1×
“Also, warping artifacts [63], eye blinking [64], optical flow with CNNs [65], heart rate [66], image quality [28], local image textures [37], long short-term memory (LSTM) and recurrent neural network (RNN) [67], multi-LSTM and blockchain [68], clustering [69], context [70], compression artifacts [71], metric learning…”
MethodFReeNet: Multi-Identity Face Reenactment
Zhang, J., Zeng, X., Wang, M., Pan, Y., Liu, L., Liu, Y., Ding, Y., & Fan, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00537 · Cited by 111 · cited 2×
“…with geometry-aware generator, GANs, and task-agnostic GANs-based schemes were designed by Kim et al. [83], Nirkin et al. [84], Zhang et al. [85], Doukas et al. [86], and Cao et al. [87], respectively. task-agnostic GANs-based schemes by Kim et al. [83], Nirkin et al. [84], Zhang et al.…”
MethodAnycost GANs for Interactive Image Synthesis and Editing
Lin, J., Zhang, R., Ganz, F., Han, S., & Zhu, J.-Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01474 · Cited by 111 · cited 1×
“…various approaches have been devised, e.g., coupled GANs [117], invertible convolution [118], U-Net [119], from speech to face GANs [120], high-resolution deep convolutional GANs [121], interactive anycost GANs [122], and structured disentanglement framework for face generation and editing [123].”
Deep convolutional pooling transformer for deepfake detection
Wang, T., Cheng, H., Chow, K. P., & Nie, L. (2023) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3588574 · Cited by 111 · cited 2×
“Also, prior studies considered deepfake detection a reactive defense mechanism and not as a battle between the attackers (i.e., deepfake generation methods) and the defenders (i.e., deepfake detection methods) [41–43].”
BackgroundMobileFaceSwap: A Lightweight Framework for Video Face Swapping
Xu, Z., Hong, Z., Ding, C., Zhu, Z., Han, J., Liu, J., & Ding, E. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20203 · Cited by 110
Generative Attribute Controller with Conditional Filtered Generative Adversarial Networks
Kaneko, T., Hiramatsu, K., & Kashino, K. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.741 · Cited by 106 · cited 1×
“This consists of generating entire non-existent face images [113–115].”
BackgroundDefending Your Voice: Adversarial Attack on Voice Conversion
Huang, C., Lin, Y. Y., Lee, H.-Y., & Lee, L.-S. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383529 · Cited by 96 · cited 2×
“Similarly, au omated speaker verif cation’s a curacy drops to 40% from 98% under adversarial examples [35].”
BackgroundCoupled Generative Adversarial Networks
Liu, M.-Y., & Tuzel, O. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.07536 · Cited by 95
Eyes Tell All: Irregular Pupil Shapes Reveal GAN-Generated Faces
Guo, H., Hu, S., Wang, X., Chang, M.-C., & Lyu, S. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9746597 · Cited by 94
Detecting Deepfakes with Metric Learning
Kumar, A., Bhavsar, A., & Verma, R. (2020) · 2020 8th International Workshop on Biometrics and Forensics (IWBF) · doi:10.1109/iwbf49977.2020.9107962 · Cited by 90 · cited 1×
“Also, warping artifacts [63], eye blinking [64], optical flow with CNNs [65], heart rate [66], image quality [28], local image textures [37], long short-term memory (LSTM) and recurrent neural network (RNN) [67], multi-LSTM and blockchain [68], clustering [69], context [70], compression artifacts [71], metric learning…”
MethodLi, Y., Chen, X., Wu, F. H., & Zha, Z.-J. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350854 · Cited by 82
Detecting Face2Face Facial Reenactment in Videos
Kumar, P., Vatsa, M., & Singh, R. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093628 · Cited by 82 · cited 1×
“[92] using multistream CNNs; and Wang et al.”
MethodDetecting Deepfake Voice Using Explainable Deep Learning Techniques
Lim, S.-Y., Chae, D.-K., & Lee, S.-C. (2022) · Applied Sciences · doi:10.3390/app12083926 · Cited by 82 · cited 2×
“…creating warmongering situations [22], generating political or religious unrest via fake speeches For instance, the fore-going works are usually lagging in the robustness of the systems against adversarial attacks [44], decision explainability [45], and real-time mobile deepfake detection [46].”
BackgroundRethinking gradient operator for exposing AI-enabled face forgeries
Guo, Z., Yang, G., Zhang, D., & Xia, M. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119361 · Cited by 74
DeepFaceEditing: deep face generation and editing with disentangled geometry and appearance control
Chen, S., Liu, F., Lai, Y., Rosin, P. L., Li, C., Fu, H., & Gao, L. (2021) · ACM Transactions on Graphics · doi:10.1145/3450626.3459760 · Cited by 73
FACEGAN: Facial Attribute Controllable rEenactment GAN
Tripathy, S., Kannala, J., & Rahtu, E. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00137 · Cited by 71
StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesis
Li, Z., Min, M. R., Li, K., & Xu, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01766 · Cited by 68
Face Editing Based on Facial Recognition Features
Ning, X., Xu, S., Nan, F., Zeng, Q., Wang, C., Cai, W., Li, W., & Jiang, Y. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3182650 · Cited by 67
GAGAN: Geometry-Aware Generative Adversarial Networks
Kossaifi, J., Tran, L., Panagakis, Y., & Pantić, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00098 · Cited by 66
On the use of automatically generated synthetic image datasets for benchmarking face recognition
Colbois, L., Pereira, T. D. F., & Marcel, S. (2021) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb52358.2021.9484363 · Cited by 61 · cited 2×
“82% under adversarial examples [33], and 67% under GANs generated synthetic samples [34].”
BackgroundCYBORG: Blending Human Saliency Into the Loss Improves Deep Learning-Based Synthetic Face Detection
Boyd, A., Tinsley, P., Bowyer, K. W., & Czajka, A. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00605 · Cited by 60
A video is worth more than 1000 lies. Comparing 3DCNN approaches for detecting deepfakes
Wang, Y., & Dantcheva, A. (2020) · 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020) · doi:10.1109/fg47880.2020.00089 · Cited by 59 · cited 2×
“…Matern et al. [89] using visual features with logistic regression and MLP; Rossler et al. [90] using mesoscopic, steganalysis, and CNN features; Sabir et al. [91] using RNN; Amerini et al. [65] using Optical Flow + CNNs; Kumar et al. [92] using multistream CNNs; and Wang et al. [93] using 3DCNN. .”
MethodOne-shot Face ReenactmentPreprint
Zhang, Y., Zhang, S., He, Y. L., Li, C., Loy, C. C., & Liu, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.03251 · Cited by 52
Evading Face Recognition via Partial Tampering of Faces
Majumdar, P., Agarwal, A., Singh, R., & Vatsa, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00008 · Cited by 48 · cited 1×
“77% under partial face tampering [31], 40–74% under digital beautification [32], 93.”
BackgroundHead2Head++: Deep Facial Attributes Re-Targeting
Doukas, M. C., Koujan, M. R., Sharmanska, V., Roussos, A., & Zafeiriou, S. (2021) · IEEE Transactions on Biometrics, Behavior, and Identity Science · doi:10.1109/tbiom.2021.3049576 · Cited by 48 · cited 2×
“…and task-agnostic GANs-based schemes were designed by Kim et al. [83], Nirkin et al. [84], Zhang et al. [85], Doukas et al. [86], and Cao et al. [87], respectively. task-agnostic GANs-based schemes by Kim et al. [83], Nirkin et al. [84], Zhang et al. [85], Doukas et al. [86], and respectively.”
Method“Combating deepfakes: multi-LSTM and blockchain as proof of authenticity for digital media,”
Ki Chan, C. C., Kumar, V., Delaney, S., & Gochoo, M. (2020) · 2020 IEEE / ITU International Conference on Artificial Intelligence for Good (AI4G) · doi:10.1109/ai4g50087.2020.9311067 · Cited by 48 · cited 1×
“Also, warping artifacts [63], eye blinking [64], optical flow with CNNs [65], heart rate [66], image quality [28], local image textures [37], long short-term memory (LSTM) and recurrent neural network (RNN) [67], multi-LSTM and blockchain [68], clustering [69], context [70], compression artifacts [71], metric learning…”
MethodDetection and Localization of Facial Expression Manipulations
Mazaheri, G., & Roy-Chowdhury, A. K. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00283 · Cited by 44
HCiT: Deepfake Video Detection Using a Hybrid Model of CNN features and Vision Transformer
Kaddar, B., Fezza, S. A., Hamidouche, W., Akhtar, Z., & Hadid, A. (2021) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip53242.2021.9675402 · Cited by 43
Self-citationA Comparative Evaluation of Local Feature Descriptors for DeepFakes Detection
Akhtar, Z., & Dasgupta, D. (2019) · 2019 IEEE International Symposium on Technologies for Homeland Security (HST) · doi:10.1109/hst47167.2019.9033005 · Cited by 42 · cited 1×
“Also, warping artifacts [63], eye blinking [64], optical flow with CNNs [65], heart rate [66], image quality [28], local image textures [37], long short-term memory (LSTM) and recurrent neural network (RNN) [67], multi-LSTM and blockchain [68], clustering [69], context [70], compression artifacts…”
BackgroundSelf-citationFaceController: Controllable Attribute Editing for Face in the Wild
Xu, Z., Yu, X., Hong, Z., Zhu, Z., Han, J., Liu, J., Ding, E., & Bai, X. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16417 · Cited by 41
Differential Detection of Facial Retouching: A Multi-Biometric Approach
Rathgeb, C., Satnoianu, C.-I., Haryanto, N. E., Bernardo, K., & Busch, C. (2020) · IEEE Access · doi:10.1109/access.2020.3000254 · Cited by 40 · cited 1×
“The Deep Boltzmann machine by Bharati et al. [106], CNN by Dang et al. [107], LBP + landmarks + CNNs by Rathgeb et al. [108], adaptive manipulation traces by Guo et al. [109], encoder-decoder by Mazaheri et al. [110], facial boundary features by Kim et al. [111], and PRNU by Scherhag et al. [112]…”
MethodAttributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints
Yu, N., Davis, L. S., & Fritz, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.08180 · Cited by 38
Talking Face Generation with Multilingual TTS
Song, H., Woo, S. H., Lee, J., Yang, S., Cho, H., Lee, Y., Choi, D., & Kim, K. W. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.02074 · Cited by 38
Berthouzoz, F., Li, W., Dontcheva, M., & Agrawala, M. (2011) · ACM Transactions on Graphics · doi:10.1145/2019627.2019639 · Cited by 37
Talking Face Generation by Adversarially Disentangled Audio-Visual RepresentationPreprint
Zhou, H., Liu, Y., Liu, Z., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.07860 · Cited by 37
Few-Shot Head Swapping in the Wild
Shu, C., Wu, H., Zhou, H., Liu, J., Hong, Z., Ding, C., Han, J., Liu, J., Ding, E., & Wang, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01052 · Cited by 35
SREFI: Synthesis of realistic example face images
Banerjee, S., Bernhard, J. S., Scheirer, W. J., Bowyer, K. W., & Flynn, P. J. (2017) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/btas.2017.8272680 · Cited by 34
SwapItUp: A Face Swap Application for Privacy Protection
Mahajan, S., Chen, L., & Tsai, T.-C. (2017) · International Conference on Advanced Information Networking and Applications (AINA) · doi:10.1109/aina.2017.53 · Cited by 34 · cited 1×
“[54] presented a face swap procedure for privacy protection.”
BackgroundUtility of Deep Learning Features for Facial Attributes Manipulation Detection
Akhtar, Z., Mouree, M. R., & Dasgupta, D. (2020) · doi:10.1109/hccai49649.2020.00015 · Cited by 34 · cited 3×
“…and misinformation However, a systematic analysis shows that the majority of them have low generalization capability, i.e., their performances drop drastically when they encounter a novel deepfake/manipulation type that was not used during the training stage, as also demonstrated in [36–40].”
BackgroundMethodSelf-citationFakeBuster: A DeepFakes Detection Tool for Video Conferencing Scenarios
Mehta, V., Gupta, P., Subramanian, R., & Dhall, A. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397482.3450726 · Cited by 34 · cited 2×
“…creating warmongering situations [22], generating political or religious unrest via fake speeches For instance, the fore-going works are usually lagging in the robustness of the systems against adversarial attacks [44], decision explainability [45], and real-time mobile deepfake detection [46].”
BackgroundMask-aware photorealistic facial attribute manipulation
Sun, R., Huang, C., Zhu, H., & Ma, L. (2021) · Computational Visual Media · doi:10.1007/s41095-021-0219-7 · Cited by 33 · cited 1×
“Moreover, spatial attention Xiao et al. [98] presented a multi-attribute manipulation GANs-based system. variational autoencoder (VAE) + GANs [100], multi-domain Moreover, spatial attention in GANs [99], variational autoencoder (VAE) + GANs [100], multi-domain GANs [101], geometry-aware GANs [102],…”
BackgroundFace Authenticity: An Overview of Face Manipulation Generation, Detection and RecognitionPreprint
Akhtar, Z., Dasgupta, D., & Banerjee, B. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3419272 · Cited by 33 · cited 3×
“Moreover, most survey articles (e.g., [4,49,50]) were mainly written from an academic point of view and not from a practical development point of view.”
BackgroundMethodSelf-citationDeep Learning Based One-Class Detection System for Fake Faces Generated by GAN Network
Li, S., Dutta, V., He, X., & Matsumaru, T. (2022) · Sensors · doi:10.3390/s22207767 · Cited by 33 · cited 1×
“While GAN fingerprint + CNNs [125], PRNU [126], co-occurrence matrices [127], neuron behaviors [128], incremental learning + CNNs [129], and self-attention mechanism [130] were also utilized.”
MethodRecent Progress of Face Image Synthesis
Lu, Z., Li, Z., Cao, J., He, R., & Sun, Z. (2017) · Asian Conference on Pattern Recognition · doi:10.1109/acpr.2017.2 · Cited by 32
Ferreira, A., Nowroozi, E., & Barni, M. (2021) · Journal of Imaging · doi:10.3390/jimaging7030050 · Cited by 32
UniFaceGAN: A Unified Framework for Temporally Consistent Facial Video Editing
Cao, M., Huang, H., Wang, H., Wang, X., Shen, L., Wang, S., Bao, L., Li, Z., & Luo, J. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3089909 · Cited by 31
NoiseScope: Detecting Deepfake Images in a Blind Setting
Pu, J., Mangaokar, N., Wang, B., Reddy, C. K., & Viswanath, B. (2020) · Annual Computer Security Applications Conference · doi:10.1145/3427228.3427285 · Cited by 30
Agarwal, M., Mukhopadhyay, R., Namboodiri, V., & Jawahar, C. V. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00515 · Cited by 28
Detecting Photoshopped Faces by Scripting PhotoshopPreprint
Wang, S.-Y., Wang, O., Owens, A., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05856 · Cited by 27
Video Face Manipulation Detection Through Ensemble of CNNs
Bonettini, N., Cannas, E. D., Mandelli, S., Bondi, L., Bestagini, P., & Tubaro, S. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9412711 · Cited by 27 · cited 1×
“Also, warping artifacts [63], eye blinking [64], optical flow with CNNs [65], heart rate [66], image quality [28], local image textures [37], long short-term memory (LSTM) and recurrent neural network (RNN) [67], multi-LSTM and blockchain [68], clustering [69], context [70], compression artifacts [71], metric learning…”
MethodDetection of Makeup Presentation Attacks based on Deep Face Representations
Rathgeb, C., Drozdowski, P., & Busch, C. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9413347 · Cited by 26 · cited 1×
“08% under makeup manipulation [30], 17.”
Towards Generalizable and Robust Face Manipulation Detection via Bag-of-feature
Miao, C., Chu, Q., Li, W., Gong, T., Zhuang, W., & Yu, N. (2021) · 2021 International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip53242.2021.9675331 · Cited by 26
Zhao, X., Yu, Y., Ni, R., & Zhao, Y. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746061 · Cited by 26 · cited 2×
“[94] designed a spatiotemporal network, which can utilize complementary global and local information.”
BackgroundDeepfake Detection with Clustering-based Embedding Regularization
Zhu, K., Wu, B., & Wang, B. (2020) · IEEE International Conference on Data Science in Cyberspace · doi:10.1109/dsc50466.2020.00046 · Cited by 25 · cited 1×
“Also, warping artifacts [63], eye blinking [64], optical flow with CNNs [65], heart rate [66], image quality [28], local image textures [37], long short-term memory (LSTM) and recurrent neural network (RNN) [67], multi-LSTM and blockchain [68], clustering [69], context [70], compression artifacts [71], metric learning…”
MethodCross-Dataset Face Manipulation Detection
Bekci, B., Akhtar, Z., & Ekenel, H. K. (2020) · Signal Processing and Communications Applications Conference (SIU) · doi:10.1109/siu49456.2020.9302157 · Cited by 24 · cited 1×
“Very few works have been focused on deepfake detection method’s explainability (e.g., [78]) and generalization capability (e.g., work of Bekci et al. in [38] and Aneja et al. [79] work using zero-shot learning).”
BackgroundSelf-citationFake visual content detection using two-stream convolutional neural networks
Yousaf, B., Usama, M., Sultani, W., Mahmood, A., & Qadir, J. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-06902-5 · Cited by 23
Spotting Deepfakes and Face Manipulations by Fusing Features from Multi-Stream CNNs Models
Yavuzkılıç, S., Şengür, A., Akhtar, Z., & Siddique, K. (2021) · Symmetry · doi:10.3390/sym13081352 · Cited by 23
Self-citationMagGAN: High-Resolution Face Attribute Editing with Mask-Guided Generative Adversarial Network
Wei, Y., Gan, Z., Li, W., Lyu, S., Chang, M., Zhang, L., Gao, J., & Zhang, P. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69538-5_40 · Cited by 23
LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speech
Zen, H., Dang, V., Clark, R., Zhang, Y., Weiss, R. J., Jia, Y., Chen, Z., & Wu, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.02882 · Cited by 23
On the Impact of Alterations on Face Photo Recognition Accuracy
Ferrara, M., Franco, A., Maltoni, D., & Sun, Y. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-41181-6_75 · Cited by 22 · cited 1×
“77% under partial face tampering [31], 40–74% under digital beautification [32], 93.”
BackgroundEfficient-Frequency: a hybrid visual forensic framework for facial forgery detection
Du, C. X. T., Duong, L. H., Trung, H. T., Tam, P. M., Nguyen, Q. V. H., & Jo, J. H. (2020) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308305 · Cited by 22
IA-FaceS: A bidirectional method for semantic face editing
Huang, W., Tu, S., & Xu, L. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.11.016 · Cited by 22
Detecting High-quality GAN-generated Face Images using Neural Networks
Nowroozi, E., & Mekdad, Y. (2023) · River Publishers eBooks · doi:10.1201/9781003373384-12 · Cited by 22
Video Face Swap Based on Autoencoder Generation Network
Yan, S., He, S., Lei, X., Ye, G., & Xie, Z. (2018) · International Conference on Audio, Language and Image Processing · doi:10.1109/icalip.2018.8455775 · Cited by 14 · cited 1×
“Other interesting face swamping methods can be seen in [28,57–61].”
MethodChen, S., Liu, F., Lai, Y., et al. (2021) · ACM Transactions on Graphics · doi:10.1145/3476576.3476648 · Cited by 12
Crowd-Powered Face Manipulation Detection: Fusing Human Examiner Decisions
Rathgeb, C., Nichols, R., Ibsen, M., Drozdowski, P., & Busch, C. (2022) · Proceedings - International Conference on Image Processing · doi:10.1109/icip46576.2022.9897841 · Cited by 10
GGViT:Multistream Vision Transformer Network in Face2Face Facial Reenactment Detection
Wu, H., Wang, P., Wang, X., Xiang, J., & Gong, R. (2022) · 2022 26th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr56361.2022.9956243 · Cited by 10
DeepFake Face Video Detection Using Hybrid Deep Residual Networks and LSTM Architecture
Yavuzkılıç, S., Akhtar, Z., Şengür, A., & Siddique, K. (2021) · CRC Press eBooks · doi:10.1201/9781003003489-4 · Cited by 9 · cited 2×
“…mechanism and not as a battle between the attackers (i.e., deepfake generation methods) and the defenders (i.e., deepfake detection methods) [41–43]. sources to the next level, which could be exploited by trolls, bots, conspiracy theorists, hyperparti-san media, and foreign governments; thus,…”
BackgroundSelf-citationDetecting “DeepFakes” in H.264 Video Data Using Compression Ghost Artifacts
Frick, R. A., Zmudzinski, S., & Steinebach, M. (2020) · Electronic Imaging · doi:10.2352/issn.2470-1173.2020.4.mwsf-116 · Cited by 7 · cited 1×
“Also, warping artifacts [63], eye blinking [64], optical flow with CNNs [65], heart rate [66], image quality [28], local image textures [37], long short-term memory (LSTM) and recurrent neural network (RNN) [67], multi-LSTM and blockchain [68], clustering [69], context [70], compression artifacts [71], metric learning…”
MethodUnknown presentation attack detection against rational attackers
Khodabakhsh, A., & Akhtar, Z. (2021) · IET Biometrics · doi:10.1049/bme2.12053 · Cited by 7
Self-citationRobust and Real-Time Face Swapping Based on Face Segmentation and CANDIDE-3
Wang, H., Xie, D., & Wei, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-97310-4_38 · Cited by 6 · cited 2×
“[55] Real-time face swapping using CANDIDE-3 COFW [132], 300W [133], LFW [134] SWR = 87.”
MethodMagGAN: High-Resolution Face Attribute Editing with Mask-Guided Generative Adversarial NetworkPreprint
Wei, Y., Gan, Z., Li, W., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01424 · Cited by 6
Unified Application of Style Transfer for Face Swapping and Reenactment
Ngo, M., de Wiel, C. A., Karaoğlu, S., & Gevers, T. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69541-5_15 · Cited by 6
Mishra, S., Shukla, A. K., & Muhuri, P. K. (2022) · Axioms · doi:10.3390/axioms11100489 · Cited by 6 · cited 1×
“For deepfake detection framework’s interpretability and dependability, various advanced combinations of techniques such as fuzzy inference systems [187], layer-wise relevance propagation [188], and the Neural Additive Model [189] could be helpful.”
MethodGeometry-Aware GAN for Face Attribute Transfer
Huang, D., Tao, X., Lü, J., & Do, M. N. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803830 · Cited by 4 · cited 2×
“…autoencoder (VAE) + GANs [100], multi-domain Moreover, spatial attention in GANs [99], variational autoencoder (VAE) + GANs [100], multi-domain GANs [101], geometry-aware GANs [102], mask-guided GANs [103], 3D face morphable model [104], and GIMP animation [105] based methods have been designed.”
BackgroundMethod
Research works printed but not linked: 18
- Li, L., Bao, J., Yang, H., Chen, D., and Wen, F. (2019). Faceshifter: Towards high fidelity and occlusion aware face swapping. arXiv.
- Koopman, M., Rodriguez, A., and Geradts, Z. (2018, January 29–31). Detection of deepfake video manipulation. Proceedings of the 20th Irish Machine Vision and Image Processing Conference (IMVIP), Coleraine, UK.
- Tariq, S., Lee, S., and Woo, S. (2020). A Convolutional LSTM based Residual Network for Deepfake Video Detection. arXiv.
- Nirkin, Y., Wolf, L., Keller, Y., and Hassner, T. (2020). DeepFake detection based on the discrepancy between the face and its context. arXiv.
- Aneja, S., and Nießner, M. (2020). Generalized Zero and Few-Shot Transfer for Facial Forgery Detection. arXiv.
- Liu, S., Lian, Z., Gu, S., and Xiao, L. (2022). Block shuffling learning for Deepfake Detection. arXiv.
- Cao, M., Huang, H., Wang, H., Wang, X., Shen, L., Wang, S., Bao, L., Li, L., and Luo, J. (2020). Task-agnostic Temporally Consistent Facial Video Editing. arXiv.
- Cozzolino, D., Thies, J., Rossler, A., Riess, C., Niener, M., and Verdoliva, L. (2018). Forensictransfer: Weakly-supervised domain adaptation for forgery detection. arXiv.
- Lu, J., Sunkavalli, K., Carr, N., Hadap, S., and Forsyth, D. (2016). A visual representation for editing face images. arXiv.
- Kim, D., Kim, D., and Kim, K. (2021). Facial Manipulation Detection Based on the Color Distribution Analysis in Edge Region. arXiv.
- Berthelot, D., Schumm, T., and Metz, L. (2017). Began: Boundary equilibrium generative adversarial networks. arXiv.
- Kingma, D., and Dhariwal, P. (2018). Glow: Generative flow with invertible 1 × 1 convolutions. arXiv.
- Choi, H., Park, C., and Lee, K. (2020). From inference to generation: End-to-end fully self-supervised generation of human face from speech. arXiv.
- Curtó, J., Zarza, I., De La Torre, F., King, I., and Lyu, M. (2017). High-resolution deep convolutional generative adversarial networks. arXiv.
- Prajapati, P., and Pollett, C. (2022). MRI-GAN: A Generalized Approach to Detect DeepFakes using Perceptual Image Assessment. arXiv.
- Karras, T., Aila, T., Laine, S., and Lehtinen, J. (2017). Progressive growing of gans for improved quality, stability, and variation. arXiv.
- Bounareli, S., Argyriou, V., and Tzimiropoulos, G. (2022). Finding Directions in GAN’s Latent Space for Neural Face Reenactment. arXiv.
- Lample, G., Zeghidour, N., Usunier, N., Bordes, A., Denoyer, L., and Ranzato, M. (2017). Fader networks: Manipulating images by sliding attributes. arXiv.
Cited by
Deepfake video detection: challenges and opportunities
Kaur, A., Noori Hoshyar, A., Saikrishna, V., Firmin, S., & Xia, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10810-6 · Cited by 214
“A person’s facial expression in the target image or video is swapped out with that of a different person in the source image or video (Xu et al. 2022; Akhtar 2023).”
Typology of Risks of Generative Text-to-Image Models
Bird, C., Ungless, E., & Kasirzadeh, A. (2023) · Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3600211.3604722 · Cited by 121
Deepfake Attacks: Generation, Detection, Datasets, Challenges, and Research Directions
Naitali, A., Ridouani, M., Salahdine, F., & Kaabouch, N. (2023) · Computers · doi:10.3390/computers12100216 · Cited by 117
Abbas, F., & Taeihagh, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124260 · Cited by 184
A Comprehensive Review of DeepFake Detection Using Advanced Machine Learning and Fusion Methods
Gupta, G., Raja, K., Gupta, M., Jan, T., Whiteside, S. T., & Prasad, M. (2023) · Electronics · doi:10.3390/electronics13010095 · Cited by 99
“The size of the DFD benchmark datasets further increased to over 100,000 videos in each dataset including DF-Platter in 2023 [8,9].”
Background
Metadata
- Authors
- Akhtar, Z.
- Affiliations
- State University of New York (US)
- Corresponding author
- Akhtar, Zahid
- ORCID
- Akhtar, Zahid
- Venue
- Journal of Imaging
- Publisher
- MDPI AG
- Published
- 2023-01-13
- Volume
- 9
- Issue
- 1
- Pages
- 18
- ISSN
- 2313-433X (ISSN-L)
- PMC
- PMC9863015
- OpenAlex
- W4315865725
- Cited by
- 106
- References
- 152
- Citations by year
- 2026: 26 · 2025: 27 · 2024: 41 · 2023: 12
- FWCI
- 2.75
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Imaging (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- deepfakes, deepfake detection, face manipulation, face reenactment, face synthesis, synthetic face generation, adversarial defense
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.