DeepFakes: a New Threat to Face Recognition? Assessment and Detection
Open accessAbstract
It is becoming increasingly easy to automatically replace a face of one person in a video with the face of another person by using a pre-trained generative adversarial network (GAN). Recent public scandals, e.g., the faces of celebrities being swapped onto pornographic videos, call for automated ways to detect these Deepfake videos. To help developing such methods, in this paper, we present the first publicly available set of Deepfake videos generated from videos of VidTIMIT database. We used open source software based on GANs to create the Deepfakes, and we emphasize that training and blending parameters can significantly impact the quality of the resulted videos. To demonstrate this impact, we generated videos with low and high visual quality (320 videos each) using differently tuned parameter sets. We showed that the state of the art face recognition systems based on VGG and Facenet neural networks are vulnerable to Deepfake videos, with 85.62% and 95.00% false acceptance rates respectively, which means methods for detecting Deepfake videos are necessary. By considering several baseline approaches, we found that audio-visual approach based on lip-sync inconsistency detection was not able to distinguish Deepfake videos. The best performing method, which is based on visual quality metrics and is often used in presentation attack detection domain, resulted in 8.97% equal error rate on high quality Deepfakes. Our experiments demonstrate that GAN-generated Deepfake videos are challenging for both face recognition systems and existing detection methods, and the further development of face swapping technology will make it even more so.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
DeepFake-TIMIT consists of 620 DeepFake videos of 32 subjects; each subject has 20 DeepFake videos, 10 of size 64×64 and 10 of size 128×128.
“The DeepFake-TIMIT dataset (Korshunov and Marcel 2018) consists of 620 DeepFake videos of 32 subjects. In DeepFake-TIMIT, each subject has 20 DeepFake videos. 10 videos are of size 64 × 64 while the other 10 videos are of size 128 × 128.”
From Countering Malicious DeepFakes: Survey, Battleground, and Horizon (2022) · cites this paper as Korshunov and Marcel 2018
The Introduction (p. 1) identifies 32 subjects, 10 source videos per subject, and two generated versions, and it reports a total of 620 DeepFake videos. But it also says there are 320 videos per version, which does not reconcile with 620 overall. The DeepFake Database section (p. 2) specifies that 64 × 64 and 128 × 128 are model input/output image sizes for facial regions, not the sizes of the videos. (LLM, conf=0.88)
Experimental — accuracy not yet measuredThe DF-TIMIT dataset is divided into two subsets: a low-quality set with 320 videos of size 64 × 64 dimensions and a high-quality set with a 128 × 128 frame size.
“A low-quality (LQ) set has 320 videos of size 64 × 64 dimensions and a high-quality (HQ) set with a 128 × 128 frame size.”
From Attention-based Multimodal learning framework for Generalized Audio-Visual Deepfake Detection (2023) · cites this paper as [76]
The Introduction (p. 1) says 320 videos were generated for each quality version and identifies 64 × 64 LQ and 128 × 128 HQ models. The Deepfake Database section (p. 2) specifies that these dimensions describe the models’ input/output facial regions, not the size of the full video frames. (LLM, conf=0.86)
Experimental — accuracy not yet measuredVisual modality datasets dominate with over 20 publicly available resources, while audio modality datasets are fewer, with 11 notable datasets.
“Visual modality datasets dominate with over 20 publicly available resources [29, 30, 30-44], while audio modality datasets are fewer, with 11 notable datasets [45-55].”
From Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness (2026) · cites this paper as [35]
VCF surpasses specialized datasets like DeepfakeTIMIT in scale while introducing four resolution tiers (1080p, 540p, 360p, 270p) and three compression levels (raw, c23, c40).
“With 1,920 authentic and 7,680 synthetic videos, VCF surpasses specialized datasets like DeepfakeTIMIT (Korshunov and Marcel, 2018) in scale while introducing four resolution tiers (1080p, 540p, 360p and 270p) and three compression levels (raw, c23 and c40) - features absent in most benchmarks.”
From VCF: A Real-World Video Conference Deepfake Benchmark for Face-Swap Detection and Robustness Evaluation (2025) · cites this paper as Korshunov and Marcel, 2018
The Deepfake TIMIT dataset contains videos with various visual artefacts and modifications, making it appropriate for testing deepfake detection algorithms.
“The dataset contains videos with various visual artefacts and modifications, making it appropriate for testing deepfake detection algorithms (Korshunov and Marcel 2018).”
From Deepfake video detection: challenges and opportunities (2024) · cites this paper as Korshunov and Marcel 2018
Most available datasets provide examples of face manipulations through either face swapping or face reenactment techniques.
“Most of the available datasets provide examples of face manipulations through either face swapping [16, 34, 77] or face reenactment [31, 35] techniques.”
From AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Dataset (2024) · cites this paper as [34]
The DF-TIMIT dataset contains a total of 620 fake videos created using 32 subjects.
“The other dataset used is the DF-TIMIT dataset which contains a total of 620 fake videos created by using 32 subjects.”
From Attention-based Multimodal learning framework for Generalized Audio-Visual Deepfake Detection (2023) · cites this paper as [76]
The DF-TIMIT dataset contains facial manipulated videos only; the audio channel in none of the videos has been altered.
“However, this dataset contains facial manipulated videos only, the audio channel in none of the videos has been altered.”
From Attention-based Multimodal learning framework for Generalized Audio-Visual Deepfake Detection (2023) · cites this paper as [76]
DeepFakes can effectively bypass face recognition systems, raising significant security concerns.
“suggesting that DeepFakes can effectively bypass face recognition systems, thereby raising significant security concerns.”
From Deepfake forensics: a survey of digital forensic methods for multimodal deepfake identification on social media (2024) · cites this paper as Korshunov & Sebastien (2018)
The authors of the EuroCity persons dataset argued that any anonymization measure will introduce a bias, and released their dataset with original data and a license agreement enforcing GDPR adherence; WoodScape will follow a similar approach.
“In the recent EuroCity persons dataset [5], the authors argued that any anonymization measure will introduce a bias.Thus they released their dataset with original data and a license agreement which enforces the user to strictly adhere to GDPR.We will follow a similar approach.”
From WoodScape: A Multi-Task, Multi-Camera Fisheye Dataset for Autonomous Driving (2019) · cites this paper as [5]
Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930 · see citing works
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267 · see citing works
Social Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767 · see citing works
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214 · see citing works
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479 · see citing works
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747 · see citing works
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089 · see citing works
Synthesizing Obama: learning lip sync from audio
Suwajanakorn, S., Seitz, S. M., & Kemelmacher-Shlizerman, I. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073640 · Cited by 1,057 · see citing works
Face Spoof Detection With Image Distortion Analysis
Wen, D., Han, H., & Jain, A. K. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2400395 · Cited by 911 · see citing works
Fast Face-Swap Using Convolutional Neural Networks
Korshunova, I., Shi, W., Dambre, J., & Theis, L. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.397 · Cited by 501 · see citing works
FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces
Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2018) · arXiv · doi:10.48550/arxiv.1803.09179 · Cited by 339 · see citing works
Face swapping: automatically replacing faces in photographs
Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P., & Nayar, S. K. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360638 · Cited by 333 · see citing works
On Face Segmentation, Face Swapping, and Face Perception
Nirkin, Y., Masi, I., Tuan, A. T., Hassner, T., & Medioni, G. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00024 · Cited by 302 · see citing works
Automated face swapping and its detection
Zhang, Y., Zheng, L., & Thing, V. L. L. (2017) · 2017 IEEE 2nd International Conference on Signal and Image Processing (ICSIP) · doi:10.1109/siprocess.2017.8124497 · Cited by 154 · see citing works
Speaker Inconsistency Detection in Tampered Video
Korshunov, P., & Marcel, S. (2018) · 2018 26th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553270 · Cited by 97 · see citing works
Self-citationSWAPPED! Digital face presentation attack detection via weighted local magnitude pattern
Agarwal, A., Singh, R., Vatsa, M., & Noore, A. (2017) · 2017 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/btas.2017.8272754 · Cited by 85 · see citing works
Deeply vulnerable: a study of the robustness of face recognition to presentation attacks
Mohammadi, A., Bhattacharjee, S., & Marcel, S. (2017) · IET Biometrics · doi:10.1049/iet-bmt.2017.0079 · Cited by 57 · see citing works
Self-citationPham, H., Wang, Y., & Pavlović, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.07716 · Cited by 29 · see citing works
SwapItUp: A Face Swap Application for Privacy Protection
Mahajan, S., Chen, L., & Tsai, T.-C. (2017) · International Conference on Advanced Information Networking and Applications (AINA) · doi:10.1109/aina.2017.53 · Cited by 28 · see citing works
Learning Multimodal Temporal Representation for Dubbing Detection in Broadcast Media
Le, N., & Odobez, J. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2967211 · Cited by 18 · see citing works
The image blending method for face swapping
Xingjie, Z., Song, J., & Park, J.-I. (2014) · 2014 4th IEEE International Conference on Network Infrastructure and Digital Content · doi:10.1109/icnidc.2014.7000272 · Cited by 15 · see citing works
Real-time face swapping in video sequences: Magic Mirror
Arar, N. M., Bekmezci, N. K., Güney, F., & Ekenel, H. K. (2011) · Signal Processing and Communications Applications Conference (SIU) · doi:10.1109/siu.2011.5929778 · Cited by 6 · see citing works
Who do you want to be? Real-time face swap
den Uyl, T. M., Tasli, H. E., Ivan, P., & Snijdewind, M. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163172 · Cited by 5 · see citing works
Flagged first, then by citations
1 of the 24 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- [12][12] J. Galbally and S. Marcel, 'Face anti-spoofing based on general image quality assessment,' in 2014 22nd International Conference on Pattern Recognition , Aug 2014, pp. 1173-1178. -
- [25][25] J. S. Chung, A. W. Senior, O. Vinyals, and A. Zisserman, 'Lip reading sentences in the wild,' CoRR , vol. abs/1611.05358, 2016. [Online]. Available: http://arxiv.org/abs/1611.05358 · arXiv
Cited by
Sorted by citations
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314 · see citing works
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · see citing works
“To date, we have the UADFV dataset [53], the DeepFake-TIMIT dataset (DF-TIMIT) [25], the FaceForenscics++ dataset (FF-DF) [40] 2 , the Google Deep-Fake detection dataset (DFD) [15], and the FaceBook Deep-Fake detection challenge (DFDC) dataset [14].”
MethodDeepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237 · see citing works
Exposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196 · see citing works
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979 · see citing works
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863 · see citing works
Exposing DeepFake Videos By Detecting Face Warping Artifacts
Li, Y., & Lyu, S. (2018) · arXiv · doi:10.48550/arxiv.1811.00656 · Cited by 785 · see citing works
On the Detection of Digital Face Manipulation
Dang, H., Liu, F., Stehouwer, J., Liu, X., & Jain, A. K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00582 · Cited by 764 · see citing works
Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain
Liu, H., Li, X., Zhou, W., Chen, Y., He, Y., Xue, H., Zhang, W., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00083 · Cited by 600 · see citing works
DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599 · see citing works
Deepfake Detection: A Systematic Literature Review
Rana, M. S., Nobi, M. N., Murali, B., & Sung, A. H. (2022) · IEEE Access · doi:10.1109/access.2022.3154404 · Cited by 573 · see citing works
Multi-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549 · see citing works
Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543 · see citing works
FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals
Ciftci, U. A., Demir, I., & Yin, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3009287 · Cited by 499 · see citing works
Two-Branch Recurrent Network for Isolating Deepfakes in Videos
Masi, I., Killekar, A., Mascarenhas, R. M., Gurudatt, S. P., & AbdAlmageed, W. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58571-6_39 · Cited by 471 · see citing works
Deep learning for deepfakes creation and detection: A survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103525 · Cited by 464 · see citing works
“Videos DeepfakeTIMIT [147] and DFDC [109].”
BackgroundInfluentialDeep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2019) · arXiv · doi:10.48550/arxiv.1909.11573 · Cited by 464
WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection
Zi, B., Chang, M., Chen, J., Ma, X., & Jiang, Y.-G. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413769 · Cited by 448 · see citing works
The deepfake detection challenge (dfdc) dataset
Dolhansky, B., Bitton, J., Pflaum, B., Lu, J., Howes, R., Wang, M., & Ferrer, C. C. (2020) · arXiv · doi:10.48550/arxiv.2006.07397 · Cited by 427 · see citing works
Learning Self-Consistency for Deepfake Detection
Zhao, T., Xu, X., Xu, M., Ding, H., Xiong, Y., & Xia, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01475 · Cited by 383 · see citing works
M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection
Wang, J., Wu, Z., Ouyang, W., Han, X., Chen, J., Jiang, Y.-G., & Li, S.-N. (2022) · Proceedings of the 2022 International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531415 · Cited by 368 · see citing works
Emotions Don't Lie: An Audio-Visual Deepfake Detection Method using Affective Cues
Mittal, T., Bhattacharya, U., Chandra, R., Bera, A., & Manocha, D. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413570 · Cited by 319 · see citing works
Advances in Adversarial Attacks and Defenses in Computer Vision: A Survey
Akhtar, N., Mian, A. S., Kardan, N., & Shah, M. (2021) · IEEE Access · doi:10.1109/access.2021.3127960 · Cited by 319 · see citing works
WoodScape: A Multi-Task, Multi-Camera Fisheye Dataset for Autonomous Driving
Yogamani, S., Hughes, C., Horgan, J., Sistu, G., Chennupati, S., Uricar, M., Milz, S., Simon, M., Amende, K., Witt, C., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00940 · Cited by 303 · see citing works
“is also the possibility of using GAN based re-targeting wherein faces are exchanged by automatically generated ones [31].”
BackgroundDeepFake Detection for Human Face Images and Videos: A Survey
Malik, A., Kuribayashi, M., Abdullahi, S. M., & Khan, A. N. (2022) · IEEE Access · doi:10.1109/access.2022.3151186 · Cited by 297 · see citing works
Combining EfficientNet and Vision Transformers for Video Deepfake Detection
Coccomini, D. A., Messina, N., Gennaro, C., & Falchi, F. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-06433-3_19 · Cited by 296 · see citing works
FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Faces
Wang, R., Juefei-Xu, F., Ma, L., Xie, X., Huang, Y., Wang, J., & Liu, Y. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/476 · Cited by 278 · see citing works
A Survey on Deepfake Video Detection
Yu, P., Xia, Z., Fei, J., & Lu, Y. (2021) · IET Biometrics · doi:10.1049/bme2.12031 · Cited by 253 · see citing works
Deepfake detection by human crowds, machines, and machine-informed crowds
Groh, M., Epstein, Z., Firestone, C., & Picard, R. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2110013119 · Cited by 248 · see citing works
Deepfake Detection: Current Challenges and Next Steps
Lyu, S. (2020) · 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew46912.2020.9105991 · Cited by 234 · see citing works
Recurrent convolutional structures for audio spoof and video deepfake detection
Chintha, A., Thai, B., Sohrawardi, S. J., Bhatt, K., Hickerson, A., Wright, M., & Ptucha, R. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2999185 · Cited by 226 · see citing works
Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization
Chugh, K., Gupta, P., Dhall, A., & Subramanian, R. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413700 · Cited by 225 · see citing works
A review on social spam detection: Challenges, open issues, and future directions
Rao, S., Verma, A. K., & Bhatia, T. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115742 · Cited by 225 · see citing works
Deepfake video detection: challenges and opportunities
Kaur, A., Noori Hoshyar, A., Saikrishna, V., Firmin, S., & Xia, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10810-6 · Cited by 214 · see citing works
AVoiD-DF: Audio-Visual Joint Learning for Detecting Deepfake
Yang, W., Zhou, X., Chen, Z., Guo, B., Ba, Z., Xia, Z., Cao, X., & Ren, K. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3262148 · Cited by 198 · see citing works
Fooled twice: People cannot detect deepfakes but think they can
Köbis, N. C., Doležalová, B., & Soraperra, I. (2021) · iScience · doi:10.1016/j.isci.2021.103364 · Cited by 193 · see citing works
Countering Malicious DeepFakes: Survey, Battleground, and Horizon
Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01606-8 · Cited by 191 · see citing works
“However, Korshunov and Marcel (2018) investigate several baselines for evaluating existing studies in DeepFake detection including lip-sync inconsistency detection.”
BackgroundMethodInfluentialOne Shot Face Swapping on Megapixels
Zhu, Y., Li, Q., Wang, J., Xu, C., & Sun, Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00480 · Cited by 189 · see citing works
Deepfake generation and detection: Case study and challenges
Patel, Y., Tanwar, S., Gupta, R., Bhattacharya, P., Davidson, I. E., Nyameko, R., Aluvala, S., & Vimal, V. (2023) · IEEE Access · doi:10.1109/access.2023.3342107 · Cited by 186 · see citing works
Deepfake generation and detection, a survey
Zhang, T. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11733-y · Cited by 176 · see citing works
F <sup>2</sup> Trans: High-Frequency Fine-Grained Transformer for Face Forgery Detection
Miao, C., Tan, Z., Chu, Q., Liu, H., Hu, H., & Yu, N. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3233774 · Cited by 172 · see citing works
Children as creators, thinkers and citizens in an AI-driven future
Ali, S., DiPaola, D., Lee, I. A., Sindato, V., Kim, G., Blumofe, R., & Breazeal, C. (2021) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2021.100040 · Cited by 172 · see citing works
Fake face detection via adaptive manipulation traces extraction network
Guo, Z., Yang, G., Chen, J., & Sun, X. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103170 · Cited by 165 · see citing works
ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis
He, Y., Gan, B., Chen, S., Zhou, Y., Yin, G., Song, L., Sheng, L., Shao, J., & Liu, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00434 · Cited by 161 · see citing works
Deepfake Detection using Spatiotemporal Convolutional NetworksPreprint
de Lima, O., Franklin, S., Basu, S., Karwoski, B., & George, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14749 · Cited by 159 · see citing works
Zhou, T., Wang, W., Liang, Z., & Shen, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00572 · Cited by 156 · see citing works
A comprehensive overview of Deepfake: generation, detection, datasets, and opportunities
Seow, J. W., Lim, M. K., Phan, R. C. W., & Liu, J. K. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.09.135 · Cited by 149 · see citing works
DeepFake video detection using convolutional vision transformer
Wodajo, D., & Atnafu, S. (2021) · arXiv · doi:10.48550/arxiv.2102.11126 · Cited by 147 · see citing works
Anti-Forensics for Face Swapping Videos via Adversarial Training
Ding, F., Zhu, G., -, Y. L., Zhang, X., Atrey, P. K., & Lyu, S. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3098422 · Cited by 146 · see citing works
KoDF: A Large-scale Korean DeepFake Detection Dataset
Kwon, P., You, J., Nam, G., Park, S., & Chae, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01057 · Cited by 145 · see citing works
Deepfakes Detection Techniques Using Deep Learning: A Survey
Almars, A. M. (2021) · Journal of Computer and Communications · doi:10.4236/jcc.2021.95003 · Cited by 143 · see citing works
Deep learning model for deep fake face recognition and detection
Suganthi, S. T., Ayoobkhan, M. U. A., Kumar, V. K., Bačanin, N., Venkatachalam, K., Hubálovský, Š., & Trojovský, P. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.881 · Cited by 140 · see citing works
Predicting Heart Rate Variations of Deepfake Videos using Neural ODE
Fernandes, S. L., Raj, S., Ortiz, E., Vintila, I., Salter, M., Urosevic, G., & Jha, S. K. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00213 · Cited by 137 · see citing works
A GAN-Based Model of Deepfake Detection in Social Media
Preeti, P., Kumar, M., & Sharma, H. K. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.01.191 · Cited by 133 · see citing works
A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
Mubarak, R., Alsboui, T., Alshaikh, O., Inuwa-Dutse, I., Khan, S., & Parkinson, S. (2023) · IEEE Access · doi:10.1109/access.2023.3344653 · Cited by 132 · see citing works
Defining the Scope of AI Regulations
Schuett, J. (2019) · Law Innovation and Technology · doi:10.1080/17579961.2023.2184135 · Cited by 133 · see citing works
DeepFake detection algorithm based on improved vision transformer
Heo, Y.-J., Yeo, W.-H., & Kim, B. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03867-9 · Cited by 127 · see citing works
Mitra, A., Mohanty, S. P., Corcoran, P., & Kougianos, E. (2021) · SN Computer Science · doi:10.1007/s42979-021-00495-x · Cited by 123 · see citing works
CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes
Huang, H., Wang, Y., Chen, Z., Zhang, Y., Li, Y., Tang, Z., Chu, W., Chen, J., Lin, W., & Ma, K. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19982 · Cited by 123 · see citing works
Voice-Face Homogeneity Tells Deepfake
Cheng, H. H., Guo, Y., Wang, T., Li, Q., Chang, X., & Nie, L. (2023) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3625231 · Cited by 123 · see citing works
Deep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, M. C., Nguyen, D. T., Nguyen, D. T., & Nahavandi, S. (2020) · Figshare · doi:10.6084/m9.figshare.12731039.v1 · Cited by 122 · see citing works
Detect and locate: Exposing face manipulation by semantic-and noise-level telltales
Kong, C., Chen, B., Li, H., Wang, S., Rocha, A., & Kwong, S. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3169921 · Cited by 120 · see citing works
Yang, J., Xiao, S., Li, A., Lu, W. B., Gao, X., & Li, Y. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3133859 · Cited by 117 · see citing works
FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset
Khalid, H., Tariq, S., Kim, M., & Woo, S. S. (2021) · arXiv · doi:10.48550/arxiv.2108.05080 · Cited by 116 · see citing works
Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes
Trinh, L., Tsang, M., Rambhatla, S., & Liu, Y. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00202 · Cited by 115 · see citing works
Hierarchical Frequency-Assisted Interactive Networks for Face Manipulation Detection
Miao, C.-T., Tan, Z., Chu, Q., Yu, N.-H., & Guo, G.-D. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3198275 · Cited by 110 · see citing works
(2020) · doi:10.1007/978-3-030-68821-9_38 · Cited by 113 · see citing works
Deepfake Media Forensics: Status and Future Challenges
Amerini, I., Barni, M., Battiato, S., Bestagini, P., Boato, G., Bruni, V., Caldelli, R., De Natale, F., De Nicola, R., Guarnera, L., et al. (2025) · Journal of Imaging · doi:10.3390/jimaging11030073 · Cited by 113 · see citing works
Evaluation of an Audio-Video Multimodal Deepfake Dataset using Unimodal and Multimodal Detectors
Khalid, H., Kim, M., Tariq, S., & Woo, S. S. (2021) · Proceedings of the 1st Workshop on Synthetic Multimedia - Audiovisual Deepfake Generation and Detection · doi:10.1145/3476099.3484315 · Cited by 110 · see citing works
A detailed analysis of image and video forgery detection techniques
Tyagi, S., & Yadav, D. (2023) · The Visual Computer · doi:10.1007/s00371-021-02347-4 · Cited by 109 · see citing works
Das, S., Seferbekov, S., Datta, A., Islam, M. S., & Amin, M. R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00421 · Cited by 107 · see citing works
Deepfake Detection: A Comprehensive Survey from the Reliability Perspective
Wang, T., Liao, X., Chow, K. P., Lin, X., & Wang, Y. (2025) · ACM Computing Surveys · doi:10.1145/3699710 · Cited by 107 · see citing works
Security and Privacy on Generative Data in AIGC: A Survey
Wang, T., Zhang, Y., Qi, S., Zhao, R., Xia, Z., & Weng, J. (2024) · ACM Computing Surveys · doi:10.1145/3703626 · Cited by 105 · see citing works
Audio-Visual Person-of-Interest DeepFake Detection
Cozzolino, D., Pianese, A., Nießner, M., & Verdoliva, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00101 · Cited by 104 · see citing works
Forensics and Analysis of Deepfake Videos
Jafar, M. T., Ababneh, M., Al-Zoube, M., & Elhassan, A. (2020) · 2020 11th International Conference on Information and Communication Systems (ICICS) · doi:10.1109/icics49469.2020.239493 · Cited by 102 · see citing works
Cai, Z., Stefanov, K., Dhall, A., & Hayat, M. (2022) · 2022 International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta56598.2022.10034605 · Cited by 99 · see citing works
Preventing DeepFake Attacks on Speaker Authentication by Dynamic Lip Movement Analysis
Yang, C.-Z., Ma, J., Wang, S., & Liew, A. W. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3045937 · Cited by 99 · see citing works
Le, T.-N., Nguyen, H. H., Yamagishi, J., & Echizen, I. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00996 · Cited by 97 · see citing works
SSTNet: Detecting Manipulated Faces Through Spatial, Steganalysis and Temporal Features
Wu, X., Xie, Z., Gao, Y., & Xiao, Y. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053969 · Cited by 94 · see citing works
GAN-Generated Image Detection With Self-Attention Mechanism Against GAN Generator Defect
Mi, Z., Jiang, X., Sun, T., & Xu, K. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2994523 · Cited by 93 · see citing works
Wang, R., Juefei-Xu, F., Luo, M., Liu, Y., & Wang, L. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475518 · Cited by 93 · see citing works
A Comprehensive Survey on Passive Techniques for Digital Video Forgery Detection
Shelke, N. A., & Kasana, S. S. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09974-4 · Cited by 87 · see citing works
Restricted Black-Box Adversarial Attack Against DeepFake Face Swapping
Dong, J., Wang, Y., Lai, J., & Xie, X. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3266702 · Cited by 86 · see citing works
Lai, X., & Rau, P. P. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106894 · Cited by 85 · see citing works
Privacy Intelligence: A Survey on Image Privacy in Online Social Networks
Liu, C., Zhu, T., Zhang, J., & Zhou, W. (2022) · ACM Computing Surveys · doi:10.1145/3547299 · Cited by 84 · see citing works
A Survey on Adversarial Attack in the Age of Artificial Intelligence
Kong, Z., Xue, J., Wang, Y., Huang, L., Niu, Z., & Li, F. (2021) · Wireless Communications and Mobile Computing · doi:10.1155/2021/4907754 · Cited by 83 · see citing works
Deep models of superficial face judgments
Peterson, J. C., Uddenberg, S., Griffiths, T. L., Todorov, A., & Suchow, J. W. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2115228119 · Cited by 82 · see citing works
La inteligencia artificial generativa y la educación universitaria
Mendiola, M. S., & Carbajal-Degante, E. (2023) · Perfiles Educativos · doi:10.22201/iisue.24486167e.2023.especial.61692 · Cited by 81 · see citing works
Video Transformer for Deepfake Detection with Incremental Learning
Khan, S. A., & Dai, H. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475332 · Cited by 79 · see citing works
An efficient deepfake video detection using robust deep learning
Qadir, A., Mahum, R., El-Meligy, M. A., Ragab, A. E., AlSalman, A., & Awais, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e25757 · Cited by 78 · see citing works
Do Deepfakes Feel Emotions? A Semantic Approach to Detecting Deepfakes Via Emotional Inconsistencies
Hosler, B., Salvi, D., Murray, A., Antonacci, F., Bestagini, P., Tubaro, S., & Stamm, M. C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00112 · Cited by 78 · see citing works
MRE-Net: Multi-Rate Excitation Network for Deepfake Video Detection
Pang, G., Zhang, B., Teng, Z., Qi, Z., & Jianping Fan, B. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3239607 · Cited by 79 · see citing works
Godulla, A., Hoffmann, C. P., & Seibert, D. (2021) · Studies in Communication and Media · doi:10.5771/2192-4007-2021-1-72 · Cited by 75 · see citing works
Deepfake Detection Scheme Based on Vision Transformer and DistillationPreprint
Heo, Y. J., Choi, Y. J., Lee, Y., & Kim, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.01353 · Cited by 76 · see citing works
El‐Shafai, W., Fouda, M. A., El‐Rabaie, E. M., & Abdel-Salam, N. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15609-1 · Cited by 72 · see citing works
Qureshi, S. M., Saeed, A., Almotiri, S. H., Ahmad, F., & Al Ghamdi, M. A. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2037 · Cited by 71 · see citing works
Swapped face detection using deep learning and subjective assessment
Ding, X., Raziei, Z., Larson, E. C., Olinick, E. V., Krueger, P., & Hahsler, M. (2020) · EURASIP Journal on Information Security · doi:10.1186/s13635-020-00109-8 · Cited by 71 · see citing works
An Experimental Evaluation on Deepfake Detection using Deep Face Recognition
Ramachandran, S., Nadimpalli, A. V., & Rattani, A. (2021) · IEEE International Carnahan Conference on Security Technology (ICCST) · doi:10.1109/iccst49569.2021.9717407 · Cited by 71 · see citing works
Data Augmentation-based Novel Deep Learning Method for Deepfaked Images Detection
Iqbal, F., Abbasi, A., Javed, A. R., Almadhor, A. S., Jalil, Z., Anwar, S., & Rida, I. (2023) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3592615 · Cited by 70 · see citing works
- Authors
- Korshunov, P., & Marcel, S.
- ORCID
- Korshunov, Pavel
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1812.08685
- OpenAlex
- W2904573504
- Cited by
- 497
- References
- 24
- Citations by year
- 2026: 12 · 2025: 31 · 2024: 71 · 2023: 94 · 2022: 77 · 2021: 106 · 2020: 88 · 2019: 16 · 2018: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Keywords
- deepfakes, face swapping, deepfake detection, generative adversarial networks, visual quality metrics, anti-spoofing, false acceptance rate, FaceNet, VGG
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
