The DOI matches its DataCite record; 23 of the 24 references it cites were found in a registry or an index.
DeepFakes: a New Threat to Face Recognition? Assessment and Detection
Open accessAbstract
It is becoming increasingly easy to automatically replace a face of one person in a video with the face of another person by using a pre-trained generative adversarial network (GAN). Recent public scandals, e.g., the faces of celebrities being swapped onto pornographic videos, call for automated ways to detect these Deepfake videos. To help developing such methods, in this paper, we present the first publicly available set of Deepfake videos generated from videos of VidTIMIT database. We used open source software based on GANs to create the Deepfakes, and we emphasize that training and blending parameters can significantly impact the quality of the resulted videos. To demonstrate this impact, we generated videos with low and high visual quality (320 videos each) using differently tuned parameter sets. We showed that the state of the art face recognition systems based on VGG and Facenet neural networks are vulnerable to Deepfake videos, with 85.62% and 95.00% false acceptance rates respectively, which means methods for detecting Deepfake videos are necessary. By considering several baseline approaches, we found that audio-visual approach based on lip-sync inconsistency detection was not able to distinguish Deepfake videos. The best performing method, which is based on visual quality metrics and is often used in presentation attack detection domain, resulted in 8.97% equal error rate on high quality Deepfakes. Our experiments demonstrate that GAN-generated Deepfake videos are challenging for both face recognition systems and existing detection methods, and the further development of face swapping technology will make it even more so.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The DeepFake-TIMIT dataset (Korshunov and Marcel 2018) consists of 620 DeepFake videos of 32 subjects. In DeepFake-TIMIT, each subject has 20 DeepFake videos. 10 videos are of size 64 × 64 while the other 10 videos are of size 128 × 128.”
From Countering Malicious DeepFakes: Survey, Battleground, and Horizon (2022) · cites this paper as Korshunov and Marcel 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A low-quality (LQ) set has 320 videos of size 64 × 64 dimensions and a high-quality (HQ) set with a 128 × 128 frame size.”
From Attention-based Multimodal learning framework for Generalized Audio-Visual Deepfake Detection (2023) · cites this paper as [76]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“DeepfakeTIMIT [48] is a video deepfake dataset derived from the VidTIMIT corpus [49], which consists of real audio–video recordings of 43 individuals, each reciting short sentences, resulting in a total of 430 videos.”
From Deepfake Media Forensics: Status and Future Challenges (2025) · cites this paper as [48]
The cited source says what the claim attributes to it.
In the citing paper
“Visual modality datasets dominate with over 20 publicly available resources [29, 30, 30-44], while audio modality datasets are fewer, with 11 notable datasets [45-55].”
From Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness (2026) · cites this paper as [35]
The cited source says what the claim attributes to it.
In the citing paper
“With 1,920 authentic and 7,680 synthetic videos, VCF surpasses specialized datasets like DeepfakeTIMIT (Korshunov and Marcel, 2018) in scale while introducing four resolution tiers (1080p, 540p, 360p and 270p) and three compression levels (raw, c23 and c40) - features absent in most benchmarks.”
From VCF: A Real-World Video Conference Deepfake Benchmark for Face-Swap Detection and Robustness Evaluation (2025) · cites this paper as Korshunov and Marcel, 2018
The cited source says what the claim attributes to it.
In the citing paper
“The dataset contains videos with various visual artefacts and modifications, making it appropriate for testing deepfake detection algorithms (Korshunov and Marcel 2018).”
From Deepfake video detection: challenges and opportunities (2024) · cites this paper as Korshunov and Marcel 2018
The cited source says what the claim attributes to it.
In the citing paper
“Most of the available datasets provide examples of face manipulations through either face swapping [16, 34, 77] or face reenactment [31, 35] techniques.”
From AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Dataset (2024) · cites this paper as [34]
The cited source says what the claim attributes to it.
In the citing paper
“The other dataset used is the DF-TIMIT dataset which contains a total of 620 fake videos created by using 32 subjects.”
From Attention-based Multimodal learning framework for Generalized Audio-Visual Deepfake Detection (2023) · cites this paper as [76]
The cited source says what the claim attributes to it.
In the citing paper
“However, this dataset contains facial manipulated videos only, the audio channel in none of the videos has been altered.”
From Attention-based Multimodal learning framework for Generalized Audio-Visual Deepfake Detection (2023) · cites this paper as [76]
The cited source says what the claim attributes to it.
In the citing paper
“suggesting that DeepFakes can effectively bypass face recognition systems, thereby raising significant security concerns.”
From Deepfake forensics: a survey of digital forensic methods for multimodal deepfake identification on social media (2024) · cites this paper as Korshunov & Sebastien (2018)
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This poses an additional challenge since there is a lack of multimodal deepfake datasets proposed in the literature, while monomodal ones are widely available.”
From A Robust Approach to Multimodal Deepfake Detection (2023) · cites this paper as [44]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“In the recent EuroCity persons dataset [5], the authors argued that any anonymization measure will introduce a bias.Thus they released their dataset with original data and a license agreement which enforces the user to strictly adhere to GDPR.We will follow a similar approach.”
From WoodScape: A Multi-Task, Multi-Camera Fisheye Dataset for Autonomous Driving (2019) · cites this paper as [5]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Social Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
Synthesizing Obama: learning lip sync from audio
Suwajanakorn, S., Seitz, S. M., & Kemelmacher-Shlizerman, I. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073640 · Cited by 1,057
Face Spoof Detection With Image Distortion Analysis
Wen, D., Han, H., & Jain, A. K. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2400395 · Cited by 911
Fast Face-Swap Using Convolutional Neural Networks
Korshunova, I., Shi, W., Dambre, J., & Theis, L. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.397 · Cited by 501
FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces
Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2018) · arXiv · doi:10.48550/arxiv.1803.09179 · Cited by 339
Face swapping: automatically replacing faces in photographs
Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P., & Nayar, S. K. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360638 · Cited by 333
On Face Segmentation, Face Swapping, and Face Perception
Nirkin, Y., Masi, I., Tuan, A. T., Hassner, T., & Medioni, G. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00024 · Cited by 307
Automated face swapping and its detection
Zhang, Y., Zheng, L., & Thing, V. L. L. (2017) · 2017 IEEE 2nd International Conference on Signal and Image Processing (ICSIP) · doi:10.1109/siprocess.2017.8124497 · Cited by 154
Speaker Inconsistency Detection in Tampered Video
Korshunov, P., & Marcel, S. (2018) · 2018 26th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553270 · Cited by 97
Self-citationSWAPPED! Digital face presentation attack detection via weighted local magnitude pattern
Agarwal, A., Singh, R., Vatsa, M., & Noore, A. (2017) · 2017 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/btas.2017.8272754 · Cited by 85
Deeply vulnerable: a study of the robustness of face recognition to presentation attacks
Mohammadi, A., Bhattacharjee, S., & Marcel, S. (2017) · IET Biometrics · doi:10.1049/iet-bmt.2017.0079 · Cited by 57
Self-citationPham, H., Wang, Y., & Pavlović, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.07716 · Cited by 29
SwapItUp: A Face Swap Application for Privacy Protection
Mahajan, S., Chen, L., & Tsai, T.-C. (2017) · International Conference on Advanced Information Networking and Applications (AINA) · doi:10.1109/aina.2017.53 · Cited by 28
Learning Multimodal Temporal Representation for Dubbing Detection in Broadcast Media
Le, N., & Odobez, J. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2967211 · Cited by 18
The image blending method for face swapping
Xingjie, Z., Song, J., & Park, J.-I. (2014) · 2014 4th IEEE International Conference on Network Infrastructure and Digital Content · doi:10.1109/icnidc.2014.7000272 · Cited by 15
Real-time face swapping in video sequences: Magic Mirror
Arar, N. M., Bekmezci, N. K., Güney, F., & Ekenel, H. K. (2011) · Signal Processing and Communications Applications Conference (SIU) · doi:10.1109/siu.2011.5929778 · Cited by 6
Who do you want to be? Real-time face swap
den Uyl, T. M., Tasli, H. E., Ivan, P., & Snijdewind, M. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163172 · Cited by 5
Research works printed but not linked: 2
- [12][12] J. Galbally and S. Marcel, 'Face anti-spoofing based on general image quality assessment,' in 2014 22nd International Conference on Pattern Recognition , Aug 2014, pp. 1173-1178. -
- [25][25] J. S. Chung, A. W. Senior, O. Vinyals, and A. Zisserman, 'Lip reading sentences in the wild,' CoRR , vol. abs/1611.05358, 2016. [Online]. Available: http://arxiv.org/abs/1611.05358 · arXiv
Cited by
Sorted by citations
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846
“To date, we have the UADFV dataset [53], the DeepFake-TIMIT dataset (DF-TIMIT) [25], the FaceForenscics++ dataset (FF-DF) [40] 2 , the Google Deep-Fake detection dataset (DFD) [15], and the FaceBook Deep-Fake detection challenge (DFDC) dataset [14].”
MethodDeepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
Exposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
Metadata
- Authors
- Korshunov, P., & Marcel, S.
- ORCID
- Korshunov, Pavel
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1812.08685
- OpenAlex
- W2904573504
- Cited by
- 497
- References
- 24
- Citations by year
- 2026: 12 · 2025: 31 · 2024: 71 · 2023: 94 · 2022: 77 · 2021: 106 · 2020: 88 · 2019: 16 · 2018: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Keywords
- deepfakes, face swapping, deepfake detection, generative adversarial networks, visual quality metrics, anti-spoofing, false acceptance rate, FaceNet, VGG
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
