The DOI matches its DataCite record; 7 of the 7 references it cites were found in a registry or an index.
Exposing DeepFake Videos By Detecting Face Warping Artifacts
Open accessAbstract
In this work, we describe a new deep learning based method that can effectively distinguish AI-generated fake videos (referred to as {\em DeepFake} videos hereafter) from real videos. Our method is based on the observations that current DeepFake algorithm can only generate images of limited resolutions, which need to be further warped to match the original faces in the source video. Such transforms leave distinctive artifacts in the resulting DeepFake videos, and we show that they can be effectively captured by convolutional neural networks (CNNs). Compared to previous methods which use a large amount of real and DeepFake generated images to train CNN classifier, our method does not need DeepFake generated images as negative training examples since we target the artifacts in affine face warping as the distinctive feature to distinguish real and fake images. The advantages of our method are two-fold: (1) Such artifacts can be simulated directly using simple image processing operations on a image to make it as negative example. Since training a DeepFake model to generate negative examples is time-consuming and resource-demanding, our method saves a plenty of time and resources in training data collection; (2) Since such artifacts are general existed in DeepFake videos from different sources, our method is more robust compared to others. Our method is evaluated on two sets of DeepFake video datasets for its effectiveness in practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deepfake detection faces a critical generalization hurdle, with performance deteriorating when there is a mismatch between the distributions of training and testing data.”
From Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection (2024) · cites this paper as [29]
In the citing paper
“RGB-based methods typically rely on subtle low-level artifacts at the pixel level.”
From Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection (2024) · cites this paper as [29]
In the citing paper
“However, these methods suffer from limited accuracy and low generalization capability.”
From Enhancing General Face Forgery Detection via Vision Transformer with Low-Rank Adaptation (2023) · cites this paper as [28]
In the citing paper
“As for the subset of DFDC, the performance of our method ( 0.846 ) is better than previous methods such as Meso4 [71] (0.753), FWA [72] (0.727) and [73] (0.844) and is close to MDS (0.916).”
From Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization (2022) · cites this paper as [72]
In the citing paper
“Several algorithms, such as Face X-ray [20], FWA [22], SLADD [3], etc , rely on landmarks to perform operations and analysis on facial images.”
From DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection (2023) · cites this paper as [22]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
Self-citationNoiseprint: A CNN-Based Camera Model Fingerprint
Cozzolino, D., & Verdoliva, L. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2916364 · Cited by 499
DeepFakes: a New Threat to Face Recognition? Assessment and Detection
Korshunov, P., & Marcel, S. (2018) · arXiv · doi:10.48550/arxiv.1812.08685 · Cited by 497
Cited by
Sorted by citations
Items 101–115 of 115
DFGC 2021: A DeepFake Game Competition
Peng, B., Fan, H., Wang, W., Dong, J., Li, Y., Lyu, S., Li, Q., Sun, Z., Chen, H., Chen, B., et al. (2021) · 2021 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb52358.2021.9484387 · Cited by 23
Self-citationFeatureTransfer: Unsupervised Domain Adaptation for Cross-Domain Deepfake Detection
Chen, B., & Tan, S. (2021) · Security and Communication Networks · doi:10.1155/2021/9942754 · Cited by 23
“[13] CNN Self-supervised MesoNet [15] CNN RGB XceptionNet [16] CNN RGB Nguyen et al.”
MethodFooled twice – people cannot detect deepfakes but think they can
Köbis, N., Doležalová, B., & Soraperra, I. (2021) · doi:10.2139/ssrn.3832978 · Cited by 194
DeSI: Deepfake Source Identifier for Social Media
Narayan, K., Agarwal, H., Mittal, S., Thakral, K., Kundu, S., Vatsa, M., & Singh, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00323 · Cited by 21
AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detection
Zhu, H., Fu, C., Wu, Q., Wu, W., Qian, C., & He, R. (2020) · arXiv · doi:10.48550/arxiv.2011.02674 · Cited by 20
Contextual Cross-Modal Attention for Audio-Visual Deepfake Detection and Localization
Katamneni, V. S., & Rattani, A. (2024) · 2024 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb62174.2024.10744480 · Cited by 20
Visual-Semantic Transformer for Face Forgery Detection
Xu, Y., Jia, G., Huang, H., Duan, J., & He, R. (2021) · 2021 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb52358.2021.9484407 · Cited by 24
Improved Deepfake Video Detection Using Convolutional Vision Transformer
Deressa, D. W., Lambert, P., Van Wallendael, G., Atnafu, S., & Mareen, H. (2024) · 2024 IEEE Gaming, Entertainment, and Media Conference (GEM) · doi:10.1109/gem61861.2024.10585593 · Cited by 20
Countering Spoof: Towards Detecting Deepfake with Multidimensional Biological Signals
Jin, X., Ye, D., & Chen, C. (2021) · Security and Communication Networks · doi:10.1155/2021/6626974 · Cited by 17
DEEPFAKER: A Unified Evaluation Platform for Facial Deepfake and Detection Models
Wang, L., Meng, X., Li, D., Zhang, X., Ji, S., & Guo, S. (2024) · ACM Transactions on Privacy and Security · doi:10.1145/3634914 · Cited by 11
Compressed Deepfake Video Detection Based on 3D Spatiotemporal Trajectories
Chen, Z., Liao, X., Wu, X., & Chen, Y. (2024) · 2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10848944 · Cited by 10
Multisemantic Path Neural Network for Deepfake Detection
Wu, N., Jin, X., Jiang, Q., Wang, P., Zhang, Y., Yao, S., & Zhou, W. (2022) · Security and Communication Networks · doi:10.1155/2022/4976848 · Cited by 9
From Black Boxes to Glass Boxes: Explainable AI for Trustworthy Deepfake Forensics
Qian, H., Xia, L., Ge, R., Fan, Y., Wang, Q., & Jing, Z. (2025) · Cryptography · doi:10.3390/cryptography9040061 · Cited by 10
Mining Generalized Multi-timescale Inconsistency for Detecting Deepfake Videos
Yu, Y., Ni, R., Yang, S., Ni, Y., Zhao, Y., & Kot, A. C. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-024-02249-7 · Cited by 7
Deepfake Detection with Data Privacy Protection
Wu, M., Wang, F., Wu, X., Yu, F., Wang, B., & Song, Z. (2022) · 2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp55362.2022.9949458
Metadata
- Authors
- Li, Y., & Lyu, S.
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Pages
- 46-52
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1811.00656
- OpenAlex
- W2898877033
- Cited by
- 785
- References
- 7
- Citations by year
- 2026: 5 · 2025: 68 · 2024: 146 · 2023: 142 · 2022: 125 · 2021: 161 · 2020: 122 · 2019: 16
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- deepfake detection, fake video detection, AI-generated video, convolutional neural networks, video forgery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
