Exposing DeepFake Videos By Detecting Face Warping Artifacts
Open accessAbstract
In this work, we describe a new deep learning based method that can effectively distinguish AI-generated fake videos (referred to as {\em DeepFake} videos hereafter) from real videos. Our method is based on the observations that current DeepFake algorithm can only generate images of limited resolutions, which need to be further warped to match the original faces in the source video. Such transforms leave distinctive artifacts in the resulting DeepFake videos, and we show that they can be effectively captured by convolutional neural networks (CNNs). Compared to previous methods which use a large amount of real and DeepFake generated images to train CNN classifier, our method does not need DeepFake generated images as negative training examples since we target the artifacts in affine face warping as the distinctive feature to distinguish real and fake images. The advantages of our method are two-fold: (1) Such artifacts can be simulated directly using simple image processing operations on a image to make it as negative example. Since training a DeepFake model to generate negative examples is time-consuming and resource-demanding, our method saves a plenty of time and resources in training data collection; (2) Since such artifacts are general existed in DeepFake videos from different sources, our method is more robust compared to others. Our method is evaluated on two sets of DeepFake video datasets for its effectiveness in practice.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Most previous deepfake detectors perform well within-dataset but struggle on cross-dataset scenarios where training and testing data distributions differ.
“Deepfake detection faces a critical generalization hurdle, with performance deteriorating when there is a mismatch between the distributions of training and testing data.”
From Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection (2024) · cites this paper as [29]
RGB-based methods typically rely on subtle low-level artifacts at the pixel level.
“RGB-based methods typically rely on subtle low-level artifacts at the pixel level.”
From Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection (2024) · cites this paper as [29]
Early face forgery detection works suffer from limited accuracy and low generalization capability.
“However, these methods suffer from limited accuracy and low generalization capability.”
From Enhancing General Face Forgery Detection via Vision Transformer with Low-Rank Adaptation (2023) · cites this paper as [28]
Several algorithms, such as Face X-ray, FWA, and SLADD, rely on landmarks to perform operations and analysis on facial images.
“Several algorithms, such as Face X-ray [20], FWA [22], SLADD [3], etc , rely on landmarks to perform operations and analysis on facial images.”
From DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection (2023) · cites this paper as [22]
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602 · see citing works
StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163 · see citing works
Noiseprint: A CNN-Based Camera Model Fingerprint
Cozzolino, D., & Verdoliva, L. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2916364 · Cited by 499 · see citing works
DeepFakes: a New Threat to Face Recognition? Assessment and Detection
Korshunov, P., & Marcel, S. (2018) · arXiv · doi:10.48550/arxiv.1812.08685 · Cited by 497 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · see citing works
“ead to serious political, social, financial, and legal consequences [7]. With the escalated concerns over the DeepFakes, there is a surge of interest in developing DeepFakes detection methods recently [4,12,16,32,20,17,26,25,22,21,23], with an upcoming dedicated global DeepFake Detection Chal1https://github.com/danmoha…”
BackgroundMethodInfluentialSelf-citationDeepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237 · see citing works
Face X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211 · see citing works
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979 · see citing works
Multi-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019 · see citing works
Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824 · see citing works
On the Detection of Digital Face Manipulation
Dang, H., Liu, F., Stehouwer, J., Liu, X., & Jain, A. K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00582 · Cited by 764 · see citing works
DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599 · see citing works
Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain
Liu, H., Li, X., Zhou, W., Chen, Y., He, Y., Xue, H., Zhang, W., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00083 · Cited by 600 · see citing works
Deepfake Detection: A Systematic Literature Review
Rana, M. S., Nobi, M. N., Murali, B., & Sung, A. H. (2022) · IEEE Access · doi:10.1109/access.2022.3154404 · Cited by 573 · see citing works
Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection
Haliassos, A., Vougioukas, K., Petridis, S., & Pantic, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00500 · Cited by 537 · see citing works
Detecting and Simulating Artifacts in GAN Fake Images
Zhang, X., Karaman, S., & Chang, S.-F. (2019) · 2019 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs47025.2019.9035107 · Cited by 567 · see citing works
Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543 · see citing works
FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals
Ciftci, U. A., Demir, I., & Yin, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3009287 · Cited by 499 · see citing works
Detecting Deepfakes with Self-Blended Images
Shiohara, K., & Yamasaki, T. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01816 · Cited by 503 · see citing works
Deep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2019) · arXiv · doi:10.48550/arxiv.1909.11573 · Cited by 464
Deep learning for deepfakes creation and detection: A survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103525 · Cited by 464 · see citing works
“ResNet50, ResNet101 and ResNet152 [81]. A deep 6 learning method to detect deepfakes based on the artifacts observed during the face warping step of the deepfake generation algorithms was proposed in [82]. The proposed method is evaluated on two deepfake data sets, namely the UADFV and DeepfakeTIMIT. The UADFV data se…”
MethodWildDeepfake: A Challenging Real-World Dataset for Deepfake Detection
Zi, B., Chang, M., Chen, J., Ma, X., & Jiang, Y.-G. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413769 · Cited by 448 · see citing works
Two-Branch Recurrent Network for Isolating Deepfakes in Videos
Masi, I., Killekar, A., Mascarenhas, R. M., Gurudatt, S. P., & AbdAlmageed, W. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58571-6_39 · Cited by 471 · see citing works
Global Texture Enhancement for Fake Face Detection in the Wild
Liu, Z., Qi, X., & Torr, P. H. S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00808 · Cited by 401 · see citing works
Learning Self-Consistency for Deepfake Detection
Zhao, T., Xu, X., Xu, M., Ding, H., Xiong, Y., & Xia, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01475 · Cited by 383 · see citing works
M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection
Wang, J., Wu, Z., Ouyang, W., Han, X., Chen, J., Jiang, Y.-G., & Li, S.-N. (2022) · Proceedings of the 2022 International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531415 · Cited by 368 · see citing works
Combating Deepfake Videos Using Blockchain and Smart Contracts
Hasan, H. R., & Salah, K. (2019) · IEEE Access · doi:10.1109/access.2019.2905689 · Cited by 339 · see citing works
Li, J., Xie, H., Li, J., Wang, Z., & Zhang, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00639 · Cited by 357 · see citing works
Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection
Chen, L., Zhang, Y., Song, Y., Liu, L., & Wang, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01815 · Cited by 307 · see citing works
Exploring Temporal Coherence for More General Video Face Forgery Detection
Zheng, Y., Bao, J., Chen, D., Zeng, M., & Wen, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01477 · Cited by 320 · see citing works
Do (microtargeted) deepfakes have real effects on political attitudes?
Dobber, T., Metoui, N., Trilling, D., Helberger, N., & de Vreese, C. (2021) · The International Journal of Press/Politics · doi:10.1177/1940161220944364 · Cited by 256 · see citing works
A Survey on Deepfake Video Detection
Yu, P., Xia, Z., Fei, J., & Lu, Y. (2021) · IET Biometrics · doi:10.1049/bme2.12031 · Cited by 253 · see citing works
Detecting Deep-Fake Videos from Appearance and Behavior
Agarwal, S., Farid, H., El-Gaaly, T., & Lim, S.-N. (2020) · 2020 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs49906.2020.9360904 · Cited by 242 · see citing works
“detect generic artifacts [7]–[10], while others detect explicit artifacts that result from, for example, image warping [11], image blending [12] and inconsistencies between the image and metadata [13].”
BackgroundDeepfake Detection: Current Challenges and Next Steps
Lyu, S. (2020) · 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew46912.2020.9105991 · Cited by 234 · see citing works
Self-citationDetecting Deep-Fake Videos from Phoneme-Viseme Mismatches
Agarwal, S., Farid, H., Fried, O., & Agrawala, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00338 · Cited by 234 · see citing works
Implicit identity leakage: The stumbling block to improving deepfake detection generalization
Dong, S., Wang, J., Ji, R., Liang, J., Fan, H., & Ge, Z. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00389 · Cited by 220 · see citing works
Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization
Chugh, K., Gupta, P., Dhall, A., & Subramanian, R. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413700 · Cited by 225 · see citing works
ID-Reveal: Identity-aware DeepFake Video Detection
Cozzolino, D., Rossler, A., Thies, J., Niesner, M., & Verdoliva, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01483 · Cited by 221 · see citing works
Joint Audio-Visual Deepfake Detection
Zhou, Y., & Lim, S.-N. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01453 · Cited by 217 · see citing works
Deepfake video detection: challenges and opportunities
Kaur, A., Noori Hoshyar, A., Saikrishna, V., Firmin, S., & Xia, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10810-6 · Cited by 214 · see citing works
Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examples
Hussain, S., Neekhara, P., Jere, M., Koushanfar, F., & McAuley, J. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00339 · Cited by 204 · see citing works
Countering Malicious DeepFakes: Survey, Battleground, and Horizon
Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01606-8 · Cited by 191 · see citing works
“Early works study the irregular eye blinking (Li et al., 2018b), the mismatch facial landmarks (Yang et al., 2019a,b), and the fixed size of synthesized faces (Li and Lyu, 2019), etc .”
BackgroundMTD-Net: Learning to Detect Deepfakes Images by Multi-Scale Texture Difference
Yang, J., Li, A., Xiao, S., Lu, W., & Gao, X. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3102487 · Cited by 184 · see citing works
ISTVT: Interpretable Spatial-Temporal Video Transformer for Deepfake Detection
Zhao, C., Wang, C., Hu, G., Chen, H., Liu, C., & Tang, J. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3239223 · Cited by 184 · see citing works
Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection
Haliassos, A., Mira, R., Petridis, S., & Pantic, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01453 · Cited by 180 · see citing works
Deepfakes Detection with Automatic Face Weighting
Montserrat, D. M., Hao, H., Yarlagadda, S. K., Baireddy, S., Shao, R., Horvath, J., Bartusiak, E., Yang, J., Guera, D., Zhu, F., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00342 · Cited by 181 · see citing works
Spatiotemporal Inconsistency Learning for DeepFake Video Detection
Gu, Z., Chen, Y., Yao, T., Ding, S., Li, J., Huang, F., & Ma, L. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475508 · Cited by 189 · see citing works
Fake face detection via adaptive manipulation traces extraction network
Guo, Z., Yang, G., Chen, J., & Sun, X. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103170 · Cited by 165 · see citing works
Fooled twice: People cannot detect deepfakes but think they can
Köbis, N. C., Doležalová, B., & Soraperra, I. (2021) · iScience · doi:10.1016/j.isci.2021.103364 · Cited by 193 · see citing works
Zhou, T., Wang, W., Liang, Z., & Shen, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00572 · Cited by 156 · see citing works
Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection
Yan, Z., Luo, Y., Lyu, S., Liu, Q., & Wu, B. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00858 · Cited by 166 · see citing works
“Our work specifically focuses on detecting face-swapping but also shows the potential to detect entire image synthesis.”
BackgroundMethodInfluentialSelf-citationA Data Verification System for CCTV Surveillance Cameras Using Blockchain Technology in Smart Cities
Khan, P., Byun, Y.-C., & Park, N. (2020) · Electronics · doi:10.3390/electronics9030484 · Cited by 144 · see citing works
FrePGAN: Robust Deepfake Detection Using Frequency-Level Perturbations
Jeong, Y., Kim, D., Ro, Y., & Choi, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19990 · Cited by 137 · see citing works
CORE: Consistent Representation Learning for Face Forgery Detection
Ni, Y., Meng, D., Yu, C., Quan, C., Ren, D., & Zhao, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00011 · Cited by 136 · see citing works
DeepfakeStack: A Deep Ensemble-based Learning Technique for Deepfake Detection
Rana, M. S., & Sung, A. H. (2020) · 2020 7th IEEE International Conference on Cyber Security and Cloud Computing (CSCloud)/2020 6th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom) · doi:10.1109/cscloud-edgecom49738.2020.00021 · Cited by 133 · see citing works
AltFreezing for More General Video Face Forgery Detection
Wang, Z., Bao, J., Zhou, W., Wang, W., & Li, H. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00402 · Cited by 137 · see citing works
“FWA [35] targets the artifacts in affine face warping as the distinctive feature to detect the forgery.”
BackgroundMethodInfluentialAdversarial Threats to DeepFake Detection: A Practical Perspective
Neekhara, P., Dolhansky, B., Bitton, J., & Ferrer, C. C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00103 · Cited by 117 · see citing works
TALL: Thumbnail Layout for Deepfake Video Detection
Xu, Y., Liang, J., Jia, G., Yang, Z., Zhang, Y., & He, R. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02071 · Cited by 109 · see citing works
Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes
Trinh, L., Tsang, M., Rambhatla, S., & Liu, Y. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00202 · Cited by 115 · see citing works
Deepfakes generation and detection: a short survey
Akhtar, Z. (2023) · Journal of Imaging · doi:10.3390/jimaging9010018 · Cited by 106 · see citing works
Das, S., Seferbekov, S., Datta, A., Islam, M. S., & Amin, M. R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00421 · Cited by 107 · see citing works
Self-Supervised Video Forensics by Audio-Visual Anomaly Detection
Feng, C., Chen, Z., & Owens, A. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01011 · Cited by 101 · see citing works
Cai, Z., Stefanov, K., Dhall, A., & Hayat, M. (2022) · 2022 International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta56598.2022.10034605 · Cited by 99 · see citing works
Le, T.-N., Nguyen, H. H., Yamagishi, J., & Echizen, I. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00996 · Cited by 97 · see citing works
DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection
Yan, Z., Zhang, Y., Yuan, X., Lyu, S., & Wu, B. (2023) · arXiv · doi:10.48550/arxiv.2307.01426 · Cited by 97 · see citing works
“7) DSP-FWA [22]: detects deepfake videos using a ResNet-50 [16] to expose the face-warping artifacts introduced by the resizing and interpolation operations in the basic deepfake maker algorithm.”
BackgroundMethodInfluentialSelf-citationDelving into the Local: Dynamic Inconsistency Learning for DeepFake Video Detection
Gu, Z., Chen, Y., Yao, T., Ding, S., Li, J., & Ma, L. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19955 · Cited by 93 · see citing works
DFDT: An End-to-End DeepFake Detection Framework Using Vision Transformer
Khormali, A., & Yuan, J.-S. (2022) · Applied Sciences · doi:10.3390/app12062953 · Cited by 88 · see citing works
A Comprehensive Survey on Passive Techniques for Digital Video Forgery Detection
Shelke, N. A., & Kasana, S. S. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09974-4 · Cited by 87 · see citing works
Detecting DeepFake, FaceSwap and Face2Face facial forgeries using frequency CNN
Kohli, A., & Gupta, A. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10420-8 · Cited by 90 · see citing works
Video Transformer for Deepfake Detection with Incremental Learning
Khan, S. A., & Dai, H. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475332 · Cited by 79 · see citing works
Detecting Deepfake Videos with Temporal Dropout 3DCNN
Zhang, D., Li, C., Lin, F., Zeng, D., & Ge, S. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/178 · Cited by 77 · see citing works
Do Deepfakes Feel Emotions? A Semantic Approach to Detecting Deepfakes Via Emotional Inconsistencies
Hosler, B., Salvi, D., Murray, A., Antonacci, F., Bestagini, P., Tubaro, S., & Stamm, M. C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00112 · Cited by 78 · see citing works
Fighting Fake News: Two Stream Network for Deepfake Detection via Learnable SRM
Han, B., Han, X., Zhang, H., Li, J., & Cao, X. (2021) · IEEE Transactions on Biometrics, Behavior, and Identity Science · doi:10.1109/tbiom.2021.3065735 · Cited by 77 · see citing works
An efficient deepfake video detection using robust deep learning
Qadir, A., Mahum, R., El-Meligy, M. A., Ragab, A. E., AlSalman, A., & Awais, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e25757 · Cited by 78 · see citing works
A Contemporary Survey on Deepfake Detection: Datasets, Algorithms, and Challenges
Gong, L. Y., & Li, X. J. (2024) · Electronics · doi:10.3390/electronics13030585 · Cited by 75 · see citing works
iCaps-Dfake: An Integrated Capsule-Based Model for Deepfake Image and Video Detection
Khalil, S. S., Youssef, S. M., & Saleh, S. N. (2021) · Future Internet · doi:10.3390/fi13040093 · Cited by 67 · see citing works
Supervised Contrastive Learning for Generalizable and Explainable DeepFakes Detection
Xu, Y., Raja, K., & Pedersen, M. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw54805.2022.00044 · Cited by 62 · see citing works
On Improving Cross-dataset Generalization of Deepfake Detectors
Nadimpalli, A. V., & Rattani, A. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00019 · Cited by 63 · see citing works
DeepFake Detection Based on High-Frequency Enhancement Network for Highly Compressed Content
Gao, J., Xia, Z., Marcialis, G. L., Dang, C., Dai, J., & Feng, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123732 · Cited by 67 · see citing works
PVASS-MDD: Predictive Visual-Audio Alignment Self-Supervision for Multimodal Deepfake Detection
Yu, Y., Liu, X., Ni, R., Yang, S., Zhao, Y., & Kot, A. C. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3309899 · Cited by 63 · see citing works
Cai, Z., Ghosh, S., Dhall, A., Gedeon, T., Stefanov, K., & Hayat, M. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103818 · Cited by 63 · see citing works
Binh, L. M., & Woo, S. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19886 · Cited by 63 · see citing works
A lightweight 3D convolutional neural network for deepfake detection
Liu, J., Zhu, K., Lu, W., Luo, X., & Zhao, X. (2021) · International Journal of Intelligent Systems · doi:10.1002/int.22499 · Cited by 57 · see citing works
Depth map guided triplet network for deepfake face detection
Liang, B., Wang, Z., Huang, B., Zou, Q., Wang, Q., & Liang, J. (2023) · Neural Networks · doi:10.1016/j.neunet.2022.11.031 · Cited by 54 · see citing works
Deepfake Video Detection Based on MesoNet with Preprocessing Module
Xia, Z., Qiao, T., Xu, M., Wu, X., Han, L., & Chen, Y. (2022) · Symmetry · doi:10.3390/sym14050939 · Cited by 56 · see citing works
A Novel Machine Learning based Method for Deepfake Video Detection in Social Media
Mitra, A., Mohanty, S. P., Corcoran, P., & Kougianos, E. (2020) · 2020 IEEE International Symposium on Smart Electronic Systems (iSES) (Formerly iNiS) · doi:10.1109/ises50453.2020.00031 · Cited by 57 · see citing works
ADD: Attention-Based DeepFake Detection Approach
Khormali, A., & Yuan, J.-S. (2021) · Big Data and Cognitive Computing · doi:10.3390/bdcc5040049 · Cited by 55 · see citing works
DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection
Yan, Z., Zhang, Y., Yuan, X., Lyu, S., & Wu, B. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-0201 · Cited by 98 · see citing works
Self-citation“Combating deepfakes: multi-LSTM and blockchain as proof of authenticity for digital media,”
Ki Chan, C. C., Kumar, V., Delaney, S., & Gochoo, M. (2020) · 2020 IEEE / ITU International Conference on Artificial Intelligence for Good (AI4G) · doi:10.1109/ai4g50087.2020.9311067 · Cited by 48 · see citing works
GenConViT: Deepfake Video Detection Using Generative Convolutional Vision Transformer
Deressa, D. W., Mareen, H., Lambert, P., Atnafu, S., Akhtar, Z., & Van Wallendael, G. (2025) · Applied Sciences · doi:10.3390/app15126622 · Cited by 46 · see citing works
Forgery-Aware Adaptive Learning With Vision Transformer for Generalized Face Forgery Detection
Luo, A., Cai, R., Kong, C., Ju, Y., Kang, X., Huang, J., & Kot, A. C. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3522091 · Cited by 41 · see citing works
An Examination of Fairness of AI Models for Deepfake Detection
Trinh, L., & Liu, Y. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/79 · Cited by 44 · see citing works
Deep Insights of Deepfake Technology : A Review
Mahmud, B. U., & Sharmin, A. (2021) · arXiv · doi:10.48550/arxiv.2105.00192 · Cited by 38 · see citing works
Quality-Agnostic Deepfake Detection with Intra-model Collaborative Learning
Le, B. M., & Woo, S. S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02045 · Cited by 36 · see citing works
Fsbi: Deepfake detection with frequency enhanced self-blended images
Abul Hasanaath, A., Luqman, H., Katib, R., & Anwar, S. (2025) · Image and Vision Computing · doi:10.1016/j.imavis.2025.105418 · Cited by 34 · see citing works
A Review of Deep Learning-based Approaches for Deepfake Content Detection
Passos, L. A., Jodas, D., Costa, K. A. P., Júnior, L. A. S., Rodrigues, D., Ser, J. D., Camacho*, D., & Papa, J. (2023) · doi:10.22541/au.169735672.27713914/v1 · Cited by 116 · see citing works
On the Generalization of Deep Learning Models in Video Deepfake Detection
Coccomini, D. A., Caldelli, R., Falchi, F., & Gennaro, C. (2023) · Journal of Imaging · doi:10.3390/jimaging9050089 · Cited by 32 · see citing works
“Face X-ray [42] FF++ 65.5 Patch-based [43] FF++ 65.6 DSP-FWA [44] FF++ 67.3 CSN [45] FF++ 68.1 Multi-Task [46] FF++ 68.1 CNN-GRU [47] FF++ 68.9 Xception [48] FF++ 70.9 CNN-aug [49] FF++ 72.1 LipForensics [50] FF++ 73.5 FTCN [10] FF++ 74.0 RealForensics [45] FF++ 75.9 RealForensics [45] FF++ 75.9…”
InfluentialIdentity-Driven DeepFake Detection
Dong, X., Bao, J., Chen, D., Zhang, W., Yu, N., Chen, D., Wen, F., & Guo, B. (2020) · arXiv · doi:10.48550/arxiv.2012.03930 · Cited by 26 · see citing works
Narayan, K., Agarwal, H., Thakral, K., Mittal, S., Vatsa, M., & Singh, R. (2022) · 2022 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb54206.2022.10007968 · Cited by 26 · see citing works
Enhancing General Face Forgery Detection via Vision Transformer with Low-Rank Adaptation
Kong, C., Li, H., & Wang, S. (2023) · 2023 IEEE 6th International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr59079.2023.00033 · Cited by 25 · see citing works
“Early works mainly focus on extracting handcrafted features such as lack of eye blinking [27], head pose inconsistency [41], and face warping artifacts [28] from the inputs.”
BackgroundUsing Deep Learning to Detecting Deepfakes
Mallet, J., Dave, R., Seliya, N., & Vanamala, M. (2022) · 2022 9th International Conference on Soft Computing & Machine Intelligence (ISCMI) · doi:10.1109/iscmi56532.2022.10068449 · Cited by 26 · see citing works
Video Face Manipulation Detection Through Ensemble of CNNs
Bonettini, N., Cannas, E. D., Mandelli, S., Bondi, L., Bestagini, P., & Tubaro, S. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9412711 · Cited by 27 · see citing works
FeatureTransfer: Unsupervised Domain Adaptation for Cross-Domain Deepfake Detection
Chen, B., & Tan, S. (2021) · Security and Communication Networks · doi:10.1155/2021/9942754 · Cited by 23 · see citing works
“[13] CNN Self-supervised MesoNet [15] CNN RGB XceptionNet [16] CNN RGB Nguyen et al.”
MethodFooled twice – people cannot detect deepfakes but think they can
Köbis, N., Doležalová, B., & Soraperra, I. (2021) · doi:10.2139/ssrn.3832978 · Cited by 194 · see citing works
- Authors
- Li, Y., & Lyu, S.
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Pages
- 46-52
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1811.00656
- OpenAlex
- W2898877033
- Cited by
- 785
- References
- 5
- Citations by year
- 2026: 5 · 2025: 68 · 2024: 146 · 2023: 142 · 2022: 125 · 2021: 161 · 2020: 122 · 2019: 16
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- deepfake detection, fake video detection, AI-generated video, convolutional neural networks, video forgery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
