Deepfakes Detection with Automatic Face Weighting
Open accessAbstract
Altered and manipulated multimedia is increasingly present and widely distributed via social media platforms. Advanced video manipulation tools enable the generation of highly realistic-looking altered multimedia. While many methods have been presented to detect manipulations, most of them fail when evaluated with data outside of the datasets used in research environments. In order to address this problem, the Deepfake Detection Challenge (DFDC) provides a large dataset of videos containing realistic manipulations and an evaluation system that ensures that methods work quickly and accurately, even when faced with challenging data. In this paper, we introduce a method based on convolutional neural networks (CNNs) and recurrent neural networks (RNNs) that extracts visual and temporal features from faces present in videos to accurately detect manipulations. The method is evaluated with the DFDC dataset, providing competitive results compared to other techniques.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Deep neural network based detection approaches such as Xception, capsules networks, and EfficientNet outperform methods based on shallow CNNs, facial physical characteristics, or distortion features.
“The recent availability of large deepfake video databases allowed researchers to train and test detection approaches based on very deep neural networks, such as Xception [1], capsules networks [8], EfficientNet [2], and discriminators of GANs used to generate synthetic images [9], which were shown to outperform the methods based on shallow CNNs, facial physical characteristics [10], [11], [12], [1”
From Improving Generalization of Deepfake Detection With Data Farming and Few-Shot Learning (2022) · cites this paper as [2]
The Related Work section says that several deep-network models outperformed shallow networks in a supervised fake-video detection setting. The Experimental Results section evaluates Xception and EfficientNet and describes their accuracy as good. Our copy does not establish that capsule networks outperform shallow CNNs, or that the named deep-network approaches outperform methods based on facial physical characteristics or distortion features. Page numbers are unavailable in our copy. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566 · see citing works
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138 · see citing works
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380 · see citing works
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,268 · see citing works
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072 · see citing works
ArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781 · see citing works
Self-citationJoint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214 · see citing works
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717 · see citing works
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314 · see citing works
Pérez, P., Gangnet, M., & Blake, A. (2003) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1201775.882269 · Cited by 2,041 · see citing works
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872 · see citing works
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747 · see citing works
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,410 · see citing works
Deepfake Video Detection Using Recurrent Neural Networks
Guera, D., & Delp, E. J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639163 · Cited by 1,285 · see citing works
Self-citationExposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196 · see citing works
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089 · see citing works
Exposing DeepFake Videos By Detecting Face Warping Artifacts
Li, Y., & Lyu, S. (2018) · arXiv · doi:10.48550/arxiv.1811.00656 · Cited by 785 · see citing works
What makes ImageNet good for transfer learning?Preprint
Huh, M., Agrawal, P., & Efros, A. A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.08614 · Cited by 591 · see citing works
Thies, J., Zollhöfer, M., Stamminger, M., Theobalt, C., & Nießner, M. (2016) · ACM SIGGRAPH Emerging Technologies · doi:10.1145/2929464.2929475 · Cited by 585 · see citing works
Detecting and Simulating Artifacts in GAN Fake Images
Zhang, X., Karaman, S., & Chang, S.-F. (2019) · 2019 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs47025.2019.9035107 · Cited by 567 · see citing works
Noiseprint: A CNN-Based Camera Model Fingerprint
Cozzolino, D., & Verdoliva, L. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2916364 · Cited by 499 · see citing works
Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints
Yu, N., Davis, L. S., & Fritz, M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00765 · Cited by 491 · see citing works
Recurrent convolutional strategies for face manipulation detection in videos
Sabir, E., Cheng, J., Jaiswal, A., AbdAlmageed, W., Masi, I., & Natarajan, P. (2019) · arXiv · doi:10.48550/arxiv.1905.00582 · Cited by 443 · see citing works
The Deepfake Detection Challenge (DFDC) Preview Dataset
Dolhansky, B., Howes, R., Pflaum, B., Baram, N., & Ferrer, C. C. (2019) · arXiv · doi:10.48550/arxiv.1910.08854 · Cited by 413 · see citing works
Detection of GAN-Generated Fake Images over Social Networks
Marra, F., Gragnaniello, D., Cozzolino, D., & Verdoliva, L. (2018) · 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2018.00084 · Cited by 399 · see citing works
Do GANs leave artificial fingerprints?
Marra, F., Gragnaniello, D., Verdoliva, L., & Poggi, G. (2019) · 2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2019.00103 · Cited by 361 · see citing works
Splicebuster: A new blind image splicing detector
Cozzolino, D., Poggi, G., & Verdoliva, L. (2015) · 2015 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2015.7368565 · Cited by 283 · see citing works
BlazeFace: Sub-millisecond Neural Face Detection on Mobile GPUs
Bazarevsky, V., Kartynnik, Y., Vakunov, A., Raveendran, K., & Grundmann, M. (2019) · arXiv · doi:10.48550/arxiv.1907.05047 · Cited by 264 · see citing works
Aligned and non-aligned double JPEG detection using convolutional neural networks
Barni, M., Bondi, L., Bonettini, N., Bestagini, P., Costanzo, A., Maggini, M., Tondi, B., & Tubaro, S. (2017) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2017.09.003 · Cited by 221 · see citing works
Shadow Removal via Shadow Image Decomposition
Lê, H., & Samaras, D. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00867 · Cited by 214 · see citing works
Satellite image forgery detection and localization using GAN and One-Class classifier
Yarlagadda, S. K., Güera, D., Bestagini, P., Zhu, F. M., Tubaro, S., & Delp, E. J. (2018) · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · doi:10.2352/issn.2470-1173.2018.07.mwsf-214 · Cited by 67 · see citing works
Self-citationImage Fine-grained InpaintingPreprint
Zheng, H., Li, J., Wang, X., & Gao, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02609 · Cited by 45 · see citing works
Splicing Detection and Localization In Satellite Imagery Using Conditional GANs
Bartusiak, E. R., Yarlagadda, S. K., Güera, D., Bestagini, P., Tubaro, S., Zhu, F. M., & Delp, E. J. (2019) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2019.00024 · Cited by 43 · see citing works
Self-citationDetecting and Simulating Artifacts in GAN Fake ImagesPreprint
Zhang, X., Karaman, S., & Chang, S.-F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06515 · Cited by 39 · see citing works
We Need No Pixels: Video Manipulation Detection Using Stream DescriptorsPreprint
Güera, D., Baireddy, S., Bestagini, P., Tubaro, S., & Delp, E. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.08743 · Cited by 38 · see citing works
Self-citationAnomaly-Based Manipulation Detection in Satellite Images.
Horváth, J., Güera, D., Yarlagadda, S. K., Bestagini, P., Zhu, F. M., Tubaro, S., & Delp, E. J. (2019) · Cited by 24 · see citing works
Self-citationShadow Removal Detection and Localization for Forensics Analysis
Yarlagadda, S. K., Güera, D., Montserrat, D. M., Zhu, F. M., Delp, E. J., Bestagini, P., & Tubaro, S. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683695 · Cited by 13 · see citing works
Self-citationCopy Move Source-Target Disambiguation Through Multi-Branch CNNs
Barni, M., Phan, Q.-T., & Tondi, B. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3045903 · Cited by 13 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- [1]1. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets," Proceedings of Advances in Neural Information Processing Systems, pp. 2672-2680, De- cember 2014, Montreal, Canada. 1
- [2]2. I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning, MIT Press, 2016, http://www.deeplearningbook. org. 1, 2
- [4]4. E. Bailey, Adobe Photoshop: A Beginners Guide to Photo- shop Lightroom -The 52 Photoshop Lightroom Tricks You Didnt Know Existed!, vol. 1, CreateSpace Independent Pub- lishing Platform, 2016, North Charleston, SC. 1
- [29]29. P. Pérez, M. Gangnet, and A. Blake, "Poisson image edit- ing," Proceedings of the ACM Special Interest Group on Computer GRAPHics and Interactive Techniques, pp. 313- 318, July 2003, San Diego, California. 2
Cited by
Sorted by citations
Deepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237 · see citing works
Deepfake Detection: A Systematic Literature Review
Rana, M. S., Nobi, M. N., Murali, B., & Sung, A. H. (2022) · IEEE Access · doi:10.1109/access.2022.3154404 · Cited by 573 · see citing works
Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543 · see citing works
Combining EfficientNet and Vision Transformers for Video Deepfake Detection
Coccomini, D. A., Messina, N., Gennaro, C., & Falchi, F. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-06433-3_19 · Cited by 296 · see citing works
A Survey on Deepfake Video Detection
Yu, P., Xia, Z., Fei, J., & Lu, Y. (2021) · IET Biometrics · doi:10.1049/bme2.12031 · Cited by 253 · see citing works
A review on social spam detection: Challenges, open issues, and future directions
Rao, S., Verma, A. K., & Bhatia, T. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115742 · Cited by 225 · see citing works
Countering Malicious DeepFakes: Survey, Battleground, and Horizon
Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01606-8 · Cited by 191 · see citing works
“…al., 2020d), few-shot learning (Mansourifar and Shi, 2020), enhanced MesoNet (Kawa and Syga, 2020; Afchar et al., 2018), a combination with CNN and RNN (Güera and Delp, 2018; Mas Montserrat et al., 2020), DNN with contrastive loss (Hsu et al., 2018), multi-attentional network (Zhao et al., 2021).”
BackgroundDeepfake generation and detection, a survey
Zhang, T. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11733-y · Cited by 176 · see citing works
DeepFake video detection using convolutional vision transformer
Wodajo, D., & Atnafu, S. (2021) · arXiv · doi:10.48550/arxiv.2102.11126 · Cited by 147 · see citing works
FrePGAN: Robust Deepfake Detection Using Frequency-Level Perturbations
Jeong, Y., Kim, D., Ro, Y., & Choi, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19990 · Cited by 137 · see citing works
A New Deep Learning-Based Methodology for Video Deepfake Detection Using XGBoost
Ismail, A. A., Elpeltagy, M. S., Zaki, M. S., & ElDahshan, K. A. (2021) · Sensors · doi:10.3390/s21165413 · Cited by 143 · see citing works
A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
Mubarak, R., Alsboui, T., Alshaikh, O., Inuwa-Dutse, I., Khan, S., & Parkinson, S. (2023) · IEEE Access · doi:10.1109/access.2023.3344653 · Cited by 132 · see citing works
DeepFake detection algorithm based on improved vision transformer
Heo, Y.-J., Yeo, W.-H., & Kim, B. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03867-9 · Cited by 127 · see citing works
BiHPF: Bilateral High-Pass Filters for Robust Deepfake Detection
Jeong, Y., Kim, D., Min, S., Joe, S., Gwon, Y., & Choi, J. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00293 · Cited by 106 · see citing works
Deep Fake Video Detection Using Transfer Learning Approach
Suratkar, S. S., & Kazi, F. (2022) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-022-07321-3 · Cited by 97 · see citing works
Cai, Z., Stefanov, K., Dhall, A., & Hayat, M. (2022) · 2022 International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta56598.2022.10034605 · Cited by 99 · see citing works
“3DCNN[33], GRU[34] and ViT [20], [19], [18]).”
DFFMD: A Deepfake Face Mask Dataset for Infectious Disease Era With Deepfake Detection Algorithms
Alnaim, N. M., Almutairi, Z. M., Alsuwat, M. S., Alalawi, H. H., Alshobaili, A., & Alenezi, F. S. (2023) · IEEE Access · doi:10.1109/access.2023.3246661 · Cited by 91 · see citing works
The face deepfake detection challenge
Guarnera, L., Giudice, O., Guarnera, F., Ortis, A., Puglisi, G., Paratore, A., Bui, L. M. Q., Fontani, M., Coccomini, D. A., Caldelli, R., et al. (2022) · Journal of Imaging · doi:10.3390/jimaging8100263 · Cited by 79 · see citing works
Shaaban, O. A., Yıldırım, R., & Alguttar, A. A. (2023) · IEEE Access · doi:10.1109/access.2023.3333866 · Cited by 79 · see citing works
Usman, M. T., Khan, H., Singh, S. K., Lee, M. Y., & Koo, J. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3476477 · Cited by 69 · see citing works
A literature review and perspectives in deepfakes: generation, detection, and applications
Dagar, D., & Vishwakarma, D. K. (2022) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-022-00241-w · Cited by 72 · see citing works
DeepFake on Face and Expression Swap: A Review
Waseem, S., Abu Bakar, S. A. R. S., Ahmed, B. A., Omar, Z., Eisa, T. A. E., & Dalam, M. E. E. (2023) · IEEE Access · doi:10.1109/access.2023.3324403 · Cited by 65 · see citing works
Cai, Z., Ghosh, S., Dhall, A., Gedeon, T., Stefanov, K., & Hayat, M. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103818 · Cited by 63 · see citing works
An Investigation of the Effectiveness of Deepfake Models and Tools
Mukta, M. S. H., Ahmad, J., Raiaan, M. A. K., Islam, S., Azam, S., Ali, M. E., & Jonkman, M. (2023) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan12040061 · Cited by 71 · see citing works
A novel approach for detecting deep fake videos using graph neural network
El-Gayar, M. M., Abouhawwash, M., Askar, S., & Sweidan, S. (2024) · Journal Of Big Data · doi:10.1186/s40537-024-00884-y · Cited by 60 · see citing works
Deepfake Video Detection Based on MesoNet with Preprocessing Module
Xia, Z., Qiao, T., Xu, M., Wu, X., Han, L., & Chen, Y. (2022) · Symmetry · doi:10.3390/sym14050939 · Cited by 56 · see citing works
Al-Dhabi, Y., & Zhang, S. (2021) · IEEE International Conference on Computer Science, Artificial Intelligence and Electronic Engineering (CSAIEE) · doi:10.1109/csaiee54046.2021.9543264 · Cited by 55 · see citing works
Convolutional Neural Network Based on Diverse Gabor Filters for Deepfake Recognition
Khalifa, A. H., Zaher, N. A., Abdallah, A., & Fakhr, M. W. (2022) · IEEE Access · doi:10.1109/access.2022.3152029 · Cited by 55 · see citing works
Assessment framework for deepfake detection in real-world situations
Lu, Y., & Ebrahimi, T. (2024) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-024-00621-8 · Cited by 60 · see citing works
“In this paper, three different types of deepfake detectors [4, 11, 21] are adopted for experiments.”
MethodRecent advances in artificial intelligence for video production system
Huang, Y., Lv, S., Tseng, K.-K., Tseng, P.-J., Xie, X., & Lin, R. F.-Y. (2023) · Enterprise Information Systems · doi:10.1080/17517575.2023.2246188 · Cited by 60 · see citing works
Analyzing Fairness in Deepfake Detection With Massively Annotated Databases
Xu, Y., Terhörst, P., Pedersen, M., & Raja, K. B. (2024) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2024.3365421 · Cited by 60 · see citing works
Forensic Symmetry for DeepFakes
Li, G., Zhao, X., & Cao, Y. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3235579 · Cited by 50 · see citing works
Improving Generalization of Deepfake Detection With Data Farming and Few-Shot Learning
Korshunov, P., & Marcel, S. (2022) · IEEE Transactions on Biometrics, Behavior, and Identity Science · doi:10.1109/tbiom.2022.3143404 · Cited by 50 · see citing works
FFR_FD: Effective and fast detection of DeepFakes via feature point defects
Wang, G., Jiang, Q., Jin, X., & Cui, X. (2022) · Information Sciences · doi:10.1016/j.ins.2022.03.026 · Cited by 49 · see citing works
An Enhanced Deep Learning-Based DeepFake Video Detection and Classification System
Awotunde, J. B., Jimoh, R. G., Imoize, A. L., Abdulrazaq, A. T., Li, C., & Lee, C. (2022) · Electronics · doi:10.3390/electronics12010087 · Cited by 53 · see citing works
Real-Time Advanced Computational Intelligence for Deep Fake Video Detection
Bansal, N., Aljrees, T., Yadav, D. P., Singh, K. U., Kumar, A., Verma, G. K., & Singh, T. (2023) · Applied Sciences · doi:10.3390/app13053095 · Cited by 51 · see citing works
Audio–Visual Synchronization and Lip Movement Analysis for Real-Time Deepfake Detection
Javed, M., Zhang, Z., Dahri, F. H., Laghari, A. A., Krajčík, M., & Almadhor, A. S. (2025) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-025-00911-7 · Cited by 50 · see citing works
Deepfake Detection Scheme Based on Vision Transformer and DistillationPreprint
Heo, Y. J., Choi, Y. J., Lee, Y., & Kim, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.01353 · Cited by 76 · see citing works
Artificial Intelligence and Political Deepfakes: Shaping Citizen Perceptions Through Misinformation
Momeni, M. (2024) · Journal of Creative Communications · doi:10.1177/09732586241277335 · Cited by 42 · see citing works
Deepfake video detection: YOLO-Face convolution recurrent approach
Ismail, A. A., Elpeltagy, M. S., Zaki, M. S., & ElDahshan, K. A. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.730 · Cited by 48 · see citing works
Leveraging edges and optical flow on faces for deepfake detection
Chintha, A., Rao, A. G., Sohrawardi, S. J., Bhatt, K., Wright, M., & Ptucha, R. (2020) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb48548.2020.9304936 · Cited by 43 · see citing works
Liz, H., Keïta, M., Ahmed, A. T., Hadid, A., Huertas‐Tato, J., & Camacho, D. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102103 · Cited by 42 · see citing works
Visual Deepfake Detection: Review of Techniques, Tools, Limitations, and Future Prospects
Ur Rehman Ahmed, N., Badshah, A., Adeel, H., Tajammul, A., Daud, A., & Alsahfi, T. (2025) · IEEE Access · doi:10.1109/access.2024.3523288 · Cited by 45 · see citing works
An integrated spatiotemporal-based methodology for deepfake detection
Ismail, A., Elpeltagy, M. S., Zaki, M. S., & ElDahshan, K. A. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07633-3 · Cited by 46 · see citing works
John, J. R., & Sherif, B. V. (2022) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac55078.2022.9987265 · Cited by 44 · see citing works
Local attention and long-distance interaction of rPPG for deepfake detection
Wu, J., Zhu, Y. M., Jiang, X., Liu, Y., & Lin, J. (2023) · The Visual Computer · doi:10.1007/s00371-023-02833-x · Cited by 37 · see citing works
An Investigation into the Utilisation of CNN with LSTM for Video Deepfake Detection
Tipper, S., Atlam, H. F., & Lallie, H. S. (2024) · Applied Sciences · doi:10.3390/app14219754 · Cited by 41 · see citing works
Deepfakes: evolution and trends
Gil, R., Virgili‐Gomà, J., López, J. M., & Garcı́a, R. (2023) · Soft Computing · doi:10.1007/s00500-023-08605-y · Cited by 40 · see citing works
Yadav, A. K., & Vishwakarma, D. K. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120898 · Cited by 34 · see citing works
Adaptive Face Forgery Detection in Cross Domain
Song, L., Fang, Z., Li, X., Dong, X., Jin, Z., Chen, Y., & Lyu, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19830-4_27 · Cited by 35 · see citing works
Emergence of deepfakes and video tampering detection approaches: A survey
Kingra, S., Aggarwal, N., & Kaur, N. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13100-x · Cited by 33 · see citing works
Subjective and Objective Evaluation of Deepfake Videos
Korshunov, P., & Marcel, S. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414258 · Cited by 32 · see citing works
A deep learning model for FaceSwap and face-reenactment deepfakes detection
Nawaz, M., Javed, A., & Irtaza, A. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111854 · Cited by 31 · see citing works
Utility of Deep Learning Features for Facial Attributes Manipulation Detection
Akhtar, Z., Mouree, M. R., & Dasgupta, D. (2020) · doi:10.1109/hccai49649.2020.00015 · Cited by 30 · see citing works
Trans-DF: A Transfer Learning-based end-to-end Deepfake Detector
Patel, M. M., Gupta, A., Tanwar, S., & Obaidat, M. S. (2020) · International Conference on Computing, Communication and Automation · doi:10.1109/iccca49541.2020.9250803 · Cited by 30 · see citing works
Deep-fake video detection approaches using convolutional – recurrent neural networks
Suratkar, S. S., Bhiungade, S., Pitale, J., Soni, K., Badgujar, T., & Kazi, F. (2022) · Journal of Control and Decision · doi:10.1080/23307706.2022.2033644 · Cited by 30 · see citing works
Deepfakes Examiner: An End-to-End Deep Learning Model for Deepfakes Videos Detection
Ilyas, H., Irtaza, A., Javed, A., & Malik, K. M. (2022) · International Conference on Open Source Systems and Technologies (ICOSST) · doi:10.1109/icosst57195.2022.10016871 · Cited by 31 · see citing works
A Review of Deep Learning-based Approaches for Deepfake Content Detection
Passos, L. A., Jodas, D., Costa, K. A. P., Júnior, L. A. S., Rodrigues, D., Ser, J. D., Camacho*, D., & Papa, J. (2023) · doi:10.22541/au.169735672.27713914/v1 · Cited by 116 · see citing works
Face manipulated deepfake generation and recognition approaches: a survey
Rehaan, M., Kaur, N., & Kingra, S. (2023) · Smart Science · doi:10.1080/23080477.2023.2268380 · Cited by 31 · see citing works
AW-MSA: Adaptively weighted multi-scale attentional features for DeepFake detection
Yadav, A. K., & Vishwakarma, D. K. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107443 · Cited by 27 · see citing works
Golden ratio based deep fake video detection system with fusion of capsule networks
Dinçer, S., Ulutaş, G., Üstübioğlu, B., Tahaoğlu, G., & Sklavos, N. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2024.109234 · Cited by 29 · see citing works
Improving Generalization of Deepfake Detection by Training for Attribution
Jain, A., Korshunov, P., & Marcel, S. (2021) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp53017.2021.9733468 · Cited by 25 · see citing works
An Overview of Recent Work in Multimedia Forensics
Bhagtani, K., Yadav, A. K. S., Bartusiak, E. R., Xiang, Z., Shao, R., Baireddy, S., & Delp, E. J. (2022) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr54900.2022.00064 · Cited by 25 · see citing works
Self-citationSiamNet: Exploiting source camera noise discrepancies using Siamese Network for Deepfake Detection
Kingra, S., Aggarwal, N., & Kaur, N. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119341 · Cited by 27 · see citing works
Using Deep Learning to Detecting Deepfakes
Mallet, J., Dave, R., Seliya, N., & Vanamala, M. (2022) · 2022 9th International Conference on Soft Computing & Machine Intelligence (ISCMI) · doi:10.1109/iscmi56532.2022.10068449 · Cited by 26 · see citing works
Video authentication detection using deep learning: a systematic literature review
Alrawahneh, A. A.-M., Abdullah, S. N. H. S., Abdullah, S. N. H. S., Kamarudin, N. H., & Taylor, S. K. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05997-8 · Cited by 24 · see citing works
Datasets, clues and state-of-the-arts for multimedia forensics: An extensive review
Yadav, A. K., & Vishwakarma, D. K. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123756 · Cited by 24 · see citing works
Towards Benchmarking and Evaluating Deepfake Detection
Deng, J., Lin, C., Hu, P., Shen, C. Q., Wang, Q., Li, Q. L., & Li, Q. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3369711 · Cited by 33 · see citing works
Jayashre, K., & Amsaprabhaa, M. (2024) · Computers & Security · doi:10.1016/j.cose.2024.103860 · Cited by 21 · see citing works
Face Forgery Detection via Symmetric Transformer
Song, L., Li, X., Fang, Z., Jin, Z., Chen, Y., & Xu, C. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547806 · Cited by 21 · see citing works
A Survey on Deepfake Video Detection Techniques Using Deep Learning
Das, A., Viji, K. S. A., & Sebastian, L. (2022) · International Conference on Next Generation Intelligent Systems (ICNGIS) · doi:10.1109/icngis54955.2022.10079802 · Cited by 21 · see citing works
Deepfake Detection with Clustering-based Embedding Regularization
Zhu, K., Wu, B., & Wang, B. (2020) · IEEE International Conference on Data Science in Cyberspace · doi:10.1109/dsc50466.2020.00046 · Cited by 22 · see citing works
MagNet: Detecting Digital Presentation Attacks on Face Recognition
Agarwal, A., Singh, R., Mayank Vatsa, A., & Afzel Noore, B. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.643424 · Cited by 20 · see citing works
Generative Autoregressive Ensembles for Satellite Imagery Manipulation Detection
Montserrat, D. M., Horváth, J., Yarlagadda, S. K., Zhu, F. M., & Delp, E. J. (2020) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs49906.2020.9360909 · Cited by 19 · see citing works
Self-citationQuick Classification of Xception And Resnet-50 Models on Deepfake Video Using Local Binary Pattern
Arini, A., Bahaweres, R. B., & Haq, J. A. (2022) · International Seminar on Machine Learning, Optimization, and Data Science (ISMODE) · doi:10.1109/ismode53584.2022.9742852 · Cited by 20 · see citing works
Robust Frame-Level Detection for Deepfake Videos With Lightweight Bayesian Inference Weighting
Zhou, L., Ma, C., Wang, Z., Zhang, Y., Shi, X., & Wu, L. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3337128 · Cited by 19 · see citing works
Deepfake Detection Using Multiple Data Modalities
Hao, H., Bartusiak, E. R., Güera, D., Montserrat, D. M., Baireddy, S., Xiang, Z., Yarlagadda, S. K., Shao, R., Horváth, J., Yang, J., et al. (2022) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-030-87664-7_11 · Cited by 19 · see citing works
Self-citationDeepfake Detection Using EfficientNet and XceptionNet
Yasser, B., Hani, J., Elgayar, S., Amgad, O., Ahmed, N., Ebied, H. M., Amr, H., & Salah, M. (2023) · International Conference on Intelligent Computing and Information Systems (ICICIS) · doi:10.1109/icicis58388.2023.10391114 · Cited by 19 · see citing works
Saif, S., Tehsin, S., & Ali, S. S. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2024.123471 · Cited by 21 · see citing works
Synthesized Speech Detection Using Convolutional Transformer-Based Spectrogram Analysis
Bartusiak, E. R., & Delp, E. J. (2021) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf53345.2021.9723142 · Cited by 18 · see citing works
Self-citationSDHF: Spotting DeepFakes with Hierarchical Features
Liang, T., Chen, P., Zhou, G., Gao, H., Liu, J., Li, Z., & Dai, J. (2020) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai50040.2020.00108 · Cited by 15 · see citing works
DeepFake Videos Detection by Using Recurrent Neural Network (RNN)
Albazony, A. A. M., Alwzwazy, H. A., Al-Khaleefa, A. S., Alazzawi, M. A., Almohamadi, M., & Alavi, S. E. (2023) · Al-Sadiq International Conference on Communication and Information Technology (AICCIT) · doi:10.1109/aiccit57614.2023.10217956 · Cited by 15 · see citing works
Fake-checker: A fusion of texture features and deep learning for deepfakes detection
Huda, N. U., Javed, A., Maswadi, K., Alhazmi, A. H., & Ashraf, R. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17586-x · Cited by 15 · see citing works
Scalable Universal Adversarial Watermark Defending Against Facial Forgery
Qiao, T., Zhao, B., Shi, R., Han, M., Hassaballah, M., Retraint, F., & Luo, X. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3460387 · Cited by 15 · see citing works
Adversarial Attack on Deepfake Detection Using RL Based Texture Patches
Fernandes, S. L., & Jha, S. K. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-66415-2_14 · Cited by 15 · see citing works
Javed, M., Han, D., Dahri, F. H., Kumar, T., Bhutto, J. A., & Khowaja, A. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01188-1 · Cited by 15 · see citing works
UAM‐Net : Robust Deepfake Detection Through Hybrid Attention Into Scalable Convolutional Network
Sudarshana, K., & Yendapalli, V. (2025) · Expert Systems · doi:10.1111/exsy.70009 · Cited by 13 · see citing works
Ahmad, W., Ali, I., Shahzad, S. A., Hashmi, A., & Ghaffar, F. (2022) · International journal of electrical and computer engineering systems · doi:10.32985/ijeces.13.9.9 · Cited by 11 · see citing works
DeepExplain: Enhancing DeepFake Detection Through Transparent and Explainable AI model
Sunkari, V., & Srinagesh, A. (2024) · Informatica · doi:10.31449/inf.v48i8.5792 · Cited by 12 · see citing works
SWYNT: Swin Y-Net Transformers for Deepfake Detection
Khalid, F., Akbar, M. H., & Gul, S. (2023) · International Conference on Robotics and Automation in Industry (ICRAI) · doi:10.1109/icrai57502.2023.10089585 · Cited by 11 · see citing works
Detecting Deepfakes with Deep Learning and Gabor Filters
Hadi, W. J., Kadhem, S. M., & Abbas, A. R. (2022) · ARO-The Scientific Journal of Koya University · doi:10.14500/aro.10917 · Cited by 11 · see citing works
Deepfake Detection using Multi-path CNN and Convolutional Attention Mechanism
Rineesh Babu, P., & Nair, P. (. ). M. S. (2022) · IEEE Mysore Sub Section International Conference (MysuruCon) · doi:10.1109/mysurucon55714.2022.9972657 · Cited by 10 · see citing works
DoFNet: Depth of Field Difference Learning for Detecting Image Forgery
Jeong, Y., Choi, J., Kim, D., Park, S., Hong, M., Park, C., Min, S.-J., & Gwon, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69544-6_6 · Cited by 10 · see citing works
Changing landscape of fake news research on social media: a bibliometric analysis
Sahid, A., Maleh, Y., & Ouazzane, K. (2025) · Quality & Quantity · doi:10.1007/s11135-024-02048-9 · Cited by 10 · see citing works
Gupta, V., Srivastava, V., Yadav, A. K., Vishwakarma, D. K., & Kumar, N. (2025) · Applied Intelligence · doi:10.1007/s10489-024-06168-5 · Cited by 9 · see citing works
A Visual Computing Unified Application Using Deep Learning and Computer Vision Techniques
Sowmya, B. J., Meeradevi, M., Seema, S., Dayananda, P., Supreeth, S., Shruthi, G., & Rohith, S. (2024) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v18i01.42673 · Cited by 9 · see citing works
Aggregating Layers for Deepfake Detection
Jevnisek, A., & Avidan, S. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956052 · Cited by 9 · see citing works
Fused Swish-ReLU Efficient-Net Model for Deepfakes Detection
Ilyas, H., Javed, A., Aljasem, M., & Alhababi, M. (2023) · International Conference on Automation, Robotics and Applications · doi:10.1109/icara56516.2023.10125801 · Cited by 9 · see citing works
Alrawahneh, A. A.-M., Abdullah, S. N. H. S., Abu-Ain, T., Abdullah, S. N. A. S., Taylor, S. K., & Suhaimi, N. H. S. (2025) · IEEE Access · doi:10.1109/access.2025.3569792 · Cited by 9 · see citing works
- Authors
- Montserrat, D. M., Hao, H., Yarlagadda, S. K., Baireddy, S., Shao, R., Horvath, J., Bartusiak, E., Yang, J., Guera, D., Zhu, F., & Delp, E. J.
- Affiliations
- Purdue University West Lafayette (US)
- ORCID
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 2851-2859
- OpenAlex
- W3020392129
- Cited by
- 181
- References
- 41
- Citations by year
- 2026: 18 · 2025: 23 · 2024: 39 · 2023: 37 · 2022: 42 · 2021: 13 · 2020: 9
- FWCI
- 7.79
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- deepfake detection, video manipulation, DFDC, convolutional neural networks, recurrent neural networks, temporal features, visual features, social media misinformation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
