Using Deep Learning to Detecting Deepfakes
Open accessThe DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Abstract
In the recent years, social media has grown to become a major source of information for many online users. This has given rise to the spread of misinformation through deepfakes. Deepfakes are videos or images that replace one person's face with another computer-generated face, often a more recognizable person in society. With the recent advances in technology, a person with little technological experience can generate these videos. This enables them to mimic a power figure in society, such as a president or celebrity, creating the potential danger of spreading misinformation and other nefarious uses of deepfakes. To combat this online threat, researchers have developed models that are designed to detect deepfakes. This study looks at various deepfake detection models that use deep learning algorithms to combat this looming threat. This survey focuses on providing a comprehensive overview of the current state of deepfake detection models and the unique approaches many researchers take to solving this problem. The benefits, limitations, and suggestions for future work will be thoroughly discussed throughout this paper.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To overcome these limitations, deep learning models exploit data-driven patterns, learning to recognize subtle inconsistencies imperceptible to the human eye [11].”
From Deepfake Media Forensics: Status and Future Challenges (2025) · cites this paper as [11]
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 8×
“[19] uses a metric know as the Mask-SSIM score, which is referenced as a quantitative metric that evaluates the visual quality of a deepfake‘s video frames.”
BackgroundMethodInfluentialDeepfake Video Detection Using Recurrent Neural Networks
Guera, D., & Delp, E. J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639163 · Cited by 1,285
Exposing DeepFake Videos By Detecting Face Warping Artifacts
Li, Y., & Lyu, S. (2018) · arXiv · doi:10.48550/arxiv.1811.00656 · Cited by 785 · cited 2×
“While a large portion of Deepfake models may utilize a CNN, as seen in [22-27], they are applied in unique ways for each model.”
BackgroundMethodDeepfake Video Detection through Optical Flow Based CNN
Amerini, I., Galteri, L., Caldelli, R., & Del Bimbo, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00152 · Cited by 424
(2019) · Cited by 415
Deepfakes Detection with Automatic Face Weighting
Montserrat, D. M., Hao, H., Yarlagadda, S. K., Baireddy, S., Shao, R., Horvath, J., Bartusiak, E., Yang, J., Guera, D., Zhu, F., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00342 · Cited by 181 · cited 1×
“The first type of methodology can be seen in [10-13], as some researchers have attempted to find the inconsistencies of how the POI‘s facial features, and other regions of interest move compared to the deepfake‘s constructed movement of the same features across the temporal domain.”
DeepFake video detection using convolutional vision transformer
Wodajo, D., & Atnafu, S. (2021) · arXiv · doi:10.48550/arxiv.2102.11126 · Cited by 147
DeepfakeStack: A Deep Ensemble-based Learning Technique for Deepfake Detection
Rana, M. S., & Sung, A. H. (2020) · 2020 7th IEEE International Conference on Cyber Security and Cloud Computing (CSCloud)/2020 6th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom) · doi:10.1109/cscloud-edgecom49738.2020.00021 · Cited by 133 · cited 1×
“Some detection tools are available to the public already, overviewed in [40], yet there is still room for much improvement.”
BackgroundCiftci, U. A., Demir, I., & Yin, L. (2020) · 2020 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb48548.2020.9304909 · Cited by 115
(2020) · doi:10.1007/978-3-030-68821-9_38 · Cited by 113
Applications of Recurrent Neural Network for Biometric Authentication & Anomaly Detection
Ackerson, J., Dave, R., & Seliya, N. (2021) · Information · doi:10.3390/info12070272 · Cited by 110
Self-citationOne Detector to Rule Them All: Towards a General Deepfake Attack Detection Framework
Tariq, S., Lee, S., & Woo, S. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449809 · Cited by 91 · cited 1×
“Many are unable to perform at the same level when applied in the real world or different datasets, but [18] looks to solve this issue by inputting a wide variety of features.”
BackgroundDetecting Deepfakes with Metric Learning
Kumar, A., Bhavsar, A., & Verma, R. (2020) · 2020 8th International Workshop on Biometrics and Forensics (IWBF) · doi:10.1109/iwbf49977.2020.9107962 · Cited by 90 · cited 2×
“Where [28] really separates itself from other work is by using a triplet network.”
BackgroundResultLewis, J. K., Toubal, I. E., Chen, H., Sandesera, V., Lomnitz, M., Hampel-Arias, Z., Prasad, C., & Palaniappan, K. (2020) · 2020 IEEE Applied Imagery Pattern Recognition Workshop (AIPR) · doi:10.1109/aipr50011.2020.9425167 · Cited by 80
Exploiting Prediction Error Inconsistencies through LSTM-based Classifiers to Detect Deepfake Videos
Amerini, I., & Caldelli, R. (2020) · Proceedings of the 2020 ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3369412.3395070 · Cited by 64 · cited 5×
“A methodology involving analyzing the motion between subsequent frames is applied in the model developed by [31].”
BackgroundMethodInfluentialUser Authentication Schemes Using Machine Learning Methods—A Review
Siddiqui, N., Pryor, L., & Dave, R. (2021) · Algorithms for intelligent systems · doi:10.1007/978-981-16-3246-4_54 · Cited by 63
Self-citationDeepfake Detection using Spatiotemporal Convolutional Networks
de Lima, O., Franklin, S., Basu, S., Karwoski, B., & George, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14749 · Cited by 62
DeepFake Detection Using Error Level Analysis and Deep Learning
Rafique, R., Nawaz, M., Kibriya, H., & Masood, M. (2021) · 2021 4th International Conference on Computing & Information Sciences (ICCIS) · doi:10.1109/iccis54243.2021.9676375 · Cited by 62
DeepFakes Detection Based on Heart Rate Estimation: Single- and Multi-frame
Hernandez‐Ortega, J., Tolosana, R., Fiérrez, J., & Morales, A. (2022) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-030-87664-7_12 · Cited by 62
Machine and Deep Learning Applications to Mouse Dynamics for Continuous User Authentication
Siddiqui, N., Dave, R., Vanamala, M., & Seliya, N. (2022) · Machine Learning and Knowledge Extraction · doi:10.3390/make4020023 · Cited by 59
Self-citationWhere Do Deep Fakes Look? Synthetic Face Detection via Gaze Tracking
Demir, I., & Ciftci, U. A. (2021) · ACM Symposium on Eye Tracking Research and Applications · doi:10.1145/3448017.3457387 · Cited by 55
Continuous User Authentication Using Mouse Dynamics, Machine Learning, and Minecraft
Siddiqui, N., Dave, R., & Seliya, N. (2021) · International Conference on Electrical, Computer and Energy Technologies (ICECET) · doi:10.1109/icecet52533.2021.9698532 · Cited by 52
Self-citationA Modern Analysis of Aging Machine Learning Based IoT Cybersecurity Methods
Strecker, S., Dave, R., Siddiqui, N., & Seliya, N. (2021) · Journal of Computer Sciences and Applications · doi:10.12691/jcsa-9-1-2 · Cited by 49
Self-citationGunn, D. J., Liu, Z., Dave, R., Yuan, X., & Roy, K. (2019) · International Journal of Computational Intelligence and Applications · doi:10.1142/s1469026819500226 · Cited by 46
Self-citationHold On and Swipe: A Touch-Movement Based Continuous Authentication Schema based on Machine Learning
Mallet, J., Pryor, L., Dave, R., Seliya, N., Vanamala, M., & Sowells-Boone, E. R. (2022) · Asia Conference on Algorithms, Computing and Machine Learning (CACML) · doi:10.1109/cacml55074.2022.00081 · Cited by 45
Self-citationPalm Print Authentication on a Cloud Platform
Shelton, J., Rice, C., Singh, J., Jenkins, J., Dave, R., Roy, K., & Chakraborty, S. (2018) · International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems (icABCD) · doi:10.1109/icabcd.2018.8465479 · Cited by 38
Self-citationUtility of Deep Learning Features for Facial Attributes Manipulation Detection
Akhtar, Z., Mouree, M. R., & Dasgupta, D. (2020) · doi:10.1109/hccai49649.2020.00015 · Cited by 34
FakeBuster: A DeepFakes Detection Tool for Video Conferencing Scenarios
Mehta, V., Gupta, P., Subramanian, R., & Dhall, A. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397482.3450726 · Cited by 34
Machine Learning Algorithms In User Authentication Schemes
Pryor, L., Dave, R., Seliya, J., & Sowells-Boone, E. R. (2021) · International Conference on Electrical, Computer and Energy Technologies (ICECET) · doi:10.1109/icecet52533.2021.9698440 · Cited by 31
Self-citationDodging DeepFake Detection via Implicit Spatial-Domain Notch Filtering
Huang, Y., Juefei-Xu, F., Guo, Q., Liu, Y., & Pu, G. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3325427 · Cited by 30
Deep Learning model-based Multimedia forgery detection
Shah, Y., Shah, P., Patel, M., Khamkar, C., & Kanani, P. (2020) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac49090.2020.9243530 · Cited by 26
Spotting Deepfakes and Face Manipulations by Fusing Features from Multi-Stream CNNs Models
Yavuzkılıç, S., Şengür, A., Akhtar, Z., & Siddique, K. (2021) · Symmetry · doi:10.3390/sym13081352 · Cited by 23
GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detection
Neves, J. C., Tolosana, R., Vera-Rodriguez, R., Lopes, V., Proenca, H., & Fierrez, J. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3007250 · Cited by 12
Using deep learning to detect deepfake videos
Shende, A. (2021) · Turkish Journal of Computer and Mathematics Education (TURCOMAT) · Cited by 12
Research works printed but not linked: 4
- 10.1109/hccai49649.2020.00015 · DOI
- Li, 2019, Celeb-DF (v2): A New Dataset for DeepFake Forensics, arXiv preprint
- Albahar, 2019, DEEPFAKES: THREATS AND COUNTERMEASURES SYSTEMATIC REVIEW, Journal of Theoretical and Applied Information Technology, 97, 22
- 10.1109/cscloud-edgecom49738.2020.00021 · DOI · Paper page
Cited by
Deepfake Attacks: Generation, Detection, Datasets, Challenges, and Research Directions
Naitali, A., Ridouani, M., Salahdine, F., & Kaabouch, N. (2023) · Computers · doi:10.3390/computers12100216 · Cited by 117
Deepfake Media Forensics: Status and Future Challenges
Amerini, I., Barni, M., Battiato, S., Bestagini, P., Boato, G., Bruni, V., Caldelli, R., De Natale, F., De Nicola, R., Guarnera, L., et al. (2025) · Journal of Imaging · doi:10.3390/jimaging11030073 · Cited by 113
Advancements in detecting Deepfakes: AI algorithms and future prospects − a review
Singh, L. H., Charanarur, P., & Chaudhary, N. K. (2025) · Discover Internet of Things · doi:10.1007/s43926-025-00154-0 · Cited by 57
Liz-López, H., Keïta, M., Ahmed, A. T., Hadid, A., Huertas‐Tato, J., & Camacho, D. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102103 · Cited by 53
Deepfake Detection Analyzing Hybrid Dataset Utilizing CNN and SVM
Mallet, J., Pryor, L., Dave, R., & Vanamala, M. (2023) · International Conference on Intelligent Systems, Metaheuristics & Swarm Intelligence (ISMSI) · doi:10.1145/3596947.3596954 · Cited by 43
Self-citation
Metadata
- Authors
- Mallet, J., Dave, R., Seliya, N., & Vanamala, M.
- Affiliations
- University of Wisconsin–Eau Claire (US)
- Minnesota State University, Mankato (US)
- Venue
- 2022 9th International Conference on Soft Computing & Machine Intelligence (ISCMI)
- Publisher
- IEEE
- Published
- 2022-11-26
- Pages
- 1-5
- OpenAlex
- W4352981324
- Cited by
- 26
- References
- 37
- Citations by year
- 2025: 8 · 2024: 4 · 2023: 13 · 2022: 1
- FWCI
- 2.36
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- International Conference on Soft Computing & Machine Intelligence (ISCMI) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- University of Wisconsin-Eau Claire's Office of Research
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Keywords
- deepfake detection, deepfakes, misinformation, face swapping, synthetic media, deep learning models, social media, video forgery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.