A Novel Deep Learning Approach for Deepfake Image Detection
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Deepfake is utilized in synthetic media to generate fake visual and audio content based on a person’s existing media. The deepfake replaces a person’s face and voice with fake media to make it realistic-looking. Fake media content generation is unethical and a threat to the community. Nowadays, deepfakes are highly misused in cybercrimes for identity theft, cyber extortion, fake news, financial fraud, celebrity fake obscenity videos for blackmailing, and many more. According to a recent Sensity report, over 96% of the deepfakes are of obscene content, with most victims being from the United Kingdom, United States, Canada, India, and South Korea. In 2019, cybercriminals generated fake audio content of a chief executive officer to call his organization and ask them to transfer $243,000 to their bank account. Deepfake crimes are rising daily. Deepfake media detection is a big challenge and has high demand in digital forensics. An advanced research approach must be built to protect the victims from blackmailing by detecting deepfake content. The primary aim of our research study is to detect deepfake media using an efficient framework. A novel deepfake predictor (DFP) approach based on a hybrid of VGG16 and convolutional neural network architecture is proposed in this study. The deepfake dataset based on real and fake faces is utilized for building neural network techniques. The Xception, NAS-Net, Mobile Net, and VGG16 are the transfer learning techniques employed in comparison. The proposed DFP approach achieved 95% precision and 94% accuracy for deepfake detection. Our novel proposed DFP approach outperformed transfer learning techniques and other state-of-the-art studies. Our novel research approach helps cybersecurity professionals overcome deepfake-related cybercrimes by accurately detecting the deepfake content and saving the deepfake victims from blackmailing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeepVision: Deepfakes Detection Using Human Eye Blinking Pattern
Jung, T., Kim, S., & Kim, K. (2020) · IEEE Access · doi:10.1109/access.2020.2988660 · Cited by 326
Deep fake image detection based on pairwise learning
Hsu, C.-C., Zhuang, Y.-X., & Lee, C.-Y. (2020) · Applied Sciences · doi:10.3390/app10010370 · Cited by 304
DeepfakeStack: A Deep Ensemble-based Learning Technique for Deepfake Detection
Rana, M. S., & Sung, A. H. (2020) · 2020 7th IEEE International Conference on Cyber Security and Cloud Computing (CSCloud)/2020 6th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom) · doi:10.1109/cscloud-edgecom49738.2020.00021 · Cited by 133
Machine learning based medical image deepfake detection: A comparative study
Solaiyappan, S., & Wen, Y. (2022) · Machine Learning with Applications · doi:10.1016/j.mlwa.2022.100298 · Cited by 73
Face Recognition Based on Deep Learning and FPGA for Ethnicity Identification
AlBdairi, A. J. A., Xiao, Z., Alkhayyat, A., Humaidi, A. J., Fadhel, M. A., Taher, B. H., Alzubaidi, L., Santamaría, J., & Al-Shamma, O. (2022) · Applied Sciences · doi:10.3390/app12052605 · Cited by 54
Research works printed but not linked: 23
- Zobaed, S., Rabby, F., Hossain, I., Hossain, E., Hasan, S., Karim, A., and Hasib, K.M. (2021). Deepfakes: Detecting forged and synthetic media content using machine learning. Artificial Intelligence in Cyber Security: Impact and Implications, Springer. · DOI
- Thambawita, 2021, DeepFake electrocardiograms using generative adversarial networks are the beginning of the end for privacy issues in medicine, Sci. Rep., 11, 21869, 10.1038/s41598-021-01295-2 · DOI
- Ahmed, M.F.B., Miah, M.S.U., Bhowmik, A., and Sulaiman, J.B. (2021, January 4–5). Awareness to Deepfake: A resistance mechanism to Deepfake. Proceedings of the 2021 International Congress of Advanced Technology and Engineering (ICOTEN), Taiz, Yemen. · DOI
- Gautam, N., and Vishwakarma, D.K. (2022). Obscenity Detection in Videos through a Sequential ConvNet Pipeline Classifier. IEEE Trans. Cogn. Dev. Syst. · DOI
- Lee, H., Park, S.H., Yoo, J.H., Jung, S.H., and Huh, J.H. (2020). Face recognition at a distance for a stand-alone access control system. Sensors, 20. · DOI
- Sarangi, 2022, A feature-level fusion based improved multimodal biometric recognition system using ear and profile face, J. Ambient Intell. Humaniz. Comput., 13, 1867, 10.1007/s12652-021-02952-0 · DOI
- Ismail, A., Elpeltagy, M., S. Zaki, M., and Eldahshan, K. (2021). A New Deep Learning-Based Methodology for Video Deepfake Detection Using XGBoost. Sensors, 21. · DOI · Paper page
- Chen, 2021, YOLO-face: A real-time face detector, Vis. Comput., 37, 805, 10.1007/s00371-020-01831-7 · DOI · Paper page
- Pan, D., Sun, L., Wang, R., Zhang, X., and Sinnott, R.O. (2020, January 7–10). Deepfake Detection through Deep Learning. Proceedings of the 2020 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT), Leicester, UK. · DOI · Paper page
- Lewis, J.K., Toubal, I.E., Chen, H., Sandesera, V., Lomnitz, M., Hampel-Arias, Z., Prasad, C., and Palaniappan, K. (2020, January 13–15). Deepfake Video Detection Based on Spatial, Spectral, and Temporal Inconsistencies Using Multimodal Deep Learning. Proceedings of the 2020 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), Washington, DC, USA. · DOI · Paper page
- Jin, 2020, Deep facial diagnosis: Deep transfer learning from face recognition to facial diagnosis, IEEE Access, 8, 123649, 10.1109/ACCESS.2020.3005687 · DOI · Paper page
- Ganguly, 2022, ViXNet: Vision Transformer with Xception Network for deepfakes based video and image forgery detection, Expert Syst. Appl., 210, 118423, 10.1016/j.eswa.2022.118423 · DOI
- Radhika, K., Devika, K., Aswathi, T., Sreevidya, P., Sowmya, V., and Soman, K. (2020). Performance analysis of NASNet on unconstrained ear recognition. Nature Inspired Computing for Data Science, Springer. · DOI
- Yousfi, Y., Butora, J., Khvedchenya, E., and Fridrich, J. (2020, January 6–11). ImageNet pre-trained CNNs for JPEG steganalysis. Proceedings of the 2020 IEEE International Workshop on Information Forensics and Security (WIFS), New York, NY, USA. · DOI
- Venkateswarlu, I.B., Kakarla, J., and Prakash, S. (2020, January 3–5). Face mask detection using mobilenet and global pooling block. Proceedings of the 2020 IEEE 4th conference on information & communication technology (CICT), Chennai, India,. · DOI
- Khan, 2021, CNN with depthwise separable convolutions and combined kernels for rating prediction, Expert Syst. Appl., 170, 114528, 10.1016/j.eswa.2020.114528 · DOI
- Jiang, Z.P., Liu, Y.Y., Shao, Z.E., and Huang, K.W. (2021). An Improved VGG16 Model for Pneumonia Image Classification. Appl. Sci., 11. · DOI · Paper page
- Ansari, S., Alnajjar, K.A., Abdallah, S., Saad, M., and El-Moursy, A.A. (2021, January 14–15). Parameter Tuning of MLP, RBF, and ANFIS Models Using Genetic Algorithm in Modeling and Classification Applications. Proceedings of the 2021 International Conference on Information Technology (ICIT), Amman, Jordan. · DOI
- Lee, S., Kim, J., Kang, H., Kang, D.Y., and Park, J. (2021). Genetic algorithm based deep learning neural network structure and hyperparameter optimization. Appl. Sci., 11. · DOI
- Indra, E., Yasir, M., Andrian, A., Sitanggang, D., Sihombing, O., Tamba, S.P., and Sagala, E. (2020, January 25–27). Design and Implementation of Student Attendance System Based on Face Recognition by Haar-Like Features Methods. Proceedings of the 2020 3rd International Conference on Mechanical, Electronics, Computer, and Industrial Technology (MECnIT), Medan, Indonesia. · DOI
- Cao, 2020, Hyperspectral image classification with convolutional neural network and active learning, IEEE Trans. Geosci. Remote Sens., 58, 4604, 10.1109/TGRS.2020.2964627 · DOI · Paper page
- Ye, 2021, A Lightweight Model of VGG-16 for Remote Sensing Image Classification, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 14, 6916, 10.1109/JSTARS.2021.3090085 · DOI
- Phiphiphatphaisit, S., and Surinta, O. (2020, January 19–22). Food image classification with improved MobileNet architecture and data augmentation. Proceedings of the 2020 The 3rd International Conference on Information Science and System, Cambridge, UK. · DOI
Cited by
Qureshi, S. M., Saeed, A., Almotiri, S. H., Ahmad, F., & Al Ghamdi, M. A. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2037 · Cited by 71
Xu, S., Yang, X., & Xie, Z. (2025) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-025-02048-y · Cited by 2
Metadata
- Authors
- Raza, A., Munir, K., & Almutairi, M.
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2022-09-29
- Volume
- 12
- Issue
- 19
- Pages
- 9820
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W4297988790
- Cited by
- 220
- References
- 5
- FWCI
- 13.52
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- University of Hafr Albatin, Saudi Arabia
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.