CoChat

A Novel Deep Learning Approach for Deepfake Image Detection

Open access
Raza, Ali, Munir, Kashif, Almutairi, Mubarak · 2022 · Applied Sciences
Cited by 220

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Abstract

Deepfake is utilized in synthetic media to generate fake visual and audio content based on a person’s existing media. The deepfake replaces a person’s face and voice with fake media to make it realistic-looking. Fake media content generation is unethical and a threat to the community. Nowadays, deepfakes are highly misused in cybercrimes for identity theft, cyber extortion, fake news, financial fraud, celebrity fake obscenity videos for blackmailing, and many more. According to a recent Sensity report, over 96% of the deepfakes are of obscene content, with most victims being from the United Kingdom, United States, Canada, India, and South Korea. In 2019, cybercriminals generated fake audio content of a chief executive officer to call his organization and ask them to transfer $243,000 to their bank account. Deepfake crimes are rising daily. Deepfake media detection is a big challenge and has high demand in digital forensics. An advanced research approach must be built to protect the victims from blackmailing by detecting deepfake content. The primary aim of our research study is to detect deepfake media using an efficient framework. A novel deepfake predictor (DFP) approach based on a hybrid of VGG16 and convolutional neural network architecture is proposed in this study. The deepfake dataset based on real and fake faces is utilized for building neural network techniques. The Xception, NAS-Net, Mobile Net, and VGG16 are the transfer learning techniques employed in comparison. The proposed DFP approach achieved 95% precision and 94% accuracy for deepfake detection. Our novel proposed DFP approach outperformed transfer learning techniques and other state-of-the-art studies. Our novel research approach helps cybersecurity professionals overcome deepfake-related cybercrimes by accurately detecting the deepfake content and saving the deepfake victims from blackmailing.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/app12199820

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 23

  1. Zobaed, S., Rabby, F., Hossain, I., Hossain, E., Hasan, S., Karim, A., and Hasib, K.M. (2021). Deepfakes: Detecting forged and synthetic media content using machine learning. Artificial Intelligence in Cyber Security: Impact and Implications, Springer. · DOI
  2. Thambawita, 2021, DeepFake electrocardiograms using generative adversarial networks are the beginning of the end for privacy issues in medicine, Sci. Rep., 11, 21869, 10.1038/s41598-021-01295-2 · DOI
  3. Ahmed, M.F.B., Miah, M.S.U., Bhowmik, A., and Sulaiman, J.B. (2021, January 4–5). Awareness to Deepfake: A resistance mechanism to Deepfake. Proceedings of the 2021 International Congress of Advanced Technology and Engineering (ICOTEN), Taiz, Yemen. · DOI
  4. Gautam, N., and Vishwakarma, D.K. (2022). Obscenity Detection in Videos through a Sequential ConvNet Pipeline Classifier. IEEE Trans. Cogn. Dev. Syst. · DOI
  5. Lee, H., Park, S.H., Yoo, J.H., Jung, S.H., and Huh, J.H. (2020). Face recognition at a distance for a stand-alone access control system. Sensors, 20. · DOI
  6. Sarangi, 2022, A feature-level fusion based improved multimodal biometric recognition system using ear and profile face, J. Ambient Intell. Humaniz. Comput., 13, 1867, 10.1007/s12652-021-02952-0 · DOI
  7. Ismail, A., Elpeltagy, M., S. Zaki, M., and Eldahshan, K. (2021). A New Deep Learning-Based Methodology for Video Deepfake Detection Using XGBoost. Sensors, 21. · DOI · Paper page
  8. Chen, 2021, YOLO-face: A real-time face detector, Vis. Comput., 37, 805, 10.1007/s00371-020-01831-7 · DOI · Paper page
  9. Pan, D., Sun, L., Wang, R., Zhang, X., and Sinnott, R.O. (2020, January 7–10). Deepfake Detection through Deep Learning. Proceedings of the 2020 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT), Leicester, UK. · DOI · Paper page
  10. Lewis, J.K., Toubal, I.E., Chen, H., Sandesera, V., Lomnitz, M., Hampel-Arias, Z., Prasad, C., and Palaniappan, K. (2020, January 13–15). Deepfake Video Detection Based on Spatial, Spectral, and Temporal Inconsistencies Using Multimodal Deep Learning. Proceedings of the 2020 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), Washington, DC, USA. · DOI · Paper page
  11. Jin, 2020, Deep facial diagnosis: Deep transfer learning from face recognition to facial diagnosis, IEEE Access, 8, 123649, 10.1109/ACCESS.2020.3005687 · DOI · Paper page
  12. Ganguly, 2022, ViXNet: Vision Transformer with Xception Network for deepfakes based video and image forgery detection, Expert Syst. Appl., 210, 118423, 10.1016/j.eswa.2022.118423 · DOI
  13. Radhika, K., Devika, K., Aswathi, T., Sreevidya, P., Sowmya, V., and Soman, K. (2020). Performance analysis of NASNet on unconstrained ear recognition. Nature Inspired Computing for Data Science, Springer. · DOI
  14. Yousfi, Y., Butora, J., Khvedchenya, E., and Fridrich, J. (2020, January 6–11). ImageNet pre-trained CNNs for JPEG steganalysis. Proceedings of the 2020 IEEE International Workshop on Information Forensics and Security (WIFS), New York, NY, USA. · DOI
  15. Venkateswarlu, I.B., Kakarla, J., and Prakash, S. (2020, January 3–5). Face mask detection using mobilenet and global pooling block. Proceedings of the 2020 IEEE 4th conference on information & communication technology (CICT), Chennai, India,. · DOI
  16. Khan, 2021, CNN with depthwise separable convolutions and combined kernels for rating prediction, Expert Syst. Appl., 170, 114528, 10.1016/j.eswa.2020.114528 · DOI
  17. Jiang, Z.P., Liu, Y.Y., Shao, Z.E., and Huang, K.W. (2021). An Improved VGG16 Model for Pneumonia Image Classification. Appl. Sci., 11. · DOI · Paper page
  18. Ansari, S., Alnajjar, K.A., Abdallah, S., Saad, M., and El-Moursy, A.A. (2021, January 14–15). Parameter Tuning of MLP, RBF, and ANFIS Models Using Genetic Algorithm in Modeling and Classification Applications. Proceedings of the 2021 International Conference on Information Technology (ICIT), Amman, Jordan. · DOI
  19. Lee, S., Kim, J., Kang, H., Kang, D.Y., and Park, J. (2021). Genetic algorithm based deep learning neural network structure and hyperparameter optimization. Appl. Sci., 11. · DOI
  20. Indra, E., Yasir, M., Andrian, A., Sitanggang, D., Sihombing, O., Tamba, S.P., and Sagala, E. (2020, January 25–27). Design and Implementation of Student Attendance System Based on Face Recognition by Haar-Like Features Methods. Proceedings of the 2020 3rd International Conference on Mechanical, Electronics, Computer, and Industrial Technology (MECnIT), Medan, Indonesia. · DOI
  21. Cao, 2020, Hyperspectral image classification with convolutional neural network and active learning, IEEE Trans. Geosci. Remote Sens., 58, 4604, 10.1109/TGRS.2020.2964627 · DOI · Paper page
  22. Ye, 2021, A Lightweight Model of VGG-16 for Remote Sensing Image Classification, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 14, 6916, 10.1109/JSTARS.2021.3090085 · DOI
  23. Phiphiphatphaisit, S., and Surinta, O. (2020, January 19–22). Food image classification with improved MobileNet architecture and data augmentation. Proceedings of the 2020 The 3rd International Conference on Information Science and System, Cambridge, UK. · DOI

Cited by

See all 220

Metadata

Authors
Raza, A., Munir, K., & Almutairi, M.
Venue
Applied Sciences
Publisher
MDPI AG
Published
2022-09-29
Volume
12
Issue
19
Pages
9820
ISSN
2076-3417 (ISSN-L)
OpenAlex
W4297988790
Cited by
220
References
5
FWCI
13.52
Type
journal article
Language
en
Open access
gold
Funders
University of Hafr Albatin, Saudi Arabia

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.