Cited by 196Digital Media Forensic DetectionGenerative Adversarial Networks and Image SynthesisMisinformation and Its Impacts

An improved dense cnn architecture for deepfake image detection

Open access
Patel, Yogesh, Tanwar, Sudeep, Bhattacharya, Pronaya, Gupta, Rajesh, Alsuwian, Turki, Davidson, Innocent Ewean, Mazibuko, Thokozile F.·2023·IEEE Access

Abstract

Recent advancements in computer vision processing need potent tools to create realistic deepfakes. A generative adversarial network (GAN) can fake the captured media streams, such as images, audio, and video, and make them visually fit other environments. So, the dissemination of fake media streams creates havoc in social communities and can destroy the reputation of a person or a community. Moreover, it manipulates public sentiments and opinions toward the person or community. Recent studies have suggested using the convolutional neural network (CNN) as an effective tool to detect deepfakes in the network. But, most techniques cannot capture the inter-frame dissimilarities of the collected media streams. Motivated by this, this paper presents a novel and improved deep-CNN (D-CNN) architecture for deepfake detection with reasonable accuracy and high generalizability. Images from multiple sources are captured to train the model, improving overall generalizability capabilities. The images are re-scaled and fed to the D-CNN model. A binary-cross entropy and Adam optimizer are utilized to improve the learning rate of the D-CNN model. We have considered seven different datasets from the reconstruction challenge with 5000 deepfake images and 10000 real images. The proposed model yields an accuracy of 98.33% in AttGANa, 99.33% in GDWCTb, 95.33% in StyleGAN, 94.67% in StyleGAN2, and 99.17% in StarGANcreal and deepfake images, that indicates its viability in experimental setups.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/access.2023.3251417

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 25

  1. K. N. Ramadhani and R. Munir, "A comparative study of deepfake video detection method," in 2020 3rd International Conference on Information and Communications Technology (ICOIACT), pp. 394-399, 2020.
  2. R. Katarya and A. Lal, "A study on combating emerging threat of deepfake weaponization," in 2020 Fourth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), pp. 485-490, 2020.
  3. D. Yadav and S. Salmani, "Deepfake: A survey on facial forgery technique using generative adversarial network," in 2019 International Conference on Intelligent Computing and Control Systems (ICCS), pp. 852-857, 2019.
  4. A. Malik, M. Kuribayashi, S. M. Abdullahi, and A. N. Khan, "Deepfake detection for human face images and videos: A survey," IEEE Access, vol. 10, pp. 18757-18775, 2022.
  5. C. C. Ki Chan, V. Kumar, S. Delaney, and M. Gochoo, "Combating deepfakes: Multi-lstm and blockchain as proof of authenticity for digital media," in 2020 IEEE / ITU International Conference on Artificial Intelli- gence for Good (AI4G), pp. 55-62, 2020.
  6. J. Thies, M. Zollhöfer, M. Stamminger, C. Theobalt, and M. Nießner, "Face2face: Real-time face capture and reenactment of rgb videos," in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2387-2395, 2016.
  7. P. Korshunov and S. Marcel, "Vulnerability assessment and detection of deepfake videos," in 2019 International Conference on Biometrics (ICB), pp. 1-6, 2019.
  8. Y. Mirsky and W. Lee, "The creation and detection of deepfakes," ACM Computing Surveys, vol. 54, no. 1, 2021. cited By 25.
  9. P. Yu, Z. Xia, J. Fei, and Y. Lu, "A survey on deepfake video detection," IET Biometrics, vol. 10, no. 6, pp. 607-624, 2021.
  10. R. Caldelli, L. Galteri, I. Amerini, and A. Del Bimbo, "Optical flow based cnn for detection of unlearnt deepfake manipulations," Pattern Recognition Letters, vol. 146, pp. 31-37, 2021.
  11. H. S. Shad, M. M. Rizvee, N. T. Roza, S. M. A. Hoq, M. Monirujja- man Khan, A. Singh, A. Zaguia, S. Bourouis, and S. K. Gupta, "Com- parative analysis of deepfake image detection method using convolutional neural network," Intell. Neuroscience, vol. 2021, jan 2021.
  12. J. Hathaliya, R. Parekh, N. Patel, R. Gupta, S. Tanwar, F. Alqahtani, M. El- ghatwary, O. Ivanov, M. S. Raboaca, and B.-C. Neagu, "Convolutional neural network-based parkinson disease classification using spect imaging data," Mathematics, vol. 10, no. 15, 2022.
  13. D. Afchar, V. Nozick, J. Yamagishi, and I. Echizen, "Mesonet: a compact facial video forgery detection network," in 2018 IEEE International Work- shop on Information Forensics and Security (WIFS), pp. 1-7, 2018.
  14. Y. Zhang, J. Zhan, W. Jiang, and Z. Fan, "Deepfake detection based on incompatibility between multiple modes," in 2021 International Confer- ence on Intelligent Technology and Embedded Systems (ICITES), pp. 1-7, 2021.
  15. Y. Li, M.-C. Chang, and S. Lyu, "In ictu oculi: Exposing ai created fake videos by detecting eye blinking," in 2018 IEEE International Workshop on Information Forensics and Security (WIFS), pp. 1-7, 2018.
  16. C.-C. Hsu, C.-Y. Lee, and Y.-X. Zhuang, "Learning to detect fake face images in the wild," in 2018 International Symposium on Computer, Consumer and Control (IS3C), pp. 388-391, 2018.
  17. D. Afchar, V. Nozick, J. Yamagishi, and I. Echizen, "Mesonet: a compact facial video forgery detection network," in 2018 IEEE International Work- shop on Information Forensics and Security (WIFS), pp. 1-7, 2018.
  18. D. Güera and E. J. Delp, "Deepfake video detection using recurrent neural networks," in 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1-6, 2018.
  19. X. Yang, Y. Li, and S. Lyu, "Exposing deep fakes using inconsistent head poses," in ICASSP 2019 -2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8261-8265, 2019.
  20. F. Matern, C. Riess, and M. Stamminger, "Exploiting visual artifacts to expose deepfakes and face manipulations," in 2019 IEEE Winter Applica- tions of Computer Vision Workshops (WACVW), pp. 83-92, 2019.
  21. F. F. Kharbat, T. Elamsy, A. Mahmoud, and R. Abdullah, "Image feature detectors for deepfake video detection," in 2019 IEEE/ACS 16th Inter- national Conference on Computer Systems and Applications (AICCSA), pp. 1-4, 2019.
  22. Z. Akhtar and D. Dasgupta, "A comparative evaluation of local feature de- scriptors for deepfakes detection," in 2019 IEEE International Symposium on Technologies for Homeland Security (HST), pp. 1-5, 2019.
  23. H. H. Nguyen, J. Yamagishi, and I. Echizen, "Capsule-forensics: Using capsule networks to detect forged images and videos," in ICASSP 2019 -2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2307-2311, 2019.
  24. M. Dordevic, M. Milivojevic, and A. Gavrovska, "Deepfake video analysis using sift features," in 2019 27th Telecommunications Forum (TELFOR), pp. 1-4, 2019.
  25. "Deepfake images detection and reconstruction challenge -21st interna- tional conference on image analysis and processing.." https://iplab.dmi. unict.it/Deepfakechallenge/. Accessed: 2023-01-05.

Cited by

Sorted by citations

Authors
Patel, Y., Tanwar, S., Bhattacharya, P., Gupta, R., Alsuwian, T., Davidson, I. E., & Mazibuko, T. F.
Affiliations
  • Nirma University (IN)
  • Amity University (IN)
  • Najran University (SA)
  • Cape Peninsula University of Technology (ZA)
  • Durban University of Technology (ZA)
Venue
IEEE Access
Published
2023
Volume
11
Pages
22081-22095
ISSN
2169-3536 (ISSN-L)
OpenAlex
W4323022407
Cited by
196
References
7
Citations by year
2026: 65 · 2025: 75 · 2024: 47 · 2023: 8 · 2022: 1
FWCI
17.70
Type
journal article
Language
en
Open access
Locations
  • IEEE Access (publishedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
Keywords
deepfake detection, dense convolutional neural network, generative adversarial networks, fake media, image editing, convolutional neural network architecture, binary cross-entropy loss, Adam optimizer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review