An improved dense cnn architecture for deepfake image detection
Open accessAbstract
Recent advancements in computer vision processing need potent tools to create realistic deepfakes. A generative adversarial network (GAN) can fake the captured media streams, such as images, audio, and video, and make them visually fit other environments. So, the dissemination of fake media streams creates havoc in social communities and can destroy the reputation of a person or a community. Moreover, it manipulates public sentiments and opinions toward the person or community. Recent studies have suggested using the convolutional neural network (CNN) as an effective tool to detect deepfakes in the network. But, most techniques cannot capture the inter-frame dissimilarities of the collected media streams. Motivated by this, this paper presents a novel and improved deep-CNN (D-CNN) architecture for deepfake detection with reasonable accuracy and high generalizability. Images from multiple sources are captured to train the model, improving overall generalizability capabilities. The images are re-scaled and fed to the D-CNN model. A binary-cross entropy and Adam optimizer are utilized to improve the learning rate of the D-CNN model. We have considered seven different datasets from the reconstruction challenge with 5000 deepfake images and 10000 real images. The proposed model yields an accuracy of 98.33% in AttGANa, 99.33% in GDWCTb, 95.33% in StyleGAN, 94.67% in StyleGAN2, and 99.17% in StarGANcreal and deepfake images, that indicates its viability in experimental setups.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602 · see citing works
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 1× · see citing works
“Thus, the image/video DF detection models are generally classified into three domains: physical/physiological features, signal level features, and data-driven models [21].”
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2020) · arXiv · doi:10.48550/arxiv.2004.11138 · Cited by 863
The deepfake detection challenge (dfdc) dataset
Dolhansky, B., Bitton, J., Pflaum, B., Lu, J., Howes, R., Wang, M., & Ferrer, C. C. (2020) · arXiv · doi:10.48550/arxiv.2006.07397 · Cited by 427 · see citing works
Deepfake Video Detection through Optical Flow Based CNN
Amerini, I., Galteri, L., Caldelli, R., & Del Bimbo, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00152 · Cited by 424 · cited 1× · see citing works
“Guera et al. [27] proposed a recurrent neural network (RNN) model, and Amerini et al. [33] used CNN with the concept of using discrepancies across frames to identify DF videos.”
MethodDetection of GAN-Generated Fake Images over Social Networks
Marra, F., Gragnaniello, D., Cozzolino, D., & Verdoliva, L. (2018) · 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2018.00084 · Cited by 399 · see citing works
Facial Sentiment Analysis Using AI Techniques: State-of-the-Art, Taxonomies, and Challenges
Patel, K., Mehta, D., Mistry, C., Gupta, R., Tanwar, S., Kumar, N., & Alazab, M. (2020) · IEEE Access · doi:10.1109/access.2020.2993803 · Cited by 157 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 25
- K. N. Ramadhani and R. Munir, "A comparative study of deepfake video detection method," in 2020 3rd International Conference on Information and Communications Technology (ICOIACT), pp. 394-399, 2020.
- R. Katarya and A. Lal, "A study on combating emerging threat of deepfake weaponization," in 2020 Fourth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), pp. 485-490, 2020.
- D. Yadav and S. Salmani, "Deepfake: A survey on facial forgery technique using generative adversarial network," in 2019 International Conference on Intelligent Computing and Control Systems (ICCS), pp. 852-857, 2019.
- A. Malik, M. Kuribayashi, S. M. Abdullahi, and A. N. Khan, "Deepfake detection for human face images and videos: A survey," IEEE Access, vol. 10, pp. 18757-18775, 2022.
- C. C. Ki Chan, V. Kumar, S. Delaney, and M. Gochoo, "Combating deepfakes: Multi-lstm and blockchain as proof of authenticity for digital media," in 2020 IEEE / ITU International Conference on Artificial Intelli- gence for Good (AI4G), pp. 55-62, 2020.
- J. Thies, M. Zollhöfer, M. Stamminger, C. Theobalt, and M. Nießner, "Face2face: Real-time face capture and reenactment of rgb videos," in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2387-2395, 2016.
- P. Korshunov and S. Marcel, "Vulnerability assessment and detection of deepfake videos," in 2019 International Conference on Biometrics (ICB), pp. 1-6, 2019.
- Y. Mirsky and W. Lee, "The creation and detection of deepfakes," ACM Computing Surveys, vol. 54, no. 1, 2021. cited By 25.
- P. Yu, Z. Xia, J. Fei, and Y. Lu, "A survey on deepfake video detection," IET Biometrics, vol. 10, no. 6, pp. 607-624, 2021.
- R. Caldelli, L. Galteri, I. Amerini, and A. Del Bimbo, "Optical flow based cnn for detection of unlearnt deepfake manipulations," Pattern Recognition Letters, vol. 146, pp. 31-37, 2021.
- H. S. Shad, M. M. Rizvee, N. T. Roza, S. M. A. Hoq, M. Monirujja- man Khan, A. Singh, A. Zaguia, S. Bourouis, and S. K. Gupta, "Com- parative analysis of deepfake image detection method using convolutional neural network," Intell. Neuroscience, vol. 2021, jan 2021.
- J. Hathaliya, R. Parekh, N. Patel, R. Gupta, S. Tanwar, F. Alqahtani, M. El- ghatwary, O. Ivanov, M. S. Raboaca, and B.-C. Neagu, "Convolutional neural network-based parkinson disease classification using spect imaging data," Mathematics, vol. 10, no. 15, 2022.
- D. Afchar, V. Nozick, J. Yamagishi, and I. Echizen, "Mesonet: a compact facial video forgery detection network," in 2018 IEEE International Work- shop on Information Forensics and Security (WIFS), pp. 1-7, 2018.
- Y. Zhang, J. Zhan, W. Jiang, and Z. Fan, "Deepfake detection based on incompatibility between multiple modes," in 2021 International Confer- ence on Intelligent Technology and Embedded Systems (ICITES), pp. 1-7, 2021.
- Y. Li, M.-C. Chang, and S. Lyu, "In ictu oculi: Exposing ai created fake videos by detecting eye blinking," in 2018 IEEE International Workshop on Information Forensics and Security (WIFS), pp. 1-7, 2018.
- C.-C. Hsu, C.-Y. Lee, and Y.-X. Zhuang, "Learning to detect fake face images in the wild," in 2018 International Symposium on Computer, Consumer and Control (IS3C), pp. 388-391, 2018.
- D. Afchar, V. Nozick, J. Yamagishi, and I. Echizen, "Mesonet: a compact facial video forgery detection network," in 2018 IEEE International Work- shop on Information Forensics and Security (WIFS), pp. 1-7, 2018.
- D. Güera and E. J. Delp, "Deepfake video detection using recurrent neural networks," in 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1-6, 2018.
- X. Yang, Y. Li, and S. Lyu, "Exposing deep fakes using inconsistent head poses," in ICASSP 2019 -2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8261-8265, 2019.
- F. Matern, C. Riess, and M. Stamminger, "Exploiting visual artifacts to expose deepfakes and face manipulations," in 2019 IEEE Winter Applica- tions of Computer Vision Workshops (WACVW), pp. 83-92, 2019.
- F. F. Kharbat, T. Elamsy, A. Mahmoud, and R. Abdullah, "Image feature detectors for deepfake video detection," in 2019 IEEE/ACS 16th Inter- national Conference on Computer Systems and Applications (AICCSA), pp. 1-4, 2019.
- Z. Akhtar and D. Dasgupta, "A comparative evaluation of local feature de- scriptors for deepfakes detection," in 2019 IEEE International Symposium on Technologies for Homeland Security (HST), pp. 1-5, 2019.
- H. H. Nguyen, J. Yamagishi, and I. Echizen, "Capsule-forensics: Using capsule networks to detect forged images and videos," in ICASSP 2019 -2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2307-2311, 2019.
- M. Dordevic, M. Milivojevic, and A. Gavrovska, "Deepfake video analysis using sift features," in 2019 27th Telecommunications Forum (TELFOR), pp. 1-4, 2019.
- "Deepfake images detection and reconstruction challenge -21st interna- tional conference on image analysis and processing.." https://iplab.dmi. unict.it/Deepfakechallenge/. Accessed: 2023-01-05.
Cited by
Sorted by citations
Deepfake generation and detection: Case study and challenges
Patel, Y., Tanwar, S., Gupta, R., Bhattacharya, P., Davidson, I. E., Nyameko, R., Aluvala, S., & Vimal, V. (2023) · IEEE Access · doi:10.1109/access.2023.3342107 · Cited by 186 · see citing works
Self-citationDeepfake Attacks: Generation, Detection, Datasets, Challenges, and Research Directions
Naitali, A., Ridouani, M., Salahdine, F., & Kaabouch, N. (2023) · Computers · doi:10.3390/computers12100216 · Cited by 117 · see citing works
Beyond Accuracy: A Deployment-Oriented Benchmark of Deepfake Detection Models
Ain, Q. U., Ning, H., Philipo, A. G., Daneshmand, M., & Ding, J. (2025) · Preprint (TechRxiv) · doi:10.36227/techrxiv.176315939.91577661/v1 · Cited by 2 · see citing works
- Authors
- Patel, Y., Tanwar, S., Bhattacharya, P., Gupta, R., Alsuwian, T., Davidson, I. E., & Mazibuko, T. F.
- Affiliations
- Nirma University (IN)
- Amity University (IN)
- Najran University (SA)
- Cape Peninsula University of Technology (ZA)
- Durban University of Technology (ZA)
- ORCID
- Venue
- IEEE Access
- Published
- 2023
- Volume
- 11
- Pages
- 22081-22095
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4323022407
- Cited by
- 196
- References
- 7
- Citations by year
- 2026: 65 · 2025: 75 · 2024: 47 · 2023: 8 · 2022: 1
- FWCI
- 17.70
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- IEEE Access (publishedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- deepfake detection, dense convolutional neural network, generative adversarial networks, fake media, image editing, convolutional neural network architecture, binary cross-entropy loss, Adam optimizer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review