The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images
Open accessAbstract
Recent advances in synthetic data have enabled the generation of images with such high quality that human beings cannot tell the difference between real-life photographs and Artificial Intelligence (AI) generated images. Given the critical necessity of data reliability and authentication, this article proposes to enhance our ability to recognise AI-generated images through computer vision. Initially, a synthetic dataset is generated that mirrors the ten classes of the already available CIFAR-10 dataset with latent diffusion, providing a contrasting set of images for comparison to real photographs. The model is capable of generating complex visual attributes, such as photorealistic reflections in water. The two sets of data present as a binary classification problem with regard to whether the photograph is real or generated by AI. This study then proposes the use of a Convolutional Neural Network (CNN) to classify the images into two categories; Real or Fake. Following hyperparameter tuning and the training of 36 individual network topologies, the optimal approach could correctly classify the images with 92.98% accuracy. Finally, this study implements explainable AI via Gradient Class Activation Mapping to explore which features within the images are useful for classification. Interpretation reveals interesting concepts within the image, in particular, noting that the actual entity itself does not hold useful information for classification; instead, the model focuses on small visual imperfections in the background of the images. The complete dataset engineered for this study, referred to as the CIFAKE dataset, is made publicly available to the research community for future work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects
Li, Z., Liu, F., Yang, W., Peng, S., & Zhou, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084827 · Cited by 5,273 · cited 1×
“In this study, the Convolutional Neural Network (CNN) [26], [27], [28] is employed to learn from the input 15644 VOLUME 12, 2024 Authorized licensed use limited to the terms of the applicable license agreement with IEEE.”
MethodPhotorealistic Text-to-Image Diffusion Models with Deep Language Understanding
Saharia, C., Chan, W., Saxena, S., Li, L., Whang, J., Denton, E., Ghasemipour, S. K. S., Ayan, B. K., Mahdavi, S. S., Lopes, R. G., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.11487 · Cited by 2,528
Zero-shot text-to-image generation
Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., Chen, M., & Sutskever, I. (2021) · arXiv · doi:10.48550/arxiv.2102.12092 · Cited by 2,417
XAI—Explainable artificial intelligence
Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S., & Yang, G.-Z. (2019) · Science Robotics · doi:10.1126/scirobotics.aay7120 · Cited by 2,053
Pennycook, G., & Rand, D. G. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.02.007 · Cited by 1,360
Deepfake Video Detection Using Recurrent Neural Networks
Guera, D., & Delp, E. J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639163 · Cited by 1,285
LAION-5B: An open large-scale dataset for training next generation image-text models
Schuhmann, C., Beaumont, R., Vencu, R., Gordon, C., Wightman, R., Cherti, M., Coombes, T., Katta, A., Mullis, C., Wortsman, M., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.08402 · Cited by 1,022
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2021) · arXiv · doi:10.48550/arxiv.2112.10752 · Cited by 737
Deepfake Video Detection through Optical Flow Based CNN
Amerini, I., Galteri, L., Caldelli, R., & Del Bimbo, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00152 · Cited by 424 · cited 1×
“When discussing the topic of vision, the results in [18] suggest that optical flow techniques could detect synthetic human faces within the FaceForensics dataset with around 81.61% accuracy.”
BackgroundInfluentialM2TR: Multi-modal Multi-scale Transformers for Deepfake Detection
Wang, J., Wu, Z., Ouyang, W., Han, X., Chen, J., Jiang, Y.-G., & Li, S.-N. (2022) · Proceedings of the 2022 International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531415 · Cited by 368
On The Detection of Synthetic Images Generated by Diffusion Models
Corvi, R., Cozzolino, D., Zingarini, G., Poggi, G., Nagano, K., & Verdoliva, L. (2023) · ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49357.2023.10095167 · Cited by 304
Identification of deep network generated images using disparities in color components
Li, H., Li, B., Tan, S., & Huang, J. (2020) · Signal Processing · doi:10.1016/j.sigpro.2020.107616 · Cited by 241
AdvFaces: Adversarial Face Synthesis
Deb, D., Zhang, J., & Jain, A. K. (2020) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb48548.2020.9304898 · Cited by 208
Predicting image credibility in fake news over social media using multi-modal approach
Singh, B., & Sharma, D. K. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06086-4 · Cited by 187
DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Models
Sha, Z., Li, Z., Yu, N., & Zhang, Y. (2023) · Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3576915.3616588 · Cited by 175 · cited 1×
“DE-FAKE, proposed by Sha et al. [16], shows that images generated by various latent diffusion approaches may contain digital fingerprints to suggest they are synthetic.”
BackgroundAdapting Pretrained Vision-Language Foundational Models to Medical Imaging DomainsPreprint
Chambon, P., Blüthgen, C., Langlotz, C., & Chaudhari, A. (2022) · arXiv.org · doi:10.48550/arxiv.2210.04133 · Cited by 152
Can people identify original and manipulated photos of real-world scenes?
Nightingale, S. J., Wade, K. A., & Watson, D. G. (2017) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-017-0067-2 · Cited by 135
A Hybrid CNN-LSTM model for Video Deepfake Detection by Leveraging Optical Flow Features
Saikia, P., Dholaria, D., Yadav, P., Patel, V., & Roy, M. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892905 · Cited by 133 · cited 1×
“Similarly, convolutional and temporal techniques were proposed in [21] to achieve 66.26% to 91.21% accuracy in a mixed set of synthetic data detection datasets.”
MethodInfluentialOn the use of Benford's law to detect GAN-generated images
Bonettini, N., Bestagini, P., Milani, S., & Tubaro, S. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412944 · Cited by 74
ArchiSound: Audio Generation with DiffusionPreprint
Schneider, F. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.13267 · Cited by 57
ArtVerse: A Paradigm for Parallel Human–Machine Collaborative Painting Creation in Metaverses
Guo, C., Dou, Y., Bai, T., Dai, X., Wang, C., & Wen, Y. (2023) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2022.3230406 · Cited by 53
Writer-independent signature verification; Evaluation of robotic and generative adversarial attacks
Bird, J. J., Naser, A., & Lotfi, A. (2023) · Information Sciences · doi:10.1016/j.ins.2023.03.029 · Cited by 30
Self-citationKhosravy, M., Nakamura, K., Hirose, Y., Nitta, N., & Babaguchi, N. (2021) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2021.03.015 · Cited by 29
Exploring Painting Synthesis with Diffusion Models
Yi, D., Guo, C., & Bai, T. (2021) · IEEE International Conference on Digital Twins and Parallel Intelligence (DTPI) · doi:10.1109/dtpi52967.2021.9540115 · Cited by 19
Cited by
Huang, Z., Hu, J., Li, X., He, Y., Zhao, X., Peng, B., Wu, B., Huang, X., & Cheng, G. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.02685 · Cited by 62
Interpretable-through-prototypes deepfake detection for diffusion models
Aghasanli, A., Kangin, D., & Angelov, P. (2023) · 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw60793.2023.00053 · Cited by 37
Vision Transformers (ViTs) for Feature Extraction and Classification of AI-Generated Visual Designs
Yun, Q. (2025) · IEEE Access · doi:10.1109/access.2025.3562130 · Cited by 13
Metadata
- Authors
- Bird, J. J., & Lotfi, A.
- Venue
- IEEE Access
- Published
- 2024
- Volume
- 12
- Pages
- 15642-15650
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4391019749
- Cited by
- 265
- References
- 29
- FWCI
- 36.30
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.