Vision Transformers (ViTs) for Feature Extraction and Classification of AI-Generated Visual Designs
Open accessAbstract
Deep learning has become a cornerstone of modern Artificial Intelligence (AI), enabling machines to process and interpret complex visual information with unprecedented accuracy. As AI-generated content becomes more realistic, the ability to distinguish between machine-created and human-created images is increasingly important. This challenge extends beyond technical concerns, influencing digital media credibility, intellectual property rights, and the integrity of visual communication. Developing robust classification models to accurately attribute image origins is crucial for ensuring transparency, preventing misinformation, and upholding artistic authenticity in an era of rapidly evolving generative AI technologies. This study addresses the critical need to differentiate between AI-generated and human-generated aesthetic images through the application of advanced deep learning models. We investigate the effectiveness of advanced deep learning architectures including High Resolution Networks (HRNet), and Vision Transformers (ViT) which are generally accurate when used to infer the creative characteristics of human visual art. The proposed model ViT, employing a mechanism of self-attention to process images as sequences of patches for feature extraction, is examined for its potential to capture global contextual relationships within images, which is essential for recognizing the nuanced differences between AI and human artistry. ViT achieves 97% accuracy shows that superior performance validates its ability, using its transformer structure, to analyze and learn about the complex features of images which disclose their origin as compared to HRNet model of 95%. This research highlights the potential of using sophisticated deep learning techniques to address the challenges of content authenticity in digital media. By leveraging the unique strengths of each model, we provide insights into their applicability and effectiveness in distinguishing between different forms of digital creation, marking a significant step forward in the field of digital forensics and content verification.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Transformer-based models achieve notable accuracy improvements, particularly for low-quality forgeries, but their computational intensity remains a significant barrier to real-time deployment.
“While these approaches achieve notable accuracy improvements, particularly for low-quality forgeries, their computational intensity remains a significant barrier to real-time deployment.”
From Beyond Accuracy: A Deployment-Oriented Benchmark of Deepfake Detection Models (2025) · cites this paper as [10]
Cites
Deep High-Resolution Representation Learning for Visual Recognition
Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., Wang, X., et al. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2983686 · Cited by 4,894 · see citing works
ViViT: A Video Vision Transformer
Arnab, A., Dehghani, M., Heigold, G., Sun, C., Lucic, M., & Schmid, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00676 · Cited by 2,767 · see citing works
(2022) · doi:10.1007/978-3-031-20053-3_27 · Cited by 1,060 · see citing works
V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer
Xu, R., Xiang, H., Tu, Z., Xia, X., Yang, M.-H., & Ma, J. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19842-7_7 · Cited by 584 · see citing works
AI-generated characters for supporting personalized learning and well-being
Pataranutaporn, P., Danry, V., Leong, J., Punpongsanon, P., Novy, D., Maes, P., & Sra, M. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00417-9 · Cited by 358 · see citing works
CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images
Bird, J. J., & Lotfi, A. (2024) · IEEE Access · doi:10.1109/access.2024.3356122 · Cited by 308 · see citing works
Humans versus AI: whether and why we prefer human-created compared to AI-created artwork
Bellaiche, L., Shahi, R., Turpin, M. H., Ragnhildstveit, A., Sprockett, S., Barr, N., Christensen, A., & Seli, P. (2023) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-023-00499-6 · Cited by 233 · cited 1× · see citing works
“A longitudinal approach allows it to make the distinction between AI generated and human generated art based on deep historical insights [32].”
Hughes, R. T., Zhu, L., & Bednarz, T. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.604234 · Cited by 178 · see citing works
Semisupervised Stacked Autoencoder With Cotraining for Hyperspectral Image Classification
Zhou, S., Xue, Z., & Du, P. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2888485 · Cited by 106 · see citing works
Developments in Image Processing Using Deep Learning and Reinforcement Learning
Valente, J., António, J., Mora, C., & Jardim, S. (2023) · Journal of Imaging · doi:10.3390/jimaging9100207 · Cited by 95 · see citing works
Revolutionizing Visuals: The Role of Generative AI in Modern Image Generation
Bansal, G., Nawal, A., Chamola, V., & Herencsar, N. (2024) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3689641 · Cited by 91 · see citing works
Fine-art painting classification via two-channel dual path networks
Zhong, S.-H., Huang, X., & Xiao, Z. (2019) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-019-00963-0 · Cited by 52 · see citing works
AI Knows You: Deep Learning Model for Prediction of Extroversion Personality Trait
Naz, A., Khan, H. U., Alesawi, S., Aboulola, O. I., Daud, A. Y., & Ramzan, M. (2024) · IEEE Access · doi:10.1109/access.2024.3486578 · Cited by 42 · see citing works
Artistic Style Recognition: Combining Deep and Shallow Neural Networks for Painting Classification
Imran, S., Naqvi, R. A., Sajid, M., Malik, T. S., Ullah, S., Moqurrab, S. A., & Yon, D. K. (2023) · Mathematics · doi:10.3390/math11224564 · Cited by 41 · see citing works
Transformation of Beauty in Digital Fine Arts Aesthetics: An Artpreneur Perspective
Wiratno, T. A., & Callula, B. (2024) · Aptisi Transactions On Technopreneurship (ATT) · doi:10.34306/att.v6i2.395 · Cited by 41 · see citing works
Attribute hierarchy based multi-task learning for fine-grained image classification
Zhao, J., Peng, Y., & He, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.02.109 · Cited by 40 · see citing works
Large Multi-modality Model Assisted AI-Generated Image Quality Assessment
Wang, P., Sun, W., Zhang, Z., Jia, J., Jiang, Y., Zhang, Z., Min, X., & Zhai, G. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681471 · Cited by 38 · see citing works
Hossain, M. Z., Zaman, F. U., & Islam, M. R. (2023) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit60459.2023.10440990 · Cited by 36 · see citing works
Using deep learning and word embeddings for predicting human agreeableness behavior
Alsini, R. A. I., Naz, A., Khan, H. U., Bukhari, A. A., Daud, A. Y., & Ramzan, M. (2024) · Scientific Reports · doi:10.1038/s41598-024-81506-8 · Cited by 33 · see citing works
Attention integrated hierarchical networks for no-reference image quality assessment
You, J., & Korhonen, J. (2021) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2021.103399 · Cited by 27 · see citing works
Four decades of image processing: a bibliometric analysis
Khan, U. F., Khan, H. U., Iqbal, S., & Munir, H. (2022) · Library Hi Tech · doi:10.1108/lht-10-2021-0351 · Cited by 27 · see citing works
A Hybrid Capsule Network for Hyperspectral Image Classification
Khodadadzadeh, M., Ding, X., Chaurasia, P., & Coyle, D. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3126427 · Cited by 26 · see citing works
Invisible Relevance Bias: Text-Image Retrieval Models Prefer AI-Generated Images
Xu, S., Hou, D., Pang, L., Deng, J., Xu, J., Shen, H., & Cheng, X. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657750 · Cited by 24 · see citing works
Hyperspectral Data Analysis for Arid Vegetation Species : Smart & Sustainable Growth
Borana, S. L., Yadav, S. K., & Parihar, S. K. (2019) · International Conference on Computing, Communication, and Intelligent Systems (ICCCIS) · doi:10.1109/icccis48478.2019.8974502 · Cited by 23 · see citing works
A Digital Aesthetics? Artificial Intelligence and the Future of the Art
Aris, S., Aeini, B., & Nosrati, S. (2023) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.22059/jcss.2023.366256.1097 · Cited by 21 · see citing works
Using Deep Learning Techniques to Enhance Blood Cell Detection in Patients with Leukemia
Ilyas, M., Bilal, M., Malik, N., Khan, H. U., Ramzan, M., & Naz, A. (2024) · Information · doi:10.3390/info15120787 · Cited by 18 · see citing works
Saeed, A., Khan, H. U., Shankar, A., Imran, T., Khan, D., Kamran, M., & Khan, M. A. (2023) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3626318 · Cited by 17 · see citing works
Habib, M. A., Wadud, M. A. H., Patwary, M. F. K., Rahman, M. M., Mridha, M. F., Okuyama, Y., & Shin, J. (2024) · IEEE Access · doi:10.1109/access.2024.3435541 · Cited by 17 · see citing works
A CNN-LSTM framework for authorship classification of paintings
Jangtjik, K. A., Ho, T.-T., Yeh, M.-C., & Hua, K. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296806 · Cited by 15 · see citing works
Li, Y., & Zhang, Q. (2024) · IEEE Access · doi:10.1109/access.2024.3486031 · Cited by 14 · see citing works
A COMPARATIVE REVIEW OF AI-GENERATED IMAGE DETECTION ACROSS SOCIAL MEDIA PLATFORMS
Anjuman Ara, M. S. A. (2024) · GLOBAL MAINSTREAM JOURNAL · doi:10.62304/jieet.v3i01.77 · Cited by 12 · see citing works
AI vs. Human Vision: A Comparative Analysis for Distinguishing AI-Generated and Natural Images
Purohit, R., Sane, Y., Vaishampayan, D., Vedantam, S., & Singh, M. (2024) · International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies (ICAECT) · doi:10.1109/icaect60202.2024.10469620 · Cited by 11 · see citing works
Khan, F. F., Kim, D., Jha, D., Mohamed, Y. H., Chang, H. H., Elgammal, A., Elliott, L., & Elhoseiny, M. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00742 · Cited by 11 · see citing works
Kalaimani, G., Kavitha, G., Selvan, C., & Mylapalli, S. (2024) · Signal Image and Video Processing · doi:10.1007/s11760-024-03440-6 · Cited by 8 · see citing works
Analysis of Quantum-Classical Hybrid Deep Learning for 6G Image Processing with Copyright Detection
Seol, J., Kim, H.-Y., Kancharla, A., & Kim, J. (2024) · Information · doi:10.3390/info15110727 · Cited by 8 · see citing works
Rojas-Simón, J., Ledeneva, Y. N., & García-Hernández, R. A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-62836-8_31 · Cited by 5 · see citing works
Aesthetics and Artificial Intelligence: Impact and Criticism of Art
Nurveda, M. N. A. (2023) · Education Achievement Journal of Science and Research · doi:10.51178/jsr.v4i3.1667 · Cited by 4 · see citing works
Exploring the role of sentiments in identification of active and influential bloggers
Alghobiri, M., Ishfaq, U., Khan, H. U., & Malik, T. (2016) · International Journal of Business & Technology · doi:10.33107/ijbte.2016.4.2.06 · Cited by 3 · see citing works
ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at ScalePreprint
Huang, J., Chen, C., Mishra, A., Kwon, B. C., Liu, Z., & Bryan, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.02990 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Zheng, Z., Ding, Y., Zeng, L., & Mughees, N. (2025) · Scientific Reports · doi:10.1038/s41598-025-24548-w · Cited by 6 · see citing works
A novel deep transformer based CvT model for sign language recognition in visual communication
Hao, J., & Pan, H. (2025) · Scientific Reports · doi:10.1038/s41598-025-31558-1 · Cited by 10 · see citing works
Yinghua, W., Linyan, L., Wenjuan, M., & Yunzhe, Z. (2026) · Scientific Reports · doi:10.1038/s41598-025-29229-2 · Cited by 4 · see citing works
Li, Y., Guo, Y., Mundher, R., & Abdulghani, A. M. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1733709 · Cited by 3 · see citing works
Rice quality recognition method based on multimodal model
Zhang, Y., Xing, X., Zhu, L., Li, X. S., Xue, X. Y., Sun, C. T., Duan, C. H., & Du, Y. P. (2025) · Food Control · doi:10.1016/j.foodcont.2025.111691 · Cited by 3 · see citing works
Beyond Accuracy: A Deployment-Oriented Benchmark of Deepfake Detection Models
Ain, Q. U., Ning, H., Philipo, A. G., Daneshmand, M., & Ding, J. (2025) · Preprint (TechRxiv) · doi:10.36227/techrxiv.176315939.91577661/v1 · Cited by 2 · see citing works
Haider, I., Khan, M. A., Masood, S., Aldossary, H., Jamel, L., Cho, Y., & Nam, Y. (2026) · IET Image Processing · doi:10.1049/ipr2.70349 · Cited by 1 · see citing works
ViT-HAR: Vision Transformer-Based Human Activity Recognition in Cluttered Environments
Mewada, A., Ahmad, S., & Ansari, M. A. (2026) · Sakarya University Journal of Computer and Information Sciences · doi:10.35377/saucis...1745614
Bengarali, M., & Smiti, A. (2025) · 2025 IEEE Afro-Mediterranean Conference on Artificial Intelligence (AMCAI) · doi:10.1109/amcai66110.2025.11474378
Luo, J., Ke, X., & Chen, X. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01199-y
Explainable AI for Interpreting Image-Based Sentiment Classification
Gautam, P., Kumar, P., & Kaur, N. (2026) · International Conference on Intelligent Computing and Control Systems (ICICCS) · doi:10.1109/iciccs67901.2026.11502818
Sun, J. I. A. X. I. N. (2026) · International Conference on Integrated Circuits and Communication Systems (ICICACS) · doi:10.1109/icicacs68679.2026.11578921
Jeevitha, D., Harihara Ulaganathan, K., Gokulkrishnan, A., & Ezhil Raj, R. (2026) · International Conference on Natural Language Processing and Computer Vision (ICNPCV) · doi:10.1109/icnpcv69434.2026.11708945
Bairam, M., Velpula, R., & Naik, R. L. (2026) · Discover Computing · doi:10.1007/s10791-026-10657-1
- Authors
- Yun, Q.
- Affiliations
- Kyungil University (KR)
- Corresponding author
- Yun, Qing
- ORCID
- Yun, Qing
- Venue
- IEEE Access
- Published
- 2025
- Volume
- 13
- Pages
- 69459-69477
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4409560444
- Cited by
- 13
- References
- 39
- Citations by year
- 2026: 9 · 2025: 4
- FWCI
- 4.60
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- AI-generated image detection, vision transformer, feature extraction, image classification, self-attention, HRNet, generative AI, content authenticity, digital forensics, content verification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review