The DOI matches its Crossref record; 165 of the 165 references it cites were found in a registry or an index.
Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers
Open accessAbstract
The launch of ChatGPT in 2022 garnered global attention, marking a significant milestone in the Generative Artificial Intelligence (GAI) field. While GAI has been in effect for the past decade, the introduction of ChatGPT sparked a new wave of research and innovation in the Artificial Intelligence (AI) domain. This surge has led to the development and release of numerous cutting-edge tools, such as Bard, Stable Diffusion, DALL-E, Make-A-Video, Runway ML, and Jukebox, among others. These tools exhibit remarkable capabilities, encompassing tasks ranging from text generation and music composition, image creation, video production, code generation, and even scientific work. They are built upon various state-of-the-art models, including Stable Diffusion, transformer models like GPT-3 (recent GPT-4), variational autoencoders, and generative adversarial networks. This advancement in GAI presents a wealth of exciting opportunities across various sectors, such as business, healthcare, education, entertainment, and media. However, concurrently, it poses unprecedented challenges such as impersonation, job displacement, privacy breaches, security vulnerabilities, and misinformation. To addressing these challenges requires a new direction for research to develop solutions and refine existing products. In our endeavor to contribute profound insights to society and advance research on GAI, we present a comprehensive journal which explores the theoretical and mathematical foundations of GAI state-of-the-art models, exploring the diverse spectrum of tasks they can perform, examining the challenges they entail, and discussing the promising prospects for the future of GAI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Research works printed but not linked: 114
- 2023, Introducing ChatGPT
- 10.1609/aimag.v27i4.1904 · doi:10.1609/aimag.v27i4.1904
- He, Deep residual learning for image recognition, 770
- Howard, 2017, MobileNets: Efficient convolutional neural networks for mobile vision applications, arXiv:1704.04861 · arXiv
- Vaswani, Attention is all you need
- Zhou, 2024, Bias in generative AI, arXiv:2403.02726 · arXiv
- Bank, 2021, Autoencoders, arXiv:2003.05991 · arXiv
- Kingma, Semi-supervised learning with deep generative models
- 10.1109/atee.2019.8724998 · doi:10.1109/atee.2019.8724998
- 10.23919/cmd54214.2022.9991542 · doi:10.23919/cmd54214.2022.9991542
- 10.1109/tii.2020.3025204 · doi:10.1109/tii.2020.3025204
- Zong, 2022, A survey on GPT-3, arXiv:2212.00857 · arXiv
- 2023, Generative AI: A Game-Changer Society Needs to be Ready for
- 10.1109/icdsca56264.2022.9987901 · doi:10.1109/icdsca56264.2022.9987901
- 10.1109/ent50460.2021.9681778 · doi:10.1109/ent50460.2021.9681778
- 10.1049/icp.2021.2422 · doi:10.1049/icp.2021.2422
- 10.1109/ialp54817.2021.9675217 · doi:10.1109/ialp54817.2021.9675217
- Achiam, 2023, GPT-4 technical report
- 10.2139/ssrn.4389233 · DOI · Paper page
- Arjovsky, 2017, Wasserstein GAN, arXiv:1701.07875 · arXiv
- 10.2307/1907301 · doi:10.2307/1907301
- Karras, 2017, Progressive growing of GANs for improved quality, stability, and variation, arXiv:1710.10196 · arXiv
- Karras, Analyzing and improving the image quality of StyleGAN, 8107
- Chen, InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets
- Donahue, 2017, Adversarial feature learning, arXiv:1605.09782 · arXiv
- 2024, U.S. State of Gen AI Report
- 2024, Prompt Engineering Guide
- 2024, OpenAI Platform
- 2023, StarCoder: A State-of-the-Art LLM for Code
- 2023, MuseNet
- Dhariwal, 2020, Jukebox: A generative model for music, arXiv:2005.00341 · arXiv
- 2023, How to Give Your Living Room a Luxurious Makeover
- Le, Voicebox: Text-guided multilingual universal speech generation at scale, 36, 14005
- 2023, Minerva: Solving Quantitative Reasoning Problems With Language Models
- 2024, Research Blog: DeepDream—A Code Example for Visualizing Neural Networks
- 2024, WaveNet: A Generative Model for Raw Audio
- 2016, Adobe Sensei Lets Customers Master the Art of Digital Experiences
- 2024, Best AI Video Generator in 2024—Synthesia
- Mitchell, 2024, The All-New Boomy: Make Instant Music, Reach Billions
- 2024, AI Art Generator: Create Stunning AI Art
- 2024, Descript | All-in-One Video & Podcast Editing, Easy as a Doc
- 2024, AI Voice Generator: Realistic Text to Speech & Voice Cloning
- 2024, AI Voice Generator: Versatile Text to Speech Software | Murf AI
- 2024, Unlock Generative AI Content At Scale
- 2024, AI Art Generator From Text
- 2024, NovelAI—The AI Storyteller
- 2024, Overdub
- 2024, Jasper | AI Copilot for Enterprise Marketing Teams
- Friedman, 2021, Introducing GitHub Copilot: Your AI Pair Programmer
- 2024, OpenAI Codex
- 2024, Automated Meeting Reports, Transcripts, Notes, Video, Coaching, Scheduling | Read
- 2024, #1 AI Music Studio—AI Music Generator for Creators
- 2024, SOUNDRAW
- 2024, AI Art Generator App—AI Art Maker
- 2024, Textalky—AI Text to Speech Synthesis Software
- 2024, Generate
- 2024, LaMDA: Our Breakthrough Conversation Technology
- 2024, Midjourney Documentation and User Guide
- 2024, Perplexity
- 2024, Introducing Whisper
- 2024, Stable Diffusion Public Release
- 2024, Stability AI Releases StableStudio, the Open Source Future of DreamStudio
- 2024, Chatsonic—Free AI Chat | GPT-4 & ChatGPT Alternative
- 2024, Adobe Firefly Feature Summary
- 2024, Wordtune | Free Generative AI Writing Tool
- 2024, Blog
- 2024, Amper | Music for Your Defining Moment | Welcome AI
- 2024, Claude 2
- 2023, Apple Preps Ajax Generative AI, ‘Apple GPT’ to Rival OpenAI and Google—Bloomberg
- 2024, Press Release: Inflection AI Introduces Pi, Your Personal AI
- 2024, Free AI Image Generator: Online Text to Image App
- 2024, Introducing PaLM 2
- 2024, Google Cloud Launches New AI Models, Opens Generative AI Studio
- 2024, An Important Next Step on Our AI Journey
- 2024, Turn Ideas Into Music With MusicLM
- 2024, Meet Studio Bot | Android Studio
- 2024, VoiceBox
- 2024, New AI Experiences and Tools | Meta AI
- 2024, Introducing CM3leon, a More Efficient, State-of-the-Art Generative Model for Text and Images
- 2024, AudioCraft
- 2024, MusicGen—A Hugging Face Space by Facebook
- Betker, 2023, Improving image generation with better captions, OpenAI, 2, 8
- 2024, RoomGPT—Redesign Your Room With AI.
- 2024, Gen-2
- 2023, Salesforce Announces Einstein GPT, the World’s First Generative AI for CRM—Salesforce
- 2024, Scribe—Powered by AI
- 2024, Introducing Devin, the First AI Software Engineer
- 2024, Sora: Creating Video From Text
- 2024, Text to Speech Software, Transforming Text to Voice Instantly
- 2024, Kits AI—Studio-quality AI Music Tools
- 2024, The #1 AI Voice Over Generator
- 2024, Paraphrasing Tool—QuillBot AI
- 2024, Home
- 2024, Generative AI Workspace for Visual Productivity
- 2023, The Impact of Generative AI on Hollywood and Entertainment
- 2023, Runway AI: Tech Behind Everything Everywhere All at Once
- 2023, AWS Announces AWS HealthScribe, a New Generative AI-Powered Service That Automatically Creates Clinical Documentation
- 2023, Cognizant and Google Cloud Expand Alliance to Bring AI to Enterprise Clients
- 2032, Generative AI to Become a $1.3 Trillion Market by 2032, Research Finds | Press | Bloomberg LP
- 2023, Amazon Launches Generative AI to Help Sellers Write Product Descriptions
- 10.1109/icocwc60930.2024.10470902 · doi:10.1109/icocwc60930.2024.10470902
- 2023, Jobs of Tomorrow: Large Language Models and Jobs
- 2023, Automation or Augmentation? This is How AI Will be Integrated Into the Jobs of Tomorrow
- 2023, We Always Hear That AI Will Take Our Jobs. But What Jobs Will it Create?
- 10.1109/tts.2023.3280109 · doi:10.1109/tts.2023.3280109
- 2023, AI-Based Cybercrime Tools WormGPT and FraudGPT Could be The Tip of the Iceberg | SlashNext
- Mihai, 2023, The transformative impact of artificial intelligence on cybersecurity, Int. J. Inf. Secur. Cybercrime, 12, 9
- 2023, Pause Giant AI Experiments: An Open Letter
- Coscarelli, 2023, An A.I. Hit of Fake ‘Drake’ and ‘The Weeknd’ Rattles the Music World
- Lane, 2023, An AI-Generated Rihanna Cover of Beyonc?’s ‘Cuff It’ is Going Viral, and It Could Open Up a New Legal Nightmare for the Music Industry
- 2023, ChatGPT In Healthcare: What Science Says
- 2023, Generative AI and the Future of Work in America | McKinsey
- 2023, Future of Work Report: AI at Work
- Hamirani, 2024, Here’s How Generative AI Will Redefine The Workplace
Cited by
Artificial intelligence in teaching and teacher professional development: A systematic review
Tan, X., Cheng, G., & Ling, M. H. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100355 · Cited by 420
Generative artificial intelligence in medicine
Teo, Z. L., Thirunavukarasu, A. J., Elangovan, K., Cheng, H., Moova, P., Soetikno, B., Nielsen, C., Pollreisz, A., Ting, D. S. J., Morris, R. J. T., et al. (2025) · Nature Medicine · doi:10.1038/s41591-025-03983-2 · Cited by 119
A review of LLMs and their applications in the architecture, engineering and construction industry
Kampelopoulos, D., Tsanousa, A., Vrochidis, S., & Kompatsiaris, I. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11241-7 · Cited by 69
Generative AI in depth: A survey of recent advances, model variants, and real-world applications
Yazdani, S., Singh, A., Saxena, N., Wang, Z., Palikhe, A., Pan, D., Pal, U., Yang, J., & Zhang, W. (2025) · Journal of Big Data · doi:10.1186/s40537-025-01247-x · Cited by 40
Effects of GenAI Interventions on Student Academic Performance: A Meta-Analysis
Gu, J., & Yan, Z. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251349620 · Cited by 30
Metadata
- Authors
- Bengesi, S., El-Sayed, H., Sarker, M. K., Houkpati, Y., Irungu, J., & Oladunni, T.
- Venue
- IEEE Access
- Published
- 2024
- Volume
- 12
- Pages
- 69812-69837
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4396685186
- Cited by
- 362
- References
- 165
- FWCI
- 51.13
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers. https://app.cochat.ai/papers/10.1109/access.2024.3397775
- The paper
- Bengesi, S., El-Sayed, H., Sarker, M. K., Houkpati, Y., Irungu, J., & Oladunni, T. (2024). Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers. IEEE Access. https://doi.org/10.1109/access.2024.3397775
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.