Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 362

The DOI matches its Crossref record; 165 of the 165 references it cites were found in a registry or an index.

Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers

Open access
Bengesi, Staphord, El-Sayed, Hoda, Sarker, MD Kamruzzaman, Houkpati, Yao, Irungu, John, Oladunni, Timothy·2024·IEEE Access

Abstract

The launch of ChatGPT in 2022 garnered global attention, marking a significant milestone in the Generative Artificial Intelligence (GAI) field. While GAI has been in effect for the past decade, the introduction of ChatGPT sparked a new wave of research and innovation in the Artificial Intelligence (AI) domain. This surge has led to the development and release of numerous cutting-edge tools, such as Bard, Stable Diffusion, DALL-E, Make-A-Video, Runway ML, and Jukebox, among others. These tools exhibit remarkable capabilities, encompassing tasks ranging from text generation and music composition, image creation, video production, code generation, and even scientific work. They are built upon various state-of-the-art models, including Stable Diffusion, transformer models like GPT-3 (recent GPT-4), variational autoencoders, and generative adversarial networks. This advancement in GAI presents a wealth of exciting opportunities across various sectors, such as business, healthcare, education, entertainment, and media. However, concurrently, it poses unprecedented challenges such as impersonation, job displacement, privacy breaches, security vulnerabilities, and misinformation. To addressing these challenges requires a new direction for research to develop solutions and refine existing products. In our endeavor to contribute profound insights to society and advance research on GAI, we present a comprehensive journal which explores the theoretical and mathematical foundations of GAI state-of-the-art models, exploring the diverse spectrum of tasks they can perform, examining the challenges they entail, and discussing the promising prospects for the future of GAI.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/access.2024.3397775

Cites

165 of 165 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 165 references

Research works printed but not linked: 114

  1. 2023, Introducing ChatGPT
  2. 10.1609/aimag.v27i4.1904 · doi:10.1609/aimag.v27i4.1904
  3. He, Deep residual learning for image recognition, 770
  4. Howard, 2017, MobileNets: Efficient convolutional neural networks for mobile vision applications, arXiv:1704.04861 · arXiv
  5. Vaswani, Attention is all you need
  6. Zhou, 2024, Bias in generative AI, arXiv:2403.02726 · arXiv
  7. Bank, 2021, Autoencoders, arXiv:2003.05991 · arXiv
  8. Kingma, Semi-supervised learning with deep generative models
  9. 10.1109/atee.2019.8724998 · doi:10.1109/atee.2019.8724998
  10. 10.23919/cmd54214.2022.9991542 · doi:10.23919/cmd54214.2022.9991542
  11. 10.1109/tii.2020.3025204 · doi:10.1109/tii.2020.3025204
  12. Zong, 2022, A survey on GPT-3, arXiv:2212.00857 · arXiv
  13. 2023, Generative AI: A Game-Changer Society Needs to be Ready for
  14. 10.1109/icdsca56264.2022.9987901 · doi:10.1109/icdsca56264.2022.9987901
  15. 10.1109/ent50460.2021.9681778 · doi:10.1109/ent50460.2021.9681778
  16. 10.1049/icp.2021.2422 · doi:10.1049/icp.2021.2422
  17. 10.1109/ialp54817.2021.9675217 · doi:10.1109/ialp54817.2021.9675217
  18. Achiam, 2023, GPT-4 technical report
  19. 10.2139/ssrn.4389233 · DOI · Paper page
  20. Arjovsky, 2017, Wasserstein GAN, arXiv:1701.07875 · arXiv
  21. 10.2307/1907301 · doi:10.2307/1907301
  22. Karras, 2017, Progressive growing of GANs for improved quality, stability, and variation, arXiv:1710.10196 · arXiv
  23. Karras, Analyzing and improving the image quality of StyleGAN, 8107
  24. Chen, InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets
  25. Donahue, 2017, Adversarial feature learning, arXiv:1605.09782 · arXiv
  26. 2024, U.S. State of Gen AI Report
  27. 2024, Prompt Engineering Guide
  28. 2024, OpenAI Platform
  29. 2023, StarCoder: A State-of-the-Art LLM for Code
  30. 2023, MuseNet
  31. Dhariwal, 2020, Jukebox: A generative model for music, arXiv:2005.00341 · arXiv
  32. 2023, How to Give Your Living Room a Luxurious Makeover
  33. Le, Voicebox: Text-guided multilingual universal speech generation at scale, 36, 14005
  34. 2023, Minerva: Solving Quantitative Reasoning Problems With Language Models
  35. 2024, Research Blog: DeepDream—A Code Example for Visualizing Neural Networks
  36. 2024, WaveNet: A Generative Model for Raw Audio
  37. 2016, Adobe Sensei Lets Customers Master the Art of Digital Experiences
  38. 2024, Best AI Video Generator in 2024—Synthesia
  39. Mitchell, 2024, The All-New Boomy: Make Instant Music, Reach Billions
  40. 2024, AI Art Generator: Create Stunning AI Art
  41. 2024, Descript | All-in-One Video & Podcast Editing, Easy as a Doc
  42. 2024, AI Voice Generator: Realistic Text to Speech & Voice Cloning
  43. 2024, AI Voice Generator: Versatile Text to Speech Software | Murf AI
  44. 2024, Unlock Generative AI Content At Scale
  45. 2024, AI Art Generator From Text
  46. 2024, NovelAI—The AI Storyteller
  47. 2024, Overdub
  48. 2024, Jasper | AI Copilot for Enterprise Marketing Teams
  49. Friedman, 2021, Introducing GitHub Copilot: Your AI Pair Programmer
  50. 2024, OpenAI Codex
  51. 2024, Automated Meeting Reports, Transcripts, Notes, Video, Coaching, Scheduling | Read
  52. 2024, #1 AI Music Studio—AI Music Generator for Creators
  53. 2024, SOUNDRAW
  54. 2024, AI Art Generator App—AI Art Maker
  55. 2024, Textalky—AI Text to Speech Synthesis Software
  56. 2024, Generate
  57. 2024, LaMDA: Our Breakthrough Conversation Technology
  58. 2024, Midjourney Documentation and User Guide
  59. 2024, Perplexity
  60. 2024, Introducing Whisper
  61. 2024, Stable Diffusion Public Release
  62. 2024, Stability AI Releases StableStudio, the Open Source Future of DreamStudio
  63. 2024, Chatsonic—Free AI Chat | GPT-4 & ChatGPT Alternative
  64. 2024, Adobe Firefly Feature Summary
  65. 2024, Wordtune | Free Generative AI Writing Tool
  66. 2024, Blog
  67. 2024, Amper | Music for Your Defining Moment | Welcome AI
  68. 2024, Claude 2
  69. 2023, Apple Preps Ajax Generative AI, ‘Apple GPT’ to Rival OpenAI and Google—Bloomberg
  70. 2024, Press Release: Inflection AI Introduces Pi, Your Personal AI
  71. 2024, Free AI Image Generator: Online Text to Image App
  72. 2024, Introducing PaLM 2
  73. 2024, Google Cloud Launches New AI Models, Opens Generative AI Studio
  74. 2024, An Important Next Step on Our AI Journey
  75. 2024, Turn Ideas Into Music With MusicLM
  76. 2024, Meet Studio Bot | Android Studio
  77. 2024, VoiceBox
  78. 2024, New AI Experiences and Tools | Meta AI
  79. 2024, Introducing CM3leon, a More Efficient, State-of-the-Art Generative Model for Text and Images
  80. 2024, AudioCraft
  81. 2024, MusicGen—A Hugging Face Space by Facebook
  82. Betker, 2023, Improving image generation with better captions, OpenAI, 2, 8
  83. 2024, RoomGPT—Redesign Your Room With AI.
  84. 2024, Gen-2
  85. 2023, Salesforce Announces Einstein GPT, the World’s First Generative AI for CRM—Salesforce
  86. 2024, Scribe—Powered by AI
  87. 2024, Introducing Devin, the First AI Software Engineer
  88. 2024, Sora: Creating Video From Text
  89. 2024, Text to Speech Software, Transforming Text to Voice Instantly
  90. 2024, Kits AI—Studio-quality AI Music Tools
  91. 2024, The #1 AI Voice Over Generator
  92. 2024, Paraphrasing Tool—QuillBot AI
  93. 2024, Home
  94. 2024, Generative AI Workspace for Visual Productivity
  95. 2023, The Impact of Generative AI on Hollywood and Entertainment
  96. 2023, Runway AI: Tech Behind Everything Everywhere All at Once
  97. 2023, AWS Announces AWS HealthScribe, a New Generative AI-Powered Service That Automatically Creates Clinical Documentation
  98. 2023, Cognizant and Google Cloud Expand Alliance to Bring AI to Enterprise Clients
  99. 2032, Generative AI to Become a $1.3 Trillion Market by 2032, Research Finds | Press | Bloomberg LP
  100. 2023, Amazon Launches Generative AI to Help Sellers Write Product Descriptions
  101. 10.1109/icocwc60930.2024.10470902 · doi:10.1109/icocwc60930.2024.10470902
  102. 2023, Jobs of Tomorrow: Large Language Models and Jobs
  103. 2023, Automation or Augmentation? This is How AI Will be Integrated Into the Jobs of Tomorrow
  104. 2023, We Always Hear That AI Will Take Our Jobs. But What Jobs Will it Create?
  105. 10.1109/tts.2023.3280109 · doi:10.1109/tts.2023.3280109
  106. 2023, AI-Based Cybercrime Tools WormGPT and FraudGPT Could be The Tip of the Iceberg | SlashNext
  107. Mihai, 2023, The transformative impact of artificial intelligence on cybersecurity, Int. J. Inf. Secur. Cybercrime, 12, 9
  108. 2023, Pause Giant AI Experiments: An Open Letter
  109. Coscarelli, 2023, An A.I. Hit of Fake ‘Drake’ and ‘The Weeknd’ Rattles the Music World
  110. Lane, 2023, An AI-Generated Rihanna Cover of Beyonc?’s ‘Cuff It’ is Going Viral, and It Could Open Up a New Legal Nightmare for the Music Industry
  111. 2023, ChatGPT In Healthcare: What Science Says
  112. 2023, Generative AI and the Future of Work in America | McKinsey
  113. 2023, Future of Work Report: AI at Work
  114. Hamirani, 2024, Here’s How Generative AI Will Redefine The Workplace

Cited by

See all 362

Metadata

Authors
Bengesi, S., El-Sayed, H., Sarker, M. K., Houkpati, Y., Irungu, J., & Oladunni, T.
Venue
IEEE Access
Published
2024
Volume
12
Pages
69812-69837
ISSN
2169-3536 (ISSN-L)
OpenAlex
W4396685186
Cited by
362
References
165
FWCI
51.13
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers. https://app.cochat.ai/papers/10.1109/access.2024.3397775
The paper
Bengesi, S., El-Sayed, H., Sarker, M. K., Houkpati, Y., Irungu, J., & Oladunni, T. (2024). Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers. IEEE Access. https://doi.org/10.1109/access.2024.3397775

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.