Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 150 of the 150 references it cites were found in a registry or an index.

The Power of Generative AI: A Review of Requirements, Models, Input–Output Formats, Evaluation Metrics, and Challenges

Open access

Abstract

Generative artificial intelligence (AI) has emerged as a powerful technology with numerous applications in various domains. There is a need to identify the requirements and evaluation metrics for generative AI models designed for specific tasks. The purpose of the research aims to investigate the fundamental aspects of generative AI systems, including their requirements, models, input–output formats, and evaluation metrics. The study addresses key research questions and presents comprehensive insights to guide researchers, developers, and practitioners in the field. Firstly, the requirements necessary for implementing generative AI systems are examined and categorized into three distinct categories: hardware, software, and user experience. Furthermore, the study explores the different types of generative AI models described in the literature by presenting a taxonomy based on architectural characteristics, such as variational autoencoders (VAEs), generative adversarial networks (GANs), diffusion models, transformers, language models, normalizing flow models, and hybrid models. A comprehensive classification of input and output formats used in generative AI systems is also provided. Moreover, the research proposes a classification system based on output types and discusses commonly used evaluation metrics in generative AI. The findings contribute to advancements in the field, enabling researchers, developers, and practitioners to effectively implement and evaluate generative AI models for various applications. The significance of the research lies in understanding that generative AI system requirements are crucial for effective planning, design, and optimal performance. A taxonomy of models aids in selecting suitable options and driving advancements. Classifying input–output formats enables leveraging diverse formats for customized systems, while evaluation metrics establish standardized methods to assess model quality and performance.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/fi15080260

Cites

150 of 150 references verified0 citation errors · 0 not checkable

Statistics

Figures

Image 1
CC-BY · From the PDF
Figure 3 Classification of the generative AI models based on the architecture. Figure 3. Classification of the generative AI models based on the architecture. 3.2.1. Variational Autoencoders (VAE)
Figure 3 Classification of the generative AI models based on the architecture. Figure 3. Classification of the generative AI models based on the architecture. 3.2.1. Variational Autoencoders (VAE)CC-BY · From the PDF
Encoder-Decoder architecture and utilize self-attention mechanisms for capturing global Figure 4. Typical structure of Variational Autoencoder (VAE). Figure 4. Typical structure of variational autoencoder (VAE).
Encoder-Decoder architecture and utilize self-attention mechanisms for capturing global Figure 4. Typical structure of Variational Autoencoder (VAE). Figure 4. Typical structure of variational autoencoder (VAE).CC-BY · From the PDF
Figure 5 Typical structure of normalizing flow model.
Figure 5 Typical structure of normalizing flow model.CC-BY · From the PDF
Figure 6 Typical structure of Generative Adversarial Networks (GAN). Figure 6. Typical structure of generative adversarial networks (GAN).
Figure 6 Typical structure of Generative Adversarial Networks (GAN). Figure 6. Typical structure of generative adversarial networks (GAN).CC-BY · From the PDF
Figure 7 Typical structure of Conditional GAN. Figure 7. Typical structure of conditional GAN.
Figure 7 Typical structure of Conditional GAN. Figure 7. Typical structure of conditional GAN.CC-BY · From the PDF
Figure 8 Typical structure of Diffusion Model. Figure 8. Typical structure of diffusion model.
Figure 8 Typical structure of Diffusion Model. Figure 8. Typical structure of diffusion model.CC-BY · From the PDF
Figure 9 Recurrent Neural Network Architecture.
Figure 9 Recurrent Neural Network Architecture.CC-BY · From the PDF
Transformer architecture (Figure obtained from [ ? ]). Figure 10. Transformer architecture (Figure obtained from [74]).
Transformer architecture (Figure obtained from [ ? ]). Figure 10. Transformer architecture (Figure obtained from [74]).CC-BY · From the PDF
Figure 11 Adversarial Autoencoder Architecture (AAE). Figure 11. Adversarial autoencoder architecture (AAE).
Figure 11 Adversarial Autoencoder Architecture (AAE). Figure 11. Adversarial autoencoder architecture (AAE).CC-BY · From the PDF
Figure 12 Prompt is "An astronaut dance party on Figure 13. Prompt is "Sprouts in the shape of Figure 14. Prompt is "3 oil painting tulip". Figure 12. Prompt is 'An astronaut dance party on the surface of Mars'. (Image was obtained from DALL-E.) 31 of ??
Figure 12 Prompt is "An astronaut dance party on Figure 13. Prompt is "Sprouts in the shape of Figure 14. Prompt is "3 oil painting tulip". Figure 12. Prompt is 'An astronaut dance party on the surface of Mars'. (Image was obtained from DALL-E.) 31 of ??CC-BY · From the PDF
custom voice synthesis technique. It utilizes two acoustic encoders: Figure 14. Prompt is "3D Figure 13. Prompt is '3D oil painting tulip'. (Image was obtained from Midjourney.)
custom voice synthesis technique. It utilizes two acoustic encoders: Figure 14. Prompt is "3D Figure 13. Prompt is '3D oil painting tulip'. (Image was obtained from Midjourney.)CC-BY · From the PDF
Figure 13 Prompt is "Sprouts in the shape of Figure 14. Prompt is "3D oil painting tulip". Figure 14. Prompt is 'Sprouts in the shape of text 'Imagen' coming out of a fairytale book'. (Image was obtained from Imagen.)
Figure 13 Prompt is "Sprouts in the shape of Figure 14. Prompt is "3D oil painting tulip". Figure 14. Prompt is 'Sprouts in the shape of text 'Imagen' coming out of a fairytale book'. (Image was obtained from Imagen.)CC-BY · From the PDF
Image 14
CC-BY · From the PDF
Image 15
CC-BY · From the PDF
Figure 16 Deblurring the images using DeblurGAN-v2 (DeblurGAN-v2 model downloaded from https://github.com/VITA-Group/DeblurGANv2 and used our image). Figure 16. Deblurring the images using DeblurGAN-v2 (DeblurGAN-v2 model downloaded from https://github.com/VITA-Group/DeblurGANv2, (accessed on 25 July 2023) and used our image).
Figure 16 Deblurring the images using DeblurGAN-v2 (DeblurGAN-v2 model downloaded from https://github.com/VITA-Group/DeblurGANv2 and used our image). Figure 16. Deblurring the images using DeblurGAN-v2 (DeblurGAN-v2 model downloaded from https://github.com/VITA-Group/DeblurGANv2, (accessed on 25 July 2023) and used our image).CC-BY · From the PDF
Figure 17 Input to the StyleCLIP(Output image is generated using https://replicate.com/orpatashnik/styleclip) is baby image with prompt "A baby boy with smiley face." The output is a smiley baby image. Figure 17. Input to the StyleCLIP (output image is generated using https://replicate.com/ orpatashnik/styleclip, accessed on 25 July 2023) is baby image with prompt 'A baby boy with smiley face.' The output is a smiley baby image.
Figure 17 Input to the StyleCLIP(Output image is generated using https://replicate.com/orpatashnik/styleclip) is baby image with prompt "A baby boy with smiley face." The output is a smiley baby image. Figure 17. Input to the StyleCLIP (output image is generated using https://replicate.com/ orpatashnik/styleclip, accessed on 25 July 2023) is baby image with prompt 'A baby boy with smiley face.' The output is a smiley baby image.CC-BY · From the PDF
Image 18
CC-BY · From the PDF
Figure 18 Evaluation metrics classification diagram for various output types. Figure 18. Evaluation metrics classification diagram for various output types.
Figure 18 Evaluation metrics classification diagram for various output types. Figure 18. Evaluation metrics classification diagram for various output types.CC-BY · From the PDF
Image 20
CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

3 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 118 references

Research works printed but not linked: 33

  1. Eckerli, F., and Osterrieder, J. (2021). Generative adversarial networks in finance: An overview. arXiv. · DOI
  2. Jose, L., Liu, S., Russo, C., Nadort, A., and Ieva, A.D. (2023, July 25). Generative Adversarial Networks in Digital Pathology and Histopathological Image Processing: A Review, Available online: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8609288/.
  3. Gozalo-Brizuela, R., and Garrido-Merchán, E.C. (2023). A survey of Generative AI Applications. arXiv.
  4. Zhang, M., Qamar, M., Kang, T., Jung, Y., Zhang, C., Bae, S.H., and Zhang, C. (2023). A survey on graph diffusion models: Generative ai in science for molecule, protein and material. arXiv.
  5. Kim, C.D., Kim, B., Lee, H., and Kim, G. (2019). Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Association for Computational Linguistics.
  6. Berabi, B., He, J., Raychev, V., and Vechev, M. (2021, January 18–24). Tfix: Learning to fix coding errors with a text-to-text transformer. Proceedings of the International Conference on Machine Learning, PMLR, Virtual Event.
  7. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2023, July 25). Attention Is All You Need. Available online: https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf.
  8. Ho, J., Jain, A., and Abbeel, P. (2020). Denoising Diffusion Probabilistic Models, Curran Associates Inc.. NIPS’20.
  9. Wu, J.Z., Ge, Y., Wang, X., Lei, W., Gu, Y., Hsu, W., Shan, Y., Qie, X., and Shou, M.Z. (2022). Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation. arXiv.
  10. Molad, E., Horwitz, E., Valevski, D., Acha, A.R., Matias, Y., Pritch, Y., Leviathan, Y., and Hoshen, Y. (2023). Dreamix: Video diffusion models are general video editors. arXiv.
  11. Zhao, W.X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., and Dong, Z. (2023). A survey of large language models. arXiv.
  12. Sutskever, I., Vinyals, O., and Le, Q.V. (2014). Proceedings of the 27th International Conference on Neural Information Processing Systems–Volume 2, MIT Press. NIPS’14.
  13. Chen, M., Tan, X., Li, B., Liu, Y., Qin, T., Zhao, S., and Liu, T.Y. (2021). Adaspeech: Adaptive text to speech for custom voice. arXiv.
  14. Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H.P.d.O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., and Brockman, G. (2021). Evaluating large language models trained on code. arXiv.
  15. Villegas, R., Babaeizadeh, M., Kindermans, P.J., Moraldo, H., Zhang, H., Saffar, M.T., Castro, S., Kunze, J., and Erhan, D. (2022). Phenaki: Variable length video generation from open domain textual description. arXiv.
  16. Narang, S., Raffel, C., Lee, K., Roberts, A., Fiedel, N., and Malkan, K. (2020). Wt5?! training text-to-text models to explain their predictions. arXiv.
  17. Oord, A.v.d., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., and Kavukcuoglu, K. (2016). Wavenet: A generative model for raw audio. arXiv.
  18. Demir, U., and Unal, G. (2018). Patch-based image inpainting with generative adversarial networks. arXiv.
  19. Liu, S., Su, D., and Yu, D. (2022). Diffgan-tts: High-fidelity and efficient text-to-speech with denoising diffusion gans. arXiv.
  20. Poole, B., Jain, A., Barron, J.T., and Mildenhall, B. (2022). Dreamfusion: Text-to-3d using 2d diffusion. arXiv.
  21. Berthelot, D., Schumm, T., and Metz, L. (2017). Began: Boundary equilibrium generative adversarial networks. arXiv.
  22. Jetchev, N., Bergmann, U., and Vollgraf, R. (2016). Texture synthesis with spatial generative adversarial networks. arXiv.
  23. Bergmann, U., Jetchev, N., and Vollgraf, R. (2017). Learning texture manifolds with the periodic spatial GAN. arXiv.
  24. Dhariwal, P., Jun, H., Payne, C., Kim, J.W., Radford, A., and Sutskever, I. (2020). Jukebox: A generative model for music. arXiv.
  25. Engel, J., Agrawal, K.K., Chen, S., Gulrajani, I., Donahue, C., and Roberts, A. (2019). Gansynth: Adversarial neural audio synthesis. arXiv.
  26. Muthukumar, P., and Zhong, J. (2021). A stochastic time series model for predicting financial trends using nlp. arXiv.
  27. Singer, U., Polyak, A., Hayes, T., Yin, X., An, J., Zhang, S., Hu, Q., Yang, H., Ashual, O., and Gafni, O. (2022). Make-a-video: Text-to-video generation without text-video data. arXiv.
  28. Ho, J., Chan, W., Saharia, C., Whang, J., Gao, R., Gritsenko, A., Kingma, D.P., Poole, B., Norouzi, M., and Fleet, D.J. (2022). Imagen video: High definition video generation with diffusion models. arXiv.
  29. Zhang, K.A., Cuesta-Infante, A., Xu, L., and Veeramachaneni, K. (2019). SteganoGAN: High capacity image steganography with GANs. arXiv.
  30. Couairon, G., Verbeek, J., Schwenk, H., and Cord, M. (2022). Diffedit: Diffusion-based semantic image editing with mask guidance. arXiv.
  31. Cao, Y., Cao, Y.P., Han, K., Shan, Y., and Wong, K.Y.K. (2023). Dreamavatar: Text-and-shape guided 3d human avatar generation via diffusion models. arXiv.
  32. Li, Z., Lu, S., Guo, D., Duan, N., Jannu, S., Jenks, G., Majumder, D., Green, J., Svyatkovskiy, A., and Fu, S. (2022). CodeReviewer: Pre-Training for Automating Code Review Activities. arXiv.
  33. Guo, D., Ren, S., Lu, S., Feng, Z., Tang, D., Liu, S., Zhou, L., Duan, N., Yin, J., and Jiang, D. (2020). GraphCodeBERT: Pre-training Code Representations with Data Flow. arXiv.

Cited by

See all 642

Metadata

Authors
Bandi, A., Adapa, P. V. S. R., & Kuchi, Y. E. V. P. K.
Affiliations
Northwest Missouri State University (US)
Corresponding author
Bandi, Ajay
Venue
Future Internet
Publisher
MDPI AG
Published
2023-07-31
Volume
15
Issue
8
Pages
260
ISSN
1999-5903 (ISSN-L)
OpenAlex
W4385416665
Cited by
638
References
118
Citations by year
2026: 149 · 2025: 297 · 2024: 182 · 2023: 10
FWCI
57.91
Type
journal article
Language
en
Open access
Locations
  • Future Internet (publishedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
generative AI, generative AI models, model taxonomy, variational autoencoder, generative adversarial networks, diffusion models, transformer models, language models, hybrid model, evaluation metrics, hardware requirements, software requirements, user experience

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Power of Generative AI: A Review of Requirements, Models, Input–Output Formats, Evaluation Metrics, and Challenges. https://app.cochat.ai/papers/10.3390/fi15080260
The paper
Bandi, A., Adapa, P. V. S. R., & Kuchi, Y. E. V. P. K. (2023). The Power of Generative AI: A Review of Requirements, Models, Input–Output Formats, Evaluation Metrics, and Challenges. Future Internet. https://doi.org/10.3390/fi15080260

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.