A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
The DOI matches its Crossref record; 332 of the 332 references it cites were found in a registry or an index.
Abstract
Generative adversarial networks (GANs) have recently become a hot research topic; however, they have been studied since 2014, and a large number of algorithms have been proposed. Nevertheless, few comprehensive studies explain the connections among different GAN variants and how they have evolved. In this paper, we attempt to provide a review of the various GAN methods from the perspectives of algorithms, theory, and applications. First, the motivations, mathematical representations, and structures of most GAN algorithms are introduced in detail, and we compare their commonalities and differences. Second, theoretical issues related to GANs are investigated. Finally, typical applications of GANs in image processing and computer vision, natural language processing, music, speech and audio, the medical field, and data science are discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Generative adversarial networks (GANs) [11] have gained interest as an important research topic in deep learning because they can generate synthetic samples that cannot be distinguished as true or false based on existing data.”
From Deep Learning-Based Optimization of Visual–Auditory Sensory Substitution (2023) · cites this paper as [11]
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 3×
“BigBiGAN achieve the state of the art in both unsupervised representation learning on ImageNet and unconditional image generation.”
BackgroundGradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 2×
“MLP can be only used for small datasets such as CIFAR-10 [189], MNIST [190], and the Toronto Face Database (TFD) [191].”
MethodInfluentialRethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930 · cited 4×
“When paired training data is available, reference [156] can be used for these image-toimage translation tasks.”
BackgroundMethodInfluentialAuto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067 · cited 1×
“The explicit density models include maximum likelihood estimation (MLE), approximate inference [95], [96], and Markov chain method [97]–[99].”
MethodA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336 · cited 1×
“The explicit density models include maximum likelihood estimation (MLE), approximate inference [95], [96], and Markov chain method [97]–[99].”
MethodMastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · cited 3×
“The intermediate version of AlphaGo utilizes two networks competing with each other.”
BackgroundPhoto-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Research works printed but not linked: 17
- Schmidhuber, 1990, Making the world differentiable: On using fully recurrent self-supervised neural networks for dynamic reinforcement learning and planning in non-stationary environments, Inst. Comput. Sci., Tech. Univ. Munich, Germany, FKI-126, Tech. Rep.
- Schmidhuber, 2009, Art & science as by-products of the search for novel patterns, or data compressible in unknown yet learnable ways, Edizioni, 98
- Goodfellow, Generative adversarial nets, 2672
- 10.1016/S0364-0213(85)80012-4 · doi:10.1016/s0364-0213(85)80012-4 · Paper page
- Gauthier, 2014, Conditional generative adversarial nets for convolutional face generation, Class Project for Stanford CS231N: Convolutional Neural Netw. Vis. Recognit., Winter semester, 2014
- Yao, 3D-aware scene manipulation via inverse graphics, 1887
- Gong, Twin auxilary classifiers GAN, 1328
- Uppal, Nonparametric density estimation & convergence of GANs under besov IPM losses, 9086
- Mroueh, Sobolev GAN
- Goodfellow, 2016, Deep Learning
- 10.1109/ICCV.2019.00460 · DOI · Paper page
- Singh, Nonparametric density estimation with adversarial losses, 10246
- Nagarajan, Theoretical insights into memorization in GANs, 1
- Cao, Learning a high fidelity pose invariant model for high-resolution face frontalization, 2867
- Zhang, Generating text via adversarial training, 1
- d’Autume, Training language GANs from scratch, 4302
- Rao, Answer-based adversarial training for generating clarification questions, 1
Cited by
Items 1,001–1,002 of 1,002
Varaprasad, S. A., Goel, T., & Tanveer, M. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108044 · Cited by 1
Lu, W., & Kong, B. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00674-2 · Cited by 1
Metadata
- Authors
- Gui, J., Sun, Z., Wen, Y., Tao, D., & Ye, J.
- Affiliations
- University of Michigan (US)
- Chinese Academy of Sciences (CN)
- Nanyang Technological University (SG)
- The University of Sydney (AU)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2023-04-01
- Volume
- 35
- Issue
- 4
- Pages
- 3313-3332
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W3216759837
- Cited by
- 1,231
- References
- 329
- Citations by year
- 2026: 181 · 2025: 304 · 2024: 341 · 2023: 216
- FWCI
- 65.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion)
- Funders
- National Natural Science Foundation of China (62172090, 62172089)
- National Key R&D Project of China (2021QY2102)
- CAAI-Huawei MindSpore Open Fund
- Alibaba Innovative Research Program
- Fundamental Research Funds for the Central Universities (2242022R10071)
- National Research Foundation Singapore
- Jiangsu Provincial Double-Innovation Doctor Program (JSSCBS20210075)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- generative adversarial networks, GAN variants, generative models, image generation, image processing, natural language generation, music generation, medical image synthesis, data science applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.