The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networks
Open accessAbstract
Although Generative Adversarial Networks (GANs) have shown remarkable success in various tasks, they still face challenges in generating high quality images. In this paper, we propose Stacked Generative Adversarial Networks (StackGANs) aimed at generating high-resolution photo-realistic images. First, we propose a two-stage generative adversarial network architecture, StackGAN-v1, for text-to-image synthesis. The Stage-I GAN sketches the primitive shape and colors of a scene based on a given text description, yielding low-resolution images. The Stage-II GAN takes Stage-I results and the text description as inputs, and generates high-resolution images with photo-realistic details. Second, an advanced multi-stage generative adversarial network architecture, StackGAN-v2, is proposed for both conditional and unconditional generative tasks. Our StackGAN-v2 consists of multiple generators and multiple discriminators arranged in a tree-like structure; images at multiple scales corresponding to the same scene are generated from different branches of the tree. StackGAN-v2 shows more stable training behavior than StackGAN-v1 by jointly approximating multiple distributions. Extensive experiments demonstrate that the proposed stacked generative adversarial networks significantly outperform other state-of-the-art methods in generating photo-realistic images.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2008) · Journal of Machine Learning Research · Cited by 33,051
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Research works printed but not linked: 12
- rezende, 2014, Stochastic backpropagation and approximate inference in deep generative models, Proc Int Conf Mach Learn, 1278
- reed, 2016, Generating interpretable images with controllable structure, Tech Rep
- arjovsky, 2017, Towards principled methods for training generative adversarial networks, Proc ICLR
- salimans, 2018, Improving GANs using optimal transport, Proc ICLR
- mansimov, 2016, Generating images from captions with attention, Proc ICLR
- gauthier, 2015, Conditional generative adversarial networks for convolutional face generation, Tech Rep
- goodfellow, 2014, Generative adversarial nets, Proc Neural Inf Process Syst, 2672
- che, 2017, Mode regularized generative adversarial networks, Proc ICLR
- denton, 2015, Deep generative image models using a laplacian pyramid of adversarial networks, Proc 28th Int Conf Neural Inf Process Syst, 1486
- chen, 2016, InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets, Proc Conf Neural Inf Process Syst, 2172
- vinyals, 2016, Matching networks for one shot learning, Proc 30th Int Conf Neural Inf Process Syst, 3630
- taigman, 2017, Unsupervised cross-domain image generation, Proc ICLR
Cited by
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022) · ACM Computing Surveys · doi:10.1145/3505244 · Cited by 3,595
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2021) · arXiv · doi:10.48550/arxiv.2101.01169 · Cited by 3,594
Semantic Image Synthesis With Spatially-Adaptive Normalization
Park, T., Liu, M.-Y., Wang, T.-C., & Zhu, J.-Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00244 · Cited by 2,974
Zero-shot text-to-image generation
Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., Chen, M., & Sutskever, I. (2021) · arXiv · doi:10.48550/arxiv.2102.12092 · Cited by 2,417
AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
Xu, T., Zhang, P., Huang, Q., Zhang, H., Gan, Z., Huang, X., & He, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00143 · Cited by 1,923
Self-citationA Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
Gui, J., Sun, Z., Wen, Y., Tao, D., & Ye, J. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3130191 · Cited by 1,231
StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery
Patashnik, O., Wu, Z., Shechtman, E., Cohen-Or, D., & Lischinski, D. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00209 · Cited by 1,023
Blended Diffusion for Text-driven Editing of Natural Images
Avrahami, O., Lischinski, D., & Fried, O. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01767 · Cited by 764
Vector Quantized Diffusion Model for Text-to-Image Synthesis
Gu, S., Chen, D., Bao, J., Wen, F., Zhang, B., Chen, D., Yuan, L., & Guo, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01043 · Cited by 720
MirrorGAN: Learning Text-To-Image Generation by Redescription
Qiao, T., Zhang, J., Xu, D., & Tao, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00160 · Cited by 644
“First, we compare MirrorGAN with state-of-the-art text-to-image methods [24, 25, 39, 40, 20, 35] using the Inception Score and R-precision score on both CUB and COCO datasets.”
MethodResultInfluentialGANimation: Anatomically-Aware Facial Animation from a Single Image
Pumarola, A., Agudo, A., Martinez, A. M., Sanfeliu, A., & Moreno-Noguer, F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_50 · Cited by 621
DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-To-Image Synthesis
Zhu, M., Pan, P., Chen, W., & Yang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00595 · Cited by 590
Multimodal intelligence: Representation learning, information fusion, and applications
Zhang, C., Yang, Z., He, X., & Deng, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2987728 · Cited by 511
DRIT++: Diverse Image-to-Image Translation via Disentangled Representations
Lee, H.-Y., Tseng, H.-Y., Mao, Q., Huang, J.-B., Lu, Y.-D., Singh, M., & Yang, M.-H. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01284-z · Cited by 486
Durall, R., Keuper, M., & Keuper, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00791 · Cited by 26
Mode Seeking Generative Adversarial Networks for Diverse Image Synthesis
Mao, Q., Lee, H.-Y., Tseng, H.-Y., Ma, S., & Yang, M.-H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00152 · Cited by 427
Méndez-Lucio, O., Baillif, B., Clevert, D.-A., Rouquié, D., & Wichard, J. (2020) · Nature Communications · doi:10.1038/s41467-019-13807-w · Cited by 419
Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networks
Santos, C. F. G. D., & Papa, J. P. (2022) · ACM Computing Surveys · doi:10.1145/3510413 · Cited by 557
MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editing
Cao, M., Wang, X., Qi, Z., Shan, Y., Qie, X., & Zheng, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02062 · Cited by 413
Self-citationTediGAN: Text-Guided Diverse Face Image Generation and Manipulation
Xia, W., Yang, Y., Xue, J.-H., & Wu, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00229 · Cited by 376
Deep learning in food category recognition
Zhang, Y., Deng, L., Zhu, H., Wang, W., Ren, Z., Zhou, Q., Lu, S., Sun, S., Zhu, Z., Gorriz, J. M., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101859 · Cited by 357
Deep learning for determining a near-optimal topological design without any iteration
Yu, Y., Hur, T., Jung, J., & Jang, I. G. (2019) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-018-2101-5 · Cited by 353
Cross-Modal Contrastive Learning for Text-to-Image Generation
Zhang, H., Koh, J. Y., Baldridge, J., Lee, H., & Yang, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00089 · Cited by 343
Self-citationObject-Driven Text-To-Image Synthesis via Adversarial Training
Li, W., Zhang, P., Zhang, L., Huang, Q., He, X., Lyu, S., & Gao, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01245 · Cited by 315
DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesis
Tao, M., Tang, H., Wu, F., Jing, X., Bao, B.-K., & Xu, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01602 · Cited by 313
AutoGAN: Neural Architecture Search for Generative Adversarial Networks
Gong, X., Chang, S., Jiang, Y., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00332 · Cited by 305
A Survey on the New Generation of Deep Learning in Image Processing
Jiao, L., & Zhao, J. (2019) · IEEE Access · doi:10.1109/access.2019.2956508 · Cited by 293
ManiGAN: Text-Guided Image Manipulation
Li, B., Qi, X., Lukasiewicz, T., & Torr, P. H. S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00790 · Cited by 280
GAN review: Models and medical image fusion applications
Zhou, T., Li, Q., Lu, H., Cheng, Q., & Zhang, X. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.10.017 · Cited by 268
Visual place recognition: A survey from deep learning perspective
Zhang, X., Wang, L., & Su, Y. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2020.107760 · Cited by 261
A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
Gui, J., Sun, Z., Wen, Y., Tao, D., & Ye, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.06937 · Cited by 253
Effectively Unbiased FID and Inception Score and Where to Find Them
Chong, M. J., & Forsyth, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00611 · Cited by 242
GAN Compression: Efficient Architectures for Interactive Conditional GANs
Li, M., Lin, J., Ding, Y., Liu, Z., Zhu, J.-Y., & Han, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00533 · Cited by 216
Defect-GAN: High-Fidelity Defect Synthesis for Automated Defect Inspection
Zhang, G., Cui, K., Hung, T.-Y., & Lu, S. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00257 · Cited by 200
Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data
Yu, N., Skripniuk, V., Abdelnabi, S., & Fritz, M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01418 · Cited by 195
Saito, M., Saito, S., Koyama, M., & Kobayashi, S. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01333-y · Cited by 116
Object Detection with Transformers: A Review
Shehzadi, T., Hashmi, K. A., Liwicki, M., Stricker, D., & Afzal, M. Z. (2025) · Sensors · doi:10.3390/s25196025 · Cited by 93
Adversarial Attacks Against Deep Generative Models on Data: A Survey
Sun, H., Zhu, T., Zhang, Z., Jin, D., Xiong, P., & Zhou, W. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3130903 · Cited by 90
Detecting fake images by identifying potential texture difference
Yang, J., Xiao, S., Li, A., Lan, G., & Wang, H. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.06.043 · Cited by 86
X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers
Cho, J., Lu, J., Schwenk, D., Hajishirzi, H., & Kembhavi, A. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.707 · Cited by 99
Liu, Y.-L. E., & Huang, Y.-M. (2025) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2311975 · Cited by 47
Sketchar: Supporting Character Design and Illustration Prototyping Using Generative AI
Ling, L., Chen, X., Wen, R., Li, T. J.-J., & LC, R. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3677102 · Cited by 52
Deep Insights of Deepfake Technology : A Review
Mahmud, B. U., & Sharmin, A. (2021) · arXiv · doi:10.48550/arxiv.2105.00192 · Cited by 38
Rizvi, S. K. J., Azad, M. A., & Fraz, M. M. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09543-4 · Cited by 37
A unified generative model using generative adversarial network for activity recognition
Chan, M. H., & Noor, M. H. M. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02548-0 · Cited by 27
Exposing DeepFakes Using Convolutional Neural Networks and Transfer Learning Approaches
Suratkar, S., Kazi, F., Sakhalkar, M., Abhyankar, N., & Kshirsagar, M. (2020) · 2020 IEEE 17th India Council International Conference (INDICON) · doi:10.1109/indicon49873.2020.9342252 · Cited by 25
“Deepfake detection approaches using deep learning: A systematic review,”
Deshmukh, A., & Wankhade, S. B. (2021) · Lecture Notes in Networks and Systems · doi:10.1007/978-981-15-7421-4_27 · Cited by 24
Focus your attention: A focal attention for multimodal learning
Liu, C., Mao, Z., Zhang, T., Liu, A.-A., Wang, B., & Zhang, Y. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3046855 · Cited by 17
TICS: text–image-based semantic CAPTCHA synthesis via multi-condition adversarial learning
Jia, X., Xiao, J., & Wu, C. (2022) · The Visual Computer · doi:10.1007/s00371-021-02061-1 · Cited by 13
Fine-grained talking face generation with video reinterpretation
Huang, X., Wang, M., & Gong, M. (2021) · The Visual Computer · doi:10.1007/s00371-020-01982-7 · Cited by 11
Self-citation
Metadata
- Authors
- Zhang, H., Xu, T., Li, H., Zhang, S., Wang, X., Huang, X., & Metaxas, D. N.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2019-08-01
- Volume
- 41
- Issue
- 8
- Pages
- 1947-1962
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2766091292
- Cited by
- 1,190
- References
- 47
- FWCI
- 63.18
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Air Force Office of Scientific Research
- National Science Foundation (1763523, 1747778, 1733843, 1703883)
- NSF (ABI-1661280, CNS-1629913)
- General Research Fund (CUHK14213616, CUHK14206114, CUHK14205615, CUHK14203015, CUHK14239816, CUHK419412, CUHK14207814, CUHK14208417, CUHK14202217)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.