The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
MirrorGAN: Learning Text-To-Image Generation by Redescription
Open accessAbstract
Generating an image from a given text description has two goals: visual realism and semantic consistency. Although significant progress has been made in generating high-quality and visually realistic images using generative adversarial networks, guaranteeing semantic consistency between the text description and visual content remains very challenging. In this paper, we address this problem by proposing a novel global-local attentive and semantic-preserving text-to-image-to-text framework called MirrorGAN. MirrorGAN exploits the idea of learning text-to-image generation by redescription and consists of three modules: a semantic text embedding module (STEM), a global-local collaborative attentive module for cascaded image generation (GLAM), and a semantic text regeneration and alignment module (STREAM). STEM generates word- and sentence-level embeddings. GLAM has a cascaded architecture for generating target images from coarse to fine scales, leveraging both local word attention and global sentence attention to progressively enhance the diversity and semantic consistency of the generated images. STREAM seeks to regenerate the text description from the generated image, which semantically aligns with the given text description. Thorough experiments on two public benchmark datasets demonstrate the superiority of MirrorGAN over other representative state-of-the-art methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 2×
“The image encoder is a convolutional neural network (CNN) [11] pretrained on ImageNet [5], and the decoder is a RNN [12].”
MethodHochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 3×
“The image encoder is a convolutional neural network (CNN) [11] pretrained on ImageNet [5], and the decoder is a RNN [12].”
MethodBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 1×
“The image encoder is a convolutional neural network (CNN) [11] pretrained on ImageNet [5], and the decoder is a RNN [12].”
MethodBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 1×
“Second, we only utilize a basic method for text embedding in STEM and image captioning in STREAM, which could be further improved, for example, by using the recently proposed BERT model [7] and state-of-the-art image captioning models [2, 3].”
MethodMicrosoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460 · cited 1×
“We evaluated our model on two commonly used datasets, CUB bird dataset [30] and MS COCO dataset [17].”
MethodLearning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · cited 4×
“The image encoder is a convolutional neural network (CNN) [11] pretrained on ImageNet [5], and the decoder is a RNN [12].”
MethodInfluentialUnpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602 · cited 1×
“Similar ideas to our own have recently been used in CycleGAN and DualGAN, which handle the bi-directional translations within two domains together [42, 36, 1], significantly advance image-to-image translation [14, 28, 15, 37, 23].”
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930 · cited 1×
“Similar ideas to our own have recently been used in CycleGAN and DualGAN, which handle the bi-directional translations within two domains together [43, 37, 1, 32], significantly advance image-to-image translation [14, 28, 15, 38, 23].”
Labaca-Castro, R. (2023) · Springer eBooks · doi:10.1007/978-3-658-40442-0_9 · Cited by 21,119
Flagged first, then by citations
Research works printed but not linked: 2
- 10.1109/iccv.2017.629 · DOI · Paper page
- taigman, 2017, Unsupervised crossdomain image generation, International Conference on Learning Representations (ICLR)
Cited by
Sorted by citations
Items 601–642 of 642
A Comparative Study of Text-to-Image Synthesis Techniques Using Generative Adversarial Networks
Kraitem, Z. (2025) · American Journal of Neural Networks and Applications · doi:10.11648/j.ajae.20231001.13
DAS-GAN: A Dual Attention Single-Stage GAN for Text-to-Image Generation
Zi, L., Chen, X., & Cong, X. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-6969-1_10
CAAM-GAN: Text to Image Generation with Conditioning Augmentation and Attention Mechanism
Cai, H., Shang, J., Yu, W., et al. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-6972-1_5
Image Verse AI- Crafting Image Worlds from Text
Likhitha, Rachana, U., Sinchana, S., et al. (2025) · International Conference on Knowledge Engineering and Communication Systems (ICKECS) · doi:10.1109/ickecs65700.2025.11035108
Self-Attention-Based Text Encoder for Enhancing DMGAN Text-to-Image Generation
Gopalakrishnan, R., Naveen, S., Kalathil, S., & Sudeep, P. V. (2025) · IEEE Access · doi:10.1109/access.2025.3588762
LAP-GAN: Label augmentation with perceptual loss for self-supervised text-to-image synthesis
Tan, Y. X., Lim, J. Y., Lim, J. Y., et al. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129005
Akash, M. S. H., & Jaisharma, K. (2025) · AIP conference proceedings · doi:10.1063/5.0277315
Image generation evaluation: a comprehensive survey of human and automatic evaluations
Liu, Q., Yang, S., Li, Z., Hou, L., Meng, C., Zhang, Y., & Sun, L. (2025) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2400904 · Cited by 1
Accelerating Attentional Generative Adversarial Networks with Sampling Blocks
Zhang, C., Jin, M., Yu, Q., Xue, H., Yang, X., & Jin, X. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-7036-9_9
ArtiFade: Learning to Generate High-quality Subject from Blemished Images
Yang, S., Hao, S., Cao, Y., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01229
A spatial attentional generative adversarial network model for text-to-image generation
Nagaraju, K. C., Thirumalagiri, M. K., Jurmure, S. K., et al. (2025) · AIP conference proceedings · doi:10.1063/5.0261307
Habib, M. A., Wadud, M. A. H., Rahman, M. M., et al. (2025) · IET Image Processing · doi:10.1049/ipr2.70185
Exploring Novel Image Generation via Script-Directed Scene Formation
Khattar, K., Goyal, T., Dhruv, K. P., et al. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-96798-6_39
Instance-level cross-attention learning for fine-grained customizable face generation
Wang, X., Gao, Y., Li, H., et al. (2025) · The Visual Computer · doi:10.1007/s00371-025-04129-8
Z-SASLM: Zero-Shot Style-Aligned SLI Blending Latent Manipulation
Borgi, A., Maiano, L., & Amerini, I. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00622
ACTesting: Automated Cross-Modal Testing Method of Text-to-Image Software
Gu, S., Fang, C., Zhang, Q., et al. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3768581
Diffusion-Based AI Model in Design Engineering for Text-to-3D CAD Generation: Comparative Study
Ekbote, K., Patil, J. D., Ingale, V., Ramgude, A. A., & Kulkarni, V. R. (2025) · Lecture notes in mechanical engineering · doi:10.1007/978-981-96-7480-0_7
AI-Generated Realms: Crafting Images from Text with Stable Diffusion Model
Ratagal, S., Navalur, P., Joshi, A., et al. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-032-06665-7_46
Photo-realistic image generation using text descriptions in Indian languages: an exploration study
Gopalakrishnan, R., & Sudeep, P. V. (2025) · Sadhana · doi:10.1007/s12046-025-02946-0
Image generation based on image description using artificial intelligence
Šimić, A., & Babac, M. B. (2025) · Applied Computing and Informatics · doi:10.1108/aci-05-2025-0186
Text-to-Image Generation for Consumer Electronics via Region-Aware Diffusion Transformer
Zhou, Y., Peng, C., Luo, J., et al. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3643140
Arabic Text to Image Generation TasksPreprint
BAHANI, M. (2022) · Research Square · doi:10.21203/rs.3.rs-2163664/v1
Semantic Response GAN (SR-GAN) for embroidery pattern generation
Chen, S. (2026) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2026.104707
Yue, X.-F., Lu, Z.-X., Zhang, Y., Zou, L., & Yang, H. (2025) · International Conferences on Dependable Systems and Their Applications · doi:10.1109/dsa66321.2025.00033
Multi-modal Hybrid Network for AIGC Image Quality Assessment with Self-supervised Learning
Hong, P., & Sang, Q. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-5682-3_12
RaDL: Relation-aware Disentangled Learning for Multi-Instance Text-to-Image Generation
Park, G., Kim, S. B., Jung, G., et al. (2025) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc58881.2025.11342862
Bad Designs by Good Talkers: Chatbots Failing to Architect Audio Encoders for Image Synthesis
León, J. E., Carrasco, M., & Peters, A. A. (2026) · IEEE Access · doi:10.1109/access.2026.3668130
Benchmarking Generative Models for Traffic Scene Image Synthesis A Comparative Study
Geng, Y., Chen, L., Qiu, B., et al. (2025) · International Conference on Algorithms, Computing and Artificial Intelligence (ACAI) · doi:10.1109/acai68217.2025.11406369
Research On Text Generated Images Based on GAN And Diffusion
Zheng, J. (2026) · Frontiers in Computing and Intelligent Systems · doi:10.54097/ak96vm73
Force Field Parameterization in Molecular Simulation by Machine Learning Methods
Chen, G. (2023) · theses.fr (ABES) · doi:10.70675/adedece5ze1cez4ae8z95c1z816d3e5e0d8c
Ma, L., Ding, J., Qian, Y., et al. (2026) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2026.3680952
Deep Learning Based Multimodal Retrieval
Chen, J. (2023) · theses.fr (ABES) · doi:10.70675/40665356z7b38z4e8fz8dceze1c899d3ae06
Li, Z., Liu, Q., Pan, J., Huang, R., Hou, L., Hu, X., Ma, J., Zhang, S., Zhang, J., Tian, X., et al. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02842-y
Self-citationINGF: Integrated News Generation Framework with Multimodal Editing and Alignment
Xu, N., Yang, X., Fu, J., et al. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-9507-5_13
Diffusion-based valuable NFT generation
Ulurak, E., Kaya, B., & Sefer, E. (2026) · Multimedia Tools and Applications · doi:10.1007/s11042-026-21724-6 · Cited by 1
Transformer-based advertisement image layout generation and object fidelity optimization
Xu, D., Hu, K., & Cai, L. (2026) · PLoS ONE · doi:10.1371/journal.pone.0352418 · Cited by 1
Self-citationL2P3D: Long-Text to Part-Specific 3D Generation via LLM-Based Multi-condition Decomposition
Chen, X., Zhao, Y., Wang, H., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3504-9_6
Exploring cGANs for Urdu Alphabets and Numerical System Generation
Khalil*, S., Arafat, S. Y., Bibi, F., et al. (2025) · International Journal of Innovations in Science and Technology · doi:10.33411/ijist/1226
A Comprehensive Review of Text-to-Multimodal Generation Techniques
Venkatesh, N., Mishra, D., & Patra, R. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-23314-1_42
Text to image synthesis using DALL-E model
Baliwal, M., Chauhan, A., Singh, A., et al. (2026) · AIP conference proceedings · doi:10.1063/5.0285844
Semantic Reinforcement Generative Adversarial Networks for Text-to-Image Generation and Evaluation
Du, M., Liu, T., Wang, Z., et al. (2026) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-032-39125-4_27
A PRISMA ‐Based Systematic Survey on Text to Image Generative Models in Multilingual Contexts
Mudiraj, N. S., & Singh, S. (2026) · Expert Systems · doi:10.1111/exsy.70448
Metadata
- Authors
- Qiao, T., Zhang, J., Xu, D., & Tao, D.
- Affiliations
- The University of Sydney (AU)
- University of Technology Sydney (AU)
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 1505-1514
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2962845008
- Semantic Scholar
- 5af2d424bb38db7e6a72f7bec2cfd8a5bb8af7fb
- Cited by
- 644
- References
- 45
- Citations by year
- 2026: 17 · 2025: 71 · 2024: 99 · 2023: 134 · 2022: 102 · 2021: 113 · 2020: 92 · 2019: 16
- FWCI
- 26.32
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61806062)
- Cultural Heritage Administration
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- text-to-image generation, semantic consistency, redescription, global-local attention, image-text alignment, generative adversarial networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
