A survey on text generation using generative adversarial networks
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
This work presents a thorough review concerning recent studies and text generation advancements using Generative Adversarial Networks. The usage of adversarial learning for text generation is promising as it provides alternatives to generate the so-called “natural” language. Nevertheless, adversarial text generation is not a simple task as its foremost architecture, the Generative Adversarial Networks, were designed to cope with continuous information (image) instead of discrete data (text). Thus, most works are based on three possible options, i.e., Gumbel-Softmax differentiation, Reinforcement Learning, and modified training objectives. All alternatives are reviewed in this survey as they present the most recent approaches for generating text using adversarial-based techniques. The selected works were taken from renowned databases, such as Science Direct, IEEEXplore, Springer, Association for Computing Machinery, and arXiv, whereas each selected work has been critically analyzed and assessed to present its objective, methodology, and experimental results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · cited 2×
“[50] WGAN-GP Google One Billion Words Gradient penalization.”
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 1×
“Additionally, previous sequences must be carried to the future during learning, as the language model predicts data based on past information [3].”
BackgroundCategorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616
Tutorial on maximum likelihood estimation
Myung, I. J. (2003) · Journal of Mathematical Psychology · doi:10.1016/s0022-2496(02)00028-7 · Cited by 1,802
Microsoft COCO Captions: Data Collection and Evaluation Server
Chen, X., Fang, H., Lin, T.-Y., Vedantam, R., Gupta, S., Dollar, P., & Zitnick, C. L. (2015) · arXiv · doi:10.48550/arxiv.1504.00325 · Cited by 1,614
Gatt, A., & Krahmer, E. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5477 · Cited by 776
Research works printed but not linked: 34
- Zhang, 2021, A survey on concept factorization: from shallow to deep representation learning, Inf. Process. Manage., 58, 102534, 10.1016/j.ipm.2021.102534 · DOI
- Zhang, 2021, Dense residual network: enhancing global dense feature flow for character recognition, Neural Netw., 139, 77, 10.1016/j.neunet.2021.02.005 · DOI
- Elman, 1990, Finding structure in time, Cognit. Sci., 14, 179, 10.1207/s15516709cog1402_1 · DOI · Paper page
- Biggio, 2018, Wild patterns: ten years after the rise of adversarial machine learning, Pattern Recognit., 84, 317, 10.1016/j.patcog.2018.07.023 · DOI · Paper page
- Hu, 2019, Face hallucination from low quality images using definition-scalable inference, Pattern Recognit., 94, 110, 10.1016/j.patcog.2019.05.027 · DOI
- Li, 2020, Semi-supervised cross-modal image generation with generative adversarial networks, Pattern Recognit., 100, 107085, 10.1016/j.patcog.2019.107085 · DOI
- Liu, 2020, Collocating clothes with generative adversarial networks cosupervised by categories and attributes: a multidiscriminator framework, IEEE Trans. Neural Netw. Learn.Syst., 31, 3540, 10.1109/TNNLS.2019.2944979 · DOI
- Sutton, 1998, vol. 135
- T. Che, Y. Li, R. Zhang, R.D. Hjelm, W. Li, Y. Song, Y. Bengio, Maximum-likelihood augmented discrete generative adversarial networks, 2017, arXiv preprint arXiv:1702.07983 · arXiv
- S. Lu, Y. Zhu, W. Zhang, J. Wang, Y. Yu, Neural text generation: past, present and beyond, 2018, arXiv preprint arXiv:1803.07133 · arXiv
- Zhang, 2020, Adversarial attacks on deep-learning models in natural language processing: a survey, ACM Trans. Intell. Syst.Technol., 11, 1
- Goldberg, 2016, A primer on neural network models for natural language processing, J. Artif. Intell. Res., 57, 345, 10.1613/jair.4992 · DOI · Paper page
- Williams, 1992, Simple statistical gradient-following algorithms for connectionist reinforcement learning, Mach. Learn., 8, 229, 10.1007/BF00992696 · DOI · Paper page
- Ondrej, 2017, Findings of the 2017 conference on machine translation (WMT17), 169
- Brown, 1992, An estimate of an upper bound for the entropy of english, Comput. Linguist., 18, 31
- M.J. Kusner, J.M. Hernández-Lobato, GANs for sequences of discrete elements with the Gumbel-Softmax distribution, 2016, arXiv preprint arXiv:1611.04051 · arXiv
- G.L. Guimaraes, B. Sanchez-Lengeling, C. Outeiral, P.L.C. Farias, A. Aspuru-Guzik, Objective-reinforced generative adversarial networks (organ) for sequence generation models, 2018, arXiv preprint arXiv:1705.10843 · arXiv
- Li, 2018, A generative model for category text generation, Inf. Sci., 450, 301, 10.1016/j.ins.2018.03.050 · DOI · Paper page
- A. Balagopalan, S. Gorti, M. Ravaut, R. Saqur, ReGAN: RE[LAX|BAR|INFORCE] based sequence generation using GANs, 2018, arXiv preprint arXiv:1805.02788 · arXiv
- Chen, 2020, Customizable text generation via conditional text generative adversarial network, Neurocomputing, 416, 125, 10.1016/j.neucom.2018.12.092 · DOI
- Wang, 2019, Automatic generation of sentimental texts via mixture adversarial networks, Artif. Intell., 275, 540, 10.1016/j.artint.2019.07.003 · DOI
- Zhang, 2019, Emotional text generation based on cross-domain sentiment transfer, IEEE Access, 7, 100081, 10.1109/ACCESS.2019.2931036 · DOI
- Liu, 2019, BFGAN: backward and forward generative adversarial networks for lexically constrained sentence generation, IEEE/ACM Trans. Audio Speech Lang. Process., 27, 2350, 10.1109/TASLP.2019.2943018 · DOI
- Sun, 2019, QuGAN: quasi generative adversarial network for tibetan question answering corpus generation, IEEE Access, 7, 116247, 10.1109/ACCESS.2019.2934581 · DOI
- Rizzo, 2020, Adversarial text generation with context adapted global knowledge and a self-attentive discriminator, Inf. Process. Manage., 57, 102217, 10.1016/j.ipm.2020.102217 · DOI
- Wu, 2020, Text generation service model based on truth-guided seqGAN, IEEE Access, 8, 11880, 10.1109/ACCESS.2020.2966291 · DOI
- W. Zhou, T. Ge, K. Xu, F. Wei, M. Zhou, Self-adversarial learning with comparative discrimination for text generation, 2020, arXiv preprint arXiv:2001.11691 · arXiv
- O. Press, A. Bar, B. Bogin, J. Berant, L. Wolf, Language generation with recurrent generative adversarial networks without pre-training, 2017, arXiv preprint arXiv:1706.01399 · arXiv
- D. Donahue, A. Rumshisky, Adversarial text generation without reinforcement learning, 2018, arXiv preprint arXiv:1810.06640 · arXiv
- Montahaei, 2021, DGSAN: discrete generative self-adversarial network, Neurocomputing, 448, 364, 10.1016/j.neucom.2021.03.097 · DOI
- Yang, 2020, FGGAN: feature-guiding generative adversarial networks for text generation, IEEE Access, 8, 105217, 10.1109/ACCESS.2020.2993928 · DOI
- Ziebart, 2008, Maximum entropy inverse reinforcement learning., vol. 3, 1433
- Zhang, 2016, Generating text via adversarial training, vol. 21
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI Blog, 1, 1
Cited by
Bandi, A., Adapa, P. V. S. R., & Kuchi, Y. E. V. P. K. (2023) · Future Internet · doi:10.3390/fi15080260 · Cited by 638
Khanjani, Z., Watson, G., & Janeja, V. P. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2022.1001063 · Cited by 121
Marchesi, R., Micheletti, N., I-Hsien Kuo, N., Barbieri, S., Jurman, G., & Osmani, V. (2025) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1013080 · Cited by 29
Neshaei, S. P., Rietsche, R., Su, X., & Wambsganss, T. (2024) · Proceedings of the 29th International Conference on Intelligent User Interfaces · doi:10.1145/3640543.3645169 · Cited by 9
“Another class of deep learning models focusing on generative tasks is the class of Generative Adversarial Networks (GANs) [25, 30, 44].”
BackgroundGenerative Network Design for Multi-Agent Coordination: A VAE-Assisted Deep RL Approach
Chen, Q., & Heydari, B. (2025) · Journal of Mechanical Design · doi:10.1115/1.4068796 · Cited by 4
Metadata
- Authors
- de Rosa, G. H., & Papa, J. P.
- Venue
- Pattern Recognition
- Publisher
- Elsevier BV
- Published
- 2021-11
- Volume
- 119
- Pages
- 108098
- ISSN
- 0031-3203 (ISSN-L)
- OpenAlex
- W3165906701
- Cited by
- 129
- References
- 11
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Council for Forest Research and Development
- Fundação de Amparo à Pesquisa do Estado de São Paulo (2013/07375-0, 2014/12236-1, 2019/02205-5, 2019/07665-4, 2020/12101-0)
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (307066/2017-7, 427968/2018-6)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A survey on text generation using generative adversarial networks. https://app.cochat.ai/papers/10.1016/j.patcog.2021.108098
- The paper
- de Rosa, G. H., & Papa, J. P. (2021). A survey on text generation using generative adversarial networks. Pattern Recognition. https://doi.org/10.1016/j.patcog.2021.108098
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.