A Survey of Knowledge-enhanced Text Generation
Open accessThe DOI matches its Crossref record; 249 of the 249 references it cites were found in a registry or an index.
Abstract
The goal of text-to-text generation is to make machines express like a human in many applications such as conversation, summarization, and translation. It is one of the most important yet challenging tasks in natural language processing (NLP). Various neural encoder-decoder models have been proposed to achieve the goal by learning to map input text to output text. However, the input text alone often provides limited knowledge to generate the desired output, so the performance of text generation is still far from satisfaction in many real-world scenarios. To address this issue, researchers have considered incorporating (i) internal knowledge embedded in the input text and (ii) external knowledge from outside sources such as knowledge base and knowledge graph into the text generation system. This research topic is known as knowledge-enhanced text generation . In this survey, we present a comprehensive review of the research on this topic over the past five years. The main content includes two parts: (i) general methods and architectures for integrating knowledge into text generation; (ii) specific techniques and applications according to different forms of knowledge data. This survey can have broad audiences, researchers and practitioners, in academia and industry.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“When performing text generation evaluation, Yuan et al. [147] formulates this task as a text generation problem and take the average of the final generation scores obtained using different prompts.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [147]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Yuan et al. [147] have demonstrated that prompt learning can be used for automated evaluation of generated texts.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [147]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
Research works printed but not linked: 6
- 10.18653/v1/D17-1209 · DOI · Paper page
- 10.5555/3524938.3525295 · doi:10.5555/3524938.3525295
- 10.5555/2145432.2145494 · doi:10.5555/2145432.2145494
- Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. In Nature. Nature Publishing Group.
- Lianhui Qin, Vered Shwartz, Peter West, Chandra Bhagavatula, Jena Hwang, Ronan Le Bras, Antoine Bosselut, and Yejin Choi. 2020. Backpropagation-based decoding for unsupervised counterfactual and abductive reasoning. In Conference on Empirical Methods in Natural Language Processing (EMNLP).
- 10.18653/v1/W16-2209 · DOI
Cited by
Items 201–261 of 261
Sentence-Permuted Paragraph GenerationPreprint
Yu, W., Zhu, C., Zhao, T., Guo, Z., & Jiang, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.07228
Self-citationEdge-Cloud Polarization and Collaboration: A Comprehensive SurveyPreprint
Yao, J., Zhang, S., Yang, Y., Wang, F., Ma, J., Zhang, J., Chu, Y., Ji, L., Jia, K., Shen, T., et al. (2021) · arXiv (Cornell University)
A Generator-based Method for Attacking Embedding-based Text Classifiers
Minh, K. D., Nguyen, D., Minh, N. L., & Hùng, P. N. (2022) · RIVF International Conference on Computing and Communication Technologies (RIVF) · doi:10.1109/rivf55975.2022.10013912
A Domain Question Answering Algorithm Based on the Contrastive Language-Image Pretraining Mechanism
Zhang, Z., Liang, D., Zhang, Z., Cai, Y., & Hou, H. (2023) · Journal of Computer and Communications · doi:10.4236/jcc.2023.115001
Holistic Graph-Based Deep Q-Network for End-to-End Drug Design and DiscoveryPreprint
Rassil, A., Chougrad, H., & Zouaki, H. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4496383
Li, Y., Radev, D., & Rafiei, D. (2023) · Synthesis lectures on data management · doi:10.1007/978-3-031-45043-3_6
Graph vs. Sequence: An Empirical Study on Knowledge Forms for Knowledge-Grounded Dialogue
Yang, Y., Huang, H., Liu, Y., & Gao, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.982 · Cited by 1
Post-hoc Utterance Refining Method by Entity Mining for Faithful Knowledge Grounded Conversations
Jang, Y., Son, S., Lee, J., Son, J., Hur, Y., Lim, J., Moon, H., Yang, K., & Lim, H. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.295 · Cited by 1
Dictionary-Assisted Chinese Nested Named Entity Recognition
Wang, Y., Ding, T., & Li, L. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-8764-1_15
Pietrosanti, G. M., Nadizar, G., Pigozzi, F., & Medvet, E. (2023) · IEEE Access · doi:10.1109/access.2023.3342912 · Cited by 1
Deep Scene Understanding with Extended Text Description for HumanPreprint
Lee, D.-G. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4705624
ESRM: A Model for Deep Semantic Analysis of Emojis based on Prompt Learning
Zhang, J., Li, Q., Deng, H., & Zeng, R. (2023) · International Conference on Electronic Information Engineering and Computer Technology (EIECT) · doi:10.1109/eiect60552.2023.10442543
Memory-enhanced text style transfer with dynamic style learning and calibration
Lin, F., Song, Y., Tian, Z., Chen, W., Dong, D., & Liu, B. (2024) · Science China Information Sciences · doi:10.1007/s11432-022-3726-0
Joo, E., Lee, D. K., Youn, J., Sung, J.-W., & Choi, H. (2024) · IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp60711.2024.00071
Insert Commonsense Knowledge Through Semantics for Dialogue Generation
Hou, S., Song, D., Wu, Z., Guo, X., & Yang, Z. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5495-3_23
Learning to generate text with auxiliary tasks
Hùng, P. Q., Nguyen, M.-T., Inoue, S., Tran-Tien, M., & Phan, X.-H. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112570
Yang, Y., Li, X., Jin, H., & Huang, K. (2024) · Frontiers in Computing and Intelligent Systems · doi:10.54097/z309gx59 · Cited by 2
Wu, S., Yu, J., & Zhou, W. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128999
Neural headline generation: A comprehensive survey
Ren, H., Chang, X., & Li, X. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129633 · Cited by 1
Medical Prescription Generator using Natural Language Processing
Paithankar, S., Patil, S. D., Shivgan, A., Mahabudhe, M., & Dharmadhikari, P. (2025) · International Conference on Intelligent Systems, Advanced Computing and Communication (ISACC) · doi:10.1109/isacc65211.2025.10969167 · Cited by 1
Label-Guided Scientific Abstract Generation with a Siamese Network Using Knowledge Graphs
Wang, H., & Lepage, Y. (2025) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.062806
Dual-Perspective Evaluation of Knowledge Graphs for Graph-to-Text Generation
Wang, H., Wang, L., & Lepage, Y. (2025) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.066351
JobSet: Synthetic Job Advertisements Dataset for Labour Market Intelligence
Colombo, S., D’Amico, S., Malandri, L., Mercorio, F., & Seveso, A. (2025) · ACM Symposium on Applied Computing · doi:10.1145/3672608.3707718 · Cited by 2
Ni, M. (2025) · Smart innovation, systems and technologies · doi:10.1007/978-981-96-2482-9_13
Hierarchical GAN for Tibetan Text Generation with Attention-Enhanced Feature Extraction
Zhang, Z., Xioing, G., Fan, M., Yu, Y., Wang, X., Tashi, K., Dongrub, R., & Li, L. (2024) · International Conference on Communication and Information Processing (ICCIP) · doi:10.1145/3708657.3708705
Fine-Tuning Llama 2 forAutomatedAd Caption Generation
Panchal, K., & Tidake, S. (2025) · doi:10.38124/ijisrt/25jul236
CoPaa: Curriculum Outline Process Automatic Agent Based on LangGraph
Zhang, J., Zhang, Q., He, Y., & Zhang, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9901-8_6 · Cited by 1
Machines in the Margins: A Systematic Review of Automated Content Generation for Wikipedia
Reeves, N., & Simperl, E. P. B. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757626 · Cited by 5
Predictive typing for the Persian language: A survey
Nouraei, B., Shanbehzadeh, J., & Asghari, P. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.112459
Granular-ball representation-based two-stage deep learning model for text classification
Qian, W., He, Y., Cai, X., & Huang, J. (2025) · Applied Intelligence · doi:10.1007/s10489-025-07010-2
Exploiting Multimodal Knowledge Graph for Multimodal Machine Translation
Xu, T., Liu, X., Wong, D. F., Zhang, Y., Chao, L. S., Zhang, M., & Gan, T. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3639995
CommonSense to DomainSense: Distilling Commonsense Reasoning to Domain-specific Knowledge Graphs
Narotam, N., Kaif, M., Yadav, N., Mutharaju, R., & Akhtar, M. S. (2025) · International Conference on Knowledge Capture · doi:10.1145/3731443.3771360
Experimental study of hyper parameter tuning in text generation chatbot on deep learning techniques
Negi, R., & Katarya, R. (2025) · AIP conference proceedings · doi:10.1063/5.0291981
Luo, H., Yang, M., Xie, Y., & Wang, J. (2025) · International Conference on Network and Information Systems for Computers (ICNISC) · doi:10.1145/3776942.3776993
A Retrieval-Augmented Multimodal Framework for Scientific Reasoning in Materials Science
Luo, Z., Xu, J., Yan, Q., & Liu, C. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-4966-5_20
A Method for Enhancing Knowledge Retrieval in Typical Power Scenarios Based on BFS Algorithm
Shao, B., Yao, Y., Zhang, Z., Wang, S., & Zhang, Z. (2025) · International Conference on Electrical Engineering and Control Science (IC2ECS) · doi:10.1109/ic2ecs68700.2025.11362021
Real-Time Knowledge Access Using Large Language Models and Web Technologies
Jayaram, M., Jyothi, C., Deepthi, T., Ramya, S., & Srikanth, P. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-17840-4_7
Knowledge Management in Production: Human-Centered and AI-Supported Approaches for the Shop Floor
Pfister, J., Schmidt, D., Jenner, M., & Müller, T. G. A. R. (2026) · IntechOpen eBooks · doi:10.5772/intechopen.1013121 · Cited by 1
Urban Representative Term Summarization: A Semantic-Assessment Ontology Learning ApproachPreprint
Li, C., Yi, X., Qi, D., Huang, Z., Pan, Z., Zhang, J., & Zheng, Y. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6344122
Infusing Structural Knowledge for Language Generation with Relational Graph Diffusion
Wang, S. H., Zhang, W., Zhu, J., Wang, Z., & Xia, Y. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00211
Min, H., Ye, F., Xu, D., Xu, J., & Liao, X. (2026) · Water · doi:10.3390/w18060686 · Cited by 1
WMMR: An Improved News Text Abstract Generation Algorithm Based on MMR and Knowledge Graph
Li, X., & Guo, X. (2025) · International Seminar on Artificial Intelligence, Computer Technology and Control Engineering (ACTCE) · doi:10.1109/actce66599.2025.00084
Context-aware Textual Knowledge Representation and Discovery
Matta, N. (2023) · theses.fr (ABES) · doi:10.70675/d9efa26az1660z4388za861z4a5af78c148c
Integrating Unsupervised Learning for the Factual Consistency of Generative Models
Nair, S., & -, Y. S. R. (2026) · Future Internet · doi:10.3390/fi18050235
Liu, X., Li, S., Zhang, H., Su, X., Xie, K., Xue, W., Zhang, W., & Diao, Y. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.115371
ConceptFormer: Towards Graph-Native Grounding of Large Language Models via Latent Concept Injection
Barmettler, J., Bernstein, A., & Rossetto, L. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774905.3794653
Zhou, C., & Yuan, Z. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3894
A Knowledge Driven Method for Data Synthesis and Evaluation Using Large Language Models
Xu, J., Luo, S., & Yang, L. (2026) · International Conference on Electronic Information Engineering, Big Data and Computer Technology (EIBDCT) · doi:10.1109/eibdct69742.2026.11566951
KahaniCraft: Personalized Stories Tailored by AI
Kumar, S., Saharan, U. S., Tomar, A., & Shukla, S. (2026) · Lecture notes in networks and systems · doi:10.1007/978-981-95-7238-0_11
Velentza, A.-M., Guyader, J., Billardon, C., Andries, M., Bosser, A.-G., & Lohr, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29586-6_15
Al-Ammar, M., Al-Khalifa, H., & Hindi, K. M. E. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.116011
From Clicks to Journeys: Empowering Advertising Text Generation With Social Simulator Guidance
Xie, Y., Wang, L., Nie, W., Li, W., Jin, G., & Liu, A.-A. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3717481
Li, Q., Meng, Z., Song, X., & Pang, Z. (2026) · International Conference on Artificial Intelligence, Big Data and Algorithms (CAIBDA) · doi:10.1109/caibda70336.2026.11621324
Multi-relational knowledge graph completion with joint embedding of entities and relations
Mao, D., Li, R., Ma, H., Zhao, Z., & Wu, J. (2026) · Knowledge and Information Systems · doi:10.1007/s10115-026-02789-z
Multiple texts, culture, marginalization, and generative AI: An introduction to the special issue
List, A., & Braasch, J. L. G. (2026) · Educational Psychologist · doi:10.1080/00461520.2026.2686110 · Cited by 1
Concept-based heterogeneous context fusion for enhancing RAG via AMR-driven distillation
Shi, K., Sun, X., Lin, Q., Li, Y., Li, Q., & Xu, G. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114604
Naik, A., Kumar, R. H., Venkatesha, S., Preethi, P., & Mamatha, H. R. (2026) · International Conference on Emerging Technologies in Computing and Communication (ETCC) · doi:10.1109/etcc69750.2026.11682009
Duarte-Martínez, V., Cobo, M. J., & Mendoza, J. N. (2026) · International Conference on eDemocracy & eGovernment · doi:10.1109/icedeg70169.2026.11695401
Xie, X., Zhou, B., & Ge, Z. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7615689
Xu, S., Zhang, L., Zhu, L., Qin, M., & Huang, C. (2026) · doi:10.1109/icstem68144.2026.11735616
Luo, D., Peng, D., Wang, Z., & Wang, C. (2026) · Memetic Computing · doi:10.1007/s12293-026-00534-1
Metadata
- Authors
- Yu, W., Zhu, C., Li, Z., Hu, Z., Wang, Q., Ji, H., & Jiang, M.
- Affiliations
- University of Notre Dame (US)
- Microsoft (United States) (US)
- Chinese University of Hong Kong (HK)
- University of California San Diego (US)
- University of Illinois Urbana-Champaign (US)
- Venue
- ACM Computing Surveys
- Published
- 2022-01-31
- Volume
- 54
- Issue
- 11s
- Pages
- 1-38
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3092288641
- Cited by
- 257
- References
- 241
- Citations by year
- 2026: 27 · 2025: 54 · 2024: 63 · 2023: 67 · 2022: 26
- FWCI
- 17.28
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (IIS-1849816, CCF-1901059, and IIS-2119531)
- Agriculture and Food Research Initiative (2020-67021-32799)
- USDA National Institute of Food and Agriculture, U.S. (HR001120C0123, FA8750-18-2-0014, and FA8750-19-2-1004)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- text-to-text generation, knowledge base integration, knowledge graphs, external knowledge, encoder-decoder architecture, internal knowledge
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.