A Survey of Knowledge-enhanced Text Generation
Open accessThe DOI matches its Crossref record; 249 of the 249 references it cites were found in a registry or an index.
Abstract
The goal of text-to-text generation is to make machines express like a human in many applications such as conversation, summarization, and translation. It is one of the most important yet challenging tasks in natural language processing (NLP). Various neural encoder-decoder models have been proposed to achieve the goal by learning to map input text to output text. However, the input text alone often provides limited knowledge to generate the desired output, so the performance of text generation is still far from satisfaction in many real-world scenarios. To address this issue, researchers have considered incorporating (i) internal knowledge embedded in the input text and (ii) external knowledge from outside sources such as knowledge base and knowledge graph into the text generation system. This research topic is known as knowledge-enhanced text generation . In this survey, we present a comprehensive review of the research on this topic over the past five years. The main content includes two parts: (i) general methods and architectures for integrating knowledge into text generation; (ii) specific techniques and applications according to different forms of knowledge data. This survey can have broad audiences, researchers and practitioners, in academia and industry.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“When performing text generation evaluation, Yuan et al. [147] formulates this task as a text generation problem and take the average of the final generation scores obtained using different prompts.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [147]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Yuan et al. [147] have demonstrated that prompt learning can be used for automated evaluation of generated texts.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [147]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–249 of 249
Retrieval Enhanced Model for Commonsense Generation
Wang, H., Liu, Y., Zhu, C., Shou, L., Gong, M., Xu, Y., & Zeng, M. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.269 · Cited by 32
Self-citationNatural Answer Generation with Heterogeneous Memory
Fu, Y., & Feng, Y. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1017 · Cited by 31
Data-to-Text Generation with Style Imitation
Lin, S., Wang, W., Yang, Z., Liang, X., Xu, F. F., Xing, E. P., & Hu, Z. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.144 · Cited by 31
Self-citationCan We Predict New Facts with Open Knowledge Graph Embeddings? A Benchmark for Open Link Prediction
Broscheit, S., Gashteovski, K., Wang, Y., & Gemulla, R. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.209 · Cited by 30
Iso, H., Qiao, C., & Li, H. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.17 · Cited by 28
Pre-training Text-to-Text Transformers for Concept-centric Common SensePreprint
Zhou, W., Lee, D., Selvam, R. K., Lee, S., Lin, B. Y., & Ren, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07956 · Cited by 27
Topic-Informed Neural Machine Translation
Zhang, J., Li, L., Way, A., & Liu, Q. (2016) · Arrow@dit (Dublin Institute of Technology) · Cited by 26
Identifying Referential Intention with Heterogeneous Contexts
Yu, W., Yu, M., Zhao, T., & Jiang, M. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380175 · Cited by 26
Self-citationGenerating Commonsense Explanation by Extracting Bridge Concepts from Reasoning Paths
Ji, H., Ke, P., Huang, S., Wei, F., & Huang, M. (2020) · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP) · doi:10.18653/v1/2020.aacl-main.28 · Cited by 26
Self-citationNeural Language Generation: Formulation, Methods, and Evaluation
Gârbacea, C., & Mei, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.15780 · Cited by 24
An Enhanced Knowledge Injection Model for Commonsense Generation
Fan, Z., Gong, Y., Wei, Z., Wang, S., Huang, Y., Jiao, J., Huang, X., Duan, N., & Zhang, R. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.182 · Cited by 24
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
Yu, D., Zhu, C., Fang, Y., Yu, W., Wang, S., Yi‐chong, X., Ren, X., Yang, Y., & Zeng, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.04330 · Cited by 24
Self-citationTowards a Continuous Knowledge Learning Engine for Chatbots
Mazumder, S., Ma, N., & Liu, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.06024 · Cited by 23
A Topic Augmented Text Generation Model: Joint Learning of Semantics and Structural Features
Tang, H., Li, M., & Jin, B. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1513 · Cited by 23
Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model
Xiong, W., Du, J., Wang, W. Y., & Stoyanov, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.09637 · Cited by 23
Inferring Search Queries from Web Documents via a Graph-Augmented Sequence to Attention Network
Han, F. X., Niu, D., Lai, K., Guo, W., He, Y., & Xu, Y. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313746 · Cited by 22
Recurrent Hierarchical Topic-Guided RNN for Language GenerationPreprint
Guo, D., Chen, B., Lu, R., & Zhou, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.10337 · Cited by 22
Injecting Entity Types into Entity-Guided Text Generation
Dong, X., Yu, W., Zhu, C., & Jiang, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.56 · Cited by 21
Self-citationDomain Aware Neural Dialog SystemPreprint
Choudhary, S., Srivastava, P., Ungar, L., & Sedoc, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.00897 · Cited by 19
A Neural Topical Expansion Framework for Unstructured Persona-oriented Dialogue GenerationPreprint
Xu, M., Li, P., Yang, H., Ren, P., Ren, Z., Chen, Z., & Ma, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02153 · Cited by 18
Dict-BERT: Enhancing Language Model Pre-training with DictionaryPreprint
Yu, W., Zhu, C., Fang, Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.06490 · Cited by 17
Self-citationConversing by Reading: Contentful Neural Conversation with On-demand Machine Reading
Qin, L., Galley, M., Brockett, C., Liu, X., Gao, X., Dolan, B., Choi, Y., & Gao, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02738 · Cited by 16
Diversify Question Generation with Continuous Content Selectors and Question Type Modeling
Wang, Z., Rao, S., Zhang, J., Qin, Z., Tian, G., & Wang, Y.-X. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.194 · Cited by 16
Knowledge Aware Conversation Generation with Reasoning on Augmented Graph.
Liu, Z., Niu, Z.-Y., Wu, H. R., & Wang, H. (2019) · Cited by 15
Exemplar Guided Neural Dialogue Generation
Cai, H., Chen, H., Song, Y., Zhao, X., & Yin, D. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/498 · Cited by 14
Generating Paraphrase with Topic as Prior Knowledge
Liu, Y., Lin, Z., Liu, F., Dai, Q., & Wang, W. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3358102 · Cited by 13
CDL: Curriculum Dual Learning for Emotion-Controllable Response GenerationPreprint
Shen, L., & Feng, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.00329 · Cited by 12
Neural Morphological Tagging of Lemma Sequences for Machine Translation
Conforti, C., Huck, M., & Fraser, A. (2018) · Conference of the Association for Machine Translation in the Americas · Cited by 11
A topic-driven language model for learning to generate diverse sentences
Gao, C., & Ren, J. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.01.002 · Cited by 11
Sentence-Permuted Paragraph Generation
Yu, W., Zhu, C., Zhao, T., Guo, Z., & Jiang, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.412 · Cited by 11
Self-citationEntity Commonsense Representation for Neural Abstractive SummarizationPreprint
Amplayo, R. K., Lim, S., & Hwang, S.-W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05504 · Cited by 10
Generating Commonsense Explanation by Extracting Bridge Concepts from Reasoning PathsPreprint
Ji, H., Ke, P., Huang, S., Wei, F., & Huang, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.11753 · Cited by 10
Self-citationGraph-based Multi-hop Reasoning for Long Text GenerationPreprint
Zhao, L., Xu, J., Lin, J., Zhang, Y., Yang, H., & Sun, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13282 · Cited by 10
Efficient Relational Learning with Hidden Variable Detection
Lao, N., Zhu, J., Xin-wang, L., Liu, Y., & Cohen, W. W. (2010) · Cited by 9
THOTH: Neural Translation and Enrichment of Knowledge Graphs
Moussallem, D., Soru, T., & Ngomo, A.-C. N. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30793-6_29 · Cited by 9
Dynamic Knowledge Graph-Based Dialogue Generation with Improved Adversarial Meta-Learning
Xu, H., & Bao, J. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240132 · Cited by 9
Towards an Engine for Lifelong Interactive Knowledge Learning in Human-Machine ConversationsPreprint
Mazumder, S., Ma, N., & Liu, B. (2018) · arXiv (Cornell University) · Cited by 8
Translating with Bilingual Topic Knowledge for Neural Machine Translation
Wei, X., Hu, Y., Xing, L., Wang, Y., & Gao, L. H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017257 · Cited by 8
Generating Well-Formed Answers by Machine Reading with Stochastic Selector Networks
Bi, B., Wu, C., Yan, M., Wang, W., Xia, J., & Li, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6238 · Cited by 7
Data-to-Text Generation with Style ImitationPreprint
Lin, S., Wang, W., Yang, Z., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09501 · Cited by 7
Coherent Comment Generation for Chinese Articles with a Graph-to-Sequence ModelPreprint
Li, W., Xu, J., He, Y., Yan, S., Wu, Y., & Sun, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.01231 · Cited by 6
Controllable Paraphrase Generation with a Syntactic ExemplarPreprint
Chen, M., Tang, Q., Wiseman, S., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00565 · Cited by 6
Polite Dialogue Generation Without Parallel DataPreprint
Niu, T., & Bansal, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.03162 · Cited by 5
Learning to Select Bi-Aspect Information for Document-Scale Text Content Manipulation
Feng, X., Sun, Y., Qin, B., Gong, H., Sun, Y., Bi, W., Liu, X., & Liu, T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6274 · Cited by 5
Product-Aware Answer Generation in E-Commerce Question-AnsweringPreprint
Gao, S., Ren, Z., Zhao, Y. E., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.07696 · Cited by 3
Task-Oriented Conversation Generation Using Heterogeneous Memory NetworksPreprint
Lin, Z., Huang, X., Ji, F. Q., Chen, H., & Zhang, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11287 · Cited by 3
GENIE: Toward Reproducible and Standardized Human Evaluation for Text GenerationPreprint
Khashabi, D., Stanovsky, G., Bragg, J., Lourie, N., Kasai, J., Choi, Y., Smith, N. A., & Weld, D. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.06561 · Cited by 2
Towards information-rich, logical text generation with knowledge-enhanced neural modelsPreprint
Wang, H., Guo, B., Wu, W., & Yu, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.00814 · Cited by 1
Learning to Select Bi-Aspect Information for Document-Scale Text Content ManipulationPreprint
Feng, X., Sun, Y., Qin, B., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10210 · Cited by 1
Research works printed but not linked: 6
- 10.18653/v1/D17-1209 · DOI · Paper page
- 10.5555/3524938.3525295 · doi:10.5555/3524938.3525295
- 10.5555/2145432.2145494 · doi:10.5555/2145432.2145494
- Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. In Nature. Nature Publishing Group.
- Lianhui Qin, Vered Shwartz, Peter West, Chandra Bhagavatula, Jena Hwang, Ronan Le Bras, Antoine Bosselut, and Yejin Choi. 2020. Backpropagation-based decoding for unsupervised counterfactual and abductive reasoning. In Conference on Empirical Methods in Natural Language Processing (EMNLP).
- 10.18653/v1/W16-2209 · DOI
Cited by
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
“• SupervisedAttentionKnowing to pay attention to the important information is a key step when extracting useful information from objects such as long text sequences [75, 129], images [130, 149], or knowledge bases [23, 146]).”
BackgroundLiu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352
“• SupervisedAttentionKnowing to pay attention to the important information is a key step when extracting useful information from objects such as long text sequences [75, 129], images [130, 149], or knowledge bases [23, 146]).”
BackgroundYang, L., Chen, H., Li, Z., Ding, X., & Wu, X. (2023) · arXiv · doi:10.48550/arxiv.2306.11489 · Cited by 239
Self-citationYang, L., Chen, H., Li, Z., Ding, X., & Wu, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3360454 · Cited by 238
“In contrast, KGs offer a structured summary and emphasize the correlation of relevant concepts when complex events involving the same entity extend across multiple sentences [60], thus enhancing the process of structured text generation.”
BackgroundSelf-citationA Survey of Knowledge Enhanced Pre-Trained Language Models
Hu, L., Liu, Z., Zhao, Z., Hou, L., Nie, L., & Li, J. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3310002 · Cited by 196
Metadata
- Authors
- Yu, W., Zhu, C., Li, Z., Hu, Z., Wang, Q., Ji, H., & Jiang, M.
- Affiliations
- University of Notre Dame (US)
- Microsoft (United States) (US)
- Chinese University of Hong Kong (HK)
- University of California San Diego (US)
- University of Illinois Urbana-Champaign (US)
- Venue
- ACM Computing Surveys
- Published
- 2022-01-31
- Volume
- 54
- Issue
- 11s
- Pages
- 1-38
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3092288641
- Cited by
- 257
- References
- 241
- Citations by year
- 2026: 27 · 2025: 54 · 2024: 63 · 2023: 67 · 2022: 26
- FWCI
- 17.28
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (IIS-1849816, CCF-1901059, and IIS-2119531)
- Agriculture and Food Research Initiative (2020-67021-32799)
- USDA National Institute of Food and Agriculture, U.S. (HR001120C0123, FA8750-18-2-0014, and FA8750-19-2-1004)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- text-to-text generation, knowledge base integration, knowledge graphs, external knowledge, encoder-decoder architecture, internal knowledge
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.