KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction
Open accessThe DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index.
Abstract
Recently, prompt-tuning has achieved promising results for specific few-shot classification tasks. The core idea of prompt-tuning is to insert text pieces (i.e., templates) into the input and transform a classification task into a masked language modeling problem. However, for relation extraction, determining an appropriate prompt template requires domain expertise, and it is cumbersome and time-consuming to obtain a suitable label word. Furthermore, there exists abundant semantic and prior knowledge among the relation labels that cannot be ignored. To this end, we focus on incorporating knowledge among relation labels into prompt-tuning for relation extraction and propose a Knowledge-aware Prompt-tuning approach with synergistic optimization (KnowPrompt). Specifically, we inject latent knowledge contained in relation labels into prompt construction with learnable virtual type words and answer words. Then, we synergistically optimize their representation with structured constraints. Extensive experimental results on five datasets with standard and low-resource settings demonstrate the effectiveness of our approach. Our code and datasets are available in GitHub1 for reproducibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816 · cited 1×
“More recently, pretrained language models (PLMs) (Devlin et al. 2019; Liu et al. 2019; Radford et al. 2018; Lewis et al. 2020) and so on have shown their exceptional success when adapted to language understanding and generation via finetuning, including RE.”
BackgroundLiu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361 · cited 2×
“In a nutshell, prompt-tuning involves template engineering and verbalizer engineering, which aims to search for the best template and an answer space [35].”
BackgroundLiu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352 · cited 2×
“In a nutshell, prompt-tuning involves template engineering and verbalizer engineering, which aims to search for the best template and an answer space [35].”
BackgroundThe Power of Scale for Parameter-Efficient Prompt Tuning
Lester, B., Al-Rfou, R., & Constant, N. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.243 · Cited by 3,096
The Power of Scale for Parameter-Efficient Prompt Tuning
Lester, B., Al-Rfou, R., & Constant, N. (2021) · arXiv · doi:10.48550/arxiv.2104.08691 · Cited by 3,092
Prefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473
Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification
Zhou, P., Shi, W., Tian, J., Qi, Z., Li, B., Hao, H., & Xu, B. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2034 · Cited by 2,012
Research works printed but not linked: 4
- [7] Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Proceedings of NeurIPS 2020 . -
- [8] Mary Elaine Califf and Raymond J. Mooney. 1999. Relational Learning of PatternMatch Rules for Information Extraction. In Proceedings of AAAI . AAAI Press / The MIT Press, 328-334. -
- [39] Meng Qu, Tianyu Gao, Louis-Pascal A. C. Xhonneux, and Jian Tang. 2020. Fewshot Relation Extraction via Bayesian Meta-learning on Relation Graphs. In Proceedings of ICML 2020 . -
- [63] Yuhao Zhang, Victor Zhong, Danqi Chen, Gabor Angeli, and Christopher D Manning. 2017. Position-aware attention and supervised data improve slot filling. In Proceedings of EMNLP . 35-45. https://nlp.stanford.edu/pubs/zhang2017tacred. pdf - · DOI · Paper page
Cited by
Items 401–450 of 450
Construction of 5G Knowledge Graph Based on Multidimensional Relationship Extraction
Meng, C. (2025) · International Conference on Neural Networks, Information and Communication Engineering (NNICE) · doi:10.1109/nnice64954.2025.11064724
Towards practical automatic document understanding
Ma, Y. (2025) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/201841
Prototype-Enhanced Few-Shot Relation Extraction Method Based on Cluster Loss Optimization
Qian, S., Fu, B., Liu, C., Song-he, J., Sun, T. H., Chen, Z., Li, D., Sun, Y., Chen, Y., & Li, Y. (2025) · Symmetry · doi:10.3390/sym17101673
Knowledge-Aware Prompt-Tuning for Integrated Conversational Recommender System
Yang, X.-H., Liu, M.-W., Luo, H., Zhou, S.-X., Ma, G., & Jiang, P. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2025.3608280
Chenguang, W. A. N. G., Ying, W. A. N. G., Yunwei, W. E. N., Zhang, F., Tian, Y., Wang, H., & Zhang, G. (2025) · Scientia Sinica Informationis · doi:10.1360/ssi-2024-0224
Gaussian-Augmented Prototypical Network for Class-Incremental Few-Shot Relation Classification
Hu, C., Hu, Y., Zhao, Y., Wu, T., Zhang, M., Liu, C., & Hu, Y. (2025) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3774420
DMCP: A Novel Debiasing Method Based on Contrastive Learning and Prompt Learning
Liang, H., He, J., Lin, J., Lin, N., Zhou, D. M., & Yang, A. (2025) · IEEE International Conference on Big Data Analytics (ICBDA) · doi:10.1109/icbda65366.2025.11211018
Soft Prompt-Tuning for Personalized News Recommendation
Yuan, X., Geng, Y., Zhu, Y. Q., Zhao, Z., & Zhang, R. (2025) · The European Journal on Artificial Intelligence · doi:10.1177/30504554251388589
Interventional Prompt-Tuning for Relation Extraction
Wang, Y., Guo, Z., Wen, L., Chen, Y., Wang, Z., & Zhao, W. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227655
Non-Salient Visual Content Grounding for Multimodal Relation ExtractionPreprint
Zhang, Z., Li, Y., Zhang, W., & Bai, T. (2025) · Research Square · doi:10.21203/rs.3.rs-7395065/v1
Few-Shot and Zero-Shot Learning for Information Extraction
Gong, J. (2024) · VTechWorks (Virginia Tech) · Cited by 1
Retrieval-Augmented Prompt Learning for Pre-Trained Foundation Models
Chen, X., Ou, Y., Feng, Q., Li, L., Li, P., Ye, H., Huang, S.-J., Qiao, S., Deng, S., Chen, H., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3608936 · Cited by 3
Self-citationPrompt-Contrastive Learning for Zero-Shot Relation Extraction
Zhong, X., Zhao, L., Peng, L., Yang, G., Hu, K., & Wu, W. (2026) · Entropy · doi:10.3390/e28010069
Hierarchical Aware Relation Extraction Based on Prompt-Tuning
Wen, X., Huo, Y., Shi, J., Su, M., Zhao, J., Li, W., Zuo, J., & Lu, Y. (2025) · IEEE International Conference on Data Science in Cyberspace · doi:10.1109/dsc67331.2025.00052
Document-Level Relation Extraction from Macro-Micro Perspective
Wen, X., Huo, Y., Shi, J., Su, M., Zhao, J., Li, W., Zuo, J., & Lu, Y. (2025) · IEEE International Conference on Data Science in Cyberspace · doi:10.1109/dsc67331.2025.00017
EduRiskX: A Neuro-Symbolic Framework with F-Logic Reasoning for Early Academic Risk PredictionPreprint
Fu, Y., Kang, Y., Bie, R., & Zhao, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-8877832/v1
Xu, W., Wang, H., & Wang, M. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-025-00463-y
Suo, J., Fang, J., Wang, H., & Xiao, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-8872718/v1
Dynamic, Efficient, and Generalizable Multi-Agent Communication for Large Language Models
Wang, S., & Li, J. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00306 · Cited by 1
Construction of a Knowledge Graph for Cardiovascular Diseases
Huang, J., Jiao, W., Fang, Y., & Dong, X. (2025) · International Symposium on Artificial Intelligence and Big Data (AIBDF) · doi:10.1109/aibdf67964.2025.11440906
Zhang, N., Li, K., Liu, P., Zhang, X., Yuan, C., & Bo, J. (2025) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc68654.2025.11437722
Self-citationSemi-Automated Knowledge Engineering and Process Mapping for Total Airport Management
Teo, D., Sam, A., Koh, C. S. M., Nagi, R., & Ribeiro, N. A. (2026) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion67272.2026.11726539
Business relation extraction from texts
Khaldi, H. (2022) · theses.fr (ABES) · doi:10.70675/ce231ce4z5d07z4ab7z9758za927ea7b5302
Argument Mining with Customized and Feature-lnjected Large Language Models
Mushtaq, U. (2023) · theses.fr (ABES) · doi:10.70675/805e9f95z56afz4453zb477zd7f0103d5406
Querying the Web as a Knowledge Graph
Dang, M.-H. (2024) · theses.fr (ABES) · doi:10.70675/c83b9447z84aez4c92zb8d0z34e5000a56ee
Genest, P.-Y. (2024) · theses.fr (ABES) · doi:10.70675/88c65002z4b8cz466dz923bz13954d6729bf · Cited by 3
Discrete linguistic structures learning for entity relation extraction
Yang, W., Chen, Y., Huang, H., Wang, K., Qin, Y., & Huang, R. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116051
Spatial Relation Extraction Using Type Correlation and Structural Constraints
Chen, Y., Li, P., & Zhu, Q. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-0378-9_3
Biomedical Relation Extraction via Cluster-Description Co-Evolution Hierarchical RAG
Shang, Y., & Guo, Y. (2026) · International Conference on Communications, Information System and Computer Engineering (CISCE) · doi:10.1109/cisce69494.2026.11504760
Research on the Application of Large Language Models in Recommendation Systems
Yang, Y., & Li, R. (2026) · Journal of Engineering System · doi:10.62517/jes.202602113 · Cited by 1
Suo, J., Fang, J., Liu, J., Wang, M., & Xiao, Y. (2026) · Journal of Intelligent & Fuzzy Systems · doi:10.1177/18758967261457533
DSE-RE: Dynamic Schema Evolution with LLM for Iterative Relation Extraction
Wang, T., Shi, D., Aguilar, J., & Zurada, J. M. (2026) · Human-Centric Intelligent Systems · doi:10.1007/s44230-026-00158-1
CDE: A Concept-Driven Joint Extraction Method for Computer Science Textbooks
Yusufu, A., Shen, H., Zhong, X., Liu, J., Ainiwaer, A., & Yusufu, A. (2026) · Applied Sciences · doi:10.3390/app16125961
CLKSP: medical entity extraction with contrastive learning and knowledgeable soft prompt
Wang, Z., & Yu, J. (2026) · Egyptian Informatics Journal · doi:10.1016/j.eij.2026.101007
Uncertainty-Aware Cognitive Synergy Framework for Relation Extraction
Yin, L., Wu, J., & Zhang, R. (2026) · International Conference on Image, Signal Processing and Pattern Recognition (ISPP) · doi:10.1109/ispp69262.2026.11543126
Label Concreteness-Guided Diverse Data Synthesis for Low-Resource Relation Extraction
Liu, X., Hu, C., Zhang, R., Chen, J., & Xu, B. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3705560
A Regularization-Based Strategy for Balancing Cross-Template Temporal Relation Extraction
Zhang, X., Wang, Z., Zhao, C. Y., Zhu, B., Tang, M., & Wang, J. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582248
KAPT: Knowledge-Augmented Prompt-Tuning Framework for Aspect-Based Sentiment Analysis
Zhang, Z., Wang, Y., Li, B., Song, H., Wu, H., & Wang, J. (2026) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2026.3708933
Liu, Z., Yang, X., Chang, Z., Ma, H., & Wang, D. (2026) · Health Information Science and Systems · doi:10.1007/s13755-026-00462-x
Constructing knowledge graphs by Large Language Models: Methodology, practice, and challenges
Wu, J., Huang, S., Zhang, Z., Wang, Y., Wang, S., Liu, M., Su, G., & Liu, L. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116963 · Cited by 1
Few-shot continual relation extraction via anchored generative replay
Lu, A., Zhao, S., & Wu, G. (2026) · Computing · doi:10.1007/s00607-026-01742-w
Dynamic prompt scheduling and context co-optimization for domain-oriented knowledge extraction
Cong, Z., Jin, X., Huang, X., Li, T., Li, Q., Lin, J., Wang, L., Song, D., Liu, Y., Yuan, Y., et al. (2026) · JOURNAL OF SHENZHEN UNIVERSITY SCIENCE AND ENGINEERING · doi:10.3724/sp.j.1249.2026.05533
Duan, W., Zhang, R., Weng, N., Freeman, G., & McNeese, N. J. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816906
Tailoring large language models for zero-shot relation extraction
Zhou, S. (2025) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Implicit and Explicit Visual Information Aware Multimodal Relation Extraction
Zhang, Z., Zhu, K., Jiang, S., & Bai, T. (2026) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3849698
Bin, C., Yang, Y., Xin, Y., Wu, J., Zhong, T., & Zhou, F. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7607757
Prior Knowledge-Guided Prototypical Network for Few-Shot Relation Extraction
Gong, W., Zhou, Q., & Wu, Y. (2026) · International Journal of Computational Intelligence and Applications · doi:10.1142/s1469026826500665
CREDO: Evidence-Conditioned Credit Assignment for Temporal Reasoning AgentsPreprint
Leng, Y., Wen, S., Chen, X., Zeng, X., Tian, Y., & Huang, S.-J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.01643
Self-citationSecureGARD: Dynamic Ontology-Guided Governance for Secure Tool-Using LLM AgentsPreprint
Xiong, G., Wen, S., Chen, X., Zeng, X., Fan, Z., Ye, W., Cao, X., & Huang, S.-J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.06682
Self-citation
Metadata
- Authors
- Chen, X., Zhang, N., Xie, X., Deng, S., Yao, Y., Tan, C., Huang, F., Si, L., & Chen, H.
- Affiliations
- Zhejiang University (CN)
- Alibaba Group (China) (CN)
- ORCID
- Venue
- Proceedings of the ACM Web Conference 2022
- Publisher
- ACM
- Published
- 2022-04-25
- Pages
- 2778-2788
- OpenAlex
- W3194836374
- Cited by
- 389
- References
- 82
- Citations by year
- 2026: 32 · 2025: 73 · 2024: 110 · 2023: 108 · 2022: 58
- FWCI
- 48.25
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- International World Wide Web Conference (WWW) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- NSFC (91846204, U19B2027)
- National Key R&D Program of China (SQ2018YFC000004)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- relation extraction, prompt tuning, synergistic optimization, masked language modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.