KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction
Open accessThe DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index.
Abstract
Recently, prompt-tuning has achieved promising results for specific few-shot classification tasks. The core idea of prompt-tuning is to insert text pieces (i.e., templates) into the input and transform a classification task into a masked language modeling problem. However, for relation extraction, determining an appropriate prompt template requires domain expertise, and it is cumbersome and time-consuming to obtain a suitable label word. Furthermore, there exists abundant semantic and prior knowledge among the relation labels that cannot be ignored. To this end, we focus on incorporating knowledge among relation labels into prompt-tuning for relation extraction and propose a Knowledge-aware Prompt-tuning approach with synergistic optimization (KnowPrompt). Specifically, we inject latent knowledge contained in relation labels into prompt construction with learnable virtual type words and answer words. Then, we synergistically optimize their representation with structured constraints. Extensive experimental results on five datasets with standard and low-resource settings demonstrate the effectiveness of our approach. Our code and datasets are available in GitHub1 for reproducibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816 · cited 1×
“More recently, pretrained language models (PLMs) (Devlin et al. 2019; Liu et al. 2019; Radford et al. 2018; Lewis et al. 2020) and so on have shown their exceptional success when adapted to language understanding and generation via finetuning, including RE.”
BackgroundLiu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361 · cited 2×
“In a nutshell, prompt-tuning involves template engineering and verbalizer engineering, which aims to search for the best template and an answer space [35].”
BackgroundLiu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352 · cited 2×
“In a nutshell, prompt-tuning involves template engineering and verbalizer engineering, which aims to search for the best template and an answer space [35].”
BackgroundThe Power of Scale for Parameter-Efficient Prompt Tuning
Lester, B., Al-Rfou, R., & Constant, N. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.243 · Cited by 3,096
The Power of Scale for Parameter-Efficient Prompt Tuning
Lester, B., Al-Rfou, R., & Constant, N. (2021) · arXiv · doi:10.48550/arxiv.2104.08691 · Cited by 3,092
Prefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473
Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification
Zhou, P., Shi, W., Tian, J., Qi, Z., Li, B., Hao, H., & Xu, B. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2034 · Cited by 2,012
Research works printed but not linked: 4
- [7] Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Proceedings of NeurIPS 2020 . -
- [8] Mary Elaine Califf and Raymond J. Mooney. 1999. Relational Learning of PatternMatch Rules for Information Extraction. In Proceedings of AAAI . AAAI Press / The MIT Press, 328-334. -
- [39] Meng Qu, Tianyu Gao, Louis-Pascal A. C. Xhonneux, and Jian Tang. 2020. Fewshot Relation Extraction via Bayesian Meta-learning on Relation Graphs. In Proceedings of ICML 2020 . -
- [63] Yuhao Zhang, Victor Zhong, Danqi Chen, Gabor Angeli, and Christopher D Manning. 2017. Position-aware attention and supervised data improve slot filling. In Proceedings of EMNLP . 35-45. https://nlp.stanford.edu/pubs/zhang2017tacred. pdf - · DOI · Paper page
Cited by
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
“Existing works [13] make a step by making prompts with additional marks to encode lexical information, such as entity markings.”
BackgroundMethodInfluentialLiu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2024) · AI Open · doi:10.1016/j.aiopen.2023.08.012 · Cited by 596
Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey
Min, B., Ross, H., Sulem, E., Veyseh, A. P. B., Nguyen, T. H., Sainz, O., Agirre, E., Heintz, I., & Roth, D. (2024) · ACM Computing Surveys · doi:10.1145/3605943 · Cited by 1,387
“[17], instead of using rules, constructed the prompts by leveraging learnable virtual template words and virtual answer words.”
BackgroundLiu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021) · arXiv · doi:10.48550/arxiv.2103.10385 · Cited by 908
P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks
Liu, X., Ji, K., Fu, Y., Tam, W., Du, Z., Yang, Z., & Tang, J. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/2022.acl-short.8 · Cited by 810
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks
Liu, X., Ji, K., Fu, Y., Tam, W. L., Du, Z., Yang, Z., & Tang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07602 · Cited by 254
PTR: Prompt Tuning with Rules for Text Classification
Han, X., Zhao, W., Ding, N., Liu, Z., & Sun, M. (2022) · AI Open · doi:10.1016/j.aiopen.2022.11.003 · Cited by 467
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352
“Existing works [13] make a step by making prompts with additional marks to encode lexical information, such as entity markings.”
BackgroundMethodInfluentialPTR: Prompt Tuning with Rules for Text Classification
Han, X., Zhao, W., Ding, N., Liu, Z., & Sun, M. (2021) · arXiv · doi:10.48550/arxiv.2105.11259 · Cited by 478
Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification
Hu, S., Ding, N., Wang, H., Liu, Z., Wang, J., Li, J., Wu, W., & Sun, M. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.158 · Cited by 265
A Comprehensive Study of Knowledge Editing for Large Language ModelsPreprint
Zhang, N., Yao, Y., Tian, B., Wang, P., Deng, S., Wang, M., Xi, Z., Mao, S., Zhang, J., Ni, Y., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.01286 · Cited by 411
Self-citationLLMs for knowledge graph construction and reasoning: recent capabilities and future opportunities
Zhu, Y., Wang, X., Chen, J., Qiao, S., Ou, Y., Yao, Y., Deng, S., Chen, H., & Zhang, N. (2024) · World Wide Web · doi:10.1007/s11280-024-01297-w · Cited by 294
“Typically, KG construction (Ye et al., 2022b) consists of several tasks, including Named Entity Recognition (NER) (Chiu and Nichols, 2016), Relation Extraction (RE) (Zeng et al., 2015; Chen et al., 2022), Event Extraction (EE) (Chen et al., 2015; Deng et al., 2020), and Entity Linking (EL) (Shen et…”
Self-citationA systematic survey of prompt engineering on vision-language foundation models
Gu, J., Han, Z., Chen, S., Beirami, A., He, B., Zhang, G., Liao, R., Qin, Y., Tresp, V., & Torr, P. (2023) · arXiv · doi:10.48550/arxiv.2307.12980 · Cited by 280
Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completion
Chen, X., Zhang, N., Li, L., Deng, S., Tan, C., Xu, C., Huang, F., Si, L., & Chen, H. (2022) · Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3477495.3531992 · Cited by 226
Self-citationA Survey of Knowledge Enhanced Pre-Trained Language Models
Hu, L., Liu, Z., Zhao, Z., Hou, L., Nie, L., & Li, J. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3310002 · Cited by 196
Information Retrieval: Recent Advances and Beyond
Hambarde, K., & Proença, H. P. M. C. (2023) · IEEE Access · doi:10.1109/access.2023.3295776 · Cited by 285
Large Language Models and Knowledge Graphs: Opportunities and Challenges
Pan, J. Z., Razniewski, S., Kalo, J.-C., Singhania, S., Chen, J., Dietze, S., Jabeen, H., Omeliyanenko, J., Zhang, W. C., Lissandrini, M., et al. (2023) · UvA-DARE (University of Amsterdam) · doi:10.4230/tgdk.1.1.2 · Cited by 74
Zhou, B., Li, X., Liu, T., Xu, K., Liu, W., & Bao, J. (2024) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.102333 · Cited by 169
Prompting Is All You Need: Automated Android Bug Replay with Large Language Models
Feng, S., & Chen, C. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3608137 · Cited by 176
Liu, Z., Chen, C., Wang, J., Chen, M., Wu, B., Che, X., Wang, D., & Wang, Q. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3639180 · Cited by 125
A comprehensive survey on relation extraction: recent advances and new frontiers
Zhao, X., Deng, Y., Yang, M., Wang, L., Zhang, R., Cheng, H., Lam, W., Shen, Y., & Xu, R. (2024) · ACM Computing Surveys · doi:10.1145/3674501 · Cited by 168
“Pipeline-based RE methods [12, 24, 180] often assume that the target entities are already identified, and the RE models merely need to predict the relations between any pair of entities.”
InfluentialConstruction of Knowledge Graphs: Current State and Challenges
Hofer, M., Obraczka, D., Saeedi, A., Köpcke, H., & Rahm, E. (2024) · Information · doi:10.3390/info15080509 · Cited by 215
Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners
Zhang, N., Li, L., Chen, X., Deng, S., Bi, Z., Tan, C., Huang, F., & Chen, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.13161 · Cited by 74
Self-citationChen, X., Zhang, N., Li, L., Yao, Y., Deng, S., Tan, C., Huang, F., Si, L., & Chen, H. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.121 · Cited by 191
Self-citationFill in the Blank: Context-aware Automated Text Input Generation for Mobile GUI Testing
Liu, Z., Chen, C., Wang, J., Che, X., Huang, Y., Hu, J., & Wang, Q. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00119 · Cited by 122
Large Language Model Instruction Following: A Survey of Progresses and Challenges
Lou, R., Zhang, K., & Yin, W. (2024) · Computational Linguistics · doi:10.1162/coli_a_00523 · Cited by 198
Wu, S., Fei, H., Cao, Y., Bing, L., & Chua, T. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.823 · Cited by 148
Zhang, Q., Xu, C., Li, J., Sun, Y., Bao, J., & Zhang, D. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125861 · Cited by 123
Generative Knowledge Graph Construction: A Review
Ye, H., Zhang, N., Chen, H., & Chen, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.1 · Cited by 146
Self-citationFew-Shot Bot: Prompt-Based Learning for Dialogue SystemsPreprint
Madotto, A., Lin, Z., Winata, G. I., & Fung, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08118 · Cited by 114
SentiPrompt: Sentiment Knowledge Enhanced Prompt-Tuning for Aspect-Based Sentiment AnalysisPreprint
Li, C., Gao, F., Bu, J., Xu, L., Chen, X., Gu, Y., Shao, Z., Zheng, Q., Zhang, N., Wang, Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08306 · Cited by 106
Self-citationExploring Task Difficulty for Few-Shot Relation Extraction
Han, J., Cheng, B. H., & Lu, W. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.204 · Cited by 116
Fake news detection via knowledgeable prompt learning
Jiang, G., Liu, S., Zhao, Y., Sun, Y., & Zhang, M. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103029 · Cited by 95
UniRel: Unified Representation and Interaction for Joint Relational Triple Extraction
Tang, W., Xu, B., Zhao, Y., Mao, Z., Liu, Y., Liao, Y., & Xie, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.477 · Cited by 108
Augmenting Low-Resource Text Classification with Graph-Grounded Pre-training and Prompting
Wen, Z., & Fang, Y. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591641 · Cited by 140
Ontology-enhanced Prompt-tuning for Few-shot Learning
Ye, H., Zhang, N., Deng, S., Chen, X., Chen, H., Xiong, F., Chen, X., & Chen, H. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3511921 · Cited by 117
Self-citationHPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classification
Wang, Z., Wang, P., Liu, T., Lin, B., Cao, Y., Sui, Z., & Wang, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.246 · Cited by 103
AliCG: Fine-grained and Evolvable Conceptual Graph Construction for Semantic Search at Alibaba
Zhang, N., Jia, Q., Deng, S., Chen, X., Ye, H., Chen, H., Tou, H., Huang, G., Wang, Z., Hua, N., et al. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467057 · Cited by 68
Self-citationVirtual prompt pre-training for prototype-based few-shot relation extraction
He, K., Huang, Y., Mao, R., Gong, T., Li, C., & Cambria, E. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118927 · Cited by 72
Caruccio, L., Cirillo, S., Polese, G., Solimando, G., Sundaramurthy, S., & Tortora, G. (2024) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2024.200336 · Cited by 107
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population
Zhang, N., Xu, X., Tao, L., Yu, H., Ye, H., Qiao, S., Xie, X. Y., Chen, X., Li, Z., & Li, L. (2022) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2022.emnlp-demos.10 · Cited by 76
Self-citationEfficient utilization of pre-trained models: A review of sentiment analysis via prompt learning
Bu, K., Liu, Y., & Ju, X. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111148 · Cited by 73
KEPT: Knowledge Enhanced Prompt Tuning for event causality identification
Liu, J., Zhang, Z., Guo, Z. M., Jin, L., Li, X., Wei, K., & Sun, X. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110064 · Cited by 81
Re4: Learning to Re-contrast, Re-attend, Re-construct for Multi-interest Recommendation
Zhang, S., Yang, L., Yao, D., Lu, Y., Feng, F., Zhao, Z., Chua, T., & Wu, F. Q. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512094 · Cited by 93
Towards Open-Vocabulary Scene Graph Generation with Prompt-Based Finetuning
He, T., Gao, L., Song, J., & Li, Y.-F. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19815-1_4 · Cited by 97
Large Knowledge Model: Perspectives and Challenges
Chen, H. (2024) · Data Intelligence · doi:10.3724/2096-7004.di.2024.0001 · Cited by 111
Self-citationPrompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning
Zhang, R., Yu, Y., Shetty, P., Song, L., & Zhang, C. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.55 · Cited by 67
Knowledge-Aware Prompt Tuning for Generalizable Vision-Language Models
Kan, B., Wang, T., Lü, W., Zhen, X., Guan, W., & Zheng, F. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01436 · Cited by 86
Summarization as Indirect Supervision for Relation Extraction
Lu, K., Hsu, I.-H., Zhou, W., Ma, M. D., & Chen, M. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.490 · Cited by 70
PromptRank: Unsupervised Keyphrase Extraction Using Prompt
Kong, A., Zhao, S., Chen, H., Li, Q., Qin, Y., Sun, R., & Bai, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.545 · Cited by 45
Self-citationPrompt-Based Meta-Learning For Few-shot Text Classification
Zhang, H., Zhang, X., Huang, H., & Yu, L. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.87 · Cited by 72
MINES: Message Intercommunication for Inductive Relation Reasoning over Neighbor-Enhanced Subgraphs
Liang, K., Meng, L., Zhou, S., Tu, W., Wang, S., Liu, Y., Liu, M., Zhao, L., Dong, X., & Liu, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i9.28935 · Cited by 65
From Misuse to Mastery: Enhancing Code Generation with Knowledge-Driven AI Chaining
Ren, X., Ye, X., Zhao, D., Xing, Z., & Yang, X. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00143 · Cited by 66
GAP: A novel Generative context-Aware Prompt-tuning method for relation extraction
Chen, Z., Li, Z., Zeng, Y., Zhang, C., & Ma, H. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123478 · Cited by 52
Towards Unified Prompt Tuning for Few-shot Text Classification
Wang, J., Wang, C., Luo, F., Tan, C., Qiu, M., Yang, F., Shi, Q., Huang, S., & Gao, M. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.37 · Cited by 58
Self-citationAutomatic Construction of Educational Knowledge Graphs: A Word Embedding-Based Approach
Ain, Q. U., Chatti, M. A., Bakar, K. G. C., Joarder, S., & Alatrash, R. (2023) · Information · doi:10.3390/info14100526 · Cited by 44
CrashTranslator: Automatically Reproducing Mobile Application Crashes Directly from Stack Trace
Huang, Y., Wang, J., Liu, Z., Wang, Y., Wang, S., Chen, C., Hu, Y., & Wang, Q. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3623298 · Cited by 57
Wang, Y., Chen, M., Zhou, W., Cai, Y., Liang, Y., Liu, D., Yang, B., Liu, J., & Hooi, B. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.224 · Cited by 63
Fooling MOSS Detection with Pretrained Language Models
Biderman, S., & Raff, E. (2022) · Proceedings of the 31st ACM International Conference on Information & Knowledge Management · doi:10.1145/3511808.3557079 · Cited by 37
SoVAR: Build Generalizable Scenarios from Accident Reports for Autonomous Driving Testing
Guo, A., Zhou, Y. H., Tian, H., Fang, C., Sun, Y., Sun, W., Gao, X., Tuan, L. A., Liu, Y., & Chen, Z. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695037 · Cited by 37
PAED: Zero-Shot Persona Attribute Extraction in Dialogues
Zhu, L., Li, W., Mao, R., Pandelea, V., & Cambria, E. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.544 · Cited by 52
Prompt Tuning in Biomedical Relation Extraction
He, J., Li, F., Li, J., Hu, X., Nian, Y., Xiang, Y., Wang, J., Wei, Q., Li, Y., Xu, H., et al. (2024) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-024-00162-9 · Cited by 42
Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuning
Chen, X., Li, L., Zhang, N., Tan, C., Huang, F., Si, L., & Chen, H. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531746 · Cited by 50
Self-citationReasoning Through Memorization: Nearest Neighbor Knowledge Graph Embeddings
Wang, P., Xie, X. Y., Wang, X., & Zhang, N. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-44693-1_9 · Cited by 41
Self-citationWhy Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning
Wei, C., Xie, S. M., & Ma, T. (2021) · arXiv · doi:10.48550/arxiv.2106.09226 · Cited by 32
Liang, K., Meng, L., Liu, Y., Liu, M., Wei, W., Liu, S., Tu, W., Wang, S., Zhou, S., & Liu, X. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681112 · Cited by 56
UniSAr: a unified structure-aware autoregressive language model for text-to-SQL semantic parsing
Dou, L., Gao, Y., Pan, M., Wang, D., Che, W., Lou, J., & Zhan, D. (2023) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-023-01898-3 · Cited by 39
LogicSolver: Towards Interpretable Math Word Problem Solving with Logical Prompt-enhanced Learning
Yang, Z., Qin, J., Chen, J., Lin, L., & Liang, X. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.1 · Cited by 33
Prompt-and-Align: Prompt-Based Social Alignment for Few-Shot Fake News Detection
Wu, J., Li, S., Deng, A., Xiong, M., & Hooi, B. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3615015 · Cited by 49
Editing Language Model-Based Knowledge Graph Embeddings
Cheng, S., Zhang, N., Tian, B., Chen, X., Liu, Q., & Chen, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29737 · Cited by 55
Self-citationMultitask Instruction-based Prompting for Fallacy Recognition
Alhindi, T., Chakrabarty, T., Musi, E., & Muresan, S. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.560 · Cited by 58
When Do Program-of-Thought Works for Reasoning?
Bi, Z., Zhang, N., Jiang, Y., Deng, S., Zheng, G., & Chen, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29721 · Cited by 57
Self-citationGenerative Prompt Tuning for Relation Classification
Han, J., Zhao, S., Cheng, B. H., Ma, S., & Lü, W. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.231 · Cited by 44
Schema-aware Reference as Prompt Improves Data-Efficient Knowledge Graph Construction
Yao, Y., Mao, S., Zhang, N., Chen, X., Deng, S., Chen, X., & Chen, H. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591763 · Cited by 39
Self-citationBi-Directional Iterative Prompt-Tuning for Event Argument Extraction
Dai, L., Wang, B., Xiang, W., & Mo, Y. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.419 · Cited by 34
Prompt-Based Prototypical Framework for Continual Relation Extraction
Zhang, H., Liang, B., Yang, M., Wang, H., & Xu, R. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3199655 · Cited by 35
Hierarchical Verbalizer for Few-Shot Hierarchical Text Classification
Ji, K., Lian, Y., Gao, J., & Wang, B. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.164 · Cited by 46
Adaptive class augmented prototype network for few-shot relation extraction
Li, R., Zhong, J., Hu, W., Dai, Q., Wang, C., Wang, W., & Li, X. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.10.025 · Cited by 32
Short text classification with Soft Knowledgeable Prompt-tuning
Zhu, Y. Q., Wang, Y., Mu, J., Li, Y., Qiang, J., Yuan, Y., & Wu, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123248 · Cited by 34
LightNER: A Lightweight Generative Framework with Prompt-guided Attention for Low-resource NERPreprint
Chen, X., Zhang, N., Li, L., Xie, X. Y., Deng, S., Tan, C., Huang, F., Si, L., & Chen, H. (2021) · arXiv (Cornell University) · Cited by 36
Self-citationCombining prompt learning with contextual semantics for inductive relation prediction
Xie, S., Pan, Q., Wang, X., Luo, X., & Sugumaran, V. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121669 · Cited by 26
Tele-Knowledge Pre-training for Fault Analysis
Chen, Z., Wen, Z., Huang, Y., Chen, M., Geng, Y., Yu, H., Bi, Z., Zhang, Y., Yao, Z., Song, W., et al. (2023) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde55515.2023.00265 · Cited by 44
Self-citationChinese legal judgment prediction via knowledgeable prompt learning
Sun, J., Huang, S., & Wei, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122177 · Cited by 36
Information Extraction in Low-Resource Scenarios: Survey and Perspective
Deng, S., Ma, Y., Zhang, N., Cao, Y., & Hooi, B. (2024) · IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg63256.2024.00013 · Cited by 34
Self-citationPre-training Methods in Information RetrievalPreprint
Fan, Y., Xie, X., Cai, Y., Chen, J., Ma, X., Li, X., Zhang, R., & Guo, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.13853 · Cited by 34
Self-citationTKDP: Threefold Knowledge-Enriched Deep Prompt Tuning for Few-Shot Named Entity Recognition
Liu, J., Fei, H., Li, F., Li, J., Li, B., Zhao, L., Teng, C., & Ji, D. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3389650 · Cited by 29
Consistent Prototype Learning for Few-Shot Continual Relation Extraction
Chen, X., Wu, H. X., & Shi, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.409 · Cited by 51
Self-citationHierarchical Text Classification Optimization via Structural Entropy and Singular Smoothing
Liu, Q., Peng, H., Huang, X., Hao, Z., Sun, Q., Yu, Z., & Yu, P. S. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3579810 · Cited by 28
One Model for All Domains: Collaborative Domain-Prefix Tuning for Cross-Domain NER
Chen, X., Li, L., Qiao, S., Zhang, N., Tan, C., Jiang, Y., Huang, F., & Chen, H. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/559 · Cited by 35
Self-citationPSAN: Prompt Semantic Augmented Network for aspect-based sentiment analysis
He, Y., Huang, X., Zou, S., & Zhang, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121632 · Cited by 24
Multilingual Relation Classification via Efficient and Effective Prompting
Chen, Y., Harbecke, D., & Hennig, L. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.69 · Cited by 24
Zhang, Y., Jiang, M., Meng, Y., Zhang, Y., & Han, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.780 · Cited by 30
Out-of-Distribution Generalization in Natural Language Processing: Past, Present, and Future
Yang, L., Song, Y., Ren, X., Lyu, C., Wang, Y., Zhuo, J., Liu, L., Wang, J., Foster, J., & Zhang, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.276 · Cited by 54
LambdaKG: A Library for Pre-trained Language Model-Based Knowledge Graph Embeddings
Xie, X., Li, Z., Wang, X., Xi, Z., & Zhang, N. (2023) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2023.ijcnlp-demo.4 · Cited by 28
Self-citationMariotti, L., Guidetti, V., Mandreoli, F., Belli, A., & Lombardi, P. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1460065 · Cited by 26
FedEAN: Entity-Aware Adversarial Negative Sampling for Federated Knowledge Graph Reasoning
Meng, L., Liang, K., Yu, H., Liu, Y., Zhou, S., Liu, M., & Liu, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3464516 · Cited by 29
Prompt Tuning on Graph-Augmented Low-Resource Text Classification
Wen, Z., & Fang, Y. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3440068 · Cited by 27
Complete feature learning and consistent relation modeling for few-shot knowledge graph completion
Liu, J., Fan, C., Zhou, F., & Xu, H. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121725 · Cited by 19
Metadata
- Authors
- Chen, X., Zhang, N., Xie, X., Deng, S., Yao, Y., Tan, C., Huang, F., Si, L., & Chen, H.
- Affiliations
- Zhejiang University (CN)
- Alibaba Group (China) (CN)
- ORCID
- Venue
- Proceedings of the ACM Web Conference 2022
- Publisher
- ACM
- Published
- 2022-04-25
- Pages
- 2778-2788
- OpenAlex
- W3194836374
- Cited by
- 389
- References
- 82
- Citations by year
- 2026: 32 · 2025: 73 · 2024: 110 · 2023: 108 · 2022: 58
- FWCI
- 48.25
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- International World Wide Web Conference (WWW) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- NSFC (91846204, U19B2027)
- National Key R&D Program of China (SQ2018YFC000004)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- relation extraction, prompt tuning, synergistic optimization, masked language modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.