KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction
Open accessThe DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index.
Abstract
Recently, prompt-tuning has achieved promising results for specific few-shot classification tasks. The core idea of prompt-tuning is to insert text pieces (i.e., templates) into the input and transform a classification task into a masked language modeling problem. However, for relation extraction, determining an appropriate prompt template requires domain expertise, and it is cumbersome and time-consuming to obtain a suitable label word. Furthermore, there exists abundant semantic and prior knowledge among the relation labels that cannot be ignored. To this end, we focus on incorporating knowledge among relation labels into prompt-tuning for relation extraction and propose a Knowledge-aware Prompt-tuning approach with synergistic optimization (KnowPrompt). Specifically, we inject latent knowledge contained in relation labels into prompt construction with learnable virtual type words and answer words. Then, we synergistically optimize their representation with structured constraints. Extensive experimental results on five datasets with standard and low-resource settings demonstrate the effectiveness of our approach. Our code and datasets are available in GitHub1 for reproducibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816 · cited 1×
“More recently, pretrained language models (PLMs) (Devlin et al. 2019; Liu et al. 2019; Radford et al. 2018; Lewis et al. 2020) and so on have shown their exceptional success when adapted to language understanding and generation via finetuning, including RE.”
BackgroundLiu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361 · cited 2×
“In a nutshell, prompt-tuning involves template engineering and verbalizer engineering, which aims to search for the best template and an answer space [35].”
BackgroundLiu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352 · cited 2×
“In a nutshell, prompt-tuning involves template engineering and verbalizer engineering, which aims to search for the best template and an answer space [35].”
BackgroundThe Power of Scale for Parameter-Efficient Prompt Tuning
Lester, B., Al-Rfou, R., & Constant, N. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.243 · Cited by 3,096
The Power of Scale for Parameter-Efficient Prompt Tuning
Lester, B., Al-Rfou, R., & Constant, N. (2021) · arXiv · doi:10.48550/arxiv.2104.08691 · Cited by 3,092
Prefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473
Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification
Zhou, P., Shi, W., Tian, J., Qi, Z., Li, B., Hao, H., & Xu, B. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2034 · Cited by 2,012
SpanBERT: Improving Pre-training by Representing and Predicting Spans
Joshi, M., Chen, D., Liu, Y., Weld, D. S., Zettlemoyer, L., & Levy, O. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00300 · Cited by 1,827
SpanBERT: Improving Pre-training by Representing and Predicting Spans
Joshi, M., Chen, D., Liu, Y., Weld, D. S., Zettlemoyer, L., & Levy, O. (2019) · arXiv · doi:10.48550/arxiv.1907.10529 · Cited by 1,827
Making Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.295 · Cited by 1,380 · cited 8×
“The typical prompt-tuning methods perform outstandingly on text classification tasks (e.g., sentiment analysis and NLI), such as LM-BFF, but they don’t involve RE application.”
BackgroundMethodInfluentialExploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference
Schick, T., & Schütze, H. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.20 · Cited by 1,305
(2019) · doi:10.18653/v1/p19-1356 · Cited by 1,291
AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts
Shin, T., Razeghi, Y., Logan IV, R. L., Wallace, E., & Singh, S. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.346 · Cited by 1,279
Distant Supervision for Relation Extraction via Piecewise Convolutional Neural Networks
Zeng, D., Liu, K., Chen, Y., & Zhao, J. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1203 · Cited by 1,149
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
Wang, A., Pruksachatkun, Y., Nangia, N., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. R. (2019) · arXiv · doi:10.48550/arxiv.1905.00537 · Cited by 1,051
Graph Convolution over Pruned Dependency Trees Improves Relation Extraction
Zhang, Y., Qi, P., & Manning, C. D. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1244 · Cited by 1,048
Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm
Reynolds, L., & McDonell, K. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3451760 · Cited by 952 · cited 1×
“With appropriate manual prompts, series of studies [6, 31, 35, 37, 40, 41] have been proposed, demonstrating the advancement of prompttuning.”
BackgroundHan, X., Zhu, H., Yu, P., Wang, Z., Yao, Y., Liu, Z., & Sun, M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1514 · Cited by 914
Self-citationLiu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021) · arXiv · doi:10.48550/arxiv.2103.10385 · Cited by 908
Position-aware Attention and Supervised Data Improve Slot Filling
Zhang, Y., Zhong, V., Chen, D., Angeli, G., & Manning, C. D. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1004 · Cited by 798
It’s Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners
Schick, T., & Schütze, H. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.185 · Cited by 747
Matching the Blanks: Distributional Similarity for Relation Learning
Baldini Soares, L., FitzGerald, N., Ling, J., & Kwiatkowski, T. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1279 · Cited by 731
Knowledge Enhanced Contextual Word Representations
Peters, M. E., Neumann, M., Logan, R., Schwartz, R., Joshi, V., Singh, S., & Smith, N. A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1005 · Cited by 661 · cited 4×
“SPANBERT [30] adopt knowledge to enhance learning objectives, KNOWBERT [38] propose to incorporate knowledge into input features, and LUKE [52] leverage knowledge to improve model architectures.”
MethodInfluentialFantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity
Lu, Y., Bartolo, M., Moore, A., Riedel, S., & Stenetorp, P. (2021) · arXiv · doi:10.48550/arxiv.2104.08786 · Cited by 615
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity
Lu, Y., Bartolo, M., Moore, A., Riedel, S., & Stenetorp, P. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.556 · Cited by 610
(2019) · doi:10.18653/v1/n19-1419 · Cited by 601
Liu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2024) · AI Open · doi:10.1016/j.aiopen.2023.08.012 · Cited by 596
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention
Yamada, I., Asai, A., Shindo, H., Takeda, H., & Matsumoto, Y. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.523 · Cited by 590
Relational Learning of Pattern-Match Rules for Information Extraction.
Califf, M. E., & Mooney, R. J. (1997) · National Conference on Artificial Intelligence · Cited by 573
What Makes Good In-Context Examples for GPT-3?
Liu, J., Shen, D., Zhang, Y., Dolan, B., Carin, L., & Chen, W. (2022) · Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures · doi:10.18653/v1/2022.deelio-1.10 · Cited by 563
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. R. (2018) · arXiv · doi:10.48550/arxiv.1804.07461 · Cited by 562
Attention Guided Graph Convolutional Networks for Relation Extraction
Guo, Z., Zhang, Y., & Lu, W. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1024 · Cited by 522
Calibrate Before Use: Improving Few-Shot Performance of Language Models
Zhao, T. Z., Wallace, E., Feng, S., Klein, D., & Singh, S. (2021) · arXiv · doi:10.48550/arxiv.2102.09690 · Cited by 513
PPT: Pre-trained Prompt Tuning for Few-shot LearningPreprint
Gu, Y.-X., Han, X., Liu, Z.-Y., & Huang, M. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2109.04332 · Cited by 507
PTR: Prompt Tuning with Rules for Text Classification
Han, X., Zhao, W., Ding, N., Liu, Z., & Sun, M. (2021) · arXiv · doi:10.48550/arxiv.2105.11259 · Cited by 478 · cited 2×
“We conducted 8-, 16-, and 32-shot experiments following LM-BFF [15, 22] to measure the average performance across five different randomly sampled data based on every experiment using a fixed set of seeds Sseed.”
BackgroundMethodPTR: Prompt Tuning with Rules for Text Classification
Han, X., Zhao, W., Ding, N., Liu, Z., & Sun, M. (2022) · AI Open · doi:10.1016/j.aiopen.2022.11.003 · Cited by 467
SemEval-2010 Task 8: Multi-Way Classification of Semantic Relations Between Pairs of Nominals
Hendrickx, I., Kim, S. N., Kozareva, Z., Nakov, P., Séaghdha, D. Ó., Padó, S., Marco Pennacchiotti, B., Romano, L., & Śzpakowicz, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.10422 · Cited by 444
Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
Dodge, J., Ilharco, G., Schwartz, R., Farhadi, A., Hajishirzi, H., & Smith, N. (2020) · arXiv · doi:10.48550/arxiv.2002.06305 · Cited by 412
Enriching Pre-trained Language Model with Entity Information for Relation Classification
Wu, S., & He, Y. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3358119 · Cited by 405
A Joint Neural Model for Information Extraction with Global Features
Lin, Y., Ji, H., Huang, F., & Wu, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.713 · Cited by 383
Self-citationHybrid Attention-Based Prototypical Networks for Noisy Few-Shot Relation Classification
Gao, T., Han, X., Liu, Z., & Sun, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016407 · Cited by 379
Reasoning with Latent Structure Refinement for Document-Level Relation Extraction
Nan, G., Guo, Z., Sekulic, I., & Lu, W. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.141 · Cited by 305
Towards a Unified View of Parameter-Efficient Transfer Learning
He, J., Zhou, C., Ma, X., Berg-Kirkpatrick, T., & Neubig, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.04366 · Cited by 268
Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification
Hu, S., Ding, N., Wang, H., Liu, Z., Wang, J., Li, J., Wu, W., & Sun, M. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.158 · Cited by 265
PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple Extraction
Zheng, H., Wen, R., Chen, X., Yang, Y., Zhang, Y., Zhang, Z., Zhang, N., Qin, B., Ming, X., & Zheng, Y. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.486 · Cited by 244
Self-citationWARP: Word-level Adversarial ReProgramming
Hambardzumyan, K., Khachatrian, H., & May, J. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.381 · Cited by 243
Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networks
Zhang, N., Deng, S., Sun, Z., Wang, G., Chen, X., Zhang, W., & Chen, H. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-1306 · Cited by 236
Self-citationRevisiting Few-sample BERT Fine-tuning
Zhang, T., Wu, F., Katiyar, A., Weinberger, K. Q., & Artzi, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05987 · Cited by 207
Learning from Context or Names? An Empirical Study on Neural Relation Extraction
Peng, H., Gao, T., Han, X., Lin, Y., Li, P., Liu, Z., Sun, M., & Zhou, J. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.298 · Cited by 185
Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification
Schick, T., Schmid, H., & Schütze, H. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.488 · Cited by 184
Document-level Relation Extraction as Semantic Segmentation
Zhang, N., Chen, X., Xie, X., Deng, S., Tan, C., Chen, M., Huang, F., Si, L., & Chen, H. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/551 · Cited by 181
Self-citationHow many data points is a prompt worth?
Le Scao, T., & Rush, A. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.208 · Cited by 179
Prompt-Learning for Fine-Grained Entity TypingPreprint
Ding, N., Chen, Y., Han, X., Xu, G., Wang, X.-B., Xie, P.-J., Zheng, H.-T., Liu, Z.-Y., Li, J.-Z., & Kim, H.-G. (2021) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2108.10604 · Cited by 179
Contrastive Triple Extraction with Generative Transformer
Ye, H., Zhang, N., Deng, S., Chen, M., Tan, C., Huang, F., & Chen, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17677 · Cited by 168
Self-citationKnowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text ClassificationPreprint
Hu, S., Ding, N., Wang, H., Liu, Z., Wang, J., Li, J., Wu, W., & Sun, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.02035 · Cited by 168
Dialogue-Based Relation Extraction
Yu, D., Sun, K., Cardie, C., & Yu, D. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.444 · Cited by 160
Contrastive Triple Extraction with Generative TransformerPreprint
Ye, H.-B., Zhang, N., Deng, S.-M., Chen, M.-S., Tan, C.-Q., Huang, F., & Chen, H. (2020) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2009.06207 · Cited by 152
Self-citationLearning information extraction patterns from examples
Huffman, S. B. (1996) · Lecture notes in computer science · doi:10.1007/3-540-60925-3_51 · Cited by 149
OpenNRE: An Open and Extensible Toolkit for Neural Relation Extraction
Han, X., Gao, T., Yao, Y., Ye, D., Liu, Z., & Sun, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP): System Demonstrations · doi:10.18653/v1/d19-3029 · Cited by 139
Self-citationPrompt-learning for Fine-grained Entity Typing
Ding, N., Chen, Y., Han, X., Xu, G., Wang, X., Xie, P., Zheng, H., Liu, Z., Li, J., & Kim, H.-G. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.512 · Cited by 133
TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task
Alt, C., Gabryszak, A., & Hennig, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.142 · Cited by 132
Neural Relation Extraction for Knowledge Base Enrichment
Trisedya, B. D., Weikum, G., Qi, J., & Zhang, R. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1023 · Cited by 128
Making Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2020) · arXiv · doi:10.48550/arxiv.2012.15723 · Cited by 124
Attention-Based Capsule Networks with Dynamic Routing for Relation Extraction
Zhang, N., Deng, S., Sun, Z., Chen, X., Zhang, W., & Chen, H. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1120 · Cited by 123
Self-citationGDPNet: Refining Latent Multi-View Graph for Relation Extraction
Xue, F., Sun, A., Zhang, H., & Chng, E. S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17670 · Cited by 106
RECON: Relation Extraction using Knowledge Graph Context in a Graph Neural Network
Bastos, A., Nadgeri, A., Singh, K., Mulang', I., Shekarpour, S., Hoffart, J., & Kaul, M. (2020) · The Web Conference · doi:10.1145/3442381.3449917 · Cited by 98
Language Models as Knowledge Bases?
Petroni, F., Rocktäschel, T., Lewis, P., Bakhtin, A., Wu, Y., Miller, A., & Riedel, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.01066 · Cited by 94
Curriculum-Meta Learning for Order-Robust Continual Relation Extraction
Wu, T., Li, X., Li, Y.-F., Haffari, G., Qi, G., Zhu, Y., & Xu, G. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17241 · Cited by 93
Prototypical Representation Learning for Relation ExtractionPreprint
Ding, N., Wang, X., Fu, Y., Xu, G., Wang, R., Xie, P., Shen, Y., Huang, F., Zheng, H.-T., & Zhang, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11647 · Cited by 76
Self-citationAliCG: Fine-grained and Evolvable Conceptual Graph Construction for Semantic Search at Alibaba
Zhang, N., Jia, Q., Deng, S., Chen, X., Ye, H., Chen, H., Tou, H., Huang, G., Wang, Z., Hua, N., et al. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467057 · Cited by 68
Self-citationA Trigger-Sense Memory Flow Framework for Joint Entity and Relation Extraction
Shen, Y., Ma, X., Tang, Y., & Lu, W. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449895 · Cited by 67
How Many Data Points is a Prompt Worth?Preprint
Scao, T. L., & Rush, A. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.08493 · Cited by 67
Neural Snowball for Few-Shot Relation Learning
Gao, T., Han, X., Xie, R., Liu, Z., Lin, F., Lin, L., & Sun, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6281 · Cited by 63
NERO: A Neural Rule Grounding Framework for Label-Efficient Relation Extraction
Zhou, W., Lin, H., Lin, B. Y., Wang, Z., Du, J., Neves, L., & Ren, X. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380282 · Cited by 62
Learning Latent Forests for Medical Relation Extraction
Guo, Z., Nan, G., Lu, W., & Cohen, S. B. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/505 · Cited by 60
Proceedings of The Web Conference 2020
(2020) · doi:10.1145/3366423 · Cited by 60
Bridging Text and Knowledge with Multi-Prototype Embedding for Few-Shot Relational Triple Extraction
Yu, H., Zhang, N., Deng, S., Ye, H., Zhang, W., & Chen, H. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.563 · Cited by 57
Self-citationPADA: Example-based Prompt Learning for on-the-fly Adaptation to Unseen Domains
Ben-David, E., Oved, N., & Reichart, R. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00468 · Cited by 54
Meta-Information Guided Meta-Learning for Few-Shot Relation Classification
Dong, B., Yao, Y., Xie, R., Gao, T., Han, X., Liu, Z., Lin, F., Lin, L., & Sun, M. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.140 · Cited by 53
Self-citationSemantic Representation for Dialogue Modeling
Bai, X., Chen, Y., Song, L., & Zhang, Y. (2021) · doi:10.18653/v1/2021.acl-long.342 · Cited by 51
How does BERT capture semantics? A closer look at polysemous words
Yenicelik, D., Schmidt, F., & Kilcher, Y. (2020) · Proceedings of the Third BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/2020.blackboxnlp-1.15 · Cited by 50
Improving Relation Extraction with Knowledge-attention
Li, P., Mao, K., Yang, X., & Li, Q. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1022 · Cited by 49
An Improved Baseline for Sentence-level Relation Extraction
Zhou, W., & Chen, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.01373 · Cited by 47
OpenUE: An Open Toolkit of Universal Extraction from Text
Zhang, N., Deng, S., Bi, Z., Yu, H., Yang, J., Chen, M., Huang, F., Zhang, W., & Chen, H. (2020) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2020.emnlp-demos.1 · Cited by 41
Self-citationLogic-guided Semantic Representation Learning for Zero-Shot Relation Classification
Li, J., Wang, R., Zhang, N., Zhang, W., Yang, F., & Chen, H. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.265 · Cited by 40
Self-citationCommonsense Knowledge Mining from Pretrained Models
Feldman, J., Davison, J., & Rush, A. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.00505 · Cited by 36
Re-TACRED: Addressing Shortcomings of the TACRED Dataset
Stoica, G., Platanios, E. A., & Poczos, B. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i15.17631 · Cited by 31
PADA: A Prompt-based Autoregressive Approach for Adaptation to Unseen Domains.Preprint
Ben‐David, E., Oved, N., & Reichart, R. (2021) · arXiv (Cornell University) · Cited by 30
Finding Influential Instances for Distantly Supervised Relation ExtractionPreprint
Wang, Z., Wen, R., Chen, X., Huang, S., Zhang, N., & Zheng, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.09841 · Cited by 25
Self-citationAutomatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification
Schick, T., Schmid, H., & Schütze, H. (2020) · Open access LMU (Ludwid Maxmilian's Universitat Munchen) · doi:10.5282/ubm/epub.74034 · Cited by 23
Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive SurveyPreprint
Chen, J., Geng, Y., Chen, Z., Pan, J. Z., He, Y., Zhang, W., Horrocks, I. R., & Chen, H. (2021) · Research Explorer (The University of Manchester) · doi:10.48550/arxiv.2112.10006 · Cited by 23
Self-citationFew-shot Relation Extraction via Bayesian Meta-learning on Task Graphs
Qu, M., Gao, T., Xhonneux, L.-P., & Tang, J. (2020) · International Conference on Machine Learning · Cited by 16
PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple ExtractionPreprint
Zheng, H., Wen, R., Chen, X., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09895 · Cited by 12
Self-citationAligning Knowledge Base and Document Embedding Models Using Regularized Multi-Task Learning
Baumgartner, M., Zhang, W., Paudel, B., Dell’Aglio, D., Chen, H., & Bernstein, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00671-6_2 · Cited by 11
Self-citationLOREM: Language-consistent Open Relation Extraction from Unstructured Text
Harting, T., Mesbah, S., & Lofi, C. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380252 · Cited by 7
Dialogue-Based Relation ExtractionPreprint
Yu, D., Sun, K., Cardie, C., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.08056 · Cited by 6
Curriculum-Meta Learning for Order-Robust Continual Relation ExtractionPreprint
Wu, T., Li, X., Li, Y.-F., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.01926 · Cited by 2
PADA: Example-based Prompt Learning for on-the-fly Adaptation to Unseen DomainsPreprint
Ben-David, E., Oved, N., & Reichart, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12206
Research works printed but not linked: 2
- Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Proceedings of NeurIPS 2020.
- 10.18653/v1/d17-1004 · DOI · Paper page
Cited by
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
“Existing works [13] make a step by making prompts with additional marks to encode lexical information, such as entity markings.”
BackgroundMethodInfluentialLiu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2024) · AI Open · doi:10.1016/j.aiopen.2023.08.012 · Cited by 596
Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey
Min, B., Ross, H., Sulem, E., Veyseh, A. P. B., Nguyen, T. H., Sainz, O., Agirre, E., Heintz, I., & Roth, D. (2024) · ACM Computing Surveys · doi:10.1145/3605943 · Cited by 1,387
Liu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021) · arXiv · doi:10.48550/arxiv.2103.10385 · Cited by 908
P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks
Liu, X., Ji, K., Fu, Y., Tam, W., Du, Z., Yang, Z., & Tang, J. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/2022.acl-short.8 · Cited by 810
Metadata
- Authors
- Chen, X., Zhang, N., Xie, X., Deng, S., Yao, Y., Tan, C., Huang, F., Si, L., & Chen, H.
- Affiliations
- Zhejiang University (CN)
- Alibaba Group (China) (CN)
- ORCID
- Venue
- Proceedings of the ACM Web Conference 2022
- Publisher
- ACM
- Published
- 2022-04-25
- Pages
- 2778-2788
- OpenAlex
- W3194836374
- Cited by
- 389
- References
- 82
- Citations by year
- 2026: 32 · 2025: 73 · 2024: 110 · 2023: 108 · 2022: 58
- FWCI
- 48.25
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- International World Wide Web Conference (WWW) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- NSFC (91846204, U19B2027)
- National Key R&D Program of China (SQ2018YFC000004)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- relation extraction, prompt tuning, synergistic optimization, masked language modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.