Template-Based Named Entity Recognition Using BART
Open accessAbstract
There is a recent interest in investigating few-shot NER, where the low-resource target domain has different label sets compared with a resource-rich source domain. Existing methods use a similarity-based metric. However, they cannot make full use of knowledge transfer in NER model parameters. To address the issue, we propose a template-based method for NER, treating NER as a language model ranking problem in a sequence-to-sequence framework, where original sentences and statement templates filled by candidate named entity span are regarded as the source sequence and the target sequence, respectively. For inference, the model is required to classify each candidate span based on the corresponding template scores. Our experiments demonstrate that the proposed method achieves 92.55% F1 score on the CoNLL03 (rich-resource task), and significantly better than fine-tuning BERT 10.88%, 15.34%, and 11.73% F1 score on the MIT Movie, the MIT Restaurant, and the ATIS (low-resource task), respectively.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Cui et al. manually design lists such as person, location, and so on, for named entity recognition tasks.
“Cui et al. [17] manually design lists such as”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [17]
Section 4.1 (page unavailable) says Cui et al. manually create templates, map entity labels such as LOC to words such as “location,” and form a list of templates. The Introduction gives “person” and “location” as template values. The paper does not say they manually designed the list of entity categories themselves; it describes those categories as pre-defined. (LLM, conf=0.82)
Experimental — accuracy not yet measuredToken or text-span answer spaces are widely used in classification tasks as well as in other tasks such as relation extraction or named entity recognition.
“Token or text-span answer spaces are widely used in classification tasks (e.g., sentiment classification; Yin et al. [144]) as well as in other tasks such as relation extraction [100] or named entity recognition [17].”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 3× · see citing works
“The current dominant methods use a sequential neural network such as BiLSTM (Hochreiter and Schmidhuber, 1997) and BERT (Devlin et al., 2019) is used to represent the input text, and softmax (Chiu and Nichols, 2016; Strubell et al., 2017; Cui and Zhang, 2019) or CRF (Lample et al., 2016; Ma and…”
MethodJakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · cited 5× · see citing works
“We use BERT (Devlin et al., 2019) and BART (Lewis et al.”
MethodInfluential(2008) · Journal of Machine Learning Research · Cited by 33,051 · see citing works
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,695 · see citing works
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821 · cited 3× · see citing works
“We use BERT (Devlin et al., 2019) and BART (Lewis et al., 2020) as our E NCODER to learn the sequence representation.”
MethodResultNeural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401 · cited 6× · see citing works
“Third, compared with traditional meth-ods (pre-trained model with a softmax/CRF), our method can be applied to arbitrary new categories of named entities without changing the output layer, and therefore allows continual learning (Lin et al., 2020).”
BackgroundMethodInfluentialIntroduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788 · cited 2× · see citing works
“Named entity recognition (NER) is a fundamental task in natural language processing, which identi-fies mention spans from text inputs according to pre-defined entity categories (Tjong Kim Sang and De Meulder, 2003), such as location, person, organization, etc.”
BackgroundMethodEnd-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Ma, X., & Hovy, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1101 · Cited by 2,567 · cited 6× · see citing works
“Third, compared with traditional meth-ods (pre-trained model with a softmax/CRF), our method can be applied to arbitrary new categories of named entities without changing the output layer, and therefore allows continual learning (Lin et al., 2020).”
BackgroundMethodInfluentialNamed Entity Recognition with Bidirectional LSTM-CNNs
Chiu, J., & Nichols, E. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00104 · Cited by 1,925 · cited 4× · see citing works
“, 2019) is used to represent the input text, and softmax (Chiu and Nichols, 2016; Strubell et al., 2017; Cui and Zhang, 2019) or CRF (Lample et al.”
MethodInfluentialLanguage Models as Knowledge Bases?
Petroni, F., Rocktäschel, T., Riedel, S., Lewis, P., Bakhtin, A., Wu, Y., & Miller, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1250 · Cited by 1,834 · cited 1× · see citing works
“Petroni et al. (2019) extract relation between entities from BERT by constructing cloze-style templates.”
MethodSelf-citationIntroduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity RecognitionPreprint
Sang, E. T. K. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0209010 · Cited by 1,677 · see citing works
Making Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.295 · Cited by 1,380 · cited 3× · see citing works
“First, due to the good generalization ability of pre-trained models (Brown et al., 2020; Gao et al., 2020), the network can effectively leverage labeled instances in the new domain for tine-tuning.”
BackgroundExploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference
Schick, T., & Schütze, H. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.20 · Cited by 1,305 · cited 2× · see citing works
“Schick and Schütze (2020) rephrase inputs as cloze questions for text classification.”
BackgroundUtilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence
Sun, C. C., Huang, L., & Qiu, X. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1035 · Cited by 670 · cited 1× · see citing works
“Sun et al. (2019) use templates to construct auxiliary sentences, and transform aspect sentiment task as a sentence-pair classification task.”
MethodLUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention
Yamada, I., Asai, A., Shindo, H., Takeda, H., & Matsumoto, Y. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.523 · Cited by 647 · see citing works
Multi-Domain Joint Semantic Frame Parsing Using Bi-Directional RNN-LSTM
Hakkani-Tür, D. Z., Tür, G., Çelikyılmaz, A., Chen, Y.-N., Gao, J., Deng, L., & Wang, Y. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-402 · Cited by 465 · see citing works
Fast and Accurate Entity Recognition with Iterated Dilated Convolutions
Strubell, E., Verga, P., Belanger, D., & Mccallum, A. (2017) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1283 · Cited by 436 · cited 4× · see citing works
“…BiLSTM (Hochreiter and Schmidhuber, 1997) and BERT (Devlin et al., 2019) is used to represent the input text, and softmax (Chiu and Nichols, 2016; Strubell et al., 2017; Cui and Zhang, 2019) or CRF (Lample et al., 2016; Ma and Hovy, 2016; Luo et al., 2020) output layers to assign named entity…”
MethodInfluentialPooled Contextualized Embeddings for Named Entity Recognition
Akbik, A., Bergmann, T., & Vollgraf, R. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1078 · Cited by 284 · see citing works
Simple and Effective Few-Shot Named Entity Recognition with Structured Nearest Neighbor Learning
Yang, Y. P., & Katiyar, A. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.516 · Cited by 203 · see citing works
Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification
Schick, T., Schmid, H., & Schütze, H. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.488 · Cited by 184 · see citing works
A Local Detection Approach for Named Entity Recognition and Mention Detection
Xu, M., Jiang, H., & Watcharawittayakul, S. (2017) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.18653/v1/p17-1114 · Cited by 144 · cited 2× · see citing works
“Ziyadi et al. (2020) follow a two-step approach (Lin et al., 2019; Xu et al., 2017), which first detects spans boundary and then recognizes entity types by comparing the similarity with the labeled instance.”
BackgroundDesign Challenges and Misconceptions in Neural Sequence LabelingPreprint
Yang, J., Liang, S., & Zhang, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04470 · Cited by 140 · see citing works
Self-citationHierarchical Contextualized Representation for Named Entity Recognition
Luo, Y., Xiao, F., & Zhao, H. Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6363 · Cited by 138 · cited 6× · see citing works
“…to represent the input text, and softmax (Chiu and Nichols, 2016; Strubell et al., 2017; Cui and Zhang, 2019) or CRF (Lample et al., 2016; Ma and Hovy, 2016; Luo et al., 2020) output layers to assign named entity tags (e.g. organization, person and location) or non-entity tags on each input token.”
BackgroundInfluentialMaking Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2020) · arXiv · doi:10.48550/arxiv.2012.15723 · Cited by 124 · cited 3× · see citing works
“First, due to the good generalization ability of pre-trained models (Brown et al., 2020; Gao et al., 2020), the network can effectively leverage labeled instances in the new domain for tine-tuning.”
BackgroundSequence-to-Nuggets: Nested Entity Mention Detection via Anchor-Region Networks
Lin, H., Lu, Y., Han, X., & Sun, L. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1511 · Cited by 122 · cited 2× · see citing works
“Ziyadi et al. (2020) follow a two-step approach (Lin et al., 2019; Xu et al., 2017), which first detects spans boundary and then recognizes entity types by comparing the similarity with the labeled instance.”
BackgroundAsgard: A portable architecture for multilingual dialogue systems
Liu, J., Pasupat, P., Cyphers, S., et al. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6639301 · Cited by 107 · cited 3× · see citing works
“(2020), we use MIT Movie Review (Liu et al., 2013), MIT Restaurant Review (Liu et al.”
BackgroundMethodSelf-citationHierarchically-Refined Label Attention Network for Sequence Labeling
Cui, L., & Zhang, Y. (2019) · doi:10.18653/v1/d19-1422 · Cited by 105 · cited 1× · see citing works
“, 2019) is used to represent the input text, and softmax (Chiu and Nichols, 2016; Strubell et al., 2017; Cui and Zhang, 2019) or CRF (Lample et al.”
MethodSelf-citationGCDT: A Global Context Enhanced Deep Transition Architecture for Sequence Labeling
Liu, Y., Meng, F., Zhang, J., Xu, J., Chen, Y., & Zhou, J. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1233 · Cited by 100 · cited 1× · see citing works
“Some methods (Chiu and Nichols, 2016; Strubell et al., 2017) treat NER as a local classification problem at each input token, while other methods use CRF (Ma and Hovy, 2016) or a sequence-to-sequence framework (Zhang et al., 2018; Liu et al., 2019).”
MethodFew-Shot Named Entity Recognition: A Comprehensive StudyPreprint
Huang, J., Li, C., Subudhi, K., Jose, D., Balakrishnan, S., Chen, W., Peng, B., Gao, J., & Han, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.14978 · Cited by 64 · cited 6× · see citing works
“For example, the performance of Huang et al. (2020) increases only 1.9% F1 score when the number of instances per entity type increase from 10 to 500.”
BackgroundMethodInfluentialLabel-Agnostic Sequence Labeling by Copying Nearest Neighbors
Wiseman, S., & Stratos, K. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1533 · Cited by 52 · cited 5× · see citing works
“Compared with the distance-based method (Wiseman and Stratos, 2019; Ziyadi et al., 2020; Huang et al., 2020), our method shows more improvement when the number of target-domain labeled data increases, because the distance-based method just optimizes its searching threshold rather than updating its…”
BackgroundMethodInfluentialExample-Based Named Entity RecognitionPreprint
Ziyadi, M., Sun, Y., Goswami, A., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.10570 · Cited by 28 · cited 7× · see citing works
“For example, when there are only 10 training instances, the method of Ziyadi et al. (2020) gives a F1 score of 40.1% on MIT Movie, as compared to 28.3% by BERT, despite that BERT requires re-training with a different output layer on both CoNLL03 and MIT Movie.”
BackgroundMethodInfluentialAutomatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification
Schick, T., Schmid, H., & Schütze, H. (2020) · Open access LMU (Ludwid Maxmilian's Universitat Munchen) · doi:10.5282/ubm/epub.74034 · Cited by 26 · cited 1× · see citing works
“Schick et al. (2020) and Gao et al. (2020) extend Schick and Schütze (2020) by automatically generating label words and templates, respectively.”
BackgroundLearning Tag Dependencies for Sequence Tagging
Zhang, Y., Chen, H., Zhao, Y., et al. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/637 · Cited by 26 · cited 1× · see citing works
“Some methods (Chiu and Nichols, 2016; Strubell et al., 2017) treat NER as a local classification problem at each input token, while other methods use CRF (Ma and Hovy, 2016) or a sequence-to-sequence framework (Zhang et al., 2018; Liu et al., 2019).”
MethodSelf-citationUncertainty-Aware Label Refinement for Sequence Labeling
Gui, T., Ye, J., Zhang, Q., Li, Z., Fei, Z., Gong, Y., & Huang, X. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.181 · Cited by 20 · see citing works
Lin, S., Gao, J., Zhang, S., et al. (2020) · World Wide Web · doi:10.1007/s11280-019-00758-x · Cited by 6 · cited 4× · see citing works
“Third, compared with traditional meth-ods (pre-trained model with a softmax/CRF), our method can be applied to arbitrary new categories of named entities without changing the output layer, and therefore allows continual learning (Lin et al., 2020).”
BackgroundMethodInfluentialNamed Entity Recognition - Is There a Glass Ceiling?
Stanisławek, T., Wróblewska, A., Wójcicka, A., Ziembicki, D., & Biecek, P. (2019) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k19-1058
Flagged first, then by citations
Research works printed but not linked: 1
- Jie Yang, Shuailong Liang, and Yue Zhang. 2018. De- sign challenges and misconceptions in neural se- quence labeling. In Proceedings of the 27th Inter- national Conference on Computational Linguistics, pages 3879-3889, Santa Fe, New Mexico, USA. As- sociation for Computational Linguistics.
Cited by
Sorted by citations
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361 · see citing works
Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey
Min, B., Ross, H., Sulem, E., Veyseh, A. P. B., Nguyen, T. H., Sainz, O., Agirre, E., Heintz, I., & Roth, D. (2024) · ACM Computing Surveys · doi:10.1145/3605943 · Cited by 1,387 · see citing works
“[26] explore generation-based ranking for NER, especially in few-shot and cross-domain few-shot settings.”
BackgroundInfluentialA Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities
Song, Y., Wang, T., Cai, P., Mondal, S. K., & Sahoo, J. P. (2023) · ACM Computing Surveys · doi:10.1145/3582688 · Cited by 721 · see citing works
“Different tasks [107] could have different blanks positions to test whether the model has learned the corresponding semantic knowledge [107, 111].”
BackgroundMethodUnified Structure Generation for Universal Information Extraction
Lu, Y., Liu, Q., Dai, D., Xiao, X., Lin, H., Han, X., Sun, L., & Wu, H. R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.395 · Cited by 481 · see citing works
Large language models are few-shot clinical information extractors
Agrawal, M., Hegselmann, S., Lang, H., Kim, Y., & Sontag, D. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.130 · Cited by 358 · see citing works
“For example, given a candidate entity X and full model access, the entity type can be predicted via an argmax over the possible types Y of the probability of statements like “X is a Y entity” (Cui et al., 2021).”
BackgroundLarge language models for generative information extraction: a survey
Xu, D., Chen, W., Peng, W., Zhang, C., Xu, T., Zhao, X., Wu, X., Zheng, Y., Wang, Y., & Chen, E. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40555-y · Cited by 326 · see citing works
CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learning
Das, S. S. S., Katiyar, A., Passonneau, R. J., & Zhang, R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.439 · Cited by 188 · see citing works
“This reduces the capability of hyperparameter tuning, which particularly affects template based methods where prompt selection is crucial for good performance (Cui et al., 2021).”
BackgroundPrompt engineering for healthcare: Methodologies and applications
Wang, J., Shi, E., Yu, S., Wu, Z., Hu, H., Ma, C., Dai, H., Yang, Q., Kang, Y., Wu, J., et al. (2025) · Meta-Radiology · doi:10.1016/j.metrad.2025.100190 · Cited by 220 · see citing works
Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction
Ma, Y., Wang, Z., Cao, Y., Li, M., Chen, M., Wang, K., & Shao, J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.466 · Cited by 151 · see citing works
“For example, (Cui et al., 2021) design the prompt for named entity recognition: [candidate span] is [entity type/not a] entity.”
BackgroundTemplate-free Prompt Tuning for Few-shot NER
Ma, R., Zhou, X., Gui, T., Tan, Y., Li, L., Zhang, Q., & Huang, X. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.420 · Cited by 136 · see citing works
Reframing Instructional Prompts to GPTk’s Language
Mishra, S. R., Khashabi, D., Baral, C. R., Choi, Y., & Hajishirzi, H. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.50 · Cited by 140 · see citing works
“, 2021) and named entity recognition (Cui et al., 2021) tasks, respectively.”
BackgroundLog Parsing with Prompt-based Few-shot Learning
Le, V.-H., & Zhang, H. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00204 · Cited by 129 · see citing works
LLMs4OL: Large Language Models for Ontology Learning
Giglou, H. B., D’Souza, J., & Auer, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47240-4_22 · Cited by 169 · see citing works
Decomposed Meta-Learning for Few-Shot Named Entity Recognition
Ma, T., Jiang, H., Wu, Q., Zhao, T., & Lin, C.-Y. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.124 · Cited by 108 · see citing works
Dynamic Prefix-Tuning for Generative Template-based Event Extraction
Liu, X., Huang, H., Shi, G., & Wang, B. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.358 · Cited by 105 · see citing works
“It is worth noticing that there may exist other ways to avoid the problem, as Cui et al. (2021) formulate the NER task as a ranking task to avoid irrelevant entity types in a similar conditional generation task setting.”
BackgroundParadigm Shift in Natural Language Processing
Sun, T., Liu, X.-Y., Qiu, X., & Huang, X. (2022) · Machine Intelligence Research · doi:10.1007/s11633-022-1331-6 · Cited by 94 · see citing works
“, 2021b) 2021 Named Entity Recognition SeqLab (M)LM (Cui et al., 2021)”
BackgroundGood Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER
Lee, D., Kadakia, A., Tan, K., Agarwal, M., Feng, X., Shibuya, T., Mitani, R., Sekiya, T., Pujara, J., & Ren, X. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.192 · Cited by 80 · see citing works
Ontology-enhanced Prompt-tuning for Few-shot Learning
Ye, H., Zhang, N., Deng, S., Chen, X., Chen, H., Xiong, F., Chen, X., & Chen, H. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3511921 · Cited by 76 · see citing works
“Originally from GPT-3, prompt-tuning has been applied to various of tasks including relation extraction [20], event extraction [21, 58], named entity recognition [5, 7], entity typing [13], and so on.”
MethodDeep learning for named entity recognition: a survey
Hu, Z., Hou, W. Z., & Liu, X. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-09646-6 · Cited by 79 · see citing works
“The main concept of TemplateNER [92], the first paper to use the Prompt approach for sequence labeling, is to build candidate entities using the N-Gram technique, stitch them together using all manual templates, and then score Fig.”
Identifying and Extracting Rare Diseases and Their Phenotypes with Large Language Models
Shyr, C., Hu, Y., Bastarache, L., Cheng, A. C., Hamid, R., Harris, P. A., & Xu, H. (2023) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-023-00155-0 · Cited by 63 · see citing works
“Last, though manually created prompts are intuitive and interpretable, evidence suggests that small changes can lead to variations in performance (Cui et al., 2021).”
BackgroundPromptNER: Prompt Locating and Typing for Named Entity Recognition
Shen, Y., Tan, Z., Wu, S., Zhang, W., Zhang, R., Xi, Y., Lü, W., & Zhuang, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.698 · Cited by 67 · see citing works
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population
Zhang, N., Xu, X., Tao, L., Yu, H., Ye, H., Qiao, S., Xie, X. Y., Chen, X., Li, Z., & Li, L. (2022) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2022.emnlp-demos.10 · Cited by 62 · see citing works
“According to (Cui et al., 2021), to construct the in-domain few-shot scenario, we reduce the number of training samples for certain entity categories by downsampling one dataset.”
BackgroundMethodKEPT: Knowledge Enhanced Prompt Tuning for event causality identification
Liu, J., Zhang, Z., Guo, Z. M., Jin, L., Li, X., Wei, K., & Sun, X. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110064 · Cited by 60 · see citing works
Self-citationLarge Language Model Instruction Following: A Survey of Progresses and Challenges
Lou, R., Zhang, K., & Yin, W. (2024) · Computational Linguistics · doi:10.1162/coli_a_00523 · Cited by 92 · see citing works
“…of previous few/zero-shot NLP tasks, like question answering (Radford et al., 2019; Lin et al., 2022), machine translation (Li et al., 2022c), sentiment analysis (Wu and Shi, 2022), textual entailment (Schick and Schütze, 2021a,b), entity recognition (Cui et al., 2021; Wang et al., 2022a), etc.”
BackgroundEfficient utilization of pre-trained models: A review of sentiment analysis via prompt learning
Bu, K., Liu, Y., & Ju, X. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111148 · Cited by 57 · see citing works
A survey on semantic processing techniques
Mao, R., He, K., Zhang, X., Chen, G., Ni, J., Yang, Z., & Cambria, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101988 · Cited by 55 · see citing works
An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling
Wang, P., Xu, R., Liu, T., Zhou, Q. S., Cao, Y., Chang, B., & Sui, Z. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.369 · Cited by 54 · see citing works
“(Cui et al., 2021) introduces a prompt method to tap the potential of BART (Lewis et al.”
MethodFew-shot Named Entity Recognition with Self-describing Networks
Chen, J., Liu, Q., Lin, H., et al. (2022) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.18653/v1/2022.acl-long.392 · Cited by 49 · see citing works
Wang, X., & Liu, J. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110114 · Cited by 47 · see citing works
Self-citationDeep Learning for Cross-Domain Few-Shot Visual Recognition: A Survey
Xu, H., Zhi, S., Sun, S., Patel, V. M., & Liu, L. (2025) · ACM Computing Surveys · doi:10.1145/3718362 · Cited by 47 · see citing works
“To address this, a new paradigm called prompt learning has emerged in natural language processing (NLP) [17].”
A Survey on Arabic Named Entity Recognition: Past, Recent Advances, and Future Trends
Qu, X., Gu, Y., Xia, Q., Li, Z., Wang, Z., & Huai, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3303136 · Cited by 53 · see citing works
“Besides generating more training samples, there are also several recent meth-ods [125], [126] focusing on designing low-resource algorithms.”
BackgroundAdaPrompt: Adaptive Model Training for Prompt-based NLP
Chen, Y., Liu, Y., Li, D., Wang, S., Zhu, C., Zeng, M., & Zhang, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.448 · Cited by 45 · see citing works
“Second, to project label words to task labels, most existing work (Schick and Schütze, 2021a,b; Cui et al., 2021) uses a pre-defined verbalizer.”
BackgroundMethodSelf-citationA review of named entity recognition: from learning methods to modelling paradigms and tasks
Seow, W. L., Chaturvedi, I., Hogarth, A., Mao, R., & Cambria, E. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11321-8 · Cited by 48 · see citing works
PromptRank: Unsupervised Keyphrase Extraction Using Prompt
Kong, A., Zhao, S., Chen, H., Li, Q., Qin, Y., Sun, R., & Bai, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.545 · Cited by 39 · see citing works
Learning In-context Learning for Named Entity Recognition
Chen, J., Lu, Y., Lin, H., Lou, J., Jia, W., Dai, D., Wu, H. R., Cao, B., Han, X., & Sun, L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.764 · Cited by 44 · see citing works
Heterogeneous Region Embedding with Prompt Learning
Zhou, S., He, D., Chen, L., Shang, S., & Han, P. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25625 · Cited by 36 · see citing works
“Prompt shapes can be separated into cloze (Petroni et al. 2019; Cui et al. 2021) and prefix prompt (Li and Liang 2021; Lester, Al-Rfou, and Constant 2021).”
BackgroundSun, Y., Zheng, Y., Hao, C., & Qiu, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.03564 · Cited by 48 · see citing works
“, 2020; Schick and Schütze, 2021b,a) or L2R LM(Radford et al., 2019; Brown et al., 2020; Cui et al., 2021), are commonly used in token-level prompt-learning approaches.”
BackgroundMethodInfluentialmLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models
Ri, R., Yamada, I., & Tsuruoka, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.505 · Cited by 38 · see citing works
“Recent studies have shown that we can address various downstream tasks by querying a language model for blanks in prompts (Petroni et al., 2019; Cui et al., 2021).”
BackgroundA prompt model with combined semantic refinement for aspect sentiment analysis
Zhu, X., Kuang, Z., & Zhang, L. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103462 · Cited by 35 · see citing works
Type-Aware Decomposed Framework for Few-Shot Named Entity Recognition
Li, Y., Yu, Y., & Qian, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.598 · Cited by 36 · see citing works
Neuberger, J., Ackermann, L., van der Aa, H., & Jablonski, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-75872-0_3 · Cited by 36 · see citing works
Zhao, B., Jin, W., Zhang, Y., Huang, S., & Yang, G. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110928 · Cited by 32 · see citing works
Self-citationFlat-Lattice-CNN: A model for Chinese medical-named-entity recognition
Wang, S., Zhang, K., & Liu, A. (2025) · PLoS ONE · doi:10.1371/journal.pone.0331464 · Cited by 30 · see citing works
“Cui’s work shares similarities with Huang’s approach [16].”
He, K., Mao, R., Huang, Y., Gong, T., Li, C., & Cambria, E. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3314807 · Cited by 31 · see citing works
“Previous works normally defined OTHER with a unique representation [24], [48], [64].”
InfluentialZha, E., Zeng, D., Lin, M., & Shen, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111730 · Cited by 33 · see citing works
Bi-Directional Iterative Prompt-Tuning for Event Argument Extraction
Dai, L., Wang, B., Xiang, W., & Mo, Y. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.419 · Cited by 28 · see citing works
Few-Shot Class-Incremental Learning for Named Entity Recognition
Wang, R., Yu, T., Zhao, H., Kim, S., Mitra, S., Zhang, R., & Henao, R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.43 · Cited by 27 · see citing works
“Recently, (Cui et al., 2021) proposes Template NER, a few-shot friendly model for NER that convert NER into a sequence-to-sequence problem.”
MethodLightNER: A Lightweight Generative Framework with Prompt-guided Attention for Low-resource NERPreprint
Chen, X., Zhang, N., Li, L., Xie, X. Y., Deng, S., Tan, C., Huang, F., Si, L., & Chen, H. (2021) · arXiv (Cornell University) · Cited by 27 · see citing works
Cross-domain Named Entity Recognition via Graph Matching
Zheng, J., Chen, H., & Ma, Q. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.210 · Cited by 25 · see citing works
Inverse is Better! Fast and Accurate Prompt for Few-shot Slot Tagging
Hou, Y., Chen, C., Luo, X., Li, B., & Che, W. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.53 · Cited by 24 · see citing works
Few-shot Named Entity Recognition: Definition, Taxonomy and Research Directions
Moscato, V., Postiglione, M., & Sperlí, G. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3609483 · Cited by 30 · see citing works
“Template-based NER [22] IOB é Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð 42.”
BackgroundMethodResultInfluentialKarakurt, E., & Akbulut, A. (2025) · Applied Sciences · doi:10.3390/app16010368 · Cited by 39 · see citing works
Prompt Consistency for Multi-Label Textual Emotion Detection
Zhou, Y., Kang, X., & Ren, F. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3254883 · Cited by 23 · see citing works
“Decomposition decomposes the prompt into multiple sub-prompts and is generally used for named entity recognition tasks [39].”
BackgroundA Dual Prompt Learning Framework for Few-Shot Dialogue State Tracking
Yang, Y., Lei, W., Huang, P., Cao, J., Li, J., & Chua, T. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583238 · Cited by 26 · see citing works
“To utilize the few-shot generation ability of PLMs via prompt learning, previous work [7, 18, 37] show that the design of prompt function � is a key factor that infuences the fnal performance.”
MethodPrompt-Based Metric Learning for Few-Shot NER
Chen, Y., Zheng, Y., & Yang, Z. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.451 · Cited by 25 · see citing works
“With the emergence of prompt-based methods in NLP research, very recently, some prompt-based approaches for few-shot NER have been proposed (Cui et al., 2021; Lee et al., 2022; Ma et al., 2021).”
BackgroundMethodTKDP: Threefold Knowledge-Enriched Deep Prompt Tuning for Few-Shot Named Entity Recognition
Liu, J., Fei, H., Li, F., Li, J., Li, B., Zhao, L., Teng, C., & Ji, D. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3389650 · Cited by 24 · see citing works
“Later, Cui et al. [11] first applied prompt tuning to the sequence tagging task, who created prompt templates by enumerating all possible mention spans.”
BackgroundMethodInfluentialSelf-citationLarge Language Model and Text Generation
Wu, Y. (2024) · Cognitive informatics in biomedicine and healthcare · doi:10.1007/978-3-031-55865-8_10 · Cited by 23 · see citing works
Self-citationRecent Advances in Named Entity Recognition: A Comprehensive Survey and Comparative StudyPreprint
Keraghel, I., Morbieu, S., & Nadif, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.10825 · Cited by 78 · see citing works
Aviation-BERT-NER: Named Entity Recognition for Aviation Safety Reports
Chandra, C., Ojima, Y., Bendarkar, M. V., et al. (2024) · Aerospace · doi:10.3390/aerospace11110890 · Cited by 21 · see citing works
T 2 -NER: A Two-Stage Span-Based Framework for Unified Named Entity Recognition with Templates
Huang, P., Zhao, X. H., Hu, M., Tan, Z., & Xiao, W. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00602 · Cited by 22 · see citing works
“Cui et al. (2021) design templates and employ BART for pre-training and fine-tuning on templates to obtain entity types of given spans.”
MethodCausality Extraction from Medical Text Using Large Language Models (LLMs)
Gopalakrishnan, S., Garbayo, L., & Zadrozny, W. (2024) · Information · doi:10.3390/info16010013 · Cited by 25 · see citing works
Enhancing named entity recognition with external knowledge from large language model
Li, Q., Xie, T., Zhang, J., Ma, K., Su, J., Yang, K., & Wang, H. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113471 · Cited by 22 · see citing works
Robust and explainable identification of logical fallacies in natural language arguments
Sourati, Z., Venkatesh, V. P. P., Deshpande, D. G., Rawlani, H., Ilievski, F., Sandlin, H.-Â., & Mermoud, A. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110418 · Cited by 20 · see citing works
Prompting Language Models for Linguistic Structure
Blevins, T., Gonen, H., & Zettlemoyer, L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.367 · Cited by 25 · see citing works
Boosting Static Resource Leak Detection via LLM-based Resource-Oriented Intention Inference
Wang, C., Liu, J., Peng, X., Liu, Y., & Lou, Y. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00131 · Cited by 25 · see citing works
“In a recent survey by Liu et al. [26], prompt templates are broadly classified into two categories: cloze prompts [16, 31], which entail filling in the blanks in text or code, and prefix prompts [23, 25], which continue generating content following a specified prefix.”
Self-citationInformation Extraction in Low-Resource Scenarios: Survey and Perspective
Deng, S., Ma, Y., Zhang, N., Cao, Y., & Hooi, B. (2024) · IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg63256.2024.00013 · Cited by 21 · see citing works
“[122], [123], [126]–[128], [214] respectively applied a template-based, template-free, dynamic-template-filling, demonstration-based, lightweight and contrastive prompt-based method for few-shot NER.”
Short answer scoring with GPT-4
Jiang, L., & Bosch, N. (2024) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3657604.3664685 · Cited by 23 · see citing works
“Moreover, motivated by Cui et al. [11], who created one prompt for each prediction sub-task, we split the prompt for scoring with rationale into two sub-prompts: one for scoring and one for rationale.”
MethodGNNer: Reducing Overlapping in Span-based NER Using Graph Neural Networks
Zaratiana, U., Tomeh, N., Holat, P., & Charnois, T. (2022) · Annual Meeting of the Association for Computational Linguistics: Student Research Workshop (ACL SRW) · doi:10.18653/v1/2022.acl-srw.9 · Cited by 18 · see citing works
“In addition, with the growing popularity of prompt-based learning, recent work such as (Cui et al., 2021) considers NER as template filling by fine-tuning a BART (Lewis et al.”
BackgroundLee, U., Kim, Y., Lee, S., Park, J., Mun, J., Lee, E., Kim, H., Lim, C., & Yoo, Y. J. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00448-4 · Cited by 20 · see citing works
“Prompts in this context can be divided based on their form: cloze prompts, which are designed to fill in the blanks of a textual string, and prefix prompts, used to continue a string prefix (Cui et al., 2021; Petroni et al., 2019; Li & Liang, 2021).”
MANNER: A Variational Memory-Augmented Model for Cross Domain Few-Shot Named Entity Recognition
Fang, J., Wang, X., Meng, Z., Xie, P., Huang, F., & Jiang, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.234 · Cited by 17 · see citing works
“Moreover, prompt-based techniques (Cui et al., 2021; Ding et al., 2022; Chen et al., 2022) have also been proposed to address few-shot NER tasks.”
BackgroundBao, J., He, Y., Sun, Y., Liang, B., Du, J., Qin, B., Yang, M., & Xu, R. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.713 · Cited by 18 · see citing works
“…information extraction (IE) tasks, such as aspect-based sentiment analysis (Zhang et al., 2021b,a), named entity recognition (Ren et al., 2021; Cui et al., 2021; Zhang et al., 2022), event argument extraction (Li et al., 2021), etc. Closely related to our work, some recent studies incorporate…”
ResultGLAD: Content-Aware Dynamic Graphs For Log Anomaly Detection
Li, Y., Liu, Y., Wang, H., Chen, Z., Cheng, W. D., Chen, Y., Yu, W., Chen, H., & Liu, C. (2023) · IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg59574.2023.00007 · Cited by 18 · see citing works
“During training, we create prompts using gold fields following [51], [52].”
MethodRapid Adaptation of Chemical Named Entity Recognition Using Few-Shot Learning and LLM Distillation
Zhang, Y., Vlachos, D. G., Liu, D., & Fang, H. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c00248 · Cited by 16 · see citing works
Self-citationZeng, J., Yin, Y., Jiang, Y., Wu, S., & Cao, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.522 · Cited by 17 · see citing works
Lu, W., Jiang, J., Shi, Y., et al. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1259652 · Cited by 16 · see citing works
Wang, Z., Huang, M., Li, C., et al. (2023) · Applied Sciences · doi:10.3390/app13053024 · Cited by 15 · see citing works
2INER: Instructive and In-Context Learning on Few-Shot Named Entity Recognition
Zhang, J., Liu, X., Lai, X., Gao, Y. F., Wang, S., Hu, Y., & Lin, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.259 · Cited by 15 · see citing works
“…De Meulder, 2003) and for the low-resource domain, we use three datasets: MIT Movie Review, MIT Restaurant Review (Liu et al., 2013) and Air-line Travel Information Systems (ATIS) (Hakkani-3 Tür et al., 2016), following (Wang et al., 2022; Chen et al., 2022b; Cui et al., 2021; Yan et al., 2021).”
BackgroundMethodOut-of-Distribution Generalization in Natural Language Processing: Past, Present, and Future
Yang, L., Song, Y., Ren, X., Lyu, C., Wang, Y., Zhuo, J., Liu, L., Wang, J., Foster, J., & Zhang, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.276 · Cited by 16 · see citing works
Self-citationExemplar-Free Lifelong Person Re-identification via Prompt-Guided Adaptive Knowledge Consolidation
Li, Q., Xu, K., Peng, Y., & Zhou, J. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02110-x · Cited by 15 · see citing works
“Although some recent works (Petroni et al., 2019; Cui et al., 2021) demonstrated that manually designed prompts can improve the generalization ability of models, designing prompts needs specific domain knowledge which is indeed difficult.”
Jin, W., Wang, N., Tao, T., Jiang, M., Xing, Y., Zhao, B., Wu, H., Duan, H., & Yang, G. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110122 · Cited by 17 · see citing works
Software requirement specific entity extraction using transformer models
Malik, G., Çevik, M., Bera, S., et al. (2022) · doi:10.21428/594757db.9e433d7c · Cited by 15 · see citing works
Legal judgment prediction via legal knowledge extraction and fusion
Zhao, Q. (2025) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-025-00019-0 · Cited by 17 · see citing works
“Cui et al. (2021) is the first paper to apply the Prompt method to the sequence labeling task.”
Multilingual Relation Classification via Efficient and Effective Prompting
Chen, Y., Harbecke, D., & Hennig, L. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.69 · Cited by 18 · see citing works
Prompt-based Connective Prediction Method for Fine-grained Implicit Discourse Relation Recognition
Zhou, H., Lan, M., Wu, Y., Chen, Y., & Ma, M. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.282 · Cited by 14 · see citing works
Self-citationKeyEE: Enhancing Low-Resource Generative Event Extraction with Auxiliary Keyword Sub-Prompt
Duan, J., Liao, X., An, Y., & Wang, J. (2024) · Big Data Mining and Analytics · doi:10.26599/bdma.2023.9020036 · Cited by 14 · see citing works
GFMRC: A machine reading comprehension model for named entity recognition
Fei, Y., & Xu, X. (2023) · Pattern Recognition Letters · doi:10.1016/j.patrec.2023.06.011 · Cited by 14 · see citing works
Cui, Z., Yu, K., Yuan, Z., Dong, X., & Luo, W. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104559 · Cited by 13 · see citing works
A Two-Stage Boundary-Enhanced Contrastive Learning approach for nested named entity recognition
Liu, Y., Zhang, K., Tong, R., Cai, C., Chen, D., & Wu, X. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126707 · Cited by 13 · see citing works
KGNER: Improving Chinese Named Entity Recognition by BERT Infused with the Knowledge Graph
Hu, W., He, L., Ma, H., Wang, K., & Xiao, J. (2022) · Applied Sciences · doi:10.3390/app12157702 · Cited by 13 · see citing works
“Yan et al. [32] used BART to solve three types of NER tasks, and Cui et al. [33] used BART to solve how to transfer richer domain knowledge to a sparse knowledge domain, and all of them achieved good results.”
MethodKnowledge-Enriched Prompt for Low-Resource Named Entity Recognition
Hou, W., Zhao, W., Liu, X., & Guo, W. (2024) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3659948 · Cited by 12 · see citing works
“Similarly, Cui et al. [4] employ a prompt-based approach for few-shot NER, which incurs high computation costs.”
BackgroundMethodInfluentialPolarity-aware deep attention network for aspect-based sentiment analysis
Wadawadagi, R. S., Tiwari, S., & Pagi, V. B. (2024) · Progress in Artificial Intelligence · doi:10.1007/s13748-024-00352-x · Cited by 12 · see citing works
Decomposed Two-Stage Prompt Learning for Few-Shot Named Entity Recognition
Ye, F., Huang, L. P., Liang, S., & Chi, K. (2023) · Information · doi:10.3390/info14050262 · Cited by 12 · see citing works
A Composable Generative Framework Based on Prompt Learning for Various Information Extraction Tasks
Kan, Z., Feng, L., Yin, Z., Qiao, L., Qiu, X., & Li, D. (2023) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2023.3278977 · Cited by 16 · see citing works
Named Entity Recognition as Structured Span Prediction
Zaratiana, U., Tomeh, N., Holat, P., & Charnois, T. (2022) · doi:10.18653/v1/2022.umios-1.1 · Cited by 13 · see citing works
“In addition, recent work such as (Cui et al., 2021) considers NER as template filling by fine-tuning a BART (Lewis et al., 2019) encoder-decoder model.”
BackgroundCoarse-to-fine Few-shot Learning for Named Entity Recognition
Ma, R., Zhang, L., Chen, X., Zhou, X., Wang, J., Gui, T., Zhang, Q., Gao, X., & Chen, Y. W. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.253 · Cited by 11 · see citing works
“Recently, an increasing number of researchers have focused on Few-shot NER and made contributions to this task (Yang and Katiyar, 2020; Huang et al., 2021; Cui et al., 2021; Ma et al., 2022; Tong et al., 2021).”
Xu, S., Li, P., & Zhu, Q. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.954 · Cited by 11 · see citing works
Decoupled Hyperbolic Graph Attention Network for Cross-domain Named Entity Recognition
Xu, J., & Cai, Y. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591662 · Cited by 10 · see citing works
“Moreover, the fine-tuned methods also show strong performance, which first pre-trains a model using the samples from source domains, then uses the samples from the target domain to fine-tune the model [3, 22, 24, 26, 34, 37].”
MethodINSNER: A generative instruction-based prompting method for boosting performance in few-shot NER
Zhao, P., Feng, C., Li, P., Dong, G., & Wang, S. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2024.104040 · Cited by 11 · see citing works
ContrastNER: Contrastive-based Prompt Tuning for Few-shot NER
Layegh, A., Payberah, A. H., Soylu, A., Roman, D., & Matskin, M. (2023) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac57700.2023.00038 · Cited by 11 · see citing works
“Suggested by [11], the masked hard prompt initialized as "〈candidate_entity〉 is a [MASK] entity".”
BackgroundMethodInfluentialFocusing, Bridging and Prompting for Few-shot Nested Named Entity Recognition
Xu, Y., Yang, Z., Zhang, L., Zhou, D., Wu, T., & Zhou, R. F. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.164 · Cited by 10 · see citing works
“…flat NER task, mainly including sequence-labeling-based (Huang et al., 2021; Ma et al., 2022b,a; Yang and Katiyar, 2020; Das et al., 2022; Huang et al., 2022b), generative-based (Cui et al., 2021; Hou et al., 2022; Chen et al., 2022) and span-based (Yang et al., 2022; Wang et al., 2022b) methods.”
Method
- Authors
- Cui, L., Wu, Y., Liu, J., Yang, S., & Zhang, Y.
- Affiliations
- Westlake University (CN)
- Zhejiang University (CN)
- Corresponding author
- Zhang, Yue
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 1835-1845
- arXiv
- 2106.01760
- OpenAlex
- W3176489198
- Semantic Scholar
- ce498651107588db67adcfbb5479bdb416f4de2f
- Cited by
- 342
- References
- 38
- Citations by year
- 2026: 16 · 2025: 65 · 2024: 80 · 2023: 121 · 2022: 56 · 2021: 4
- FWCI
- 30.09
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Findings of the Association for Computational Linguistics: ACL (Findings of ACL) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61976180)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- named entity recognition, few-shot learning, BART, Seq2Seq, low-resource domains, knowledge transfer, domain adaptation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
