The DOI matches its DataCite record; 38 of the 38 references it cites were found in a registry or an index.
Template-Based Named Entity Recognition Using BART
Open accessAbstract
There is a recent interest in investigating few-shot NER, where the low-resource target domain has different label sets compared with a resource-rich source domain. Existing methods use a similarity-based metric. However, they cannot make full use of knowledge transfer in NER model parameters. To address the issue, we propose a template-based method for NER, treating NER as a language model ranking problem in a sequence-to-sequence framework, where original sentences and statement templates filled by candidate named entity span are regarded as the source sequence and the target sequence, respectively. For inference, the model is required to classify each candidate span based on the corresponding template scores. Our experiments demonstrate that the proposed method achieves 92.55% F1 score on the CoNLL03 (rich-resource task), and significantly better than fine-tuning BERT 10.88%, 15.34%, and 11.73% F1 score on the MIT Movie, the MIT Restaurant, and the ATIS (low-resource task), respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Cui et al. [17] manually design lists such as”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [17]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Token or text-span answer spaces are widely used in classification tasks (e.g., sentiment classification; Yin et al. [144]) as well as in other tasks such as relation extraction [100] or named entity recognition [17].”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 3×
“The current dominant methods use a sequential neural network such as BiLSTM (Hochreiter and Schmidhuber, 1997) and BERT (Devlin et al., 2019) is used to represent the input text, and softmax (Chiu and Nichols, 2016; Strubell et al., 2017; Cui and Zhang, 2019) or CRF (Lample et al., 2016; Ma and…”
MethodJakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 5×
“We use BERT (Devlin et al., 2019) and BART (Lewis et al.”
MethodInfluential(2008) · Journal of Machine Learning Research · Cited by 33,051
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821 · cited 3×
“We use BERT (Devlin et al., 2019) and BART (Lewis et al., 2020) as our E NCODER to learn the sequence representation.”
MethodResultNeural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401 · cited 6×
“Third, compared with traditional meth-ods (pre-trained model with a softmax/CRF), our method can be applied to arbitrary new categories of named entities without changing the output layer, and therefore allows continual learning (Lin et al., 2020).”
BackgroundMethodInfluentialIntroduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788 · cited 2×
“Named entity recognition (NER) is a fundamental task in natural language processing, which identi-fies mention spans from text inputs according to pre-defined entity categories (Tjong Kim Sang and De Meulder, 2003), such as location, person, organization, etc.”
BackgroundMethodEnd-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Ma, X., & Hovy, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1101 · Cited by 2,567 · cited 6×
“Third, compared with traditional meth-ods (pre-trained model with a softmax/CRF), our method can be applied to arbitrary new categories of named entities without changing the output layer, and therefore allows continual learning (Lin et al., 2020).”
BackgroundMethodInfluentialNamed Entity Recognition with Bidirectional LSTM-CNNs
Chiu, J., & Nichols, E. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00104 · Cited by 2,007 · cited 4×
“, 2019) is used to represent the input text, and softmax (Chiu and Nichols, 2016; Strubell et al., 2017; Cui and Zhang, 2019) or CRF (Lample et al.”
MethodInfluential
Research works printed but not linked: 1
- Jie Yang, Shuailong Liang, and Yue Zhang. 2018. De- sign challenges and misconceptions in neural se- quence labeling. In Proceedings of the 27th Inter- national Conference on Computational Linguistics, pages 3879-3889, Santa Fe, New Mexico, USA. As- sociation for Computational Linguistics.
Cited by
Sorted by citations
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey
Min, B., Ross, H., Sulem, E., Veyseh, A. P. B., Nguyen, T. H., Sainz, O., Agirre, E., Heintz, I., & Roth, D. (2024) · ACM Computing Surveys · doi:10.1145/3605943 · Cited by 1,387
“[26] explore generation-based ranking for NER, especially in few-shot and cross-domain few-shot settings.”
BackgroundInfluentialA Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities
Song, Y., Wang, T., Cai, P., Mondal, S. K., & Sahoo, J. P. (2023) · ACM Computing Surveys · doi:10.1145/3582688 · Cited by 721
“Different tasks [107] could have different blanks positions to test whether the model has learned the corresponding semantic knowledge [107, 111].”
BackgroundMethodUnified Structure Generation for Universal Information Extraction
Lu, Y., Liu, Q., Dai, D., Xiao, X., Lin, H., Han, X., Sun, L., & Wu, H. R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.395 · Cited by 520
Large language models are few-shot clinical information extractors
Agrawal, M., Hegselmann, S., Lang, H., Kim, Y., & Sontag, D. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.130 · Cited by 358
“For example, given a candidate entity X and full model access, the entity type can be predicted via an argmax over the possible types Y of the probability of statements like “X is a Y entity” (Cui et al., 2021).”
BackgroundLarge language models for generative information extraction: a survey
Xu, D., Chen, W., Peng, W., Zhang, C., Xu, T., Zhao, X., Wu, X., Zheng, Y., Wang, Y., & Chen, E. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40555-y · Cited by 326
CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learning
Das, S. S. S., Katiyar, A., Passonneau, R. J., & Zhang, R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.439 · Cited by 207
“This reduces the capability of hyperparameter tuning, which particularly affects template based methods where prompt selection is crucial for good performance (Cui et al., 2021).”
BackgroundPrompt engineering for healthcare: Methodologies and applications
Wang, J., Shi, E., Yu, S., Wu, Z., Hu, H., Ma, C., Dai, H., Yang, Q., Kang, Y., Wu, J., et al. (2025) · Meta-Radiology · doi:10.1016/j.metrad.2025.100190 · Cited by 266
Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction
Ma, Y., Wang, Z., Cao, Y., Li, M., Chen, M., Wang, K., & Shao, J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.466 · Cited by 151
“For example, (Cui et al., 2021) design the prompt for named entity recognition: [candidate span] is [entity type/not a] entity.”
BackgroundTemplate-free Prompt Tuning for Few-shot NER
Ma, R., Zhou, X., Gui, T., Tan, Y., Li, L., Zhang, Q., & Huang, X. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.420 · Cited by 144
Reframing Instructional Prompts to GPTk’s Language
Mishra, S. R., Khashabi, D., Baral, C. R., Choi, Y., & Hajishirzi, H. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.50 · Cited by 140
“, 2021) and named entity recognition (Cui et al., 2021) tasks, respectively.”
BackgroundLog Parsing with Prompt-based Few-shot Learning
Le, V.-H., & Zhang, H. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00204 · Cited by 129
LLMs4OL: Large Language Models for Ontology Learning
Giglou, H. B., D’Souza, J., & Auer, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47240-4_22 · Cited by 212
Decomposed Meta-Learning for Few-Shot Named Entity Recognition
Ma, T., Jiang, H., Wu, Q., Zhao, T., & Lin, C.-Y. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.124 · Cited by 116
Dynamic Prefix-Tuning for Generative Template-based Event Extraction
Liu, X., Huang, H., Shi, G., & Wang, B. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.358 · Cited by 113
“It is worth noticing that there may exist other ways to avoid the problem, as Cui et al. (2021) formulate the NER task as a ranking task to avoid irrelevant entity types in a similar conditional generation task setting.”
BackgroundParadigm Shift in Natural Language Processing
Sun, T., Liu, X.-Y., Qiu, X., & Huang, X. (2022) · Machine Intelligence Research · doi:10.1007/s11633-022-1331-6 · Cited by 103
“, 2021b) 2021 Named Entity Recognition SeqLab (M)LM (Cui et al., 2021)”
BackgroundGood Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER
Lee, D., Kadakia, A., Tan, K., Agarwal, M., Feng, X., Shibuya, T., Mitani, R., Sekiya, T., Pujara, J., & Ren, X. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.192 · Cited by 84
Ontology-enhanced Prompt-tuning for Few-shot Learning
Ye, H., Zhang, N., Deng, S., Chen, X., Chen, H., Xiong, F., Chen, X., & Chen, H. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3511921 · Cited by 80
“Originally from GPT-3, prompt-tuning has been applied to various of tasks including relation extraction [20], event extraction [21, 58], named entity recognition [5, 7], entity typing [13], and so on.”
MethodDeep learning for named entity recognition: a survey
Hu, Z., Hou, W. Z., & Liu, X. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-09646-6 · Cited by 88
“The main concept of TemplateNER [92], the first paper to use the Prompt approach for sequence labeling, is to build candidate entities using the N-Gram technique, stitch them together using all manual templates, and then score Fig.”
Identifying and Extracting Rare Diseases and Their Phenotypes with Large Language Models
Shyr, C., Hu, Y., Bastarache, L. A., Cheng, A., Hamid, R., Harris, P. A., & Xu, H. (2024) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-023-00155-0 · Cited by 77
“Last, though manually created prompts are intuitive and interpretable, evidence suggests that small changes can lead to variations in performance (Cui et al., 2021).”
BackgroundPromptNER: Prompt Locating and Typing for Named Entity Recognition
Shen, Y., Tan, Z., Wu, S., Zhang, W., Zhang, R., Xi, Y., Lü, W., & Zhuang, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.698 · Cited by 82
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population
Zhang, N., Xu, X., Tao, L., Yu, H., Ye, H., Qiao, S., Xie, X. Y., Chen, X., Li, Z., & Li, L. (2022) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2022.emnlp-demos.10 · Cited by 64
“According to (Cui et al., 2021), to construct the in-domain few-shot scenario, we reduce the number of training samples for certain entity categories by downsampling one dataset.”
BackgroundMethodKEPT: Knowledge Enhanced Prompt Tuning for event causality identification
Liu, J., Zhang, Z., Guo, Z. M., Jin, L., Li, X., Wei, K., & Sun, X. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110064 · Cited by 60
Self-citationLarge Language Model Instruction Following: A Survey of Progresses and Challenges
Lou, R., Zhang, K., & Yin, W. (2024) · Computational Linguistics · doi:10.1162/coli_a_00523 · Cited by 133
“…of previous few/zero-shot NLP tasks, like question answering (Radford et al., 2019; Lin et al., 2022), machine translation (Li et al., 2022c), sentiment analysis (Wu and Shi, 2022), textual entailment (Schick and Schütze, 2021a,b), entity recognition (Cui et al., 2021; Wang et al., 2022a), etc.”
BackgroundEfficient utilization of pre-trained models: A review of sentiment analysis via prompt learning
Bu, K., Liu, Y., & Ju, X. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111148 · Cited by 61
A survey on semantic processing techniques
Mao, R., He, K., Zhang, X., Chen, G., Ni, J., Yang, Z., & Cambria, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101988 · Cited by 55
An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling
Wang, P., Xu, R., Liu, T., Zhou, Q. S., Cao, Y., Chang, B., & Sui, Z. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.369 · Cited by 55
“(Cui et al., 2021) introduces a prompt method to tap the potential of BART (Lewis et al.”
MethodFew-shot Named Entity Recognition with Self-describing Networks
Chen, J., Liu, Q., Lin, H., Han, X., & Sun, L. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.392 · Cited by 54
Wang, X., & Liu, J. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110114 · Cited by 47
Self-citationDeep Learning for Cross-Domain Few-Shot Visual Recognition: A Survey
Xu, H., Zhi, S., Sun, S., Patel, V. M., & Liu, L. (2025) · ACM Computing Surveys · doi:10.1145/3718362 · Cited by 57
“To address this, a new paradigm called prompt learning has emerged in natural language processing (NLP) [17].”
A Survey on Arabic Named Entity Recognition: Past, Recent Advances, and Future Trends
Qu, X., Gu, Y., Xia, Q., Li, Z., Wang, Z., & Huai, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3303136 · Cited by 58
“Besides generating more training samples, there are also several recent meth-ods [125], [126] focusing on designing low-resource algorithms.”
BackgroundAdaPrompt: Adaptive Model Training for Prompt-based NLP
Chen, Y., Liu, Y., Li, D., Wang, S., Zhu, C., Zeng, M., & Zhang, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.448 · Cited by 50
“Second, to project label words to task labels, most existing work (Schick and Schütze, 2021a,b; Cui et al., 2021) uses a pre-defined verbalizer.”
BackgroundMethodSelf-citationA review of named entity recognition: from learning methods to modelling paradigms and tasks
Seow, W. L., Chaturvedi, I., Hogarth, A., Mao, R., & Cambria, E. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11321-8 · Cited by 54
PromptRank: Unsupervised Keyphrase Extraction Using Prompt
Kong, A., Zhao, S., Chen, H., Li, Q., Qin, Y., Sun, R., & Bai, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.545 · Cited by 45
Learning In-context Learning for Named Entity Recognition
Chen, J., Lu, Y., Lin, H., Lou, J., Jia, W., Dai, D., Wu, H. R., Cao, B., Han, X., & Sun, L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.764 · Cited by 55
Heterogeneous Region Embedding with Prompt Learning
Zhou, S., He, D., Chen, L., Shang, S., & Han, P. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25625 · Cited by 37
“Prompt shapes can be separated into cloze (Petroni et al. 2019; Cui et al. 2021) and prefix prompt (Li and Liang 2021; Lester, Al-Rfou, and Constant 2021).”
BackgroundSun, Y., Zheng, Y., Hao, C., & Qiu, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.03564 · Cited by 57
“, 2020; Schick and Schütze, 2021b,a) or L2R LM(Radford et al., 2019; Brown et al., 2020; Cui et al., 2021), are commonly used in token-level prompt-learning approaches.”
BackgroundMethodInfluentialmLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models
Ri, R., Yamada, I., & Tsuruoka, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.505 · Cited by 43
“Recent studies have shown that we can address various downstream tasks by querying a language model for blanks in prompts (Petroni et al., 2019; Cui et al., 2021).”
BackgroundA prompt model with combined semantic refinement for aspect sentiment analysis
Zhu, X., Kuang, Z., & Zhang, L. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103462 · Cited by 35
Type-Aware Decomposed Framework for Few-Shot Named Entity Recognition
Li, Y., Yu, Y., & Qian, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.598 · Cited by 39
Neuberger, J., Ackermann, L., van der Aa, H., & Jablonski, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-75872-0_3 · Cited by 36
Zhao, B., Jin, W., Zhang, Y., Huang, S., & Yang, G. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110928 · Cited by 32
Self-citationFlat-Lattice-CNN: A model for Chinese medical-named-entity recognition
Wang, S., Zhang, K., & Liu, A. (2025) · PLoS ONE · doi:10.1371/journal.pone.0331464 · Cited by 30
“Cui’s work shares similarities with Huang’s approach [16].”
He, K., Mao, R., Huang, Y., Gong, T., Li, C., & Cambria, E. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3314807 · Cited by 32
“Previous works normally defined OTHER with a unique representation [24], [48], [64].”
InfluentialZha, E., Zeng, D., Lin, M., & Shen, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111730 · Cited by 35
Bi-Directional Iterative Prompt-Tuning for Event Argument Extraction
Dai, L., Wang, B., Xiang, W., & Mo, Y. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.419 · Cited by 29
Few-Shot Class-Incremental Learning for Named Entity Recognition
Wang, R., Yu, T., Zhao, H., Kim, S., Mitra, S., Zhang, R., & Henao, R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.43 · Cited by 27
“Recently, (Cui et al., 2021) proposes Template NER, a few-shot friendly model for NER that convert NER into a sequence-to-sequence problem.”
MethodLightNER: A Lightweight Generative Framework with Prompt-guided Attention for Low-resource NERPreprint
Chen, X., Zhang, N., Li, L., Xie, X. Y., Deng, S., Tan, C., Huang, F., Si, L., & Chen, H. (2021) · arXiv (Cornell University) · Cited by 27
Cross-domain Named Entity Recognition via Graph Matching
Zheng, J., Chen, H., & Ma, Q. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.210 · Cited by 28
Inverse is Better! Fast and Accurate Prompt for Few-shot Slot Tagging
Hou, Y., Chen, C., Luo, X., Li, B., & Che, W. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.53 · Cited by 25
Few-shot Named Entity Recognition: Definition, Taxonomy and Research Directions
Moscato, V., Postiglione, M., & Sperlí, G. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3609483 · Cited by 33
“Template-based NER [22] IOB é Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð Ð 42.”
BackgroundMethodResultInfluentialKarakurt, E., & Akbulut, A. (2025) · Applied Sciences · doi:10.3390/app16010368 · Cited by 45
Prompt Consistency for Multi-Label Textual Emotion Detection
Zhou, Y., Kang, X., & Ren, F. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3254883 · Cited by 23
“Decomposition decomposes the prompt into multiple sub-prompts and is generally used for named entity recognition tasks [39].”
BackgroundA Dual Prompt Learning Framework for Few-Shot Dialogue State Tracking
Yang, Y., Lei, W., Huang, P., Cao, J., Li, J., & Chua, T. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583238 · Cited by 29
“To utilize the few-shot generation ability of PLMs via prompt learning, previous work [7, 18, 37] show that the design of prompt function � is a key factor that infuences the fnal performance.”
MethodPrompt-Based Metric Learning for Few-Shot NER
Chen, Y., Zheng, Y., & Yang, Z. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.451 · Cited by 25
“With the emergence of prompt-based methods in NLP research, very recently, some prompt-based approaches for few-shot NER have been proposed (Cui et al., 2021; Lee et al., 2022; Ma et al., 2021).”
BackgroundMethodTKDP: Threefold Knowledge-Enriched Deep Prompt Tuning for Few-Shot Named Entity Recognition
Liu, J., Fei, H., Li, F., Li, J., Li, B., Zhao, L., Teng, C., & Ji, D. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3389650 · Cited by 24
“Later, Cui et al. [11] first applied prompt tuning to the sequence tagging task, who created prompt templates by enumerating all possible mention spans.”
BackgroundMethodInfluentialSelf-citationLarge Language Model and Text Generation
Wu, Y. (2024) · Cognitive informatics in biomedicine and healthcare · doi:10.1007/978-3-031-55865-8_10 · Cited by 25
Self-citationRecent Advances in Named Entity Recognition: A Comprehensive Survey and Comparative StudyPreprint
Keraghel, I., Morbieu, S., & Nadif, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.10825 · Cited by 144
Aviation-BERT-NER: Named Entity Recognition for Aviation Safety Reports
Chandra, C., Ojima, Y., Bendarkar, M. V., & Mavris, D. N. (2024) · Aerospace · doi:10.3390/aerospace11110890 · Cited by 25
T 2 -NER: A Two-Stage Span-Based Framework for Unified Named Entity Recognition with Templates
Huang, P., Zhao, X. H., Hu, M., Tan, Z., & Xiao, W. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00602 · Cited by 24
“Cui et al. (2021) design templates and employ BART for pre-training and fine-tuning on templates to obtain entity types of given spans.”
MethodCausality Extraction from Medical Text Using Large Language Models (LLMs)
Gopalakrishnan, S., Garbayo, L., & Zadrozny, W. (2024) · Information · doi:10.3390/info16010013 · Cited by 30
Enhancing named entity recognition with external knowledge from large language model
Li, Q., Xie, T., Zhang, J., Ma, K., Su, J., Yang, K., & Wang, H. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113471 · Cited by 22
Robust and explainable identification of logical fallacies in natural language arguments
Sourati, Z., Venkatesh, V. P. P., Deshpande, D. G., Rawlani, H., Ilievski, F., Sandlin, H.-Â., & Mermoud, A. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110418 · Cited by 24
Prompting Language Models for Linguistic Structure
Blevins, T., Gonen, H., & Zettlemoyer, L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.367 · Cited by 36
Boosting Static Resource Leak Detection via LLM-based Resource-Oriented Intention Inference
Wang, C., Liu, J., Peng, X., Liu, Y., & Lou, Y. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00131 · Cited by 25
“In a recent survey by Liu et al. [26], prompt templates are broadly classified into two categories: cloze prompts [16, 31], which entail filling in the blanks in text or code, and prefix prompts [23, 25], which continue generating content following a specified prefix.”
Self-citationInformation Extraction in Low-Resource Scenarios: Survey and Perspective
Deng, S., Ma, Y., Zhang, N., Cao, Y., & Hooi, B. (2024) · IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg63256.2024.00013 · Cited by 25
“[122], [123], [126]–[128], [214] respectively applied a template-based, template-free, dynamic-template-filling, demonstration-based, lightweight and contrastive prompt-based method for few-shot NER.”
Short answer scoring with GPT-4
Jiang, L., & Bosch, N. (2024) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3657604.3664685 · Cited by 23
“Moreover, motivated by Cui et al. [11], who created one prompt for each prediction sub-task, we split the prompt for scoring with rationale into two sub-prompts: one for scoring and one for rationale.”
MethodGNNer: Reducing Overlapping in Span-based NER Using Graph Neural Networks
Zaratiana, U., Tomeh, N., Holat, P., & Charnois, T. (2022) · Annual Meeting of the Association for Computational Linguistics: Student Research Workshop (ACL SRW) · doi:10.18653/v1/2022.acl-srw.9 · Cited by 19
“In addition, with the growing popularity of prompt-based learning, recent work such as (Cui et al., 2021) considers NER as template filling by fine-tuning a BART (Lewis et al.”
BackgroundLee, U., Kim, Y., Lee, S., Park, J., Mun, J., Lee, E., Kim, H., Lim, C., & Yoo, Y. J. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00448-4 · Cited by 22
“Prompts in this context can be divided based on their form: cloze prompts, which are designed to fill in the blanks of a textual string, and prefix prompts, used to continue a string prefix (Cui et al., 2021; Petroni et al., 2019; Li & Liang, 2021).”
MANNER: A Variational Memory-Augmented Model for Cross Domain Few-Shot Named Entity Recognition
Fang, J., Wang, X., Meng, Z., Xie, P., Huang, F., & Jiang, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.234 · Cited by 18
“Moreover, prompt-based techniques (Cui et al., 2021; Ding et al., 2022; Chen et al., 2022) have also been proposed to address few-shot NER tasks.”
BackgroundBao, J., He, Y., Sun, Y., Liang, B., Du, J., Qin, B., Yang, M., & Xu, R. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.713 · Cited by 18
“…information extraction (IE) tasks, such as aspect-based sentiment analysis (Zhang et al., 2021b,a), named entity recognition (Ren et al., 2021; Cui et al., 2021; Zhang et al., 2022), event argument extraction (Li et al., 2021), etc. Closely related to our work, some recent studies incorporate…”
ResultGLAD: Content-Aware Dynamic Graphs For Log Anomaly Detection
Li, Y., Liu, Y., Wang, H., Chen, Z., Cheng, W. D., Chen, Y., Yu, W., Chen, H., & Liu, C. (2023) · IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg59574.2023.00007 · Cited by 21
“During training, we create prompts using gold fields following [51], [52].”
MethodRapid Adaptation of Chemical Named Entity Recognition Using Few-Shot Learning and LLM Distillation
Zhang, Y., Vlachos, D. G., Liu, D., & Fang, H. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c00248 · Cited by 16
Self-citationZeng, J., Yin, Y., Jiang, Y., Wu, S., & Cao, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.522 · Cited by 18
Lu, W., Jiang, J., Shi, Y., Zhong, X., Gu, J., Huangfu, L., & Gong, M. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1259652 · Cited by 18
Wang, Z., Huang, M., Li, C., et al. (2023) · Applied Sciences · doi:10.3390/app13053024 · Cited by 15
2INER: Instructive and In-Context Learning on Few-Shot Named Entity Recognition
Zhang, J., Liu, X., Lai, X., Gao, Y. F., Wang, S., Hu, Y., & Lin, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.259 · Cited by 16
“…De Meulder, 2003) and for the low-resource domain, we use three datasets: MIT Movie Review, MIT Restaurant Review (Liu et al., 2013) and Air-line Travel Information Systems (ATIS) (Hakkani-3 Tür et al., 2016), following (Wang et al., 2022; Chen et al., 2022b; Cui et al., 2021; Yan et al., 2021).”
BackgroundMethodOut-of-Distribution Generalization in Natural Language Processing: Past, Present, and Future
Yang, L., Song, Y., Ren, X., Lyu, C., Wang, Y., Zhuo, J., Liu, L., Wang, J., Foster, J., & Zhang, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.276 · Cited by 21
Self-citationExemplar-Free Lifelong Person Re-identification via Prompt-Guided Adaptive Knowledge Consolidation
Li, Q., Xu, K., Peng, Y., & Zhou, J. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02110-x · Cited by 16
“Although some recent works (Petroni et al., 2019; Cui et al., 2021) demonstrated that manually designed prompts can improve the generalization ability of models, designing prompts needs specific domain knowledge which is indeed difficult.”
Jin, W., Wang, N., Tao, T., Jiang, M., Xing, Y., Zhao, B., Wu, H., Duan, H., & Yang, G. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110122 · Cited by 17
Software requirement specific entity extraction using transformer models
Malik, G., Çevik, M., Bera, S., Yıldırım, S., Parikh, D., & Basar, A. (2022) · doi:10.21428/594757db.9e433d7c · Cited by 18
Legal judgment prediction via legal knowledge extraction and fusion
Zhao, Q. (2025) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-025-00019-0 · Cited by 17
“Cui et al. (2021) is the first paper to apply the Prompt method to the sequence labeling task.”
Multilingual Relation Classification via Efficient and Effective Prompting
Chen, Y., Harbecke, D., & Hennig, L. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.69 · Cited by 21
Prompt-based Connective Prediction Method for Fine-grained Implicit Discourse Relation Recognition
Zhou, H., Lan, M., Wu, Y., Chen, Y., & Ma, M. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.282 · Cited by 15
Self-citationKeyEE: Enhancing Low-Resource Generative Event Extraction with Auxiliary Keyword Sub-Prompt
Duan, J., Liao, X., An, Y., & Wang, J. (2024) · Big Data Mining and Analytics · doi:10.26599/bdma.2023.9020036 · Cited by 14
GFMRC: A machine reading comprehension model for named entity recognition
Fei, Y., & Xu, X. (2023) · Pattern Recognition Letters · doi:10.1016/j.patrec.2023.06.011 · Cited by 14
Cui, Z., Yu, K., Yuan, Z., Dong, X., & Luo, W. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104559 · Cited by 13
A Two-Stage Boundary-Enhanced Contrastive Learning approach for nested named entity recognition
Liu, Y., Zhang, K., Tong, R., Cai, C., Chen, D., & Wu, X. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126707 · Cited by 13
KGNER: Improving Chinese Named Entity Recognition by BERT Infused with the Knowledge Graph
Hu, W., He, L., Ma, H., Wang, K., & Xiao, J. (2022) · Applied Sciences · doi:10.3390/app12157702 · Cited by 13
“Yan et al. [32] used BART to solve three types of NER tasks, and Cui et al. [33] used BART to solve how to transfer richer domain knowledge to a sparse knowledge domain, and all of them achieved good results.”
MethodKnowledge-Enriched Prompt for Low-Resource Named Entity Recognition
Hou, W., Zhao, W., Liu, X., & Guo, W. (2024) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3659948 · Cited by 13
“Similarly, Cui et al. [4] employ a prompt-based approach for few-shot NER, which incurs high computation costs.”
BackgroundMethodInfluentialPolarity-aware deep attention network for aspect-based sentiment analysis
Wadawadagi, R. S., Tiwari, S., & Pagi, V. B. (2024) · Progress in Artificial Intelligence · doi:10.1007/s13748-024-00352-x · Cited by 14
Decomposed Two-Stage Prompt Learning for Few-Shot Named Entity Recognition
Ye, F., Huang, L. P., Liang, S., & Chi, K. (2023) · Information · doi:10.3390/info14050262 · Cited by 17
A Composable Generative Framework Based on Prompt Learning for Various Information Extraction Tasks
Kan, Z., Feng, L., Yin, Z., Qiao, L., Qiu, X., & Li, D. (2023) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2023.3278977 · Cited by 17
Named Entity Recognition as Structured Span Prediction
Zaratiana, U., Tomeh, N., Holat, P., & Charnois, T. (2022) · doi:10.18653/v1/2022.umios-1.1 · Cited by 15
“In addition, recent work such as (Cui et al., 2021) considers NER as template filling by fine-tuning a BART (Lewis et al., 2019) encoder-decoder model.”
BackgroundCoarse-to-fine Few-shot Learning for Named Entity Recognition
Ma, R., Zhang, L., Chen, X., Zhou, X., Wang, J., Gui, T., Zhang, Q., Gao, X., & Chen, Y. W. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.253 · Cited by 11
“Recently, an increasing number of researchers have focused on Few-shot NER and made contributions to this task (Yang and Katiyar, 2020; Huang et al., 2021; Cui et al., 2021; Ma et al., 2022; Tong et al., 2021).”
Xu, S., Li, P., & Zhu, Q. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.954 · Cited by 11
Decoupled Hyperbolic Graph Attention Network for Cross-domain Named Entity Recognition
Xu, J., & Cai, Y. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591662 · Cited by 10
“Moreover, the fine-tuned methods also show strong performance, which first pre-trains a model using the samples from source domains, then uses the samples from the target domain to fine-tune the model [3, 22, 24, 26, 34, 37].”
MethodINSNER: A generative instruction-based prompting method for boosting performance in few-shot NER
Zhao, P., Feng, C., Li, P., Dong, G., & Wang, S. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2024.104040 · Cited by 11
ContrastNER: Contrastive-based Prompt Tuning for Few-shot NER
Layegh, A., Payberah, A. H., Soylu, A., Roman, D., & Matskin, M. (2023) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac57700.2023.00038 · Cited by 17
“Suggested by [11], the masked hard prompt initialized as "〈candidate_entity〉 is a [MASK] entity".”
BackgroundMethodInfluentialFocusing, Bridging and Prompting for Few-shot Nested Named Entity Recognition
Xu, Y., Yang, Z., Zhang, L., Zhou, D., Wu, T., & Zhou, R. F. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.164 · Cited by 10
“…flat NER task, mainly including sequence-labeling-based (Huang et al., 2021; Ma et al., 2022b,a; Yang and Katiyar, 2020; Das et al., 2022; Huang et al., 2022b), generative-based (Cui et al., 2021; Hou et al., 2022; Chen et al., 2022) and span-based (Yang et al., 2022; Wang et al., 2022b) methods.”
Method
Metadata
- Authors
- Cui, L., Wu, Y., Liu, J., Yang, S., & Zhang, Y.
- Affiliations
- Westlake University (CN)
- Zhejiang University (CN)
- Corresponding author
- Zhang, Yue
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 1835-1845
- arXiv
- 2106.01760
- OpenAlex
- W3176489198
- Semantic Scholar
- ce498651107588db67adcfbb5479bdb416f4de2f
- Cited by
- 342
- References
- 38
- Citations by year
- 2026: 16 · 2025: 65 · 2024: 80 · 2023: 121 · 2022: 56 · 2021: 4
- FWCI
- 30.09
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Findings of the Association for Computational Linguistics: ACL (Findings of ACL) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61976180)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- named entity recognition, few-shot learning, BART, Seq2Seq, low-resource domains, knowledge transfer, domain adaptation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
