The DOI matches its DataCite record; 38 of the 38 references it cites were found in a registry or an index.
Template-Based Named Entity Recognition Using BART
Open accessAbstract
There is a recent interest in investigating few-shot NER, where the low-resource target domain has different label sets compared with a resource-rich source domain. Existing methods use a similarity-based metric. However, they cannot make full use of knowledge transfer in NER model parameters. To address the issue, we propose a template-based method for NER, treating NER as a language model ranking problem in a sequence-to-sequence framework, where original sentences and statement templates filled by candidate named entity span are regarded as the source sequence and the target sequence, respectively. For inference, the model is required to classify each candidate span based on the corresponding template scores. Our experiments demonstrate that the proposed method achieves 92.55% F1 score on the CoNLL03 (rich-resource task), and significantly better than fine-tuning BERT 10.88%, 15.34%, and 11.73% F1 score on the MIT Movie, the MIT Restaurant, and the ATIS (low-resource task), respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Cui et al. [17] manually design lists such as”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [17]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Token or text-span answer spaces are widely used in classification tasks (e.g., sentiment classification; Yin et al. [144]) as well as in other tasks such as relation extraction [100] or named entity recognition [17].”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 3×
“The current dominant methods use a sequential neural network such as BiLSTM (Hochreiter and Schmidhuber, 1997) and BERT (Devlin et al., 2019) is used to represent the input text, and softmax (Chiu and Nichols, 2016; Strubell et al., 2017; Cui and Zhang, 2019) or CRF (Lample et al., 2016; Ma and…”
MethodJakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 5×
“We use BERT (Devlin et al., 2019) and BART (Lewis et al.”
MethodInfluential(2008) · Journal of Machine Learning Research · Cited by 33,051
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821 · cited 3×
“We use BERT (Devlin et al., 2019) and BART (Lewis et al., 2020) as our E NCODER to learn the sequence representation.”
MethodResultNeural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401 · cited 6×
“Third, compared with traditional meth-ods (pre-trained model with a softmax/CRF), our method can be applied to arbitrary new categories of named entities without changing the output layer, and therefore allows continual learning (Lin et al., 2020).”
BackgroundMethodInfluentialIntroduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788 · cited 2×
“Named entity recognition (NER) is a fundamental task in natural language processing, which identi-fies mention spans from text inputs according to pre-defined entity categories (Tjong Kim Sang and De Meulder, 2003), such as location, person, organization, etc.”
BackgroundMethodEnd-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Ma, X., & Hovy, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1101 · Cited by 2,567 · cited 6×
“Third, compared with traditional meth-ods (pre-trained model with a softmax/CRF), our method can be applied to arbitrary new categories of named entities without changing the output layer, and therefore allows continual learning (Lin et al., 2020).”
BackgroundMethodInfluentialNamed Entity Recognition with Bidirectional LSTM-CNNs
Chiu, J., & Nichols, E. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00104 · Cited by 2,007 · cited 4×
“, 2019) is used to represent the input text, and softmax (Chiu and Nichols, 2016; Strubell et al., 2017; Cui and Zhang, 2019) or CRF (Lample et al.”
MethodInfluential
Flagged first, then by citations
Research works printed but not linked: 1
- Jie Yang, Shuailong Liang, and Yue Zhang. 2018. De- sign challenges and misconceptions in neural se- quence labeling. In Proceedings of the 27th Inter- national Conference on Computational Linguistics, pages 3879-3889, Santa Fe, New Mexico, USA. As- sociation for Computational Linguistics.
Cited by
Sorted by citations
Items 101–200 of 342
Retrieval-Augmented Few-shot Text Classification
Yu, G., Liu, L., Jiang, H., Shi, S., & Ao, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.447 · Cited by 13
Zero-shot Triplet Extraction by Template Infilling
Kim, B., Iso, H., Bhutani, N., Junior, E. R. H., Nakashole, N., & Mitchell, T. M. (2023) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2023.ijcnlp-main.18 · Cited by 19
Discourse-Aware Soft Prompting for Text Generation
Ghazvininejad, M., Karpukhin, V., Gor, V., & Çelikyılmaz, A. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.303 · Cited by 12
Yu, Y., He, W. P., Kang, Y.-M., & Ji, Y. (2022) · Data Intelligence · doi:10.1162/dint_a_00202 · Cited by 9
“Among them, Template-BART takes the longest because it also needs to enumerate entity spans and entity types.”
InfluentialText-Image Scene Graph Fusion for Multimodal Named Entity Recognition
Cheng, J., Long, K., Zhang, S., Zhang, T., Ma, L., Cheng, S., & Guo, Y. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3326416 · Cited by 10
Generalizing Few-Shot Named Entity Recognizers to Unseen Domains with Type-Related Features
Wang, Z., Zhao, Z., Chen, Z., Ren, P., de Rijke, M., & Ren, Z. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.147 · Cited by 13
Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse Finetuning
Das, S. S. S., Zhang, H., Shi, P., Yin, W., & Zhang, R. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.433 · Cited by 26
Shi, X., Hu, M., Ren, F., Shi, P., & Nakagawa, S. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05492-0 · Cited by 10
Few-shot relational triple extraction with hierarchical prototype optimization
Gao, C., Zhang, X., Jin, Z. G., Shang, W., Ma, Y., Li, L., Ding, Z., & Liang, Y. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110779 · Cited by 9
Zhuang, Y., Zhang, J., Li, X., Liu, C., Yu, Y., Dong, W., & He, K. (2024) · JMIR Medical Informatics · doi:10.2196/63020 · Cited by 10
Exploring Pre-Trained Language Models to Build Knowledge Graph for Metal-Organic Frameworks (MOFs)
An, Y., Greenberg, J., Hu, X. T., Kalinowski, A., Fang, X., Zhao, X., McClellan, S., Uribe‐Romo, F. J., Langlois, K., Furst, J. D., et al. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020568 · Cited by 12
“More sophisticated answer processing could be developed to extract the correct answers from the output space of a PLM. Researchers have developed manual approaches using verbalizers [14], [25], [38], [51] and automatic methods through paraphrasing [26], pruning [43], and label decomposition [12].”
BackgroundMethodAPI comparison knowledge extraction via prompt-tuned language model
Yang, Y., Zhu, Y., Chen, S., & Jian, P. (2023) · Journal of Computer Languages · doi:10.1016/j.cola.2023.101200 · Cited by 9
Few-shot named entity recognition with hybrid multi-prototype learning
Liao, Z., Fei, J., Zeng, W., & Zhao, X. H. (2023) · World Wide Web · doi:10.1007/s11280-023-01143-5 · Cited by 9
“While some cross-lingual enhanced [10, 38] and cross-domain enhanced [28, 42] methods aim to transfer the capability obtained in high resource to low resource, templates-based NER [3] follows templates-based NLP [29, 30] and treats NER as a language model problem by ranking sentences filled by candidate named entity s…”
BackgroundPrompted and integrated textual information enhancing aspect-based sentiment analysis
Shi, X., Hu, M. Q., Ren, F., Shi, P., Deng, J., & Tang, Y. (2023) · Journal of Intelligent Information Systems · doi:10.1007/s10844-023-00805-0 · Cited by 10
“As noted above, prompts can be mainly concluded in two groups: cloze prompts Petroni et al. (2019), Cui et al. (2021), which use textual string to fill in the blanks, and prefix prompts Li and Liang (2021), Lester et al. (2021), which continue a string prefix.”
Prompt-based event relation identification with Constrained Prefix ATTention mechanism
Zhang, H., Ke, W., Zhang, J., Luo, Z., Ma, H., Luan, Z., & Wang, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111072 · Cited by 10
Causal Intervention-based Few-Shot Named Entity Recognition
Yang, Z., Liu, Y., & Ouyang, C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1046 · Cited by 11
Interpretable Transformers for Alzheimer Disease Diagnosis on Multi-modal Data
Kamal, M. S., & Nimmy, S. F. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651416 · Cited by 10
Contrastive Demonstration Tuning for Pre-trained Language Models
Liang, X., Zhang, N., Cheng, S., Zhang, Z., Tan, C., & Chen, H. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.56 · Cited by 11
Yang, Z., Ma, J., Yang, K., Lin, H., Chen, H., Yang, R., & Chang, Y. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103657 · Cited by 8
Improving few-shot named entity recognition via Semantics induced Optimal Transport
Zhou, D., Li, S., Chen, Q., & Yao, H. L. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127938 · Cited by 9
A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models
Song, Y., He, Y., Zhao, X.-F., Gu, H., Jiang, D., Yang, H., & Fan, L. (2024) · Journal of Computer Science and Technology · doi:10.1007/s11390-024-4058-8 · Cited by 11
“Furthermore, in certain tasks like text classification, question answering, or entity recognition, answers are crafted manually as word lists that pertain to relevant topics [25, 27].”
BackgroundInfluentialPosition-based Prompting for Health Outcome Generation
Abaho, M., Bollegala, D., Williamson, P. R., & Dodd, S. R. (2022) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2022.bionlp-1.3 · Cited by 12
Improving unified named entity recognition by incorporating mention relevance
Ji, L., Yan, D., Cheng, Z., & Song, Y. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08820-6 · Cited by 8
Named Entity Recognition for Few-Shot Power Dispatch Based on Multi-Task
Tan, Z., Chen, Y., Liang, Z., Meng, Q., & Lin, D. (2023) · Electronics · doi:10.3390/electronics12163476 · Cited by 8
“Cui [20] proposed the TemplateNERmodel to enumerate all text spans of a text as candidate entity labels by an exhaustive method and construct the corresponding prompt templates [21] to pass into the Seq‐to‐Seq model [22] for classification.”
MethodGenerating Variable Explanations via Zero-shot Prompt Learning
Wang, C., Lou, Y., Liu, J., & Peng, X. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00130 · Cited by 10
“In a recent survey by Liu et al. [56], prompt templates are broadly classified into two categories: cloze prompts [57], [13], which entail filling in the blanks in text or code, and prefix prompts [58], [59], which continue generating content following a specified prefix.”
Self-citationPrompt Tuning for Multi-Label Text Classification: How to Link Exercises to Knowledge Concepts?
Wei, L., Li, Y., Zhu, Y. Q., Li, B., & Zhang, L. (2022) · Applied Sciences · doi:10.3390/app122010363 · Cited by 11
“For example, Cui et al. [37] employed closed prompts filled by a candidate named entity span as the target sequence in named entity recognition tasks.”
Improving Few-Shot Named Entity Recognition with Causal Interventions
Yang, Z., Liu, Y., Ouyang, C., Zhao, S. G., & Zhu, C. (2024) · Big Data Mining and Analytics · doi:10.26599/bdma.2024.9020052 · Cited by 10
Zhao, Q., Gao, T., & Guo, N. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104129 · Cited by 10
Few-Shot Composition Learning for Image Retrieval with Prompt Tuning
Wu, J., Wang, R., Zhao, H., Zhang, R., Lu, C., Li, S., & Henao, R. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25597 · Cited by 8
“…works use hard prompts, e.g., handcrafted template words for classification (Gao, Fisch, and Chen 2020; Hu et al. 2021), named entity recognition (Cui et al. 2021), etc. Recently, studies have shown that training with soft prompts (Hambardzumyan, Khachatrian, and May 2021; Li and Liang 2021;…”
BackgroundXu, W., & Ouyang, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-44192-9_1 · Cited by 7
SIG: Speaker Identification in Literature via Prompt-Based Generation
Su, Z., Xu, L., Xu, J., Li, J., & Huangfu, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29870 · Cited by 14
Ma, Y., Liu, J., Lü, W., & Cheng, Q. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103315 · Cited by 7
Self-citationWang, Z., Zhao, K., Wang, Z., & Shang, J. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.232 · Cited by 9
Global Constraints with Prompting for Zero-Shot Event Argument Classification
Lin, Z., Zhang, H., & Song, Y. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.191 · Cited by 9
Ten Natural Language Processing Tasks with Generative Artificial Intelligence
Golec, J., & Hachaj, T. (2025) · Applied Sciences · doi:10.3390/app15169057 · Cited by 14
KBPT: knowledge-based prompt tuning for zero-shot relation triplet extraction
Guo, Q., Guo, Y., & Zhao, J. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2014 · Cited by 8
Zero-Shot Relation Triple Extraction with Prompts for Low-Resource Languages
Halike, A., Wumaier, A., & Yibulayin, T. (2023) · Applied Sciences · doi:10.3390/app13074636 · Cited by 7
Multimodal Propaganda Detection Via Anti-Persuasion Prompt enhanced contrastive learning
Cui, J., Li, L., Zhang, X., & Yuan, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096771 · Cited by 6
DORE: Document Ordered Relation Extraction based on Generative Framework
Guo, Q., Yang, Y., Yan, H., Qiu, X., & Zhang, Z. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.253 · Cited by 6
Prompt-WNQA: A prompt-based complex question answering for wireless network over knowledge graph
Liu, P., Qian, B., Sun, Q., & Zhao, L. (2023) · Computer Networks · doi:10.1016/j.comnet.2023.110014 · Cited by 7
Chinese Nested Named Entity Recognition Based on Boundary Prompt
Li, Z., Song, M. N., Zhu, Y., & Zhang, L. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-6222-8_28 · Cited by 6
A Query-Parallel Machine Reading Comprehension Framework for Low-resource NER
Zhang, Y., & Wang, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.135 · Cited by 6
“For cross-domain low-resource setting, we use the CrossNER dataset (Liu et al., 2021) (Yan et al., 2021) methods as well as state-of-the-art approaches, including the classic BiLSTM-CRF (Ma and Hovy, 2016) and BERT-Tagger (Devlin et al., 2019), single query machine reading comprehension method BERT-MRC (Li et al., 202…”
MethodInfluentialSelf-citationTian, C., Yin, W., Li, D., & Moens, M. (2024) · IEEE Access · doi:10.1109/access.2024.3374727 · Cited by 6
“Prompt-based models have been studied extensively [6], [25], [26].”
BackgroundScalable Prompt Generation for Semi-supervised Learning with Language Models
Zhou, Y., Maharjan, S., & Liu, B. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.58 · Cited by 10
Schema-adaptable Knowledge Graph Construction
Ye, H., Gui, H., Xu, X., Chen, X., Chen, H., & Zhang, N. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.425 · Cited by 10
Eliciting Knowledge from Language Models for Event Extraction.Preprint
Lin, J., Jin, J., & Chen, Q. (2021) · arXiv (Cornell University) · Cited by 7
PromptCNER: A Segmentation-based Method for Few-shot Chinese NER with Prompt-tuning
Mai, C., Chen, Y., Gong, Z., Wang, H., Qiu, M., Yuan, C., & Huang, Y. (2024) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3705314 · Cited by 6
“To alleviate the low-data problems, the few-shot NER methods have attracted high attention recently [4].”
InfluentialFGVIrony: A Chinese Dataset of Fine-grained Verbal Irony
Wen, Z., Wang, R., Wang, Q., Gui, L., Long, Y., Chen, S., Liang, B., Yang, M., & Xu, R. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104169 · Cited by 5
CyberDualNER: A Dual-Stage Approach for Few-Shot Named Entity Recognition in Cybersecurity
Zheng, C., Lu, C., Li, C., Zheng, Z., & Pan, L. (2025) · Electronics · doi:10.3390/electronics14091791 · Cited by 7
Evaluating various Finetuned LLMs for Cybersecurity Named Entity Recognition
Shanmukha Aditya, G., Kruthika, B., Venkata Sneha, G., Gupta, D., & Srivastava, S. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.04.444 · Cited by 5
Wang, Y., Lin, M., Hu, Q., Bao, L., Bai, S., & Li, Y. (2025) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-025-00055-w · Cited by 8
“On the other hand, previous studies have shown that small language models (SLMs) based on prompt learning can effectively learn entity spans and segment information by combining prompt information with contextual semantics (Cui et al. 2021; Liu et al. 2022).”
He, H. W., & Choi, J. D. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00557 · Cited by 6
“While our focus is the potential of S2S, we mainly consider two strong baselines that also use BART as the only external resource: the generative BART-Pointer framework (Yan et al., 2021) and the recent template-based BART NER (Cui et al., 2021).”
BackgroundMethodInfluentialJung, D., Park, C., Eo, S., & Lim, H. (2023) · Mathematics · doi:10.3390/math11194169 · Cited by 5
“Considering these, we construct a template that reformulates tasks in a cloze style to fill the masked part in the given input text [23,24].”
GL-NER: Generation-Aware Large Language Models for Few-Shot Named Entity Recognition
Zhu, X., Dai, F., Gu, X., Li, B., Zhang, M., & Wang, W. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72350-6_30 · Cited by 8
Bridging the Gap between Language Models and Cross-Lingual Sequence Labeling
Chen, N., Shou, L., Gong, M., Pei, J., & Jiang, D. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.139 · Cited by 5
Diverse and High-Quality Data Augmentation Using GPT for Named Entity Recognition
Chen, H., Zhang, W., Cheng, L., & Ye, H. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-1648-1_23 · Cited by 5
Zero-Shot Slot Filling with Slot-Prefix Prompting and Attention Relationship Descriptor
Luo, Q., & Liu, L. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26566 · Cited by 5
“Prompt is a token, sentence, or template which reformulates the input of an NLP task to better explore the intrinsic knowledge of PLMs, and it achieved success in various NLP tasks (Radford et al. 2019; Petroni et al. 2019; Cui et al. 2021; Schick and Schütze 2021).”
BackgroundSLNER: Chinese Few-Shot Named Entity Recognition with Enhanced Span and Label Semantics
Ren, Z., Qin, X., & Ran, W. (2023) · Applied Sciences · doi:10.3390/app13158609 · Cited by 7
Improved Word Sense Disambiguation via Prompt-based Contextual Word Representation
He, Q., Zhang, J., & Huang, X. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191929 · Cited by 5
“Multi-prompt learning is a collection of these two engineering prompts aimed at improving model generality, and there are typically several methods of multi-template learning, such as prompt augmentation [12], prompt composition [13], and prompt decomposition [14].”
MethodMetricPrompt: Prompting Model as a Relevance Metric for Few-shot Text Classification
Dong, H., Zhang, W., & Che, W. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599430 · Cited by 6
Name entity recognition for Air Traffic Control transcripts using deep learning based approach
Brundha, J., Nair, P. C., Gupta, D., & Agarwal, J. (2023) · IEEE India Conference · doi:10.1109/indicon59947.2023.10440794 · Cited by 5
PMRC: Prompt-Based Machine Reading Comprehension for Few-Shot Named Entity Recognition
Huang, J., Yan, D., & Cai, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29791 · Cited by 5
“For example, in the NER field, (Cui et al. 2021) redefine the task as a cloze-style task, where prompts are used to guide the model to fill in the missing entity information.”
BackgroundMethodInfluentialBetter Results Through Ambiguity Resolution: Large Language Models that Ask Clarifying Questions
Tix, B., & Binsted, K. A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-61572-6_6 · Cited by 6
A Prompt-Based Hierarchical Pipeline for Cross-Domain Slot Filling
Wei, X., Li, Y., Si, Y., Wang, L., Wang, X., & Dang, J. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3410877 · Cited by 5
TI-Prompt: Towards a Prompt Tuning Method for Few-shot Threat Intelligence Twitter Classification
You, Y., Jiang, Z., Zhang, K., Jiang, J., Wang, X., Zhang, Z., Wang, S., & Feng, H. (2022) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac54236.2022.00046 · Cited by 6
Improving Biomedical Entity Linking with Cross-Entity Interaction
Xu, Z., Chen, Y., & Hu, B. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26624 · Cited by 7
“There are mainly two types of prompts: (1) cloze prompt (Cui et al. 2021): filling in the blanks of a textual string, suitable for PLMs with MLM pretraining task.”
BackgroundAutomatic Creation of Named Entity Recognition Datasets by Querying Phrase Representations
Kim, H., Yoo, J., Yoon, S., & Kang, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.394 · Cited by 6
PNeSM: Arbitrary 3D Scene Stylization via Prompt-Based Neural Style Mapping
Chen, J., Xing, W., Sun, J., Chu, T., Huang, Y., Ji, B., Zhao, L., Lin, H., Chen, H., & Wang, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i2.27870 · Cited by 5
“Cui et al. 2021; Petroni et al. 2019) manually design text prompts, achieving impressive results in few-shot or even zero-shot settings.”
BackgroundDomain-control prompt-driven zero-shot relational triplet extraction
Xu, L., Gao, C., & Tian, X. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127270 · Cited by 4
FE-CFNER: Feature Enhancement-based approach for Chinese Few-shot Named Entity Recognition
Yang, S., Lai, P., Fang, R., Fu, Y.-G., Ye, F., & Wang, Y. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101730 · Cited by 5
Self-citationPAVE: Lazy-MDP based Ensemble to Improve Recall of Product Attribute Extraction Models
Kumar, K., & Saladi, A. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557119 · Cited by 5
“[8] ranked entity templates on different answer spans using pre-trained BART.”
MethodFLightNER: A Federated Learning Approach to Lightweight Named-Entity Recognition
Abadeer, M., Shi, W., & Corriveau, J. (2022) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom56396.2022.00098 · Cited by 4
“Template-based prompting apply non-continuous prompts to NER [24].”
BackgroundDecoupled Two-Phase Framework for Class-Incremental Few-Shot Named Entity Recognition
Chen, Y., Huang, Z., Hu, M., Li, D., Wang, C., Liu, F., & Lu, X. (2023) · Tsinghua Science & Technology · doi:10.26599/tst.2022.9010043 · Cited by 4
Simple Questions Generate Named Entity Recognition Datasets
Kim, H., Yoo, J., Yoon, S., Lee, J., & Kang, J. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.417 · Cited by 6
“We excluded some few-shot NER models because they use a sufficient amount of source data (Yang and Katiyar, 2020; Cui et al., 2021), which differs from our setting.”
Evaluating the Robustness of Discrete Prompts
Ishibashi, Y., Bollegala, D., Sudoh, K., & Nakamura, S. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.174 · Cited by 7
CLINER: exploring task-relevant features and label semantic for few-shot named entity recognition
Li, X., Li, X. D., Zhao, M., et al. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-09285-3 · Cited by 4
“Cui et al. [27] apply prompt-based techniques to Few-Shot NER, use sequence to sequence models to fill named entities in pre-defined templates.”
A Systematic Review of Computational Approaches to Deciphering Bronze Age Aegean and Cypriot Scripts
Braović, M., Krstinić, D., Štula, M., & Ivanda, A. (2024) · Computational Linguistics · doi:10.1162/coli_a_00514 · Cited by 7
Acupuncture and tuina knowledge graph with prompt learning
Li, X., Han, X., Wei, S., et al. (2024) · Frontiers in Big Data · doi:10.3389/fdata.2024.1346958 · Cited by 4
“TemplateNER (Cui et al., 2021): A Prompt Learning approach: using generative BART models for sequence annotation tasks and exploring the potential of BART models for few-shot scenarios using a Template-based approach.”
MethodSu, L., Chen, J., Peng, Y., & Sun, C. H. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104739 · Cited by 5
MPE 3 : Learning meta-prompt with entity-enhanced semantics for few-shot named entity recognition
Xia, Y., Zhao, T., Wang, L., Liu, Q., Wu, S., & Zhang, X. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.129031 · Cited by 5
PII Data Detection using Keras & NLP
Kommathoti, Y. R., Neha, P., Pabbathi, S., et al. (2024) · doi:10.1109/delcon64804.2024.10866085 · Cited by 4
“[12] III.”
HYLR-FO: Hybrid Approach Using Language Models and Rule-Based Systems for On-Device Food Ordering
Yang, S., Kim, D., & Lee, S.-J. (2025) · Electronics · doi:10.3390/electronics14040775 · Cited by 5
Self-citationVillena, F., Pablo Báez, B., Peñafiel, S., Rojas, M. S., Paredes, I., & Dunstan, J. (2025) · JCO Clinical Cancer Informatics · doi:10.1200/cci.24.00124 · Cited by 4
“…architectures, which have achieved the state-of-the-art results in several data sets from different domains and languages, as in the works of Cui et al, 7 Sapci et al, 8 and Das et al. 9 A recently published work showed the ef fi cacy of NLP to detect metastasis mentions in pathology reports.”
Zhou, C., Huang, B., & Ling, Y. (2025) · Applied Sciences · doi:10.3390/app15115801 · Cited by 5
“The prompt template consists of a discrete sequence of text [22,36]; • Soft prompt.”
A survey of Few-Shot Relation Extraction combining meta-learning with prompt learning
Hang, T., Wu, W., Feng, J., Djigal, H., & Huang, J. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130534 · Cited by 5
Guo, Y. Q., Feng, S., Liu, F., Lin, W., Li, L., Wang, X., Su, J., & Gao, Q. (2023) · Applied Sciences · doi:10.3390/app14010354 · Cited by 4
Informed Named Entity Recognition Decoding for Generative Language Models
Deußer, T., Hillebrand, L., Bauckhage, C., & Sifa, R. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825603 · Cited by 13
“In a way, this has been studied in [29] and in [30], where the extraction task was modeled as a translation task with an encoder-decoder setup, but both did not introduce a way to control for model hallucinations and used different templates.”
Exploiting Morpheme and Cross-lingual Knowledge to Enhance Mongolian Named Entity Recognition
Zhang, S., Zhang, Y., Chen, Y., Du, W., Xu, J., & Liu, J. (2022) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3511098 · Cited by 4
“Cui et al. [10] proposed a template-based method for low-resource NER with the help of generative pre-trained language model BART [21].”
MethodSelf-citationPlug-Tagger: A Pluggable Sequence Labeling Framework Using Language ModelsPreprint
Zhou, X., Ma, R., Gui, T., Tan, Y., Zhang, Q., & Huang, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07331 · Cited by 6
“To get the better use of knowledge in pretrained models, (Han et al. 2021; Schick and Schütze 2021; Cui et al. 2021; Wang et al. 2021; Chen et al. 2021; Liu et al. 2021) reformulate the paradigm of downstream tasks into new task that similar to pre-training.”
MethodGallego, F., & Veredas, F. J. (2024) · Database · doi:10.1093/database/baae087 · Cited by 4
“Following this approach, Cui and collaborators [8] proposed a series of templates designed to adapt a BART [9] model to zero or few-shot scenarios for NER.”
BackgroundLin, X., Hei, J., Wang, Y., et al. (2025) · Frontiers in Environmental Science · doi:10.3389/fenvs.2025.1612446 · Cited by 3
MSPF: A multi-semantic prompting fusion framework for emotion-cause pair extraction in conversations
Xie, B., Wang, J., Guo, H., Chen, P., Zhang, H., Jiang, B., Wang, Y., & Chen, L. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104356 · Cited by 4
PROMPT-BART: A Named Entity Recognition Model Applied to Cyber Threat Intelligence
Feng, X., He, S., Wei, X., Liu, R., Yue, H., & Wang, X. (2025) · Applied Sciences · doi:10.3390/app151810276 · Cited by 3
“Moreover, Cui et al. [25] proposed a template-based sequence-to-sequence method, Template-NER, which formulates NER as a language model ranking problem.”
From Legacy to Standard: LLM-Assisted Transformation of Cybersecurity Playbooks into CACAO Format
Akbari Gurabi, M., Nitz, L., Castravet, R.-M., Matzutt, R., Mandal, A., & Decker, S. (2026) · Lecture Notes in Computer Science · doi:10.1007/978-3-032-16092-8_27 · Cited by 3
Less is More: A Prototypical Framework for Efficient Few-Shot Named Entity Recognition
Zhang, Y., & Fang, H. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35320-8_3 · Cited by 3
Self-citationBuhl, D., Szafarski, D., Welz, L., & Lanquillon, C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35894-4_3 · Cited by 3
CDANER: Contrastive Learning with Cross-domain Attention for Few-shot Named Entity Recognition
Li, W., Li, H., Ge, J., Zhang, L., Li, L., & Wu, B. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191439 · Cited by 3
Document-level relation extraction with multi-semantic knowledge interaction
Hou, W., Wu, W., Liu, X., & Zhao, W. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121083 · Cited by 3
A Flat-Span Contrastive Learning Method for Nested Named Entity Recognition
Liu, Y., Zhang, K., Tong, R., Cai, C., Chen, D., & Wu, X. (2024) · International Conference on Asian Language Processing · doi:10.1109/ialp63756.2024.10661137 · Cited by 3
“Additionally, Cui et al. [9] framed the NER problem as a language model ranking issue within the seq2seq framework.”
BackgroundThreat Detection Framework Based on Industrial Internet of Things Logs
Zhang, S., Wang, Y., & Su, X. (2024) · IEEE Access · doi:10.1109/access.2024.3514097 · Cited by 3
Metadata
- Authors
- Cui, L., Wu, Y., Liu, J., Yang, S., & Zhang, Y.
- Affiliations
- Westlake University (CN)
- Zhejiang University (CN)
- Corresponding author
- Zhang, Yue
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 1835-1845
- arXiv
- 2106.01760
- OpenAlex
- W3176489198
- Semantic Scholar
- ce498651107588db67adcfbb5479bdb416f4de2f
- Cited by
- 342
- References
- 38
- Citations by year
- 2026: 16 · 2025: 65 · 2024: 80 · 2023: 121 · 2022: 56 · 2021: 4
- FWCI
- 30.09
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Findings of the Association for Computational Linguistics: ACL (Findings of ACL) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61976180)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- named entity recognition, few-shot learning, BART, Seq2Seq, low-resource domains, knowledge transfer, domain adaptation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
