The DOI matches its DataCite record; 38 of the 38 references it cites were found in a registry or an index.
Template-Based Named Entity Recognition Using BART
Open accessAbstract
There is a recent interest in investigating few-shot NER, where the low-resource target domain has different label sets compared with a resource-rich source domain. Existing methods use a similarity-based metric. However, they cannot make full use of knowledge transfer in NER model parameters. To address the issue, we propose a template-based method for NER, treating NER as a language model ranking problem in a sequence-to-sequence framework, where original sentences and statement templates filled by candidate named entity span are regarded as the source sequence and the target sequence, respectively. For inference, the model is required to classify each candidate span based on the corresponding template scores. Our experiments demonstrate that the proposed method achieves 92.55% F1 score on the CoNLL03 (rich-resource task), and significantly better than fine-tuning BERT 10.88%, 15.34%, and 11.73% F1 score on the MIT Movie, the MIT Restaurant, and the ATIS (low-resource task), respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Cui et al. [17] manually design lists such as”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [17]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Token or text-span answer spaces are widely used in classification tasks (e.g., sentiment classification; Yin et al. [144]) as well as in other tasks such as relation extraction [100] or named entity recognition [17].”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 3×
“The current dominant methods use a sequential neural network such as BiLSTM (Hochreiter and Schmidhuber, 1997) and BERT (Devlin et al., 2019) is used to represent the input text, and softmax (Chiu and Nichols, 2016; Strubell et al., 2017; Cui and Zhang, 2019) or CRF (Lample et al., 2016; Ma and…”
MethodJakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 5×
“We use BERT (Devlin et al., 2019) and BART (Lewis et al.”
MethodInfluential(2008) · Journal of Machine Learning Research · Cited by 33,051
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821 · cited 3×
“We use BERT (Devlin et al., 2019) and BART (Lewis et al., 2020) as our E NCODER to learn the sequence representation.”
MethodResultNeural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401 · cited 6×
“Third, compared with traditional meth-ods (pre-trained model with a softmax/CRF), our method can be applied to arbitrary new categories of named entities without changing the output layer, and therefore allows continual learning (Lin et al., 2020).”
BackgroundMethodInfluentialIntroduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788 · cited 2×
“Named entity recognition (NER) is a fundamental task in natural language processing, which identi-fies mention spans from text inputs according to pre-defined entity categories (Tjong Kim Sang and De Meulder, 2003), such as location, person, organization, etc.”
BackgroundMethodEnd-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Ma, X., & Hovy, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1101 · Cited by 2,567 · cited 6×
“Third, compared with traditional meth-ods (pre-trained model with a softmax/CRF), our method can be applied to arbitrary new categories of named entities without changing the output layer, and therefore allows continual learning (Lin et al., 2020).”
BackgroundMethodInfluentialNamed Entity Recognition with Bidirectional LSTM-CNNs
Chiu, J., & Nichols, E. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00104 · Cited by 2,007 · cited 4×
“, 2019) is used to represent the input text, and softmax (Chiu and Nichols, 2016; Strubell et al., 2017; Cui and Zhang, 2019) or CRF (Lample et al.”
MethodInfluential
Research works printed but not linked: 1
- Jie Yang, Shuailong Liang, and Yue Zhang. 2018. De- sign challenges and misconceptions in neural se- quence labeling. In Proceedings of the 27th Inter- national Conference on Computational Linguistics, pages 3879-3889, Santa Fe, New Mexico, USA. As- sociation for Computational Linguistics.
Cited by
Sorted by citations
Items 301–342 of 342
Liu, S., Guo, Y., Yang, S., & Yang, F. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10832051
“At present, prompt-based methods have been applied to a variety of tasks, such as machine translation [12], text summary [13], information extraction [14] and so on.”
Self-citationA Fusion Tuning Method for Named Entity Recognition
Wang, J., Chen, Y., Zou, A., et al. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-1024-2_19
Simplify Prompt Template and Optimum Label-Select for Few-Shot NER
Qin, X., Tan, S., Chun, X., Qin, Z., Li, Y., Fu, Y., Wang, W., & Zhang, J. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-1907-8_35
ECSGen and iZen: A New NLP Task and a Zeroshot Framework to Perform it
Riyadh, M., & Shafiq, M. O. (2024) · International Conference on Machine Learning and Applications · doi:10.1109/icmla61862.2024.00143
Research on an Event Extraction Framework Based on Two-Step Prompt Learning for Chinese Policy
Ding, H., Huayue, G., & Cao, P. (2025) · Applied Sciences · doi:10.3390/app15063378
Few-Shot Named Entity Recognition Based on Self-Descriptive Network and Knowledge Graph Enhancer
Hou, Y., Zhou, Z., Wang, Y., & Liu, Z. (2024) · IEEE International Conference on Data, Information, Knowledge and Wisdom (DIKW) · doi:10.1109/dikw64278.2024.00012
“For instance, in Figure 1, entity types from various schemas are mapped to a shared concept set (e.g., park, garden, country, ...), enabling consistent knowledge transfer from multiple sources [8].”
Few-shot named entity recognition based on triplet loss
Yang, J., & Xu, Y. (2024) · Asia-Pacific Artificial Intelligence and Big Data Forum (AIBDF) · doi:10.1145/3718491.3718540
“In addition, many have proposed other solutions: Cui L et al[10] proposed the idea of solving the small sample named entity recognition problem based on cue words using a generative pre-training model, BART[11], where the goal is to generate corresponding templates based on predefined templates for…”
Improved Legal Document-Based Named Entity Recognition in Real-World ApplicationsPreprint
Orozco‐Arroyave, J. R., & Moreno-Acevedo, S. A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5202375
Utilizing Large Language Models to Detect and Decipher Abbreviation in Clinical Notes (Preprint)Preprint
Jafarpour, H., Cheligeer, C., Yan, J., Xu, Y., Eastwood, C. A., Southern, D. A., Zeng, Y., & Quan, H. (2025) · doi:10.2196/preprints.74042
Prompt Tuning Techniques for Chinese Idiom Recommendation
Wang, S.-M., Su, I., & Chung, Y. (2025) · IEEE Access · doi:10.1109/access.2025.3561188
“Cui et al. examined a prompt-based strategy for approaching the named entity recognition (NER) task [14].”
Named Entity Recognition in Mechanical Fault Diagnosis: A Template-Free Prompt Learning Approach
Li, F., Luo, P., Luo, J., Qin, G., & Ma, H. (2025) · Processes · doi:10.3390/pr13041242
“Cui et al. [30] first applied prompt learning to NER.”
Wang, Y., Lin, M., Hu, Q., Bai, S., Li, Y., & Bao, L. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130357
Generation-Based Few-Shot BioNER via Local Knowledge Index and Dual Prompts
Li, W., Wang, H., Li, W., Zhao, J., & Sun, Y. (2025) · Interdisciplinary Sciences Computational Life Sciences · doi:10.1007/s12539-025-00709-3
“The automated generation of templates is divided into discrete prompts [7, 8] (a.k.a. hard prompts) and continuous prompts [9] (a.k.a. soft prompts).”
Prompt-Based Out-of-Distribution Intent Detection
Chow, R., & Lam, A. Y. S. (2025) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3372440
Latent Layer Causal Structure Enhancement for Cross-Domain Named Entity Recognition
Wu, J., Xu, J., & Liu, X. (2025) · International Conference on Communication Networks and Machine Learning (CNML) · doi:10.1145/3728199.3728205
“For example, Cui et al. [13] redefine NER as a language model ordering problem using “[X] is a [MASK] entity” templates and the BART model.”
Instruction and Demonstration-based service attribute Mining mechanism for textual data
Li, C., Liu, A., & Wang, N. (2025) · International Symposium on Computer Applications and Information Systems (ISCAIS) · doi:10.1109/iscait64916.2025.11010416
“Given that the IDM model is highly sensitive to the sequence of the input text [26], the final input format for the IDM model is as input [ , , ] T D I = .”
Li, X., Feng, K., Wang, H., & Zhao, F. (2025) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd64889.2025.11033247
A Hybrid Prompt Method for Few-Shot Named Entity Recognition
Li, Y., Tyszberowicz, S. S., Liu, Z., & Liu, B. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-7030-7_9
Get Your Act Together! A Prompt-Based Framework for Business Action RecommendationPreprint
Dinh, M. N., Minh, N. Đ., La, N. M., Le, K. D., & Phung, T. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5382117
Think Twice Before Imputation: Optimizing Data Imputation Order for Machine Learning
Zhang, J., Yuan, H., Si, J., Jiang, N., & Wang, S. (2025) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65448.2025.00106 · Cited by 1
Utilizing Advanced Transformers for Summarized Review-Aware Recommender System
Kim, S., Jin, L., Li, Q., Li, X., Yoon, C., & Kim, J. (2025) · IEEE Access · doi:10.1109/access.2025.3598937
“The model tokenizes input text sequences S = { w 1 , w 2 , . . . , w n } using byte pair encoding and learns by restoring corrupted text through added noise, such as text infilling and sentence permutation [24], [32].”
Recognition Service for Named Entities via Multilayer Feature Learning for Large Web Knowledge Bases
Li, C., Li, R., Ma, Y., et al. (2025) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws67624.2025.00018
“[40] introduced a template-based NER service that fine-tunes a pretrained LLM using predefined template prompts, optimizing the entity recognition performance.”
ProMNER: Prompt-Guided Unimodal and Multimodal Named Entity Recognition in a Generative Way
Liu, X., Lang, F., Gao, C., et al. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2025.3603878
“Cui et al. [45] proposed a template-based BART that fills the target sequence with candidate spans.”
Guo, M., & Wu, R. (2025) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2025.1693823
UnionPromptNER serves as a union prompting method to bridge few-shot named entity recognition
Tian, W., Xu, S., Wang, Y., Li, H., & Zhu, H. (2025) · Scientific Reports · doi:10.1038/s41598-025-30822-8
“Cui et al. 26 proposed a template-based method for NER, treating NER as a language model ranking problem in a sequence-to-sequence framework, where original sentences and statement templates filled by candidate named entity spans are regarded as the source and target sequences, respectively.”
Efficient Nearest Neighbor Promptbased Learning for Fewshot Ner in Manufacturing
Chen, J. C., & Wang, P. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.11169726
“For instance, Cui et al.[3] proposed a template-based method for NER, treating NER as a language model ranking problem in a sequence-to-sequence framework, where original sentences and statement templates filled by candidate named entity span are regarded as the source sequence and the target…”
InfluentialNumerical information extraction in legal texts using open and closed Large Language Models
Bitelli, B. V., & Finger, M. (2025) · doi:10.5753/eniac.2025.14453
“As a very recent research area, different approaches have been proposed for prompt construction [Cui et al. 2021, Chen et al. 2021].”
Diversified Prompting Strategy for Improving Slot Filling With Large Language Models
Shin, M., & Shin, Y. (2026) · IEEE Access · doi:10.1109/access.2025.3650469
“One approach introduces inverse prompting strategies for few-shot slot tagging [24], demonstrating faster inference compared to traditional template-based named entity recognition methods that require exhaustive n-gram enumeration [28].”
Wei, J., Luo, W., & Chen, B. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-5679-3_8
Chain of evidence for few-shot NER with large language models
Wu, C., Zhang, Q., Xue, Y., & Zhao, H. (2026) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02849-w
“In the realm of natural language processing, various approaches have been proposed to address the task of few-shot named entity recognition, which are mainly divided into metric-based and prompt-based approaches [15–17].”
Chinese coal mine accident question answering system based on knowledge graph
Tang, J., Wang, Z., Gao, W., & Li, M. (2025) · International Conference on Communication and Information Processing (ICCIP) · doi:10.1145/3784833.3784853
“Although this method has shown promising results in datasets in specific domains, it requires substantial human effort and time to construct and maintain rules [13, 14].”
Gao, W., & He, W. (2026) · Symmetry · doi:10.3390/sym18020319
Chain of Thought and Reinforcement Learning Based Low-Resource Named Entity Recognition Model
Jiang, B., Han, C., Zhu, J., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-6426-2_45
LinkUIE: Entity Linking Adapter for Universal Information Extraction
Xiong, W., Zheng, Y., Meng, W., Liu, B., Wang, D., & Zheng, J. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-8414-7_26
Modeling and optimization of an online publishing application
Cuculovic, M. (2022) · theses.fr (ABES) · doi:10.70675/5425dc78z25adz4de4z956fzf34b008ec511
Natural Language Processing for Analyzing Messages of Astrophysical Observations
Alkan, A. K. (2024) · theses.fr (ABES) · doi:10.70675/ab93cd1az4468z404czb2b3z8dc680a04e4d
Prompt-based Relation Extraction for Pharmacovigilance
Yeh, H.-S. (2024) · theses.fr (ABES) · doi:10.70675/762a3598ze739z4c47za72ez62e5a986fd1f
Kouhoue, J. M. (2025) · theses.fr (ABES) · doi:10.70675/6e94e745z22d7z4660zbab5z817a79addd38
VSGN: Visual–Semantic Guided Interaction Network for Multimodal Named Entity Recognition
Yao, J., Zhou, Z., Li, R., et al. (2026) · Symmetry · doi:10.3390/sym18050769
Telnoff, Q., Hemmer, A., Coustaty, M., Crohas, F., Bartolo, N., Doucet, A., & Ogier, J.-M. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-19108-3_7
Few-Shot Learning for Audio Signal
Deng, X., & Xu, K. (2026) · Springer eBooks · doi:10.1007/978-981-95-0836-5_7
NerAxom-MGF: Leveraging Multi-Granularity Fusion for Assamese Named Entity Recognition
Sarmah, P., Lahkar, M. P., Kalita, S., & Sharma, U. (2026) · Information Retrieval Research · doi:10.54195/irrj.26376
Metadata
- Authors
- Cui, L., Wu, Y., Liu, J., Yang, S., & Zhang, Y.
- Affiliations
- Westlake University (CN)
- Zhejiang University (CN)
- Corresponding author
- Zhang, Yue
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 1835-1845
- arXiv
- 2106.01760
- OpenAlex
- W3176489198
- Semantic Scholar
- ce498651107588db67adcfbb5479bdb416f4de2f
- Cited by
- 342
- References
- 38
- Citations by year
- 2026: 16 · 2025: 65 · 2024: 80 · 2023: 121 · 2022: 56 · 2021: 4
- FWCI
- 30.09
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Findings of the Association for Computational Linguistics: ACL (Findings of ACL) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61976180)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- named entity recognition, few-shot learning, BART, Seq2Seq, low-resource domains, knowledge transfer, domain adaptation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
