The DOI matches its DataCite record; 49 of the 54 references it cites were found in a registry or an index.
PTR: Prompt Tuning with Rules for Text Classification
Open accessAbstract
Fine-tuned pre-trained language models (PLMs) have achieved awesome performance on almost all NLP tasks. By using additional prompts to fine-tune PLMs, we can further stimulate the rich knowledge distributed in PLMs to better serve downstream tasks. Prompt tuning has achieved promising results on some few-class classification tasks such as sentiment classification and natural language inference. However, manually designing lots of language prompts is cumbersome and fallible. For those auto-generated prompts, it is also expensive and time-consuming to verify their effectiveness in non-few-shot scenarios. Hence, it is still challenging for prompt tuning to address many-class classification tasks. To this end, we propose prompt tuning with rules (PTR) for many-class text classification and apply logic rules to construct prompts with several sub-prompts. In this way, PTR is able to encode prior knowledge of each class into prompt tuning. We conduct experiments on relation classification, a typical and complicated many-class classification task, and the results show that PTR can significantly and consistently outperform existing state-of-the-art baselines. This indicates that PTR is a promising approach to take advantage of both human prior knowledge and PLMs for those complicated classification tasks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Han et al. [41] propose prompt tuning with rules (PTR), which uses manually crafted sub-templates to compose a complete template using logic rules.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [41]
In the citing paper
“To enhance the representation ability of the resulting template, they also insert several virtual tokens whose embeddings can be tuned together with the pre-trained LMs parameters using training samples.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [41]
In the citing paper
“Experiment results demonstrate the effectiveness of this prompt design method in relation classification tasks.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [41]
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 1×
“…al., 2020), summarization (Zhang et al., 2019; Liu and Lapata, 2019), question answering (Adiwardana et al., 2020), to text classification (Baldini Soares et al., 2019; Peng et al., 2020; Ding et al., 2021), fine-tuned PLMs have been demonstrated their effectiveness on almost all important NLP tasks.”
BackgroundPan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 2×
“To alleviate this issue, prompt tuning has been proposed to bridge the gap of objective forms in pre-training and fine-tuning (Brown et al., 2020; Schick et al., 2020).”
BackgroundRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · cited 4×
“, 2019), RoBERTa (Liu et al., 2019) and T5 (Raffel et al.”
BackgroundInfluentialExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366
The Power of Scale for Parameter-Efficient Prompt Tuning
Lester, B., Al-Rfou, R., & Constant, N. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.243 · Cited by 3,096 · cited 1×
“Recently, some continuous prompts have also been proposed (Li and Liang, 2021; Lester et al., 2021), which directly use a series of learnable continuous embeddings as prompt templates and get rid of the trouble of designing prompts.”
BackgroundPrefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473 · cited 1×
“Recently, some continuous prompts have also been proposed (Li and Liang, 2021; Lester et al., 2021), which directly use a series of learnable continuous embeddings as prompt templates and get rid of the trouble of designing prompts.”
BackgroundExploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference
Schick, T., & Schütze, H. (2020) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2001.07676 · Cited by 1,935 · cited 2×
“tasks such as natural language inference (Schick and Schütze, 2021; Liu et al., 2021).”
BackgroundText Summarization with Pretrained Encoders
Liu, Y., & Lapata, M. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1387 · Cited by 1,934 · cited 1×
“, 2020), summarization (Zhang et al., 2019; Liu and Lapata, 2019), question answering (Adiwardana et al.”
BackgroundLanguage Models as Knowledge Bases?
Petroni, F., Rocktäschel, T., Riedel, S., Lewis, P., Bakhtin, A., Wu, Y., & Miller, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1250 · Cited by 1,834 · cited 3×
“ries of research work on knowledge probing (Trinh and Le, 2018; Petroni et al., 2019; Davison et al., 2019), language prompts have been proven to effectively stimulate knowledge from PLMs.”
BackgroundSpanBERT: Improving Pre-training by Representing and Predicting Spans
Joshi, M., Chen, D., Liu, Y., Weld, D. S., Zettlemoyer, L., & Levy, O. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00300 · Cited by 1,827 · cited 1×
“For those knowledge-enhanced PLMs, we select SPANBERT (Joshi et al., 2020), KNOWBERT (Peters et al.”
MethodPre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591 · cited 1×
“It is now a consensus of the NLP community to fine-tune PLMs for specific tasks instead of learning models from scratch (Qiu et al., 2020).”
BackgroundMaking Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.295 · Cited by 1,380 · cited 2×
“Gao et al. (2020) take seq-to-seq models to generate prompt candidates, and then use each of them for prompt tuning and verify their effectiveness on development sets.”
BackgroundMethod(2019) · doi:10.18653/v1/p19-1356 · Cited by 1,291 · cited 2×
“By applying self-supervised learning, PLMs can capture a wealth of linguistic (Jawahar et al., 2019), semantic (Yenicelik et al.”
BackgroundMethodPEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
Zhang, J., Zhao, Y., Saleh, M., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1912.08777 · Cited by 1,206 · cited 1×
“, 2020), summarization (Zhang et al., 2019; Liu and Lapata, 2019), question answering (Adiwardana et al.”
BackgroundGraph Convolution over Pruned Dependency Trees Improves Relation Extraction
Zhang, Y., Qi, P., & Manning, C. D. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1244 · Cited by 931 · cited 3×
“We carry out our experiments on four relaction clas-sification datasets: TACRED (Zhang et al., 2017), TACREV (Alt et al., 2020), ReTACRED (Sto-ica et al., 2021), and SemEval 2010 Task 8 (Se-mEval) (Hendrickx et al., 2010).”
MethodSemEval-2010 Task 8: Multi-Way Classification of Semantic Relations Between Pairs of Nominals
Hendrickx, I., Kim, S., Kozareva, Z., Nakov, P., Séaghdha, D. Ó., Padó, S., Pennacchiotti, M., Romano, L., & Szpakowicz, S. (2009) · SEW@NAACL-HLT · doi:10.3115/1621969.1621986 · Cited by 929 · cited 2×
“Although these PLMs can capture rich knowledge (Jawahar et al., 2019; Hewitt and Manning, 2019; Petroni et al., 2019; Yenicelik et al., 2020) from massive corpora, a fine-tuning process with extra task-specific data is still required to transfer their knowledge for downstream tasks.”
BackgroundLiu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021) · arXiv · doi:10.48550/arxiv.2103.10385 · Cited by 908 · cited 4×
“Moreover, human-picked prompts have achieved promising results on few-class classification tasks such as sentiment classification and natural language inference (Schick and Schütze, 2021; Liu et al., 2021).”
BackgroundInfluentialPosition-aware Attention and Supervised Data Improve Slot Filling
Zhang, Y., Zhong, V., Chen, D., Angeli, G., & Manning, C. D. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1004 · Cited by 869 · cited 6×
“Four popular benchmarks of relation classification are used for our experiments, including TA-CRED (Zhang et al., 2017), TACREV (Alt et al., 2020), ReTACRED (Stoica et al., 2021), and Se-mEval 2010 Task 8 (Hendrickx et al., 2010).”
MethodInfluentialLUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionPreprint
Yamada, I., Asai, A., Shindo, H., Takeda, H., & Matsumoto, Y. (2020) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2010.01057 · Cited by 802
Efficient Intent Detection with Dual Sentence Encoders
Casanueva, I., Temcinas, T., Gerz, D., Henderson, M., & Vulic, I. (2020) · NLP4CONVAI · doi:10.48550/arxiv.2003.04807 · Cited by 750
Matching the Blanks: Distributional Similarity for Relation Learning
Baldini Soares, L., FitzGerald, N., Ling, J., & Kwiatkowski, T. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1279 · Cited by 731
Knowledge Enhanced Contextual Word Representations
Peters, M. E., Neumann, M., Logan, R., Schwartz, R., Joshi, V., Singh, S., & Smith, N. A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1005 · Cited by 661 · cited 1×
“, 2020), KNOWBERT (Peters et al., 2019), LUKE (Yamada et al.”
Towards a Human-like Open-Domain Chatbot
Adiwardana, D., Luong, M.-T., So, D. R., Hall, J., Fiedel, N., Thoppilan, R., Yang, Z., Kulshreshtha, A., Nemade, G., Lu, Y., et al. (2020) · arXiv · doi:10.48550/arxiv.2001.09977 · Cited by 614 · cited 2×
“, 2019; Liu and Lapata, 2019), question answering (Adiwardana et al., 2020), to”
Background(2019) · doi:10.18653/v1/n19-1419 · Cited by 601 · cited 1×
“Although these PLMs have captured rich knowledge (Jawahar et al., 2019; Hewitt and Manning, 2019; Petroni et al., 2019; Yenicelik et al., 2020) from massive corpora, a fine-tuning process with extra task-specific data is still required to transfer the knowledge for downstream tasks.”
BackgroundEliciting Knowledge from Language Models Using Automatically Generated PromptsPreprint
Shin, T., Razeghi, Y., Logan, R. L., IV, Wallace, E., & Singh, S. (2020) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2010.15980 · Cited by 583 · cited 2×
“Shin et al. (2020) further explore gradient-guided search to automatically generate both templates and label words.”
BackgroundAn Evaluation Dataset for Intent Classification and Out-of-Scope Prediction
Larson, S., Mahendran, A., Peper, J. J., Clarke, C., Lee, A., Hill, P., Kummerfeld, J. K., Leach, K., Laurenzano, M. A., Tang, L., et al. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1131 · Cited by 535
Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
Dodge, J., Ilharco, G., Schwartz, R., Farhadi, A., Hajishirzi, H., & Smith, N. (2020) · arXiv · doi:10.48550/arxiv.2002.06305 · Cited by 412 · cited 1×
“Besides fine-tuning language models for specific tasks, recent studies have explored better optimization and regularization techniques to improve fine-tuning (Lee et al., 2019; Dodge et al., 2020).”
MethodKnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction
Chen, X., Zhang, N., Xie, X., Deng, S., Yao, Y., Tan, C., Huang, F., Si, L., & Chen, H. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3511998 · Cited by 389
A Simple Method for Commonsense Reasoning
Trinh, T. H., & Le, Q. V. (2018) · arXiv · doi:10.48550/arxiv.1806.02847 · Cited by 293
Few-NERD: A Few-shot Named Entity Recognition Dataset
Ding, N., Xu, G., Chen, Y., Wang, X., Han, X., Xie, P., Zheng, H.-T., & Liu, Z. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.248 · Cited by 285
Self-citationRen, X., Wu, Z., He, W., Qu, M., Voss, C. R., Ji, H., Abdelzaher, T., & Han, J. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3038912.3052708 · Cited by 265
Commonsense Knowledge Mining from Pretrained Models
Davison, J., Feldman, J., & Rush, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1109 · Cited by 264 · cited 1×
“ries of research work on knowledge probing (Trinh and Le, 2018; Petroni et al., 2019; Davison et al., 2019), language prompts have been proven to effectively stimulate knowledge from PLMs.”
BackgroundDialoGPT: Large-Scale Generative Pre-training for Conversational Response GenerationPreprint
Zhang, Y., Sun, S., Galley, M., Chen, Y.-C., Brockett, C., Gao, X., Gao, J., Liu, J., & Dolan, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00536 · Cited by 258 · cited 1×
“From dialogue (Zhang et al., 2020), summarization (Zhang et al.”
Learning from Context or Names? An Empirical Study on Neural Relation Extraction
Peng, H., Gao, T., Han, X., Lin, Y., Li, P., Liu, Z., Sun, M., & Zhou, J. (2020) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2010.01923 · Cited by 229 · cited 1×
“, 2020), to text classification (Baldini Soares et al., 2019; Peng et al., 2020; Ding et al., 2021), fine-tuned PLMs have been demonstrated their effectiveness on almost all important NLP tasks.”
BackgroundSelf-citationMultilingual Universal Sentence Encoder for Semantic RetrievalPreprint
Yang, Y., Cer, D. M., Ahmad, A., Guo, M., Law, J., Constant, N., Ábrego, G. H., Yuan, S., Tar, C., Sung, Y.-H., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04307 · Cited by 196
TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task
Alt, C., Gabryszak, A., & Hennig, L. (2020) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2004.14855 · Cited by 192 · cited 9×
“TACREV: one dataset built based on the original TACRED dataset.”
InfluentialMixout: Effective Regularization to Finetune Large-scale Pretrained Language ModelsPreprint
Lee, C., Cho, K., & Kang, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11299 · Cited by 179 · cited 1×
“Besides fine-tuning language models for specific tasks, recent studies have explored better optimization and regularization techniques to improve fine-tuning (Lee et al., 2019; Dodge et al., 2020).”
BackgroundOpenNRE: An Open and Extensible Toolkit for Neural Relation Extraction
Han, X., Gao, T., Yao, Y., Ye, D., Liu, Z., & Sun, M. (2019) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/d19-3029 · Cited by 160 · cited 1×
“Our model is implemented based on the toolkit Transformers (Wolf et al., 2020) and Open-NRE (Han et al., 2019).”
MethodSelf-citationRe-TACRED: Addressing Shortcomings of the TACRED Dataset
Stoica, G., Platanios, E. A., & Póczos, B. (2021) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2104.08398 · Cited by 158 · cited 7×
“We introduce the reversed setting of TACRED, TACREV, Re-TACRED in Section 5.3 and report the corresponding results in Table 2.”
BackgroundMethodInfluentialNeural Architectures for Fine-grained Entity Type ClassificationPreprint
Shimaoka, S., Stenetorp, P., Inui, K., & Riedel, S. (2016) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.1606.01341 · Cited by 122
Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language InferencePreprint
Zhang, J., Hashimoto, K., Liu, W.-H., Wu, C.-S., Wan, Y., Yu, P. S., Socher, R., & Xiong, C. (2020) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2010.13009 · Cited by 100
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning
Zhang, J., Bui, T., Yoon, S., Chen, X., Liu, Z., Xia, C., Tran, Q. H., Chang, W. H., & Yu, P. S. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.144 · Cited by 81
Self-citationAn Improved Baseline for Sentence-level Relation ExtractionPreprint
Zhou, W., & Chen, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.01373 · Cited by 78
Prototypical Representation Learning for Relation ExtractionPreprint
Ding, N., Wang, X., Fu, Y., Xu, G., Wang, R., Xie, P., Shen, Y., Huang, F., Zheng, H.-T., & Zhang, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11647 · Cited by 64 · cited 1×
“, 2020), to text classification (Baldini Soares et al., 2019; Peng et al., 2020; Ding et al., 2021), fine-tuned PLMs have been demonstrated their effectiveness on almost all important NLP tasks.”
BackgroundSelf-citationHow does BERT capture semantics? A closer look at polysemous words
Yenicelik, D., Schmidt, F., & Kilcher, Y. (2020) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2020.blackboxnlp-1.15 · Cited by 51 · cited 2×
“, 2019), semantic (Yenicelik et al., 2020), syntactic (Hewitt and Manning, 2019) and world”
BackgroundPrompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning
Zhang, R., Yu, Y., Shetty, P., Song, L., & Zhang, C. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2203.09735 · Cited by 29
Automatically Identifying Words That Can Serve as Labels for Few-Shot Text ClassificationPreprint
Schick, T., Schmid, H., & Schütze, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13641 · Cited by 17 · cited 1×
“To alleviate this issue, prompt tuning has been proposed to bridge the gap of objective forms in pre-training and fine-tuning (Brown et al., 2020; Schick et al., 2020).”
Background
Cited by
Sorted by citations
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey
Min, B., Ross, H., Sulem, E., Veyseh, A. P. B., Nguyen, T. H., Sainz, O., Agirre, E., Heintz, I., & Roth, D. (2024) · ACM Computing Surveys · doi:10.1145/3605943 · Cited by 1,387
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and TasksPreprint
Liu, X., Ji, K., Fu, Y., Tam, W. L., Du, Z., Yang, Z., & Tang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07602 · Cited by 743
“Prompt tuning and P-tuning have been proved quite effective in many NLU tasks, including knowledge probing, sentimental analysis (Li et al., 2021), relation extraction (Han et al., 2021), entity typing (Ding et al., 2021) and so on.”
BackgroundPre-Trained Models: Past, Present and FuturePreprint
Han, X., Zhang, Z.-Y., Ding, N., Gu, Y.-X., Liu, X., Huo, Y., Qiu, J.-Z., Yao, Y., Zhang, A., Zhang, L., et al. (2021) · AI Open · doi:10.48550/arxiv.2106.07139 · Cited by 1,146
“By designing, generating and searching discrete (Petroni et al., 2019; Gao et al., 2021; Hu et al., 2021) or continuous (Liu et al., 2021b; Han et al., 2021; Lester et al., 2021) prompts and using MLM for specific downstream tasks, these models could (1) bridge the gap between pre-training and…”
BackgroundMethodSelf-citation
Metadata
- Authors
- Han, X., Zhao, W., Ding, N., Liu, Z., & Sun, M.
- Affiliations
- Beijing National Research Center for Information Science and Technology (CN)
- Beijing Academy of Artificial Intelligence (CN)
- Corresponding author
- Liu, Zhiyuan
- Sun, Maosong
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Volume
- 3
- Pages
- 182-192
- ISSN
- 2666-6510 (ISSN-L)
- arXiv
- 2105.11259
- OpenAlex
- W4309811444
- Cited by
- 478
- References
- 54
- Citations by year
- 2026: 27 · 2025: 92 · 2024: 131 · 2023: 137 · 2022: 77 · 2021: 14
- FWCI
- 35.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-nd
- arxiv.org/licenses/nonexclusive-distrib/1.0/
- Locations
- AI Open (publishedVersion, cc-by-nc-nd)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (62236004)
- Tsinghua University
- National Key Research and Development Program of China (2020AAA0106500)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- prompt tuning, text classification, pre-trained language models, relation classification, entity typing, intent classification, prior knowledge encoding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
