The DOI matches its DataCite record; 49 of the 54 references it cites were found in a registry or an index.
PTR: Prompt Tuning with Rules for Text Classification
Open accessAbstract
Fine-tuned pre-trained language models (PLMs) have achieved awesome performance on almost all NLP tasks. By using additional prompts to fine-tune PLMs, we can further stimulate the rich knowledge distributed in PLMs to better serve downstream tasks. Prompt tuning has achieved promising results on some few-class classification tasks such as sentiment classification and natural language inference. However, manually designing lots of language prompts is cumbersome and fallible. For those auto-generated prompts, it is also expensive and time-consuming to verify their effectiveness in non-few-shot scenarios. Hence, it is still challenging for prompt tuning to address many-class classification tasks. To this end, we propose prompt tuning with rules (PTR) for many-class text classification and apply logic rules to construct prompts with several sub-prompts. In this way, PTR is able to encode prior knowledge of each class into prompt tuning. We conduct experiments on relation classification, a typical and complicated many-class classification task, and the results show that PTR can significantly and consistently outperform existing state-of-the-art baselines. This indicates that PTR is a promising approach to take advantage of both human prior knowledge and PLMs for those complicated classification tasks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Han et al. [41] propose prompt tuning with rules (PTR), which uses manually crafted sub-templates to compose a complete template using logic rules.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [41]
In the citing paper
“To enhance the representation ability of the resulting template, they also insert several virtual tokens whose embeddings can be tuned together with the pre-trained LMs parameters using training samples.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [41]
In the citing paper
“Experiment results demonstrate the effectiveness of this prompt design method in relation classification tasks.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [41]
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 1×
“…al., 2020), summarization (Zhang et al., 2019; Liu and Lapata, 2019), question answering (Adiwardana et al., 2020), to text classification (Baldini Soares et al., 2019; Peng et al., 2020; Ding et al., 2021), fine-tuned PLMs have been demonstrated their effectiveness on almost all important NLP tasks.”
BackgroundPan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 2×
“To alleviate this issue, prompt tuning has been proposed to bridge the gap of objective forms in pre-training and fine-tuning (Brown et al., 2020; Schick et al., 2020).”
BackgroundRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · cited 4×
“, 2019), RoBERTa (Liu et al., 2019) and T5 (Raffel et al.”
BackgroundInfluentialExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366
The Power of Scale for Parameter-Efficient Prompt Tuning
Lester, B., Al-Rfou, R., & Constant, N. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.243 · Cited by 3,096 · cited 1×
“Recently, some continuous prompts have also been proposed (Li and Liang, 2021; Lester et al., 2021), which directly use a series of learnable continuous embeddings as prompt templates and get rid of the trouble of designing prompts.”
BackgroundPrefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473 · cited 1×
“Recently, some continuous prompts have also been proposed (Li and Liang, 2021; Lester et al., 2021), which directly use a series of learnable continuous embeddings as prompt templates and get rid of the trouble of designing prompts.”
BackgroundExploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference
Schick, T., & Schütze, H. (2020) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2001.07676 · Cited by 1,935 · cited 2×
“tasks such as natural language inference (Schick and Schütze, 2021; Liu et al., 2021).”
BackgroundText Summarization with Pretrained Encoders
Liu, Y., & Lapata, M. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1387 · Cited by 1,934 · cited 1×
“, 2020), summarization (Zhang et al., 2019; Liu and Lapata, 2019), question answering (Adiwardana et al.”
Background
Cited by
Sorted by citations
Items 301–400 of 576
Adapting Knowledge Prompt Tuning for Enhanced Automated Program Repair
Cai, X., & Jiang, L. (2025) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner64311.2025.00041 · Cited by 3
“1) Hard Prompt: The hard prompt [14], [15], [22] is a method to rewrite the model’s input by introducing a series of natural language tokens as prompts.”
InfluentialGenKP: generative knowledge prompts for enhancing large language models
Li, X., Peng, S., Yada, S., Wakamiya, S., & Aramaki, E. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06318-3 · Cited by 6
A discrete convolutional network for entity relation extraction
Yang, W., Qin, Y., Wang, K., Hu, Y., Huang, R., & Chen, Y. (2025) · Neural Networks · doi:10.1016/j.neunet.2024.107117 · Cited by 7
PURE: a Prompt-based framework with dynamic Update mechanism for educational Relation Extraction
Cui, X., Yang, Y., Li, D., Cui, J., Qu, X., Song, C. L., Liu, H., & Ke, S. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01692-w · Cited by 7
Guo, B., Meng, J., Zhao, D., Jia, X., Chu, Y., & Lin, H. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104717 · Cited by 8
TCohPrompt: task-coherent prompt-oriented fine-tuning for relation extraction
Long, J., Yin, Z., Liu, C., & Huang, W. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01563-4 · Cited by 8
“PTR [11], an approach for many-class text classification, which encodes prior knowledge of each class into prompt tuning using logic rules and achieves significant and consistent improvements on relation classification tasks.”
Wang, D., Zeng, J.-Y., Huang, G., Xu, D.-X., Jia, X., Qin, C.-B., & Wen, J. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112202 · Cited by 6
DANTE: Dialog graph enhanced prompt learning for conversational question answering over KGs
Li, J., Song, S., Yan, S., Hu, G., Lai, C., & Zhou, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112294 · Cited by 5
Majority Rules Guided Aspect-Category Based Sentiment Analysis via Label Prior Knowledge
Li, L., Tang, S., & Wu, R.-W. (2024) · International Conference on Language Resources and Evaluation · doi:10.63317/43dgp6cs8btk · Cited by 6
“(Han et al., 2022), we design Ruled Prompt by building several sub-prompts which contain subordinate relationships and thesauri of aspect categories to generate prompts (Section 2.1).”
MethodInfluentialDeep Instruction Tuning for Segment Anything Model
Huang, X.-R., Luo, G., Zhu, C.-Y., Tong, B., Zhou, Y.-Y., Sun, X.-S., & Ji, R.-R. (2024) · ACM Multimedia · doi:10.1145/3664647.3680571 · Cited by 6
“In this case, prompt tuning [14, 16, 48, 70] is proposed to use hand-craft or learnable prompt tokens to mitigate distribution shifts between pre-training and downstream tasks.”
MethodSemantic Map-based Generation of Navigation Instructions
Li, C., Zhang, C., Teufel, S., Doddipatla, R., & Stoyanchev, S. (2024) · International Conference on Language Resources and Evaluation · doi:10.48550/arxiv.2403.19603 · Cited by 6
Genetic Auto-prompt Learning for Pre-trained Code Intelligence Language Models
Feng, C., Sun, Y.-N., Li, K., Zhou, P., Lv, J.-C., & Lu, A.-J. (2024) · arXiv.org · doi:10.48550/arxiv.2403.13588 · Cited by 6
“The prompt consists of a prompt template and verbalizer [29], [30].”
BackgroundSTID-Prompt: Prompt learning for sentiment-topic-importance detection in financial news
Sun, S., Pan, X., Yang, T., & Gao, J. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111347 · Cited by 8
ICL Markup: Structuring In-Context Learning using Soft-Token TagsPreprint
Brunet, M.-E., Anderson, A., & Zemel, R. (2023) · arXiv.org · doi:10.48550/arxiv.2312.07405 · Cited by 6
TARGET: Template-Transferable Backdoor Attack Against Prompt-based NLP Models via GPT4
Tan, Z., Chen, Q., Huang, Y., & Liang, C. (2023) · Natural Language Processing and Chinese Computing · doi:10.48550/arxiv.2311.17429 · Cited by 6
Prompt Learning for Low-Resource Multi-Domain Fake News Detection
Peng, Z., Lin, N., Zhou, Y., Zhou, D. M., & Yang, A. (2023) · International Conference on Asian Language Processing · doi:10.1109/ialp61005.2023.10337265 · Cited by 6
“Several studies have shown that prompt templates with special and learnable tokens can improve prompt learning [14], [15].”
BackgroundTuning N-ary relation extraction as Machine Reading Comprehension
Ren, P., Xu, T., Qu, J., Sang, Y., Li, Z., Fang, J., Zhao, P., & Ma, G. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126893 · Cited by 5
Khamsehashari, R., Schmitt, V., Polzehl, T., Mohtaj, S., & Möller, S. (2023) · Symposium on Security and Privacy in Speech Communication (SPSC) · doi:10.21437/spsc.2023-1 · Cited by 2
“This approach draws inspiration from recent advancements in natural language processing, where prompt-based learning has shown enhanced performance across various language tasks [42, 43].”
From Visual Prompt Learning to Zero-Shot Transfer: Mapping Is All You Need
Yang, Z., Sha, Z.-Y., Backes, M., & Zhang, Y. (2023) · arXiv.org · doi:10.48550/arxiv.2303.05266 · Cited by 6
“Recent approaches [5, 13, 14, 23, 25, 27] aim to address these issues by focusing on learning a "soft prompt," which is a continuous vector that can be optimized via backpropagation while keeping the backbone model frozen.”
BackgroundRole Knowledge Prompting for Document-Level Event Argument Extraction
Hu, R., Liu, H., & Zhou, H. (2023) · Applied Sciences · doi:10.3390/app13053041 · Cited by 6
“Tsinghua University proposed PTR [42], which implants logic rules into prompt tuning, and KPT [50], which extends label mapping through external knowledge graphs, achieving large performance gains in task scenarios.”
Relation Extraction Based on Prompt Information and Feature Reuse
Feng, P., Zhang, X., Zhao, J. M., Wang, Y., & Huang, B. (2023) · Data Intelligence · doi:10.1162/dint_a_00192 · Cited by 6
“The proposed model, denoted as RPR, is compared with the previous methods TRE [12], Entity-Aware BERT [14], R-BERT [15], PTR [18], and Skeleton-Aware BERT [17].”
BackgroundMethodResultDistinguishability Calibration to In-Context Learning
Li, H., Yan, H., Li, Y.-R., Qian, L., He, Y.-L., & Gui, L. (2023) · Findings · doi:10.48550/arxiv.2302.06198 · Cited by 6
“Inspired by the hierarchical structure of coarse-to-fine emotion categories, we assume that a fine-grained emotion should be close to the coarse-grained emotion it belongs to.”
BackgroundMethodInfluentialExploring Pre-Trained Language Models to Build Knowledge Graph for Metal-Organic Frameworks (MOFs)
An, Y., Greenberg, J., Hu, X. T., Kalinowski, A., Fang, X., Zhao, X., McClellan, S., Uribe‐Romo, F. J., Langlois, K., Furst, J. D., et al. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020568 · Cited by 12
“An increasing number of studies have been reported using prompt@PLM to solve text classification [10], [20], [41], [42], named-entity recognition [14], natural language inference [20], [41], [42], sentiment analysis [28], relation extraction [12], [22], text summarization [1], and parsing [13].”
BackgroundSong, C., Shao, T., Lin, K., Liu, D., Wang, S., & Chen, H. (2022) · Applied Sciences · doi:10.3390/app122111117 · Cited by 8
COMPILING: A Benchmark Dataset for Chinese Complexity Controllable Definition Generation
Yuan, J., Kong, C., Xie, C.-H., Yang, L., & Yang, E. (2022) · China National Conference on Chinese Computational Linguistics · doi:10.48550/arxiv.2209.14614 · Cited by 6
“A discrete prompt refers to the fact that the constructed prompt is composed of actual text symbols, and applicable tasks include text classification (Han et al., 2021b), text generation (Zheng and Huang, 2021), etc.”
BackgroundLi, X., Wang, W., Fang, J., Jin, L., Kang, H., & Liu, C. (2022) · Applied Sciences · doi:10.3390/app12199688 · Cited by 7
“Considering that most auto-generating prompts cannot achieve a comparable performance, we design task-specific manual prompts for fact-checking [40,41].”
MethodAdaptive Multi-view Rule Discovery for Weakly-Supervised Compatible Products Prediction
Zhang, R., West, R., Cui, X., & Zhang, C. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539208 · Cited by 6
“It enables PLMs to adapt to new scenarios with few or no labeled data [4, 11, 16, 18, 19].”
BackgroundProtum: A New Method For Prompt Tuning Based on "[MASK]"Preprint
He, P., Chen, Y., Wang, Y., & Zhang, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.12109 · Cited by 2
“The MLM head (Han et al., 2021) are regard as the input for classifier layers in the previous PT methods.”
MethodGraphPrompt: Graph-Based Prompt Templates for Biomedical Synonym Prediction
Xu, H., Zhang, J., Wang, Z., Zhang, S., Bhalerao, M. M., Liu, Y., Zhu, D., & Wang, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26256 · Cited by 10
“The most related prompt-based works to our task is prompt-based relation extraction (Chen et al. 2021; Han et al. 2021) and prompt-based knowledge base completion (Davison, Feldman, and Rush 2019).”
BackgroundSyRACT: zero-shot biomedical document-level relation extraction with synergistic RAG and CoT
Dong, X., Zhao, D., Meng, J., Guo, B., & Lin, H. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf356 · Cited by 9
“We compared our method with the following models: PTR (Han et al. 2022), a rule-based Prompt Tuning with Rules method, combines multiple sub-prompts into task specific prompts using logical rules, introducing prior knowledge to assist model learning.”
Ye, Z., Cai, C., Dong, R., Qi, J., Feng, L., Chen, P., & Liu, F. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.04650 · Cited by 6
A survey of Few-Shot Relation Extraction combining meta-learning with prompt learning
Hang, T., Wu, W., Feng, J., Djigal, H., & Huang, J. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130534 · Cited by 5
Zhou, C., Huang, B., & Ling, Y. (2025) · Applied Sciences · doi:10.3390/app15115801 · Cited by 5
“The prompt template is represented by a continuous sequence of learn‑ able features [37,38].”
E-InMeMo: Enhanced Prompting for Visual In-Context Learning
Zhang, J., Wang, B., Liu, H., Li, L., Nakashima, Y., & Nagahara, H. (2025) · Journal of Imaging · doi:10.3390/jimaging11070232 · Cited by 4
“Learnable visual prompting, initially introduced in [19], draws inspiration from prompt-based learning in NLP [30,46,56].”
Clickbait Detection via Prompt-Tuning With Titles Only
Wang, Y., Zhu, Y. Q., Li, Y., Qiang, J., Yuan, Y., & Wu, X. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3406418 · Cited by 10
“In prompt-tuning, while automatic prompt generation methods can circumvent labor-intensive processes, many of these methods fail to attain comparable performance to manually selected prompt methods in real-world scenarios [30].”
SciPrompt: Knowledge-augmented Prompting for Fine-grained Categorization of Scientific Topics
You, Z., Han, K.-Y., Zhu, H., Ludaescher, B., & Diesner, J. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2410.01946 · Cited by 5
“…and Schütze, 2021a,b), which initially investigated how cloze-based prompt templates can guide language models to tackle classification tasks (Han et al., 2022; Ding et al., 2022b; Min et al., 2022; Wang et al., 2022a; Zhang et al., 2022; Wang et al., 2022b), has inspired research on…”
BackgroundJoint extraction of biomedical overlapping triples through feature partition encoding
Zhu, Q., Cheng, H., Meng, Y., Yang, H., & Zhao, W. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122723 · Cited by 7
Self-citationPrompt Tuning for Few-shot Relation Extraction via Modeling Global and Local Graphs
Zhang, Z., Yang, Y., & Chen, B. (2024) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3ehsmnvdxvv3
“PTR(Han et al., 2022) uses logic rules with multiple sub-prompts to encode prior knowledge in prompt-tuning.”
MethodWiki-based Prompts for Enhancing Relation Extraction using Language Models
Layegh, A., Payberah, A. H., Soylu, A., Roman, D., & Matskin, M. (2024) · ACM Symposium on Applied Computing · doi:10.1145/3605098.3635949 · Cited by 3
“PTR [13] is a prompt-tuning framework for RE tasks.”
BackgroundMethodInfluentialLi, M.-M., Zhu, J., Wang, Y., Yang, Y., Li, Y., & Wang, H. (2024) · The Web Conference · doi:10.1145/3589334.3645602 · Cited by 6
L-TUNING: Synchronized Label Tuning for Prompt and Prefix in LLMs
Kowsher, M., Sobuj, M. S. I., Mahmud, A., Prottasha, N. J., & Bhat, P. (2023) · Tiny Papers @ ICLR · doi:10.48550/arxiv.2402.01643 · Cited by 5
“This indicates that L-Tuning’s efficacy is particularly significant in the context of LLMs, underscoring its potential as a scalable and efficient approach to optimizing advanced language processing systems.”
MethodInfluentialLabels Need Prompts Too: Mask Matching for Natural Language Understanding Tasks
Li, B., Ye, W., Wang, Q.-D., Zhao, W., & Zhang, S.-K. (2023) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2312.08726 · Cited by 5
“Prompt-tuning (Liu et al. 2021a; Han et al. 2021; Chen et al. 2022) naturally exploits textual semantics of labels by manually designing proper label verbalizer (Schick and Schütze 2021; Gao, Fisch, and Chen 2021; Lee et al. 2022), as shown in Figure 1 (c).”
BackgroundMethodInfluentialSelf-citationCORE: A Few-Shot Company Relation Classification Dataset for Robust Domain Adaptation
Borchert, P., Weerdt, J. D., Coussement, K., Caigny, A. D., & Moens, M.-F. (2023) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2310.12024 · Cited by 5
“Given input x , the probability of predicting relation r is denoted as: where h [ MASK ] is the hidden vector of [ MASK ] and w v denotes the pre-softmax vector corresponding to v ∈ V (Gao et al., 2021; Han et al., 2022).”
BackgroundPrompt Backdoors in Visual Prompt Learning
Huang, H., Zhao, Z., Backes, M., Shen, Y., & Zhang, Y. (2023) · arXiv.org · doi:10.48550/arxiv.2310.07632 · Cited by 5
Wang, B., Wang, Z., Xiang, W., & Mo, Y. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3527135 · Cited by 3
“Han et al. [28] propose PTR for many-class text classification, using logic rules to construct prompts with sub-prompts, encoding prior knowledge.”
KICE: A Knowledge Consolidation and Expansion Framework for Relation Extraction
Lu, Y., Wang, X., Yang, H., & Tang, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26565 · Cited by 4
“PTR (Han et al. 2021) builds prompts consisting of several sub-prompts and infers relation by considering predicted masked words on different sub-prompts.”
MixPro: Simple yet Effective Data Augmentation for Prompt-based Learning
Li, B., Dou, L., Hou, Y., Feng, Y., Mu, H., Wang, E., Zhu, Q., Sun, Q., & Che, W. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02548-6 · Cited by 3
Incorporating Task-Specific Concept Knowledge into Script Learning
Sun, C.-K., Xu, T., Zhai, C.-X., & Ji, H. (2022) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2209.00068 · Cited by 5
“The prompt-learning methods have been applied to many NLP tasks, including Relation Extraction (Chen et al., 2022; Han et al., 2021), Named Entity Recognition (Ma et al.”
MethodPTS: A Prompt-based Teacher-Student Network for Weakly Supervised Aspect Detection
Li, H., Yang, L., Li, L., Xu, C., Xia, S., & Yuan, C. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892147 · Cited by 6
“Sufficient empirical analysis shows that taking prompttuning methods is effective for the general knowledge stimulation of PLMs, either for manually picking handcrafted prompts [24][25] or automatically building autogenerated prompts [22][23].”
BackgroundChemical-Protein Relation Extraction with Pre-trained Prompt Tuning
He, J.-P., Li, F., Hu, X.-Y., Li, J., Yi, N., Wang, J.-Q., Xiang, Y., Wei, Q., Xu, H., & Tao, C. (2022) · IEEE International Conference on Healthcare Informatics · doi:10.1109/ichi54592.2022.00120 · Cited by 5
Plug-Tagger: A Pluggable Sequence Labeling Framework Using Language ModelsPreprint
Zhou, X., Ma, R., Gui, T., Tan, Y., Zhang, Q., & Huang, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07331 · Cited by 6
“To get the better use of knowledge in pretrained models, (Han et al. 2021; Schick and Schütze 2021; Cui et al. 2021; Wang et al. 2021; Chen et al. 2021; Liu et al. 2021) reformulate the paradigm of downstream tasks into new task that similar to pre-training.”
MethodDeep Learning-Driven Garden Design: Integrating AI Into the Creative Process
Yang, H. M., Zheng, D., & Wang, L. (2025) · IEEE Access · doi:10.1109/access.2025.3602874 · Cited by 8
“Therefore, exploring deep learning-driven fashion design is critical to developing intelligent systems that augment human creativity and respond dynamically to an ever-evolving market [5].”
Discourse-Aware Prompt Design for Text GenerationPreprint
Ghazvininejad, M., Karpukhin, V., & Celikyilmaz, A. (2021) · arXiv.org · doi:10.48550/arxiv.2112.05717 · Cited by 5
“These range from prompt engineering (Petroni et al., 2019; Cui et al., 2021), to more advanced approaches such as prompt ensembling (Mao et al., 2021), composition (Han et al., 2021), or prompt-aware training methods (Lester et al., 2021; Gu et al., 2021).”
BackgroundP4E: Few-Shot Event Detection as Prompt-Guided Identification and Localization
Li, S., Liu, L., Xie, Y., Ji, H., & Han, J.-W. (2022) · arXiv.org · doi:10.48550/arxiv.2202.07615 · Cited by 4
“, 2021) and relation extraction (Han et al., 2021; Chen et al., 2022) but they focus on improving the classification component of these tasks.”
BackgroundMethodAn Overview of Large Language Models for Statisticians
Ji, W., Yuan, W., Getzen, E. J., Cho, K., Jordan, M. I., Mei, S., Weston, J., Su, W., Xu, J., & Zhang, L. (2026) · The American Statistician · doi:10.1080/00031305.2026.2657480 · Cited by 36
PromptSED: An evolving topic-enhanced prompting framework for incremental social event detection
Yu, X., Ren, J., Jiang, L., Peng, H., Hao, Z., Sun, L., Peng, K., Zhu, L., & Yu, P. S. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107772 · Cited by 4
Efficient and Privacy-Preserving Soft Prompt Transfer for LLMsPreprint
Wang, X., Xu, J., Boenisch, F., Michael Backes, A., Choquette-Choo, C. A., & Dziedzic, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.16196 · Cited by 2
“Such gradient-based approaches are generally known to yield higher performance at lower computational costs (Liu et al., 2022).”
Joint Scheduling of Causal Prompts and Tasks for Multi-Task Learning
Li, C., Qin, J., Cui, J., Liu, Z., Hu, N., & Liao, Q. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02339 · Cited by 3
“Prompt learning is initially proposed to adapt large pre-trained language models (LMs) for NLP tasks [13, 17, 35].”
Self-citationMedical short text classification via Soft Prompt-tuning
Xiao, X., Wang, H., Jiang, F. X., Qi, T., & Wang, W. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1519280 · Cited by 4
Cross-language few-shot intent recognition via prompt-based tuning
Cao, P., Li, Y., & Li, X. (2024) · Applied Intelligence · doi:10.1007/s10489-024-06089-3 · Cited by 3
Context-aware Prompt Tuning: Advancing In-Context Learning with Adversarial MethodsPreprint
Blau, T., Kimhi, M., Belinkov, Y., Bronstein, A. M., & Baskin, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.17222 · Cited by 7
“Despite its advantages, ICL has limitations, often underperforming compared to optimization-based methods (Liu et al., 2022; Peng et al., 2023; Sun et al., 2023).”
BackgroundPrompt-based contrastive learning to combat the COVID-19 infodemic
Peng, Z., Li, M., Wang, Y., & Mo, D. Y. W. (2025) · Machine Learning · doi:10.1007/s10994-024-06731-8 · Cited by 1
“…(Bojanowski et al., 2016), CNN (Kim, 2014; Luo et al., 2022), BiLSTM, HAN (Wang et al., 2021; Yang et al., 2016), BiLSTM + Attention (Wani et al., 2021), SimCSE (Gao et al., 2021; Tan et al., 2023), BERT (Devlin et al., 2019; Kawintira-non et al., 2022) and prompt tuning (Han et al., 2022).”
Contrastive learning-based few-shot relation extraction with open-book datastore
Gong, W., & Zhou, Q. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.112302 · Cited by 4
Liu, Y., Zhang, K., Gan, A.-R., Yue, L.-N., Hu, F., Liu, Q., & Chen, E.-H. (2024) · International Conference on Database Systems for Advanced Applications · doi:10.48550/arxiv.2407.08967 · Cited by 4
Jia, C., Wang, P., Li, Z., Li, Y.-C., Zhang, Z., Tang, N., & Yu, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.17039 · Cited by 2
“To improve the controllability and efficiency of LLMs, prompt-based methods [20, 21, 22, 23] have emerged as a pivotal technique.”
MethodPDAMeta: Meta-Learning Framework with Progressive Data Augmentation for Few-Shot Text Classification
Li, X., Song, K., Lin, T., Kang, Y., Zhao, F., Sun, C.-L., & Liu, X.-Z. (2024) · International Conference on Language Resources and Evaluation · doi:10.63317/2kpqdoqtfn2h · Cited by 4
“…have shown promising results by overcoming this challenge in various tasks, which mainly focus on improving the learning and generalization capability of the model via meta-learning (Yin, 2020; Lee et al., 2022a) or prompt-based methods (Lester et al., 2021; Han et al., 2022; Wang et al., 2022).”
BackgroundPrompt-tuning for Clickbait Detection via Text Summarization
Deng, H., Zhu, Y., Wang, Y., Qiang, J.-P., Yuan, Y.-H., Li, Y., & Zhang, R. (2024) · International Conference on Neural Information Processing · doi:10.48550/arxiv.2404.11206 · Cited by 4
“Various hand-crafted prompts, which are discretely specified prompts that remain constant during training, have been designed and applied across different tasks, including knowledge probing [35], relation extraction [36], and text classification [37].”
ResultSimple knowledge graph completion model based on PU learning and prompt learning
Duan, L., Wang, J., Luo, B., & Sun, Q. (2024) · Knowledge and Information Systems · doi:10.1007/s10115-023-02040-z · Cited by 3
Aspect-level sentiment classification with fused local and global context
Feng, A., Cai, J., Gao, Z., & Li, X. (2023) · Journal Of Big Data · doi:10.1186/s40537-023-00856-8 · Cited by 7
“Han et al. [29] suggested that prompt methods had shown significant improvements in a number of few-shot text understanding tasks (sentiment analysis/ semantic reasoning).”
MethodOn the Analysis of Cross-Lingual Prompt Tuning for Decoder-based Multilingual Model
Park, N., Park, J., Yoo, K. M., & Yoon, S. (2023) · arXiv.org · doi:10.48550/arxiv.2311.07820 · Cited by 4
“In other words, we presume the finely tokenized subwords may act as a form of discrete prompts (Liu et al., 2021; Han et al., 2021), leading to the observation that prompt tuning is more effective for low-resource languages compared to fine-tuning.”
BackgroundAttention is Not Always What You Need: Towards Efficient Classification of Domain-Specific Text
Wahba, Y., Madhavji, N., & Steinbacher, J. (2023) · arXiv.org · doi:10.1007/978-3-031-37963-5_80 · Cited by 4
“• Domain-specific terms are challenging for PLMs since there are few statistical clues in the underlying training corpora [13][14].”
BackgroundInfluentialSTA: Self-controlled Text Augmentation for Improving Text Classifications
Wang, C., Pontiveros, G. F., Derby, S., & Wijaya, T. K. (2023) · ECNLP · doi:10.48550/arxiv.2302.12784 · Cited by 4
“To ensure semantic fidelity, the model itself (self-controlling) is then used to both generate novel data and selectively retain only the most convincing examples using a classification template.”
MethodConsprompt: Exploiting Contrastive Samples for Few-Shot Prompt Learning
Weng, J., Deng, Y., Li, D., Hao, Y., Hu, Y., & Huang, H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448403 · Cited by 3
“In order to construct a task-specific prompt, [5] apply some logical rules in the sub-prompts construction.”
BackgroundLong Text Truncation Algorithm Based on Label Embedding in Text Classification
Chen, J., & Lv, S. (2022) · Applied Sciences · doi:10.3390/app12199874 · Cited by 4
A Unified Generative Framework based on Prompt Learning for Various Information Extraction Tasks
Kan, Z.-G., Feng, L., Yin, Z., Qiao, L.-B., Qiu, X., & Li, D. (2022) · arXiv.org · doi:10.48550/arxiv.2209.11570 · Cited by 4
“To make a fair comparison, we applied the same split as the previous works [10], [11], [33], [35], [43] and followed the evaluation criteria used in them as well.”
InfluentialFL-Tuning: Layer Tuning for Feed-Forward Network in Transformer
Liu, J.-P., Song, Y., Xue, K., Sun, H., Wang, C., Chen, L., Jiang, H., Liang, J.-Q., & Ruan, T. (2022) · arXiv.org · doi:10.48550/arxiv.2206.15312 · Cited by 4
Research on Natural Language Misleading Content Detection Method Based on Attention Mechanism
Liu, B. (2025) · IEEE Access · doi:10.1109/access.2025.3591455 · Cited by 5
“…researchers have progressively explored more sophisticated natural language processing (NLP) techniques, transitioning from early pattern-based systems to context-sensitive neural models, and eventually to attention-enhanced architectures that selectively focus on crucial parts of the input [4].”
Gedara, T. M. H., Gaeta, R., Tomasiello, S., & Shawi, R. E. (2025) · IEEE Access · doi:10.1109/access.2025.3627504 · Cited by 5
“However, due to the limited interpretability of soft prompts, Han et al. [51] proposed combining hard templates with soft tokens, striking a balance between interpretability and adaptability.”
Zhou, Z.-Y., Lin, Y., Wen, H., Guo, S., Hu, J.-L., Lin, Y.-F., & Wan, H.-Y. (2024) · arXiv.org · doi:10.48550/arxiv.2405.12459 · Cited by 4
“𝑜”
Wang, Y., Mei, J., Zou, B., Fan, R., He, T., & Aw, A. T. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.853 · Cited by 5
A Prompt Based Approach for Euphemism Detection
Maimaitituoheti, A., Yang, Y., & Fan, X.-C. (2022) · FLP · doi:10.18653/v1/2022.flp-1.2 · Cited by 4
“Like the template, there are a lot of ways to create verbalizers, including manually created verbalizer, knowledgeable verbalizer (Hu et al., 2022), and ptr verbalizer (Han et al., 2021).”
MethodAutomatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data
Shum, K., Diao, S., & Zhang, T. (2023) · arXiv · doi:10.48550/arxiv.2302.12822 · Cited by 3
“…al., 2021; Gao et al., 2021; Ben-David et al., 2022; Davison et al., 2019; Su et al., 2022; Diao et al., 2022; Guo et al., 2023) and continuous prompts (Zhong et al., 2021; Qin and Eisner, 2021; Hambardzumyan et al., 2021; Liu et al., 2021; Han et al., 2021; Li and Liang, 2021; Yang et al., 2023).”
Prompt-tuning with Attribute Guidance for Low-resource Entity Matching
Liu, L., & Yang, C. (2026) · Pacific-Asia Conference on Knowledge Discovery and Data Mining · doi:10.48550/arxiv.2603.19321 · Cited by 3
“Recently, methods like continuous prompts [12,7] have emerged, reducing the need for manual prompt design and improving prompt expressiveness.”
ImagePrompt: Image-enhanced prompt-tuning for multimodal relation extraction
Zhang, R., Hu, Y., Liu, T., & Cao, J. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131264 · Cited by 2
Choi, Y., Lee, M.-J., Soo-Young, H., & Han, J. (2025) · SAGE Open · doi:10.1177/21582440251381680 · Cited by 7
“Ongoing academic research spanning diverse applications of GAI has highlighted the significance of meticulously developed prompts (Dai et al., 2023; Han et al., 2022; Liu & Chilton, 2022).”
DiaBlo: Diagonal Blocks Are Sufficient For FinetuningPreprint
Gurses, S., Zhang, A., Deng, Y., Dong, X., Li, X., Wang, N., Yin, P., & Yang, Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.03230 · Cited by 4
“Early PEFT techniques, such as Prompt Tuning [16, 27] and Prefix Tuning [28], introduce learnable embeddings or token sequences that steer the model’s behavior without modifying the core parameters.”
Wei, D., Chau, M., & Li, Z. (2025) · MIS Quarterly · doi:10.25300/misq/2025/18416 · Cited by 4
A multi-source heterogeneous knowledge injected prompt learning method for legal charge prediction
Sun, J., & Wei, C. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113438 · Cited by 5
Rumor detection for emergency events via few-shot ensembled prompt learning
Su, C., Zhou, J., Jiang, Z., Zhu, S., Li, C., Fang, W. H., & Lu, H. (2025) · Journal of Intelligent Information Systems · doi:10.1007/s10844-025-00944-6 · Cited by 4
“…s and an entity mention m in s , Ding et al. (2021) and Huang et al. (2022) both inserted s into a prompt template to build the input text sequence for a PLM, In few-shot relation extraction, Han et al. (2022) designed sub-prompts for each instance, combining their results for the final prediction.”
Empirical Evaluation of Prompting Strategies for Fact Verification Tasks
Chakraborty, M., Kulkarni, A., & Li, Q. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3701716.3717815 · Cited by 3
“Han et al. [7] proposed prompt tuning methods for classification tasks, while Sobania et al. [21] and Xia and Zhang [26] examined prompts for software bug fixing.”
Cao, X., Shi, L., Wang, X., Duan, Y., Yang, X., & Zhang, X. (2025) · Applied Sciences · doi:10.3390/app15042106 · Cited by 2
“Han et al. [33] introduced rule-based prompt tuning and refinement (PTR) for multi-class text classification, leveraging logical rules to construct prompts with multiple sub-prompts.”
A homogeneous multimodality sentence representation for relation extraction
Wang, K., Chen, Y., Yang, W., & Qin, Y. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102968 · Cited by 3
A Commit Classification Framework Incorporated With Prompt Tuning and External Knowledge
Tong, J., & Rui, X. (2025) · IET Software · doi:10.1049/sfw2/5566134 · Cited by 2
“Han et al. [32] proposed a method that encodes external knowledge in classi fi cation tasks into rules, then, designs sub-cues according to the rules, and fi nally combines the sub-cues to handle the classi fi cation task.”
Knowledge-enhanced meta-prompt for few-shot relation extraction
Cui, J., Xu, F., Wang, X., Li, Y., Qu, X., Yao, L., & Li, D. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101762 · Cited by 3
The Effect of Prompt Types on Text Summarization Performance With Large Language Models
Borhan, I., & Bajaj, A. (2024) · Journal of Database Management · doi:10.4018/jdm.358475 · Cited by 7
Document-level relation extraction with multi-semantic knowledge interaction
Hou, W., Wu, W., Liu, X., & Zhao, W. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121083 · Cited by 3
Self-citationStaRS : Learning a Stable Representation Space for Continual Relation Classification
Pang, N., Zhao, X. H., Zeng, W., Tan, Z., & Xiao, W. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3442236 · Cited by 4
“To accomplish RC in realistic few-shot setting [25], [26], prompt-tuning is introduced to take full advantages of knowledge in PLMs that bridges the gap between RC and the pretraining task of PLMs.”
A Review on Neuro-symbolic AI Improvements to Natural Language Processing
Keber, M., Grubišić, I., Barešić, A., & Jović, A. (2024) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.1109/mipro60963.2024.10569741 · Cited by 12
“Without tuning the model Han et al. [43] used rules to inject a prefix that dynamically influences the MHA into a prompt for each shot at NER and RE.”
Explainable Deepfake Detection with Human Prompts
Ma, X., Tian, J.-H., Li, Z.-X., Chai, Y.-S., Zang, L.-J., & Han, J.-Z. (2024) · International Conference on Computer Supported Cooperative Work in Design · doi:10.1109/cscwd61410.2024.10580761 · Cited by 3
“Han et al. [15] propose knowledgeable prompt learning for fake news detection (FND).”
BackgroundJiang, Y.-Z., Li, J.-L., & Chen, H. (2024) · International Conference on Language Resources and Evaluation · doi:10.63317/5p6y3hiezipy · Cited by 3
“• PTR (Han et al., 2022b) It applies logic rules to construct prompts with several sub-prompts.”
BackgroundMethodInfluential
Metadata
- Authors
- Han, X., Zhao, W., Ding, N., Liu, Z., & Sun, M.
- Affiliations
- Beijing National Research Center for Information Science and Technology (CN)
- Beijing Academy of Artificial Intelligence (CN)
- Corresponding author
- Liu, Zhiyuan
- Sun, Maosong
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Volume
- 3
- Pages
- 182-192
- ISSN
- 2666-6510 (ISSN-L)
- arXiv
- 2105.11259
- OpenAlex
- W4309811444
- Cited by
- 478
- References
- 54
- Citations by year
- 2026: 27 · 2025: 92 · 2024: 131 · 2023: 137 · 2022: 77 · 2021: 14
- FWCI
- 35.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-nd
- arxiv.org/licenses/nonexclusive-distrib/1.0/
- Locations
- AI Open (publishedVersion, cc-by-nc-nd)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (62236004)
- Tsinghua University
- National Key Research and Development Program of China (2020AAA0106500)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- prompt tuning, text classification, pre-trained language models, relation classification, entity typing, intent classification, prior knowledge encoding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
