P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks
Open accessAbstract
Prompt tuning, which only tunes continuous prompts with a frozen language model, substantially reduces per-task storage and memory usage at training. However, in the context of NLU, prior work reveals that prompt tuning does not perform well for normal-sized pretrained models. We also find that existing methods of prompt tuning cannot handle hard sequence labeling tasks, indicating a lack of universality. We present a novel empirical finding that properly optimized prompt tuning can be universally effective across a wide range of model scales and NLU tasks. It matches the performance of finetuning while having only 0.1%-3% tuned parameters. Our method P-Tuning v2 is an implementation of Deep Prompt Tuning (CITATION) optimized and adapted for NLU. Given the universality and simplicity of P-Tuning v2, we believe it can serve as an alternative to finetuning and a strong baseline for future research.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · see citing works
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · see citing works
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · see citing works
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687 · see citing works
Self-citationSQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · see citing works
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222 · see citing works
The Power of Scale for Parameter-Efficient Prompt Tuning
Lester, B., Al-Rfou, R., & Constant, N. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.243 · Cited by 3,096 · see citing works
The Power of Scale for Parameter-Efficient Prompt Tuning
Lester, B., Al-Rfou, R., & Constant, N. (2021) · arXiv · doi:10.48550/arxiv.2104.08691 · Cited by 3,092
Prefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473 · see citing works
Introduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity RecognitionPreprint
Sang, E. T. K. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0209010 · Cited by 1,677 · see citing works
Making Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.295 · Cited by 1,380 · see citing works
AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts
Shin, T., Razeghi, Y., Logan IV, R. L., Wallace, E., & Singh, S. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.346 · Cited by 1,279 · see citing works
Liu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2023) · AI Open · doi:10.1016/j.aiopen.2023.08.012 · Cited by 1,124 · see citing works
Self-citationDEBERTA: DECODING-ENHANCED BERT WITH DISENTANGLED ATTENTION
He, P., Liu, X., Gao, J., & Chen, W. (2021) · International Conference on Learning Representations · Cited by 1,116 · see citing works
Self-citationSuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
Wang, A., Pruksachatkun, Y., Nangia, N., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. R. (2019) · arXiv · doi:10.48550/arxiv.1905.00537 · Cited by 1,051 · see citing works
It’s Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners
Schick, T., & Schütze, H. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.185 · Cited by 747 · see citing works
(2012) · Cited by 618 · see citing works
Introduction to the CoNLL-2004 Shared Task: Semantic Role Labeling
Carreras, X., & Màrquez, L. (2004) · Cited by 393 · see citing works
PPT: Pre-trained Prompt Tuning for Few-shot Learning
Gu, Y., Han, X., Liu, Z., & Huang, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.576 · Cited by 392 · see citing works
Learning How to Ask: Querying LMs with Mixtures of Soft Prompts
Qin, G., & Eisner, J. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.410 · Cited by 342 · see citing works
Factual Probing Is [MASK]: Learning vs. Learning to Recall
Zhong, Z., Friedman, D., & Chen, D. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.398 · Cited by 274 · see citing works
Noisy Channel Language Model Prompting for Few-Shot Text Classification
Min, S., Lewis, M., Hajishirzi, H., & Zettlemoyer, L. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.365 · Cited by 142 · see citing works
Kim, B., Kim, H., Lee, S., Lee, G., Kwak, D., Hyeon, J. D., Park, S., Kim, S., Kim, S., Seo, D., et al. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.274 · Cited by 97 · see citing works
Better Feature Integration for Named Entity Recognition
Xu, L. T., Jie, Z., Lu, W., & Bing, L. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.271 · Cited by 43 · see citing works
All NLP Tasks Are Generation Tasks: A General Pretraining FrameworkPreprint
Du, Z., Qian, Y., Liu, X., Ding, M., Qiu, J., Yang, Z., & Tang, J. (2021) · arXiv (Cornell University) · Cited by 38 · see citing works
Self-citationAdaPrompt: Adaptive Prompt-based Finetuning for Relation ExtractionPreprint
Chen, X., Xie, X. Y., Zhang, N., Yan, J., Deng, S., Tan, C., Huang, F., Si, L., & Chen, H. (2021) · arXiv (Cornell University) · Cited by 33 · see citing works
Language Models are Good TranslatorsPreprint
Wang, S., Tu, Z., Tan, Z., Wang, W., Sun, M., & Liu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.13627 · Cited by 15 · see citing works
Wang, H., Cui, M., Zhou, Z., Fung, G. P. C., & Wong, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.05187 · Cited by 10 · see citing works
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language UnderstandingPreprint
Zheng, Y., Zhou, J., Qian, Y., Ding, M., Liao, C., Li, J., Salakhutdinov, R., Tang, J., Ruder, S., & Yang, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.12742 · Cited by 8 · see citing works
Self-citationBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805
Flagged first, then by citations
Research works printed but not linked: 4
- P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks https://aclanthology.org/2022.acl-short.8/ (Liu et al., ACL 2022)
- P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks (Liu et al., ACL 2022)
- Xiao Liu, Kaixuan Ji, Yicheng Fu, Weng Tam, Zhengxiao Du, Zhilin Yang, and Jie Tang. 2022. P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 61–68, Dublin, Ireland. Association for Computational Linguistics.
- ACL materials are Copyright © 1963–2026 ACL; other materials are copyrighted by their respective copyright holders. Materials prior to 2016 here are licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 International License. Permission is granted to make copies for the purposes of teaching and research. Materials published in or after 2016 are licensed on a Creative Commons Attribution 4.0 International License.
Cited by
Sorted by citations
Jia, M., Tang, L., Chen, B.-C., Cardie, C., Belongie, S., Hariharan, B., & Lim, S.-N. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19827-4_41 · Cited by 1,965 · see citing works
A Comprehensive Overview of Large Language Models
Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N., & Mian, A. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3744746 · Cited by 1,257 · see citing works
Liu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2023) · AI Open · doi:10.1016/j.aiopen.2023.08.012 · Cited by 1,124 · see citing works
Self-citationHarnessing the power of llms in practice: a survey on chatGPT and beyond
Yang, J., Jin, H., Tang, R., Han, X., Feng, Q., Jiang, H., Zhong, S., Yin, B., & Hu, X. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3649506 · Cited by 644 · see citing works
DualPrompt: Complementary Prompting for Rehearsal-Free Continual Learning
Wang, Z., Zhang, Z., Ebrahimi, S., Sun, R., Zhang, H., Lee, C.-Y., Ren, X., Su, G., Perot, V., Dy, J., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19809-0_36 · Cited by 532 · see citing works
Using large language models in psychology
Demszky, D., Yang, D., Yeager, D. S., Bryan, C. J., Clapper, M., Chandhok, S., Eichstaedt, J. C., Hecht, C., Jamieson, J., Johnson, M., et al. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00241-5 · Cited by 369 · see citing works
Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey
Ling, C., Zhao, X., Lu, J., Deng, C., Zheng, C., Wang, J., Chowdhury, T., Li, Y., Cui, H., Zhang, X., et al. (2025) · ACM Computing Surveys · doi:10.1145/3764579 · Cited by 263 · see citing works
ZegCLIP: Towards Adapting CLIP for Zero-shot Semantic Segmentation
Zhou, Z., Lei, Y., Zhang, B., Liu, L., & Liu, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01075 · Cited by 251 · see citing works
End-Edge-Cloud Collaborative Computing for Deep Learning: A Comprehensive Survey
Wang, Y., Yang, C., Lan, S.-L., Zhu, L.-H., & Zhang, Y. (2024) · IEEE Communications Surveys and Tutorials · doi:10.1109/comst.2024.3393230 · Cited by 255 · see citing works
How Can Recommender Systems Benefit from Large Language Models: A Survey
Lin, J., Dai, X., Xi, Y., Liu, W., Chen, B., Zhang, H., Liu, Y., Wu, C., Li, X., Zhu, C., et al. (2025) · ACM Transactions on Information Systems · doi:10.1145/3678004 · Cited by 242 · see citing works
Review of large vision models and visual prompt engineering
Wang, J., Liu, Z., Zhao, L., Wu, Z., Ma, C., Yu, S., Dai, H., Yang, Q., Liu, Y., Zhang, S., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100047 · Cited by 231 · see citing works
When LLMs meet cybersecurity: a systematic literature review
Zhang, J., Bu, H., Wen, H., Liu, Y., Fei, H., Xi, R., Li, L., Yang, Y., Zhu, H., & Meng, D. (2025) · Cybersecurity · doi:10.1186/s42400-025-00361-w · Cited by 220 · see citing works
All in One: Multi-Task Prompting for Graph Neural Networks
Sun, X., Cheng, H., Li, J., Liu, B., & Guan, J. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599256 · Cited by 189 · see citing works
Parameter-efficient fine-tuning in large language models: a survey of methodologies
Wang, L., Chen, S., Jiang, L., Pan, S., Cai, R., Yang, S., & Yang, F. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11236-4 · Cited by 186 · see citing works
Liu, P., Qian, L., Zhao, X., & Tao, B. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3366977 · Cited by 186 · see citing works
ViTPose++: Vision Transformer for Generic Body Pose Estimation
Xu, Y., Zhang, J., Zhang, Q., & Tao, D. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3330016 · Cited by 172 · see citing works
No more fine-tuning? an experimental evaluation of prompt tuning in code intelligence
Wang, C., Yang, Y., Gao, C., Peng, Y. F., Zhang, H., & Lyu, M. R.-T. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3549113 · Cited by 153 · see citing works
ChatAgri: Exploring potentials of ChatGPT on cross-linguistic agricultural text classification
Zhao, B., Jin, W., Ser, J. D., & Yang, G. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126708 · Cited by 150 · see citing works
OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learning
Ye, R., Wang, W., Chai, J., Li, D., Li, Z., Xu, Y., Du, Y., Wang, Y., & Chen, S. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671582 · Cited by 143 · see citing works
Prompttts: Controllable Text-To-Speech With Text Descriptions
Guo, Z., Leng, Y., Wu, Y., Zhao, S., & Tan, X. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096285 · Cited by 142 · see citing works
When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications
Liu, Q., Wu, X., Zhao, X., Zhu, Y., Xu, D., Tian, F., & Zheng, Y. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657722 · Cited by 141 · see citing works
Large Language Models in Finance (FinLLMs)
Lee, J., Stevens, N., & Han, S. C. (2025) · Neural Computing and Applications · doi:10.1007/s00521-024-10495-6 · Cited by 133 · see citing works
NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Rails
Rebedea, T., Dinu, R., Sreedhar, M. N., Parisien, C., & Cohen, J. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2023.emnlp-demo.40 · Cited by 130 · see citing works
Fill in the Blank: Context-aware Automated Text Input Generation for Mobile GUI Testing
Liu, Z., Chen, C., Wang, J., Che, X., Huang, Y.-K., Hu, J., & Wang, Q. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00119 · Cited by 130 · see citing works
Wei, Z., Chen, L., Jin, Y., Ma, X., Liu, T., Ling, P., Wang, B., Chen, H., & Zheng, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02704 · Cited by 121 · see citing works
The life cycle of large language models in education: A framework for understanding sources of bias
Lee, J., Hicke, Y., Yu, R., Brooks, C., & Kizilcec, R. F. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13505 · Cited by 119 · see citing works
Exploring Large Language Models for Knowledge Graph Completion
Yao, L., Peng, J., Mao, C., & Luo, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889242 · Cited by 115 · see citing works
S3: Social-network Simulation System with Large Language Model-Empowered Agents
Gao, C., Lan, X., Lu, Z., Mao, J., Piao, J., Wang, H., Jin, D., & Li, Y. (2023) · doi:10.2139/ssrn.4607026 · Cited by 113 · see citing works
Graph Foundation Models: Concepts, Opportunities and Challenges
Liu, J., Yang, C. H., Lu, Z., Chen, J., Li, Y., Zhang, M., Bai, T., Fang, Y., Sun, L., Yu, P. S., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3548729 · Cited by 111 · see citing works
From Large Language Models to Large Multimodal Models: A Literature Review
Huang, D., Yan, C., Li, Q., & Peng, X. (2024) · Applied Sciences · doi:10.3390/app14125068 · Cited by 110 · see citing works
Semantic understanding and prompt engineering for large-scale traffic data imputation
Zhang, K., Zhou, F., Wu, L., Xie, N., & He, Z. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102038 · Cited by 109 · see citing works
Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Models
Louis, A., DIJCK, G. V., & Spanakis, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i20.30232 · Cited by 108 · see citing works
A Survey on Employing Large Language Models for Text-to-SQL Tasks
Shi, L., Tang, Z., Zhang, N., Zhang, X., & Yang, Z. (2025) · ACM Computing Surveys · doi:10.1145/3737873 · Cited by 105 · see citing works
Self-citationTowards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning
Zhang, Z.-R., Tan, C., Xu, H., Wang, C., Huang, J. G., & Huang, S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.107 · Cited by 102 · see citing works
Information Retrieval meets Large Language Models: A strategic report from Chinese IR community
Ai, Q., Bai, T., Cao, Z., Chang, Y., Chen, J., Chen, Z., Cheng, Z., Dong, S., Dou, Z., Feng, F., et al. (2023) · AI Open · doi:10.1016/j.aiopen.2023.08.001 · Cited by 100 · see citing works
An overview of large AI models and their applications
Tu, X., He, Z., Huang, Y., Zhang, Z., Yang, M., & Zhao, J. C. (2024) · Visual Intelligence · doi:10.1007/s44267-024-00065-8 · Cited by 95 · see citing works
Application of large language models in medicine
Liu, F., Zhou, H., Gu, B., Zou, X., Huang, J., Wu, J., Li, Y., Chen, S. S., Hua, Y., Zhou, P., et al. (2025) · Nature Reviews Bioengineering · doi:10.1038/s44222-025-00279-5 · Cited by 94 · see citing works
LLM Fine-Tuning: Concepts, Opportunities, and Challenges
Wu, X.-K., Chen, M., Li, W., Wang, R., Lu, L., Liu, J., Hwang, K., Hao, Y., Pan, Y., Meng, Q., et al. (2025) · Big Data and Cognitive Computing · doi:10.3390/bdcc9040087 · Cited by 94 · see citing works
Towards Human-Like Educational Question Generation with Large Language Models
Wang, Z., Valdez, J., Mallick, D. B., & Baraniuk, R. G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-11644-5_13 · Cited by 92 · see citing works
Exploring the frontiers of LLMs in psychological applications: a comprehensive review
Ke, L., Tong, S., Cheng, P., & Peng, K. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11297-5 · Cited by 92 · see citing works
CNN-BiLSTM-Attention: A multi-label neural classifier for short texts with a small set of labels
Lu, G., Liu, Y., Wang, J., & Wu, H. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103320 · Cited by 86 · see citing works
5%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks
Yin, D., Hu, L., Li, B., Zhang, Y., & Yang, X. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01869 · Cited by 87 · see citing works
Automated Essay Scoring and Revising Based on Open-Source Large Language Models
Song, Y., Zhu, Q., Wang, H., & Zheng, Q. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3396873 · Cited by 82 · see citing works
Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performance
Lin, L., Fan, H., Zhang, Z., Wang, Y., Xu, Y., & Ling, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73232-4_17 · Cited by 77 · see citing works
A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trends
Jiang, J., Zuo, Z., Wu, G., Jiang, K., & Liu, X. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3598132 · Cited by 78 · see citing works
Self-citationGraphLLM: Boosting Graph Reasoning Ability of Large Language Model
Chai, Z., Zhang, T., Wu, L., Han, K., Hu, X., Huang, X., & Yang, Y. (2025) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3627488 · Cited by 77 · see citing works
Augmenting Low-Resource Text Classification with Graph-Grounded Pre-training and Prompting
Wen, Z., & Fang, Y. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591641 · Cited by 73 · see citing works
Cheng, P., Yang, X., Smith, K. E., Yu, Z., Chen, A., Bian, J., & Wu, Y. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104630 · Cited by 73 · see citing works
Park, D., An, G.-T., Kamyod, C., & Kim, C. G. (2024) · Journal of Web Engineering · doi:10.13052/jwe1540-9589.2285 · Cited by 72 · see citing works
Han, S., Wang, M., Zhang, J., Li, D., & Duan, J. (2024) · Electronics · doi:10.3390/electronics13245040 · Cited by 72 · see citing works
CCT5: A Code-Change-Oriented Pre-trained Model
Lin, B., Wang, S., Liu, Z., Liu, Y., Xia, X., & Mao, X. (2023) · Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3611643.3616339 · Cited by 69 · see citing works
Kim, S., Joo, S., Kim, D., Jang, J., Ye, S., Shin, J., & Seo, M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.782 · Cited by 69 · see citing works
Multitask Vision-Language Prompt Tuning
Shen, S., Yang, S., Zhang, T., Zhai, B., Gonzalez, J. E., Keutzer, K., & Darrell, T. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00556 · Cited by 69 · see citing works
A Practical Survey on Zero-shot Prompt Design for In-context Learning
Columbia University, N. Y. C., & Li, Y. (2023) · Proceedings of the Conference Recent Advances in Natural Language Processing - Large Language Models for Natural Language Processings · doi:10.26615/978-954-452-092-2_069 · Cited by 68 · see citing works
Personalized Prompt for Sequential Recommendation
Wu, Y., Xie, R., Zhu, Y., Zhuang, F., Zhang, X., Lin, L., & He, Q. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3357498 · Cited by 67 · see citing works
Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition
Guo, Z., Jin, T., & Zhao, Z. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.94 · Cited by 77 · see citing works
Mayer, C., Ludwig, S., & Brandt, S. (2022) · Journal of Research on Technology in Education · doi:10.1080/15391523.2022.2142872 · Cited by 64 · see citing works
Unique Security and Privacy Threats of Large Language Models: A Comprehensive Survey
Wang, S., Zhu, T., Liu, B., Ding, M., Ye, D., Zhou, W., & Yu, P. S. (2025) · ACM Computing Surveys · doi:10.1145/3764113 · Cited by 64 · see citing works
Che, T., Liu, J., Yang, Z., Ren, J., Zhou, J., Sheng, V. S., Dai, H., & Dou, D. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.488 · Cited by 63 · see citing works
Self-citationEfficient Model Personalization in Federated Learning via Client-Specific Prompt Generation
Yang, F.-E., Wang, C.-Y., & Wang, Y.-C. F. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01755 · Cited by 63 · see citing works
Revisiting Parameter-Efficient Tuning: Are We Really There Yet?
Chen, G., Liu, F., Meng, Z., & Liang, S. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.168 · Cited by 60 · see citing works
Generative Artificial Intelligence for Software Engineering—A Research Agenda
Nguyen‐Duc, A., Cabrero‐Daniel, B., Przybylek, A., Arora, C., Khanna, D., Herda, T., Rafiq, U., Melegati, J., Guerra, E., Kemell, K., et al. (2025) · Software: Practice and Experience · doi:10.1002/spe.70005 · Cited by 60 · see citing works
WaterGPT: Training a Large Language Model to Become a Hydrology Expert
Ren, Y., Zhang, T., Dong, X., Li, W., Wang, Z., He, J., Zhang, H., & Jiao, L. (2024) · Water · doi:10.3390/w16213075 · Cited by 60 · see citing works
Adapting Language Models to Compress Contexts
Chevalier, A., Wettig, A., Ajith, A., & Chen, D. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.232 · Cited by 59 · see citing works
LLaFS: When Large Language Models Meet Few-Shot Segmentation
Zhu, L., Chen, T., Ji, D., Ye, J., & Liu, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00296 · Cited by 59 · see citing works
Similarity-Aware Multimodal Prompt Learning for fake news detection
Jiang, Y., Yu, X., Wang, Y., Xu, X., Song, X., & Maynard, D. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119446 · Cited by 58 · see citing works
Recent Advances of Foundation Language Models-based Continual Learning: A Survey
Yang, Y., Zhou, J., Ding, X., Huai, T., Liu, S., Chen, Q., Xie, Y., & He, L. (2024) · ACM Computing Surveys · doi:10.1145/3705725 · Cited by 57 · see citing works
Nie, T., Sun, J., & Ma, W. (2025) · Artificial Intelligence for Transportation · doi:10.1016/j.ait.2025.100003 · Cited by 56 · see citing works
<scp>PLeak:</scp> Prompt Leaking Attacks against Large Language Model Applications
Hui, B., Yuan, H., Gong, N., Burlina, P., & Cao, Y. (2024) · Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3658644.3670370 · Cited by 55 · see citing works
A survey on semantic processing techniques
Mao, R., He, K., Zhang, X., Chen, G., Ni, J., Yang, Z., & Cambria, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101988 · Cited by 55 · see citing works
Self-citationLarge scale foundation models for intelligent manufacturing applications: a survey
Zhang, H., Semujju, S. D., Wang, Z., Lv, X., Xu, K., Wu, L., Jia, Y., Wu, J., Liang, W., Zhuang, R., et al. (2025) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-024-02536-7 · Cited by 52 · see citing works
Tuan, N. T., Moore, P. T., Thanh, D. H. V., & Pham, H. V. (2024) · Applied Sciences · doi:10.3390/app14073036 · Cited by 49 · see citing works
Progressive Visual Prompt Learning with Contrastive Feature Re-formation
Chen, X., Zhu, Y., Shen, H., Chen, B., Liao, Y., Chen, X., & Wang, L. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02172-x · Cited by 47 · see citing works
ArGue: Attribute-Guided Prompt Tuning for Vision-Language Models
Tian, X., Zou, S., Yang, Z., & Zhang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02700 · Cited by 47 · see citing works
Self-citationDuan, H., Shao, S., Zhai, B., Shah, T., Han, J., & Ranjan, R. K. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02398-3 · Cited by 47 · see citing works
Tu, C.-H., Mai, Z., & Chao, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00746 · Cited by 46 · see citing works
Ma, J., Zhao, J., & Hou, Y. (2024) · Sensors · doi:10.3390/s24175502 · Cited by 45 · see citing works
Yang, Y., Zhou, X., Mao, R., Xu, J., Yang, L., Zhang, Y., Shen, H., & Zhang, H. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112234 · Cited by 45 · see citing works
Prompt Tuning in Code Intelligence: An Experimental Evaluation
Wang, C., Yang, Y., Gao, C., Peng, Y., Zhang, H., & Lyu, M. R.-T. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3313881 · Cited by 44 · see citing works
Domain Prompt Learning for Efficiently Adapting CLIP to Unseen Domains
Zhang, X., Gu, S., Matsuo, Y., & Iwasawa, Y. (2023) · Transactions of the Japanese Society for Artificial Intelligence · doi:10.1527/tjsai.38-6_b-mc2 · Cited by 43 · see citing works
Huang, Q. Y., Yuan, Z., Xing, Z., Xu, X., Zhu, L., & Lu, Q. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3556912 · Cited by 42 · see citing works
Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models
Zha, Y., Wang, J., Dai, T., Chen, B., Wang, Z., & Xia, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01302 · Cited by 42 · see citing works
LEAP: LLM instruction-example adaptive prompting framework for biomedical relation extraction
Zhou, H., Li, M., Xiao, Y., Yang, H., & Zhang, R. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae147 · Cited by 42 · see citing works
A Fast, Performant, Secure Distributed Training Framework For LLM
Huang, W., Wang, Y., Cheng, A., Zhou, A., Yu, C., & Wang, L. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446717 · Cited by 41 · see citing works
MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning
Peng, L., Cai, S., Wu, Z., Shang, H., Zhu, X., & Li, X. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103225 · Cited by 41 · see citing works
ChatGPT for digital pathology research
Omar, M., Ullanat, V., Loda, M. F., Marchionni, L., & Umeton, R. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00114-6 · Cited by 39 · see citing works
Li, H., Yang, R., Xu, S., Xiao, Y., & Zhao, H. (2024) · Buildings · doi:10.3390/buildings14082502 · Cited by 39 · see citing works
Karakurt, E., & Akbulut, A. (2025) · Applied Sciences · doi:10.3390/app16010368 · Cited by 39 · see citing works
Choi, M., Pei, J., Kumar, S., Shu, C., & Jurgens, D. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.699 · Cited by 38 · see citing works
Automatic depression severity assessment with deep learning using parameter-efficient tuning
Lau, C., Zhu, X., & Chan, W.-Y. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1160291 · Cited by 38 · see citing works
When Prompt-based Incremental Learning Does Not Meet Strong Pretraining
Tang, Y.-M., Peng, Y.-X., & Zheng, W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00164 · Cited by 38 · see citing works
Prompt Guided Transformer for Multi-Task Dense Prediction
Lu, Y., Sirejiding, S., Ding, Y., Wang, C., & Lu, H. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3349865 · Cited by 37 · see citing works
RumorLLM: A Rumor Large Language Model-Based Fake-News-Detection Data-Augmentation Approach
Lai, J., Yang, X., Luo, W., Zhou, L., Li, L., Wang, Y., & Shi, X. (2024) · Applied Sciences · doi:10.3390/app14083532 · Cited by 37 · see citing works
A Survey on the Optimization of Large Language Model-based Agents
Du, S., Zhao, J., Shi, J., Xie, Z., Jiang, X., Bai, Y., & He, L. (2026) · ACM Computing Surveys · doi:10.1145/3789261 · Cited by 38 · see citing works
PanDa: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation
Zhong, Q., Ding, L., Liu, J., Du, B., & Tao, D. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3376453 · Cited by 37 · see citing works
From Misuse to Mastery: Enhancing Code Generation with Knowledge-Driven AI Chaining
Ren, X., Ye, X., Zhao, D., Xing, Z., & Yang, X. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00143 · Cited by 36 · see citing works
Huang, C., Lu, K.-H., Wang, S.-H., Hsiao, C.-Y., Kuan, C.-Y., Wu, H., Arora, S., Chang, K., Shi, J., Peng, Y., et al. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448257 · Cited by 35 · see citing works
Ta-Adapter: Enhancing few-shot CLIP with task-aware encoders
Zhang, W., Zhang, Y., Deng, Y., Zhang, W., Lin, J., Huang, B., Zhang, J., & Yu, W. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110559 · Cited by 35 · see citing works
A review on enhancing agricultural intelligence with large language models
Li, H.-X., Wu, H., Li, Q., & Zhao, C. (2025) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2025.05.006 · Cited by 35 · see citing works
DreamArtist: Controllable One-Shot Text-to-Image Generation via Positive-Negative Adapter
Dong, Z., Wei, P., & Lin, L. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02526-z · Cited by 35 · see citing works
- Authors
- Liu, X., Ji, K., Fu, Y., Tam, W., Du, Z., Yang, Z., & Tang, J.
- Affiliations
- Beijing Academy of Artificial Intelligence (CN)
- Tsinghua University (CN)
- Shanghai Qi Zhi Institute (CN)
- Corresponding author
- Liu, Xiao
- Venue
- Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
- Published
- 2022
- Pages
- 61-68
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W4285247752
- Cited by
- 810
- References
- 29
- Citations by year
- 2026: 112 · 2025: 232 · 2024: 265 · 2023: 173 · 2022: 28
- FWCI
- 96.50
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- Funders
- National Natural Science Foundation of China (61836013, 61825602)
- Tsinghua University
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- prompt tuning, fine-tuning alternatives, natural language understanding, sequence labeling, model scale, memory efficiency, parameter-efficient training
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
