The DOI matches its DataCite record; 47 of the 49 references it cites were found in a registry or an index, and 1 are not checked yet.
The Power of Scale for Parameter-Efficient Prompt Tuning
Open accessAbstract
In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts are learned through backpropagation and can be tuned to incorporate signal from any number of labeled examples. Our end-to-end learned approach outperforms GPT-3's "few-shot" learning by a large margin. More remarkably, through ablations on model size using T5, we show that prompt tuning becomes more competitive with scale: as models exceed billions of parameters, our method "closes the gap" and matches the strong performance of model tuning (where all model weights are tuned). This finding is especially relevant in that large models are costly to share and serve, and the ability to reuse one frozen model for multiple downstream tasks can ease this burden. Our method can be seen as a simplification of the recently proposed "prefix tuning" of Li and Liang (2021), and we provide a comparison to this and other similar approaches. Finally, we show that conditioning a frozen model with soft prompts confers benefits in robustness to domain transfer, as compared to full model tuning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These approaches become inapplicable when there is only API access to the LLM.”
From Large Language Models as Optimizers (2023) · cites this paper as Lester et al., 2021
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
(2010) · International Conference on Machine Learning · Cited by 13,995
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
seaborn: statistical data visualization
Waskom, M. (2021) · Journal of Open Source Software · doi:10.21105/joss.03021 · Cited by 7,310
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
Kudo, T., & Richardson, J. (2018) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-2012 · Cited by 4,454
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Research works printed but not linked: 8
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert- Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. In Advances in Neural Information Processing Systems, volume 33, pages 1877-1901.
- Marie-Catherine De Marneff, Mandy Simons, and Ju- dith Tonhauser. 2019. The CommitmentBank: In- vestigating projection in naturally occurring dis- course. Proceedings of Sinn und Bedeutung 23.
- Danilo Giampiccolo, Bernardo Magnini, Ido Dagan, and Bill Dolan. 2007. The third PASCAL recog- nizing textual entailment challenge. In Proceedings of the ACL-PASCAL workshop on textual entailment and paraphrasing, pages 1-9. Association for Com- putational Linguistics.
- PMLR.
- Colin Raffel, Noam Shazeer, Adam Roberts, Kather- ine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to- text transformer. Journal of Machine Learning Re- search, 21(140):1-67.
- Melissa Roemmele, Cosmin Adrian Bejan, and An- drew S Gordon. 2011. Choice of plausible alterna- tives: An evaluation of commonsense causal reason- ing. In 2011 AAAI Spring Symposium Series.
- Noam Shazeer and Mitchell Stern. 2018. Adafactor: Adaptive learning rates with sublinear memory cost. In Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 4596-4604.
- PMLR.
Cited by
Sorted by citations
Items 401–500 of 1,009
Privacy Preserving Prompt Engineering: A Survey
Edemacu, K., & Wu, X. (2025) · ACM Computing Surveys · doi:10.1145/3729219 · Cited by 72
FedLLMGuard: A federated large language model for anomaly detection in 5G networks
Rezaie, H., Taheri, R., & Shojafar, M. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111473 · Cited by 38
A Comprehensive Survey on Self-Supervised Learning for Recommendation
Ren, X., Wei, W., Xia, L., & Huang, C. (2025) · ACM Computing Surveys · doi:10.1145/3746280 · Cited by 59
Towards Unified Prompt Tuning for Few-shot Text Classification
Wang, J., Wang, C., Luo, F., Tan, C., Qiu, M., Yang, F., Shi, Q., Huang, S., & Gao, M. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.37 · Cited by 43
Automatic depression severity assessment with deep learning using parameter-efficient tuning
Lau, C., Zhu, X., & Chan, W.-Y. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1160291 · Cited by 39
Heterogeneous Region Embedding with Prompt Learning
Zhou, S., He, D., Chen, L., Shang, S., & Han, P. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25625 · Cited by 37
PromptVT: Prompting for Efficient and Accurate Visual Tracking
Zhang, M., Zhang, Q., Song, W., Huang, D., & He, Q. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3376582 · Cited by 41
Troika: Multi-Path Cross-Modal Traction for Compositional Zero-Shot Learning
Huang, S., Gong, B., Feng, Y., Zhang, M., Lv, Y., & Wang, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02266 · Cited by 38
Yang, R., Zhu, J., Man, J., Liu, H., Li, F., & Zhou, Y. J. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102868 · Cited by 42
IDPG: An Instance-Dependent Prompt Generation Method
Wu, Z., Wang, S., Gu, J., Hou, R., Dong, Y., Vydiswaran, V. G. V., & Ma, H. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.403 · Cited by 41
PPT: Backdoor Attacks on Pre-trained Models via Poisoned Prompt Tuning
Du, W., Zhao, Y., Li, B., Liu, G., & Wang, S. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/96 · Cited by 41
Fiannaca, A. J., Kulkarni, C. E., Cai, C. J., & Terry, M. A. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3585737 · Cited by 42
Making LLMs Worth Every Penny: Resource-Limited Text Classification in Banking
Loukas, L., Stogiannidis, I., Diamantopoulos, O., Malakasiotis, P., & Vassos, S. (2023) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3604237.3626891 · Cited by 52
DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval
Yang, X., Zhu, L., Wang, X., & Yang, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28475 · Cited by 37
Lee, A. V. Y., Teo, C. L., & Tan, S. C. (2024) · AI · doi:10.3390/ai5030069 · Cited by 40
Zhang, X. J., Hu, X., Zhang, T., Yang, L., Liu, C., Xu, N., Wang, H., & Sun, W. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae404 · Cited by 38
Danish, S., Sadeghi‐Niaraki, A., Khan, S. U., Dang, L. M., Tightiz, L., & Moon, H. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103623 · Cited by 45
Continual Training of Language Models for Few-Shot Learning
Ke, Z., Lin, H., Shao, Y., Xu, H., Shu, L., & Liu, B. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.695 · Cited by 35
PAED: Zero-Shot Persona Attribute Extraction in Dialogues
Zhu, L., Li, W., Mao, R., Pandelea, V., & Cambria, E. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.544 · Cited by 36
FedHM: Efficient federated learning for heterogeneous models via low-rank factorization
Yao, D., Pan, W., Shi, Y., O'Neill, M. J., Dai, Y., Wan, Y., Zhao, P., Jin, H., & Sun, L. (2025) · Artificial Intelligence · doi:10.1016/j.artint.2025.104333 · Cited by 45
Identifying Creative Harmful Memes via Prompt based Approach
Ji, J., Ren, W., & Naseem, U. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3587427 · Cited by 36
A prompt model with combined semantic refinement for aspect sentiment analysis
Zhu, X., Kuang, Z., & Zhang, L. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103462 · Cited by 35
Language models are not naysayers: an analysis of language models on negation benchmarks
Truong, T. H., Baldwin, T., Verspoor, K. M., & Cohn, T. (2023) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/2023.starsem-1.10 · Cited by 69
DualCoOp++: Fast and Effective Adaptation to Multi-Label Recognition With Limited Annotations
Hu, P., Sun, X., Sclaroff, S., & Saenko, K. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3346405 · Cited by 42
Prompting Segmentation with Sound Is Generalizable Audio-Visual Source Localizer
Wang, Y., Liu, W., Li, G., Ding, J., Hu, D., & Li, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28378 · Cited by 48
Generalized Graph Prompt: Toward a Unification of Pre-Training and Downstream Tasks on Graphs
Yu, X., Liu, Z., Fang, Y., Liu, Z., Chen, S., & Zhang, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3419109 · Cited by 41
Meshkin, H., Zirkle, J., Arabidarrehdor, G., Chaturbedi, A., Chakravartula, S., Mann, J., Thrasher, B., & Li, Z. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae354 · Cited by 41
InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning
Gupta, P., Jiao, C., Yeh, Y.-T., Mehri, S., Eskénazi, M., & Bigham, J. P. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.33 · Cited by 75
Bayesian Prompt Learning for Image-Language Model Generalization
Derakhshani, M. M., Sanchez, E., Bulat, A., da Costa, V. G. T., Snoek, C. G. M., Tzimiropoulos, G., & Martínez, B. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01398 · Cited by 61
Gradient-Regulated Meta-Prompt Learning for Generalizable Vision-Language Models
Li, J., Gao, M., Wei, L., Tang, S., Zhang, W., Li, M., Ji, W., Tian, Q., Chua, T., & Zhuang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00241 · Cited by 37
Wang, L., Bi, W., Zhao, S., Ma, Y., Lv, L., Meng, C., Fu, J., & Lv, H. (2024) · JMIR Formative Research · doi:10.2196/53216 · Cited by 35
Huang, C., Lu, K.-H., Wang, S.-H., Hsiao, C.-Y., Kuan, C.-Y., Wu, H., Arora, S., Chang, K., Shi, J., Peng, Y., et al. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448257 · Cited by 53
Zhang, Y., Li, J., Wang, Z., He, Z., Guan, Q., Lin, J., & Yu, W. (2024) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2024.104312 · Cited by 41
What Language Model to Train if You Have One Million GPU Hours?
Le Scao, T., Wang, T., Hesslow, D., Bekman, S., Bari, M. S., Biderman, S., Elsahar, H., Muennighoff, N., Phang, J., Press, O., et al. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.54 · Cited by 33
Black Box Few-Shot Adaptation for Vision-Language models
Ouali, Y., Bulat, A., Matinez, B., & Tzimiropoulos, G. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01424 · Cited by 39
PanDa: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation
Zhong, Q., Ding, L., Liu, J., Du, B., & Tao, D. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3376453 · Cited by 43
LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5Preprint
Qin, C., & Joty, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07298 · Cited by 75
Parameter-efficient fine-tuning on large protein language models improves signal peptide predictionPreprint
Zeng, S., Wang, D., Jiang, L., & Xu, D. H. (2024) · Genome Research · doi:10.1101/gr.279132.124 · Cited by 34
How Does Fine-Tuning Impact Out-of-Distribution Detection for Vision-Language Models?
Ming, Y., & Li, Y. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01895-7 · Cited by 39
Knowledge Prompt-tuning for Sequential Recommendation
Zhai, J., Zheng, X., Wang, C., Li, H., & Tian, Y. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612252 · Cited by 32
UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation
Cheng, D., Huang, S., Bi, J., Zhan, Y., Liu, J., Wang, Y., Sun, H., Wei, F., Deng, W., & Zhang, Q. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.758 · Cited by 32
Infusing behavior science into large language models for activity coaching
Hegde, N., Vardhan, M., Nathani, D., Rosenzweig, E., Speed, C., Karthikesalingam, A., & Seneviratne, M. G. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000431 · Cited by 36
Li, X., Huang, G., Cheng, L., Zhong, G., Liu, W., Chen, X., & Cai, M. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104728 · Cited by 32
Prompt-Driven Referring Image Segmentation with Instance Contrasting
Shang, C., Song, Z., Qiu, H., Wang, L., Meng, F., & Li, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00395 · Cited by 37
One-dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applications
Lyu, M., Yang, Y., Hong, H., Chen, H., Jin, X., He, Y., Xue, H., Han, J., & Ding, G. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00722 · Cited by 67
An outline of Prognostics and health management Large Model: Concepts, Paradigms, and challenges
Tao, L., Li, S., Liu, H., Huang, Q., Ma, L., Ning, G., Chen, Y., Wu, Y., Li, B., Zhang, W., et al. (2025) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2025.112683 · Cited by 37
Lee, Y.-J., Chung, J. J. Y., Kim, T. S., Song, J. Y., & Kim, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502087 · Cited by 35
Jiang, Y., Zhang, L., & Wang, W. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.220 · Cited by 44
Open-Set Fine-Grained Retrieval via Prompting Vision-Language Evaluator
Wang, S., Chang, J., Li, H., Wang, Z., Ouyang, W., & Tian, Q. C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01857 · Cited by 32
Extracting Latent Steering Vectors from Pretrained Language Models
Subramani, N., Suresh, N., & Peters, M. E. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.48 · Cited by 214
APrompt: Attention Prompt Tuning for Efficient Adaptation of Pre-trained Language Models
Wang, Q., Mao, Y., Wang, J., Yu, H., Nie, S., Wang, S., Feng, F., Huang, L., Quan, X., Xu, Z., et al. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.567 · Cited by 32
Advancing bioinformatics with language models: components, applications, and perspectives
Liu, J., Yang, M., Yu, Y., Xu, H., Wang, T., Li, K., & Zhou, X. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag367 · Cited by 66
PneumoLLM: Harnessing the power of large language model for pneumoconiosis diagnosis
Song, M., Wang, J., Yu, Z., Wang, J., Yang, L., Lu, Y., Li, B., Wang, X., Wang, X., Huang, Q., et al. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103248 · Cited by 31
Tailoring Education with GenAI: A New Horizon in Lesson Planning
Karpouzis, K. C., Pantazatos, D., Taouki, J., & Meli, K. (2024) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon60312.2024.10578690 · Cited by 40
The Evolution of Large Language Model: Models, Applications and Challenges
Sindhu, B., Prathamesh, R. P., Sameera, M. B., & Kumaraswamy, S. (2024) · International Conference on Current Trends in Advanced Computing (ICCTAC) · doi:10.1109/icctac61556.2024.10581180 · Cited by 41
Timperley, L., Berthoud, L., Snider, C. M., & Tryfonas, T. (2025) · Journal of Engineering Design · doi:10.1080/09544828.2025.2453401 · Cited by 31
Generative AI Meets Wireless Networking: An Interactive Paradigm for Intent-Driven Communications
Qin, X., Sun, M., Dai, J., Ma, P., Cao, Y., Zhang, J., Wang, J., Xu, X., Zhang, P., & Niyato, D. T. (2025) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2025.3567613 · Cited by 36
Empowering Generalist Material Intelligence with Large Language Models
Yuan, W., Chen, G., Wang, Z., & You, F. (2025) · Advanced Materials · doi:10.1002/adma.202502771 · Cited by 42
Large Language Models for Health Care Text Classification: Systematic Review
Sakai, H., & Lam, S. S. (2025) · JMIR AI · doi:10.2196/79202 · Cited by 55
Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning
Zhang, R., Yu, Y., Shetty, P., Song, L., & Zhang, C. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.55 · Cited by 55
Zhao, B., Jin, W., Zhang, Y., Huang, S., & Yang, G. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110928 · Cited by 32
Towards Instance-adaptive Inference for Federated Learning
Feng, C., Yu, K., Liu, N., Xu, X., Khan, S. A., & Zuo, W. (2023) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51070.2023.02128 · Cited by 27
Yang, X., Wang, Z., Wang, Q., Ke, W., Zhang, K., & Shi, J. (2024) · International Journal of Web Information Systems · doi:10.1108/ijwis-12-2023-0256 · Cited by 34
Open-Vocabulary Semantic Segmentation with Image Embedding Balancing
Shan, X., Wu, D., Zhu, G., Shao, Y., Sang, N., & Gao, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02684 · Cited by 31
CAT-SAM: Conditional Tuning for Few-Shot Adaptation of Segment Anything Model
Xiao, A., Xuan, W., Qi, H., Xing, Y., Ren, R., Zhang, X., Shao, L., & Lu, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73661-2_11 · Cited by 28
Federated Low-Rank Adaptation for Large Models Fine-Tuning Over Wireless Networks
Sun, H., Tian, H., Ni, W., Zheng, J., Niyato, D. T., & Zhang, P. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3497998 · Cited by 33
Contrastive Conditional Latent Diffusion for Audio-Visual Segmentation
Mao, Y., Zhang, J., Xiang, M., Lv, Y., Li, D., Zhong, Y., & Dai, Y. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3580269 · Cited by 60
Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learning
Liang, D., Feng, T., Zhou, X., Zhang, Y., Zou, Z., & Bai, X. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3594749 · Cited by 34
Analytical Survey of Learning with Low-Resource Data: From Analysis to Investigation
Cao, X., Xu, M., Yu, X., Yao, J., Ye, W., Huang, S.-J., Zhang, M.-L., Tsang, I. W.-H., Ong, Y.-S., Kwok, J. T.-Y., et al. (2025) · ACM Computing Surveys · doi:10.1145/3773075 · Cited by 37
From System 1 to System 2: A Survey of Reasoning Large Language Models
Zhang, D., Li, Z., Zhang, M.-L., Zhang, J., Liu, Z., Yao, Y., Xu, H., Zheng, J., Chen, X., Zhang, Y., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3637037 · Cited by 522
Neural Data Transformer 2: Multi-context Pretraining for Neural Spiking Activity
Ye, J., Collinger, J. L., Wehbe, L., & Gaunt, R. (2023) · neural information processing systems · doi:10.52202/075280-3523 · Cited by 46
CINS: Comprehensive Instruction for Few-Shot Learning in Task-Oriented Dialog Systems
Mi, F., Wang, Y., & Li, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21356 · Cited by 34
GPS: Genetic Prompt Search for Efficient Few-Shot Learning
Xu, H., Chen, Y., Du, Y., Shao, N., Yanggang, W., Li, H., & Yang, Z. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.559 · Cited by 69
Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning
Poth, C., Sterz, H., Paul, I., Purkayastha, S., Engländer, L., Imhof, T., Vuli, I., Ruder, S., Gurevych, I., & Pfeiffer, J. (2023) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2023.emnlp-demo.13 · Cited by 39
Few-shot code translation via task-adapted prompt learning
Li, X., Yuan, S., Gu, X., Chen, Y., & Shen, B. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112002 · Cited by 29
UPetu: A Unified Parameter-Efficient Fine-Tuning Framework for Remote Sensing Foundation Model
Dong, Z., Gu, Y., & Liu, T. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3382734 · Cited by 37
Human-Centric Autonomous Systems With LLMs for User Command Reasoning
Yang, Y., Zhang, Q., Li, C., Marta, D., Batool, N., & Folkesson, J. B. (2024) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw60836.2024.00108 · Cited by 32
Project-specific code summarization with in-context learning
Yun, S. M., LIN, S.-J., Gu, X., & Shen, B. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112149 · Cited by 29
A Survey on Efficient Vision‐Language Models
Shinde, G., Ravi, A., Dey, E., Sakib, S., Rampure, M., & Roy, N. (2025) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70036 · Cited by 46
GraphLLM: Boosting Graph Reasoning Ability of Large Language Model
Chai, Z., Zhang, T., Wu, L., Han, K., Hu, X., Huang, X., & Yang, Y. (2025) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3627488 · Cited by 170
MERIt: Meta-Path Guided Contrastive Learning for Logical Reasoning
Jiao, F., Guo, Y., Song, X., & Nie, L. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.276 · Cited by 35
Prompt Evolution for Generative AI: A Classifier-Guided Approach
Wong, M., Ong, Y.-S., Gupta, A., Bali, K. K., & Chen, C. (2023) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai54212.2023.00105 · Cited by 36
Questions Are All You Need to Train a Dense Passage Retriever
Sachan, D. S., Lewis, M., Yogatama, D., Zettlemoyer, L., Pineau, J., & Zaheer, M. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00564 · Cited by 35
ADEPT: A DEbiasing PrompT Framework
Yang, K., Yu, C., Fung, Y. R., Li, M., & Ji, H. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26279 · Cited by 34
He, K., Mao, R., Huang, Y., Gong, T., Li, C., & Cambria, E. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3314807 · Cited by 32
Prompt tuning for parameter-efficient medical image segmentation
Fischer, M., Bartler, A., & Yang, B. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.103024 · Cited by 38
Exploring Prompt-based Few-shot Learning for Grounded Dialog GenerationPreprint
Zheng, C., & Huang, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.06513 · Cited by 43
ProQA: Structural Prompt-based Pre-training for Unified Question Answering
Zhong, W., Gao, Y., Ding, N., Qin, Y., Liu, Z., Zhou, M., Wang, J., Yin, J. P., & Duan, N. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.313 · Cited by 33
Multi-Modal Attribute Prompting for Vision-Language Models
Liu, X., Wu, J., Yang, W., Zhou, X., & Zhang, T. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3424566 · Cited by 32
LAMM: Label Alignment for Multi-Modal Prompt Learning
Gao, J., Ruan, J., Xiang, S., Yu, Z., Ji, K. F., Xie, M., Liu, T., & Fu, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i3.27950 · Cited by 30
Steering Prototypes with Prompt-tuning for Rehearsal-free Continual Learning
Li, Z., Zhao, L., Zhang, Z., Zhang, H., Liu, D., Liu, T., & Metaxas, D. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00251 · Cited by 39
MCPL: Multi-Modal Collaborative Prompt Learning for Medical Vision-Language Model
Wang, P., Zhang, H., & Yuan, Y. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3418408 · Cited by 28
PromptCARE: Prompt Copyright Protection by Watermark Injection and Verification
Yao, H., Lou, J., Qin, Z., & Ren, K. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00209 · Cited by 32
Zanella, M., & Ayed, I. B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02245 · Cited by 38
ID-like Prompt Learning for Few-Shot Out-of-Distribution Detection
Bai, Y., Han, Z., Cao, B., Jiang, X., Hu, Q., & Zhang, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01655 · Cited by 37
Cross-Modal Remote Sensing Image–Text Retrieval via Context and Uncertainty-Aware Prompt
Wang, Y., Tang, X., Ma, J., Zhang, X., Liu, F., & Jiao, L. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3458898 · Cited by 34
Comprehensive Fine-Tuning Large Language Models of Code for Automated Program Repair
Huang, K., Zhang, J., Bao, X., Wang, X., & Liu, Y. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3532759 · Cited by 30
Shehmir, S., & Kashef, R. F. (2025) · Future Internet · doi:10.3390/fi17060252 · Cited by 42
Hassan, M., Kabir, M. E., Jusoh, M., An, H. K., Negnevitsky, M., & Li, C. (2025) · IEEE Access · doi:10.1109/access.2025.3589319 · Cited by 35
The Power of Prompt Tuning for Low-Resource Semantic Parsing
Schucher, N., Reddy, S., & de Vries, H. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-short.17 · Cited by 30
Metadata
- Authors
- Lester, B., Al-Rfou, R., & Constant, N.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 3045-3059
- arXiv
- 2104.08691
- OpenAlex
- W3152956381
- Cited by
- 3,092
- References
- 49
- Citations by year
- 2026: 512 · 2025: 889 · 2024: 754 · 2023: 649 · 2022: 246 · 2021: 40
- FWCI
- 195.07
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- prompt tuning, soft prompts, parameter-efficient fine-tuning, frozen language models, few-shot learning, model size, prefix tuning, T5, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
