The DOI matches its DataCite record; 47 of the 49 references it cites were found in a registry or an index, and 1 are not checked yet.
The Power of Scale for Parameter-Efficient Prompt Tuning
Open accessAbstract
In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts are learned through backpropagation and can be tuned to incorporate signal from any number of labeled examples. Our end-to-end learned approach outperforms GPT-3's "few-shot" learning by a large margin. More remarkably, through ablations on model size using T5, we show that prompt tuning becomes more competitive with scale: as models exceed billions of parameters, our method "closes the gap" and matches the strong performance of model tuning (where all model weights are tuned). This finding is especially relevant in that large models are costly to share and serve, and the ability to reuse one frozen model for multiple downstream tasks can ease this burden. Our method can be seen as a simplification of the recently proposed "prefix tuning" of Li and Liang (2021), and we provide a comparison to this and other similar approaches. Finally, we show that conditioning a frozen model with soft prompts confers benefits in robustness to domain transfer, as compared to full model tuning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These approaches become inapplicable when there is only API access to the LLM.”
From Large Language Models as Optimizers (2023) · cites this paper as Lester et al., 2021
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
(2010) · International Conference on Machine Learning · Cited by 13,995
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
seaborn: statistical data visualization
Waskom, M. (2021) · Journal of Open Source Software · doi:10.21105/joss.03021 · Cited by 7,310
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
Kudo, T., & Richardson, J. (2018) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-2012 · Cited by 4,454
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Research works printed but not linked: 8
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert- Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. In Advances in Neural Information Processing Systems, volume 33, pages 1877-1901.
- Marie-Catherine De Marneff, Mandy Simons, and Ju- dith Tonhauser. 2019. The CommitmentBank: In- vestigating projection in naturally occurring dis- course. Proceedings of Sinn und Bedeutung 23.
- Danilo Giampiccolo, Bernardo Magnini, Ido Dagan, and Bill Dolan. 2007. The third PASCAL recog- nizing textual entailment challenge. In Proceedings of the ACL-PASCAL workshop on textual entailment and paraphrasing, pages 1-9. Association for Com- putational Linguistics.
- PMLR.
- Colin Raffel, Noam Shazeer, Adam Roberts, Kather- ine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to- text transformer. Journal of Machine Learning Re- search, 21(140):1-67.
- Melissa Roemmele, Cosmin Adrian Bejan, and An- drew S Gordon. 2011. Choice of plausible alterna- tives: An evaluation of commonsense causal reason- ing. In 2011 AAAI Spring Symposium Series.
- Noam Shazeer and Mitchell Stern. 2018. Adafactor: Adaptive learning rates with sublinear memory cost. In Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 4596-4604.
- PMLR.
Cited by
Sorted by citations
Items 901–1,000 of 1,009
Assessing the Effectiveness of Vulnerability Detection via Prompt Tuning: An Empirical Study
Lu, G., Ju, X., Chen, X., Yang, S., Chen, L., & Shen, H. (2023) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec60848.2023.00052 · Cited by 12
Chen, S., Wang, W., Chen, X., Lu, P., Yang, Z., & Du, Y. (2024) · Data Intelligence · doi:10.1162/dint_a_00251 · Cited by 14
Prompt-Guided Semantic-Aware Distillation for Weakly Supervised Incremental Semantic Segmentation
Hao, X., Jiang, X., Ni, W., Tan, W., & Yan, B. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3412996 · Cited by 13
Visual primitives as words: Alignment and interaction for compositional zero-shot learning
Shuang, F., Li, J., Huang, Q., Zhao, W., Xu, D., Han, C., & Cheng, H. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110814 · Cited by 11
Potential and Limitations of LLMs in Capturing Structured Semantics: A Case Study on SRL
Cheng, N., Yan, Z., Wang, Z., Li, Z., Yu, J., Zheng, Z., Tu, K., Xu, J., & Han, W. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-981-97-5663-6_5 · Cited by 13
Evaluating Large Language Models for G-Code Debugging, Manipulation, and Comprehension
Jignasu, A., Marshall, K. A., Ganapathysubramanian, B., Balu, A., Hegde, C., & Krishnamurthy, A. (2024) · IEEE LLM Aided Design Workshop (LAD) · doi:10.1109/lad62341.2024.10691700 · Cited by 15
Efficiency at scale: Investigating the performance of diminutive language models in clinical tasks
Taylor, N., Ghose, U., Rohanian, O., Nouriborji, M., Kormilitzin, A., Clifton, D. A., & Nevado‐Holgado, A. J. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.103002 · Cited by 14
Missing Modality Prediction for Unpaired Multimodal Learning via Joint Embedding of Unimodal Models
Kim, D., & Kim, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73016-0_11 · Cited by 12
Cascade Prompt Learning for Vision-Language Model Adaptation
Wu, G., Zhang, X., Li, Z., Chen, Z., Liang, J., Yang, J. J., & Li, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72973-7_18 · Cited by 16
Industrial Language-Image Dataset (ILID): Adapting Vision Foundation Models for Industrial Settings
Moenck, K., Thieu, D. T., Koch, J., & Schüppstuhl, T. (2024) · Procedia CIRP · doi:10.1016/j.procir.2024.10.084 · Cited by 13
Parameter-Efficient Fine-Tuning of Large Pretrained Models for Instance Segmentation Tasks
Baker, N. A., Rohrschneider, D., & Handmann, U. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6040133 · Cited by 14
Toyteller: AI-powered Visual Storytelling Through Toy-Playing with Character Symbols
Chung, J. J. Y., Roemmele, M., & Kreminski, M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713435 · Cited by 23
Learning with Enriched Inductive Biases for Vision-Language Models
Yang, L., Zhang, R., Chen, Q., & Xie, X. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02354-1 · Cited by 14
Guo, Y., Wang, H., Ren, X., Wang, T., Chen, W., Xu, Z., & Ge, H. (2025) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.70004 · Cited by 11
Non-Homophilic Graph Pre-Training and Prompt Learning
Yu, X., Zhang, J., Fang, Y., & Jiang, R. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3690624.3709219 · Cited by 24
Just Shift It: Test-Time Prototype Shifting for Zero-Shot Generalization with Vision-Language Models
Sui, E., Wang, X., & Yeung, S. Y. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00090 · Cited by 24
Yin, G., Chen, Y., Lee, M., Du, X., Ke, Y., Tang, W., Chen, Z., Zhou, M., Yue, J., Yang, H., et al. (2025) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2025.3556008 · Cited by 12
Paragraph-to-Image Generation with Information-Enriched Diffusion Model
Wu, W., Li, Z., He, Y., Shou, M. Z., Shen, C., Cheng, L., Li, Y., Gao, T., & Zhang, D. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02435-1 · Cited by 38
APEER : Automatic Prompt Engineering Enhances Large Language Model Reranking
Jin, C., Peng, H., Zhao, S., Wang, Z. G., Xu, W., Han, L., Zhao, J., Zhong, K.-W., Rajasekaran, S., & Metaxas, D. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3701716.3717574 · Cited by 60
A Survey on the Impact of Pre-Trained Language Models in Sentiment Classification Task
Gautam, H., Gaur, A., & Yadav, D. K. (2025) · International Journal of Data Science and Analytics · doi:10.1007/s41060-025-00805-z · Cited by 14
Reward-Based Gradient Modulation for Multimodal Emotion Recognition With LoRA
Liu, F., Fu, Z., & Wang, Y. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2025.3566373 · Cited by 11
CTourLLM: enhancing LLMs with Chinese tourism knowledge
Wei, Q., Yang, M., Wang, J., Mao, W., Xu, J., & Ning, H. (2025) · Cluster Computing · doi:10.1007/s10586-024-05009-x · Cited by 30
A review of few-shot image classification: Approaches, datasets and research trends
Lim, J. Y., Lim, K. M., Lee, C. P., & Tan, Y. X. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130774 · Cited by 18
Zhang, Y., Dong, X., Ding, W., Li, B., Jiang, P., & Gai, K. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543873.3584629 · Cited by 11
Contextualized medication event extraction with striding NER and multi-turn QA
Tsujimura, T., Yamada, K., Ida, R., Miwa, M., & Sasaki, Y. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104416 · Cited by 11
Pre-training Antibody Language Models for Antigen-Specific Computational Antibody Design
Gao, K., Wu, L., Zhu, J., Peng, T., Xia, Y., He, L., Xie, S., Qin, T., Liu, H., He, K., et al. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599468 · Cited by 11
Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning?
Qin, C., Joty, S., Li, Q., & Zhao, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.659 · Cited by 14
Discrete Prompt Optimization via Constrained Generation for Zero-shot Re-ranker
Cho, S., Jeong, S., Seo, J. Y., & Park, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.61 · Cited by 16
Polyglot Prompt: Multilingual Multitask Prompt Training
Fu, J., Ng, S.-K., & Liu, P. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.674 · Cited by 33
Tiny-Attention Adapter: Contexts Are More Important Than the Number of Parameters
Zhao, H., Tan, H., & Mei, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.444 · Cited by 20
AVFormer: Injecting Vision into Frozen Speech Models for Zero-Shot AV-ASR
Seo, P. H., Nagrani, A., & Schmid, C. (2023) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52729.2023.02195 · Cited by 35
Learning to Name Classes for Vision and Language Models
Parisot, S., Yang, Y., & McDonagh, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02248 · Cited by 12
Muthusamy, V., Rizk, Y., Kate, K., Venkateswaran, P., Isahagian, V., Gulati, A., & Dube, P. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.461 · Cited by 17
An, Y., Fang, Q., & Wang, L. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107874 · Cited by 11
Li, Z., Mak, M., & Meng, H. M. L. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447795 · Cited by 11
Black-Box Prompt Tuning With Subspace Learning
Zheng, Y., Tan, Z., Li, P., & Liu, Y. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3407519 · Cited by 14
Learning Combinatorial Prompts for Universal Controllable Image Captioning
Wang, Z., Xiao, J., Zhuang, Y., Gao, F., Shao, J., & Chen, L. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02179-4 · Cited by 13
Semi-Siamese Bi-encoder Neural Ranking Model Using Lightweight Fine-Tuning
Jung, E., Choi, J., & Rhee, W. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3511978 · Cited by 15
Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting
Li, X., Wang, L., Dong, G., He, K., Zhao, J., Hao, L., Liu, J., & Xu, W. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.52 · Cited by 11
Improving the Sample Efficiency of Prompt Tuning with Domain Adaptation
Guo, X., Li, B., & Yu, H. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.258 · Cited by 20
On Transferability of Prompt Tuning for Natural Language UnderstandingPreprint
Su, Y., Wang, X., Qin, Y., Chan, C.-M., Lin, Y., Liu, Z., Li, P., Li, J., Hou, L., Sun, M., et al. (2021) · arXiv (Cornell University) · Cited by 12
LLM Instruction-Example Adaptive Prompting (LEAP) Framework for Clinical Relation ExtractionPreprint
Zhou, H., Li, M., Xiao, Y., Yang, H. Q., & Zhang, R. (2023) · medRxiv · doi:10.1101/2023.12.15.23300059 · Cited by 11
Large language models for PHM: a review of optimization techniques and applications
Yu, T., Tang, J., Yu, Q., Li, L., Liu, Y., & Poler, R. (2025) · Autonomous Intelligent Systems · doi:10.1007/s43684-025-00100-5 · Cited by 13
Politics of the prompt: Government in the age of generative AI
Amoore, L., Bennett, S., Campolo, A., Jacobsen, B. N., & Rella, L. (2025) · Economy and Society · doi:10.1080/03085147.2025.2560177 · Cited by 10
Enhancing large language model for fake news video detection via cross-modal retrieval
Han, L., Zhang, X., Wang, T., Liu, Y., & Dong, Z. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104471 · Cited by 13
Multimodal recommender systems: A survey of representation, modeling, and optimization
Pan, Z., Pan, Z., Cai, F., & Chen, H. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103991 · Cited by 13
Parameter-Efficient Sparsity for Large Language Models Fine-Tuning
Li, Y., Luo, F., Tan, C., Wang, M., Huang, S., Li, S., & Bai, J. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/586 · Cited by 27
ContrastNER: Contrastive-based Prompt Tuning for Few-shot NER
Layegh, A., Payberah, A. H., Soylu, A., Roman, D., & Matskin, M. (2023) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac57700.2023.00038 · Cited by 17
Training Models to Generate, Recognize, and Reframe Unhelpful Thoughts
Maddela, M., Ung, M., Xu, J., Madotto, A., Foran, H., & Boureau, Y.-L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.763 · Cited by 24
Prompted and integrated textual information enhancing aspect-based sentiment analysis
Shi, X., Hu, M. Q., Ren, F., Shi, P., Deng, J., & Tang, Y. (2023) · Journal of Intelligent Information Systems · doi:10.1007/s10844-023-00805-0 · Cited by 10
SMoP: Towards Efficient and Effective Prompt Tuning with Sparse Mixture-of-Prompts
Choi, J., Kim, J., Park, J.-H., Mok, W.-L., & Lee, S. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.884 · Cited by 12
Test-Time Personalization with Meta Prompt for Gaze Estimation
Liu, H., Qi, J., Li, Z., Hassanpour, M., Wang, Y., Plataniotis, K. N., & Yu, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i4.28151 · Cited by 10
On Unsupervised Domain Adaptation: Pseudo Label Guided Mixup for Adversarial Prompt Tuning
Kong, F., Zhang, R., Wang, Z., & Mao, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29800 · Cited by 10
Adversarial Attacks on Vision-Language Model-Empowered Chatbots in Consumer Electronics
Shang, Y., Liu, Z., Kang, J., Hossain, M. S., & Wu, Y. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3417688 · Cited by 11
FE-Adapter: Adapting Image-Based Emotion Classifiers to Videos
Gowda, S. N., Gao, B., & Clifton, D. A. (2024) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg59268.2024.10581905 · Cited by 10
Ahmad, K. M., Liu, Q., Khan, A. A., Gan, Y., & Lin, R. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124828 · Cited by 10
Bu, C., Liu, Y., Huang, M., Shao, J., Ji, S., Luo, W., & Wu, X. (2024) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3689827 · Cited by 11
Masrouri, M., Paul, K., & Zhao Qin, A. (2024) · Extreme Mechanics Letters · doi:10.1016/j.eml.2024.102230 · Cited by 10
Cross-Modal Adapter: Parameter-Efficient Transfer Learning Approach for Vision-Language Models
Yang, J., Li, Z., Xie, S., Zhu, W., Yu, W., & Li, S. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10688369 · Cited by 17
Enhancing Few-Shot Out-of-Distribution Detection With Pre-Trained Model Features
Dong, J., Yao, Y., Wei, J., Zhou, H., Gao, Y., & Fang, Z. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3468874 · Cited by 13
GIST: Improving Parameter Efficient Fine-Tuning via Knowledge Interaction
Ruan, J., Gao, J., Xie, M., Xiang, S., Yu, Z., Liu, T., Fu, Y., & Qu, X. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680843 · Cited by 15
LiDAR-Based All-Weather 3D Object Detection via Prompting and Distilling 4D Radar
Chae, Y., Kim, H., Oh, C., Kim, M., & Yoon, K. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72992-8_21 · Cited by 10
Synergy of Sight and Semantics: Visual Intention Understanding with CLIP
Yang, Q., Ye, M., & Tao, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73247-8_9 · Cited by 11
Developing healthcare language model embedding spaces
Taylor, N., Schofield, D., Kormilitzin, A., Joyce, D. W., & Nevado‐Holgado, A. J. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.103009 · Cited by 14
Neupane, S., Tripathi, H., Mitra, S., Bozorgzad, S., Mittal, S., Rahimi, S., & Amirlatifi, A. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825266 · Cited by 11
Mu, B., Wei, K., Shao, Q., Xu, Y., & Xie, L. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888133 · Cited by 13
Analyzing LLAMA3 Performance on Classification Task Using LoRA and QLoRA Techniques
Patil, R., Khot, P., & Gudivada, V. N. (2025) · Applied Sciences · doi:10.3390/app15063087 · Cited by 19
Class-Aware Prompting for Federated Few-Shot Class-Incremental Learning
Liang, F.-Y., Zhan, Y.-W., Liu, J., Zhang, C.-Y., Chen, Z.-D., Luo, X., & Xu, X.-S. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3551612 · Cited by 13
From Translation to Generative LLMs: Classification of Code-Mixed Affective Tasks
Yadav, A., Garg, T., Klemen, M., Ulčar, M., Agarwal, B., & Robnik‐Šikonja, M. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3553399 · Cited by 22
Fine-tuning Multimodal Large Language Models for Product Bundling
Liu, X., Wu, J., Tao, Z., Ma, Y., Wei, Y., & Chua, T. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3690624.3709255 · Cited by 13
Enhanced Retrieval-Augmented Generation Using Low-Rank Adaptation
Choi, Y., Kim, S., Bassole, Y. C. F., & Sung, Y. (2025) · Applied Sciences · doi:10.3390/app15084425 · Cited by 14
MARSHA: multi-agent RAG system for hazard adaptation
Xie, Y., Jiang, B., Mallick, T., Bergerson, J., Hutchison, J. K., Verner, D. R., Branham, J., Alexander, M. R., Ross, R. B., Feng, Y. W., et al. (2025) · npj Climate Action · doi:10.1038/s44168-025-00254-1 · Cited by 27
Scattered or Connected? An Optimized Parameter-efficient Tuning Approach for Information Retrieval
Ma, X., Guo, J., Zhang, R., Fan, Y., & Cheng, X. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557445 · Cited by 10
Meta Learning for Domain Agnostic Soft Prompt
Chen, M.-Y., Rohmatillah, M., Lee, C.-H., & Chien, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094860 · Cited by 10
Mind the Biases: Quantifying Cognitive Biases in Language Model Prompting
Lin, R., & Ng, H. T. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.324 · Cited by 13
Curriculum Prompt Learning with Self-Training for Abstractive Dialogue Summarization
Li, C., Wang, L., Lin, X. A., de Melo, G., & He, L. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.72 · Cited by 10
À-la-carte Prompt Tuning (APT): Combining Distinct Data Via Composable Prompting
Bowman, B., Achille, A., Zancato, L., Trager, M., Perera, P., Paolini, G., & Soatto, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01439 · Cited by 14
SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domains
Goswami, K., Lange, L., Araki, J., & Adel, H. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.197 · Cited by 12
Prompt-Based Grouping Transformer for Nucleus Detection and Classification
Huang, J., Li, H., Sun, W., Wan, X., & Li, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43993-3_55 · Cited by 11
Efficient Finetuning Large Language Models For Vietnamese Chatbot
Doan, V.-T., Truong, Q.-T., Nguyen, D.-V., Nguyen, V.-T., & Luu, T.-N. N. (2023) · International Conference on Multimedia Analysis and Pattern Recognition (MAPR) · doi:10.1109/mapr59823.2023.10288647 · Cited by 11
Liu, Y., An, C., & Qiu, X. (2023) · Frontiers of Computer Science · doi:10.1007/s11704-023-3131-8 · Cited by 13
On the Effectiveness of LayerNorm Tuning for Continual Learning in Vision Transformers
Min, T. D., Mancini, M., Alahari, K., Alameda-Pineda, X., & Ricci, E. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00385 · Cited by 12
Adaptive Prompt Routing for Arbitrary Text Style Transfer with Pre-trained Language Models
Liu, Q., Qin, J., Ye, W., Mou, H. L., He, Y., & Wang, K. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29832 · Cited by 11
PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Data
Herzig, R., Abramovich, O., Avraham, E. B., Arbelle, A., Karlinsky, L., Shamir, A., Darrell, T., & Globerson, A. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00666 · Cited by 10
Exploring Universal Intrinsic Task Subspace for Few-Shot Learning via Prompt Tuning
Qin, Y., Wang, X., Su, Y., Lin, Y., Ding, N., Yi, J., Chen, W., Liu, Z., Li, J., Hou, L., et al. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3430545 · Cited by 72
Zero-Shot Chain-of-Thought Reasoning Guided by Evolutionary Algorithms in Large Language Models
Jin, F., Liu, Y., & Tan, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3352-7_5 · Cited by 21
Data-Efficient Finetuning Using Cross-Task Nearest Neighbors
Ivison, H., Smith, N. A., Hajishirzi, H., & Dasigi, P. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.576 · Cited by 23
Stabilized In-Context Learning with Pre-trained Language Models for Few Shot Dialogue State Tracking
Chen, D., Qian, K., & Zhou, Y. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.115 · Cited by 12
Challenges and Paths Towards AI for Software EngineeringPreprint
Gu, A., Jain, N., Li, W., Shetty, M., Shao, Y., Li, Z., Yang, D., Ellis, K., Sen, K., & Solar-Lezama, A. (2025) · Qeios · doi:10.32388/vv1661 · Cited by 40
UniGDD: A Unified Generative Framework for Goal-Oriented Document-Grounded Dialogue
Gao, C., Zhang, W., & Lam, W. P. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-short.66 · Cited by 9
Yu, Y., He, W. P., Kang, Y.-M., & Ji, Y. (2022) · Data Intelligence · doi:10.1162/dint_a_00202 · Cited by 9
Parameter-Efficient Learning for Text-to-Speech Accent Adaptation
Yang, L.-J., Yang, C.-H. H., & Chien, J. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1212 · Cited by 11
Adapting an ASR Foundation Model for Spoken Language Assessment
Ma, R., Qian, M., Gales, M., & Knill, K. M. (2023) · ISCA Workshop on Speech and Language Technology in Education (SLaTE) · doi:10.21437/slate.2023-20 · Cited by 17
Yang, H., & Li, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.907 · Cited by 18
On the Automatic Generation and Simplification of Children’s Stories
Valentini, M., Weber, J., Salcido, J., Wright, T., Colunga, E., & von der Wense, K. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.218 · Cited by 22
An Adaptive Prompt Generation Framework for Task-oriented Dialogue System
Gao, J. Y., Xiang, L., Wu, H., Zhao, H. X., Tong, Y., & He, Z. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.76 · Cited by 9
Optimizing and Evaluating Pre- Trained Large Language Models for Alzheimer's Disease Detection
Casu, F., Grosso, E., Lagorio, A., & Trunfio, G. A. (2024) · Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP) · doi:10.1109/pdp62718.2024.00046 · Cited by 11
HybridPrompt: Domain-Aware Prompting for Cross-Domain Few-Shot Learning
Wu, J., Zhang, T., & Zhang, Y. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02086-8 · Cited by 11
Huang, Q. Y., Sun, Y., Xing, Z., Cao, Y., Chen, J., Xu, X., Jin, H., & Lu, J. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3680469 · Cited by 9
Metadata
- Authors
- Lester, B., Al-Rfou, R., & Constant, N.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 3045-3059
- arXiv
- 2104.08691
- OpenAlex
- W3152956381
- Cited by
- 3,092
- References
- 49
- Citations by year
- 2026: 512 · 2025: 889 · 2024: 754 · 2023: 649 · 2022: 246 · 2021: 40
- FWCI
- 195.07
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- prompt tuning, soft prompts, parameter-efficient fine-tuning, frozen language models, few-shot learning, model size, prefix tuning, T5, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
