The DOI matches its DataCite record; 47 of the 49 references it cites were found in a registry or an index, and 1 are not checked yet.
The Power of Scale for Parameter-Efficient Prompt Tuning
Open accessAbstract
In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts are learned through backpropagation and can be tuned to incorporate signal from any number of labeled examples. Our end-to-end learned approach outperforms GPT-3's "few-shot" learning by a large margin. More remarkably, through ablations on model size using T5, we show that prompt tuning becomes more competitive with scale: as models exceed billions of parameters, our method "closes the gap" and matches the strong performance of model tuning (where all model weights are tuned). This finding is especially relevant in that large models are costly to share and serve, and the ability to reuse one frozen model for multiple downstream tasks can ease this burden. Our method can be seen as a simplification of the recently proposed "prefix tuning" of Li and Liang (2021), and we provide a comparison to this and other similar approaches. Finally, we show that conditioning a frozen model with soft prompts confers benefits in robustness to domain transfer, as compared to full model tuning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These approaches become inapplicable when there is only API access to the LLM.”
From Large Language Models as Optimizers (2023) · cites this paper as Lester et al., 2021
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
(2010) · International Conference on Machine Learning · Cited by 13,995
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
seaborn: statistical data visualization
Waskom, M. (2021) · Journal of Open Source Software · doi:10.21105/joss.03021 · Cited by 7,310
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
Kudo, T., & Richardson, J. (2018) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-2012 · Cited by 4,454
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Research works printed but not linked: 8
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert- Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. In Advances in Neural Information Processing Systems, volume 33, pages 1877-1901.
- Marie-Catherine De Marneff, Mandy Simons, and Ju- dith Tonhauser. 2019. The CommitmentBank: In- vestigating projection in naturally occurring dis- course. Proceedings of Sinn und Bedeutung 23.
- Danilo Giampiccolo, Bernardo Magnini, Ido Dagan, and Bill Dolan. 2007. The third PASCAL recog- nizing textual entailment challenge. In Proceedings of the ACL-PASCAL workshop on textual entailment and paraphrasing, pages 1-9. Association for Com- putational Linguistics.
- PMLR.
- Colin Raffel, Noam Shazeer, Adam Roberts, Kather- ine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to- text transformer. Journal of Machine Learning Re- search, 21(140):1-67.
- Melissa Roemmele, Cosmin Adrian Bejan, and An- drew S Gordon. 2011. Choice of plausible alterna- tives: An evaluation of commonsense causal reason- ing. In 2011 AAAI Spring Symposium Series.
- Noam Shazeer and Mitchell Stern. 2018. Adafactor: Adaptive learning rates with sublinear memory cost. In Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 4596-4604.
- PMLR.
Cited by
Sorted by citations
Items 701–800 of 1,009
An Overview on Language Models: Recent Developments and OutlookPreprint
Wei, C., Wang, Y.-C., Wang, B., & Kuo, C. ‐. J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.05759 · Cited by 15
A Survey of Reasoning with Foundation ModelsPreprint
Sun, J., Zheng, C., Xie, E., Liu, Z., Chu, R., Liu, J., Xu, J., Ding, M., Li, H., Geng, M., et al. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/ac4sp · Cited by 143
Foundation Models for Video Understanding: A SurveyPreprint
Madan, N., Møgelmose, A., Modi, R., Rawat, Y. S., & Moeslund, T. B. (2024) · doi:10.36227/techrxiv.171769139.99464428/v1 · Cited by 24
Image-Text Co-Decomposition for Text-Supervised Semantic Segmentation
Wu, J.-J., Chang, A. C.-H., Chuang, C.-Y., Chen, C.-P., Liu, Y.-L., Chen, M.-H., Hu, H.-N., Chuang, Y., & Lin, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02530 · Cited by 24
LLM for Mobile: An Initial Roadmap
Chen, D., Liu, Y., Zhou, M., Zhao, Y., Wang, H., Wang, S., Chen, X., Bissyandé, T. F., Klein, J., & Li, L. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3708528 · Cited by 27
Berman, E., Malek, H. S., Bitzer, M., Malek, N. P., & Eickhoff, C. (2025) · Journal of Medical Internet Research · doi:10.2196/64364 · Cited by 19
Zhang, Y., Fan, Q., Chen, X., Li, M., Zhao, Z., Li, F., & Guo, L. (2025) · Mathematics · doi:10.3390/math13040566 · Cited by 21
Multimodal Large Models are Effective Action Anticipators
Wang, B., Tian, Y., Wang, S., & Yang, L. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3557615 · Cited by 18
Qi, X., Yang, B. Y., Wang, S., Zhang, Z., Zhang, Y., & Du, K. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.115266 · Cited by 17
Building a Personalized Dialogue System with Prompt-Tuning
Kasahara, T., Kawahara, D., Tùng, N. T., Li, S., Shinzato, K., & Sato, T. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop (NAACL SRW) · doi:10.18653/v1/2022.naacl-srw.13 · Cited by 18
MVP-Tuning: Multi-View Knowledge Retrieval with Prompt Tuning for Commonsense Reasoning
Huang, Y., Li, Y., Xu, Y., Zhang, L., Gan, R., Zhang, J., & Wang, L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.750 · Cited by 18
Neural Architecture Search for Parameter-Efficient Fine-tuning of Large Pre-trained Language Models
Lawton, N., Kumar, A., Thattai, G., Galstyan, A., & Steeg, G. V. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.539 · Cited by 34
Deeply Coupled Cross-Modal Prompt Learning
Liu, X., Tang, W., Lu, J., Zhao, R., Guo, Z., & Tan, F. Z. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.504 · Cited by 21
Prefix Conditioning Unifies Language and Label Supervision
Saito, K., Sohn, K., Zhang, X., Li, C., Lee, C.-Y., Saenko, K., & Pfister, T. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00280 · Cited by 19
Structure-Aware Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
Hu, Y., Xie, Y., Wang, T., Chen, M., & Pan, Z. (2023) · Mathematics · doi:10.3390/math11204317 · Cited by 21
Chen, Y., Fu, Q., Fan, G., Du, L., Lou, J., Han, S., Zhang, D., Li, Z., & Xiao, Y. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614904 · Cited by 21
Multi-party Goal Tracking with LLMs: Comparing Pre-training, Fine-tuning, and Prompt Engineering
Addlesee, A., Sieińska, W., Gunson, N., García, D. H., Dondrup, C., & Lemon, O. (2023) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2023.sigdial-1.22 · Cited by 25
Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text Retrievers
Tam, W., Liu, X., Ji, K., Xue, L., Liu, J., Li, T., Dong, Y., & Tang, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.874 · Cited by 33
G-Prompt: Graphon-based Prompt Tuning for graph classification
Duan, Y., Liu, J., Chen, S., Chen, L., & Wu, J. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2023.103639 · Cited by 18
Affective Prompt-Tuning-Based Language Model for Semantic-Based Emotional Text Generation
Gu, Z., & He, K. (2024) · International Journal on Semantic Web and Information Systems · doi:10.4018/ijswis.339187 · Cited by 21
Learning emotional prompt features with multiple views for visual emotion analysis
Xu, Q., Wei, Y., Yuan, S., Wu, J., Wang, L., & Wu, C. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102366 · Cited by 19
Task-Adaptive Prompted Transformer for Cross-Domain Few-Shot Learning
Wu, J., Liu, X., Yin, X., Zhang, T., & Zhang, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28416 · Cited by 17
Instruct Me More! Random Prompting for Visual In-Context Learning
Zhang, J., Wang, B., Li, L., Nakashima, Y., & Nagahara, H. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00258 · Cited by 20
Time-, Memory- and Parameter-Efficient Visual Adaptation
Mercea, O.-B., Gritsenko, A. A., Schmid, C., & Arnab, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00529 · Cited by 23
Zhao, S., & Sun, X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112571 · Cited by 19
Zhao, Q., Qian, H., Liu, Z., Zhang, G.-D., & Gu, L. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3680022 · Cited by 29
Competition between AI foundation models: dynamics and policy recommendations
Schrepel, T., & Pentland, A. (2024) · Industrial and Corporate Change · doi:10.1093/icc/dtae042 · Cited by 25
Strong and Weak Prompt Engineering for Remote Sensing Image-Text Cross-Modal Retrieval
Sun, T., Zheng, C., Li, X., Gao, Y., Nie, J., Huang, L., & Wei, Z. (2025) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2025.3534474 · Cited by 24
Towards Incremental Learning in Large Language Models: A Critical Review
Jovanovic, M., & Voss, P. (2025) · Expert Systems · doi:10.1111/exsy.70127 · Cited by 32
ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models
Xu, B., Peng, Z., Lei, B., Mukherjee, S., Liu, Y., & Xu, D. (2023) · arXiv · doi:10.48550/arxiv.2305.18323 · Cited by 17
Knowledge Graph-Based In-Context Learning for Advanced Fault Diagnosis in Sensor Networks
Xie, X., Wang, J., Han, Y., & Li, W. (2024) · Sensors · doi:10.3390/s24248086 · Cited by 18
Knowledge-guided large language model for material science
Wang, G., Hu, J., Zhou, J., Liu, S., Li, Q., & Sun, Z. (2025) · Review of Materials Research · doi:10.1016/j.revmat.2025.100007 · Cited by 16
Prompt-Based Modality Alignment for Effective Multi-Modal Object Re-Identification
Zhang, S., Luo, W., Cheng, D., Xing, Y., Liang, G., Wang, P., & Zhang, Y. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3556531 · Cited by 24
Online-LoRA: Task-Free Online Continual Learning via Low Rank Adaptation
Wei, X., Li, G., & Marculescu, R. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00646 · Cited by 16
Yun, S., Chae, S., Lee, D., & Ro, Y. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02384 · Cited by 21
Kristiani, E., Verma, V. K., & Chao-Tung, Y. (2026) · AI · doi:10.3390/ai7010015 · Cited by 18
AugPrompt: Knowledgeable augmented-trigger prompt for few-shot event classification
Song, C., Cai, F., Zheng, J., Zhao, X. H., & Shao, T. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103153 · Cited by 17
Can Large Language Models Safely Address Patient Questions Following Cataract Surgery?
Chowdhury, M., Lim, E., Higham, A., McKinnon, R., Ventoura, N., He, Y., & De Pennington, N. (2023) · Proceedings of the 5th Clinical Natural Language Processing Workshop · doi:10.18653/v1/2023.clinicalnlp-1.17 · Cited by 17
DiscoPrompt: Path Prediction Prompt Tuning for Implicit Discourse Relation Recognition
Chan, C., Liu, X., Cheng, J., Li, Z., Song, Y., Wong, G. Y., & See, S. C. W. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.4 · Cited by 22
Fusing Pre-Trained Language Models with Multimodal Prompts through Reinforcement Learning
Yu, Y., Chung, J., Yun, H., Hessel, J., Park, J. S., Lu, X., Zellers, R., Ammanabrolu, P., Bras, R. J. L., Kim, G., et al. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01044 · Cited by 17
QAmeleon : Multilingual QA with Only 5 Examples
Agrawal, P., Alberti, C., Huot, F., Maynez, J., Ma, J., Ruder, S., Ganchev, K., Das, D., & Lapata, M. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00625 · Cited by 31
eP-ALM: Efficient Perceptual Augmentation of Language Models
Shukor, M., Dancette, C., & Cord, M. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02016 · Cited by 16
Space-time Prompting for Video Class-incremental Learning
Pei, Y., Qing, Z., Zhang, S., Wang, X., Zhang, Y., Zhao, D., & Qian, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01096 · Cited by 18
Learning to Prompt Knowledge Transfer for Open-World Continual Learning
Li, Y., Yang, X. S., Wang, H., Wang, X., & Li, T. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29275 · Cited by 17
CAILA: Concept-Aware Intra-Layer Adapters for Compositional Zero-Shot Learning
Zheng, Z., Zhu, H., & Nevatia, R. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00174 · Cited by 16
Wu, R., Jiao, B., Wang, W., Liu, M., & Wang, P. (2024) · International Conference on Multimedia Retrieval · doi:10.1145/3652583.3658109 · Cited by 18
ConvLoRA and AdaBN Based Domain Adaptation via Self-Training
Aleem, S., Dietlmeier, J., Arazo, E., & Little, S. (2024) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635661 · Cited by 16
Hu, L., Zhang, X., Song, D., Zhou, C., He, H., & Nie, L. (2025) · ACM Transactions on Information Systems · doi:10.1145/3711857 · Cited by 18
Prompt-based learning for few-shot class-incremental learning
Yuan, J., Chen, H., Tian, S., Li, W., Li, L., Ning, E., & Zhang, Y. (2025) · Alexandria Engineering Journal · doi:10.1016/j.aej.2025.02.008 · Cited by 17
Huang, C., Li, X., Zheng, X., Du, Y., Chen, X., Huang, D., & Fan, Y. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127290 · Cited by 17
Embodied LLM Agents Learn to Cooperate in Organized Teams
Guo, X., Huang, K., Liu, J., Fan, W., Vélez, N., Wu, Q., Wang, H., Griffiths, T. L., & Wang, M. (2026) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2025.3637527 · Cited by 110
A Close Look into the Calibration of Pre-trained Language Models
Chen, Y., Yuan, L., Cui, G., Liu, Z., & Ji, H. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.75 · Cited by 22
Active Prompt Learning in Vision Language Models
Bang, J., Ahn, S., & Lee, J.-G. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02550 · Cited by 19
DocExtractNet: A novel framework for enhanced information extraction from business documents
Yan, Z., Ye, Z., Ge, J., Qin, J., Liu, J., Cheng, Y., & Gurrin, C. G. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2024.104046 · Cited by 21
GraphLoRA: Structure-Aware Contrastive Low-Rank Adaptation for Cross-Graph Transfer Learning
Yang, Z.-R., Han, J., Wang, C., & Liu, H. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3690624.3709186 · Cited by 16
Hao, M., Gu, Y., Dong, K., Tiwari, P., Lv, X., & Ning, X. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107453 · Cited by 15
Query-Driven Feature Learning for Cross-View Geo-Localization
Hu, S., Shi, Z., Jin, T., & Liu, Y. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3558924 · Cited by 17
de Oliveira, R., Garber, M., Gwinnutt, J. M., Rashidi, E., Hwang, J.-H. (., Gilmour, W., Nanavati, J., Abidine, K. Z. E., & Mack, C. D. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf058 · Cited by 22
Open-Vocabulary Object Detection in UAV Imagery: A Review and Future Perspectives
Zhou, Y., Li, J., Ou, C., Yan, D., Zhang, H., & Xue, X. (2025) · Drones · doi:10.3390/drones9080557 · Cited by 22
CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Survey
Li, J., Li, Y., Fu, Y., Liu, J., Liu, Y., Yang, M., & King, I. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3651700 · Cited by 31
A comprehensive survey of genome language models in bioinformatics
Shu, L., Tang, J., Guan, X., & Zhang, D. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf724 · Cited by 22
Meta-Learning the Difference: Preparing Large Language Models for Efficient Adaptation
Hou, Z., Salazar, J., & Polovets, G. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00517 · Cited by 18
MoCA: Incorporating domain pretraining and cross attention for textbook question answering
Xu, F., Lin, Q., Liu, J., Zhang, L., Zhao, T., Chai, Q., Pan, Y., Huang, Y., & Wang, Q. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109588 · Cited by 17
Li, Z., Jin, J., Long, W., & Wei, L. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107260 · Cited by 16
White, R., Peng, T., Sripitak, P., Johansen, A. R., & Snyder, M. P. (2023) · International Conference on Information Technology for Social Good (GoodIT) · doi:10.1145/3582515.3609559 · Cited by 18
Client-Customized Adaptation for Parameter-Efficient Federated Learning
Kim, Y., Kim, J., Mok, W.-L., Park, J.-H., & Lee, S. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.75 · Cited by 16
Social-Group-Agnostic Bias Mitigation via the Stereotype Content Model
Omrani, A., Ziabari, A. S., Yu, C., Golazizian, P., Kennedy, B., Atari, M., Ji, H., & Dehghani, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.227 · Cited by 16
Data Curation Alone Can Stabilize In-context Learning
Chang, T.-Y., & Jia, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.452 · Cited by 37
Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning
Özdayi, M. S., Peris, C., FitzGerald, J., Dupuy, C., Majmudar, J., Khan, H., Parikh, R., & Gupta, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.129 · Cited by 44
Late Prompt Tuning: A Late Prompt Could Be Better Than Many Prompts
Liu, X., Sun, T., Huang, X., & Qiu, X. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.95 · Cited by 25
ConStruct-VL: Data-Free Continual Structured VL Concepts Learning*
Smith, J. S., Cascante-Bonilla, P., Arbelle, A., Kim, D., Panda, R., Cox, D., Yang, D., Kira, Z., Feris, R., & Karlinsky, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01440 · Cited by 15
UniHD at TSAR-2022 Shared Task: Is Compute All We Need for Lexical Simplification?
Aumiller, D., & Gertz, M. (2022) · Workshop on Text Simplification, Accessibility and Readability (TSAR) · doi:10.18653/v1/2022.tsar-1.28 · Cited by 20
Out-of-Distribution Generalization in Natural Language Processing: Past, Present, and Future
Yang, L., Song, Y., Ren, X., Lyu, C., Wang, Y., Zhuo, J., Liu, L., Wang, J., Foster, J., & Zhang, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.276 · Cited by 21
Learning to Describe for Predicting Zero-shot Drug-Drug Interactions
Zhu, F., Zhang, Y., Chen, L., Qin, B., & Xu, R. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.918 · Cited by 19
Optimizing Prompts Using In-Context Few-Shot Learning for Text-to-Image Generative Models
Lee, S., Lee, J., Bae, C. H., Choi, M.-S., Lee, R., & Ahn, S. (2024) · IEEE Access · doi:10.1109/access.2023.3348778 · Cited by 16
An Overview of Text-Based Person Search: Recent Advances and Future Directions
Niu, K., Liu, Y., Long, Y., Huang, Y., Wang, L., & Zhang, Y. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3376373 · Cited by 18
Semantic-Oriented Visual Prompt Learning for Diabetic Retinopathy Grading on Fundus Images
Zhang, Y., Ma, X., Huang, K., Li, M., & Heng, P. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3383827 · Cited by 16
Automated API Docs Generator using Generative AI
Dhyani, P., Nautiyal, S., Negi, A., Dhyani, S., & Chaudhary, P. M. (2024) · IEEE International Students' Conference on Electrical, Electronics and Computer Science (SCEECS) · doi:10.1109/sceecs61402.2024.10482119 · Cited by 22
FT2Ra: A Fine-Tuning-Inspired Approach to Retrieval-Augmented Code Completion
Guo, Q., Li, X., Xie, X., Liu, S., Tang, Z. J., Feng, R., Wang, J., Ge, J., & Bu, L. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3652130 · Cited by 19
Exemplar-Free Lifelong Person Re-identification via Prompt-Guided Adaptive Knowledge Consolidation
Li, Q., Xu, K., Peng, Y., & Zhou, J. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02110-x · Cited by 16
Relational Prompt-Based Pre-Trained Language Models for Social Event Detection
Li, P., Yu, X., Peng, H., Xian, Y., Wang, L., Sun, L., Zhang, J., & Yu, P. S. (2024) · ACM Transactions on Information Systems · doi:10.1145/3695869 · Cited by 15
Unlocking the Potential of Prompt-Tuning in Bridging Generalized and Personalized Federated Learning
Deng, W., Thrampoulidis, C., & Li, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00582 · Cited by 15
Steitz, J.-M. O., & Roth, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02213 · Cited by 21
Zhuang, H., Fang, D., Tong, K., Liu, Y., Zeng, Z., Zhou, X., & Chen, C. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3483557 · Cited by 17
Advances in artificial intelligence: a review for the creative industries
Anantrasirichai, N., Zhang, F., & Bull, D. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11494-w · Cited by 62
Mylrea, M. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-29246-0.00007-9 · Cited by 19
DreamArtist: Controllable One-Shot Text-to-Image Generation via Positive-Negative Adapter
Dong, Z., Wei, P., & Lin, L. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02526-z · Cited by 35
Automated Prompting for Non-Overlapping Cross-Domain Sequential Recommendation
Guo, L., Wang, C., Wang, X., Zhu, L., & Yin, H. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3589721 · Cited by 15
CPL: Counterfactual Prompt Learning for Vision and Language Models
He, X., Yang, D., Feng, W., Fu, T.-J., Akula, A., Jampani, V., Narayana, P., Basu, S., Wang, W. Y., & Wang, X. E. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.224 · Cited by 32
Learning visual language models for video understanding
Yang, A. (2023) · theses.fr (ABES) · doi:10.70675/802872a7z8092z4556za1fdz2c7af45f0e72 · Cited by 26
LLM-Driven Medical Report Generation via Communication-Efficient Heterogeneous Federated Learning
Che, H., Jin, H., Guo, Z., Lin, Y., Jin, C., & Chen, H. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3591185 · Cited by 19
LoRA Subtraction for Drift-Resistant Space in Exemplar-Free Continual Learning
Liu, X., & Chang, X. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01426 · Cited by 17
Rethinking Few-Shot Adaptation of Vision-Language Models in Two Stages
Farina, M., Mancini, M., Iacca, G., & Ricci, E. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02791 · Cited by 16
Yu, G., Ju, R., Sugumaran, V., & Liu, H. (2025) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2025.111973 · Cited by 14
XTrack: Multimodal Training Boosts RGB-X Video Object Trackers
Tan, Y., Wu, Z., Fu, Y., Zhou, Z., Sun, G., Zamfir, E., Ch, M., Paudel, D. P., Gool, L. V., & Timofte, R. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00543 · Cited by 27
MACSum : Controllable Summarization with Mixed Attributes
Zhang, Y., Liu, Y., Yang, Z., Fang, Y., Chen, Y., Radev, D., Zhu, C., Zeng, M., & Zhang, R. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00575 · Cited by 25
Multilingual Relation Classification via Efficient and Effective Prompting
Chen, Y., Harbecke, D., & Hennig, L. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.69 · Cited by 21
LanSER: Language-Model Supported Speech Emotion Recognition
Gong, T., Belanich, J., Somandepalli, K., Nagrani, A., Eoff, B. D., & Jou, B. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1832 · Cited by 20
Li, D., & Zhang, Z. (2023) · PLoS ONE · doi:10.1371/journal.pone.0293034 · Cited by 16
JASMINE: Arabic GPT Models for Few-Shot Learning
Nagoudi, E. M. B., Abdul-Mageed, M., Elmadany, A., Inciarte, A. A., & Khondaker, M. T. I. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.1040 · Cited by 25
Metadata
- Authors
- Lester, B., Al-Rfou, R., & Constant, N.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 3045-3059
- arXiv
- 2104.08691
- OpenAlex
- W3152956381
- Cited by
- 3,092
- References
- 49
- Citations by year
- 2026: 512 · 2025: 889 · 2024: 754 · 2023: 649 · 2022: 246 · 2021: 40
- FWCI
- 195.07
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- prompt tuning, soft prompts, parameter-efficient fine-tuning, frozen language models, few-shot learning, model size, prefix tuning, T5, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
