The DOI matches its DataCite record; 47 of the 49 references it cites were found in a registry or an index, and 1 are not checked yet.
The Power of Scale for Parameter-Efficient Prompt Tuning
Open accessAbstract
In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts are learned through backpropagation and can be tuned to incorporate signal from any number of labeled examples. Our end-to-end learned approach outperforms GPT-3's "few-shot" learning by a large margin. More remarkably, through ablations on model size using T5, we show that prompt tuning becomes more competitive with scale: as models exceed billions of parameters, our method "closes the gap" and matches the strong performance of model tuning (where all model weights are tuned). This finding is especially relevant in that large models are costly to share and serve, and the ability to reuse one frozen model for multiple downstream tasks can ease this burden. Our method can be seen as a simplification of the recently proposed "prefix tuning" of Li and Liang (2021), and we provide a comparison to this and other similar approaches. Finally, we show that conditioning a frozen model with soft prompts confers benefits in robustness to domain transfer, as compared to full model tuning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These approaches become inapplicable when there is only API access to the LLM.”
From Large Language Models as Optimizers (2023) · cites this paper as Lester et al., 2021
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
(2010) · International Conference on Machine Learning · Cited by 13,995
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
seaborn: statistical data visualization
Waskom, M. (2021) · Journal of Open Source Software · doi:10.21105/joss.03021 · Cited by 7,310
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
Kudo, T., & Richardson, J. (2018) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-2012 · Cited by 4,454
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Research works printed but not linked: 8
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert- Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. In Advances in Neural Information Processing Systems, volume 33, pages 1877-1901.
- Marie-Catherine De Marneff, Mandy Simons, and Ju- dith Tonhauser. 2019. The CommitmentBank: In- vestigating projection in naturally occurring dis- course. Proceedings of Sinn und Bedeutung 23.
- Danilo Giampiccolo, Bernardo Magnini, Ido Dagan, and Bill Dolan. 2007. The third PASCAL recog- nizing textual entailment challenge. In Proceedings of the ACL-PASCAL workshop on textual entailment and paraphrasing, pages 1-9. Association for Com- putational Linguistics.
- PMLR.
- Colin Raffel, Noam Shazeer, Adam Roberts, Kather- ine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to- text transformer. Journal of Machine Learning Re- search, 21(140):1-67.
- Melissa Roemmele, Cosmin Adrian Bejan, and An- drew S Gordon. 2011. Choice of plausible alterna- tives: An evaluation of commonsense causal reason- ing. In 2011 AAAI Spring Symposium Series.
- Noam Shazeer and Mitchell Stern. 2018. Adafactor: Adaptive learning rates with sublinear memory cost. In Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 4596-4604.
- PMLR.
Cited by
Sorted by citations
Items 801–900 of 1,009
PromptASR for Contextualized ASR with Controllable Style
Yang, X., Kang, W., Yao, Z., Yang, Y., Guo, L., Kuang, F., Lin, L., & Povey, D. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448264 · Cited by 14
TaskLAMA: Probing the Complex Task Understanding of Language Models
Yuan, Q., Kazemi, M., Xu, X., Noble, I., Imbrasaitė, V., & Ramachandran, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29918 · Cited by 22
Self-Prompt Mechanism for Few-Shot Image Recognition
Song, M., Wang, H., & Zhong, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28297 · Cited by 14
Vision and Structured-Language Pretraining for Cross-Modal Food Retrieval
Shukor, M., Thome, N., & Cord, M. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104071 · Cited by 15
PSC-BERT: A spam identification and classification algorithm via prompt learning and spell check
Gui, J., Zhou, Y., Yu, K., & Wu, X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112266 · Cited by 17
Uncertainty-Aware Explainable Recommendation with Large Language Models
Peng, Y., Chen, H., Lin, C.-S., Huang, G., Hu, J., Guo, H., Kong, B., Hu, S., Wu, X., & Wang, X. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651104 · Cited by 22
Distilling Vision-Language Models on Millions of Videos
Zhao, Y., Zhao, L., Zhou, X., Wu, J., Chu, C.-T., Miao, H., Schroff, F., Adam, H., Liu, T., Gong, B., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01245 · Cited by 23
AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Description
Xie, J., Han, T., Bain, M., Nagrani, A., Varol, G., Xie, W., & Zisserman, A. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0908-6_5 · Cited by 16
Yun, S., Masukawa, R., Na, M., & Imani, M. (2025) · 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv61041.2025.00464 · Cited by 14
Cross-Level Requirements Tracing Based on Large Language Models
Ge, C., Wang, T., Yang, X., & Treude, C. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3572094 · Cited by 15
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding
Zheng, Y., Zhou, J. L., Qian, Y., Ding, M., Liao, C., Li, J., Salakhutdinov, R., Tang, J., Ruder, S., & Yang, Z. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.38 · Cited by 16
Hu, X., Yu, S., Xiong, C., Liu, Z., Liu, Z., & Yu, G. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531786 · Cited by 14
Prediction of Vulnerability Characteristics Based on Vulnerability Description and Prompt Learning
Li, X., Ren, X., Xue, Y., Xing, Z., & Sun, J. (2023) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner56733.2023.00062 · Cited by 15
Eliciting Knowledge from Large Pre-Trained Models for Unsupervised Knowledge-Grounded Conversation
Li, Y., Zhao, J., Lyu, M. R.-T., & Wang, L. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.721 · Cited by 18
Response Generation with Context-Aware Prompt LearningPreprint
Gu, X., Yoo, K. M., & Lee, S.-W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.02643 · Cited by 26
ProteinGLUE multi-task benchmark suite for self-supervised protein modeling
Capel, H., Weiler, R., Dijkstra, M., Vleugels, R., Bloem, P., & Feenstra, K. A. (2022) · Scientific Reports · doi:10.1038/s41598-022-19608-4 · Cited by 11
ChatDB: Augmenting LLMs with Databases as Their Symbolic Memory
Hu, C., Fu, J., Du, C., Luo, S., Zhao, J., & Zhao, H. (2023) · arXiv · doi:10.48550/arxiv.2306.03901 · Cited by 13
LLMs on a Budget: System-Level Approaches to Power-Efficient and Scalable Fine-Tuning
Gogineni, K., Suvizi, A., & Venkataramani, G. (2025) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2025.3580498 · Cited by 14
GP-MoLFormer: a foundation model for molecular generation
Ross, J., Belgodere, B. M., Hoffman, S. C., Chenthamarakshan, V., Navratil, J., Mroueh, Y., & Das, P. (2025) · Digital Discovery · doi:10.1039/d5dd00122f · Cited by 38
CM-CLIP: Few-shot Cross-modal Generalization for Face Anti-spoofing via Prompt Learning
Ma, H., Liu, A., Lin, X., Escalante, H. J., Guyon, I., Wan, J., Lei, Z., & Liang, Y. (2026) · Machine Intelligence Research · doi:10.1007/s11633-025-1575-z · Cited by 13
Zeng, F., & Gao, W. G. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.278 · Cited by 17
Retrieving Multimodal Prompts for Generative Visual Question Answering
Ossowski, T., & Hu, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.158 · Cited by 19
Don’t Prompt, Search! Mining-based Zero-Shot Learning with Language Models
van de Kar, M., Xia, M., Chen, D., & Artetxe, M. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.509 · Cited by 13
LMSanitator: Defending Prompt-Tuning Against Task-Agnostic Backdoors
Wei, C., Meng, W., Zhang, Z., Chen, M., Zhao, M., Fang, W., Wang, L., Zhang, Z., & Chen, W. (2024) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2024.23238 · Cited by 20
UDAPTER - Efficient Domain Adaptation Using Adapters
Malik, B., Kashyap, A. R., Kan, M., & Poria, S. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.165 · Cited by 15
Toward Human Readable Prompt Tuning: Kubrick’s The Shining is a good movie, and a good prompt too?
Shi, W., Han, X., Gonen, H., Holtzman, A., Tsvetkov, Y., & Zettlemoyer, L. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.733 · Cited by 44
Adaptation with Self-Evaluation to Improve Selective Prediction in LLMs
Chen, J., Yoon, J., Ebrahimi, S., Arik, S., Pfister, T., & Jha, S. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.345 · Cited by 13
Impact of Co-occurrence on Factual Knowledge of Large Language Models
Kang, C., & Choi, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.518 · Cited by 38
Bai, J., Yan, Z., Zhang, S., Yang, J., Guo, H., & Li, Z. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111874 · Cited by 13
A head-to-head attention with prompt text augmentation for text classification
Peng, B., Han, K., Zhong, L., Wu, S., & Zhang, T. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127815 · Cited by 14
Discrete Prompt Compression With Reinforcement Learning
Jung, H., & Kim, K.-J. (2024) · IEEE Access · doi:10.1109/access.2024.3403426 · Cited by 29
Compositional Prompting for Anti-Forgetting in Domain Incremental Learning
Liu, Z., Peng, Y., & Zhou, J. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02134-3 · Cited by 13
Prompt Tuning on Graph-Augmented Low-Resource Text Classification
Wen, Z., & Fang, Y. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3440068 · Cited by 20
SCEdit: Efficient and Controllable Image Diffusion Generation via Skip Connection Editing
Jiang, Z., Mao, C., Pan, Y., Han, Z., & Zhang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00859 · Cited by 23
FMCF: Few-shot Multimodal aspect-based sentiment analysis framework based on Contrastive Finetuning
Du, Y., Xie, R., Zhang, B., & Yin, Z. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05841-z · Cited by 13
Can LLMs’ Tuning Methods Work in Medical Multimodal Domain?
Chen, J., Jiang, Y., Yang, D., Li, M., Wei, J., Qian, Z., & Zhang, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72086-4_11 · Cited by 20
Derivative-Free Optimization for Low-Rank Adaptation in Large Language Models
Jin, F., Liu, Y., & Tan, Y. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3477330 · Cited by 27
Huang, Y., Cheng, P., Tam, R. C., & Tang, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72390-2_12 · Cited by 13
A Study on Text Classification in the Age of Large Language Models
Paul Trust, & Minghim, R. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6040129 · Cited by 22
Language-Driven Visual Consensus for Zero-Shot Semantic Segmentation
Zhang, Z., Ke, W., Zhu, Y., Liang, X., Liu, J., Ye, Q., & Zhang, T. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3504816 · Cited by 15
AI agents in chemical research: GVIM – an intelligent research assistant system
Ma, K. (2025) · Digital Discovery · doi:10.1039/d4dd00398e · Cited by 16
Grounding Foundation Models through Federated Transfer Learning: A General Framework
Kang, Y., Fan, T., Gu, H., Zhang, X., Fan, L., & Yang, Q. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3742788 · Cited by 38
Wu, S., Qiao, Y., He, S., Zhou, J., Wang, Z., Li, X., & Wang, F. (2025) · Fire · doi:10.3390/fire8060237 · Cited by 13
Retrieval-Enhanced Visual Prompt Learning for Few-Shot Classification
Rong, J., Chen, H., Ou, L., Chen, T., Yu, X., & Liu, Y. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3651774 · Cited by 24
PUnifiedNER: A Prompting-Based Unified NER System for Diverse Datasets
Lu, J., Zhao, R., Namee, B. M., & Tan, F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26564 · Cited by 17
CP-Rec: Contextual Prompting for Conversational Recommender Systems
Chen, K., & Sun, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26487 · Cited by 14
Kwon, S. J., Kim, J., Bae, J., Yoo, K. M., Kim, J.-H., Park, B., Kim, B., Ha, J.-W., Sung, N., & Lee, D. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.240 · Cited by 17
Tu, L., Xiong, C., & Zhou, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.401 · Cited by 16
Fang, L., Kuang, Y., Liu, Q., Yang, Y., & Yue, J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3336283 · Cited by 13
Matsushima, T., Noguchi, Y., Arima, J., Aoki, T., Okita, Y., Ikeda, Y., Ishimoto, K., Taniguchi, S., Yamashita, Y., Seto, S., et al. (2022) · Advanced Robotics · doi:10.1080/01691864.2022.2114297 · Cited by 13
Toward robust natural language systems
Moon, H. C. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/169803 · Cited by 13
Zeng, S., Wang, D., & Xu, D. H. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.11.04.565642 · Cited by 13
Tailoring Education with GenAI: A New Horizon in Lesson PlanningPreprint
Karpouzis, K. C., Pantazatos, D., Taouki, J., & Meli, K. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/9b4su · Cited by 49
Saleem, S., Asim, M. N., van Elst, L., & Dengel, A. R. (2025) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01707-6 · Cited by 13
Han, Y., He, F., Shao, Q., Wang, D., & Xu, D. H. (2025) · Biomolecules · doi:10.3390/biom15060843 · Cited by 12
Mai, Z., Zhang, P., Tu, C.-H., Chen, H.-Y., Nguyen, Q.-H., Zhang, L., & Chao, W. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01383 · Cited by 15
Keep the Balance: A Parameter-Efficient Symmetrical Framework for RGB+X Semantic Segmentation
Cai, J., Su, J. K., Li, Q., Yang, W., Wang, S., Zhao, T., He, S., & Liu, W. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00990 · Cited by 12
Advancing Textual Prompt Learning with Anchored Attributes
Li, Z., Song, Y., Cheng, M., Li, X., & Yang, J. Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00345 · Cited by 17
ByGPT5: End-to-End Style-conditioned Poetry Generation with Token-free Language Models
Belouadi, J., & Eger, S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.406 · Cited by 25
Cross-Architecture Distillation for Face Recognition
Zhao, W., Zhu, X., He, Z., Zhang, X., & Lei, Z. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611711 · Cited by 12
Multimodal Neurons in Pretrained Text-Only Transformers
Schwettmann, S., Chowdhury, N., Klein, S., Bau, D., & Torralba, A. B. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00308 · Cited by 18
Entity recognition from colloquial text
Babaian, T., & Xu, J. (2024) · Decision Support Systems · doi:10.1016/j.dss.2024.114172 · Cited by 14
Spatio-temporal Prompting Network for Robust Video Feature Extraction
Sun, G., Wang, C., Zhang, Z., Deng, J., Zafeiriou, S. P., & Yang, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01250 · Cited by 14
DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embedding
Choi, J., Hong, J. H., & Ro, Y. M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00718 · Cited by 20
Few-Shot Relation Extraction With Automatically Generated Prompts
Zhao, X., Yang, M., Qu, Q., & Xu, R. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3365858 · Cited by 12
PGVT: Pose-Guided Video Transformer for Fine-Grained Action Recognition
Zhang, H., Leong, M. C., Li, L., & Lin, W. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00651 · Cited by 13
Navigating Challenges and Technical Debt in Large Language Models Deployment
Menshawy, A., Nawaz, M. Z., & Fahmy, M. (2024) · Workshop on Machine Learning and Systems (EuroMLSys) · doi:10.1145/3642970.3655840 · Cited by 17
Efficiently Gluing Pre-Trained Language and Vision Models for Image Captioning
Song, P., Zhou, Y., Yang, X., Liu, D., Hu, Z., Wang, D., & Wang, M. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3682067 · Cited by 12
Cross-Domain Fake News Detection Using a Prompt-Based Approach
Alghamdi, J., Lin, Y., & Luo, S. (2024) · Future Internet · doi:10.3390/fi16080286 · Cited by 14
Balanced Destruction-Reconstruction Dynamics for Memory-Replay Class Incremental Learning
Zhou, Y., Yao, J., Hong, F., Zhang, Y., & Wang, Y. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3451932 · Cited by 19
Any-Shift Prompting for Generalization Over Distributions
Xiao, Z., Shen, J., Derakhshani, M. M., Liao, S., & Snoek, C. G. M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01314 · Cited by 20
Generating Action-conditioned Prompts for Open-vocabulary Video Action Recognition
Jia, C., Luo, M., Chang, X., Dang, Z., Han, M., Wang, M., Dai, G., Dang, S., & Wang, J. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680690 · Cited by 12
Improving Zero-Shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation
Mistretta, M., Baldrati, A., Bertini, M., & Bagdanov, A. D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72907-2_27 · Cited by 16
ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to Video
Li, X., Zhu, Y., & Wang, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73010-8_25 · Cited by 20
PromptFusion: Decoupling Stability and Plasticity for Continual Learning
Chen, H., Wu, Z., Han, X., Jia, M., & Jiang, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73021-4_12 · Cited by 13
CEAT: Continual Expansion and Absorption Transformer for Non-Exemplar Class-Incremental Learning
Dong, S., Gao, X., He, Y., Zhou, Z., Kot, A. C., & Gong, Y. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3502837 · Cited by 13
Clean-label backdoor attack and defense: An examination of language model vulnerability
Zhao, S., Xu, X., Xiao, L., Wen, J., & Tuan, L. A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125856 · Cited by 15
Wang, N., Wang, S., Li, M., Wu, L., Zhang, Z., Guan, Z., & Zhu, L. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3516579 · Cited by 14
Yi, F., Singh, A., & Tao, Z. (2024) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000101 · Cited by 13
Vision-Language Tracking With CLIP and Interactive Prompt Learning
Zhu, H. B., Lu, Q., Xue, L., Zhang, P., & Yuan, G. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3520103 · Cited by 17
Foundation Model Engineering: Engineering Foundation Models Just as Engineering Software
Ran, D., Wu, M. S., Yang, W. M., & Xie, T. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3719005 · Cited by 15
Senath, T., Athukorala, K., Costa, R., Ranathunga, S., & Kaur, R. (2025) · Natural Language Processing Journal · doi:10.1016/j.nlp.2025.100177 · Cited by 16
Decomposed Two-Stage Prompt Learning for Few-Shot Named Entity Recognition
Ye, F., Huang, L. P., Liang, S., & Chi, K. (2023) · Information · doi:10.3390/info14050262 · Cited by 17
Adapted Multimodal Bert with Layer-Wise Fusion for Sentiment Analysis
Chlapanis, O. S., Paraskevopoulos, G., & Potamianos, A. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094923 · Cited by 13
Ma, Z., Yu, Z., Li, J., & Li, G. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26569 · Cited by 12
Zhang, Z., Guo, W., Meng, X., Wang, Y., Wang, Y., Jiang, X., Liu, Q., & Yang, Z. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.725 · Cited by 18
What Makes Data-to-Text Generation Hard for Pretrained Language Models?
Keymanesh, M., Benton, A., & Dredze, M. H. (2022) · Workshop on Generation, Evaluation and Metrics (GEM) · doi:10.18653/v1/2022.gem-1.50 · Cited by 13
Towards Realistic Low-resource Relation Extraction: A Benchmark with Empirical Baseline Study
Xu, X., Chen, X., Zhang, N., Xie, X., Chen, X., & Chen, H. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.29 · Cited by 15
P-Adapters: Robustly Extracting Factual Information from Language Models with Diverse PromptsPreprint
Newman, B., Choubey, P. K., & Rajani, N. F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07280 · Cited by 17
Incorporating Pre-training Paradigm for Antibody Sequence-Structure Co-designPreprint
Gao, K., Wu, L., Zhu, J., Peng, T., Xia, Y., He, L., Xie, S., Qin, T., Liu, H., He, K., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.14.516404 · Cited by 13
Lai, J., Li, M., Chen, S., Long, J., Chen, Y., Lü, H., Zou, C., & Zhang, Z. (2025) · Analytical Chemistry · doi:10.1021/acs.analchem.5c01846 · Cited by 15
Soft Prompt Decoding for Multilingual Dense Retrieval
Huang, Z., Zeng, H., Zamani, H., & Allan, J. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591769 · Cited by 13
A Gradient Control Method for Backdoor Attacks on Parameter-Efficient Tuning
Gu, N., Fu, P., Liu, X., Liu, Z., Lin, Z., & Wang, W. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.194 · Cited by 14
Socratic Question Generation: A Novel Dataset, Models, and Evaluation
Ang, B. H., Gollapalli, S. D., & Ng, S.-K. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.12 · Cited by 13
Bulat, A., & Tzimiropoulos, G. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01904-9 · Cited by 12
How Reliable Are AI-Generated-Text Detectors? An Assessment Framework Using Evasive Soft Prompts
Kumarage, T., Sheth, P., Moraffah, R., Garland, J., & Liu, H. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.94 · Cited by 27
Point-to-Pixel Prompting for Point Cloud Analysis With Pre-Trained Image Models
Wang, Z., Rao, Y., Yu, X., Zhou, J., & Lu, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3354961 · Cited by 13
Prompt-Driven Target Speech Diarization
Jiang, Y., Chen, Z., Tao, R., Deng, L., Qian, Y., & Li, H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446072 · Cited by 11
Text-to-Image Generation for Abstract Concepts
Liao, J., Chen, X., Fu, Q., Du, L., He, X., Wang, X., Han, S., & Zhang, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i4.28122 · Cited by 19
Improving Open Set Recognition via Visual Prompts Distilled from Common-Sense Knowledge
Kim, S., Kim, H.-I., & Ro, Y. M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i3.28058 · Cited by 11
Metadata
- Authors
- Lester, B., Al-Rfou, R., & Constant, N.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 3045-3059
- arXiv
- 2104.08691
- OpenAlex
- W3152956381
- Cited by
- 3,092
- References
- 49
- Citations by year
- 2026: 512 · 2025: 889 · 2024: 754 · 2023: 649 · 2022: 246 · 2021: 40
- FWCI
- 195.07
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- prompt tuning, soft prompts, parameter-efficient fine-tuning, frozen language models, few-shot learning, model size, prefix tuning, T5, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
