The DOI matches its DataCite record; 47 of the 49 references it cites were found in a registry or an index, and 1 are not checked yet.
The Power of Scale for Parameter-Efficient Prompt Tuning
Open accessAbstract
In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts are learned through backpropagation and can be tuned to incorporate signal from any number of labeled examples. Our end-to-end learned approach outperforms GPT-3's "few-shot" learning by a large margin. More remarkably, through ablations on model size using T5, we show that prompt tuning becomes more competitive with scale: as models exceed billions of parameters, our method "closes the gap" and matches the strong performance of model tuning (where all model weights are tuned). This finding is especially relevant in that large models are costly to share and serve, and the ability to reuse one frozen model for multiple downstream tasks can ease this burden. Our method can be seen as a simplification of the recently proposed "prefix tuning" of Li and Liang (2021), and we provide a comparison to this and other similar approaches. Finally, we show that conditioning a frozen model with soft prompts confers benefits in robustness to domain transfer, as compared to full model tuning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These approaches become inapplicable when there is only API access to the LLM.”
From Large Language Models as Optimizers (2023) · cites this paper as Lester et al., 2021
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
(2010) · International Conference on Machine Learning · Cited by 13,995
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
seaborn: statistical data visualization
Waskom, M. (2021) · Journal of Open Source Software · doi:10.21105/joss.03021 · Cited by 7,310
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
Kudo, T., & Richardson, J. (2018) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-2012 · Cited by 4,454
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Research works printed but not linked: 8
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert- Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. In Advances in Neural Information Processing Systems, volume 33, pages 1877-1901.
- Marie-Catherine De Marneff, Mandy Simons, and Ju- dith Tonhauser. 2019. The CommitmentBank: In- vestigating projection in naturally occurring dis- course. Proceedings of Sinn und Bedeutung 23.
- Danilo Giampiccolo, Bernardo Magnini, Ido Dagan, and Bill Dolan. 2007. The third PASCAL recog- nizing textual entailment challenge. In Proceedings of the ACL-PASCAL workshop on textual entailment and paraphrasing, pages 1-9. Association for Com- putational Linguistics.
- PMLR.
- Colin Raffel, Noam Shazeer, Adam Roberts, Kather- ine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to- text transformer. Journal of Machine Learning Re- search, 21(140):1-67.
- Melissa Roemmele, Cosmin Adrian Bejan, and An- drew S Gordon. 2011. Choice of plausible alterna- tives: An evaluation of commonsense causal reason- ing. In 2011 AAAI Spring Symposium Series.
- Noam Shazeer and Mitchell Stern. 2018. Adafactor: Adaptive learning rates with sublinear memory cost. In Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 4596-4604.
- PMLR.
Cited by
Sorted by citations
Items 301–400 of 1,009
Graph Foundation Models: Concepts, Opportunities and Challenges
Liu, J., Yang, C. H., Lu, Z., Chen, J., Li, Y., Zhang, M., Bai, T., Fang, Y., Sun, L., Yu, P. S., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3548729 · Cited by 217
SAN: Side Adapter Network for Open-Vocabulary Semantic Segmentation
Xu, M., Zhang, Z., Wei, F., Hu, H., & Bai, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3311618 · Cited by 54
Kim, S., Joo, S., Kim, D., Jang, J., Ye, S., Shin, J., & Seo, M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.782 · Cited by 139
Che, T., Liu, J., Yang, Z., Ren, J., Zhou, J., Sheng, V. S., Dai, H., & Dou, D. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.488 · Cited by 92
Chain-of-Thought in Neural Code Generation: From and for Lightweight Language Models
Yang, G., Zhou, Y., Chen, X., Zhang, X., Zhuo, T. Y., & Chen, T. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3440503 · Cited by 75
Creativity and Machine Learning: A Survey
Franceschelli, G., & Musolesi, M. (2024) · ACM Computing Surveys · doi:10.1145/3664595 · Cited by 83
Petals: Collaborative Inference and Fine-tuning of Large Models
Borzunov, A., Baranchuk, D., Dettmers, T., Riabinin, M., Belkada, Y., Chumachenko, A., Samygin, P., & Raffel, C. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations) · doi:10.18653/v1/2023.acl-demo.54 · Cited by 52
A Closer Look at the Few-Shot Adaptation of Large Vision-Language Models
Silva-Rodríguez, J., Hajimiri, S., Ayed, I. B., & Dolz, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02235 · Cited by 64
Benchmarking DNA foundation models for genomic and genetic tasks
Feng, H., Wu, L., Zhao, B., Huff, C. D., Zhang, J. J., Wu, J., Lin, L., Wei, P., & Wu, C. (2025) · Nature Communications · doi:10.1038/s41467-025-65823-8 · Cited by 83
LASP: Text-to-Text Optimization for Language-Aware Soft Prompting of Vision & Language Models
Bulat, A., & Tzimiropoulos, G. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02225 · Cited by 64
Parameter-Efficient Transfer Learning for Medical Visual Question Answering
Liu, J., Hu, T., Zhang, Y., Yang, F., Hao, J., Lv, J., & Liu, Z. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3311333 · Cited by 52
VIP5: Towards Multimodal Foundation Models for Recommendation
Geng, S., Tan, J., Liu, S., Fu, Z., & Zhang, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.644 · Cited by 111
ITI-Gen: Inclusive Text-to-Image Generation
Zhang, C., Chen, X., Chai, S., Wu, C., Lagun, D., Beeler, T., & la Torre, F. D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00367 · Cited by 59
Mask-guided BERT for few-shot text classification
Liao, W., Liu, Z., Dai, H., Wu, Z., Zhang, Y., Huang, X., Chen, Y., Jiang, X., Liu, D., Zhu, D., et al. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128576 · Cited by 73
FKA-Owl: Advancing Multimodal Fake News Detection through Knowledge-Augmented LVLMs
Liu, X., Li, P., Huang, H., Li, Z., Cui, X., Liang, J., Qin, L., Deng, W., & He, Z. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681089 · Cited by 65
ADAPT: Vision-Language Navigation with Modality-Aligned Action Prompts
Lin, B., Zhu, Y., Chen, Z., Liang, X., Liu, J., & Liang, X. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01496 · Cited by 59
PLATE: A Prompt-Enhanced Paradigm for Multi-Scenario Recommendations
Wang, Y., Zhao, X., Chen, B., Liu, Q., Guo, H., Liu, H., Wang, Y., Zhang, R., & Tang, R. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591750 · Cited by 50
Clinical Prompt Learning With Frozen Language Models
Taylor, N., Zhang, Y., Joyce, D. W., Gao, Z., Kormilitzin, A., & Nevado‐Holgado, A. J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3294633 · Cited by 55
Personalized Prompt for Sequential Recommendation
Wu, Y., Xie, R., Zhu, Y., Zhuang, F., Zhang, X., Lin, L., & He, Q. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3357498 · Cited by 75
Deep learning models for ischemic stroke lesion segmentation in medical images: A survey
Luo, J., Dai, P., He, Z., Huang, Z., Liao, S., & Liu, K. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108509 · Cited by 55
FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysis
Zhang, C., Mao, Y., Fan, Y., Mi, Y., Gao, Y., Chen, L., Lou, D., & Lin, J. (2024) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3626246.3653375 · Cited by 73
Towards Lifelong Learning of Large Language Models: A Survey
Zheng, J., Qiu, S., Shi, C., & Ma, Q. (2025) · ACM Computing Surveys · doi:10.1145/3716629 · Cited by 93
Ma, Y., Zheng, S., Yang, Z., Pan, H., & Hong, J. (2025) · International Journal of Production Research · doi:10.1080/00207543.2025.2472298 · Cited by 65
Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answering
Baek, J., Aji, A., & Saffari, A. (2023) · Proceedings of the First Workshop on Matching From Unstructured and Structured Data (MATCHING 2023) · doi:10.18653/v1/2023.matching-1.7 · Cited by 51
Pre-training Methods in Information Retrieval
Fan, Y., Xie, X., Cai, Y., Chen, J., Ma, X., Li, X., Zhang, R., & Guo, J. (2022) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000100 · Cited by 69
Natural Language to Code Translation with Execution
Shi, F., Fried, D., Ghazvininejad, M., Zettlemoyer, L., & Wang, S. I. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.231 · Cited by 105
SimDA: Simple Diffusion Adapter for Efficient Video Generation
Xing, Z., Dai, Q., Hu, H., Wu, Z., & Jiang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00748 · Cited by 92
Adapting Language Models to Compress Contexts
Chevalier, A., Wettig, A., Ajith, A., & Chen, D. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.232 · Cited by 59
A collective AI via lifelong learning and sharing at the edge
Soltoggio, A., Ben-Iwhiwhu, E., Braverman, V., Eaton, E., Epstein, B., Ge, Y., Halperin, L., How, J., Itti, L., Jacobs, M. A., et al. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00800-2 · Cited by 51
LLM4VV: Developing LLM-driven testsuite for compiler validation
Munley, C., Jarmusch, A., & Chandrasekaran, S. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.05.034 · Cited by 55
Towards Visual-Prompt Temporal Answer Grounding in Instructional Video
Shutao Li, A., Li, B., Sun, B., & Weng, Y. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3411045 · Cited by 55
DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection
Shao, R., Wu, T., Nie, L., & Liu, Z. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-024-02274-6 · Cited by 48
A Review of Large Language Models for Energy Systems: Applications, Challenges, and Future Prospects
Mirshekali, H., Shadi, M. R., Ladani, F. G., & Shaker, H. R. (2025) · IEEE Access · doi:10.1109/access.2025.3610994 · Cited by 64
Prompt-free and Efficient Few-shot Learning with Language Models
Mahabadi, R. K., Zettlemoyer, L., Henderson, J., Mathias, L., Saeidi, M., Stoyanov, V., & Yazdani, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.254 · Cited by 71
Prompt Learns Prompt: Exploring Knowledge-Aware Generative Prompt Collaboration For Video Captioning
Yan, L., Han, C., Xu, Z., Liu, D., & Wang, Q. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/180 · Cited by 50
What is the limitation of multimodal LLMs? A deeper look into multimodal LLMs through prompt probing
Qi, S., Cao, Z., Rao, J., Wang, L., Xiao, J., & Wang, X. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103510 · Cited by 55
Task Contamination: Language Models May Not Be Few-Shot Anymore
Li, C., & Flanigan, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29808 · Cited by 47
Can GNN be Good Adapter for LLMs?
Huang, X., Han, K., Yang, Y., Bao, D., Tao, Q., Chai, Z., & Zhu, Q. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645627 · Cited by 70
ArGue: Attribute-Guided Prompt Tuning for Vision-Language Models
Tian, X., Zou, S., Yang, Z., & Zhang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02700 · Cited by 54
GeoLLM: A specialized large language model framework for intelligent geotechnical design
Xu, H., Zhang, N., Yin, Z., & Njock, P. G. A. (2024) · Computers and Geotechnics · doi:10.1016/j.compgeo.2024.106849 · Cited by 50
Zhang, T., Ma, L., Cheng, S., Liu, Y., Li, N., & Wang, H. (2025) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2025.101922 · Cited by 53
Selective Fairness in Recommendation via Prompts
Wu, Y., Xie, R., Zhu, Y., Zhuang, F., Ao, X., Zhang, X., Lin, L., & He, Q. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531913 · Cited by 47
SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters
He, S., Ding, L., Dong, D., Zhang, J., & Tao, D. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.160 · Cited by 95
BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning
Oh, C., Hwang, H., Lee, H., Lim, Y., Jung, G., Jung, J., Choi, H., & Song, K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02320 · Cited by 50
Introducing Language Guidance in Prompt-based Continual Learning
Khan, M. G. Z. A., Naeem, M. F., Gool, L. V., Stricker, D., Tombari, F., & Afzal, M. Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01053 · Cited by 46
Chuang, Y.-N., Tang, R., Jiang, X., & Hu, X. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104606 · Cited by 46
Cross-Domain Few-Shot Object Detection via Enhanced Open-Set Object Detector
Fu, Y., Wang, Y., Pan, Y., Huai, L., Qiu, X., Shangguan, Z., Liu, T., Fu, Y., Gool, L. V., & Jiang, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73636-0_15 · Cited by 47
Duan, H., Shao, S., Zhai, B., Shah, T., Han, J., & Ranjan, R. K. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02398-3 · Cited by 49
Nie, T., Sun, J., & Ma, W. (2025) · Artificial Intelligence for Transportation · doi:10.1016/j.ait.2025.100003 · Cited by 70
Few-Shot Bot: Prompt-Based Learning for Dialogue SystemsPreprint
Madotto, A., Lin, Z., Winata, G. I., & Fung, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08118 · Cited by 96
Exploring the Universal Vulnerability of Prompt-based Learning Paradigm
Xu, L., Chen, Y., Cui, G., Gao, H., & Liu, Z. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.137 · Cited by 73
Distribution-Aware Prompt Tuning for Vision-Language Models
Cho, E., Kim, J., & Kim, H. J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02011 · Cited by 50
Adapting LLMs for Efficient Context Processing through Soft Prompt Compression
Wang, C., Yang, Y., Li, R., Sun, D., Cai, R., Zhang, Y., & Fu, C. (2024) · International Conference on Modeling, Natural Language Processing and Machine Learning (CMNM) · doi:10.1145/3677779.3677794 · Cited by 47
Unique Security and Privacy Threats of Large Language Models: A Comprehensive Survey
Wang, S., Zhu, T., Liu, B., Ding, M., Ye, D., Zhou, W., & Yu, P. S. (2025) · ACM Computing Surveys · doi:10.1145/3764113 · Cited by 96
Fu, J., Yuan, F., Song, Y., Yuan, Z., Cheng, M., Cheng, S., Zhang, J., Wang, J., & Pan, Y. (2024) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3616855.3635805 · Cited by 65
Tu, C.-H., Mai, Z., & Chao, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00746 · Cited by 54
Brain-Inspired Remote Sensing Foundation Models and Open Problems: A Comprehensive Survey
Jiao, L., Huang, Z., Lu, X., Liu, X., Yang, Y., Zhao, J., Zhang, J., Hou, B., Yang, S., Liu, F., et al. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3316302 · Cited by 49
Prompt Tuning in Code Intelligence: An Experimental Evaluation
Wang, C., Yang, Y., Gao, C., Peng, Y., Zhang, H., & Lyu, M. R.-T. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3313881 · Cited by 48
PoisonPrompt: Backdoor Attack on Prompt-Based Large Language Models
Yao, H., Lou, J., & Qin, Z. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446267 · Cited by 63
CEPrompt: Cross-Modal Emotion-Aware Prompting for Facial Expression Recognition
Zhou, H., Huang, S., Zhang, F., & Xu, C. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3424777 · Cited by 49
Cross-modal adapter for vision–language retrieval
Jiang, H., Zhang, J., Huang, R., Ge, C., Ni, Z., Song, S., & Huang, G. M. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.111144 · Cited by 72
Resource-efficient Algorithms and Systems of Foundation Models: A Survey
Xu, M., Cai, D., Yin, W., Wang, S., Jin, X., & Liu, X. (2024) · ACM Computing Surveys · doi:10.1145/3706418 · Cited by 255
Controllable Image Captioning via Prompting
Wang, N., Xie, J., Wu, J., Jia, M., & Li, L. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25360 · Cited by 50
AutoAD: Movie Description in Context
Han, T., Bain, M., Nagrani, A., Varol, G., Xie, W., & Zisserman, A. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01815 · Cited by 43
In-Context Learning Creates Task Vectors
Hendel, R., Geva, M., & Globerson, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.624 · Cited by 229
Knowledge-Aware Prompt Tuning for Generalizable Vision-Language Models
Kan, B., Wang, T., Lü, W., Zhen, X., Guan, W., & Zheng, F. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01436 · Cited by 48
Tuan, N. T., Moore, P. T., Thanh, D. H. V., & Pham, H. V. (2024) · Applied Sciences · doi:10.3390/app14073036 · Cited by 51
Efficient Multimodal Semantic Segmentation via Dual-Prompt Learning
Dong, S., Feng, Y., Yang, Q., Huang, Y., Liu, D., & Fan, H. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801872 · Cited by 46
Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation
He, W., Dai, Y., Yang, M., Sun, J. Q., Huang, F., Si, L., & Li, Y. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3532069 · Cited by 44
Huang, Q. Y., Yuan, Z., Xing, Z., Xu, X., Zhu, L., & Lu, Q. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3556912 · Cited by 47
Hierarchical Prompt Learning for Multi-Task Learning
Liu, Y., Lu, Y., Liu, H., An, Y., Xu, Z., Yao, Z., Zhang, B., Xiong, Z., & Gui, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01048 · Cited by 44
Pre-trained Vision and Language Transformers are Few-Shot Incremental Learners
Park, K.-H., Song, K., & Park, G.-M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02254 · Cited by 43
Discrete and Soft Prompting for Multilingual Models
Zhao, M., & Schütze, H. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.672 · Cited by 55
Parameter-Efficient Fine-Tuning without Introducing New Latency
Liao, B., Meng, Y., & Monz, C. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.233 · Cited by 79
Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrations
Yoo, K. M., Kim, J., Kim, H. J., Cho, H., Jo, H., Lee, S., Lee, S., & Kim, T. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.155 · Cited by 91
Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models
Zha, Y., Wang, J., Dai, T., Chen, B., Wang, Z., & Xia, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01302 · Cited by 49
MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning
Peng, L., Cai, S., Wu, Z., Shang, H., Zhu, X., & Li, X. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103225 · Cited by 41
Continual Prompt Tuning for Dialog State Tracking
Zhu, Q., Li, B., Mi, F., Zhu, X., & Huang, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.80 · Cited by 51
Multimodal Parameter-Efficient Few-Shot Class Incremental Learning
D’Alessandro, M., Alonso, A., Calabrés, E., & Galar, M. (2023) · 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw60793.2023.00364 · Cited by 40
Mohammadabadi, S. M. S., Kara, B. C., Eyüpoğlu, C., Uzay, C., Tosun, M. S., & Karakuş, O. (2025) · Electronics · doi:10.3390/electronics14183580 · Cited by 71
Prompt-based and weak-modality enhanced multimodal recommendation
Dong, X., Song, X., Tian, M., & Hu, L. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101989 · Cited by 44
Domain Prompt Learning for Efficiently Adapting CLIP to Unseen Domains
Zhang, X., Gu, S., Matsuo, Y., & Iwasawa, Y. (2023) · Transactions of the Japanese Society for Artificial Intelligence · doi:10.1527/tjsai.38-6_b-mc2 · Cited by 43
Data-Juicer: A One-Stop Data Processing System for Large Language Models
Chen, D., Huang, Y., Ma, Z., Chen, H., Pan, X., Ge, C., Gao, D., Xie, Y., Liu, Z., Gao, J., et al. (2024) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3626246.3653385 · Cited by 72
GenerRNA: A generative pre-trained language model for de novo RNA design
Zhao, Y., Oono, K., Takizawa, H., & Kotera, M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0310814 · Cited by 50
KronA: Parameter-Efficient Tuning with Kronecker Adapter
Edalati, A., Tahaei, M. S., Kobyzev, I., Nia, V. P., Clark, J. J., & Rezagholizadeh, M. (2025) · Machine translation · doi:10.1007/978-3-031-85747-8_4 · Cited by 168
BBTv2: Towards a Gradient-Free Future with Large Language Models
Sun, T., He, Z., Qian, H., Zhou, Y., Huang, X., & Qiu, X. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.259 · Cited by 60
Label Semantic Aware Pre-training for Few-shot Text Classification
Mueller, A., Krone, J., Romeo, S. O., Mansour, S., Mansimov, E., Zhang, Y., & Roth, D. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.570 · Cited by 40
Choi, M., Pei, J., Kumar, S., Shu, C., & Jurgens, D. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.699 · Cited by 38
Prompted representation joint contrastive learning for aspect-based sentiment analysis
Shi, X., Hu, M. Q., Ren, F., & Shi, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111345 · Cited by 38
When Prompt-based Incremental Learning Does Not Meet Strong Pretraining
Tang, Y.-M., Peng, Y.-X., & Zheng, W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00164 · Cited by 40
Exploring Clean Label Backdoor Attacks and Defense in Language Models
Zhao, S., Tuan, L. A., Fu, J., Wen, J., & Luo, W. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3407571 · Cited by 46
He, X., Zannettou, S., Shen, Y. C., & Zhang, Y. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00061 · Cited by 58
RecruitPro: A Pretrained Language Model with Skill-Aware Prompt Learning for Intelligent Recruitment
Fang, C., Qin, C., Zhang, Q., Yao, K., Zhang, J., Zhu, H., Zhuang, F., & Xiong, H. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599894 · Cited by 39
Text-Visual Prompting for Efficient 2D Temporal Video Grounding
Zhang, Y., Chen, X., Jia, J., Liu, S., & Ding, K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01421 · Cited by 40
Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformation
Lucas, J., Uchendu, A., Yamashita, M., Lee, J., Rohatgi, S., & Lee, D. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.883 · Cited by 37
Prompt Guided Transformer for Multi-Task Dense Prediction
Lu, Y., Sirejiding, S., Ding, Y., Wang, C., & Lu, H. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3349865 · Cited by 37
PromptMM: Multi-Modal Knowledge Distillation for Recommendation with Prompt-Tuning
Wei, W., Tang, J., Xia, L., Jiang, Y., & Huang, C. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645359 · Cited by 48
Drive Anywhere: Generalizable End-to-end Autonomous Driving with Multi-modal Foundation Models
Wang, T.-H. J., Maalouf, A., Xiao, W., Ban, Y., Amini, A., Rosman, G., Karaman, S., & Rus, D. L. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611590 · Cited by 52
Continual Learning for Smart City: A Survey
Yang, L., Luo, Z., Zhang, S., Teng, F., & Li, T. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3447123 · Cited by 46
Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysis
Zhou, X., Liang, D., Xu, W., Zhu, X., Xu, Y., Zou, Z., & Bai, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01393 · Cited by 41
Metadata
- Authors
- Lester, B., Al-Rfou, R., & Constant, N.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 3045-3059
- arXiv
- 2104.08691
- OpenAlex
- W3152956381
- Cited by
- 3,092
- References
- 49
- Citations by year
- 2026: 512 · 2025: 889 · 2024: 754 · 2023: 649 · 2022: 246 · 2021: 40
- FWCI
- 195.07
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- prompt tuning, soft prompts, parameter-efficient fine-tuning, frozen language models, few-shot learning, model size, prefix tuning, T5, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
