The DOI matches its DataCite record; 47 of the 49 references it cites were found in a registry or an index, and 1 are not checked yet.
The Power of Scale for Parameter-Efficient Prompt Tuning
Open accessAbstract
In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts are learned through backpropagation and can be tuned to incorporate signal from any number of labeled examples. Our end-to-end learned approach outperforms GPT-3's "few-shot" learning by a large margin. More remarkably, through ablations on model size using T5, we show that prompt tuning becomes more competitive with scale: as models exceed billions of parameters, our method "closes the gap" and matches the strong performance of model tuning (where all model weights are tuned). This finding is especially relevant in that large models are costly to share and serve, and the ability to reuse one frozen model for multiple downstream tasks can ease this burden. Our method can be seen as a simplification of the recently proposed "prefix tuning" of Li and Liang (2021), and we provide a comparison to this and other similar approaches. Finally, we show that conditioning a frozen model with soft prompts confers benefits in robustness to domain transfer, as compared to full model tuning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These approaches become inapplicable when there is only API access to the LLM.”
From Large Language Models as Optimizers (2023) · cites this paper as Lester et al., 2021
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
(2010) · International Conference on Machine Learning · Cited by 13,995
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
seaborn: statistical data visualization
Waskom, M. (2021) · Journal of Open Source Software · doi:10.21105/joss.03021 · Cited by 7,310
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
Kudo, T., & Richardson, J. (2018) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-2012 · Cited by 4,454
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Research works printed but not linked: 8
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert- Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. In Advances in Neural Information Processing Systems, volume 33, pages 1877-1901.
- Marie-Catherine De Marneff, Mandy Simons, and Ju- dith Tonhauser. 2019. The CommitmentBank: In- vestigating projection in naturally occurring dis- course. Proceedings of Sinn und Bedeutung 23.
- Danilo Giampiccolo, Bernardo Magnini, Ido Dagan, and Bill Dolan. 2007. The third PASCAL recog- nizing textual entailment challenge. In Proceedings of the ACL-PASCAL workshop on textual entailment and paraphrasing, pages 1-9. Association for Com- putational Linguistics.
- PMLR.
- Colin Raffel, Noam Shazeer, Adam Roberts, Kather- ine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to- text transformer. Journal of Machine Learning Re- search, 21(140):1-67.
- Melissa Roemmele, Cosmin Adrian Bejan, and An- drew S Gordon. 2011. Choice of plausible alterna- tives: An evaluation of commonsense causal reason- ing. In 2011 AAAI Spring Symposium Series.
- Noam Shazeer and Mitchell Stern. 2018. Adafactor: Adaptive learning rates with sublinear memory cost. In Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 4596-4604.
- PMLR.
Cited by
Sorted by citations
Items 601–700 of 1,009
Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Models
Tang, Y., Zhang, R., Guo, Z., Ma, X., Zhao, B., Wang, Z., Wang, D., & Li, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28323 · Cited by 33
FIT-RAG: Black-Box RAG with Factual Information and Token Reduction
Mao, Y., Dong, X., Xu, W., Gao, Y., Wei, B., & Zhang, Y. (2024) · ACM Transactions on Information Systems · doi:10.1145/3676957 · Cited by 39
Opportunities and Challenges of Generative-AI in Finance
Desai, A. P., Ravi, T., Luqman, M., Mallya, G., Kota, N., & Yadav, P. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825658 · Cited by 34
Transfer learning for language model adaptation
Saiful, B. M. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/169892 · Cited by 22
ZeroSCROLLS: A zero-shot benchmark for long text understanding
Shaham, U., Ivgi, M., Efrat, A., Berant, J., & Levy, O. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.536 · Cited by 23
A Survey on Neural Data-to-Text Generation
Lin, Y., Ruan, T., Liu, J., & Wang, H. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3304385 · Cited by 25
Transfer Learning with Foundational Models for Time Series Forecasting using Low-Rank Adaptations
Germán-Morales, M., Rivera-Rivas, A. J., Díaz, M. J. D. J., & Carmona, C. J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103247 · Cited by 25
Split Fine-Tuning for Large Language Models in Wireless Networks
Zhang, S., Cheng, G., Wu, W., Huang, X., Song, L., & Shen, X. (2025) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2025.3581484 · Cited by 22
Yang, N., Fan, M., Wang, W., & Zhang, H. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2025.3614494 · Cited by 27
Defending Against Prompt Injection With a Few DefensiveTokens
Chen, S., Wang, Y.-M., Carlini, N., Sitawarin, C., & Wagner, D. (2025) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/3733799.3762982 · Cited by 62
Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classification
Wang, H., Xu, C., & McAuley, J. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.401 · Cited by 27
Event Extraction With Dynamic Prefix Tuning and Relevance Retrieval
Huang, H., Liu, X., Shi, G., & Liu, Q. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3266495 · Cited by 21
Improving Gender Fairness of Pre-Trained Language Models without Catastrophic Forgetting
Fatemi, Z., Chen, X., Liu, W., & Xiong, C. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.108 · Cited by 36
Control Prefixes for Parameter-Efficient Text Generation
Clive, J., Cao, K., & Rei, M. (2022) · Workshop on Generation, Evaluation and Metrics (GEM) · doi:10.18653/v1/2022.gem-1.31 · Cited by 50
Mimicking the Thinking Process for Emotion Recognition in Conversation with Prompts and Paraphrasing
Zhang, T., Chen, Z., Zhong, M., & Qian, T. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/699 · Cited by 24
BLESS: Benchmarking Large Language Models on Sentence Simplification
Kew, T., Chi, A., Vásquez-Rodríguez, L., Agrawal, S., Aumiller, D., Alva-Manchego, F. E., & Shardlow, M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.821 · Cited by 50
LoGoPrompt: Synthetic Text Images Can Be Good Visual Prompts for Vision-Language Models
Cheng, S., & Yang, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00274 · Cited by 30
Prompting Multi-Modal Image Segmentation with Semantic Grouping
He, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i3.27981 · Cited by 24
Kumar, S. S., Cummings, M. L., & Stimpson, A. (2024) · 2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms59971.2024.10555871 · Cited by 21
Simple, Efficient, and Scalable Structure-Aware Adapter Boosts Protein Language Models
Tan, Y., Li, M., Zhou, B., Zhong, B., Zheng, L., Tan, P., Zhou, Z., Yu, H., Fan, G., & Hong, L. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c00689 · Cited by 23
Semantically-Shifted Incremental Adapter-Tuning is A Continual ViTransformer
Tan, Y., Zhou, Q., Xiang, X., Wang, K., Wu, Y., & Li, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02194 · Cited by 27
Cao, C., Cai, Y., Dong, Q., Wang, Y., & Fu, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00736 · Cited by 20
Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning.Preprint
Qin, Y., Wang, X., Su, Y., Lin, Y., Ding, N., Liu, Z., Li, J., Hou, L., Li, P., Sun, M., et al. (2021) · arXiv (Cornell University) · Cited by 22
Generative AI: Overview, Economic Impact, and Applications in Asset ManagementPreprint
Luk, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4574814 · Cited by 24
Augmenting Cognitive Architectures with Large Language Models
Joshi, H. N., & Ustun, V. (2024) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v2i1.27689 · Cited by 23
Non-exemplar Domain Incremental Object Detection via Learning Domain Bias
Song, X. R., He, Y., Dong, S., & Gong, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i13.29427 · Cited by 23
AdapterGNN: Parameter-Efficient Fine-Tuning Improves Generalization in GNNs
Li, S., Han, X., & Bai, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29264 · Cited by 27
Mapping the first dataset of global urban land uses with Sentinel-2 imagery and POI prompt
Xiong, S., Zhang, X., Wang, H., Lei, Y., Tan, G., & Du, S. (2025) · Remote Sensing of Environment · doi:10.1016/j.rse.2025.114824 · Cited by 24
Enhancing large language models for text-to-testcase generation
Alagarsamy, S., Tantithamthavorn, C. K., Takerngsaksiri, W., Arora, C., & Aleti, A. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112531 · Cited by 29
Boosting Static Resource Leak Detection via LLM-based Resource-Oriented Intention Inference
Wang, C., Liu, J., Peng, X., Liu, Y., & Lou, Y. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00131 · Cited by 25
Kojima, T., Matsuo, Y., & Iwasawa, Y. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/141 · Cited by 32
Zero- and Few-Shot Event Detection via Prompt-Based Meta Learning
Yue, Z., Zeng, H., Lan, M., Ji, H., & Wang, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.440 · Cited by 27
Efficient (Soft) Q-Learning for Text Generation with Limited Good Data
Guo, H., Tan, B., Liu, Z., Xing, E. P., & Hu, Z. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.518 · Cited by 54
FashionSAP: Symbols and Attributes Prompt for Fine-Grained Fashion Vision-Language Pre-Training
Han, Y., Zhang, L., Chen, Q., Chen, Z., Li, Z., Yang, J., & Cao, Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01443 · Cited by 22
MixPHM: Redundancy-Aware Parameter-Efficient Tuning for Low-Resource Visual Question Answering
Jiang, J., & Zheng, N. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02318 · Cited by 24
Make Segment Anything Model Perfect on Shadow Detection
Chen, X.-D., Wu, W., Yang, W., Qin, H., Wu, X.-T., & Mao, X. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3332257 · Cited by 21
Incorporating Structured Representations into Pretrained Vision & Language Models Using Scene Graphs
Herzig, R., Mendelson, A., Karlinsky, L., Arbelle, A., Feris, R., Darrell, T., & Globerson, A. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.870 · Cited by 27
Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents
Chae, H., Song, Y., Ong, K., Kwon, T., Kim, M., Yu, Y., Lee, D., Kang, D., & Yeo, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.342 · Cited by 41
VLN-PETL: Parameter-Efficient Transfer Learning for Vision-and-Language Navigation
Qiao, Y., Zheng, Y. H., & Wu, Q. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01416 · Cited by 27
Evolutionary Multi-objective Optimization of Large Language Model Prompts for Balancing Sentiments
Baumann, J., & Krämer, O. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-56855-8_13 · Cited by 29
Evolving Parameterized Prompt Memory for Continual Learning
Kurniawan, M. R., Song, X. R., Ma, Z., He, Y., Gong, Y., Qi, Y., & Wei, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29231 · Cited by 20
Learning to Adapt CLIP for Few-Shot Monocular Depth Estimation
Hu, X., Zhang, C., Zhang, Y. H., Hai, B., Yu, K., & He, Z. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00550 · Cited by 28
Torbarina, L., Ferkovic, T., Roguski, Ł., Mihelčić, V., Šarlija, B., & Kraljević, Ž. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100076 · Cited by 29
Cognition Guided Video Anomaly Detection Framework for Surveillance Services
Zhang, M., Wang, J., Qi, Q., Zhuang, Z., Sun, H., & Liao, J. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3407588 · Cited by 24
Transformers in source code generation: A comprehensive survey
Ghaemi, H., Alizadehsani, Z., Shahraki, A., & Corchado, J. M. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103193 · Cited by 27
RSAdapter: Adapting Multimodal Models for Remote Sensing Visual Question Answering
Wang, Y., & Ghamisi, P. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3413174 · Cited by 23
Hybrid Prompt Learning for Generating Justifications of Security Risks in Automation Rules
Breve, B., Cimino, G., & Deufemia, V. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3675401 · Cited by 20
Tc-llama 2: fine-tuning LLM for technology and commercialization applications
Yeom, J., Lee, H., Byun, H., Kim, Y., Byun, J., Choi, Y., Kim, S., & Song, K. (2024) · Journal Of Big Data · doi:10.1186/s40537-024-00963-0 · Cited by 21
Multi-task prompt tuning with soft context sharing for vision–language models
Ding, K., Wang, Y., Liu, P., Yu, Q., Zhang, H., Xiang, S., & Pan, C. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128290 · Cited by 24
Kim, J., Ku, Y., Kim, J., Cha, J., & Baek, S. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00420 · Cited by 22
Few-Shot Class Incremental Learning with Attention-Aware Self-adaptive Prompt
Liu, C., Wang, Z., Xiong, T., Chen, R., Wu, Y., Guo, J., & Huang, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73004-7_1 · Cited by 20
Federated Learning in Practice: Reflections and Projections
Daly, K., Eichner, H., Kairouz, P., McMahan, H. B., Ramage, D., & Xu, Z. (2024) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa62245.2024.00026 · Cited by 45
Automatic High-Level Test Case Generation using Large Language Models
Hasan, N. B., Islam, M. A., Khan, J. Y., Senjik, S., & Iqbal, A. (2025) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr66628.2025.00105 · Cited by 21
Prompting disentangled embeddings for knowledge graph completion with pre-trained language model
Geng, Y., Chen, J., Zeng, Y., Chen, Z., Zhang, W., Pan, J. Z., Wang, Y., & Xu, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.126175 · Cited by 20
Xu, T., Chen, L., Hu, Z., & Li, B. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127582 · Cited by 21
He, Y., Wang, E., Rong, Y., Cheng, Z., & Chen, H. (2025) · 2025 IEEE/ACM International Workshop on Responsible AI Engineering (RAIE) · doi:10.1109/raie66699.2025.00013 · Cited by 71
Privacy in Fine-Tuning Large Language Models: Attacks, Defenses, and Future Directions
Du, H., Liu, S., Zheng, L., Cao, Y., Nakamura, A., & Chen, L. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-8183-9_25 · Cited by 23
Stuhler, O., Ton, C. D., & Ollion, É. (2025) · Sociological Methods & Research · doi:10.1177/00491241251336794 · Cited by 29
AI Large Models for Power System: A Survey and Outlook
Yao, Q. J., Fang, F., Chen, Y., Liu, J., Mo, H., & Ao, Y. (2025) · IET Smart Energy Systems · doi:10.1049/ses2.70000 · Cited by 20
LoRA dropout as a sparsity regularizer for overfitting reduction
Lin, Y., Ma, X., Chu, X., Jin, Y., Yang, Z., & Wang, Y. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114241 · Cited by 76
Multi-Party Empathetic Dialogue Generation: A New Task for Dialog Systems
Zhu, L. Y., Zhang, Z., Wang, J., Wang, H., Wu, H., & Yang, Z. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.24 · Cited by 21
Li, Y., Mehrish, A., Bhardwaj, R., Majumder, N., Bo, C., Zhao, S., Zadeh, A., Mihalcea, R. F., & Poria, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095656 · Cited by 19
CodePrompt: Task-Agnostic Prefix Tuning for Program and Language Generation
Choi, Y., & Lee, J.-H. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.325 · Cited by 20
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models
Peng, H. M., Wang, X., Hu, S., Jin, H., Hou, L., Li, J., Liu, Z., & Liu, Q. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.335 · Cited by 34
Prompt-MIL: Boosting Multi-instance Learning Schemes via Task-Specific Prompt Tuning
Zhang, J., Kapse, S., Ma, K., Prasanna, P., Saltz, J. H., Vakalopoulou, M., & Samaras, D. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43993-3_60 · Cited by 21
Chun, J., & Elkins, K. (2023) · International Journal of Digital Humanities · doi:10.1007/s42803-023-00069-8 · Cited by 22
Cheng, K., Song, W., Ma, Z., Zhu, W., Zhu, Z., & Zhang, J. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611987 · Cited by 22
Sheng, L., Gu, Z., & Chang, F. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122886 · Cited by 19
Class-Incremental Grouping Network for Continual Audio-Visual Learning
Mo, S., Pian, W., & Tian, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00716 · Cited by 20
SA²VP: Spatially Aligned-and-Adapted Visual Prompt
Pei, W., Xia, T., Chen, F., Li, J., Tian, J., & Lu, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28243 · Cited by 21
CoPL: Contextual Prompt Learning for Vision-Language Understanding
Goswami, K., Karanam, S., Udhayanan, P., Joseph, K. J., & Srinivasan, B. V. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29766 · Cited by 25
JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claims
Zeng, F., & Gao, W. G. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00649 · Cited by 28
ProRLearn: boosting prompt tuning-based vulnerability detection by reinforcement learning
Ren, Z., Ju, X., Chen, X., & Shen, H. (2024) · Automated Software Engineering · doi:10.1007/s10515-024-00438-9 · Cited by 23
Chen, X., Liu, T., Fournier‐Viger, P., Zhang, B., Long, G., & Zhang, Q. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111968 · Cited by 22
Low-Rank Prompt-Guided Transformer for Hyperspectral Image Denoising
Tan, X., Shao, M., Qiao, Y., Liu, T., & Cao, X. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3414956 · Cited by 19
Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-Rank Experts
Wu, J., Xia, H., Wang, Y., Pang, B., & Soricut, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01347 · Cited by 35
Control Prefixes for Text Generation.Preprint
Clive, J., Cao, K., & Rei, M. (2021) · arXiv (Cornell University) · Cited by 19
Zheng, Z., Marié, S., Farazdaghi, E., Yahia, E., Makhoul, K., Lagarde, T., Meouche, R. E., & Ababsa, F. (2024) · Energy and Buildings · doi:10.1016/j.enbuild.2024.115173 · Cited by 20
Multi-modal adapter for RGB-T tracking
Wang, H., Xu, T., Tang, Z., Wu, X.-J., & Kittler, J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102940 · Cited by 20
Hou, Y., Bishop, J. R., Liu, H., & Zhang, R. (2025) · Journal of Medical Internet Research · doi:10.2196/67677 · Cited by 20
Wu, R., Jiao, B., Liu, M., Wang, S., Wang, W., & Wang, P. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3560118 · Cited by 21
AF-CLIP: Zero-Shot Anomaly Detection via Anomaly-Focused CLIP Adaptation
Fang, Q., Lv, W., & Su, Q. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755635 · Cited by 18
Domain Prompt Tuning via Meta Relabeling for Unsupervised Adversarial Adaptation
Jin, X., Lan, C., Zeng, W., & Chen, Z. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3272742 · Cited by 19
Joint Holistic and Masked Face Recognition
Zhu, Y., Ren, M., Jing, H., Dai, L., Sun, Z., & Li, P. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3280717 · Cited by 21
EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation
Ge, T., Chen, S., & Wei, F. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.741 · Cited by 21
Prompting Strategies for Citation Classification
Kunnath, S. N., Pride, D., & Knoth, P. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3615018 · Cited by 19
HoneyBee: Progressive Instruction Finetuning of Large Language Models for Materials Science
Song, Y., Miret, S., Zhang, H., & Liu, B. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.380 · Cited by 21
Exploring Distributional Shifts in Large Language Models for Code Analysis
Arakelyan, S., Das, R. J., Mao, Y., & Ren, X. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.1013 · Cited by 28
Zhang, Y., Jiang, M., Meng, Y., Zhang, Y., & Han, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.780 · Cited by 21
The Life Cycle of Knowledge in Big Language Models: A Survey
Cao, B., Lin, H., Han, X., & Sun, L. (2024) · Machine Intelligence Research · doi:10.1007/s11633-023-1416-x · Cited by 18
VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control
Hu, Z.-Y., Li, Y., Lyu, M. R.-T., & Wang, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00281 · Cited by 20
A Novel Multi-Stage Prompting Approach for Language Agnostic MCQ Generation Using GPT
Maity, S., Deroy, A., & Sarkar, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-56063-7_18 · Cited by 26
Murugesan, B., Hussain, R., Bhattacharya, R., Ayed, I. B., & Dolz, J. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00036 · Cited by 18
Personalized Federated Continual Learning via Multi-Granularity Prompt
Yu, H., Yang, X., Gao, X., Kang, Y., Wang, H., Zhang, J., & Li, T. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671948 · Cited by 18
UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory
Diao, H., Wan, B., Zhang, Y., Jia, X., Lu, H., & Chen, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02714 · Cited by 23
Zero-Shot Spam Email Classification Using Pre-trained Large Language Models
Rojas–Galeano, S. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-74595-9_1 · Cited by 24
SmartLLMSentry: A Comprehensive LLM Based Smart Contract Vulnerability Detection Framework
Zaazaa, O., & Bakkali, H. E. (2024) · Journal of Metaverse · doi:10.57019/jmv.1489060 · Cited by 23
Zeng, Y. W., Zhou, J., Ye, B., Qu, Z., Guo, S., Gong, T., & Li, P. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3553201 · Cited by 18
HGTDP-DTA: Hybrid Graph-Transformer with Dynamic Prompt for Drug-Target Binding Affinity Prediction
Xiao, X., Wang, W., Xie, J., Zhu, L., Chen, G., Li, Z., Wang, T., & Xu, M. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-6585-3_24 · Cited by 21
TaleBrush: Visual Sketching of Story Generation with Pretrained Language Models
Chung, J. J. Y., Kim, W., Yoo, K. M., Lee, H., Adar, E., & Chang, M. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519873 · Cited by 22
Metadata
- Authors
- Lester, B., Al-Rfou, R., & Constant, N.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 3045-3059
- arXiv
- 2104.08691
- OpenAlex
- W3152956381
- Cited by
- 3,092
- References
- 49
- Citations by year
- 2026: 512 · 2025: 889 · 2024: 754 · 2023: 649 · 2022: 246 · 2021: 40
- FWCI
- 195.07
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- prompt tuning, soft prompts, parameter-efficient fine-tuning, frozen language models, few-shot learning, model size, prefix tuning, T5, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
