The DOI matches its DataCite record; 47 of the 49 references it cites were found in a registry or an index, and 1 are not checked yet.
The Power of Scale for Parameter-Efficient Prompt Tuning
Open accessAbstract
In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts are learned through backpropagation and can be tuned to incorporate signal from any number of labeled examples. Our end-to-end learned approach outperforms GPT-3's "few-shot" learning by a large margin. More remarkably, through ablations on model size using T5, we show that prompt tuning becomes more competitive with scale: as models exceed billions of parameters, our method "closes the gap" and matches the strong performance of model tuning (where all model weights are tuned). This finding is especially relevant in that large models are costly to share and serve, and the ability to reuse one frozen model for multiple downstream tasks can ease this burden. Our method can be seen as a simplification of the recently proposed "prefix tuning" of Li and Liang (2021), and we provide a comparison to this and other similar approaches. Finally, we show that conditioning a frozen model with soft prompts confers benefits in robustness to domain transfer, as compared to full model tuning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These approaches become inapplicable when there is only API access to the LLM.”
From Large Language Models as Optimizers (2023) · cites this paper as Lester et al., 2021
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
(2010) · International Conference on Machine Learning · Cited by 13,995
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
seaborn: statistical data visualization
Waskom, M. (2021) · Journal of Open Source Software · doi:10.21105/joss.03021 · Cited by 7,310
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
Kudo, T., & Richardson, J. (2018) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-2012 · Cited by 4,454
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Research works printed but not linked: 8
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert- Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. In Advances in Neural Information Processing Systems, volume 33, pages 1877-1901.
- Marie-Catherine De Marneff, Mandy Simons, and Ju- dith Tonhauser. 2019. The CommitmentBank: In- vestigating projection in naturally occurring dis- course. Proceedings of Sinn und Bedeutung 23.
- Danilo Giampiccolo, Bernardo Magnini, Ido Dagan, and Bill Dolan. 2007. The third PASCAL recog- nizing textual entailment challenge. In Proceedings of the ACL-PASCAL workshop on textual entailment and paraphrasing, pages 1-9. Association for Com- putational Linguistics.
- PMLR.
- Colin Raffel, Noam Shazeer, Adam Roberts, Kather- ine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to- text transformer. Journal of Machine Learning Re- search, 21(140):1-67.
- Melissa Roemmele, Cosmin Adrian Bejan, and An- drew S Gordon. 2011. Choice of plausible alterna- tives: An evaluation of commonsense causal reason- ing. In 2011 AAAI Spring Symposium Series.
- Noam Shazeer and Mitchell Stern. 2018. Adafactor: Adaptive learning rates with sublinear memory cost. In Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 4596-4604.
- PMLR.
Cited by
Sorted by citations
Items 501–600 of 1,009
On Natural Language User Profiles for Transparent and Scrutable Recommendation
Radlinski, F., Balog, K., Díaz, F., Dixon, L., & Wedin, B. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531873 · Cited by 30
XPrompt: Exploring the Extreme of Prompt Tuning
Ma, F., Zhang, C., Ren, L., Wang, J., Wang, Q., Wu, W., Quan, X., & Song, D. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.758 · Cited by 45
Rehearsal-free Continual Language Learning via Efficient Parameter Isolation
Wang, Z., Liu, Y., Ji, T., Wang, X., Wu, Y., Jiang, C., Ye, C., Han, Z., Wang, L., Shao, X., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.612 · Cited by 35
Finding Skill Neurons in Pre-trained Transformer-based Language Models
Wang, X., Wen, K., Zhang, Z., Hou, L., Liu, Z., & Li, J. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.765 · Cited by 79
Moon, J.-Y., Park, K.-H., Kim, J. U., & Park, G.-M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01077 · Cited by 30
Li, W., Hacid, H., Almazrouei, E., & Debbah, M. A. (2023) · AI · doi:10.3390/ai4030039 · Cited by 37
Meta-prompt based learning for low-resource false information detection
Huang, Y., Gao, M., Wang, J., Yin, J., Shu, K., Fan, Q., & Wen, J. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103279 · Cited by 29
Hydra: Multi-head low-rank adaptation for parameter efficient fine-tuning
Kim, S., Yang, H.-M., Kim, Y., Hong, Y., & Park, E. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106414 · Cited by 36
Frozen Feature Augmentation for Few-Shot Image Classification
Bär, A., Houlsby, N., Dehghani, M., & Kumar, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01519 · Cited by 28
Cross-Platform Video Person ReID: A New Benchmark Dataset and Adaptation Approach
Zhang, S., Luo, W., Cheng, D., Yang, Q., Ran, L., Xing, Y., & Zhang, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73383-3_16 · Cited by 27
AECR: Automatic attack technique intelligence extraction based on fine-tuned large language model
Chen, M., Zhu, K., Lu, B., Li, D., Yuan, Q., & Zhu, Y. (2024) · Computers & Security · doi:10.1016/j.cose.2024.104213 · Cited by 31
Real-Time Text-to-Cypher Query Generation with Large Language Models for Graph Databases
Hornsteiner, M., Kreussel, M., Steindl, C., Ebner, F., Empl, P., & Schönig, S. (2024) · Future Internet · doi:10.3390/fi16120438 · Cited by 33
A review on enhancing agricultural intelligence with large language models
Li, H.-X., Wu, H., Li, Q., & Zhao, C. (2025) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2025.05.006 · Cited by 39
MSP: Multi-Stage Prompting for Making Pre-trained Language Models Better Translators
Tan, Z., Zhang, X., Wang, S., & Liu, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.424 · Cited by 41
Zero- and Few-Shot NLP with Pretrained Language Models
Beltagy, I., Cohan, A., Logan, R., IV, Min, S., & Singh, S. (2022) · doi:10.18653/v1/2022.acl-tutorials.6 · Cited by 28
CP3: Unifying Point Cloud Completion by Pretrain-Prompt-Predict Paradigm
Xu, M., Wang, Y., Liu, Y., He, T., & Qiao, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3257026 · Cited by 28
“Do you follow me?”: A Survey of Recent Approaches in Dialogue State Tracking
Jacqmin, L., Rojas-Barahona, L. M., & Favre, B. (2022) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2022.sigdial-1.33 · Cited by 28
E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation
Zhong, Q., Ding, L., Liu, J., Du, B., & Tao, D. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3341917 · Cited by 32
LightNER: A Lightweight Generative Framework with Prompt-guided Attention for Low-resource NERPreprint
Chen, X., Zhang, N., Li, L., Xie, X. Y., Deng, S., Tan, C., Huang, F., Si, L., & Chen, H. (2021) · arXiv (Cornell University) · Cited by 27
Wingate, D., Shoeybi, M., & Sorensen, T. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.412 · Cited by 26
A Survey: Collaborative Hardware and Software Design in the Era of Large Language Models
Guo, C., Cheng, F., Du, Z., Kiessling, J., Ku, J., Li, S., Li, Z., Ma, M., Molom-Ochir, T., Morris, B., et al. (2025) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2024.3476008 · Cited by 32
Zero-Shot Generative Model Adaptation via Image-Specific Prompt Learning
Guo, J., Wang, C., Wu, Y., Zhang, E., Wang, K., Xu, X., Song, S., Shi, H., & Huang, G. M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01106 · Cited by 26
Intelligent Practices of Large Language Models in Digital Government Services
Han, J., Lu, J., Xu, Y., You, J., & Wu, B. (2024) · IEEE Access · doi:10.1109/access.2024.3349969 · Cited by 30
Image Compression for Machine and Human Vision with Spatial-Frequency Adaptation
Li, H., Li, S., Ding, S., Dai, W., Cao, M., Li, C., Zou, J., & Xiong, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72983-6_22 · Cited by 36
Exploring the application of LLM-based AI in UX design: an empirical case study of ChatGPT
Zhou, Z., Li, Y., & Yu, J. (2024) · Human-Computer Interaction · doi:10.1080/07370024.2024.2420991 · Cited by 34
Soft prompt tuning for augmenting dense retrieval with large language models
Peng, Z., Wu, X., Wang, Q., & Fang, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112758 · Cited by 43
Modality-missing RGBT Tracking: Invertible Prompt Learning and High-quality Benchmarks
Lu, A., Li, C., Zhao, J., Tang, J., & Luo, B. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02311-4 · Cited by 31
Two-stage Unidirectional Fusion Network for RGBT tracking
Liu, Y., Gao, Z., Cao, Y., & Zhou, D. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.112983 · Cited by 27
Unleashing the Power of Continual Learning on Non-Centralized Devices: A Survey
Li, Y., Wang, H., Xu, W., Xiao, T., Liu, H., Tu, M., Wang, Y., Yang, X., Zhang, R., Yu, S., et al. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2025.3568279 · Cited by 36
Improving In-Context Few-Shot Learning via Self-Supervised Training
Chen, M., Du, J., Pasunuru, R., Mihaylov, T., Iyer, S. V., Stoyanov, V., & Kozareva, Z. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.260 · Cited by 31
Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts
Khashabi, D., Lyu, X., Min, S., Qin, L., Richardson, K., Welleck, S., Hajishirzi, H., Khot, T., Sabharwal, A., Singh, S., et al. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.266 · Cited by 58
Fine-Grained Retrieval Prompt Tuning
Wang, S., Chang, J., Wang, Z., Li, H., Ouyang, W., & Tian, Q. C. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25363 · Cited by 27
Hierarchical Verbalizer for Few-Shot Hierarchical Text Classification
Ji, K., Lian, Y., Gao, J., & Wang, B. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.164 · Cited by 27
Generative Prompt Tuning for Relation Classification
Han, J., Zhao, S., Cheng, B. H., Ma, S., & Lü, W. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.231 · Cited by 30
Ju, C., Zheng, K., Liu, J., Zhao, P., Zhang, Y., Chang, J., Tian, Q. C., & Wang, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01417 · Cited by 27
Modal-aware Visual Prompting for Incomplete Multi-modal Brain Tumor Segmentation
Qiu, Y., Zhao, Z., Yao, H., Chen, D., & Wang, Z. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611712 · Cited by 27
Transcending Scaling Laws with 0.1% Extra Compute
Tay, Y., Wei, J., Chung, H. W., Tran, V., So, D. R., Shakeri, S., Garcia, X., Zheng, S., Rao, J., Chowdhery, A., et al. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.91 · Cited by 95
An Empirical Study of Parameter-Efficient Fine-Tuning Methods for Pre-Trained Code Models
Liu, J., Sha, C., & Peng, X. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00125 · Cited by 37
Short text classification with Soft Knowledgeable Prompt-tuning
Zhu, Y. Q., Wang, Y., Mu, J., Li, Y., Qiang, J., Yuan, Y., & Wu, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123248 · Cited by 27
Learning to Rewrite Prompts for Personalized Text Generation
Li, C., Zhang, M., Mei, Q., Kong, W., & Bendersky, M. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645408 · Cited by 39
Delving into Parameter-Efficient Fine-Tuning in Code Change Learning: An Empirical Study
Liu, S., Keung, J., Yang, Z., Liu, F., Zhou, Q., & Liao, Y. (2024) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner60148.2024.00055 · Cited by 48
AAPL: Adding Attributes to Prompt Learning for Vision-Language Models
Kim, G., Kim, S., & Lee, S. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00164 · Cited by 27
Chen, S., Wang, W., Chen, X., Zhang, M., Lu, P., Li, X., & Du, Y. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-06499-7 · Cited by 27
Large Language Models in Psychiatry: Current Applications, Limitations, and Future Scope
Liu, Z., Bao, Y., Zeng, S., Qian, R., Deng, M., Gu, A., Li, J., Wang, W., Cai, W., Li, W., et al. (2024) · Big Data Mining and Analytics · doi:10.26599/bdma.2024.9020046 · Cited by 25
Exploring Effective Factors for Improving Visual In-Context Learning
Sun, Y., Chen, Q., Wang, J., Wang, J., & Li, Z. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3554410 · Cited by 61
Empirical Guidelines for Deploying LLMs onto Resource-constrained Edge Devices
Qin, R., Liu, D., Xu, C., Yan, Z., Tan, Z., Jia, Z., Nassereldine, A., Li, J., Jiang, M., Abbasi, A., et al. (2025) · ACM Transactions on Design Automation of Electronic Systems · doi:10.1145/3736721 · Cited by 50
Karakurt, E., & Akbulut, A. (2025) · Applied Sciences · doi:10.3390/app16010368 · Cited by 45
Residual Prompt Tuning: improving prompt tuning with residual reparameterization
Razdaibiedina, A., Mao, Y., Khabsa, M., Lewis, M., Hou, R., Ba, J. L., & Almahairi, A. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.421 · Cited by 48
RadAdapt: Radiology Report Summarization via Lightweight Domain Adaptation of Large Language Models
Van Veen, D., Van Uden, C., Attias, M., Pareek, A., Bluethgen, C., Polacin, M., Chiu, W., Delbrouck, J.-B., Zambrano Chaves, J., Langlotz, C., et al. (2023) · The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks · doi:10.18653/v1/2023.bionlp-1.42 · Cited by 25
DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Generation
Zhang, H., & Song, D. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.223 · Cited by 31
CoEdIT: Text Editing by Task-Specific Instruction Tuning
Raheja, V., Kumar, D., Koo, R., & Kang, D. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.350 · Cited by 62
Sparsely Shared Lora on Whisper for Child Speech Recognition
Liu, W., Qin, Y. H., Peng, Z., & Lee, T. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447004 · Cited by 33
Chinese Spelling Correction as Rephrasing Language Model
Liu, L., Wu, H., & Zhao, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29829 · Cited by 30
Prompt Tuning of Deep Neural Networks for Speaker-Adaptive Visual Speech Recognition
Kim, M., Kim, H.-I., & Ro, Y. M. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3484658 · Cited by 35
Open-Ended Instructable Embodied Agents with Memory-Augmented Large Language Models
Sarch, G., Wu, Y., Tarr, M., & Fragkiadaki, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.226 · Cited by 25
A T5-based interpretable reading comprehension model with more accurate evidence training
Guan, B., Zhu, X., & Yuan, S. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103584 · Cited by 29
Unsupervised Domain Adaption Harnessing Vision-Language Pre-Training
Zhou, W., & Zhou, Z. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3391304 · Cited by 26
Razuvayevskaya, O., Wu, B., Leite, J. A., Heppell, F., Srba, I., Scarton, C., Bontcheva, K., & Song, X. (2024) · PLoS ONE · doi:10.1371/journal.pone.0301738 · Cited by 34
Kuerbanjiang, W., Peng, S., Jiamaliding, Y., & Yi, Y. (2024) · Journal of Medical Internet Research · doi:10.2196/63626 · Cited by 24
Parameter-efficient fine-tuning of large language models using semantic knowledge tuning
Prottasha, N. J., Mahmud, A., Sobuj, M. S. I., Bhat, P., Kowsher, M., Yousefi, N., & Garibay, Ö. Ö. (2024) · Scientific Reports · doi:10.1038/s41598-024-75599-4 · Cited by 32
Toward General Industrial Intelligence: A Survey of Large Models as a Service in Industrial IoT
Tang, J., Chen, J., He, J., Chen, F., Lv, Z., Han, G., Liu, Z., Yang, H. H., & Li, W. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2025.3578877 · Cited by 28
CUP: Curriculum Learning based Prompt Tuning for Implicit Event Argument Extraction
Lin, J., Chen, Q., Zhou, J., Jin, J., & He, L. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/589 · Cited by 26
CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation
Ke, P., Zhou, H., Lin, Y., Li, P., Zhou, J., Zhu, X., & Huang, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.164 · Cited by 36
An Empirical Analysis of Parameter-Efficient Methods for Debiasing Pre-Trained Language Models
Xie, Z., & Lukasiewicz, T. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.876 · Cited by 41
PSCVFinder: A Prompt-Tuning Based Framework for Smart Contract Vulnerability Detection
Yu, L., Lu, J., Liu, X., Li, Y., Zhang, F., & Ma, J. (2023) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre59848.2023.00030 · Cited by 29
Cross-Modal Alternating Learning With Task-Aware Representations for Continual Learning
Li, W., Gao, B.-B., Xia, B., Wang, J., Liu, J., Liu, Y., Wang, C., & Zheng, F. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3340551 · Cited by 26
Data-Centric Foundation Models in Computational Healthcare: A Survey
Zhang, Y., Gao, J. G., Tan, Z., Zhou, L., Ding, K., Zhou, M., Zhang, S., & Wang, D. (2026) · ACM Computing Surveys · doi:10.1145/3800677 · Cited by 65
Perada: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees
Xie, C., Huang, D.-A., Chu, W., Xu, D., Xiao, C., Li, B., & Anandkumar, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02250 · Cited by 33
ProS: Prompting-to-Simulate Generalized Knowledge for Universal Cross-Domain Retrieval
Fang, K., Song, J., Gao, L., Zeng, P., Cheng, Z.-Q., Li, X., & Shen, H. T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01637 · Cited by 26
AutoPEFT : Automatic Configuration Search for Parameter-Efficient Fine-Tuning
Zhou, H., Wan, X., Vulić, I., & Korhonen, A. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00662 · Cited by 60
UniDCP: Unifying Multiple Medical Vision-Language Tasks via Dynamic Cross-Modal Learnable Prompts
Zhan, C., Zhang, Y., Lin, Y., Wang, G., & Wang, H. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3397191 · Cited by 25
Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach
Dong, W., Zhang, X., Chen, B., Yan, D., Lin, Z., Yan, Q., Wang, P., & Yang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01524 · Cited by 31
Zheng, Y., Chang, C.-H., Huang, S.-H., Chen, P., & Picek, S. (2024) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2024.3477348 · Cited by 31
Wang, F., Shi, D., Aguilar, J., Cui, X., Jiang, J., Shen, L., & Li, M. (2025) · Knowledge and Information Systems · doi:10.1007/s10115-025-02399-1 · Cited by 23
Context-Aware Abbreviation Expansion Using Large Language Models
Cai, S., Venugopalan, S., Tomanek, K., Narayanan, A., Morris, M. R., & Brenner, M. P. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.91 · Cited by 26
Prompt Consistency for Multi-Label Textual Emotion Detection
Zhou, Y., Kang, X., & Ren, F. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3254883 · Cited by 23
Instance-Aware Prompt Learning for Language Understanding and Generation
Jin, F., Lu, J., Zhang, J., & Zong, C. (2023) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3604613 · Cited by 29
MixPAVE: Mix-Prompt Tuning for Few-shot Product Attribute Value Extraction
Yang, L., Wang, Q., Wang, J., Quan, X., Feng, F., Chen, Y., Khabsa, M., Wang, S., Xu, Z., & Liu, D. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.633 · Cited by 23
Consistent Prototype Learning for Few-Shot Continual Relation Extraction
Chen, X., Wu, H. X., & Shi, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.409 · Cited by 24
The Art of Prompting: Event Detection based on Type Specific Prompts
Wang, S., Yu, M., & Huang, L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.111 · Cited by 30
Learning Expressive Prompting With Residuals for Vision Transformers
Das, R., Dukler, Y., Ravichandran, A., & Swaminathan, A. D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00328 · Cited by 26
APoLLo : Unified Adapter and Prompt Learning for Vision Language Models
Chowdhury, S., Nag, S., & Manocha, D. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.629 · Cited by 31
Zheng, H., Wang, M., Wang, Z., & Huang, X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111547 · Cited by 24
ZEETAD: Adapting Pretrained Vision-Language Model for Zero-Shot End-to-End Temporal Action Detection
Phan, T., Vo-Ho, V.-K., Le, D., Doretto, G., Adjeroh, D., & Le, N. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00689 · Cited by 25
CitePrompt: Using Prompts to Identify Citation Intent in Scientific Papers
Lahiri, A., Sanyal, D. K., & Mukherjee, I. (2023) · 2023 ACM/IEEE Joint Conference on Digital Libraries (JCDL) · doi:10.1109/jcdl57899.2023.00017 · Cited by 24
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing
Qiu, L., Shaw, P. M., Pasupat, P., Shi, T., Herzig, J., Pitler, E., Sha, F., & Toutanova, K. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.624 · Cited by 41
TKDP: Threefold Knowledge-Enriched Deep Prompt Tuning for Few-Shot Named Entity Recognition
Liu, J., Fei, H., Li, F., Li, J., Li, B., Zhao, L., Teng, C., & Ji, D. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3389650 · Cited by 24
AgXQA: A benchmark for advanced Agricultural Extension question answering
Kpodo, J., Kordjamshidi, P., & Nejadhashemi, A. P. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109349 · Cited by 25
Requirements Satisfiability with In-Context Learning
Santos, S., Breaux, T. D., Norton, T. B., Haghighi, S., & Ghanavati, S. (2024) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re59067.2024.00025 · Cited by 27
Zhou, W., Huang, H., Zhang, H., & Wang, C. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3475371 · Cited by 22
Tian, Y., Han, Y., Chen, X., Wang, W. W., & Chawla, N. V. (2025) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3701551.3703577 · Cited by 63
Generative language reconstruction from brain recordings
Ye, Z., Ai, Q., Liu, Y., de Rijke, M., Zhang, M., Lioma, C., & Ruotsalo, T. (2025) · Communications Biology · doi:10.1038/s42003-025-07731-7 · Cited by 24
Mr. DETR: Instructive Multi-Route Training for Detection Transformers
Zhang, C.-B., Zhong, Y., & Han, K. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00928 · Cited by 31
A Unified SAM-Guided Self-Prompt Learning Framework for Infrared Small Target Detection
Fu, Y., Lyu, J., Ma, P., Liu, Z., & Ng, M. K. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3610919 · Cited by 25
Novelty Controlled Paraphrase Generation with Retrieval Augmented Conditional Prompt Tuning
Chowdhury, J. R., Zhuang, Y., & Wang, S. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21297 · Cited by 9
Multitask Pre-training of Modular Prompt for Chinese Few-Shot Learning
Sun, T., He, Z., Zhu, Q., Qiu, X., & Huang, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.625 · Cited by 27
Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual Generation
Vu, T., Barua, A., Lester, B., Cer, D. M., Iyyer, M., & Constant, N. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.630 · Cited by 37
Self-citationPSAN: Prompt Semantic Augmented Network for aspect-based sentiment analysis
He, Y., Huang, X., Zou, S., & Zhang, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121632 · Cited by 22
Chinese legal judgment prediction via knowledgeable prompt learning
Sun, J., Huang, S., & Wei, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122177 · Cited by 25
Extending Whisper with Prompt Tuning to Target-Speaker ASR
Ma, H., Peng, Z., Shao, M., Li, J., & Liu, J. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447492 · Cited by 26
Metadata
- Authors
- Lester, B., Al-Rfou, R., & Constant, N.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 3045-3059
- arXiv
- 2104.08691
- OpenAlex
- W3152956381
- Cited by
- 3,092
- References
- 49
- Citations by year
- 2026: 512 · 2025: 889 · 2024: 754 · 2023: 649 · 2022: 246 · 2021: 40
- FWCI
- 195.07
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- prompt tuning, soft prompts, parameter-efficient fine-tuning, frozen language models, few-shot learning, model size, prefix tuning, T5, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
