The DOI matches its DataCite record; 58 of the 58 references it cites were found in a registry or an index.
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Open accessAbstract
Large language models (LMs) are able to in-context learn -- perform a new task via inference alone by conditioning on a few input-label pairs (demonstrations) and making predictions for new inputs. However, there has been little understanding of how the model learns and which aspects of the demonstrations contribute to end task performance. In this paper, we show that ground truth demonstrations are in fact not required -- randomly replacing labels in the demonstrations barely hurts performance on a range of classification and multi-choce tasks, consistently over 12 different models including GPT-3. Instead, we find that other aspects of the demonstrations are the key drivers of end task performance, including the fact that they provide a few examples of (1) the label space, (2) the distribution of the input text, and (3) the overall format of the sequence. Together, our analysis provides a new way of understanding how and why in-context learning works, while opening up new questions about how much can be learned from large language models through inference alone.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Min et al. [44] has shown that rather than learning new tasks, in-context learning [42] works by activating patterns from the training data.”
From RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics (2024) · cites this paper as [44]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Self-citationExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Self-citationChain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
The PASCAL Recognising Textual Entailment Challenge
Dagan, I., Glickman, O., & Magnini, B. (2006) · Lecture notes in computer science · doi:10.1007/11736790_9 · Cited by 1,674
Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering
Mihaylov, T., Clark, P. E., Khot, T., & Sabharwal, A. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1260 · Cited by 1,602
Automatically Constructing a Corpus of Sentential Paraphrases.
Dolan, W. B., & Brockett, C. (2005) · Cited by 1,101
Flagged first, then by citations
Research works printed but not linked: 4
- Michael Chen, Mike D'Arcy, Alisa Liu, Jared Fer- nandez, and Doug Downey. 2019. CODAH: An adversarially-authored question answering dataset for common sense. In Proceedings of the 3rd Work- shop on Evaluating Vector Space Representations for NLP.
- Ido Dagan, Oren Glickman, and Bernardo Magnini. 2005. The pascal recognising textual entailment chal- lenge. In Machine Learning Challenges Workshop.
- Ioannis Mollas, Zoe Chrysopoulou, Stamatis Karlos, and Grigorios Tsoumakas. 2020. Ethos: an online hate speech detection dataset. ArXiv.
- Wei Wang, Vincent W Zheng, Han Yu, and Chunyan Miao. 2019b. A survey of zero-shot learning: Set- tings, methods, and applications. ACM Transactions on Intelligent Systems and Technology (TIST).
Cited by
Sorted by citations
Items 101–200 of 758
Meshkin, H., Zirkle, J., Arabidarrehdor, G., Chaturbedi, A., Chakravartula, S., Mann, J., Thrasher, B., & Li, Z. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae354 · Cited by 41
InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning
Gupta, P., Jiao, C., Yeh, Y.-T., Mehri, S., Eskénazi, M., & Bigham, J. P. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.33 · Cited by 75
Karpurapu, S., Myneni, S., Nettur, U., Gajja, L. S., Burke, D., Stiehm, T., & Payne, J. (2024) · IEEE Access · doi:10.1109/access.2024.3391815 · Cited by 49
Can Whisper Perform Speech-Based In-Context Learning?
Wang, S., Yang, C.-H. H., Wu, J. Y., & Zhang, C. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446502 · Cited by 50
Men, C., Han, Y., Wang, P., Tao, J., & Huang, C. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3550999 · Cited by 37
Active Learning Principles for In-Context Learning with Large Language Models
Margatina, K., Schick, T., Αλέτρας, Ν., & Dwivedi-Yu, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.334 · Cited by 72
PLACES: Prompting Language Models for Social Conversation Synthesis
Chen, M., Papangelis, A., Tao, C., Kim, S., Rosenbaum, A., Liu, Y., Zhou, Y., & Hakkani-Tür, D. Z. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.63 · Cited by 53
Lan, Y., Li, X., Liu, X., Li, Y., Qin, W., & Qian, W. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612389 · Cited by 36
Ye, A., Maiti, A., Schmidt, M. W., & Pedersen, S. (2024) · Future Internet · doi:10.3390/fi16050167 · Cited by 36
FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models
Zhang, J., Tang, L., Song, Y., Meng, Q., Qian, H., Shao, J., Song, W., Zhu, S., & Gu, J. J. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611663 · Cited by 32
Finding Support Examples for In-Context Learning
Li, X., & Qiu, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.411 · Cited by 81
On the Relation between Sensitivity and Accuracy in In-Context Learning
Chen, Y., Zhao, C., Zhou, Y., McKeown, K. R., & He, H. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.12 · Cited by 62
Mitigating Label Biases for In-context Learning
Fei, Y., Hou, Y., Chen, Z., & Bosselut, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.783 · Cited by 65
Chain of Thought with Explicit Evidence Reasoning for Few-shot Relation Extraction
Ma, X., Li, J., & Zhang, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.153 · Cited by 37
Elhenawy, M. M. Z., Abutahoun, A., Alhadidi, T. I., Jaber, A., Ashqar, H. I., Jaradat, S., Abdelhay, A., Glaser, S., & Rakotonirainy, A. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6030093 · Cited by 45
Prompting Frameworks for Large Language Models: A Survey
Liu, X., Wang, J., Yuan, X., Sun, J., Dong, G., Di, P., Wang, W., & Wang, D. (2026) · ACM Computing Surveys · doi:10.1145/3789253 · Cited by 86
Jiao, W., Huang, J.-T., Wang, W., He, Z., Liang, T., Wang, X., Shi, S., & Tu, Z. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1001 · Cited by 61
Symbol tuning improves in-context learning in language models
Wei, J., Hou, L., Lampinen, A. K., Chen, X., Huang, D. Y., Tay, Y., Chen, X., Lu, Y., Zhou, D., Ma, T., et al. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.61 · Cited by 80
Liu, Y., Checa, M., & Vasudevan, R. K. (2024) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ad52e9 · Cited by 38
Mitigating reasoning hallucination through Multi-agent Collaborative Filtering
Shi, J., Zhao, J., Wu, X., Xu, R., Jiang, Y.-H., & He, L. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125723 · Cited by 34
Nettur, S. B., Karpurapu, S., Nettur, U., & Gajja, L. S. (2024) · IEEE Access · doi:10.1109/access.2024.3521407 · Cited by 35
ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback
Ye, J., Gao, J., Wu, Z., Feng, J., Yu, C., & Kong, L. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.269 · Cited by 48
Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints
Lu, A., Zhang, H., Zhang, Y., Wang, X., & Yang, D. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.148 · Cited by 52
Gursesli, M. C., Taveekitworachai, P., Abdullah, F., Dewantoro, M. F., Lanatà, A., Guazzini, A., Lê, V. K., Villars, A., & Thawonmas, R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47658-7_16 · Cited by 29
A novel prompting method for few-shot NER via LLMs
Cheng, Q., Chen, L., Hu, Z., Tang, J., Xu, Q., & Ning, B. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100099 · Cited by 32
Intent‐Based Network Configuration Using Large Language Models
Tu, N. V., Nam, S., & Hong, J. W. (2024) · International Journal of Network Management · doi:10.1002/nem.2313 · Cited by 31
Elhilali, A., Ngo, A. S.-H., Reichenpfader, D., & Denecke, K. (2025) · JMIR Medical Education · doi:10.2196/81271 · Cited by 29
Say What You Mean! Large Language Models Speak Too Positively about Negative Commonsense Knowledge
Chen, J., Shi, W., Fu, Z., Cheng, S., Li, L., & Xiao, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.550 · Cited by 35
Guo, C., Tian, Z., Tang, J., Li, S., Wen, Z., Wang, K., & Wang, T. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-8076-5_25 · Cited by 32
GPT-FinRE: In-context Learning for Financial Relation Extraction using Large Language Models
Rajpoot, P. K., & Parikh, A. P. (2023) · Workshop on Financial Technology and Natural Language Processing (FinNLP) · doi:10.18653/v1/2023.finnlp-2.5 · Cited by 39
Tu, N. V., Yoo, J., & Hong, J. W. (2024) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms59830.2024.10575237 · Cited by 25
Zhu, S., Pan, L., & Xiong, D. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103825 · Cited by 28
What Makes Multimodal In-Context Learning Work?
Baldassini, F. B., Shukor, M., Cord, M., Soulier, L., & Piwowarski, B. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00161 · Cited by 35
Exploring Effective Factors for Improving Visual In-Context Learning
Sun, Y., Chen, Q., Wang, J., Wang, J., & Li, Z. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3554410 · Cited by 61
Zhou, Y., Ni, T., Lee, W., & Zhao, Q. (2025) · Transactions on Artificial Intelligence · doi:10.53941/tai.2025.100003 · Cited by 66
In-Context Learning for Text Classification with Many Labels
Milios, A., Reddy, S., & Bahdanau, D. (2023) · GenBench Workshop on Generalisation (Benchmarking) in NLP (GenBench) · doi:10.18653/v1/2023.genbench-1.14 · Cited by 33
Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
Ye, S., Hwang, H., Yang, S., Yun, H., Kim, Y., & Seo, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29909 · Cited by 59
Nanophotonic device design based on large language models: multilayer and metasurface examples
Kim, M., Park, H., & Shin, J. (2025) · Nanophotonics · doi:10.1515/nanoph-2024-0674 · Cited by 28
Toward General Industrial Intelligence: A Survey of Large Models as a Service in Industrial IoT
Tang, J., Chen, J., He, J., Chen, F., Lv, Z., Han, G., Liu, Z., Yang, H. H., & Li, W. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2025.3578877 · Cited by 28
ScatterShot: Interactive In-context Example Curation for Text Transformation
Wu, T., Shen, H., Weld, D. S., Heer, J., & Ribeiro, M. T. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584059 · Cited by 34
ChatGPT4PCG Competition: Character-like Level Generation for Science Birds
Taveekitworachai, P., Abdullah, F., Dewantoro, M. F., Thawonmas, R., Togelius, J., & Renz, J. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333206 · Cited by 27
MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning
Zhang, C., Lin, K., Yang, Z., Wang, J., Li, L., Lin, C.-C., Liu, Z., & Wang, L. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01295 · Cited by 24
Performance Analysis of Llama 2 Among Other LLMs
Huang, D., Hu, Z., & Wang, Z. (2024) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai59869.2024.00108 · Cited by 25
(2025) · doi:10.1007/s12525-025-00862-z · Cited by 23
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing
Qiu, L., Shaw, P. M., Pasupat, P., Shi, T., Herzig, J., Pitler, E., Sha, F., & Toutanova, K. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.624 · Cited by 41
FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repair
Fatima, S., Hemmati, H., & Briand, L. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3472476 · Cited by 35
In-BoXBART: Get Instructions into Biomedical Multi-Task Learning
Parmar, M., Mishra, S. R., Purohit, M., Luo, M., Mohammad, M., & Baral, C. R. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.10 · Cited by 38
Pre-Training to Learn in Context
Gu, Y., Dong, L., Wei, F., & Huang, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.267 · Cited by 51
ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval
Yu, Y., Zhuang, Y., Zhang, R., Yu, M., Shen, J., & Zhang, C. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.748 · Cited by 28
Boosting Your Context by Dual Similarity Checkup for In-Context Learning Medical Image Segmentation
Gao, J. Y., Lao, Q., Kang, Q., Liu, P., Du, C., Li, K., & Zhang, L. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3440311 · Cited by 22
Retrieval-style In-context Learning for Few-shot Hierarchical Text Classification
Chen, H., Zhao, Y. H., Chen, Z., Wang, M., Li, L., Zhang, M., & Zhang, M. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00697 · Cited by 23
Selecting Better Samples from Pre-trained LLMs: A Case Study on Question Generation
Yuan, X., Wang, T., Wang, Y.-H., Fine, E., Abdelghani, R., Sauzéon, H., & Oudeyer, P.-Y. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.820 · Cited by 21
Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning
Alves, D., Guerreiro, N., Alves, J., Pombal, J., Rei, R., de Souza, J. G. C., Colombo, P., & Martins, A. F. T. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.744 · Cited by 43
In-context Learning for Few-shot Multimodal Named Entity Recognition
Cai, C., Wang, Q., Liang, B., Qin, B., Yang, M., Wong, K., & Xu, R. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.196 · Cited by 24
Dr.ICL: Demonstration-Retrieved In-context Learning
Luo, M., Xu, X., Dai, Z., Pasupat, P., Kazemi, M., Baral, C. R., Imbrasaitė, V., & Zhao, V. Y. (2024) · Data Intelligence · doi:10.3724/2096-7004.di.2024.0012 · Cited by 86
LLM-Assisted Multi-Teacher Continual Learning for Visual Question Answering in Robotic Surgery
Chen, K., Du, Y., You, T., Islam, M., Guo, Z., Jin, Y., Chen, G., & Heng, P. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610603 · Cited by 21
Managing Linux servers with LLM-based AI agents: An empirical evaluation with GPT4
Cao, Q., Wang, F., Lindley, L. C., & Wang, Z. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100570 · Cited by 28
Do LLMs Really Adapt to Domains? An Ontology Learning Perspective
Mai, H. T., Chu, C. X., & Paulheim, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-77844-5_7 · Cited by 33
Understanding In-Context Learning via Supportive Pretraining Data
Han, X., Simig, D., Mihaylov, T., Tsvetkov, Y., Çelikyılmaz, A., & Wang, T. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.708 · Cited by 39
Prompting Language Models for Linguistic Structure
Blevins, T., Gonen, H., & Zettlemoyer, L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.367 · Cited by 36
Self-citationLi, O., Subramanian, M., Saakyan, A., CH-Wang, S., & Muresan, S. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.974 · Cited by 26
LLM-controller: Dynamic robot control adaptation using large language models
Zahedifar, R., Baghshah, M. S., & Taheri, A. (2025) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2024.104913 · Cited by 23
Selective Demonstrations for Cross-domain Text-to-SQL
Chang, S., & Fosler‐Lussier, E. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.944 · Cited by 30
CAR: Conceptualization-Augmented Reasoner for Zero-Shot Commonsense Question Answering
Wang, W., Fang, T., Ding, W., Xu, B., Liu, X., Song, Y., & Bosselut, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.902 · Cited by 25
Tang, Y., Puduppully, R., Liu, Z., & Chen, N. F. (2023) · Workshop on New Frontiers in Summarization (NewSum) · doi:10.18653/v1/2023.newsum-1.6 · Cited by 21
Prompting Strategies for Citation Classification
Kunnath, S. N., Pride, D., & Knoth, P. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3615018 · Cited by 19
Software Vulnerability Detection with GPT and In-Context Learning
Liu, Z., Liao, Q., Gu, W., & Gao, C. (2023) · IEEE International Conference on Data Science in Cyberspace · doi:10.1109/dsc59305.2023.00041 · Cited by 22
The Life Cycle of Knowledge in Big Language Models: A Survey
Cao, B., Lin, H., Han, X., & Sun, L. (2024) · Machine Intelligence Research · doi:10.1007/s11633-023-1416-x · Cited by 18
Integration of cognitive tasks into artificial general intelligence test for large models
Qu, Y., Wei, C., Du, P., Che, W., Zhang, C., Ouyang, W., Bian, Y., Xu, F., Hu, B., Du, K., et al. (2024) · iScience · doi:10.1016/j.isci.2024.109550 · Cited by 20
Ceron, T., Falk, N., Barić, A., Nikolaev, D., & Padó, S. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00710 · Cited by 23
An Interactive Agent Foundation Model
Durante, Z., Gong, R., Sarkar, B., Wake, N., Taori, R., Tang, P. C., Lakshmikanth, S. K., Schulman, K. A., Milstein, A. S., Vo, H., et al. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00350 · Cited by 28
Mohamed, A., Rashid, M. E., & Shaalan, K. F. (2025) · IEEE Access · doi:10.1109/access.2025.3575303 · Cited by 20
Cheng, Y., Bajaber, O., Tsegai, S. A., Song, D. X., & Gao, P. (2025) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp63326.2025.00057 · Cited by 45
Compromising LLM Driven Embodied Agents With Contextual Backdoor Attacks
Liu, A., Zhou, Y., Liu, X., Zhang, T., Liang, S., Wang, J., Pu, Y., Li, T., Zhang, J., Zhou, W., et al. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3555410 · Cited by 28
Prompting Large Language Models for Malicious Webpage Detection
Li, L., & Gong, B. (2023) · IEEE International Conference on Pattern Recognition and Machine Learning (PRML) · doi:10.1109/prml59573.2023.10348229 · Cited by 19
Beyond Text: Frozen Large Language Models in Visual Signal Comprehension
Zhu, L., Wei, F., & Lu, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02554 · Cited by 24
Knowledge Graph-Based In-Context Learning for Advanced Fault Diagnosis in Sensor Networks
Xie, X., Wang, J., Han, Y., & Li, W. (2024) · Sensors · doi:10.3390/s24248086 · Cited by 18
Chen, Z., Hao, J., Sun, H., Zhao, L., Li, J., Qian, Q., Peng, Q., Wang, X., Cong, S., Shen, L., et al. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104278 · Cited by 17
Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations
Lyu, X., Min, S., Beltagy, I., Zettlemoyer, L., & Hajishirzi, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.129 · Cited by 53
Self-citationAdapt in Contexts: Retrieval-Augmented Domain Adaptation via In-Context Learning
Long, Q., Wang, W., & Pan, S. J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.402 · Cited by 25
Potential merits and flaws of large language models in epilepsy care: A critical review
Diessen, E. G. A. L. V., van Amerongen, R. A., Zijlmans, M., & Otte, W. M. (2024) · Epilepsia · doi:10.1111/epi.17907 · Cited by 23
Designing a Proactive Context-Aware AI Chatbot for People's Long-Term Goals
Jones, B., Xu, Y., Li, Q., & Scherer, S. J. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650912 · Cited by 25
Distilling mathematical reasoning capabilities into Small Language Models
Zhu, X., Li, J., Liu, Y., Ma, C., & Wang, W. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106594 · Cited by 29
Improving Web Element Localization by Using a Large Language Model
Nass, M., Alégroth, E., & FELDT, R. H. (2024) · Software Testing Verification and Reliability · doi:10.1002/stvr.1893 · Cited by 25
Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinement
Xi, Z., Jin, S., Zhou, Y., Zheng, R., Gao, S., Liu, J., Gui, T., Zhang, Q., & Huang, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.762 · Cited by 40
Multi-Dimensional Evaluation of Text Summarization with In-Context Learning
Jain, S., Keshava, V., Mysore Sathyendra, S., Fernandes, P., Liu, P., Neubig, G., & Zhou, C. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.537 · Cited by 15
Learning-based models for vulnerability detection: an extensive study
Ni, C., Yin, X., Shen, L., & Wang, S.-H. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10734-x · Cited by 34
Scaling medical AI across clinical contexts
Li, M. M., Reis, B. Y., Rodman, A. M., Cai, T., Dagan, N., Balicer, R. D., Loscalzo, J., Kohane, I. S., & Žitnik, M. (2026) · Nature Medicine · doi:10.1038/s41591-025-04184-7 · Cited by 24
Diverse Retrieval-Augmented In-Context Learning for Dialogue State Tracking
King, B., & Flanigan, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.344 · Cited by 22
Data Curation Alone Can Stabilize In-context Learning
Chang, T.-Y., & Jia, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.452 · Cited by 37
Distilling Script Knowledge from Large Language Models for Constrained Language Planning
Yuan, S., Chen, J., Fu, Z., Ge, X., Shah, S., Jankowski, C., Xiao, Y., & Yang, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.236 · Cited by 37
FreeAL: Towards Human-Free Active Learning in the Era of Large Language Models
Xiao, R., Dong, Y., Zhao, J., Wu, R., Lin, M., Chen, G., & Wang, H. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.896 · Cited by 36
Qu, Y., Huang, S., Li, Y., Bai, T., Chen, X., Wang, X., Li, L., & Yao, Y. (2025) · Automated Software Engineering · doi:10.1007/s10515-024-00485-2 · Cited by 19
PQCache: Product Quantization-based KVCache for Long Context LLM Inference
Zhang, H., Ji, X., Chen, Y., Fu, F., Miao, X., Nie, X., Chen, W., & Cui, B. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3725338 · Cited by 81
MCC-KD: Multi-CoT Consistent Knowledge Distillation
Chen, H., Wu, S., Quan, X., Wang, R., Yan, M., & Zhang, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.454 · Cited by 36
In-Context Learning for Few-Shot Nested Named Entity Recognition
Zhang, M., Wang, B., Fei, H., & Zhang, M. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446653 · Cited by 19
ContextMate: a context-aware smart agent for efficient data analysis
Jadoon, A. K., Yu, C., & Shi, Y.-C. (2024) · CCF Transactions on Pervasive Computing and Interaction · doi:10.1007/s42486-023-00144-7 · Cited by 15
Adam, U. A., Ayanwale, M. A., Lameed, S. N., Owolabi, T., Onowugbeda, F. U., Oladejo, A. I., Okebukola, P. A., Ogolo, K. G., & Adebowale, M. A. (2025) · The Journal of Educational Research · doi:10.1080/00220671.2024.2446898 · Cited by 14
CoLE: A collaborative legal expert prompting framework for large language models in law
Li, B., Fan, S., Zhu, S., & Wen, L. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113052 · Cited by 15
Large Language Models as Configuration Validators
Lian, X., Chen, Y., Cheng, R., Huang, J., Thakkar, P., Zhang, M., & Xu, T. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00017 · Cited by 41
Metadata
- Authors
- Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., & Zettlemoyer, L.
- Affiliations
- University of Washington (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Pages
- 11048-11064
- arXiv
- 2202.12837
- OpenAlex
- W4385567149
- Cited by
- 752
- References
- 57
- Citations by year
- 2026: 135 · 2025: 227 · 2024: 179 · 2023: 191 · 2022: 20
- FWCI
- 85.30
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (2044660)
- Office of Naval Research (N00014-18, N00014-18-1-2826, ONR-N00014, N00014)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- in-context learning, demonstrations, large language models, label noise, input distribution, label space, GPT-3, classification tasks, multiple-choice tasks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review