The DOI matches its DataCite record; 58 of the 58 references it cites were found in a registry or an index.
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Open accessAbstract
Large language models (LMs) are able to in-context learn -- perform a new task via inference alone by conditioning on a few input-label pairs (demonstrations) and making predictions for new inputs. However, there has been little understanding of how the model learns and which aspects of the demonstrations contribute to end task performance. In this paper, we show that ground truth demonstrations are in fact not required -- randomly replacing labels in the demonstrations barely hurts performance on a range of classification and multi-choce tasks, consistently over 12 different models including GPT-3. Instead, we find that other aspects of the demonstrations are the key drivers of end task performance, including the fact that they provide a few examples of (1) the label space, (2) the distribution of the input text, and (3) the overall format of the sequence. Together, our analysis provides a new way of understanding how and why in-context learning works, while opening up new questions about how much can be learned from large language models through inference alone.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Min et al. [44] has shown that rather than learning new tasks, in-context learning [42] works by activating patterns from the training data.”
From RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics (2024) · cites this paper as [44]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Self-citationExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Self-citationChain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
The PASCAL Recognising Textual Entailment Challenge
Dagan, I., Glickman, O., & Magnini, B. (2006) · Lecture notes in computer science · doi:10.1007/11736790_9 · Cited by 1,674
Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering
Mihaylov, T., Clark, P. E., Khot, T., & Sabharwal, A. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1260 · Cited by 1,602
Automatically Constructing a Corpus of Sentential Paraphrases.
Dolan, W. B., & Brockett, C. (2005) · Cited by 1,101
Research works printed but not linked: 4
- Michael Chen, Mike D'Arcy, Alisa Liu, Jared Fer- nandez, and Doug Downey. 2019. CODAH: An adversarially-authored question answering dataset for common sense. In Proceedings of the 3rd Work- shop on Evaluating Vector Space Representations for NLP.
- Ido Dagan, Oren Glickman, and Bernardo Magnini. 2005. The pascal recognising textual entailment chal- lenge. In Machine Learning Challenges Workshop.
- Ioannis Mollas, Zoe Chrysopoulou, Stamatis Karlos, and Grigorios Tsoumakas. 2020. Ethos: an online hate speech detection dataset. ArXiv.
- Wei Wang, Vincent W Zheng, Han Yu, and Chunyan Miao. 2019b. A survey of zero-shot learning: Set- tings, methods, and applications. ACM Transactions on Intelligent Systems and Technology (TIST).
Cited by
Sorted by citations
Items 301–400 of 758
ZS4C: Zero-Shot Synthesis of Compilable Code for Incomplete Code Snippets Using LLMs
Kabir, A., Wang, S., Tian, Y., Chen, T.-H. P., Asaduzzaman, M., & Zhang, W. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3702979 · Cited by 13
Cheung, L. H., & Marco, G. D. (2024) · Nexus Network Journal · doi:10.1007/s00004-024-00805-9 · Cited by 7
Dynamics as Prompts: In-Context Learning for Sim-to-Real System Identifications
Zhang, X., Liu, S., Huang, P., Han, W. J., Lyu, Y., Xu, M., & Zhao, D. X. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3540391 · Cited by 7
Leveraging Large Language Models for Wireless Symbol Detection via In-Context Learning
Abbas, M., Kar, K., & Chen, T. (2024) · Globecom · doi:10.1109/globecom52923.2024.10901317 · Cited by 13
Chain-of-Thought Prompting for Speech Translation
Hu, K., Chen, Z., Yang, C.-H. H., Żelasko, P., Hrinchuk, O., Lavrukhin, V., Balam, J., & Ginsburg, B. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890560 · Cited by 20
Wang, L., Yurechko, K., Dani, P., Chen, Q. Z., & Zhang, A. X. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713691 · Cited by 15
SMUTF: Schema Matching Using Generative Tags and Hybrid Features
Zhang, Y., Mei, D., Luo, H., Xu, C., & Tsai, R. T. (2025) · Information Systems · doi:10.1016/j.is.2025.102570 · Cited by 14
LLaFS++: Few-Shot Image Segmentation With Large Language Models
Zhu, L., Chen, T., Ji, D., Xu, P., Ye, J., & Liu, J. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3573609 · Cited by 9
Jin, S., Fu, Z., Song, G., Pei, J., Gong, H., Ma, L., & Zhang, D. (2025) · Corrosion Science · doi:10.1016/j.corsci.2025.113217 · Cited by 8
TickIt: Leveraging Large Language Models for Automated Ticket Escalation
Liu, F., He, X., Zhang, T., Chen, J., Li, Y., Yi, L.-H., Zhang, H., Wu, G., & Shi, R. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3728558 · Cited by 16
Dual-model synergy for audit opinion prediction: A collaborative LLM agent framework approach
Lu, L. Y., Hao, J.-X., & Tang, X. (2025) · International Review of Economics & Finance · doi:10.1016/j.iref.2025.104642 · Cited by 14
Retrieval-Augmented Generation-Based Relation Extraction
Efeoğlu, Ş., & Paschke, A. (2025) · Semantic Web · doi:10.1177/22104968251385519 · Cited by 26
Large language model performance versus human expert ratings in automated suicide risk assessment
Thomas, J., Elyoseph, Z., Kuchinke, L., & Meinlschmidt, G. (2025) · Scientific Reports · doi:10.1038/s41598-025-22402-7 · Cited by 9
Transductive Learning for Textual Few-Shot Classification in API-based Embedding Models
Colombo, P., Pellegrain, V., Boudiaf, M., Tami, M., Storchan, V., Ayed, I. B., & Piantanida, P. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.257 · Cited by 9
Theme-Driven Keyphrase Extraction to Analyze Social Media Discourse
Romano, W., Sharif, O., Basak, M., Gatto, J., & Preum, S. M. (2024) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v18i1.31391 · Cited by 7
Huber-Fliflet, N., Zhang, J., Gronvall, P., Wei, F., & Spinelli, P. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10826061 · Cited by 9
Valuing Training Data via Causal Inference for In-Context Learning
Zhou, X., Ye, W., Lee, Z., Zou, L., & Zhang, S. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3546761 · Cited by 7
One Size Doesn’t Fit All: Predicting the Number of Examples for In-Context Learning
Chandra, M., Ganguly, D., & Ounis, I. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88708-6_5 · Cited by 12
Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Models
Chen, A. S., Lessing, A. M., Tang, A., Chada, G., Smith, L. M., Levine, S., & Finn, C. (2024) · IEEE International Conference on Robotics and Automation · doi:10.1109/icra55743.2025.11127234 · Cited by 25
Universal Self-Adaptive Prompting
Wan, X., Sun, R., Nakhost, H., Dai, H., Eisenschlos, J. M., Arık, S. Ö., & Pfister, T. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.461 · Cited by 21
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning
Lu, X., Brahman, F., West, P., Jung, J., Chandu, K. R., Ravichander, A., Ammanabrolu, P., Jiang, L., Ramnath, S., Dziri, N., et al. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.424 · Cited by 30
Towards Informative Few-Shot Prompt with Maximum Information Gain for In-Context Learning
Liu, H., & Wang, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1060 · Cited by 10
SINC: Self-Supervised In-Context Learning for Vision-Language Tasks
Chen, Y.-S., Song, Y.-Z., Yeo, C. Y., Liu, B., Fu, J., & Shuai, H.-H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01415 · Cited by 7
Dialogue for Prompting: A Policy-Gradient-Based Discrete Prompt Generation for Few-Shot Learning
Li, C., Liu, X., Wang, Y., Li, D., Lan, Y., & Shen, C. Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29809 · Cited by 14
Learning the Power of “No”: Foundation Models with Negations
Singh, J., Shrivastava, I., Mayank Vatsa, A., Singh, R., & Bharati, A. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00777 · Cited by 6
Mimic In-Context Learning for Multimodal Tasks
Jiang, Y.-C., Fu, J., Hao, C.-D., Hu, X., Peng, Y., Geng, X., & Yang, X. (2025) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.02776 · Cited by 21
Zhang, W., Chen, Y., Liu, X., & Zhang, H. (2025) · Land Use Policy · doi:10.1016/j.landusepol.2025.107807 · Cited by 7
An Automotive Fault Diagnosis Framework Based on Knowledge Graphs and Large Language Models
Lin, W., & Miao, K. (2025) · Electronics · doi:10.3390/electronics14214180 · Cited by 8
Ishida, K., Murakami, R., Yamanoi, K., Hamada, K., Hasebe, K., Sakurai, A., Miyamoto, T., Mizuno, R., Taki, M., Yamaguchi, K., et al. (2025) · npj Precision Oncology · doi:10.1038/s41698-025-01157-4 · Cited by 6
Empowering Conversational Agents using Semantic In-Context Learning
Omidvar, A., & An, A. (2023) · Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/2023.bea-1.62 · Cited by 6
IDAS: Intent Discovery with Abstractive Summarization
Raedt, M. D., Godin, F., Demeester, T., & Develder, C. (2023) · Workshop on NLP for Conversational AI (NLP4ConvAI) · doi:10.18653/v1/2023.nlp4convai-1.7 · Cited by 21
Zhao, Y., Zhang, Y., Sui, D., Cao, L., Zhao, J., & Liu, K. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.331 · Cited by 13
Large Language Models Meet Open-World Intent Discovery and Recognition: An Evaluation of ChatGPT
Song, X., He, K., Wang, P., Dong, G., Mou, Y., Wang, J., Xian, Y., Cai, X., & Xu, W. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.636 · Cited by 11
MotionGPT: Human Motion Synthesis with Improved Diversity and Realism via GPT-3 Prompting
Ribeiro-Gomes, J., Cai, T., Milacski, Z. Á., Wu, C. H., Prakash, A., Takagi, S., Aubel, A., Kim, D., Bernardino, A. J. M., & la Torre, F. D. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00499 · Cited by 12
Holmes ⌕ A Benchmark to Assess the Linguistic Competence of Language Models
Waldis, A., Waldis, A., Perlitz, Y., Choshen, L., Choshen, L., Hou, Y., & Gurevych, I. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00718 · Cited by 23
Dong, Z., Hu, L., Chen, J., Wang, Z., & Wu, F. Q. (2025) · ACM Transactions on Information Systems · doi:10.1145/3716499 · Cited by 11
M2R-Whisper: Multi-stage and Multi-scale Retrieval Augmentation for Enhancing Whisper
Zhou, J., Zhao, S., He, J., Wang, H., Zeng, W., Chen, Y., Sun, H., Kong, A., & Qin, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888086 · Cited by 6
Beyond Positive Scaling: How Negation Impacts Scaling Trends of Language Models
Zhang, Y., Yasunaga, M., Zhou, Z., HaoChen, J. Z., Zou, J., Liang, P., & Yeung, S. Y. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.472 · Cited by 17
EvEntS ReaLM: Event Reasoning of Entity States via Language Models
Spiliopoulou, E., Pagnoni, A., Bisk, Y., & Hovy, E. H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.129 · Cited by 9
WinoDict: Probing language models for in-context word acquisition
Eisenschlos, J. M., Cole, J. R., Liu, F., & Cohen, W. W. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.7 · Cited by 6
Investigating the Learning Behaviour of In-Context Learning: A Comparison with Supervised Learning
Wang, X., Wang, Y., Xu, C., Geng, X., Zhang, B., Tao, C., Rudzicz, F., Mercer, R. E., & Jiang, D. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230559 · Cited by 15
Li, S., Zhou, G., Li, Z., Lu, J., & Huang, N. (2023) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs60937.2023.00032 · Cited by 7
Kodali, R. K., Upreti, Y. P., & Boppana, L. (2024) · International Conference on Robotics, Engineering, Science, and Technology (RESTCON) · doi:10.1109/restcon60981.2024.10463557 · Cited by 6
ReCorD: Reasoning and Correcting Diffusion for HOI Generation
Jiang-Lin, J.-Y., Huang, K.-Y., Lo, L., Huang, Y.-N., Lin, T., Wu, J.-C., Shuai, H.-H., & Cheng, W.-H. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680936 · Cited by 6
Systematic Human Learning and Generalization From a Brief Tutorial With Explanatory Feedback
Nam, A., & McClelland, J. L. (2024) · Open Mind · doi:10.1162/opmi_a_00123 · Cited by 12
Complex QA and language models hybrid architectures, SurveyPreprint
Daull, X., Bellot, P., Bruno, E., Martin, V., & Murisasco, É. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.09051 · Cited by 32
Grimoire is All You Need for Enhancing Large Language ModelsPreprint
Chen, D., Song, S., Yu, Q., Li, Z., Wang, W., Xiong, F., & Tang, B. (2024) · Research Square · doi:10.21203/rs.3.rs-3845612/v1 · Cited by 13
Long-Term Memory for Large Language Models Through Topic-Based Vector Database
Zhang, Y., Yu, Z., Jiang, W., Shen, Y., & Li, J. (2023) · 2023 International Conference on Asian Language Processing (IALP) · doi:10.1109/ialp61005.2023.10337079 · Cited by 6
Liu, W., Huang, Z., Wang, C., Peng, Y., & Xie, S. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111411 · Cited by 5
LLM-powered Zero-shot Online Log Parsing
Zhi, C., Cheng, L., Liu, M., Zhao, X., Xu, Y., & Deng, S. (2024) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws62655.2024.00106 · Cited by 6
LogGenius: An Unsupervised Log Parsing Framework with Zero-shot Prompt Engineering
Yu, X., Nong, S., He, D., Zheng, W., Ma, T., Liu, N., Li, J., & Xie, G. (2024) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws62655.2024.00159 · Cited by 8
Muroň, M., Dařena, F., Procházka, D., & Kern, R. (2025) · Spatial Cognition and Computation · doi:10.1080/13875868.2025.2449859 · Cited by 5
On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook
Fan, M., Wang, C., Chen, C., Liu, Y., & Huang, J. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02375-w · Cited by 40
How Effectively Do LLMs Extract Feature-Sentiment Pairs from App Reviews?
Shah, F. A., Sabir, A., Sharma, R., & Pfahl, D. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88531-0_9 · Cited by 17
Shopfloor layout generation method based on large language models
Hu, Y., Sun, Y., Wen, X., Wang, S., & Bao, J. (2025) · International Journal of Computer Integrated Manufacturing · doi:10.1080/0951192x.2025.2482258 · Cited by 8
WebGLM: Towards an Efficient and Reliable Web-Enhanced Question-Answering System
Lai, H., Liu, X., Yu, H., Xu, Y., Iong, I. L., Yao, S., Zeng, A., Du, Z., Dong, Y., & Tang, J. (2025) · ACM Transactions on Information Systems · doi:10.1145/3729421 · Cited by 7
The Strong Pull of Prior Knowledge in Large Language Models and Its Impact on Emotion Recognition
Chochlakis, G., Potamianos, A., Lerman, K., & Narayanan, S. S. (2024) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii63134.2024.00041 · Cited by 11
Voskoboinik, E., von Zansen, A., Phan, N., Getman, Y., Grósz, T., & Kurimo, M. (2025) · Language Testing · doi:10.1177/02655322251351648 · Cited by 8
Cross Encoding as Augmentation: Towards Effective Educational Text Classification
Lee, H. S., Choi, S. L., Lee, Y., Moon, H., Oh, S., Jeong, M., Go, H., & Wallraven, C. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.137 · Cited by 6
Robust NL-to-Cypher Translation for KBQA: Harnessing Large Language Model with Chain of Prompts
Feng, G., Zhu, G., Shi, S., Sun, Y., Fan, Z., Gao, S., & Hu, J. F. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-7224-1_25 · Cited by 7
Analyzing Audience Comments: Improving Interactive Narrative with ChatGPT
Li, X., You, X., Chen, S., Taveekitworachai, P., & Thawonmas, R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47658-7_20 · Cited by 5
Weber, L., Bruni, E., & Hupkes, D. (2023) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2023.conll-1.20 · Cited by 25
PromptSet: A Programmer's Prompting Dataset
Pister, K. S., Paul, D. J., Joshi, I., & Brophy, P. (2024) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1145/3643795.3648395 · Cited by 12
Hint-Enhanced In-Context Learning Wakes Large Language Models Up For Knowledge-Intensive Tasks
Wang, Y., Guo, Q., Ni, X., Shi, C., Liu, L., Jiang, H., & Yang, Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447527 · Cited by 9
Overview of the PromptCBLUE Shared Task in CHIP2023
Zhu, W., Wang, X., Chen, M., & Tang, B. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-1717-0_1 · Cited by 7
Bounoua, M., Franzese, G., & Pietro Michiardi, A. (2024) · Entropy · doi:10.3390/e26040320 · Cited by 12
From Passive to Active: Towards Conversational In-Vehicle Navigation Through Large Language Models
Du, H., Tao, S., Feng, X., Ma, J., & Wang, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-61353-1_11 · Cited by 5
DPO: Discrete Prompt Optimization for Vision-Language Models
Liang, N., & Liu, Y. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3528362 · Cited by 6
Robustness of Learning from Task Instructions
Gu, J., Zhao, H., Xu, H., Nie, L., Mei, H., & Yin, W. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.875 · Cited by 21
Pre-Finetuning for Few-Shot Emotional Speech Recognition
Chen, M., & Zhou, Y. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-136 · Cited by 7
Characterizing Information Seeking Events in Health-Related Social Discourse
Sharif, O., Basak, M., Parvin, T., Scharfstein, A., Bradham, A., Borodovsky, J. T., Lord, S., & Preum, S. M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i20.30241 · Cited by 7
Scalable Interactive Machine Learning for Future Command and Control
Madison, A., Novoseller, E., Goecks, V. G., Files, B. T., Waytowich, N. R., Yu, A., Lawhern, V. J., Thurman, S. M., Kelshaw, C., & McDowell, K. (2024) · International Conference on Military Communications and Information Systems (ICMCIS) · doi:10.1109/icmcis61231.2024.10540933 · Cited by 8
Huang, Q. Y., Luo, Z., Xing, Z., Zeng, J., Chen, J., Xu, X., & Chen, Y. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3672458 · Cited by 6
Cheung, L. H., Lombardi, D., & Marco, G. D. (2025) · Architectural Science Review · doi:10.1080/00038628.2025.2586655 · Cited by 6
Context Is King: Large Language Models’ Interpretability in Divergent Knowledge Scenarios
Piñeiro-Martín, A., Santos-Criado, F.-J., García-Mateo, C., Docío-Fernández, L., & López-Pérez, M. D. C. (2025) · Applied Sciences · doi:10.3390/app15031192 · Cited by 4
Assessing large language model performance related to aging in genetic conditions
Othman, A. A., Flaharty, K. A., Hanchard, S. E. L., Hu, P., Duong, D., Waikel, R. L., & Solomon, B. D. (2025) · npj Aging · doi:10.1038/s41514-025-00226-z · Cited by 4
AutoMathKG: The Automated Mathematical Knowledge Graph Based on LLM and Vector Database
Bian, R., Geng, Y., Yang, Z., & Cheng, B. (2025) · Computational Intelligence · doi:10.1111/coin.70096 · Cited by 7
Structural chain of thoughts for radiology education
Awasthi, A., Chung, B., Vu, A. M., Khan, S. B., Le, N., Deng, Z., Agrawal, R., Wu, C. C., & Nguyen, H. V. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114433 · Cited by 4
Generating Failure-Based Oracles to Support Testing of Reported Bugs in Android Apps
Johnson, J., Mahmud, J., Chaparro, O., Moran, K., & Fazzini, M. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00182 · Cited by 3
Pneg: Prompt-based Negative Response Generation for Dialogue Response Selection Task
Lee, N., Park, C., Choi, H.-J., & Choo, J. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.733 · Cited by 4
Generative Calibration for In-context Learning
Jiang, Z., Zhang, Y., Cao, L., Zhao, J., & Liu, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.152 · Cited by 14
ALCUNA: Large Language Models Meet New Knowledge
Yin, X., Huang, B., & Wan, X. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.87 · Cited by 27
Ye, S., Jang, J., Kim, D., Jo, Y., & Seo, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.822 · Cited by 10
Toward Unified Controllable Text Generation via Regular Expression Instruction
Zheng, X. W., Lin, H., Han, X., & Sun, L. (2023) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2023.ijcnlp-main.1 · Cited by 11
LFDe: A Lighter, Faster and More Data-Efficient Pre-training Framework for Event Extraction
Kan, Z., Peng, L., Gao, Y., Liu, N., Qiao, L., & Li, D. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645318 · Cited by 5
Shahriar, T., & Matsuda, N. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-64299-9_2 · Cited by 4
Li, B., Liu, T., Ma, J., Dai, J., & Liao, P. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111074 · Cited by 4
Chochlakis, G., Pandiyan, N. M., Lerman, K., & Narayanan, S. S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887804 · Cited by 15
AllHands :Ask Me Anything on Large-scale Verbatim Feedback via Large Language Models
Zhang, C., Ma, Z., Wu, Y., He, S., Qin, S., Ma, M., Qin, X., Kang, Y., Liang, Y., Gou, X., et al. (2025) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65448.2025.00011 · Cited by 6
In-Context Learning Enables Robot Action Prediction in LLMs
Yin, Y., Wang, Z., Sharma, Y., Niu, D., Darrell, T., & Herzig, R. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128807 · Cited by 32
Braga, V. (2023) · Journal of Engineering Science · doi:10.52326/jes.utm.2023.30(3).07 · Cited by 3
In-Context Demonstration Selection with Cross Entropy Difference
Iter, D., Pryzant, R., Xu, R., Wang, S., Liu, Y., Yi‐chong, X., & Zhu, C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.81 · Cited by 13
Exploring In-Context Learning for Knowledge Grounded Dialog Generation
Chen, Q., Wu, W., & Li, S. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.675 · Cited by 4
Osada, M., Ricardez, G. A. G., Suzuki, Y., & Taniguchi, T. (2024) · Advanced Robotics · doi:10.1080/01691864.2024.2393408 · Cited by 5
Faithful Self-Refinement in Mathematical Reasoning via Progressive Back-Translation
Liao, H., Zhu, Z., Hu, S., He, H., & Jin, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890054 · Cited by 3
Redefining text-to-SQL metrics by incorporating semantic and structural similarity
Pinna, G., Perezhohin, Y., Manzoni, L., Castelli, M., & Lorenzo, A. D. (2025) · Scientific Reports · doi:10.1038/s41598-025-04890-9 · Cited by 9
Movin, M., & Hauff, C. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730119 · Cited by 3
Li, Q., Lin, J., Wang, C., Xiao, S., Jiang, X., & Hu, Z. (2025) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2025.104460 · Cited by 4
GreenFoodLens: Sustainability Labels for Food Recommendation
Balloccu, G., Boratto, L., Fenu, G., Marras, M., Medda, G., & Murgia, G. (2025) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3705328.3748165 · Cited by 3
Metadata
- Authors
- Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., & Zettlemoyer, L.
- Affiliations
- University of Washington (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Pages
- 11048-11064
- arXiv
- 2202.12837
- OpenAlex
- W4385567149
- Cited by
- 752
- References
- 57
- Citations by year
- 2026: 135 · 2025: 227 · 2024: 179 · 2023: 191 · 2022: 20
- FWCI
- 85.30
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (2044660)
- Office of Naval Research (N00014-18, N00014-18-1-2826, ONR-N00014, N00014)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- in-context learning, demonstrations, large language models, label noise, input distribution, label space, GPT-3, classification tasks, multiple-choice tasks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review