The DOI matches its DataCite record; 58 of the 58 references it cites were found in a registry or an index.
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Open accessAbstract
Large language models (LMs) are able to in-context learn -- perform a new task via inference alone by conditioning on a few input-label pairs (demonstrations) and making predictions for new inputs. However, there has been little understanding of how the model learns and which aspects of the demonstrations contribute to end task performance. In this paper, we show that ground truth demonstrations are in fact not required -- randomly replacing labels in the demonstrations barely hurts performance on a range of classification and multi-choce tasks, consistently over 12 different models including GPT-3. Instead, we find that other aspects of the demonstrations are the key drivers of end task performance, including the fact that they provide a few examples of (1) the label space, (2) the distribution of the input text, and (3) the overall format of the sequence. Together, our analysis provides a new way of understanding how and why in-context learning works, while opening up new questions about how much can be learned from large language models through inference alone.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Min et al. [44] has shown that rather than learning new tasks, in-context learning [42] works by activating patterns from the training data.”
From RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics (2024) · cites this paper as [44]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Self-citationExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Self-citationChain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
The PASCAL Recognising Textual Entailment Challenge
Dagan, I., Glickman, O., & Magnini, B. (2006) · Lecture notes in computer science · doi:10.1007/11736790_9 · Cited by 1,674
Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering
Mihaylov, T., Clark, P. E., Khot, T., & Sabharwal, A. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1260 · Cited by 1,602
Automatically Constructing a Corpus of Sentential Paraphrases.
Dolan, W. B., & Brockett, C. (2005) · Cited by 1,101
Research works printed but not linked: 4
- Michael Chen, Mike D'Arcy, Alisa Liu, Jared Fer- nandez, and Doug Downey. 2019. CODAH: An adversarially-authored question answering dataset for common sense. In Proceedings of the 3rd Work- shop on Evaluating Vector Space Representations for NLP.
- Ido Dagan, Oren Glickman, and Bernardo Magnini. 2005. The pascal recognising textual entailment chal- lenge. In Machine Learning Challenges Workshop.
- Ioannis Mollas, Zoe Chrysopoulou, Stamatis Karlos, and Grigorios Tsoumakas. 2020. Ethos: an online hate speech detection dataset. ArXiv.
- Wei Wang, Vincent W Zheng, Han Yu, and Chunyan Miao. 2019b. A survey of zero-shot learning: Set- tings, methods, and applications. ACM Transactions on Intelligent Systems and Technology (TIST).
Cited by
Sorted by citations
Items 501–600 of 758
Wei, H., Wu, B., Wang, C., Su, G., & Zhou, T. (2025) · International Conference on Multimedia Retrieval · doi:10.1145/3731715.3733303 · Cited by 1
Aspect sentiment learning for Aspect-Level Sentiment Classification
Jian, Z., Li, J., Wang, M., Yao, J., & Wu, Q. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107758 · Cited by 1
ColorGPT: Leveraging Large Language Models for Multimodal Color Recommendation
Xia, D., Inoue, N., Qiu, Q., & Kikuchi, K. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04630-7_10 · Cited by 1
MedICL: In-Context Learning for Semantically Enhanced AKI Prediction in Cardiac Surgery
Su, C., Wang, Y., Xu, B., Feng, R., Du, L., Liu, H., & Meng, G. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05141-7_39 · Cited by 1
SAI: Latency-Aware Satellite Edge LAM Inference with Looped Transformer
Yuan, H., Wang, Z., Jiang, Y., Liu, X., Shi, Y., & Wang, T. (2025) · International Conference on Communications · doi:10.1109/icc52391.2025.11161072 · Cited by 1
Large Language Models as Attribution Regularizers for Efficient Model Training
Vukadin, D., Šilić, M., & Delač, G. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08327-2_4 · Cited by 1
To Theoretically Understand Transformer-Based In-Context Learning for Optimizing CSMA
Hao, S., Li, H., & Duan, L. (2025) · ACM International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing (MobiHoc) · doi:10.1145/3704413.3764423 · Cited by 1
Abumelha, M., ALGhamdi, A. S. A.-M., Fayoumi, A. G., & Ragab, M. (2025) · JMIR Medical Informatics · doi:10.2196/78432 · Cited by 2
TOT-DS: Demonstration Selection for Enhancing the Reasoning Capabilities of Large Language Models
Liu, X. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228014 · Cited by 1
On the Use of Agentic Coding Manifests: An Empirical Study of Claude Code
Chatlatanagulchai, W., Thonglek, K., Reid, B., Kashiwa, Y., Leelaprute, P., Rungsawang, A., Manaskasemsak, B., & Iida, H. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-12089-2_40 · Cited by 1
Legal lay summarization: exploring methods and data generation with large language models
Moro, G., Magnani, L. D. M., & Ragazzi, L. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11392-7 · Cited by 3
Pinzuti, E., Tüscher, O., & Castro, A. F. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1706090 · Cited by 2
Are Triggers Needed for Document-Level Event Extraction?
Shaar, S., Chen, W., Chatterjee, M., Wang, B., Zhao, W., & Cardie, C. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.51 · Cited by 3
A KG-LLM-Enabled Inspection Work Packaging Approach in Module Prefabrication
Dong, Q., Li, X., Liu, G., Chengke, W., & Chen, T. (2025) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-6595 · Cited by 1
Shared sensitivity to data distribution during learning in humans and transformer networks
Lerousseau, J. P., & Summerfield, C. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02359-3 · Cited by 4
Li, Z., Qiao, Y., Chen, X., & Chen, S. (2025) · Symmetry · doi:10.3390/sym18010047 · Cited by 1
Kim, S., Lee, D. S. U., Kim, Y., Yoon, H., & Lee, H. (2026) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2026.104982 · Cited by 1
Dual-Channel Retrieval-Augmented In-Context Learning for Comparative Opinion Mining
Gui, W., Yang, Z., Xu, F., Yan, H., Xu, F., & Xia, R. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3656970 · Cited by 1
Aiyappa, R., Senthilmani, S., An, J., Kwak, H., & Ahn, Y. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3540 · Cited by 14
Explainable AI-Generated Image Forensics: A Low-Resolution Perspective with Novel Artifact Taxonomy
Sharma, K. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00168 · Cited by 1
Benchmarking international construction contract knowledge of large language models
Xia, H., Chen, Y., Qi, X., & Wang, Y. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.131754 · Cited by 1
Detecting stress from videos via intra-subject and inter-subject learning
Ding, Y., Dai, Y. Q., Cao, L., Tian, J., Lin, Z., & Feng, L. (2026) · Health Information Science and Systems · doi:10.1007/s13755-026-00450-1 · Cited by 1
A State-Aware Dual-Tool Architecture for Improved Tool Use in Multi-Turn LLM Dialogue
Pałgan, B., Wawryszczuk, M., Chwał, J., Tkacz, E., & Dzik, R. (2026) · Applied Sciences · doi:10.3390/app16094329 · Cited by 1
Predicate Renaming via Large Language Models
Gentili, E., Ribeiro, T., Riguzzi, F., & Inoue, K. (2026) · Machine Learning · doi:10.1007/s10994-026-07075-1 · Cited by 1
Scoring Structured Academic Documents with Large Language Models: Impact Case Studies
Thelwall, M. A., Kousha, K., & He, G. (2026) · Journal of Data and Information Science · doi:10.1515/jdis-2025-0465 · Cited by 1
Benchmarking Conversation Routing in Chatbot Systems Based on Large Language Models
Maksymenko, D., Kryvoshein, D., Turuta, O., Kazakov, D., & Turuta, O. (2024) · International Workshop of IT-professionals on Artificial Intelligence (ProfIT AI) · doi:10.55056/ceur-ws.org/vol-3777/paper6.pdf · Cited by 1
Mala, C. S., Gezi̇ci, G., & Giannotti, F. (2026) · Machine Learning · doi:10.1007/s10994-026-07121-y · Cited by 1
Pretrained Language Representations for Text Understanding: A Weakly-Supervised Perspective
Yu, M., Huang, J., Zhang, Y., Zhang, Y., & Han, J. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599569 · Cited by 1
Distilled Language Models are economically efficient for the enterprise. ...mostly.
Howell, K., Christian, G., Fomitchov, P., Kehat, G., Marzulla, J., Rolston, L., Tredup, J., Zimmerman, I., Selfridge, E. O., & Bradley, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-industry.24 · Cited by 2
MLLabs-LIG at TempoWiC 2022: A Generative Approach for Examining Temporal Meaning Shift
Lyu, C., Zhou, Y., & Ji, T. (2022) · doi:10.18653/v1/2022.evonlp-1.1 · Cited by 1
Prompt-Free Few-Shot Learning with ELECTRA for Acceptability Judgment
Li, L., Li, Z., Chen, Y., Li, S., & Zhou, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-44696-2_4 · Cited by 1
HIT-MI &T Lab’s Submission to CCMT 2023 Automatic Post-editing Task
Zhang, R., Yuan, J., Huang, H., Yang, M., & Zhao, T. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-7894-6_6 · Cited by 1
Fan, C., Tian, J., Li, Y., He, H., & Jin, Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448239 · Cited by 4
Building end-to-end dialogue system with large language models
Fan, J., & Ma, G. (2024) · International Conference on Signal Processing Systems (ICSPS) · doi:10.1117/12.3022781 · Cited by 1
TraitsPrompt: Does Personality Traits Influence the Performance of a Large Language Model?
Zhu, Q., Lan, T., Xue, X., Yu, Z., & He, H. (2024) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd61410.2024.10580436 · Cited by 1
Kulikov, V., Neychev, R., & Makarov, I. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-67008-4_4 · Cited by 1
Video animation in coordination system to improve students’ cognitive ability
Firdaus, Z., Zubaidah, S., & Munzil, M. (2024) · JPBI (Jurnal Pendidikan Biologi Indonesia) · doi:10.22219/jpbi.v10i2.33192 · Cited by 1
Tian, L., Huang, N., & Zhang, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-71736-9_18 · Cited by 1
MILE: A Mutation Testing Framework of In-Context Learning Systems
Wei, Z., Zhang, Y., & Sun, M. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0602-3_18 · Cited by 3
Enhancing Complex Question Answering via LLM Pseudo-Document and Adaptive Retrieval
Zhou, J., Zheng, Z., Lyu, Y., & Xu, T. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0579-8_19 · Cited by 1
Can ChatGPT Pass Modern Control Theory Exam?
Ogo, I., & Koga, M. (2024) · International Conference on Control, Automation and Systems (ICCAS) · doi:10.23919/iccas63016.2024.10773183 · Cited by 1
Visual Summary Thought of Large Vision-Language Models for Multimodal Recommendation
Liu, Y., Wang, Y., Cao, Y., Sun, L., & Yu, P. S. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825030 · Cited by 1
Du, Y., Zhang, Q., Fu, S., Hou, Y., & Han, H. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-07214-w · Cited by 1
DupLLM:Duplicate Pull Requests Detection Based on Large Language Model
Liao, Z., Liu, P., Lan, P., & Sun, K. (2024) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec65559.2024.00023 · Cited by 1
Chen, M., Zhang, Z., Chen, J., Rebibo, D., Wu, H., Fung, S.-H., Cheng, A. S., Tsui, S. K., Sinha, S., Cao, Q., et al. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.07.042 · Cited by 2
Enhancing Large Language Models with In-Context Learning for Reservoir Management Tasks
Al-Ismael, M. A., & Awotunde, A. A. (2025) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-025-10472-8 · Cited by 1
LLM-powered database migration: A framework for knowledge graph system evolution
Zhao, S., Zhang, Q., & Lan, M. (2025) · Alexandria Engineering Journal · doi:10.1016/j.aej.2025.08.014 · Cited by 1
Building generalizable deep learning solutions for mobile sensing
Xu, H. (2024) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/174809 · Cited by 1
Do LLMs Overcome Shortcut Learning?An Evaluation of Shortcut Challenges in Large Language ModelsPreprint
Yuan, Y., Zhao, L., Zhang, K., Zheng, G., & Liu, Q. (2024) · Qeios · doi:10.32388/1bzh25 · Cited by 2
Fung, S.-H., Zhang, Z., Wang, R., Miao, C., Wong, B. S., Li, K. Y., Hong, C., Zhou, J., Yip, K. Y.-L., Tsui, S. K., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.02.11.637772 · Cited by 1
DAFE: LLM-Based Evaluation Through Dynamic Arbitration for Free-Form Question-AnsweringPreprint
Badshah, S., & Sajjad, H. (2025) · Qeios · doi:10.32388/b69sky · Cited by 1
Fuchs, J., Johnson, C., Foster, N. R., & Leese, P. (2025) · medRxiv · doi:10.1101/2025.09.23.25336010 · Cited by 1
Uncovering Hidden Consequences of Pre-training Objectives in Sequence-to-Sequence Models
Kew, T., & Sennrich, R. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.438
Understanding Demonstration-based Learning from a Causal Perspective
Zhang, R., & Yu, T. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.125 · Cited by 1
Meta-training with Demonstration Retrieval for Efficient Few-shot Learning
Mueller, A., Narang, K., Mathias, L., Wang, Q., & Firooz, H. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.376 · Cited by 2
Can In-context Learners Learn a Reasoning Concept from Demonstrations?
Tefnik, M., & Kadlčík, M. (2023) · NLRSE · doi:10.18653/v1/2023.nlrse-1.8 · Cited by 3
Can Publicly Available Models Understand NATO Language? A Named Entity Recognition Case Study
D’Ercole, R., Kok, A., Eles, P., Valiyev, G., & Street, M. (2023) · International Conference on Military Communications and Information Systems (ICMCIS) · doi:10.1109/icmcis59922.2023.10253530
Transductive Learning for Textual Few-Shot Classification in API-based Embedding ModelsPreprint
Colombo, P., Pellegrain, V., Boudiaf, M., Storchan, V., Tami, M., Ayed, I. B., Hudelot, C., & Piantanida, P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.13998
Badriyah, R., Hartiningsih, S., & Sabilah, F. (2023) · Voices of English Language Education Society · doi:10.29408/veles.v7i2.20325
Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turns
Coca, A., Tseng, B.-H., Chen, J., Lin, W., Zhang, W., Anders, T., & Byrne, B. (2023) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2023.sigdial-1.42
Statistical Depth for Ranking and Characterizing Transformer-Based Text Embeddings
Seegmiller, P., & Preum, S. M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.596
Machine Reading Comprehension using Case-based Reasoning
Thai, D., Agarwal, D., Chaudhary, M., Zhao, W., Das, R., Lee, J. Y., Hajishirzi, H., Zaheer, M., & McCallum, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.564 · Cited by 4
Self-citationImproving Input-label Mapping with Demonstration Replay for In-context Learning
Gong, Z., Liu, J., Wang, Q., Wang, J., Cai, X., Zhao, D., & Yan, R. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.995 · Cited by 2
Yan, T., Zhang, Y., Han, J., Liu, Z., Barnhart, W. R., Sun, S., Zhou, J., Ji, F., & He, J. (2024) · doi:10.2196/preprints.58054
Mao, T., Fu, J., & Yoshie, O. (2024) · Asia Conference on Information Engineering (ACIE) · doi:10.1109/acie61839.2024.00033
New Community Cold-Start Recommendation: A Novel Large Language Model-based MethodPreprint
Che, S., Mao, M., & Liu, H. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4828316
Reasoning subevent relation over heterogeneous event graph
Wu, T., Ding, X. H., Du, L., Qin, B., & Liu, T. (2024) · Knowledge and Information Systems · doi:10.1007/s10115-024-02124-4
Valentino, M., & Freitas, A. (2024) · Philosophy & Technology · doi:10.1007/s13347-024-00775-3 · Cited by 1
Guiding ChatGPT to Generate Salient Domain Summaries
Gao, J. H., Cao, Z., Huang, S., Qin, L., & Ai, C. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650616 · Cited by 2
TELLMe: Teaching and Exploiting Large Language Models for Model Selection in Text Retrieval
Li, Z., Bai, J., Chen, Z., Li, C., Ouyang, Y., & Rong, W. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651417
Legally-Guided Automated Decision-Making System Using Language Model Agents for Autonomous Driving
Wang, Y., Barta, D., Hesse, J., Buchwald, P., & Paschke, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72407-7_17
An Academic Information Collection System based on Large Language Model
Lang, Q., Lyu, S., Wang, H., & Zhang, R. (2024) · International Conference on Electronic Communication and Artificial Intelligence (ICECAI) · doi:10.1109/icecai62591.2024.10675124
TEAP: Text Embedding-Based Algorithm Tag Prediction
Wang, J. (2024) · International Conference on Electronic Communication and Artificial Intelligence (ICECAI) · doi:10.1109/icecai62591.2024.10674904
Seeing Beyond Classes: Zero-Shot Grounded Situation Recognition via Language Explainer
Lei, J., Li, L., Wang, C., Xiao, J., & Chen, L. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681036 · Cited by 1
Language-Emphasized Cross-Lingual In-Context Learning for Multilingual LLM
Li, J., Wei, X., Wang, X., Zhuang, N., Wang, L., & Dang, J. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-9437-9_26
Retrieval-Enhanced Template Generation for Template Extraction
Wang, R., Xiang, W., Wang, Z., & Wang, B. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-9431-7_29
Learning Rate Decay Scheduler Using the Loss Operator as Generalization
An, W., Zhang, J., Liu, J., Shao, K., Bian, K., & Zhou, J. (2024) · IEEE International Conference on Pattern Recognition and Machine Learning (PRML) · doi:10.1109/prml62565.2024.10779896 · Cited by 1
Schema Retrieval for Korean Geographic Knowledge Base Question Answering Using Few-Shot Prompting
Lee, S. E., & Yu, K. (2024) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi13120453
CPLS: Optimizing the Assignment of LLM Queries
Liu, Y., Zhang, H., Li, Z., & Miao, Y. (2024) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme58944.2024.00024
The Impact of Varying Knowledge on Question-Answering System
Ha, A. N. T., Quoc, T. N., Van, T. N., Trung, H. P., Hoang, V. T., & Le-Viet, T. (2024) · Asian Conference on Communication and Networks (ASIANComNet) · doi:10.1109/asiancomnet63184.2024.10811070
Probing Robustness of In-context Learning in LLM Classification Predictions Under Label Noise
Ayachitula, S., Kundu, C. K., & Mishra, B. K. (2024) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa62245.2024.00057 · Cited by 1
Few-Shot N-Ary Knowledge Inference Using Large Language Models
Lang, F., Song, W., Zhu, Q., & Zhu, S. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-0792-1_22
On the Potential of Large Language Models in Parallel Systems: A Systematic Analysis
Cheng, X., Luo, S., Yang, J., Lei, Y., Li, Z., & Yang, L. (2024) · China Automation Congress (CAC) · doi:10.1109/cac63892.2024.10864500
Collaborating LLMs and PLMs for Medical Tasks
Xu, G., Meng, Y., Wang, R., & Qi, G. (2024) · IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg63256.2024.00060
Detecting Cyberbullying in Visual Content: A Large Vision-Language Model Approach
Mu, J., Cong, D., Qin, H., Ajay, I., Guo, K., Vishwamitra, N., & Hu, H. (2024) · International Conference on Machine Learning and Applications · doi:10.1109/icmla61862.2024.00257
Neighborhood Deviation Attack Against In-Context Learning
Hou, D., Yang, Z., Zheng, L., Jin, B., Xu, H., Li, Y., Xu, B., & Peng, K. (2025) · Applied Sciences · doi:10.3390/app15084177
Structural Chain of Thoughts for Radiology EducationPreprint
Awasthi, A., Chung, B., Vu, A. M., Khan, S. B., Le, N., Deng, Z., Agrawal, R., Wu, C. C., & Nguyen, H. V. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5230388
Making language models better human-like learners
Qin, C. (2025) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/183806
Generative Negative Sample Enhancement Based Few-Shot Named Entity Recognition
Duan, Z. Y., Xiao, S., Chen, J., Zhao, S., & Zhang, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-92741-6_22
Yuan, Y., Gao, Y., Moen, H., Isometsä, E. T., Marttinen, P., & Aledavood, T. (2025) · medRxiv · doi:10.1101/2025.05.10.25327354
Structured Creativity: Enhancing Business Model Innovation with Generative AI
Scheiber, C., Böttcher, T. P., Fielt, E., Kowalkiewicz, M., Weber, M., & Krcmar, H. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93979-2_13
Exploring Explanations Improves the Robustness of In-Context LearningPreprint
Honday, U., & Oka, T. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5277637
Zhao, B., Jin, W., Wang, J., Gao, Y., Cao, C., Shi, B., & Tao, T. (2024) · Asian Conference on Artificial Intelligence Technology (ACAIT) · doi:10.1109/acait63902.2024.11022234
Mitani, S., Moona, S., Matsuo, S., & Burger, E. (2025) · doi:10.1109/raie66699.2025.00008
Scalable Tabular Dataset Labeling with Language Models
Hu, Y., Fountalis, I., Tian, J. W., & Vasiloglou, N. (2025) · International Conference on Scalable Scientific Data Management (SSDBM) · doi:10.1145/3733723.3733739
Identifying Multi-parameter Constraint Errors in Python Data Science Library API Documentation
Xu, X., Xie, F., Zhu, C., Bai, G., Khurshid, S., & Li, Y. (2025) · Proceedings of the ACM on Software Engineering · doi:10.1145/3728945 · Cited by 1
Hu, X., & Abisado, M. (2025) · Forum for Linguistic Studies · doi:10.30564/fls.v7i6.9143
Few-Shot Document-Level Event Argument Extraction Based on Multi-Agent Systems
Yu, J., Xian, Y., Yu, Z., Wang, H., Huang, Y., & Xiang, Y. (2025) · International Conference on Neural Networks, Information and Communication Engineering (NNICE) · doi:10.1109/nnice64954.2025.11064421
Metadata
- Authors
- Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., & Zettlemoyer, L.
- Affiliations
- University of Washington (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Pages
- 11048-11064
- arXiv
- 2202.12837
- OpenAlex
- W4385567149
- Cited by
- 752
- References
- 57
- Citations by year
- 2026: 135 · 2025: 227 · 2024: 179 · 2023: 191 · 2022: 20
- FWCI
- 85.30
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (2044660)
- Office of Naval Research (N00014-18, N00014-18-1-2826, ONR-N00014, N00014)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- in-context learning, demonstrations, large language models, label noise, input distribution, label space, GPT-3, classification tasks, multiple-choice tasks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review