The DOI matches its DataCite record; 58 of the 58 references it cites were found in a registry or an index.
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Open accessAbstract
Large language models (LMs) are able to in-context learn -- perform a new task via inference alone by conditioning on a few input-label pairs (demonstrations) and making predictions for new inputs. However, there has been little understanding of how the model learns and which aspects of the demonstrations contribute to end task performance. In this paper, we show that ground truth demonstrations are in fact not required -- randomly replacing labels in the demonstrations barely hurts performance on a range of classification and multi-choce tasks, consistently over 12 different models including GPT-3. Instead, we find that other aspects of the demonstrations are the key drivers of end task performance, including the fact that they provide a few examples of (1) the label space, (2) the distribution of the input text, and (3) the overall format of the sequence. Together, our analysis provides a new way of understanding how and why in-context learning works, while opening up new questions about how much can be learned from large language models through inference alone.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Min et al. [44] has shown that rather than learning new tasks, in-context learning [42] works by activating patterns from the training data.”
From RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics (2024) · cites this paper as [44]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Self-citationExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Self-citationChain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
The PASCAL Recognising Textual Entailment Challenge
Dagan, I., Glickman, O., & Magnini, B. (2006) · Lecture notes in computer science · doi:10.1007/11736790_9 · Cited by 1,674
Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering
Mihaylov, T., Clark, P. E., Khot, T., & Sabharwal, A. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1260 · Cited by 1,602
Automatically Constructing a Corpus of Sentential Paraphrases.
Dolan, W. B., & Brockett, C. (2005) · Cited by 1,101
Research works printed but not linked: 4
- Michael Chen, Mike D'Arcy, Alisa Liu, Jared Fer- nandez, and Doug Downey. 2019. CODAH: An adversarially-authored question answering dataset for common sense. In Proceedings of the 3rd Work- shop on Evaluating Vector Space Representations for NLP.
- Ido Dagan, Oren Glickman, and Bernardo Magnini. 2005. The pascal recognising textual entailment chal- lenge. In Machine Learning Challenges Workshop.
- Ioannis Mollas, Zoe Chrysopoulou, Stamatis Karlos, and Grigorios Tsoumakas. 2020. Ethos: an online hate speech detection dataset. ArXiv.
- Wei Wang, Vincent W Zheng, Han Yu, and Chunyan Miao. 2019b. A survey of zero-shot learning: Set- tings, methods, and applications. ACM Transactions on Intelligent Systems and Technology (TIST).
Cited by
Sorted by citations
Items 201–300 of 758
Can Large Language Models Faithfully Express Their Intrinsic Uncertainty in Words?
Yona, G., Aharoni, R., & Geva, M. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.443 · Cited by 18
Watson, E. ‘., Viana, T., & Zhang, S. (2023) · AI · doi:10.3390/ai4010007 · Cited by 18
Don’t Prompt, Search! Mining-based Zero-Shot Learning with Language Models
van de Kar, M., Xia, M., Chen, D., & Artetxe, M. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.509 · Cited by 13
Self-citationImproving Dutch Vaccine Hesitancy Monitoring via Multi-Label Data Augmentation with GPT-3.5
Nooten, J. V., & Daelemans, W. M. P. (2023) · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) · doi:10.18653/v1/2023.wassa-1.23 · Cited by 15
Toward Human Readable Prompt Tuning: Kubrick’s The Shining is a good movie, and a good prompt too?
Shi, W., Han, X., Gonen, H., Holtzman, A., Tsvetkov, Y., & Zettlemoyer, L. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.733 · Cited by 44
Self-citationLeveraging Large Language Models for Exploiting ASR Uncertainty
Dighe, P., Su, Y., Zheng, S., Liu, Y., Garg, V., Niu, X., & Tewfik, A. H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446132 · Cited by 19
CoderUJB: An Executable and Unified Java Benchmark for Practical Programming Scenarios
Zeng, Z., Wang, Y., Xie, R., Ye, W., & Zhang, S. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3652115 · Cited by 16
Exploration On Prompting LLM With Code-Specific Information For Vulnerability Detection
Liu, Z., Yang, Z., & Liao, Q. (2024) · IEEE International Conference on Software Services Engineering (SSE) · doi:10.1109/sse62657.2024.00049 · Cited by 18
OptLLM: Optimal Assignment of Queries to Large Language Models
Liu, Y., Zhang, H., Miao, Y., Le, V.-H., & Li, Z. (2024) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws62655.2024.00098 · Cited by 28
Refactoring for Dockerfile Quality: A Dive into Developer Practices and Automation Potential
Ksontini, E., Mastouri, M., Khalsi, R., & Kessentini, W. (2025) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr66628.2025.00116 · Cited by 17
Prompting in the Wild: An Empirical Study of Prompt Evolution in Software Repositories
Tafreshipour, M., Imani, A., Huang, E., de Almeida, E. S., Zimmermann, T., & Ahmed, I. (2025) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr66628.2025.00106 · Cited by 37
Bansal, H., Gopalakrishnan, K., Dingliwal, S., Bodapati, S., Kirchhoff, K., & Roth, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.660 · Cited by 47
LMentry: A Language Model Benchmark of Elementary Language Tasks
Efrat, A., Honovich, O., & Levy, O. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.666 · Cited by 27
Kwon, S. J., Kim, J., Bae, J., Yoo, K. M., Kim, J.-H., Park, B., Kim, B., Ha, J.-W., Sung, N., & Lee, D. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.240 · Cited by 17
A Simple and Effective Framework for Strict Zero-Shot Hierarchical Classification
Bhambhoria, R. V., Chen, L., & Zhu, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.152 · Cited by 14
How Many Demonstrations Do You Need for In-context Learning?
Chen, J., Chen, L., Zhu, C., & Zhou, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.745 · Cited by 12
Yang, J., Zhang, X., Liang, K. M., & Liu, Y. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386949 · Cited by 18
Link-Context Learning for Multimodal LLMs
Tai, Y., Fan, W., Zhang, Z., & Liu, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02566 · Cited by 20
Context-aware prompt learning for test-time vision recognition with frozen vision-language model
Yin, J., Zhang, X., Wu, L. Y., & Wang, X. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111359 · Cited by 16
Paradigm-Based Automatic HDL Code Generation Using LLMs
Sun, W., Li, B., Zhang, G. L., Yin, X., Zhuo, C., & Schlichtmann, U. (2025) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed65160.2025.11014391 · Cited by 14
A Video Is Worth 4096 Tokens: Verbalize Story Videos To Understand Them In Zero Shot
Bhattacharyya, A., Singla, Y., Krishnamurthy, B., Shah, R. R., & Chen, C. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.608 · Cited by 28
Proceedings of the 4th New Frontiers in Summarization Workshop
(2023) · doi:10.18653/v1/2023.newsum-1 · Cited by 12
Characterizing In-Context Learning: When Can Transformers Match Standard Learning Algorithms?
Hawarey, M. (2026) · doi:10.65737/airmcs2026277 · Cited by 11
Azad, M. S., Leeon, S. I., Khan, R., Mohammed, N., & Momen, S. (2024) · Array · doi:10.1016/j.array.2024.100372 · Cited by 11
Exploring the Robustness of In-Context Learning with Noisy Labels
Cheng, C., Yu, X., Wen, H., Sun, J., Yue, G., Zhang, Y., & Wei, Z. (2025) · ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49660.2025.10889281 · Cited by 11
Zhang, T., Yu, Y., Mao, X., Wang, S., Yang, K., Lu, Y., Zhang, Z., & Zhao, Y. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00104 · Cited by 19
Prompt2Model: Generating Deployable Models from Natural Language Instructions
Viswanathan, V., Zhao, C., Bertsch, A., Wu, T., & Neubig, G. (2023) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2023.emnlp-demo.38 · Cited by 35
Prompt-Augmented Linear Probing: Scaling beyond the Limit of Few-Shot In-Context Learners
Cho, H., Kim, H. J., Kim, J., Lee, S.-W., Lee, S., Yoo, K. M., & Kim, T. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26495 · Cited by 14
Jin, W., Wang, J., Gao, Y., Shi, B., Wang, N., Zhao, B., & Yang, G. (2025) · Computational Intelligence · doi:10.1111/coin.70129 · Cited by 10
UISGPT: Automated Mobile UI Design Smell Detection with Large Language Models
Yang, B., & Li, S. (2024) · Electronics · doi:10.3390/electronics13163127 · Cited by 10
Rethinking and Improving Visual Prompt Selection for In-Context Learning Segmentation
Suo, W., Lai, L., Sun, M., Zhang, H., Wang, P., & Zhang, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72952-2_2 · Cited by 13
Towards Emotion-enriched Text-to-Motion Generation via LLM-guided Limb-level Emotion Manipulating
Yu, T., Wang, J.-J., Wang, J.-W., Luo, J.-M., & Zhou, G.-D. (2024) · ACM Multimedia · doi:10.1145/3664647.3681487 · Cited by 17
DreamStruct: Understanding Slides and User Interfaces via Synthetic Data Generation
Peng, Y.-H., Huq, F., Jiang, Y., Wu, J., Li, X. Y., Bigham, J. P., & Pavel, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72691-0_26 · Cited by 10
Zheng, C., Xie, F., Ji, T., Zhou, H., & Zheng, Y. (2024) · Journal of Fluid Mechanics · doi:10.1017/jfm.2024.1133 · Cited by 12
LLM4Jobs: Unsupervised occupation extraction and standardization leveraging Large Language Models
Li, N., Kang, B., & Bie, T. D. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113302 · Cited by 36
Constructing formal models of cryptographic protocols from Alice&Bob style specifications via LLM
Li, Q., Ji-hong, H., Yuan, L., Li, X., & Wang, X. (2025) · Scientific Reports · doi:10.1038/s41598-025-93373-y · Cited by 10
Jin, W., Su, D., Tao, T., Wang, X., Wang, N., & Zhao, B. (2025) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-025-00038-x · Cited by 14
ECAMP: Entity-centered Context-aware Medical Vision Language Pre-training
Wang, R., Yao, Q., Jiang, Z., Lai, H., He, Z., Tao, X., & Zhou, S. K. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103690 · Cited by 17
LLaMoCo: Instruction Tuning of Large Language Models for Optimization Code Generation
Ma, Z., Gong, Y., Guo, H., Chen, J., Ma, Y., Cao, Z., & Zhang, J. (2026) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2026.3656374 · Cited by 59
Mind the Biases: Quantifying Cognitive Biases in Language Model Prompting
Lin, R., & Ng, H. T. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.324 · Cited by 13
Do Models Really Learn to Follow Instructions? An Empirical Study of Instruction Tuning
Kung, P.-N., & Peng, N. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.113 · Cited by 40
Dynamically retrieving knowledge via query generation for informative dialogue generation
Hu, Z., Wang, L., Chen, Y., Liu, Y., Li, R., Zhao, M., Lu, X., & Jiang, Z. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127036 · Cited by 10
Yin, F., Vig, J., Laban, P., Joty, S., Xiong, C., & Wu, C.-S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.172 · Cited by 33
Large Language Models are Catalyzing Chemistry EducationPreprint
Du, Y., Duan, C., Bran, A. M., Sotnikova, A., Qu, Y., Kulik, H. J., Bosselut, A., Xu, J., & Schwaller, P. (2024) · ChemRxiv · doi:10.26434/chemrxiv-2024-h722v · Cited by 10
Huang, Q. Y., Sun, Y., Xing, Z., Cao, Y., Chen, J., Xu, X., Jin, H., & Lu, J. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3680469 · Cited by 9
DP-TabICL: In-Context Learning with Differentially Private Tabular Data
Carey, A. N., Bhaila, K., Edemacu, K., & Wu, X. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10826053 · Cited by 13
Xu, Q., Li, J., Tian, Y., Zhou, L., Zhang, F., & Huang, R. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126951 · Cited by 9
Ojemann, W. K. S., Xie, K., Liu, K., Chang, E., Roth, D., Litt, B., & Ellis, C. A. (2025) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-025-00198-5 · Cited by 10
Avignone, A., Tierno, A., Fiori, A., & Chiusano, S. (2025) · Information · doi:10.3390/info16050368 · Cited by 13
Comparing the accuracy of large language models and prompt engineering in diagnosing realworld cases
Yao, G., Zhang, W. D., Zhu, Y., Wong, U.-K., Zhang, Y., Cui, Y., Shen, G., Li, Z., & Gao, H. Y. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106026 · Cited by 13
Park, G., Park, J., & Lee, H. (2025) · Applied Sciences · doi:10.3390/app15147800 · Cited by 12
Benchmarking Large Language Models on Homework Assessment in Circuit Analysis
Chen, L., Qin, Z., Guo, Y., Rohde, J. A., & Zhang, Y. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-025-00501-w · Cited by 11
Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations
Si, C., Friedman, D., Joshi, N., Shi, F., Chen, D., & He, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.632 · Cited by 32
Robustness of Demonstration-based Learning Under Limited Data Scenario
Zhang, H., Zhang, Y., Zhang, R., & Yang, D. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.116 · Cited by 14
The Importance of Human-Labeled Data in the Era of LLMs
Liu, Y. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/802 · Cited by 16
Characterizing Mechanisms for Factual Recall in Language Models
Yu, Q., Merullo, J., & Pavlick, E. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.615 · Cited by 48
Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support Conversation
Xu, Z., Chen, D., Kuang, J., Yi, Z., Li, Y., & Shen, Y. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657695 · Cited by 10
Generating Java code pairing with ChatGPT
Zhao, Z., Zhang, N., Yu, B., & Duan, Z. (2024) · Theoretical Computer Science · doi:10.1016/j.tcs.2024.114879 · Cited by 9
Can Multimodal Large Language Models Truly Perform Multimodal In-Context Learning?
Chen, S., Han, Z., He, B., Liu, J., Buckley, M., Qin, Y., Torr, P. H. S., Volker Tresp, C., & Gu, J. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00585 · Cited by 25
Enhancing Chinese Address Parsing in Low-Resource Scenarios through In-Context Learning
Ling, G., Mu, X., Wang, C., & Xu, A. (2023) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi12070296 · Cited by 9
Generating EDU Extracts for Plan-Guided Summary Re-Ranking
Adams, G., Fabbri, A. R., Ladhak, F., Elhadad, N., & McKeown, K. R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.151 · Cited by 10
Contrastive Demonstration Tuning for Pre-trained Language Models
Liang, X., Zhang, N., Cheng, S., Zhang, Z., Tan, C., & Chen, H. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.56 · Cited by 11
Bootstrapping Multilingual Semantic Parsers using Large Language Models
Awasthi, A., Gupta, N., Samanta, B., Dave, S., Sarawagi, S., & Talukdar, P. P. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.180 · Cited by 12
Meta In-Context Learning: Harnessing Large Language Models for Electrical Data Classification
Zhou, M., Li, F., Zhang, F., Zheng, J., & Ma, Q. (2023) · Energies · doi:10.3390/en16186679 · Cited by 12
Self-ICL: Zero-Shot In-Context Learning with Self-Generated Demonstrations
Chen, W., Wu, C.-K., Chen, Y.-N., & Chen, H. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.968 · Cited by 33
The First ChatGPT4PCG Competition
Abdullah, F., Taveekitworachai, P., Dewantoro, M. F., Thawonmas, R., Togelius, J., & Renz, J. (2024) · IEEE Transactions on Games · doi:10.1109/tg.2024.3376429 · Cited by 11
Parallel Learning for Legal Intelligence: A HANOI Approach Based on Unified Prompting
Song, Z., Huang, M., Miao, Q., & Wang, F. (2023) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2023.3301400 · Cited by 9
Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks
Kung, P.-N., Yin, F., Wu, D., Chang, K.-W., & Peng, N. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.112 · Cited by 36
MindMap: Constructing Evidence Chains for Multi-Step Reasoning in Large Language Models
Wu, Y., Han, X., Song, W., Cheng, M., & Li, F. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29896 · Cited by 8
Automated Detection of Dark Patterns Using In-Context Learning Capabilities of GPT-3
Sazid, Y., Fuad, M. M. N., & Sakib, K. M. (2023) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec60848.2023.00072 · Cited by 8
Alzaid, E., Pergola, G., Evans, H., Snead, D. R. J., & Minhas, F. (2024) · The Journal of Pathology Clinical Research · doi:10.1002/2056-4538.70010 · Cited by 8
Zhao, Q., Gao, T., & Guo, N. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104129 · Cited by 10
Clinical Text Generation: Are We There Yet?
Hiebel, N., Ferret, O., Fort, K., & Névéol, A. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-103123-095202 · Cited by 11
Zhang, Z., Schoop, E., Nichols, J. W., Mahajan, A., & Swearngin, A. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712153 · Cited by 23
A Survey on the Recent Advancements in Human-Centered Dialog Systems
Oruche, R., Goruganthu, S. K., Akula, R., Cheng, X., Goni, M. A., Shibo, B. W., Kee, K. F., Zampieri, M., & Calyam, P. P. (2025) · ACM Computing Surveys · doi:10.1145/3729220 · Cited by 11
Clustering Algorithms and RAG Enhancing Semi-Supervised Text Classification with Large LLMs
Zhong, S., Zeng, J., Yu, Y., & Lin, B. (2025) · International Journal of Data Science and Analytics · doi:10.1007/s41060-025-00774-3 · Cited by 10
Understanding the Potentials and Limitations of Prompt-based Music Generative AI
Choi, Y., Moon, J., Yoo, J., & Hong, J.-H. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713762 · Cited by 12
Gao, C., Chen, X., & Zhang, G. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107803 · Cited by 14
Zhou, W., Huang, M., Liu, S., You, Q., & Meng, F. (2025) · IEEE Access · doi:10.1109/access.2025.3586370 · Cited by 8
Language model collaboration for relation extraction from classical Chinese historical documents
Tang, X., Wang, L., & Wang, J. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104286 · Cited by 11
Understanding Human-AI Misalignment in LLM-Based Job-Seeking Support for Neurodivergent Users
Hall, K., Ma, M., Zhang, X., Swain, V. D., & Kim, J. G. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746361 · Cited by 8
Can Large Language Models Be Query Optimizer for Relational Databases?
Tan, J., Zhao, K., Li, R., Yu, J. X., Piao, C., Cheng, H., Meng, H. M. L., Zhao, D., & Rong, Y. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3769771 · Cited by 30
Are large pre-trained vision language models effective construction safety inspectors
Chen, X., & Zou, Z. (2026) · Data-Centric Engineering · doi:10.1017/dce.2026.10044 · Cited by 19
PCR-Chain: Partial Code Reuse Assisted by Hierarchical Chaining of Prompts on Frozen Copilot
Huang, Q. Y., Zhu, J., Li, Z., Xing, Z., Wang, C., & Xu, X. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion58688.2023.00013 · Cited by 9
Sentiment and Emotion Classification in Low-resource Settings
Barnes, J. (2023) · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) · doi:10.18653/v1/2023.wassa-1.26 · Cited by 11
Li, S., Han, C., Yu, P., Edwards, C., Li, M., Wang, X., Fung, Y. R., Yu, C., Tetreault, J., Hovy, E. H., et al. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.799 · Cited by 11
DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuning
Venkateswaran, P., Duesterwald, E., & Isahagian, V. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.310 · Cited by 10
Mixture of Soft Prompts for Controllable Data Generation
Chen, D., Lee, C. C., Lu, Y., Rosati, D., & Zhou, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.988 · Cited by 22
A Case for Business Process-Specific Foundation Models
Rizk, Y., Venkateswaran, P., Isahagian, V., Narcomey, A., & Muthusamy, V. (2024) · Lecture notes in business information processing · doi:10.1007/978-3-031-50974-2_4 · Cited by 14
SpeechPrompt: Prompting Speech Language Models for Speech Processing Tasks
Chang, K.-W., Wu, H., Wang, Y.-K., Wu, Y.-K., Shen, H., Tseng, W.-C., Kang, I.-T., Li, S.-W. D., & Lee, H.-Y. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3436618 · Cited by 8
Han, C., & Isaacs, K. E. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456351 · Cited by 8
DG-PIC: Domain Generalized Point-In-Context Learning for Point Cloud Understanding
Jiang, J., Zhou, Q., Li, Y., Lu, X., Wang, M., Ma, L., Chang, J. M., & Zhang, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72658-3_26 · Cited by 8
FLamE: Few-shot Learning from Natural Language Explanations
Zhou, Y., Zhang, Y., & Tan, C. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.372 · Cited by 12
MEAL: Stable and Active Learning for Few-Shot Prompting
Köksal, A., Schick, T., & Schuetze, H. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.36 · Cited by 19
In-Context Learning in Large Language Models: A Comprehensive SurveyPreprint
Highmore, C. (2024) · Preprints.org · doi:10.20944/preprints202407.0926.v1 · Cited by 8
Enabling Device Control Planning Capabilities of Small Language Model
Paul, S., Zhang, L., Shen, Y., & Jin, H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446064 · Cited by 7
Controllable Speaking Styles Using A Large Language Model
Sigurgeirsson, A., & King, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448400 · Cited by 13
Taxonomy Completion via Implicit Concept Insertion
Shi, J., Dong, H., Chen, J., Wu, Z., & Horrocks, I. R. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645584 · Cited by 10
Integrating Open-domain Knowledge via Large Language Model for Multimodal Fake News Detection
Xie, A., Zhu, F., Han, J., & Hu, S. (2024) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd61410.2024.10580818 · Cited by 7
A Prompt Example Construction Method Based on Clustering and Semantic Similarity
Chen, D., & Wang, J. (2024) · Systems · doi:10.3390/systems12100410 · Cited by 9
Metadata
- Authors
- Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., & Zettlemoyer, L.
- Affiliations
- University of Washington (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Pages
- 11048-11064
- arXiv
- 2202.12837
- OpenAlex
- W4385567149
- Cited by
- 752
- References
- 57
- Citations by year
- 2026: 135 · 2025: 227 · 2024: 179 · 2023: 191 · 2022: 20
- FWCI
- 85.30
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (2044660)
- Office of Naval Research (N00014-18, N00014-18-1-2826, ONR-N00014, N00014)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- in-context learning, demonstrations, large language models, label noise, input distribution, label space, GPT-3, classification tasks, multiple-choice tasks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review