The DOI matches its DataCite record; 58 of the 58 references it cites were found in a registry or an index.
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Open accessAbstract
Large language models (LMs) are able to in-context learn -- perform a new task via inference alone by conditioning on a few input-label pairs (demonstrations) and making predictions for new inputs. However, there has been little understanding of how the model learns and which aspects of the demonstrations contribute to end task performance. In this paper, we show that ground truth demonstrations are in fact not required -- randomly replacing labels in the demonstrations barely hurts performance on a range of classification and multi-choce tasks, consistently over 12 different models including GPT-3. Instead, we find that other aspects of the demonstrations are the key drivers of end task performance, including the fact that they provide a few examples of (1) the label space, (2) the distribution of the input text, and (3) the overall format of the sequence. Together, our analysis provides a new way of understanding how and why in-context learning works, while opening up new questions about how much can be learned from large language models through inference alone.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Min et al. [44] has shown that rather than learning new tasks, in-context learning [42] works by activating patterns from the training data.”
From RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics (2024) · cites this paper as [44]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Self-citationExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Self-citationChain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
The PASCAL Recognising Textual Entailment Challenge
Dagan, I., Glickman, O., & Magnini, B. (2006) · Lecture notes in computer science · doi:10.1007/11736790_9 · Cited by 1,674
Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering
Mihaylov, T., Clark, P. E., Khot, T., & Sabharwal, A. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1260 · Cited by 1,602
Automatically Constructing a Corpus of Sentential Paraphrases.
Dolan, W. B., & Brockett, C. (2005) · Cited by 1,101
Research works printed but not linked: 4
- Michael Chen, Mike D'Arcy, Alisa Liu, Jared Fer- nandez, and Doug Downey. 2019. CODAH: An adversarially-authored question answering dataset for common sense. In Proceedings of the 3rd Work- shop on Evaluating Vector Space Representations for NLP.
- Ido Dagan, Oren Glickman, and Bernardo Magnini. 2005. The pascal recognising textual entailment chal- lenge. In Machine Learning Challenges Workshop.
- Ioannis Mollas, Zoe Chrysopoulou, Stamatis Karlos, and Grigorios Tsoumakas. 2020. Ethos: an online hate speech detection dataset. ArXiv.
- Wei Wang, Vincent W Zheng, Han Yu, and Chunyan Miao. 2019b. A survey of zero-shot learning: Set- tings, methods, and applications. ACM Transactions on Intelligent Systems and Technology (TIST).
Cited by
Sorted by citations
Items 601–700 of 758
Rethinking the Chain-of-Thought: The Roles of In-Context Learning and Pretrained Priors
Yang, H., Yang, Z., Zhang, Y., Zhu, S., & Yang, L. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0020-8_34
Contextual Learning of Large Language Models Under Chain-of-Thought Optimization Strategy
Xia, Z., Gao, B., Liu, J., & Peng, Z. (2024) · International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE) · doi:10.1109/icbaie63306.2024.11116958
Kalyan Chakravarthy, K. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5393117
Balancing Rare Linguistic Features in Small Datasets through LLM-Augmented Training
李, 扬. (2025) · Modern Linguistics · doi:10.12677/ml.2025.138940
Beyond Computational Formalism or, Architecture Matters
Dobson, J. E. (2025) · Journal of Cultural Analytics · doi:10.22148/001c.133923 · Cited by 2
Foundation-Model-Based Action Selection for Behavior Trees in Navigation
Moriconi, M., Laible, S., & Recchiuto, C. T. (2025) · European Conference on Mobile Robots · doi:10.1109/ecmr65884.2025.11163061
CARE-VL: A Domain-Specialized Vision-Language Model for Early ASD Screening
Yoo, C.-H., Yoo, J., & Jang, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04971-1_6
Liao, J., Lin, S., Huang, C., Zhang, Z., & Liu, M. (2025) · doi:10.1109/icaie64856.2025.11158095
Rethinking Data Use in Large Language Models
Min, S., Hajishirzi, H., & Zettlemoyer, L. (2025) · Computational Linguistics · doi:10.1162/coli.a.573
Self-citationPan, T., Pu, W., Zhao, L., & Zhou, R. (2025) · Chinese Control Conference (CCC) · doi:10.23919/ccc64809.2025.11178847
How to quickly select good in-context examples in large language models for data-to-text tasks?
Li, Y., Yang, J., Jiang, L., Liu, S., & An, N. (2025) · Natural language processing. · doi:10.1017/nlp.2025.10010
Darmawan, R. P., & Wibowo, S. A. (2025) · IEEE International Symposium on Future Telecommunication Technologies (SOFTT) · doi:10.1109/softt67007.2025.11213109
Evaluating Text Summarization from Multiple Dimensions Using In-Context Learning
Sharma, K. K., Kumar, A., & Srivastava, A. K. (2025) · International Conference on Engineering Innovations and Technologies (ICoEIT) · doi:10.1109/icoeit63558.2025.11210872
Chinese–English Intelligent Translation Leveraging Large Language Modeling and Correction Mechanisms
Liu, J. (2025) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213025500186
Li, Y., Peng, J., Yang, L., Li, Y., Shi, F., Xue, P., & Xu, C. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4088-4_7
Ni, X., Zhao, Q., & Huang, S. (2025) · Scientia Sinica Informationis · doi:10.1360/ssi-2024-0329
Ding, Y., Jiang, X., & Akinseloyin, O. (2025) · medRxiv · doi:10.1101/2025.11.08.25339805
Extracting Causal Relational Rules for Medical Question-Answering Tasks using Large Language Models
Rahman, M. S., Zhang, Y., Rios, A., & Yang, K. (2025) · IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies · doi:10.1145/3721201.3725434
A Chain-of-Thought-Based Model Auto-Configuration Method for Customized Production Simulation
Li, N., Laili, Y., Ren, L., & Zhang, L. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4472-1_23
Logic Consistency Makes Large Language Models Personalized Reasoning Teachers
Zhang, B., Zhang, X., Zhang, Y., Yu, J., & Wang, J. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229110
Gautam, N., Paudel, B., Caragea, D., & Caragea, C. (2025) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa65442.2025.11247964
In-situ Value-aligned Human-Robot Interactions with Physical Constraints
Li, H., Jiao, Z., Liu, X., Liu, H., & Zheng, Z. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246572
Unified Cognitive Consciousness Theory: Introduction
Chang, E. Y. (2025) · ACM eBooks · doi:10.1145/3749421.3749428
Unified Cognitive Consciousness Theory: Formalization, Validation, and Outlook
Chang, E. Y. (2025) · ACM eBooks · doi:10.1145/3749421.3749438
Pouramini, A., & Faili, H. (2025) · SN Computer Science · doi:10.1007/s42979-025-04594-x
Fiscal and Tax QA via Clause-Level Knowledge Graphs and Retrieval-augmented Large Language Models
Chen, H., Bu, X., & Tian, S. (2025) · International Conference on Computer Information Science and Artificial Intelligence (CISAI) · doi:10.1145/3773365.3773416
Strategic symptom warning based on causal knowledge map and D-S evidence theory reasoning
Chai, S., Liu, Z., Cheng, Q., & Zeng, Z. (2025) · International Conference on Computer Information Science and Application Technology (CISAT) · doi:10.1109/cisat66811.2025.11181844
Liu, J. “., Su, Y., & Seth, P. (2025) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.1267
Xu, Y., Tang, F., Wu, Y., Gao, L., Deussen, O., Yan, H., Li, J., Cao, J., & Lee, T.-Y. (2025) · SIGGRAPH Asia Conference Papers · doi:10.1145/3757377.3763820 · Cited by 1
From Small to Large: In-Context Learning as a New Paradigm for Domain Generalization
Zhou, G., Han, Z. Y., Xie, S., Chen, S., Huang, B., Zhu, L., Gao, X., Yao, L., & Khan, S. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02618-w
In-Context Example Ordering for LLM-Based API Sequence Generation
Bhope, R. A., Venkateswaran, P., Jayaram, K. R., Isahagian, V., Muthusamy, V., & Venkatasubramanian, N. (2025) · International Middleware Conference · doi:10.1145/3721464.3777432
Designing Prompts for Shared-Experience-Focused Utterance Generation in LLM-Based Dialogue Systems
Fukushima, R., & Hashimoto, M. (2025) · Journal of Machine Intelligence and Data Science · doi:10.11159/jmids.2025.009
A Retrieval-Augmented Multimodal Framework for Scientific Reasoning in Materials Science
Luo, Z., Xu, J., Yan, Q., & Liu, C. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-4966-5_20
Jafri, R., Patil, S., Krishnakumar, P., Ali, S. A., Ali, S. A., & Hussain, S. F. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-12767-9_13
Zhou, X., Liang, X., Du, R., & Wang, Z. (2025) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc58881.2025.11343045
Human Cognitive Pattern Simulation for Crowdsourced Test Report Consistency Detection
Ling, Y., Yu, S., Chen, S., Wang, L., Fang, C., Guo, W., Liu, J., & Chen, Z. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3659293
Chain of evidence for few-shot NER with large language models
Wu, C., Zhang, Q., Xue, Y., & Zhao, H. (2026) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02849-w
Mathematical decomposition of prompt engineering in Large Language Model architecture
Jovanović, M., Živanović, M. M., & Aleksić, A. (2025) · Engineering Today · doi:10.5937/engtoday2600002j
Shi, C., Meng, T., Mao, R., & Zhou, H. (2025) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2026.01.067
From Raw to Synthetic: Evaluating LLM-Based Data Augmentation for Sentiment Analysis
Tekinay, B., & Toçoğlu, M. A. (2026) · IEEE Access · doi:10.1109/access.2026.3664756
Navigating Risk: Do LLMs Make the Right Call?
Sundaresan, D., Saad, F., Cheerla, S., & Singh, M. P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-17542-7_8
Large Language Model Judged Self-Training for Named Entity Recognition
Chen, S., Wang, J., Yang, C., Xiao, Y., Li, Z., & Lin, X. A. (2026) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3773966.3778009
Ma, H., Dou, S., Liu, Y., Xing, F., Li, F., & Pi, F. (2026) · Scientific Reports · doi:10.1038/s41598-026-39582-5
Selitskiy, S., & Inoue, C. (2025) · International Conference on Foundation and Large Language Models (FLLM) · doi:10.1109/fllm67465.2025.11391110
Mapping the Danish National Health Registries to the OMOP Common Data Model (Preprint)Preprint
Dobreva, J., Yaqoob, M., Alves, F. S., Dahl, S. C., Vesteghem, C., Nielsen, P. B., Hose, K., Bøgsted, M., & Sagi, T. (2026) · doi:10.2196/preprints.93317
Wang, Z., Wang, Y., & Zhao, W. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7081-2_26
ECLR'25: 2nd Workshop on Efficient Computing Under Limited Resources: Visual Computing
Guo, J., Chen, Z., Ma, Y., Ding, Y., Liu, X., Kim, J., Ouyang, W., & Tao, D. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00333
Reasoning-Enhanced Prompt Strategies for Multi-Label Classification
Yu, J. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00638
R$$^2$$ComSync: improving code-comment synchronization with in-context learning and reranking
Yang, Z., Lin, H., Yu, X., Keung, J., Liu, S., Chan, P. Y. P., Sun, Y., & Zhang, F. (2026) · Empirical Software Engineering · doi:10.1007/s10664-025-10800-4
Nanda, S., Majee, A., & Iyer, R. (2025) · Proceedings · doi:10.1109/icdm65498.2025.00154
Rethinking Graph Reasoning: Equip Large Language Models with Topology-Enhanced Prompt
Ma, Y., Wang, R., Chen, Q., Jiakai, L. I., Liang, S., & Qin, K. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401726
Huffman, K., Zhang, J., Huber-Fliflet, N., Wei, F., & Gronvall, P. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11400939
Comparative Evaluation of Encoder- and Decoder-Based Models for Actionable Findings in CT Reports
Fukui, Y., Harada, N., Nagatani, Y., Iguchi, H., & Watanabe, Y. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-01888-1
ELM: Leveraging Large Language Models for Reliable Emotion Recognition
Feng, R. (2025) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi67134.2025.00025
Joshi, S., & Jadhav, K. S. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00420
Emami, Y., Zhou, H., Gaitán, M. G., Li, K., Almeida, L., & Han, Z. (2026) · IEEE Wireless Communications · doi:10.1109/mwc.2026.3666489
Xin, S., Li, H., Yang, Z., Zhou, Y., Dong, L., & Chen, C. L. P. (2025) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc60802.2025.11423063
DLM-IDS: Leveraging LLM for Efficient IoT Intrusion Detection with Limited Training Data
Li, L., Zhao, M., Wang, Z., Li, G., & Xiao, B. (2025) · Globecom · doi:10.1109/globecom59602.2025.11432529
Jia, Z., Liu, J., Kou, C., Jiang, J., Li, H., Gao, H., & Liu, Q. (2026) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02898-1
Zhong, Q., Gong, J., Zhu, K., Liao, F., Liu, J., & Du, B. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6486774
Prompt Optimization Framework for Enhancing Large Language Model Response Accuracy
Sukanya, N. S., Asha, V., Srujan, D., Lasrado, S., Patil, S., & Kalgutkar, S. D. (2026) · International Conference on Sentiment Analysis and Deep Learning (ICSADL) · doi:10.1109/icsadl67539.2026.11451930
Doumanas, D., Soularidis, A., Zafeiropoulos, N., Chatzistamatis, S., Tsekouras, G. E., Saer, A. E., Nathanailidis, C., & Kotis, K. (2026) · Information · doi:10.3390/info17040342
Harnessing the Power of Multimodal and Textual Data in Industry 4.0
Pellegrain, V. (2023) · theses.fr (ABES) · doi:10.70675/7522c20fza9b4z4c4az8d8dz290dd3669716 · Cited by 1
Tang, S., Xu, Y., Teng, Z., Chang, J., Zhang, L., Wu, Z., Wang, P. H., & Shu, J. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00743-1
Sugianto, T. W. M., Prasetyo, R. D., & Prasetyo, S. Y. (2026) · International Seminar on Intelligent Business and Edge-Computing Research (ISIBER) · doi:10.1109/isiber68248.2026.11469949
TranSCoT: Towards Improving Quality of Code Translations
Meena, L., Govindappa, S., Gupta, M., Choudhury, A. R., Arya, V., Sabharwal, Y., & Bedathur, S. (2025) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3799830.3799841
Fine-Tuning or In-Context Learning? Understanding Their Trade-offs in Misinformation Detection
Kim, H. K., Nayak, S., & Skumanich, A. (2026) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3779211.3793170
Robust Multi-Domain Sentiment Classification Using DeBERTa-Based Embeddings and LightGBM
Dhiman, D., Asha, V., Vasumathi, M. T., H, V. B., Kumar, V., & Patgar, V. V. (2026) · International Conference on Intelligent Computing and Control Systems (ICICCS) · doi:10.1109/iciccs67901.2026.11502780
An Efficient Context Management System for On-Device LLMaaS
Yin, W., Xu, M., Li, Y., & Liu, X. (2026) · doi:10.1145/3774906.3800479
Traditional Machine Learning vs Large Language Models: An Empirical Study on Classification Tasks
Emam, A., Yahia, A., Ahmed, H., & Eldin, N. G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-19865-5_31
Dang, L. H., Le, T. M., Le, V., Phuong, T. M., & Tran, T. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01411-z · Cited by 2
Bati, V. S., B, A. C., Sindhya, S. H., & Kalpa, R. (2026) · International Conference on Knowledge Engineering and Communication Systems (ICKECS) · doi:10.1109/ickecs70176.2026.11528014
Robustness of Prompting: Enhancing Robustness of Large Language Models Against Prompt Attacks
Mu, L., Chu, G., Li, N., Sang, L., & Zhang, Y. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3697684 · Cited by 2
Efficient and Effective Personalized In-Context Learning for On-Device Large Model Services
Wang, H., Huang, Y., Hu, Z., Li, Q., Fan, P., Huang, Y., Wang, S., & Qi, T. (2026) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2026.3697569
Harada, Y. (2026) · Qeios · doi:10.32388/be0zbc.3 · Cited by 1
Ding, H., Zhuang, Z., Xue, L., Wang, Z., Jiang, T., Bai, R., & Feng, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6878408
BHGPT: Multiple AI Models for Built Heritage Knowledge Retrieval
Cui, C. D. L., Yan, W., Fioravanti, A., & Currà, E. (2026) · Rivista Tema · doi:10.36253/tema-16962
ICL-KB: Charting the Failure Frontier of Few-Shot LLMs
He, W., Xue, R., Jiang, S., & Dai, P. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-1468-6_9
DSE-RE: Dynamic Schema Evolution with LLM for Iterative Relation Extraction
Wang, T., Shi, D., Aguilar, J., & Zurada, J. M. (2026) · Human-Centric Intelligent Systems · doi:10.1007/s44230-026-00158-1
Epidemic Event Extraction from News Media using Large Language Models
Korat, N., Soky, K., Lay, V., Buatoom, U., & Viriyavit, W. (2025) · Conference on Digital Economy and Fintech Innovation (DEFI) · doi:10.1109/defi67526.2025.11551611
Task-Driven Generative Prompt Learning for Vision-Language Pretrained Model
Wu, Q., Zhang, X., Cheng, D., Xing, Y., Liang, G., Dang, K., & Zhang, Y. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3703499
Syharat, C. M., Zaghi, A. E., & Motaref, S. (2026) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2026.1830196
The meek shall inherit the Earth: personality, empathy, and the human shaping of LLMs
Mangalam, M. (2026) · AI and Ethics · doi:10.1007/s43681-026-01215-y
Optimizing In-Context Demonstrations for LLM-Based Automated Grading
Chu, Y., Li, H., Yang, K., Copur‐Gencturk, Y., Haudek, K. C., Krajcik, J., Shin, N., & Tang, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29755-6_20
Liu, Z., Mondol, A., Jiao, X., Chao, J., Li, L., & Xing, W. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29760-0_61
Xie, Y., Tang, F., Zhu, Y., Li, M., & Yao, F. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10070213
AI-Driven Data Extraction from Bridge Engineering Documents
Wiederer, J. W. J., Mehringer, A.-M., Hoeng, S. K., Schubert, A., Obergrießer, M., & Kraus, M. A. (2026) · Lecture notes in civil engineering · doi:10.1007/978-3-032-18712-3_46
Automatic Prompt Template Construction via Declarative Programming for Solving Math Word Problems
Li, H., Ma, K., & Yang, M. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11581607
Fukuda, H., Kawabe, W., & Sugano, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29596-5_6
Semantic Consensus-Based Multi-LLM Architecture for TÜBİTAK Proposal Generation
Aktaş, Y., Yi̇ği̇t, T., Ersoy, M., & Üncü, İ. S. (2026) · Advances in Artificial Intelligence Research · doi:10.54569/aair.1894025
Alomari, N., Redah, M., Ashraf, A., & Alshayeb, M. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10915-2
Sbih, R., Jafar, A., & Kazem, A. (2026) · IEEE Access · doi:10.1109/access.2026.3711662
Transformer-Based In-Context Learning for Distributed Channel Access Optimization
Hao, S., Li, H., & Duan, L. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3713842
Guideline-Aware Prompting for Arabic Relation Extraction with Large Language Models
habib, F. J., Ismail, S., & Mahmoud, A. M. (2026) · IEEE International Conference on Smart Sustainable Systems for Computer and Engineering Applications (3SCEA) · doi:10.1109/3scea68071.2026.11603223
Zhang, H., Xie, H., Zou, D., & Wang, F. L. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3761-6_12
Arabameri, F., Ploennigs, J., Imani, M., & Spyridis, P. (2026) · Infrastructures · doi:10.3390/infrastructures11070247
From Data to Themes: Aspect Mining Meets Agentic AI for Financial Metadata Discovery
Sharma, R. K., Bharathy, G. K., Karimi, F., Sharma, A., & Prasad, M. (2026) · International Journal of Intelligent Systems · doi:10.1155/int/6821390
Metadata
- Authors
- Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., & Zettlemoyer, L.
- Affiliations
- University of Washington (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Pages
- 11048-11064
- arXiv
- 2202.12837
- OpenAlex
- W4385567149
- Cited by
- 752
- References
- 57
- Citations by year
- 2026: 135 · 2025: 227 · 2024: 179 · 2023: 191 · 2022: 20
- FWCI
- 85.30
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (2044660)
- Office of Naval Research (N00014-18, N00014-18-1-2826, ONR-N00014, N00014)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- in-context learning, demonstrations, large language models, label noise, input distribution, label space, GPT-3, classification tasks, multiple-choice tasks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review