The DOI matches its DataCite record; 59 of the 61 references it cites were found in a registry or an index.
Measuring and Narrowing the Compositionality Gap in Language Models
Open accessAbstract
We investigate the ability of language models to perform compositional reasoning tasks where the overall solution depends on correctly composing the answers to sub-problems. We measure how often models can correctly answer all sub-problems but not generate the overall solution, a ratio we call the compositionality gap. We evaluate this ratio by asking multi-hop questions with answers that require composing multiple facts unlikely to have been observed together during pretraining. In the GPT-3 family of models, as model size increases we show that the single-hop question answering performance improves faster than the multi-hop performance does, therefore the compositionality gap does not decrease. This surprising result suggests that while more powerful models memorize and recall more factual knowledge, they show no corresponding improvement in their ability to perform this kind of compositional reasoning. We then demonstrate how elicitive prompting (such as chain of thought) narrows the compositionality gap by reasoning explicitly. We present a new method, self-ask, that further improves on chain of thought. In our method, the model explicitly asks itself (and answers) follow-up questions before answering the initial question. We finally show that self-ask's structured prompting lets us easily plug in a search engine to answer the follow-up questions, which additionally improves accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing benchmarks, such as HotpotQA [59], Bamboogle [38], and 2wiki [21], are often cited as multi-hop benchmarks, yet they typically involve only two information-seeking steps. Moreover, these datasets are not explicitly structured to support long-horizon interactions that necessitate the agent to manage the memory state.”
From MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents (2025) · cites this paper as [38]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Improved performance in reasoning tasks can be gained by encouraging language models to first generate internal thoughts or reasoning chains before responding (Wei et al., 2022; Adolphs et al., 2021; Wang et al., 2022; Lanchantin et al., 2023), as well as updating their initial response through self-critique (Press et al., 2022; Madaan et al., 2023).”
From Chain-of-Verification Reduces Hallucination in Large Language Models (2023) · cites this paper as Press et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Simpler decomposition methods like Self-Ask [21] often broaden context too aggressively, triggering the dilution trap.”
From Replace, Don't Expand: Mitigating Context Dilution in Multi-Hop RAG via Fixed-Budget Evidence Assembly (2025) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“as well as updating their initial response through self-critique (Press et al., 2022; Madaan et al., 2023)”
From Chain-of-Verification Reduces Hallucination in Large Language Models (2024) · cites this paper as Press et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“SelfAsk (Press et al., 2022) prompts LLMs to decompose a question into subquestions and answers these subquestions by issuing separate calls to the Google Search API.”
From Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions (2023) · cites this paper as Press et al., 2022
Experimental — accuracy not yet measured
The cited source says what the claim attributes to it.
In the citing paper
“More sophisticated RAG methods, which perform multiple steps of retrieval and generation from an LLM, are even able to integrate information across new or updated knowledge elements[38, 64, 72, 78, 88, 90, 92], another crucial aspect of long-term memory systems.”
From HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models (2024) · cites this paper as [64]
The cited source says what the claim attributes to it.
In the citing paper
“Our experiments show that FRESH- PROMPT outperforms both competing search engine-augmented prompting methods such as SELF-ASK (Press et al., 2022) as well as commercial systems such as PERPLEXITY.AI.”
From FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation (2024) · cites this paper as Press et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“Lastly, we note that our QA scores exceed those reported by recent works on few-shot prompting for open-domain QA (ODQA) (Khot et al., 2023;Press et al., 2022;Yao et al., 2022), although a fair apples-to-apples comparison with them isn't possible (cf.Appendix C).”
From Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions (2023) · cites this paper as Press et al., 2022
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“IRCoT is SOTA for few-shot multistep ODQA.14”
From Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions (2023) · cites this paper as Press et al., 2022
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101
Self-citationA Diversity-Promoting Objective Function for Neural Conversation Models
Li, J., Galley, M., Brockett, C., Gao, J., & Dolan, B. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1014 · Cited by 2,459
Large language models are zero-shot reasoners
Kojima, T., Gu, S. (., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1613 · Cited by 2,013
Vinyals, O., & Le, Q. (2015) · arXiv · doi:10.48550/arxiv.1506.05869 · Cited by 1,400
Emergent Abilities of Large Language Models
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.07682 · Cited by 1,264
Personalizing Dialogue Agents: I have a dog, do you have pets too?
Zhang, S., Dinan, E., Urbanek, J., Szlam, A., Kiela, D., & Weston, J. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1205 · Cited by 1,177
Neural Responding Machine for Short-Text Conversation
Shang, L., Lu, Z., & Li, H. (2015) · doi:10.3115/v1/p15-1152 · Cited by 1,146
Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering
Izacard, G., & Grave, E. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.74 · Cited by 1,109
Flagged first, then by citations
2 of the 61 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Sewon Min, Victor Zhong, Luke Zettlemoyer, and Han- naneh Hajishirzi. 2019. Multi-hop reading compre- hension through question decomposition and rescor- ing. ArXiv, abs/1906.02916. · arXiv
- Xi Ye and Greg Durrett. 2022. The unreliability of explanations in few-shot in-context learning. ArXiv, abs/2205.03401. · arXiv
Cited by
Sorted by citations
Items 201–300 of 326
Natural Language Querying on Domain-Specific NoSQL Database with Large Language Models
Zhang, W., He, C., Yang, G., Bandyopadhyay, D., Shi, T., & Wang, P. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822485 · Cited by 1
Investigating ChatGPT Translation Hallucination from an Embodied-Cognitive Translatology Perspective
Jiao, H., Li, X., Ding, J., & Xiao-jun, Z. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-2885-8_12 · Cited by 1
Efficient and Deployable Knowledge Infusion for Open-World Recommendations via Large Language Models
Xi, Y., Liu, W., Lin, J., Weng, M., Cai, X., Zhu, H. C., Zhu, J., Chen, B., Tang, R., Yu, Y. H., et al. (2025) · ACM Transactions on Recommender Systems · doi:10.1145/3725894 · Cited by 12
Towards a Probabilistic Framework for Analyzing and Improving LLM-Enabled Software
Baldonado, J. M., Bonomo, F., & Braberman, V. A. (2025) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw64639.2025.10962470 · Cited by 2
Moral Judgment with a Large Language Model-Based Agent
Xiong, S., Gu, H., Liang, W., & Yin, L. (2025) · Electronics · doi:10.3390/electronics14132580 · Cited by 1
Cheap Learning: Maximizing Performance of Language Models for Social Data Science Using Minimal Data
Castro-González, L., Chung, Y.-L., Kirk, H. R., Francis, J., Williams, A. R., Johansson, P., & Bright, J. (2025) · Sociological Methods & Research · doi:10.1177/00491241251340608 · Cited by 2
Leveraging medical discourse to answer complex questions
Galitsky, B. A. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-30046-2.00007-7 · Cited by 1
Advances in reasoning by prompting large language models: A survey
Hong, R., Pang, X., & Zhang, C. (2026) · Cybernetics and Intelligence · doi:10.26599/cai.2024.9390004 · Cited by 3
Towards Unified Objectives for Self-Reflective AIPreprint
Samwald, M., Praas, R., & Hebenstreit, K. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4446991 · Cited by 2
TaSR-RAG: Taxonomy-guided Structured Reasoning for Retrieval-Augmented Generation
Sun, J., Xie, Y., Shi, J., Wang, S., & Han, J. (2026) · arXiv · doi:10.48550/arxiv.2603.09341
“To investigate complex reasoning, we include several multi-hop datasets: HotpotQA [28], 2Wiki-MultiHopQA [5], MuSiQue [24], and Bamboogle [16].”
Lahmy, M., & Yozevitch, R. (2025) · arXiv · doi:10.48550/arxiv.2512.10787 · Cited by 1
“Simpler decomposition meth-ods like Self-Ask [21] often broaden context too aggressively, triggering the dilution trap.”
Continuum: Efficient and Robust Multi-Turn LLM Agent Scheduling with KV Cache Time-to-Live
Li, H., He, R., Mang, Q., Zhang, Q., Mao, H., Chen, X., Zhou, H., Zhang, H., Cheung, A., Gonzalez, J., et al. (2025) · arXiv · doi:10.48550/arxiv.2511.02230
“No Tool-Call Awareness: Wadlom et al. [50] study efficient LLM serving for agentic workflows from a data-systems perspective.”
SmartSearch: How Ranking Beats Structure for Conversational Memory Retrieval
Derehag, J., Calva, C., & Ghiurau, T. (2026) · arXiv · doi:10.48550/arxiv.2603.15599
“Self-Ask (Press et al., 2023) decomposes complex questions into sub-questions answered sequentially.”
MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents
Zhou, Z., Qu, A., Wu, Z., Kim, S., Prakash, A., Rus, D., Zhao, J., Low, B. K. H., & Liang, P. P. (2025) · arXiv · doi:10.48550/arxiv.2506.15841 · Cited by 218
“Existing benchmarks, such as HotpotQA [59], Bamboogle [38], and 2wiki [21], are often cited as multi-hop benchmarks, yet they typically involve only two information-seeking steps.”
SealQA: Raising the Bar for Reasoning in Search-Augmented Language Models
Pham, T., Nguyen, N., Zunjare, P., Chen, W., Tseng, Y.-M., & Vu, T. (2025) · arXiv · doi:10.48550/arxiv.2506.01062
“ASK [Press et al., 2023] to inject G OOGLE search results into the prompt.”
Mitigating Context Interference for Reliable and Efficient Search Agents
Xue, B., Wu, B., Qiao, S., Wang, S., Wang, R., Du, Y., Wang, H., Pan, J. Z., Yilmaz, E., Wong, K.-F., et al. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2026.acl-long.160
“Multi-hop QA includes: 1) HotpotQA (Yang et al., 2018), the first large-scale dataset requiring reasoning across multiple Wikipedia paragraphs; 2) 2WikiMultiHopQA (2Wiki) (Ho et al., 2020), which provides evidence information containing a reasoning path for multi-hop questions; 3) MuSiQue (Trivedi et al., 2022), which…”
Zhou, S., Yetişgen, M., & Mari Ostendorf, E. (2023) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2023.clinicalnlp-1.38 · Cited by 1
Retrieval-Augmented Parsing for Complex Graphs by Exploiting Structure and Uncertainty
Zi, L., Yuan, Q., Pasupat, P., Liu, J. Z., & Shang, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.419
Simple and Effective Input Reformulations for Translation
Yu, B., Lillemark, H. J., & Keutzer, K. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.638
When Do Decompositions Help for Machine Reading?
Wei, K., Lawrie, D., Durme, B. V., Chen, Y., & Weller, O. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.219 · Cited by 2
FastLearn: A Rapid Learning Agent for Chat Models to Acquire Latest Knowledge
Fu, C., Wang, G., Lu, R., & Tang, S. (2024) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr62202.2024.00035 · Cited by 1
Complex Claim Verification via Human Fact-Checking Imitation with Large Language Models
Xu, B., Sun, F., Liu, X., Wu, P., Wang, X., & Pan, L. (2024) · International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP) · doi:10.1109/isai-nlp64410.2024.10799276 · Cited by 1
Success and failure of compositional generalisation in distributional models of language
Mao, S., Huebner, P. A., & Willits, J. A. (2025) · Language Cognition and Neuroscience · doi:10.1080/23273798.2024.2443861
A Multi-Attribute Mixture Expert Reasoning Approach Based on Large Language ModelsPreprint
Zhang, L., Yuan, J., He, Y., Yu, M., Zhu, K., Luo, J., Yu, Z., & Li, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5167458
CRMR: A Collaborative Multistep Reasoning Framework for Solving Mathematical Problems
Zhang, Y., Tang, X., & Hao, K. (2025) · Machine Intelligence Research · doi:10.1007/s11633-024-1531-3 · Cited by 1
Mitigating error propagation in multi-hop fact verification with logic reasoning
Lyu, X., Cao, C., Sun, M., & Xu, R. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02679-w
Step-Wise Selection from Multiple Reasoning Chains to Enhance LLMs for Multi-hop QA
Xu, T., Murayama, Y., & Izumi, K. (2025) · Transactions of the Japanese Society for Artificial Intelligence · doi:10.1527/tjsai.40-5_a-p21
Rethinking Data Use in Large Language Models
Min, S., Hajishirzi, H., & Zettlemoyer, L. (2025) · Computational Linguistics · doi:10.1162/coli.a.573
Self-citationAdaptive complex knowledge base question answering with program decomposition chain
Wang, D., Zhou, S., Liang, K., Liu, G., Qian, C., Ren, H., & Huang, J. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131736
Prompt Engineering: Gute Frage, gutes Ergebnis
Lang, F. U. (2025) · Springer eBooks · doi:10.1007/978-3-662-71542-0_3
Schmidt, D. M., Schubert, R., & Cimiano, P. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-09527-5_1
Liu, M., Yang, C., Jiang, B., & Lei, C. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209576
GenR1-Searcher: Curriculum Reinforcement Learning for Dynamic Retrieval and Document Generation
Wang, Y., Zhao, Y., Duan, R., Li, J., Wang, Y., & Zhang, K. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3760903
Chen, X., Xu, Y., Han, W., Luo, L., & Yang, L. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3349-7_10
Debiasing Event Causality Identification in Large Language Models via Back-Door Adjustment
Xie, M., Han, R., & Yu, S. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228257
ToP: a Structured Pathway for Document-level Information Extraction with Large Language Models
Yin, P., Ren, Y., Fang, F., Hu, B., & Bai, X. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227926
Probing the reasoning abilities of LLMs in blocks world
Zhao, K. Z., & Macbeth, J. (2025) · Cognitive Systems Research · doi:10.1016/j.cogsys.2025.101421
Training LLM with Human Feedback
Rezaei, H., Beheshti, A., & Rabhi, F. (2025) · Springer eBooks · doi:10.1007/978-981-95-3658-0_53
Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers
Zhang, Z., Lin, P., Wang, Z., Zhang, Y., & Xu, Z. J. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3646483
Comparison of representative demonstration designing methods of Language Models
Tiwari, S. (2023) · Open Research Knowledge Graph (ORKG) · doi:10.48366/r598308
FoVer: First-Order Logic Verification for Natural Language Reasoning
Pei, Y., Du, Y., & Jin, X. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.41
River Connectivity: A Comparative Review Between AI and Experts
Negreiros, B., Jenkins, C., Wieprecht, S., & Schwindt, S. (2025) · Water Resources Research · doi:10.1029/2025wr042117
MAD-HD: Multi-agent Debate-Driven Ungrounded Hallucination Detection
Gao, Z., Bao, F., & Li, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3343-5_39
The Transformer Era of Generative Intelligence: Evolution of Language and Vision Models
Wang, Z. (2025) · Springer eBooks · doi:10.1007/978-981-95-2525-6_7
Unlocking In-Context Learning for Natural Datasets Beyond Language Modelling
Bratulić, J., Mittal, S., Hoffmann, D. T., Böhm, S., Schirrmeister, R. T., Ball, T., Rupprecht, C., & Brox, T. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-12840-9_20 · Cited by 2
M o N a C o : More Natural and Complex Questions for Reasoning Across Dozens of Documents
Wolfson, T., Trivedi, H. K., Geva, M., Goldberg, Y., Roth, D., Khot, T., Sabharwal, A., & Tsarfaty, R. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.64 · Cited by 12
Cui, H., Gu, J., Peng, J., Wang, T., & Wu, X. (2026) · Information · doi:10.3390/info17020116
Baba Is LLM: Reasoning in a Game with Dynamic Rules
van Wetten, F., Plaat, A., & van Duijn, M. J. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-15632-7_4 · Cited by 5
DKF-RAG: Dynamic Knowledge Fusion-enhanced Retrieval-Augmented Generation
Wei, Y., Li, W., & Han, J. (2025) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc58881.2025.11343223
Bootstrapping in the Loop: Multi-hop Question Answering via Alternating Decomposition and Retrieval
He, J., Guan, Z., Zhang, F., Zhang, Z., & Xu, Y. (2026) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3773966.3779382
Adaptive retrieval-enhanced generation system based on query complexity awareness
柴敬尧, CHEN, Z., Li, T., & Zhang, C. (2025) · International Conference on Artificial Intelligence and Computer Engineering (ICAICE) · doi:10.1109/icaice68195.2025.11382483
Ask First, Test on Demand: A Deference-Gated Socratic Agent Design
Urteaga-Reyesvera, J. C., & Martínez, R. C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-17933-3_3
Retrieval-Augmented Generation for Multi-Hop Question Answering Based on Structured Planning
Huang, Y., Yang, L., Yang, X.-H., & Xu, X. (2026) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3789506
Chen, Y., Ye, Y., & Wei, X. (2026) · International Conference on Consumer Electronics and Computer Engineering (ICCECE) · doi:10.1109/iccece69169.2026.11399818
Calibrated Query Augmentation and Dual Preference Alignment for Retrieval-Augmented Generation
Wu, J., Xue, Z., Ou, S., Yu, L., Shao, Y., & Ye, G. (2026) · IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp68355.2026.00028
Wang, X., Liang, Y., Dong, R., & Li, F. (2025) · International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI) · doi:10.1109/cei66465.2025.11398457
Lim, H. (2026) · Journal of Youth Impact · doi:10.66245/jyi.v1.i1.002
LLM-TripPlanner: A Large-Language-Model-Based Agent for Personalized Trip Planning
Liu, Y., Chung, H., Xu, Z., Jang, K., Chen, S., & Chen, T. (2025) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc60802.2025.11423528
Metacognitive Multi-agent Retrieval-Augmented Generation for Multi-hop Reasoning
Iturra-Bocaz, G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21324-2_42
Hallucination-aware Retrieval Augmented Generation with Evidence-based Semantic Clustering
Jin, C., Lu, Y., Nie, J., & Yu, S. (2026) · International Conference on Artificial Intelligence and Social Network Systems (AISNS) · doi:10.1109/aisns67921.2026.11440643
SmartQueryViz:An AI-Driven MongoDB Query Generator and Visualizer for Sensor-Based Applications
Velvizhi, S., Sahana, S., & Sivaprabha, M. E. (2026) · International Conference on Advances in Intelligent Computing and Applications (AICAPS) · doi:10.1109/aicaps68631.2026.11453151
Wang, Z., & Chen, W. (2026) · Synthesis lectures on human language technologies · doi:10.1007/978-3-032-06264-2_2
CompactRAG: Reducing LLM Calls and Token Overhead in Multi-Hop Question Answering
Yang, H., Yang, Z., Zhang, X., Wei, W., Zhang, Y., & Yang, L. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792512 · Cited by 2
Toward Generalized Web Agent Training: A Deep Dive into Entropy-Balanced Reinforcement Learning
Dong, G., Bao, L., Wang, Z., Zhao, K., Li, X., Jin, J., Yang, J., Mao, H., Zhang, F., Gai, K., et al. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792301 · Cited by 3
Jarsania, J., & Patel, V. (2025) · International Conference on Artificial Intelligence, Blockchain, Cloud Computing, and Data Analytics (ICoABCD) · doi:10.1109/icoabcd67551.2025.11470747
Grasnick, A. (2026) · Springer eBooks · doi:10.1007/978-3-658-47898-8_14-1
HyKAG: Hybrid Knowledge-Aware Retrieval-Augmented Generation for Knowledge-Intensive Questions
Zhao, Q., Wang, R., Zha, D., & Tang, Z. G. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7078-2_33
Reason to Retrieve: Structured Chain-of-Thought for Text-Video Retrieval
Chen, Y., Chen, S., Huang, Q., & Wang, G. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463500
MTSearch-R1: Reinforcement Learning for Flexible Multi-Tool Search with Large Language Models
Shen, Y., & Ke, J. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11461921
TRACE: Optimizing Multi-Hop Question Answering via Confidence-Guided Retrieval Assimilation
Han, Y., Pei, Y., Luo, H., Ji, B., Wang, J., Lu, Y., & Ren, F. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11460451
Automating structured reasoning with entity-driven semantic simplification in Llms
Liao, J., Yan, C., Wang, P., & Wan, Y. (2026) · Systems Science & Control Engineering · doi:10.1080/21642583.2026.2672171
Zhao, R., Zhao, F., & Xu, G. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-0369-7_34
Dang, L. H., Le, T. M., Le, V., Phuong, T. M., & Tran, T. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01411-z · Cited by 2
Prompt Engineering: Good Question, Good Result
Lang, F. (2026) · Springer eBooks · doi:10.1007/978-3-662-73208-3_3
Learning Collaborative Reasoning Strategies Through Trust-Weighted Multi-Agent Consensus
Shakya, P., Bataju, K., Ghimire, K., Mandal, A., Gyawali, S., Awale, M., Dahal, M., Adhikari, S., Rijal, S., You, Y. H., et al. (2026) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai68641.2026.11536431
Unlocking In-Context Learning for Natural Datasets Across Modalities
Bratulić, J., Mittal, S., Hoffmann, D. T., Böhm, S., Schirrmeister, R. T., Ball, T., Rupprecht, C., & Brox, T. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02913-0
A Multi-Agent Orchestrated RAG System for Intelligent Information Retrieval
Gupta, V., Dixit, A., & Sethi, S. (2026) · International Conference on Innovations in Computational Intelligence (ICICI) · doi:10.1109/icici68867.2026.11565018
DynaChain: On-Demand Retrieval-Augmented Generation via Dynamic Reasoning Chain Correction
Cui, H., Chen, Y., Kou, X., Ding, Y., & Wang, H. (2026) · International Conference on Artificial Intelligence and Industrial Technology Applications (AIITA) · doi:10.1109/aiita69518.2026.11567339
ConCise: Training-Free Conclusion-Chain State Compression for Cost-Efficient Multi-Step RAG Services
Yan, K., Tang, Z., Wang, T., & Weijia Jia, B. (2026) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws72778.2026.00092
V-CoT: A Collaborative Multi-Role Approach to Visual Reasoning
Liu, G., Zhu, P., & Hou, Q. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582533
Lee, Y., Hur, M., & Min, M. (2026) · Scientometrics · doi:10.1007/s11192-026-05729-4
Recursive Short-to-Long Generalization for Multi-hop Reasoning
Xu, M., Sun, K., Chen, J., Pi, Q., Su, G., Ning, Y., Li, Y., Zhu, Y., Zhong, M., Jiang, J., et al. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809697
DECAR: Dual Evidence Chain Reasoning via Anchor–Boundary Agents for LLM-KG Integration
Zhang, B., Bai, S., & 包亚倩 (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3432-5_47
Uncertainty Quantification for Multimodal Retrieval Augmented Generation
Binz, S., Soudani, H., & Hasibi, F. (2026) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3805713.3820431
DLLM-Searcher: Adapting Diffusion Language Model for Efficient Search Agents
Zhao, J., Xu, S., Sun, Z., Zhu, F., Ou, J., Shi, Y., Li, C., Zhang, X., & Xu, J. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809643 · Cited by 12
Query-Aware Context Selection for Retrieval-Augmented Generation
Iratni, M., Boughanem, M., & Dkaki, T. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809959
Tool-Star: Empowering Multi-Tool Collaborative Web Agent via Reinforcement Learning
Dong, G., Chen, Y., Li, X., Jin, J., Qian, H., Zhu, Y., Mao, H., Zhou, G., Dou, Z., & Wen, J.-R. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809712 · Cited by 2
STRIDE: Strategic Iterative Decision-Making for Retrieval-Augmented Multi-Hop Question Answering
Chen, W., Zhao, L., Zheng, Z., Hou, H., & Xu, T. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809703 · Cited by 2
SmartSearch: Process Reward-Guided Query Refinement for Search Agents
Wen, T., Dong, G., & Dou, Z. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809700 · Cited by 16
How Generative AI Disrupts Search: An Empirical Study of Google Search, Gemini, and AI Overviews
Grossman, R., Liu, S., Chen, M. K., Smith, M., Borcea, C., & Chen, Y. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809667
LLM-Oriented Information Retrieval: A Denoising-First Perspective
Dai, L., Sun, L., Cao, F., Rao, Z., Yang, C., Liu, H., & Xiong, H. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808544 · Cited by 2
Deng, W., Liu, Y., & Cui, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3426-4_8
RAGnRoll: Learning to Iteratively Retrieve and Generate Attributable Answer Snippets
Djeddal, H., Soulier, L., Pinel-Sauvagnat, K., Katrenko, S., Erbacher, P., & Tamine, L. (2026) · ACM Transactions on Information Systems · doi:10.1145/3831679
Less is more: a PMA framework for zero-shot multi-hop question answering
Dong, R., Wang, X., Li, S. X., & Li, F. (2026) · Journal of Intelligent Information Systems · doi:10.1007/s10844-026-01081-4
Nicolau, S., Molina, A., Ramos-Terrades, O., & Lladós, J. (2026) · IEEE International Conference on Document Analysis and Recognition · doi:10.1007/978-3-032-36039-7_14 · Cited by 1
Operational AI Assistance in Slack-Based Troubleshooting: A Measurement Framework and Field Results
Bommareddy, R. K. R. (2026) · IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology (IAICT) · doi:10.1109/iaict71158.2026.11620929
TRIP: A Bi-level Travel Routing Intelligent Planner Informed from Human Planning Behaviors
Liu, Y., Zhang, R., Chen, Y., Sun, L., & Zhu, T. (2026) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3836768
RAPO: Expanding Exploration for LLM Agents via Retrieval-Augmented Policy Optimization
Zhang, S., Xiong, Y., Chen, X., Jia, Z., Huang, R. L., Xu, J., & Zhang, J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817803 · Cited by 1
Think Less, Act Warranted: Efficient Tool-Integrated Reasoning via Dual-Efficiency Regularization
Xiao, Y., Gong, S., & Yue, L. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817650
CB-VQA: Chain-Bridge Visual Question Answering via Question-Aware Intermediate Validation
Cui, M., Ge, H., Yan, J. M., Liu, Y., & Long, S. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3723109
Metadata
- Authors
- Press, O., Zhang, M., Min, S., Schmidt, L., Smith, N. A., & Lewis, M.
- Affiliations
- University of Washington (US)
- Allen Institute for Artificial Intelligence (US)
- Corresponding author
- Press, Ofir
- ORCID
- Smith, Noah A.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Pages
- 5687-5711
- arXiv
- 2210.03350
- OpenAlex
- W4389520103
- Cited by
- 294
- References
- 61
- Citations by year
- 2026: 90 · 2025: 90 · 2024: 44 · 2023: 69 · 2022: 1
- FWCI
- 52.09
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (2113530)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- compositional reasoning, multi-hop question answering, chain-of-thought prompting, GPT-3, model size scaling, structured prompting, search engine integration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
