Answering Questions by Meta-Reasoning over Multiple Chains of Thought
Open accessAbstract
Modern systems for multi-hop question answering (QA) typically break questions into a sequence of reasoning steps, termed chain-of-thought (CoT), before arriving at a final answer. Often, multiple chains are sampled and aggregated through a voting mechanism over the final answers, but the intermediate steps themselves are discarded. While such approaches improve performance, they do not consider the relations between intermediate steps across chains and do not provide a unified explanation for the predicted answer. We introduce Multi-Chain Reasoning (MCR), an approach which prompts large language models to meta-reason over multiple chains of thought, rather than aggregating their answers. MCR examines different reasoning chains, mixes information between them and selects the most relevant facts in generating an explanation and predicting the answer. MCR outperforms strong baselines on 7 multi-hop QA datasets. Moreover, our analysis reveals that MCR explanations exhibit high quality, enabling humans to verify its answers.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
More sophisticated RAG methods are able to integrate information across new or updated knowledge elements.
“More sophisticated RAG methods, which perform multiple steps of retrieval and generation from an LLM, are even able to integrate information across new or updated knowledge elements[38, 64, 72, 78, 88, 90, 92], another crucial aspect of long-term memory systems.”
From HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models (2024) · cites this paper as [92]
The Method and Analysis sections describe multiple retrieval-and-generation steps and show that MCR can combine facts from different reasoning chains. Appendix B.3 says the system retrieves from an updated Wikipedia source, but it does not establish that MCR integrates information specifically across new or updated knowledge elements. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · see citing works
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602 · see citing works
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263 · see citing works
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590 · see citing works
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W., Salakhutdinov, R., & Manning, C. D. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1259 · Cited by 1,804 · see citing works
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T. L., Cao, Y., & Narasimhan, K. (2023) · arXiv · doi:10.48550/arxiv.2305.10601 · Cited by 1,158 · see citing works
Reflexion: Language Agents with Verbal Reinforcement Learning
Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11366 · Cited by 1,087 · see citing works
Self-Consistency Improves Chain of Thought Reasoning in Language Models
Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowdhery, A., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2203.11171 · Cited by 829 · see citing works
Complexity-Based Prompting for Multi-Step ReasoningPreprint
Fu, Y., Peng, H.-C., Sabharwal, A., Clark, P., & Khot, T. (2022) · International Conference on Learning Representations · doi:10.48550/arxiv.2210.00720 · Cited by 670 · see citing works
Towards a Human-like Open-Domain Chatbot
Adiwardana, D., Luong, M.-T., So, D. R., Hall, J., Fiedel, N., Thoppilan, R., Yang, Z., Kulshreshtha, A., Nemade, G., Lu, Y., et al. (2020) · arXiv · doi:10.48550/arxiv.2001.09977 · Cited by 614 · see citing works
ReAct: Synergizing Reasoning and Acting in Language Models
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.03629 · Cited by 608 · see citing works
Training Verifiers to Solve Math Word Problems
Cobbe, K., Kosaraju, V., Bavarian, M., Chen, M., Jun, H., Kaiser, L., Plappert, M., Tworek, J., Hilton, J., Nakano, R., et al. (2021) · arXiv · doi:10.48550/arxiv.2110.14168 · Cited by 575 · see citing works
The Web as a Knowledge-Base for Answering Complex Questions
Talmor, A., & Berant, J. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1059 · Cited by 520 · see citing works
Self-citationWelbl, J., Stenetorp, P., & Riedel, S. (2018) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.1162/tacl_a_00021 · Cited by 459 · see citing works
In-Context Retrieval-Augmented Language Models
Ram, O., Levine, Y., Dalmedigos, I., Muhlgay, D., Shashua, A., Leyton-Brown, K., & Shoham, Y. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00605 · Cited by 449 · see citing works
Least-to-Most Prompting Enables Complex Reasoning in Large Language Models
Zhou, D., Schärli, N., Hou, L., Wei, J., Scales, N., Wang, X., Schuurmans, D., Cui, C., Bousquet, O., Le, Q., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.10625 · Cited by 380 · see citing works
ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction
Santhanam, K., Khattab, O., Saad-Falcon, J., Potts, C., & Zaharia, M. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.272 · Cited by 353 · see citing works
Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions
Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.557 · Cited by 349 · see citing works
Measuring and Narrowing the Compositionality Gap in Language Models
Press, O., Zhang, M., Min, S., Schmidt, L., Smith, N., & Lewis, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.378 · Cited by 303 · see citing works
♫ MuSiQue: Multihop Questions via Single-hop Question Composition
Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00475 · Cited by 283 · see citing works
Reasoning with Language Model Prompting: A Survey
Qiao, S., Ou, Y., Zhang, N., Chen, X., Yao, Y., Deng, S., Tan, C., Huang, F., & Chen, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.294 · Cited by 218 · see citing works
(2022) · doi:10.52202/068431-1126 · Cited by 182 · see citing works
B reak It Down: A Question Understanding Benchmark
Wolfson, T., Geva, M., Gupta, A., Gardner, M., Goldberg, Y., Deutch, D., & Berant, J. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00309 · Cited by 136 · see citing works
Self-citationSelection-Inference: Exploiting Large Language Models for Interpretable Logical ReasoningPreprint
Creswell, A., Shanahan, M., & Higgins, I. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.09712 · Cited by 122 · see citing works
MultiModalQA: Complex Question Answering over Text, Tables and ImagesPreprint
Talmor, A., Yoran, O., Catav, A., Lahav, D., Wang, Y., Asai, A., Ilharco, G., Hajishirzi, H., & Berant, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06039 · Cited by 91 · see citing works
Self-citationTeaching Large Language Models to Self-Debug
Chen, X., Lin, M., Schärli, N., & Zhou, D. (2023) · arXiv · doi:10.48550/arxiv.2304.05128 · Cited by 77 · see citing works
QuaRTz: An Open-Domain Dataset of Qualitative Relationship Questions
Tafjord, O., Gardner, M., Lin, K., & Clark, P. E. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1608 · Cited by 64 · see citing works
Evaluating Explanations: How Much Do Explanations from the Teacher Aid Students?
Pruthi, D., Bansal, R., Dhingra, B., Soares, L. B., Collins, M., Lipton, Z. C., Neubig, G., & Cohen, W. W. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00465 · Cited by 60 · see citing works
FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationPreprint
Aly, R., Guo, Z., Schlichtkrull, M., Thorne, J., Vlachos, A., Christodoulopoulos, C., Cocarascu, O., & Mittal, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05707 · Cited by 57 · see citing works
Recitation-Augmented Language Models
Sun, Z., Wang, X., Tay, Y., Yang, Y., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2210.01296 · Cited by 34 · see citing works
Entailer: Answering Questions with Faithful and Truthful Chains of Reasoning
Tafjord, O., Mishra, B. D., & Clark, P. A. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.134 · Cited by 31 · see citing works
Making Retrieval-Augmented Language Models Robust to Irrelevant Context
Yoran, O., Wolfson, T., Ram, O., & Berant, J. (2023) · arXiv · doi:10.48550/arxiv.2310.01558 · Cited by 26 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Reflexion: Language Agents with Verbal Reinforcement Learning
Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11366 · Cited by 1,087 · see citing works
“Yoran et al. [31] and Nair et al. [16] use decider models to reason over several generations.”
Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy
Shao, Z., Gong, Y., Shen, Y., Huang, M., Duan, N., & Chen, W. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.620 · Cited by 200 · see citing works
Reasoning with Language Model Prompting: A Survey
Qiao, S., Ou, Y., Zhang, N., Chen, X., Yao, Y., Deng, S., Tan, C., Huang, F., & Chen, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.294 · Cited by 218 · see citing works
ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMs
Chen, J., Saha, S., & Bansal, M. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.381 · Cited by 64 · see citing works
DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines
Khattab, O., Singhvi, A., Maheshwari, P., Zhang, Z., Santhanam, K., Vardhamanan, S., Haq, S., Sharma, A., Joshi, T. T., Moazam, H., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.03714 · Cited by 60 · see citing works
“…in-context learning has proved transformative, we argue that the true expressive power in this emerging paradigm is in building sophisticated text transformation graphs in which composable modules and optimizers (teleprompters) come together to leverage LMs in more systematic and reliable ways.”
BackgroundLM vs LM: Detecting Factual Errors via Cross Examination
Cohen, R., Hamri, M., Geva, M., & Globerson, A. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.778 · Cited by 60 · see citing works
Efficient Prompting for LLM-Based Generative Internet of Things
Xiao, B., Kantarcı, B., Kang, J., Niyato, D. T., & Guizani, M. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3470210 · Cited by 60 · see citing works
IdealGPT: Iteratively Decomposing Vision and Language Reasoning via Large Language Models
You, H., Sun, R., Wang, Z., Chen, L., Wang, G., Ayyubi, H., Chang, K.-W., & Chang, S. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.755 · Cited by 46 · see citing works
Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models
Wang, H., & Shu, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.416 · Cited by 49 · see citing works
HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models
Gutiérrez, B. J., Shu, Y., Gu, Y., Yasunaga, M., & Su, Y. (2024) · arXiv · doi:10.48550/arxiv.2405.14831 · Cited by 152 · see citing works
“More sophisticated RAG methods, which perform multiple steps of retrieval and generation from an LLM, are even able to integrate information across new or updated knowledge elements[30, 49, 55, 61, 69, 71, 73], another crucial aspect of long-term memory systems.”
SEMINT: an LLM-empowered long-term vessel trajectory prediction framework
Chen, N., Yang, A., Wu, H., Chen, L., Xiong, W., & Jing, N. (2025) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2025.2487990 · Cited by 19 · see citing works
Probabilistic Tree-of-thought Reasoning for Answering Knowledge-intensive Complex Questions
Cao, S., Zhang, J., Shi, J., Lv, X., Yao, Z., Tian, Q., Hou, L., & Li, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.835 · Cited by 17 · see citing works
Leveraging Structured Information for Explainable Multi-hop Question Answering and Reasoning
Li, R., & Du, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.452 · Cited by 12 · see citing works
Liu, Y., Zhu, J., Liu, X., Tang, H., Zhang, Y., Zhang, K., Zhou, X., & Chen, E. (2025) · Proceedings · doi:10.1109/icdm65498.2025.00055 · Cited by 23 · see citing works
A review on persian question answering systems: from traditional to modern approaches
Jolfaei, S. A., & Mohebi, A. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11122-z · Cited by 8 · see citing works
Allies: Prompting Large Language Model with Beam Search
Sun, H., Liu, X., Gong, Y., Zhang, Y., Jiang, D., Yang, L., & Duan, N. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.247 · Cited by 7 · see citing works
Fine-Grained Entity Recognition via Large Language Models
Qiao, X., Gu, S., Cheng, J., Chen, P., Xiong, Z., Shen, H., & Jiang, G. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3574197 · Cited by 4 · see citing works
Effective Tool Augmented Multi-Agent Framework for Data Analysis
Zhang, X., Mao, Z., Chen, Z., & Gao, S. (2024) · Data Intelligence · doi:10.3724/2096-7004.di.2024.0013 · Cited by 4 · see citing works
Fan, Y. B., Hu, Z., Li, R., Wang, Y. X., Zhang, G., Tan, H., & Liang, J. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121763 · Cited by 5 · see citing works
Flows: Building Blocks of Reasoning and Collaborating AIPreprint
Josifoski, M., Klein, L., Peyrard, M., Baldwin, N., Li, Y., Geng, S., Schnitzler, J. P., Yao, Y., Wei, J., Paul, D., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.01285 · Cited by 14 · see citing works
Beyond decomposition: Hierarchical dependency management in multi‐document question answering
Zheng, X., Li, Z., Chen, Q., & Zhang, Y. (2024) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24971 · Cited by 3 · see citing works
Document Embeddings Enhance Biomedical Retrieval-Augmented Generation
Kong, Y., Yang, Z., Luo, L., Ding, Z., Wang, L., Liu, W., Zhang, Y., Xu, B., Wang, J., Sun, Y., et al. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822781 · Cited by 2 · see citing works
MDA: a multi-agent framework for data analysis task
Zhang, X., Kong, H., & Gao, S. (2025) · Neural Computing and Applications · doi:10.1007/s00521-025-11369-1 · Cited by 2 · see citing works
KnowTrace: Bootstrapping Iterative Retrieval-Augmented Generation with Structured Knowledge Tracing
Li, R. L., Dai, Q., Zhang, Z., Chen, X., Dong, Z., & Wen, J.-R. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737015 · Cited by 4 · see citing works
AtomR: Atomic Operator-Empowered Large Language Models for Heterogeneous Knowledge Reasoning
Xin, A., Liu, J., Yao, Z., Lee, Z., Cao, S., Hou, L., & Li, J. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3736849 · Cited by 4 · see citing works
Jiang, M., Huang, T., Guo, B., Lu, Y., & Zhang, F. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-7030-7_15 · Cited by 1 · see citing works
Disentangling Complex Questions in LLMs via Multi-Hop Dependency Graphs
Oruche, R., Dmonte, A., Seth, V., Zeng, Z., Zhang, Y., Zampieri, M., & Calyam, P. P. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3761037 · Cited by 1 · see citing works
Fusing Temporal Graphs into Transformers for Time-Sensitive Question Answering
Su, X., Howard, P., Hakim, N. Z., & Bethard, S. J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.67
MCot-NWU: A Multi-CoT Framework for Interpreting Chinese Internet Neologisms
Yin, B., Zong, C., Xu, Z., & Hu, N. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-9986-5_15
Step-Wise Selection from Multiple Reasoning Chains to Enhance LLMs for Multi-hop QA
Xu, T., Murayama, Y., & Izumi, K. (2025) · Transactions of the Japanese Society for Artificial Intelligence · doi:10.1527/tjsai.40-5_a-p21
EVL-MCoT: Enhanced Vision-Language Multi-CoT for Harmful Meme Detection
Yang, H., Wang, J., & Zhang, X. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3349-7_31
ToP: a Structured Pathway for Document-level Information Extraction with Large Language Models
Yin, P., Ren, Y., Fang, F., Hu, B., & Bai, X. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227926
Late-Interaction InfoNCE: A Novel Contrastive Loss Function with Combined Similarity Metrics
Bu, Y., Wang, L., Huang, T. C., Hamdulla, A., Zhang, H., & Zhang, Q. (2025) · International Symposium on Computer and Information Processing Technology (ISCIPT) · doi:10.1109/iscipt67144.2025.11264929
M o N a C o : More Natural and Complex Questions for Reasoning Across Dozens of Documents
Wolfson, T., Trivedi, H. K., Geva, M., Goldberg, Y., Roth, D., Khot, T., Sabharwal, A., & Tsarfaty, R. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.64 · Cited by 2 · see citing works
Self-citationExplaining Pre-Trained Language Models in the Context of Higher Education
Chovanec, K., Fields, J., & Madiraju, P. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402656
Lu, G., Zhan, W., Peng, L., & Li, L. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00615-8
How Generative AI Disrupts Search: An Empirical Study of Google Search, Gemini, and AI Overviews
Grossman, R., Liu, S., Chen, M. K., Smith, M., Borcea, C., & Chen, Y. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809667
Less is more: a PMA framework for zero-shot multi-hop question answering
Dong, R., Wang, X., Li, S. X., & Li, F. (2026) · Journal of Intelligent Information Systems · doi:10.1007/s10844-026-01081-4
Layered Evidence-Centric Graph Construction for Explainable Multi-hop Question Answering
Zeng, W., Xie, H., Chao, Z., Wu, Q., Liu, H., Li, S., Qu, J., & Li, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-34374-1_10
Deng, Y. (2026) · World Conference on Computer and Information Security (WCCIS) · doi:10.1109/wccis70285.2026.11651016
Construction Method for Instruction Tuning Dataset for Domain-specific Entity Extraction Tasks
Kang, C., & Shen, C. (2026) · International Conference on Computational Intelligence and Machine Learning (CIML) · doi:10.1109/ciml69155.2026.11692762
Lu, J., Fang, T., Zhang, T., Wong, D. F., Yang, M., Wang, Y., & Xu, H. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3742218
- Authors
- Yoran, O., Wolfson, T., Bogin, B., Katz, U., Deutch, D., & Berant, J.
- Affiliations
- Tel Aviv University (IL)
- Bar-Ilan University (IL)
- ORCID
- Deutch, Daniel
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 5942-5966
- arXiv
- 2304.13007
- OpenAlex
- W4389523807
- Cited by
- 38
- References
- 32
- Citations by year
- 2026: 8 · 2025: 15 · 2024: 5 · 2023: 10
- FWCI
- 6.73
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- European Commission
- H2020 European Research Council (802800)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- multi-hop question answering, chain-of-thought, meta-reasoning, explanation generation, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
