The DOI matches its DataCite record; 17 of the 17 references it cites were found in a registry or an index.
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
Open accessAbstract
Existing question answering (QA) datasets fail to train QA systems to perform complex reasoning and provide explanations for answers. We introduce HotpotQA, a new dataset with 113k Wikipedia-based question-answer pairs with four key features: (1) the questions require finding and reasoning over multiple supporting documents to answer; (2) the questions are diverse and not constrained to any pre-existing knowledge bases or knowledge schemas; (3) we provide sentence-level supporting facts required for reasoning, allowing QA systems to reason with strong supervision and explain the predictions; (4) we offer a new type of factoid comparison questions to test QA systems' ability to extract relevant facts and perform necessary comparison. We show that HotpotQA is challenging for the latest QA systems, and the supporting facts enable models to improve performance and make explainable predictions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We modify the DSPy framework [24] for joint optimization, lowering cost while maintaining accuracy on HotPotQA [60].”
From AI Agents That Matter (2024) · cites this paper as [60]
In the citing paper
“Multi-step reasoning in LLMs typically involves executing sequential logical operations-typically requiring 3-10 intermediate steps-to arrive at solutions that cannot be derived through single-step inference (Cobbe et al., 2021; Yang et al., 2018; Suzgun et al., 2022).”
From Survey on Evaluation of LLM-based Agents (2025) · cites this paper as Yang et al., 2018
In the citing paper
“For example, Reflexion (Shinn et al., 2023) tracks success rate on tasks like HotPotQA (Yang et al., 2018) and ALFWorld (Shridhar et al., 2021), while RAISE (Liu et al., 2024a) enhances the ReAct framework with a two-part memory system evaluated through human judgment on quality metrics and efficiency.”
From Survey on Evaluation of LLM-based Agents (2025) · cites this paper as Yang et al., 2018
Citations
Cites
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J. R., Bethard, S. J., & McClosky, D. (2014) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.3115/v1/p14-5010 · Cited by 7,252
Self-citationSQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T., et al. (2016) · arXiv · doi:10.48550/arxiv.1611.09268 · Cited by 2,473
Know What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Joshi, M., Choi, E., Weld, D., & Zettlemoyer, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1147 · Cited by 1,690
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · arXiv · doi:10.48550/arxiv.1606.05250 · Cited by 678
Gated Self-Matching Networks for Reading Comprehension and Question Answering
Wang, W., Yang, N., Wei, F., Chang, B., & Zhou, M. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1018 · Cited by 674
The Web as a Knowledge-Base for Answering Complex Questions
Talmor, A., & Berant, J. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1059 · Cited by 520
Simple and Effective Multi-Paragraph Reading Comprehension
Clark, C., & Gardner, M. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1078 · Cited by 434
Why We Need New Evaluation Metrics for NLG
Novikova, J., Dušek, O., Cercas Curry, A., & Rieser, V. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1238 · Cited by 422
Cited by
Sorted by citations
How is ChatGPT's behavior changing over time?
Chen, L., Zaharia, M., & Zou, J. (2023) · arXiv · doi:10.48550/arxiv.2307.09009 · Cited by 507
CTRL: A Conditional Transformer Language Model for Controllable Generation
Keskar, N. S., McCann, B., Varshney, L. R., Xiong, C., & Socher, R. (2019) · arXiv · doi:10.48550/arxiv.1909.05858 · Cited by 751
Retrieval-Augmented Generation for Large Language Models: A Survey
Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, M., & Wang, H. (2023) · arXiv · doi:10.48550/arxiv.2312.10997 · Cited by 876
Adversarial NLI: A New Benchmark for Natural Language Understanding
Nie, Y., Williams, A., Dinan, E., Bansal, M., Weston, J., & Kiela, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.441 · Cited by 656
ReAct: Synergizing Reasoning and Acting in Language Models
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.03629 · Cited by 608
BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment AnalysisPreprint
Xu, H., Liu, B., Shu, L., & Yu, P. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.02232 · Cited by 553
Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models
Zhang, Q., Hu, C., Upasani, S., Ma, B., Hong, F., Kamanuru, V., Rainton, J., Wu, C., Ji, M., Li, H., et al. (2025) · arXiv · doi:10.48550/arxiv.2510.04618 · Cited by 370
Clark, J. H., Choi, E., Collins, M., Garrette, D., Kwiatkowski, T., Nikolaev, V., & Palomaki, J. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00317 · Cited by 477
♫ MuSiQue: Multihop Questions via Single-hop Question Composition
Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00475 · Cited by 283
Autoregressive Entity RetrievalPreprint
Cao, N. D., Izacard, G., Riedel, S., & Petroni, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.00904 · Cited by 384
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
Xiong, L., Xiong, C., Li, Y., Tang, K.-F., Liu, J., Bennett, P., Ahmed, J., & Overwijk, A. (2020) · arXiv · doi:10.48550/arxiv.2007.00808 · Cited by 204
ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading ComprehensionPreprint
Zhang, S., Liu, X., Liu, J., Gao, J., Duh, K., & Durme, B. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12885 · Cited by 339
Self-citationTransformers as Soft Reasoners over Language
Clark, P., Tafjord, O., & Richardson, K. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/537 · Cited by 176
The NLP Cookbook: Modern Recipes for Transformer Based Deep Learning Architectures
Singh, S. K., & Mahmood, A. (2021) · IEEE Access · doi:10.1109/access.2021.3077350 · Cited by 178
Hallucination‐Free? Assessing the Reliability of Leading AI Legal Research Tools
Magesh, V., Surani, F., Dahl, M., Suzgun, M., Manning, C. D., & Ho, D. E. (2025) · Journal of Empirical Legal Studies · doi:10.1111/jels.12413 · Cited by 182
Self-citationLearning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering
Asai, A., Hashimoto, K., Hajishirzi, H., Socher, R., & Xiong, C. (2019) · arXiv · doi:10.48550/arxiv.1911.10470 · Cited by 152
Question Answering Over Temporal Knowledge Graphs
Saxena, A., Chakrabarti, S., & Talukdar, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.520 · Cited by 91
ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systems
Saad-Falcon, J., Khattab, O., Potts, C., & Zaharia, M. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2024.naacl-long.20 · Cited by 148
Training Question Answering Models From Synthetic Data
Puri, R., Spring, R., Shoeybi, M., Patwary, M. A., & Catanzaro, B. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.468 · Cited by 161
B reak It Down: A Question Understanding Benchmark
Wolfson, T., Geva, M., Gupta, A., Gardner, M., Goldberg, Y., Deutch, D., & Berant, J. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00309 · Cited by 150
Neural Module Networks for Reasoning over TextPreprint
Gupta, N., Lin, K., Roth, D., Singh, S., & Gardner, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.04971 · Cited by 94
Explaining Answers with Entailment Trees
Dalvi, B. B., Jansen, P. A., Tafjord, O., Xie, Z., Smith, H., Pipatanangkura, L., & Clark, P. E. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.585 · Cited by 148
DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines
Khattab, O., Singhvi, A., Maheshwari, P., Zhang, Z., Santhanam, K., Vardhamanan, S., Haq, S., Sharma, A., Joshi, T. T., Moazam, H., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.03714 · Cited by 911
Self-Supervised Knowledge Triplet Learning for Zero-Shot Question Answering
Banerjee, P., & Baral, C. R. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.11 · Cited by 54
LooGLE: Can Long-Context Language Models Understand Long Contexts?
Li, J., Wang, M., Zheng, Z., & Zhang, M. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.859 · Cited by 55
Towards Continual Knowledge Learning of Language Models
Jang, J., Ye, S., Yang, S., Shin, J., Han, J., Kim, G., Choi, S. J., & Seo, M. (2021) · arXiv · doi:10.48550/arxiv.2110.03215 · Cited by 49
“Configuration KILT (Petroni et al., 2021) consists of 5 different tasks and 11 datasets: OpenDomain Question Answering (Joshi et al., 2017; Kwiatkowski et al., 2019; Fan et al., 2019; Yang et al., 2018), Fact Checking (Thorne et al., 2018), Entity Linking (Hoffart et al., 2011; Guo & Barbosa, 2018), Slot-filling (Levy…”
BackgroundDeep learning based question answering system in Bengali
Mayeesha, T. T., Sarwar, A. M., & Rahman, R. M. (2020) · Journal of Information and Telecommunication · doi:10.1080/24751839.2020.1833136 · Cited by 54
Esteva, A., Kale, A., Paulus, R., Hashimoto, K., Yin, W., Radev, D., & Socher, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09595 · Cited by 48
Machine Reading Comprehension: The Role of Contextualized Language Models and BeyondPreprint
Zhang, Z., Zhao, H., & Wang, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.06249 · Cited by 63
Jhamtani, H., & Clark, P. E. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.10 · Cited by 54
Break It Down: A Question Understanding BenchmarkPreprint
Wolfson, T., Geva, M., Gupta, A., Gardner, M., Goldberg, Y., Deutch, D., & Berant, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.11770 · Cited by 40
Understanding the Dark Side of LLMs' Intrinsic Self-Correction
Zhang, Q., Wang, D., Qian, H., Li, Y., Zhang, T., Huang, M., Xu, K., Li, H., Yan, L., & Qiu, H. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1314 · Cited by 36
Understanding the planning of LLM agents: A survey
Huang, X., Liu, W., Chen, X., Wang, X., Wang, H., Lian, D., Wang, Y., Tang, R., & Chen, E. (2024) · arXiv · doi:10.48550/arxiv.2402.02716 · Cited by 47
Domain-agnostic Question-Answering with Adversarial Training
Lee, S., Kim, D., & Park, J. (2019) · Workshop on Machine Reading for Question Answering (MRQA) · doi:10.18653/v1/d19-5826 · Cited by 40
A Qualitative Comparison of CoQA, SQuAD 2.0 and QuACPreprint
Yatskar, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.10735 · Cited by 46
A Survey on Explainability in Machine Reading ComprehensionPreprint
Thayaparan, M., Valentino, M., & Freitas, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.00389 · Cited by 54
Hallucination Detection in Large Language Models with Metamorphic Relations
Yang, B., Mamun, M. A. A., Zhang, J. M., & Uddin, G. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3715735 · Cited by 51
ETC: Encoding Long and Structured Inputs in TransformersPreprint
Ainslie, J., Ontañón, S., Alberti, C., Cvicek, V., Fisher, Z., Pham, P., Ravula, A., Sanghai, S. K., Wang, Q., & Li, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.08483 · Cited by 27
Survey on Evaluation of LLM-based Agents
Yehudai, A., Eden, L., Li, A., Uziel, G., Zhao, Y., Bar-Haim, R., Cohan, A., & Shmueli-Scheuer, M. (2025) · arXiv · doi:10.48550/arxiv.2503.16416 · Cited by 26
HopRetriever: Retrieve Hops over Wikipedia to Answer Complex Questions
Li, S., Li, X., Shang, L., Jiang, X., Liu, Q., Sun, C., Ji, Z., & Liu, B. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i15.17568 · Cited by 26
FaVIQ: FAct Verification from Information-seeking Questions
Park, J., Min, S., Kang, J., Zettlemoyer, L., & Hajishirzi, H. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.354 · Cited by 37
Uniqorn: Unified question answering over RDF knowledge graphs and natural language text
Pramanik, S., Alabi, J. O., Roy, R. S., & Weikum, G. (2024) · Journal of Web Semantics · doi:10.1016/j.websem.2024.100833 · Cited by 45
On the Diversity and Limits of Human Explanations
Tan, C. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.158 · Cited by 33
Halterman, A., Keith, K. A., Sarwar, S. M., & O’Connor, B. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.371 · Cited by 20
SEDM: Selective Self-Evolving Distributed Memory for Agents
Liu, Y., Min, A., Wang, Y., Yao, Y., Han, Y., Zhang, R., He, J., Li, Z., Qi, Y., Xu, H., et al. (2025) · arXiv · doi:10.48550/arxiv.2509.09498 · Cited by 20
Answering Any-hop Open-domain Questions with Iterative Document Reranking
Zhang, Y., Nie, P., Ramamurthy, A., & Song, L. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462853 · Cited by 27
Wu, Z., & Xu, H. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106075 · Cited by 20
Identifying Supporting Facts for Multi-hop Question Answering with Document Graph Networks
Thayaparan, M., Valentino, M., Schlegel, V., & Freitas, A. (2019) · Workshop on Graph Based Methods for Natural Language Processing · doi:10.18653/v1/d19-5306 · Cited by 20
PathReasoner: Explainable reasoning paths for commonsense question answering
Zhan, X., Huang, Y., Dong, X. M., Cao, Q., & Liang, X. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107612 · Cited by 21
Review Conversational Reading ComprehensionPreprint
Xu, H., Liu, B., Shu, L., & Yu, P. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.00821 · Cited by 24
ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models
Xu, B., Peng, Z., Lei, B., Mukherjee, S., Liu, Y., & Xu, D. (2023) · arXiv · doi:10.48550/arxiv.2305.18323 · Cited by 17
Neural Conversational QA: Learning to Reason vs Exploiting Patterns
Verma, N., Sharma, A., Madan, D., Contractor, D., Kumar, H., & Joshi, S. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.589 · Cited by 14
Liu, N. F., Lee, T., Jia, R., & Liang, P. (2021) · arXiv (Cornell University) · Cited by 17
Conditional Self-Attention for Query-based SummarizationPreprint
Xie, Y., Zhou, T., Mao, Y., & Chen, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07338 · Cited by 17
Visuo-Linguistic Question Answering (VLQA) Challenge
Sampat, S. K., Yang, Y., & Baral, C. R. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.413 · Cited by 16
Multi-Paragraph Reasoning with Knowledge-enhanced Graph Neural NetworkPreprint
Ye, D., Lin, Y., Liu, Z., Liu, Z., & Sun, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.02170 · Cited by 13
Reference Knowledgeable Network for Machine Reading Comprehension
Zhao, Y., Zhang, Z., & Zhao, H. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3164219 · Cited by 13
Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge.Preprint
Talmor, A., Tafjord, O., Clark, P. E., Goldberg, Y., & Berant, J. (2020) · arXiv (Cornell University) · Cited by 13
Conversational recommendation based on end-to-end learning: How far are we?
Manzoor, A., & Jannach, D. (2021) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2021.100139 · Cited by 12
ERNIE-Doc: A Retrospective Long-Document Modeling TransformerPreprint
Ding, S., Shang, J., Wang, S., Sun, Y., Tian, H., Wu, H. R., & Wang, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15688 · Cited by 11
Bhakthavatsalam, S., Khashabi, D., Khot, T., Mishra, B. D., Richardson, K., Sabharwal, A., Schoenick, C., Tafjord, O., & Clark, P. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.03315 · Cited by 11
Answer Complex Questions: Path Ranker Is All You Need
Zhang, X., Zhan, K., Hu, E., Fu, C., Luo, L., Jiang, H., Jia, Y., Yu, F., Dou, Z., Cao, Z., et al. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462942 · Cited by 10
Knowledge-Aided Open-Domain Question AnsweringPreprint
Zhou, M., Shi, Z., Huang, M., & Zhu, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05244 · Cited by 15
Robustifying Multi-hop QA through Pseudo-Evidentiality Training
Lee, K., Hwang, S.-W., Han, S.-E., & Lee, D. (2021) · doi:10.18653/v1/2021.acl-long.476 · Cited by 9
Directional attention weaving for text-grounded conversational question answering
Li, R., Jiang, Z., Wang, L., Lu, X., & Zhao, M. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.056 · Cited by 9
Multi-level retrieval with semantic Axiomatic Fuzzy Set clustering for question answering
Lang, Q., Liu, X., & Deng, Y. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107858 · Cited by 10
Addressing Semantic Drift in Question Generation for Semi-Supervised Question AnsweringPreprint
Zhang, S., & Bansal, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06356 · Cited by 19
Self-citationKapoor, S., Stroebl, B., Siegel, Z. S., Nadgir, N., & Narayanan, A. (2024) · arXiv · doi:10.48550/arxiv.2407.01502 · Cited by 13
Learning with Instance Bundles for Reading Comprehension
Dua, D., Dasigi, P., Singh, S., & Gardner, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.584 · Cited by 9
Interactive Language Learning by Question AnsweringPreprint
Yuan, X., Côté, M.-A., Fu, J., Lin, Z., Pal, C., Bengio, Y., & Trischler, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.10909 · Cited by 13
Self-citationHuman Evaluation of Spoken vs. Visual Explanations for Open-Domain QA
Gonzalez, A. V., Bansal, G., Fan, A., Jia, R., Mehdad, Y., & Iyer, S. (2020) · arXiv · doi:10.48550/arxiv.2012.15075 · Cited by 7
Evaluating Explanations for Reading Comprehension with Realistic Counterfactuals.Preprint
Ye, X., Nair, R., & Durrett, G. (2021) · arXiv (Cornell University) · Cited by 6
SnapKV: LLM Knows What You are Looking for Before Generation
Li, Y., Huang, Y., Yang, B., Venkitesh, B., Locatelli, A., Ye, H., Cai, T., Lewis, P., & Chen, D. (2024) · arXiv · doi:10.48550/arxiv.2404.14469 · Cited by 74
Answering POI-recommendation Questions using Tourism Reviews
Contractor, D., Shah, K., Partap, A., Singla, P., & Mausam, M. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482320 · Cited by 7
Chia, Y. K., Witteveen, S., & Andrews, M. (2020) · doi:10.18653/v1/2020.textgraphs-1.14 · Cited by 5
Explainable Natural Language Reasoning via Conceptual Unification.Preprint
Valentino, M., Thayaparan, M., & Freitas, A. (2020) · arXiv (Cornell University) · Cited by 5
A Self-supervised Method for Entity AlignmentPreprint
Liu, X., Hong, H., Wang, X., Chen, Z., Kharlamov, E., Dong, Y., & Tang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09395 · Cited by 5
The Graph Reasoning Approach Based on the Dynamic Knowledge Auxiliary for Complex Fact Verification
Wang, Y., Xia, C., Si, C., Zhang, C., & Wang, T. (2020) · Electronics · doi:10.3390/electronics9091472 · Cited by 4
The TechQA DatasetPreprint
Castelli, V., Chakravarti, R., Dana, S., Ferritto, A., Florian, R., Franz, M., Garg, D., Khandelwal, D., McCarley, S., McCawley, M., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.02984 · Cited by 26
Tang, H., Liu, J., Li, H., Yu, H., Wu, H. R., & Wang, H. (2020) · arXiv (Cornell University) · Cited by 3
Knollmeyer, S., Caymazer, O., Koval, L., Akmal, M. U., Asif, S., Mathias, S. G., & Großmann, D. (2026) · SN Computer Science · doi:10.1007/s42979-026-05134-x · Cited by 9
Empowering Large Language Model Agent through Step-Level Self-Critique and Self-Training
Zhai, Y., Liu, H., Zhang, Z., Lin, T., Xu, K., Yang, C., Feng, D., Ding, B., & Wang, H. (2025) · Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3726302.3729965 · Cited by 3
Toward conversational agents with context and time sensitive long-term memory
Alonso, N., Figliolia, T., Ndirango, A., & Millidge, B. (2024) · arXiv · doi:10.48550/arxiv.2406.00057 · Cited by 2
BioWorkflow: Retrieving comprehensive bioinformatics workflows from publications
Wang, Y., & Wang, J. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf571 · Cited by 2
Betz, G., & Richardson, K. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.900943 · Cited by 2
On the Transferability of Minimal Prediction Preserving Inputs in Question Answering
Longpre, S., Lu, Y., & DuBois, C. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.101 · Cited by 2
A Study on Forecasting Order Quantity from Manufacturing Supply Chain Data using XAI
Jung, Y., & Yoon, C. (2024) · The Journal of Korean Institute of Information Technology · doi:10.14801/jkiit.2024.22.8.41 · Cited by 2
A Cognitive Method for Automatically Retrieving Complex Information on a Large Scale
Wang, Y., Yao, B., Wang, T., Xia, C., & Zhao, X. (2020) · Sensors · doi:10.3390/s20113057 · Cited by 2
Semantic Graphs for Generating Deep QuestionsPreprint
Pan, L., Xie, Y., Feng, Y., Chua, T., & Kan, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12704 · Cited by 2
VisBERT: Hidden-State Visualizations for TransformersPreprint
van Aken, B., Winter, B., Löser, A., & Gers, F. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.04507 · Cited by 2
DSPy Assertions: Computational Constraints for Self-Refining Language Model Pipelines
Singhvi, A., Shetty, M., Tan, S., Potts, C., Sen, K., Zaharia, M., & Khattab, O. (2023) · arXiv · doi:10.48550/arxiv.2312.13382 · Cited by 2
Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation
Krishna, S., Krishna, K., Mohananey, A., Schwarcz, S., Stambler, A., Upadhyay, S., & Faruqui, M. (2024) · arXiv · doi:10.48550/arxiv.2409.12941 · Cited by 1
EvoAgentX: An Automated Framework for Evolving Agentic Workflows
Wang, Y., Liu, S., Fang, J., & Meng, Z. (2025) · Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2025.emnlp-demos.47 · Cited by 1
A Cognitive Automation Approach for a Smart Lending and Early Warning Application.
Oro, E., Ruffolo, M., & Pupo, F. (2020) · EDBT/ICDT Workshops · Cited by 1
A Study of the Tasks and Models in Machine Reading ComprehensionPreprint
Wang, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08635 · Cited by 3
Asking Complex Questions with Multi-hop Answer-focused ReasoningPreprint
Ma, X., Zhu, Q., Zhou, Y., Li, X., & Wu, D. O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.07402 · Cited by 4
Understanding in Artificial IntelligencePreprint
Maetschke, S., Iraola, D. M., Barnard, P., ShafieiBavani, E., Zhong, P., Xu, Y., & Yepes, A. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.06573 · Cited by 4
Evaluating Document Coherence ModellingPreprint
Shen, A., Mistica, M., Salehi, B., Li, H., Baldwin, T., & Qi, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.10133 · Cited by 1
Improving Cross-Lingual Reading Comprehension with Self-TrainingPreprint
Huang, W., Huang, C., & Lee, H.-Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.03627 · Cited by 2
Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive StudyPreprint
Mou, X., Yang, C., Yu, M., Yao, B., Guo, X., Potdar, S., & Su, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03826 · Cited by 1
Metadata
- Authors
- Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W. W., Salakhutdinov, R., & Manning, C. D.
- Affiliations
- Mila - Quebec Artificial Intelligence Institute (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1809.09600
- OpenAlex
- W2952862139
- Cited by
- 97
- References
- 16
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 2 · 2023: 1 · 2022: 5 · 2021: 31 · 2020: 38 · 2019: 12 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1514268)
- Nvidia
- Université de Montréal
- Defense Advanced Research Projects Agency
- Office of Naval Research (N000141812861)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- multi-hop question answering, HotpotQA, explainable question answering, complex reasoning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
