The DOI matches its DataCite record; 37 of the 37 references it cites were found in a registry or an index.
Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering
Open accessAbstract
Answering questions that require multi-hop reasoning at web-scale necessitates retrieving multiple evidence documents, one of which often has little lexical or semantic relationship to the question. This paper introduces a new graph-based recurrent retrieval approach that learns to retrieve reasoning paths over the Wikipedia graph to answer multi-hop open-domain questions. Our retriever model trains a recurrent neural network that learns to sequentially retrieve evidence paragraphs in the reasoning path by conditioning on the previously retrieved documents. Our reader model ranks the reasoning paths and extracts the answer span included in the best reasoning path. Experimental results show state-of-the-art results in three open-domain QA datasets, showcasing the effectiveness and robustness of our method. Notably, our method achieves significant improvement in HotpotQA, outperforming the previous best model by more than 14 points.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
Know What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069
Bidirectional Attention Flow for Machine ComprehensionPreprint
Seo, M. J., Kembhavi, A., Farhadi, A., & Hajishirzi, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01603 · Cited by 1,698
Self-citationWeight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural NetworksPreprint
Salimans, T., & Kingma, D. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.07868 · Cited by 1,551
Latent retrieval for weakly supervised open domain question answering
Lee, K., Chang, M.-W., & Toutanova, K. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1612 · Cited by 771
Using the Output Embedding to Improve Language Models
Press, O., & Wolf, L. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2025 · Cited by 729
Cited by
Sorted by citations
Items 101–154 of 154
KE-GCL: Knowledge Enhanced Graph Contrastive Learning for Commonsense Question Answering
Zhang, L., & Li, R. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.6 · Cited by 7
ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks
Xiong, K., Ding, X. H., Li, Z., Du, L., Liu, T., Qin, B., Zheng, Y., & Huai, B. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.431 · Cited by 9
Zhao, C., Xiong, C., Boyd-Graber, J. L., & Daumé, H. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.756 · Cited by 8
Self-citationTopic-aware multi-hop machine reading comprehension using weighted graphs
Mohammadi, A., Ramezani, R., & Baraani-Dastjerdi, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119873 · Cited by 8
Break, Perturb, Build: Automatic Perturbation of Reasoning Paths Through Question Decomposition
Geva, M., Wolfson, T., & Berant, J. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00450 · Cited by 11
RINK: Reader-Inherited Evidence Reranker for Table-and-Text Open Domain Question Answering
Park, E., Lee, S., Seo, D., Kim, S., Kang, I.-H., & Na, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26577 · Cited by 5
Nguyen, D.-H., Le, N.-K., & Nguyen, L.-M. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103514 · Cited by 6
Relation-Guided Pre-Training for Open-Domain Question Answering
Hu, Z., Sun, Y., & Chang, K.-W. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.292 · Cited by 7
Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering
Ho, X., Nguyen, A.-K. D., Sugawara, S., & Aizawa, A. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.87 · Cited by 5
Don’t Read Too Much Into It: Adaptive Computation for Open-Domain Question Answering
Wu, Y., Riedel, S., Minervini, P., & Stenetorp, P. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.244 · Cited by 5
Ni, A., Gardner, M., & Dasigi, P. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.497 · Cited by 11
A Text Mining Approach to Discovering COVID-19 Relevant Factors
Sastre, J. M., Vahid, A. H., McDonagh, C., & Walsh, P. (2020) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313149 · Cited by 5
Weakly Supervised Pre-Training for Multi-Hop Retriever
Seonwoo, Y., Lee, S.-W., Kim, J., Ha, J.-W., & Oh, A. H. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.62 · Cited by 5
Pruning the Index Contents for Memory Efficient Open-Domain QAPreprint
Fajčík, M., Dočekal, M., Ondrej, K., & Smrž, P. (2021) · arXiv (Cornell University) · doi:10.13140/rg.2.2.32959.02727 · Cited by 8
ReasonChainQA: Text-based Complex Question Answering with Explainable Evidence Chains
Zhu, M., Weng, Y., He, S., Liu, K., & Zhao, J. (2022) · China Automation Congress (CAC) · doi:10.1109/cac57257.2022.10055048 · Cited by 4
Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoning
Guo, W., Gong, Q., Rao, Y., & Lai, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.231 · Cited by 5
Learning to Recover Reasoning Chains for Multi-Hop Question Answering via Cooperative Games
Feng, Y., Yu, M., Xiong, W., Guo, X., Huang, J., Chang, S., Campbell, M. S., Greenspan, M., & Zhu, X. (2021) · doi:10.21428/594757db.ce391ef3 · Cited by 6
Surface-Based Retrieval Reduces Perplexity of Retrieval-Augmented Language Models
Doostmohammadi, E., Norlund, T., Kuhlmann, M., & Johansson, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.45 · Cited by 8
Single Sequence Prediction over Reasoning Graphs for Multi-hop QA
Ramesh, G., Sreedhar, M. N., & Hu, J. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.642 · Cited by 3
Training Adaptive Computation for Open-Domain Question Answering with Computational Constraints
Wu, Y., Minervini, P., Stenetorp, P., & Riedel, S. (2021) · doi:10.18653/v1/2021.acl-short.57 · Cited by 3
MKGN: A Multi-Dimensional Knowledge Enhanced Graph Network for Multi-Hop Question and Answering
Zhang, Y., Fandong, M. E. N. G., Zhang, J., Yufeng, C. H. E. N., Xu, J., & Zhou, J. (2022) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2021edp7154 · Cited by 3
Design Neural Database to identify the problem of the conditions in Dental Clinics
Talib, R., Rashid, S. T., Jumaah, N. S., & Sabah, R. (2022) · Al-Salam Journal for Engineering and Technology · doi:10.55145/ajest.2022.01.02.001 · Cited by 3
M3: A Multi-View Fusion and Multi-Decoding Network for Multi-Document Reading Comprehension
Wen, L., Wang, H., Luo, Y., & Wang, X. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.94 · Cited by 3
Revisiting the Open-Domain Question Answering PipelinePreprint
Semnani, S. J., & Pandey, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.00914 · Cited by 5
Cost-Effective Knowledge Graph Reasoning for Complex Factoid Questions
Yang, X., Chiang, M.-F., Lee, W.-C., & Chang, Y. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533753 · Cited by 2
A Hybrid Text Generation-Based Query Expansion Method for Open-Domain Question Answering
Zhu, W., Zhang, X., Zhai, Q., & Liu, C. (2023) · Future Internet · doi:10.3390/fi15050180 · Cited by 3
Complementary Evidence Identification in Open-Domain Question Answering
Mou, X., Yu, M., Chang, S., Feng, Y., Zhang, L., & Su, H. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.234 · Cited by 1
Don’t Read Too Much Into It: Adaptive Computation for Open-Domain Question Answering
Wu, Y., Minervini, P., Stenetorp, P., & Riedel, S. (2020) · Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) · doi:10.18653/v1/2020.sustainlp-1.9 · Cited by 2
Knowledge Transfer between Structured and Unstructured Sources for Complex Question Answering
Mo, L., Wang, Z., Zhao, J., & Sun, H. (2022) · doi:10.18653/v1/2022.suki-1.7 · Cited by 2
Learning to Build Reasoning Chains by Reliable Path Retrieval
Zhu, M., Weng, Y., He, S., Wang, C., Liu, K., Cai, L., & Zhao, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097146 · Cited by 2
A Cognitive Method for Automatically Retrieving Complex Information on a Large Scale
Wang, Y., Yao, B., Wang, T., Xia, C., & Zhao, X. (2020) · Sensors · doi:10.3390/s20113057 · Cited by 2
A multilingual semantic search chatbot framework
Vinay, R., Thejas, B. U., Sharma, H. A. V., Shobha, G., & Ghuli, P. (2024) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v13.i2.pp2333-2341 · Cited by 1
COPER: a Query-Adaptable Semantics-based Search Engine for Persian COVID-19 Articles
Khanmohammadi, R., Mirshafiee, M. S., & Allahyari, M. (2021) · International Conference on Web Research (ICWR) · doi:10.1109/icwr51868.2021.9443151 · Cited by 1
RPA: Reasoning Path Augmentation in Iterative Retrieving for Multi-Hop QA
Cao, Z., Liu, B., & Li, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26483 · Cited by 1
Mao, J., Jiang, W., Wang, X., Liu, H., Xia, Y., Lyu, Y., & She, Q. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.356 · Cited by 1
mReFinED: An Efficient End-to-End Multilingual Entity Linking System
Limkonchotiwat, P., Cheng, W., Christodoulopoulos, C., Saffari, A., & Lehmann, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1007 · Cited by 1
A Copy-Augmented Generative Model for Open-Domain Question Answering
Liu, S., Wang, D., Li, X., Huang, M., & Ding, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-short.47 · Cited by 1
Efficient Retrieval Optimized Multi-task LearningPreprint
Fun, H., Gandhi, S., & Ravi, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.10129 · Cited by 7
Liang, Z., & Surdeanu, M. (2020) · Workshop on Insights from Negative Results in NLP (Insights) · doi:10.18653/v1/2020.insights-1.12
SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering
Lu, X., Lee, K., & Zhao, T. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-demos.2
Entity-Based Knowledge Graph Information Retrieval for Biomedical Articles
Prasad, V. K., Bharti, S., & Koganti, N. (2021) · Lecture notes in networks and systems · doi:10.1007/978-981-16-1089-9_62
SR3: Sentence Ranking, Reasoning, and Replication for Scenario-Based Essay Question Answering
Chen, Y., Zhao, Y., & Cheng, G. (2022) · IEEE Internet Computing · doi:10.1109/mic.2022.3161587
Cheater’s Bowl: Human vs. Computer Search Strategies for Open-Domain QA
He, W., Mao, A., & Boyd-Graber, J. L. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.266
Multi-hop question answering using sparse graphs
Hemmati, N., & Ghassem-Sani, G. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107128
Non-monotonic Generation of Knowledge Paths for Context Understanding
Lo, P.-C., & Lim, E. (2023) · ACM Transactions on Management Information Systems · doi:10.1145/3627994
A Tree-Shaped Fuzzy Clustering Answer Retrieval Model Based on Question Alignment
Lang, Q., Witold Pedrycz, C., Liu, X., & Fang, Y. (2024) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2024.3431938
MaxMind: A Memory Loop Network to Enhance Software Productivity Based on LLMs
Dong, Y., Fang, X., Hu, Y., Jiang, R., & Jiang, Z. (2024) · IEEE Smart World Congress (SWC) · doi:10.1109/swc62898.2024.00239
Adaptive question answering system
Lakshmi, P. N., Abhinav, A., Soma, D. B., Srikari, B. D., & Iswarya, D. (2025) · i-manager s Journal on Information Technology · doi:10.26634/jit.14.1.21933
Zhu, J., fanrui, Y., du ruolin, Li, J., & Xu, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5367913
A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System ChallengesPreprint
Raja, R., Vats, A., Vats, A., & Majumder, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5359269 · Cited by 10
Dammu, P. P. S., Palkhiwala, A., Roosta, T. G., & Shah, C. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808627 · Cited by 1
A Neutral and Evidence-Grounded Evaluation of Chunking Strategies in Industrial RAG Systems
Aguiar, V. A., Pereira, G. L. B., Novais, A. M. A., de Jesus, T. P., de Oliveira, S. S. T., & Soares, A. S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39904-5_13
REALM: Retrieval-Augmented Language Model Pre-Training
Guu, K., Lee, K., Tung, Z., Pasupat, P., & Chang, M.-W. (2020) · arXiv · doi:10.48550/arxiv.2002.08909 · Cited by 574
Metadata
- Authors
- Asai, A., Hashimoto, K., Hajishirzi, H., Socher, R., & Xiong, C.
- Affiliations
- University of Washington (US)
- Salesforce (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1911.10470
- OpenAlex
- W2990928880
- Cited by
- 152
- References
- 37
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 4 · 2023: 23 · 2022: 37 · 2021: 54 · 2020: 27 · 2019: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- multi-hop question answering, open-domain question answering, graph-based retrieval, HotpotQA
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
