Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering
Open accessAbstract
Answering questions that require multi-hop reasoning at web-scale necessitates retrieving multiple evidence documents, one of which often has little lexical or semantic relationship to the question. This paper introduces a new graph-based recurrent retrieval approach that learns to retrieve reasoning paths over the Wikipedia graph to answer multi-hop open-domain questions. Our retriever model trains a recurrent neural network that learns to sequentially retrieve evidence paragraphs in the reasoning path by conditioning on the previously retrieved documents. Our reader model ranks the reasoning paths and extracts the answer span included in the best reasoning path. Experimental results show state-of-the-art results in three open-domain QA datasets, showcasing the effectiveness and robustness of our method. Notably, our method achieves significant improvement in HotpotQA, outperforming the previous best model by more than 14 points.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · see citing works
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · see citing works
Bidirectional Attention Flow for Machine ComprehensionPreprint
Seo, M., Kembhavi, A., Farhadi, A., & Hajishirzi, H. (2016) · International Conference on Learning Representations · doi:10.48550/arxiv.1611.01603 · Cited by 2,322 · see citing works
Self-citationKnow What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240 · see citing works
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069 · see citing works
Dynamic Coattention Networks For Question AnsweringPreprint
Xiong, C., Zhong, V., & Socher, R. (2016) · International Conference on Learning Representations · doi:10.48550/arxiv.1611.01604 · Cited by 827 · see citing works
Self-citationLatent retrieval for weakly supervised open domain question answering
Lee, K., Chang, M.-W., & Toutanova, K. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1612 · Cited by 771 · see citing works
Scaling Neural Machine Translation
Ott, M., Edunov, S., Grangier, D., & Auli, M. (2018) · Conference on Machine Translation · doi:10.18653/v1/w18-6301 · Cited by 662 · see citing works
Using the Output Embedding to Improve Language Models
Press, O., & Wolf, L. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2025 · Cited by 642 · see citing works
Weight normalization: a simple reparameterization to accelerate training of deep neural networks
Salimans, T., & Kingma, D. P. (2016) · neural information processing systems · Cited by 617 · see citing works
Nogueira, R., & Cho, K. (2019) · arXiv · doi:10.48550/arxiv.1901.04085 · Cited by 615 · see citing works
End-to-End Open-Domain Question Answering with BERTserini
Yang, W., Xie, Y., Lin, A., Li, X., Tan, L., Xiong, K., Li, M., & Lin, J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-4013 · Cited by 472 · see citing works
Simple and Effective Multi-Paragraph Reading Comprehension
Clark, C., & Gardner, M. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1078 · Cited by 402 · see citing works
R3: Reinforced Ranker-Reader for Open-Domain Question Answering
Wang, S., Yu, M., Guo, X., Wang, Z., Klinger, T., Zhang, W., Chang, S., Tesauro, G., Zhou, B., & Jiang, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12053 · Cited by 346 · see citing works
Tying Word Vectors and Word Classifiers: A Loss Framework for Language ModelingPreprint
Inan, H., Khosravi, K., & Socher, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01462 · Cited by 314 · see citing works
Self-citationMulti-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answering
Wang, Z., Ng, P., Ma, X., Nallapati, R. M., & Xiang, B. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1599 · Cited by 246 · see citing works
Fast and Accurate Annotation of Short Texts with Wikipedia Pages
Ferragina, P., & Scaiella, U. (2011) · IEEE Software · doi:10.1109/ms.2011.122 · Cited by 243 · see citing works
Cognitive Graph for Multi-Hop Reading Comprehension at Scale
Ding, M., Zhou, C., Chen, Q., Yang, H., & Tang, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1259 · Cited by 222 · see citing works
Multi-hop Reading Comprehension through Question Decomposition and Rescoring
Min, S., Zhong, V., Zettlemoyer, L., & Hajishirzi, H. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1613 · Cited by 197 · see citing works
Self-citationReal-Time Open-Domain Question Answering with Dense-Sparse Phrase Index
Seo, M., Lee, J., Kwiatkowski, T., Parikh, A. P., Farhadi, A., & Hajishirzi, H. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1436 · Cited by 147 · see citing works
Self-citationEfficient and Robust Question Answering from Minimal Context over Documents
Min, S., Zhong, V., Socher, R., & Xiong, C. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1160 · Cited by 147 · see citing works
Self-citationEvidence Aggregation for Answer Re-Ranking in Open-Domain Question AnsweringPreprint
Wang, S., Yu, M., Jiang, J., Zhang, W., Guo, X., Chang, S., Wang, Z., Klinger, T., Tesauro, G. J., & Campbell, M. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.05116 · Cited by 143 · see citing works
Compositional Questions Do Not Necessitate Multi-hop Reasoning
Min, S., Wallace, E., Singh, S., Gardner, M., Hajishirzi, H., & Zettlemoyer, L. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1416 · Cited by 138 · see citing works
Self-citationA Discrete Hard EM Approach for Weakly Supervised Question Answering
Min, S., Chen, D., Hajishirzi, H., & Zettlemoyer, L. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1284 · Cited by 137 · see citing works
Self-citationRevealing the Importance of Semantic Retrieval for Machine Reading at Scale
Nie, Y., Wang, S., & Bansal, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1258 · Cited by 132 · see citing works
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W. W., Salakhutdinov, R., & Manning, C. D. (2018) · arXiv · doi:10.48550/arxiv.1809.09600 · Cited by 97 · see citing works
Ranking Paragraphs for Improving Answer Recall in Open-Domain Question Answering
Lee, J., Yun, S., Kim, H., Ko, M., & Kang, J. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1053 · Cited by 96 · see citing works
Multi-Hop Paragraph Retrieval for Open-Domain Question Answering
Feldman, Y., & El‐Yaniv, R. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1222 · Cited by 94 · see citing works
Adaptive Document Retrieval for Deep Question Answering
Kratzwald, B., & Feuerriegel, S. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1055 · Cited by 56 · see citing works
Retrieve, Read, Rerank: Towards End-to-End Multi-Document Reading Comprehension
Hu, M., Peng, Y., Huang, Z., & Li, D. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1221 · Cited by 54 · see citing works
Dynamically Fused Graph Network for Multi-hop ReasoningPreprint
Xiao, Y., Qu, Y., Qiu, L., Zhou, H., Li, L., Zhang, W., & Yu, Y. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.06933 · Cited by 42 · see citing works
PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and TextPreprint
Sun, H., Bedrax-Weiss, T., & Cohen, W. W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09537 · Cited by 33 · see citing works
Do Multi-hop Readers Dream of Reasoning Chains?
Wang, H., Yu, M., Guo, X., Das, R., Xiong, W., & Gao, T. (2019) · Workshop on Machine Reading for Question Answering (MRQA) · doi:10.18653/v1/d19-5813 · Cited by 22 · see citing works
Answering Complex Open-domain Questions Through Iterative Query GenerationPreprint
Qi, P., Lin, X., Mehr, L., Wang, Z., & Manning, C. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.07000 · Cited by 20 · see citing works
Weaver: Deep Co-Encoding of Questions and Documents for Machine ReadingPreprint
Raison, M., Mazaré, P.-E., Das, R., & Bordes, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.10490 · Cited by 15 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Self-supervised Learning: Generative or Contrastive
Liu, X., Zhang, F., Hou, Z., Mian, L., Wang, Z., Zhang, J., & Tang, J. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090866 · Cited by 1,890 · see citing works
A Metaverse: Taxonomy, Components, Applications, and Open Challenges
Park, S., & Kim, Y. (2022) · IEEE Access · doi:10.1109/access.2021.3140175 · Cited by 1,926 · see citing works
Self-Consistency Improves Chain of Thought Reasoning in Language Models
Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowdhery, A., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2203.11171 · Cited by 829 · see citing works
“…reasoning paths, such as constructing semantic graphs (Xu et al., 2021a), learning an RNN to retrieve reasoning paths over the Wikipedia graph (Asai et al., 2020), fine-tuning with human annotated reasoning paths on math problems (Cobbe et al., 2021), or training an extractor with…”
BackgroundHow Much Knowledge Can You Pack into the Parameters of a Language Model?
Roberts, A., Raffel, C., & Shazeer, N. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.437 · Cited by 638 · see citing works
Retrieval Augmentation Reduces Hallucination in Conversation
Shuster, K., Poff, S., Chen, M., Kiela, D., & Weston, J. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.320 · Cited by 575 · see citing works
Qu, Y., Ding, Y., Liu, J., Liu, K., Ren, R., Zhao, W. X., Dong, D., Wu, H. R., & Wang, H. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.466 · Cited by 479 · see citing works
BARTScore: Evaluating Generated Text as Text Generation
Yuan, W., Neubig, G., & Liu, P. (2021) · arXiv · doi:10.48550/arxiv.2106.11520 · Cited by 353 · see citing works
LinkBERT: Pretraining Language Models with Document Links
Yasunaga, M., Leskovec, J., & Liang, P. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.551 · Cited by 374 · see citing works
AmbigQA: Answering Ambiguous Open-domain Questions
Min, S., Michael, J., Hajishirzi, H., & Zettlemoyer, L. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.466 · Cited by 219 · see citing works
Self-citationHierarchical Graph Network for Multi-hop Question Answering
Fang, Y., Sun, S., Gan, Z., Pillai, R., Wang, S., & Liu, J. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.710 · Cited by 176 · see citing works
Knowledge Graph Prompting for Multi-Document Question Answering
Wang, Y., Lipka, N., Rossi, R. A., Siu, A. F., Zhang, R., & Derr, T. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29889 · Cited by 189 · see citing works
Generation-Augmented Retrieval for Open-Domain Question Answering
Mao, Y., He, P., Liu, X., Shen, Y., Gao, J., Han, J., & Chen, W. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.316 · Cited by 146 · see citing works
A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers
Dasigi, P., Lo, K., Beltagy, I., Cohan, A., Smith, N. A., & Gardner, M. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.365 · Cited by 138 · see citing works
Evaluating Open-Domain Question Answering in the Era of Large Language Models
Kamalloo, E., Dziri, N., Clarke, C. L. A., & Rafiei, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.307 · Cited by 144 · see citing works
Lin, B. Y., Lee, S., Khanna, R., & Ren, X. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.557 · Cited by 122 · see citing works
Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answering
Zhang, J., Zhang, X., Yu, J., Tang, J., Tang, J., Li, C., & Chen, H. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.396 · Cited by 118 · see citing works
(2021) · doi:10.18653/v1/2021.naacl-main.46 · Cited by 115 · see citing works
Self-citationHoVer: A Dataset for Many-Hop Fact Extraction And Claim Verification
Jiang, Y., Bordia, S., Zhong, Z., Dognin, C., Singh, M., & Bansal, M. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.309 · Cited by 121 · see citing works
Asai, A., Wu, Z., Wang, Y., Sil, A., & Hajishirzi, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.11511 · Cited by 101 · see citing works
“7 The issues of performance variance from different Wikipedia dumps have been reported by prior work (Asai et al., 2020; Izacard et al., 2022b).”
BackgroundSelf-citationMultilingual Autoregressive Entity Linking
Cao, N. D., Wu, L., Popat, K., Artetxe, M., Goyal, N., Plekhanov, M., Zettlemoyer, L., Cancedda, N., Riedel, S., & Petroni, F. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00460 · Cited by 107 · see citing works
Relevance-guided Supervision for OpenQA with ColBERT
Khattab, O., Potts, C., & Zaharia, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00405 · Cited by 72 · see citing works
Geographic Question Answering: Challenges, Uniqueness, Classification, and Future Directions
Mai, G., Janowicz, K., Zhu, R., Cai, L., & Lao, N. (2021) · AGILE GIScience Series · doi:10.5194/agile-giss-2-8-2021 · Cited by 73 · see citing works
Learning Dense Representations of Phrases at Scale
Lee, J., Sung, M., Kang, J., & Chen, D. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.518 · Cited by 82 · see citing works
Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answering
Wang, P., Peng, N., Ilievski, F., Szekely, P. A., & Ren, X. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.369 · Cited by 67 · see citing works
Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language Inference
Zhang, J., Hashimoto, K., Liu, W., Wu, C.-S., Wan, Y., Yu, P. S., Socher, R., & Xiong, C. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.411 · Cited by 73 · see citing works
Self-citationMulti-hop Question Answering via Reasoning ChainsPreprint
Chen, J., Lin, S.-T., & Durrett, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.02610 · Cited by 73 · see citing works
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
Yu, D., Zhu, C., Fang, Y., Yu, W., Wang, S., Xu, Y., Ren, X., Yang, Y., & Zeng, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.340 · Cited by 60 · see citing works
MultiModalQA: Complex Question Answering over Text, Tables and ImagesPreprint
Talmor, A., Yoran, O., Catav, A., Lahav, D., Wang, Y., Asai, A., Ilharco, G., Hajishirzi, H., & Berant, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06039 · Cited by 91 · see citing works
Self-citationSPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrieval
Zhao, T., Lu, X., & Lee, K. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.47 · Cited by 62 · see citing works
ProoFVer: Natural Logic Theorem Proving for Fact Verification
Krishna, A., Riedel, S., & Vlachos, A. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00503 · Cited by 51 · see citing works
Answering Questions on COVID-19 in Real-Time
Lee, J., Yi, S. S., Jeong, M., Sung, M., Yoon, W., Choi, Y., Ko, M., & Kang, J. (2020) · Workshop on NLP for COVID-19 (NLP-COVID19) · doi:10.18653/v1/2020.nlpcovid19-2.1 · Cited by 48 · see citing works
From natural language processing to neural databases
Thorne, J. P., Yazdani, M., Saeidi, M., Silvestri, F., Riedel, S., & Halevy, A. Y. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3447689.3447706 · Cited by 40 · see citing works
Answering Open-Domain Questions of Varying Reasoning Steps from Text
Qi, P., Lee, H., Sido, O. T., & Manning, C. D. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.292 · Cited by 52 · see citing works
Knowledge-based natural answer generation via effective graph learning
Liu, Z., Li, J., Huang, Y., Cui, N., & Pei, L. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113288 · Cited by 36 · see citing works
DC-BERT: Decoupling Question and Document for Efficient Contextual Encoding
Nie, P., Zhang, Y., Geng, X., Ramamurthy, A., Song, L., & Jiang, D. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401271 · Cited by 40 · see citing works
Context-Aware Answer Extraction in Question Answering
Seonwoo, Y., Kim, J., Ha, J.-W., & Oh, A. H. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.189 · Cited by 36 · see citing works
Multi-Hop Fact Checking of Political Claims
Ostrowski, W., Arora, A., Atanasova, P., & Augenstein, I. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/536 · Cited by 37 · see citing works
Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering
Hu, Z., Yi‐chong, X., Yu, W., Wang, S., Yang, Z., Zhu, C., Chang, K.-W., & Sun, Y. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.650 · Cited by 42 · see citing works
Semantic matching in machine reading comprehension: An empirical study
Liu, Q., Mao, R., Geng, X., & Cambria, E. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103145 · Cited by 34 · see citing works
Highly Parallel Autoregressive Entity Linking with Discriminative Correction
Cao, N. D., Aziz, W. F., & Titov, I. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.604 · Cited by 31 · see citing works
Generation-Augmented Retrieval for Open-domain Question Answering
Mao, Y., He, P., Liu, X., Shen, Y., Gao, J., Han, J., & Chen, W. (2020) · arXiv · doi:10.48550/arxiv.2009.08553 · Cited by 31 · see citing works
A Survey on Explainability in Machine Reading ComprehensionPreprint
Thayaparan, M., Valentino, M., & Freitas, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.00389 · Cited by 37 · see citing works
Timeline Summarization based on Event Graph Compression via Time-Aware Optimal Transport
Li, M., Ma, T., Yu, M., Wu, L., Gao, T., Ji, H., & McKeown, K. R. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.519 · Cited by 29 · see citing works
Chen, Q., Ji, F., Chen, H., & Zhang, Y. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.232 · Cited by 28 · see citing works
Reader-Guided Passage Reranking for Open-Domain Question Answering
Mao, Y., He, P., Liu, X., Shen, Y., Gao, J., Han, J., & Chen, W. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.29 · Cited by 30 · see citing works
Thorne, J. P., Yazdani, M., Saeidi, M., Silvestri, F., Riedel, S., & Halevy, A. Y. (2021) · doi:10.18653/v1/2021.acl-long.241 · Cited by 27 · see citing works
BioReader: a Retrieval-Enhanced Text-to-Text Transformer for Biomedical Literature
Frisoni, G., Mizutani, M., Moro, G., & Valgimigli, L. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.390 · Cited by 27 · see citing works
Interpreting Deep Learning Models in Natural Language Processing: A ReviewPreprint
Sun, X., Yang, D., Li, X., Zhang, T., Meng, Y., Qiu, H., Wang, G., Hovy, E. H., & Li, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10470 · Cited by 40 · see citing works
Xu, W., Zhang, H., Cai, D., & Lam, W. P. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.90 · Cited by 28 · see citing works
HopRetriever: Retrieve Hops over Wikipedia to Answer Complex Questions
Li, S., Li, X., Shang, L., Jiang, X., Liu, Q., Sun, C., Ji, Z., & Liu, B. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i15.17568 · Cited by 23 · see citing works
Adaptive Information Seeking for Open-Domain Question Answering
Zhu, Y., Pang, L., Lan, Y., Shen, H., & Cheng, X. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.293 · Cited by 24 · see citing works
Dense Hierarchical Retrieval for Open-domain Question Answering
Liu, Y., Hashimoto, K., Zhou, Y., Yavuz, S., Xiong, C., & Yu, P. S. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.19 · Cited by 26 · see citing works
Self-citationCluster-Former: Clustering-based Sparse Transformer for Question Answering
Wang, S., Zhou, L., Gan, Z., Chen, Y.-C., Fang, Y., Sun, S., Cheng, Y., & Liu, J. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.346 · Cited by 24 · see citing works
Iyer, S. V., Min, S., Mehdad, Y., & Yih, W.-T. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.100 · Cited by 24 · see citing works
Modeling Multi-hop Question Answering as Single Sequence Prediction
Yavuz, S., Hashimoto, K., Zhou, Y., Keskar, N. S., & Xiong, C. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.69 · Cited by 24 · see citing works
Self-citationHippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models
Gutiérrez, B. J., Shu, Y., Gu, Y., Yasunaga, M., & Su, Y. (2024) · arXiv · doi:10.48550/arxiv.2405.14831 · Cited by 152 · see citing works
“In contrast, synonymy edges have the largest effect on 2WikiMultiHopQA, suggesting that noisy entity standardization is useful when most relevant concepts are named entities, and improvements to synonymy detection could lead to stronger performance in other datasets.”
SRLGRN: Semantic Role Labeling Graph Reasoning Network
Chen, Z., & Kordjamshidi, P. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.714 · Cited by 20 · see citing works
AFS Graph: Multidimensional Axiomatic Fuzzy Set Knowledge Graph for Open-Domain Question Answering
Lang, Q., Liu, X., & Jia, W. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3171677 · Cited by 21 · see citing works
Visual language integration: A survey and open challenges
Park, S., & Kim, Y. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100548 · Cited by 21 · see citing works
Grape: Knowledge Graph Enhanced Passage Reader for Open-domain Question Answering
Ju, M., Yu, W., Zhao, T., Zhang, C., & Ye, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.13 · Cited by 28 · see citing works
Guo, X., Yu, M., Gao, Y., Gan, C., Campbell, M. S., & Chang, S. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.624 · Cited by 19 · see citing works
Multi-Step Reasoning Over Unstructured Text with Beam Dense Retrieval
Zhao, C., Xiong, C., Boyd-Graber, J. L., & Daumé, H. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.368 · Cited by 23 · see citing works
Self-citationBreadth First Reasoning Graph for Multi-hop Question Answering
Huang, Y., & Yang, M. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.464 · Cited by 20 · see citing works
Reasoning over Hybrid Chain for Table-and-Text Open Domain Question Answering
Zhong, W., Huang, J., Liu, Q., Zhou, M., Wang, J., Yin, J. P., & Duan, N. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/629 · Cited by 20 · see citing works
PathReasoner: Explainable reasoning paths for commonsense question answering
Zhan, X., Huang, Y., Dong, X. M., Cao, Q., & Liang, X. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107612 · Cited by 18 · see citing works
What’s in a Name? Answer Equivalence For Open-Domain Question Answering
Si, C., Zhao, C., & Boyd-Graber, J. L. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.757 · Cited by 17 · see citing works
A Survey of Reasoning with Foundation ModelsPreprint
Sun, J., Zheng, C., Xie, E., Liu, Z., Chu, R., Liu, J., Xu, J., Ding, M., Li, H., Geng, M., et al. (2023) · doi:10.31219/osf.io/ac4sp · Cited by 51 · see citing works
Cross-Thought for Sentence Encoder Pre-training
Wang, S., Fang, Y., Sun, S., Gan, Z., Cheng, Y., Liu, J., & Jiang, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.30 · Cited by 17 · see citing works
Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge
Ma, K., Cheng, H., Liu, X., Nyberg, E., & Gao, J. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.392 · Cited by 19 · see citing works
Chain-of-Skills: A Configurable Model for Open-Domain Question Answering
Ma, K., Cheng, H., Zhang, Y., Liu, X., Nyberg, E., & Gao, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.89 · Cited by 22 · see citing works
Generative Multi-hop Retrieval
Lee, H., Yang, S., Oh, H., & Seo, M. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.92 · Cited by 20 · see citing works
Question Answering Systems: A Systematic Literature Review
Alanazi, S. S., Elfadil, N., Jarajreh, M. A., & Algarni, S. (2021) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2021.0120359 · Cited by 21 · see citing works
Asynchronous Multi-grained Graph Network For Interpretable Multi-hop Reading Comprehension
Li, R., Wang, L., Wang, S., & Jiang, Z. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/531 · Cited by 16 · see citing works
Kia, M. A., Garifullina, A., Kern, M., Chamberlain, J., & Jameel, S. (2022) · IEEE Access · doi:10.1109/access.2022.3170466 · Cited by 16 · see citing works
Al-Obeidat, F. N., Adedugbe, O., Bani-Hani, A. I., Benkhelifa, E., & Majdalawieh, M. (2020) · International Conference on Social Networks Analysis, Management and Security (SNAMS) · doi:10.1109/snams52053.2020.9336541 · Cited by 15 · see citing works
ELECTRA-based graph network model for multi-hop question answering
Zhu, P., Yuan, Y., & Chen, L. (2023) · Journal of Intelligent Information Systems · doi:10.1007/s10844-023-00800-5 · Cited by 14 · see citing works
Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories
Wilmot, D., & Keller, F. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.65 · Cited by 14 · see citing works
Reasoning over Public and Private Data in Retrieval-Based Systems
Arora, S., Lewis, P., Fan, A., Kahn, J., & Ré, C. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00580 · Cited by 14 · see citing works
Visual Explanation for Open-Domain Question Answering With BERT
Shao, Z., Sun, S., Zhao, Y., Wang, S., Wei, Z., Gui, T., Turkay, Ç., & Chen, S. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3243676 · Cited by 13 · see citing works
Alkhaldi, T., Chu, C., & Kurohashi, S. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3120643 · Cited by 13 · see citing works
Leveraging Structured Information for Explainable Multi-hop Question Answering and Reasoning
Li, R., & Du, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.452 · Cited by 12 · see citing works
Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA
Huang, J., Zhong, W., Liu, Q., Gong, M., Jiang, D., & Duan, N. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.303 · Cited by 14 · see citing works
Progressively Pretrained Dense Corpus Index for Open-Domain Question Answering
Xiong, W., Wang, H., & Wang, W. Y. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.244 · Cited by 14 · see citing works
elBERto: Self-supervised commonsense learning for question answering
Zhan, X., Li, Y., Dong, X., Liang, X., Hu, Z., & Carin, L. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109964 · Cited by 12 · see citing works
ReSel: N-ary Relation Extraction from Scientific Text and Tables by Learning to Retrieve and Select
Zhuang, Y., Li, Y., Zhang, J., Yu, Y., Mou, Y., Chen, X., Song, L., & Zhang, C. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.46 · Cited by 12 · see citing works
Disentangled Retrieval and Reasoning for Implicit Question Answering
Liu, Q., Geng, X., Wang, Y., Cambria, E., & Jiang, D. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3220933 · Cited by 11 · see citing works
Multi-Step Inference for Reasoning Over Paragraphs
Liu, J., Gardner, M., Cohen, S. B., & Lapata, M. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.245 · Cited by 11 · see citing works
WikiContradiction: Detecting Self-Contradiction Articles on Wikipedia
Hsu, C., Li, C., Sáez-Trumper, D., & Hsu, Y.-Z. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671319 · Cited by 12 · see citing works
Knowledge-Aided Open-Domain Question AnsweringPreprint
Zhou, M., Shi, Z., Huang, M., & Zhu, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05244 · Cited by 11 · see citing works
Robustifying Multi-hop QA through Pseudo-Evidentiality Training
Lee, K., Hwang, S.-W., Han, S.-E., & Lee, D. (2021) · doi:10.18653/v1/2021.acl-long.476 · Cited by 9 · see citing works
Explainable Multi-hop Verbal Reasoning Through Internal Monologue
Liang, Z., Bethard, S. J., & Surdeanu, M. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.97 · Cited by 11 · see citing works
Multi-level retrieval with semantic Axiomatic Fuzzy Set clustering for question answering
Lang, Q., Liu, X., & Deng, Y. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107858 · Cited by 9 · see citing works
Natural Logic-guided Autoregressive Multi-hop Document Retrieval for Fact Verification
Aly, R., & Vlachos, A. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.411 · Cited by 9 · see citing works
REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-training
Jiao, F., Guo, Y., Niu, Y., Ji, F., Li, F.-L., & Nie, L. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.13 · Cited by 7 · see citing works
Combining Lexical and Dense Retrieval for Computationally Efficient Multi-hop Question Answering
Sidiropoulos, G., Voskarides, N., Vakulenko, S., & Kanoulas, E. (2021) · Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) · doi:10.18653/v1/2021.sustainlp-1.7 · Cited by 9 · see citing works
Triple-Fact Retriever: An explainable reasoning retrieval model for multi-hop QA problem
Wu, C., Hu, E., Zhan, K., Luo, L., Zhang, X., Jiang, H., Wang, Q., Cao, Z., Yu, F., & Chen, L. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00095 · Cited by 8 · see citing works
Few-shot Reranking for Multi-hop QA via Language Model Prompting
Khalifa, M., Logeswaran, L., Lee, M., Lee, H., & Wang, L. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.885 · Cited by 11 · see citing works
Deep Knowledge Graph Representation Learning for Completion, Alignment, and Question Answering
Chakrabarti, S. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3532679 · Cited by 8 · see citing works
Instructed Language Models with Retrievers Are Powerful Entity Linkers
Xiao, Z., Gong, M., Wu, J., Zhang, X., Shou, L., & Jiang, D. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.139 · Cited by 9 · see citing works
- Authors
- Asai, A., Hashimoto, K., Hajishirzi, H., Socher, R., & Xiong, C.
- Affiliations
- University of Washington (US)
- Salesforce (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1911.10470
- OpenAlex
- W2990928880
- Cited by
- 152
- References
- 37
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 4 · 2023: 23 · 2022: 37 · 2021: 54 · 2020: 27 · 2019: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- multi-hop question answering, open-domain question answering, graph-based retrieval, HotpotQA
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
