Generation-Augmented Retrieval for Open-domain Question Answering
Open accessAbstract
We propose Generation-Augmented Retrieval (GAR) for answering open-domain questions, which augments a query through text generation of heuristically discovered relevant contexts without external resources as supervision. We demonstrate that the generated contexts substantially enrich the semantics of the queries and GAR with sparse representations (BM25) achieves comparable or better performance than state-of-the-art dense retrieval methods such as DPR. We show that generating diverse contexts for a query is beneficial as fusing their results consistently yields better retrieval accuracy. Moreover, as sparse and dense representations are often complementary, GAR can be easily combined with DPR to achieve even better performance. GAR achieves state-of-the-art performance on Natural Questions and TriviaQA datasets under the extractive QA setup when equipped with an extractive reader, and consistently outperforms other retrieval methods when the same generative reader is used.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Some studies have investigated utilizing the model's predictions as supplementary context to inform the retrieval process.
“some studies have investigated utilizing the model's predictions as supplementary context to inform the retrieval process (Mao et al., 2020;Li et al., 2022;Wang et al., 2023;Zemlyanskiy et al., 2022).”
From RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation (2023) · cites this paper as Mao et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · see citing works
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821 · see citing works
Billion-scale similarity search with GPUs
Johnson, J., Douze, M., & Jegou, H. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2921572 · Cited by 4,228 · see citing works
Dense passage retrieval for open-domain question answering
Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W.-T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.550 · Cited by 3,575 · see citing works
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101 · see citing works
Relevance feedback in information retrieval
Rocchio, J. J. (1971) · Medical Entomology and Zoology · Cited by 2,680 · see citing works
Longformer: The Long-Document Transformer
Beltagy, I., Peters, M. E., & Cohan, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05150 · Cited by 2,281 · see citing works
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069 · see citing works
Learning deep structured semantic models for web search using clickthrough data
Huang, P.-S., He, X., Gao, J., Deng, L., Acero, A., & Heck, L. P. (2013) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2505515.2505665 · Cited by 2,054 · see citing works
Self-citationTriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Joshi, M., Choi, E., Weld, D., & Zettlemoyer, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1147 · Cited by 1,690 · see citing works
Relevance-Based Language Models
Lavrenko, V. P., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130376 · Cited by 1,441 · see citing works
MS MARCO: A Human Generated MAchine Reading COmprehension DatasetPreprint
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T. G., et al. (2016) · arXiv (Cornell University) · doi:10.4230/lipics.giscience.2025.5 · Cited by 1,190 · see citing works
Self-citationLeveraging Passage Retrieval with Generative Models for Open Domain Question Answering
Izacard, G., & Grave, E. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.74 · Cited by 1,109 · see citing works
Reciprocal rank fusion outperforms condorcet and individual rank learning methods
Cormack, G. V., Clarke, C. L. A., & Buettcher, S. (2009) · Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1571941.1572114 · Cited by 797 · see citing works
Latent retrieval for weakly supervised open domain question answering
Lee, K., Chang, M.-W., & Toutanova, K. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1612 · Cited by 771 · see citing works
How Much Knowledge Can You Pack into the Parameters of a Language Model?
Roberts, A., Raffel, C., & Shazeer, N. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.437 · Cited by 638 · see citing works
REALM: Retrieval-Augmented Language Model Pre-Training
Guu, K., Lee, K., Tung, Z., Pasupat, P., & Chang, M.-W. (2020) · arXiv · doi:10.48550/arxiv.2002.08909 · Cited by 574 · see citing works
Sparse, Dense, and Attentional Representations for Text Retrieval
Luan, Y., Eisenstein, J., Toutanova, K., & Collins, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00369 · Cited by 363 · see citing works
The Second Conversational Intelligence Challenge (ConvAI2)
Dinan, E., Logacheva, V., Malykh, V., Miller, A., Shuster, K., Urbanek, J., Kiela, D., Szlam, A. D., Serban, I. V., Lowe, R., et al. (2019) · The Springer series on challenges in machine learning · doi:10.1007/978-3-030-29135-8_7 · Cited by 362 · see citing works
Yang, P., Fang, H., & Lin, J. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080721 · Cited by 321 · see citing works
The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems
Lowe, R., Pow, N., Serban, I. V., & Pineau, J. (2015) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/w15-4640 · Cited by 282 · see citing works
UMass at TREC 2004: Novelty and HARD
AbdulJaleel, N., Allan, J., Croft, W. B., Díaz, F., Larkey, L. S., Li, X., Smucker, M. D., & Wade, C. (2004) · doi:10.21236/ada460118 · Cited by 274 · see citing works
AmbigQA: Answering Ambiguous Open-domain Questions
Min, S., Michael, J., Hajishirzi, H., & Zettlemoyer, L. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.466 · Cited by 219 · see citing works
Positional relevance model for pseudo-relevance feedback
Lv, Y., & Zhai, C. (2010) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1835449.1835546 · Cited by 215 · see citing works
Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering
Asai, A., Hashimoto, K., Hajishirzi, H., Socher, R., & Xiong, C. (2019) · arXiv · doi:10.48550/arxiv.1911.10470 · Cited by 152 · see citing works
Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets
Lewis, P., Stenetorp, P., & Riedel, S. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.86 · Cited by 145 · see citing works
Few-Shot Generative Conversational Query Rewriting
Shi, Y., Liu, J., Yang, J., Xiong, C., Bennett, P. N., Gao, J., & Liu, Z. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401323 · Cited by 143 · see citing works
Self-citationA Discrete Hard EM Approach for Weakly Supervised Question Answering
Min, S., Chen, D., Hajishirzi, H., & Zettlemoyer, L. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1284 · Cited by 137 · see citing works
Knowledge Guided Text Retrieval and Reading for Open Domain Question AnsweringPreprint
Min, S., Chen, D., Zettlemoyer, L., & Hajishirzi, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.03868 · Cited by 82 · see citing works
Lin, S.-C., Yang, J.-H., Nogueira, R. F., Tsai, M.-F., Wang, C., & Lin, J. (2021) · ACM Transactions on Information Systems · doi:10.1145/3446426 · Cited by 70 · see citing works
NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons LearnedPreprint
Min, S., Boyd-Graber, J. L., Alberti, C., Chen, D., Choi, E., Collins, M., Guu, K., Hajishirzi, H., Lee, K., Palomaki, J., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.00133 · Cited by 63 · see citing works
Self-citationLin, S.-C., Yang, J.-H., Nogueira, R., Tsai, M.-F., Wang, C.-J., & Lin, J. (2020) · arXiv · doi:10.48550/arxiv.2005.02230 · Cited by 62 · see citing works
Question Rewriting for Conversational Question Answering
Vakulenko, S., Longpre, S., Tu, Z., & Anantha, R. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441748 · Cited by 37 · see citing works
Constrained Abstractive Summarization: Preserving Factual Consistency with Constrained GenerationPreprint
Mao, Y., Ren, X., Ji, H., & Han, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.12723 · Cited by 33 · see citing works
Self-citationOverview of the TREC 2022 deep learning trackPreprint
Craswell, N., Mitra, B., Yılmaz, E., Campos, D., Lin, J., Voorhees, E. M., & Soboroff, I. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.10865 · Cited by 26 · see citing works
Query Reformulation using Query History for Passage Retrieval in Conversational SearchPreprint
Lin, S.-C., Yang, J.-H., Nogueira, R. F., Tsai, M.-F., Wang, C., & Lin, J. (2020) · arXiv (Cornell University) · Cited by 19 · see citing works
Generative Question Refinement with Deep Reinforcement Learning in Retrieval-based QA System
Liu, Y., Zhang, C., Yan, X., Chang, Y., & Yu, P. S. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3358046 · Cited by 15 · see citing works
Deep Reinforced Query Reformulation for Information RetrievalPreprint
Wang, X., Macdonald, C., & Ounis, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.07987 · Cited by 13 · see citing works
Sequence to Sequence Learning for Query Expansion
Zaiem, S., & Sadat, F. (2019) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v33i01.330110075 · Cited by 7 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- Danqi Chen, Adam Fisch, Jason Weston, and Antoine Bordes. 2017. Reading Wikipedia to answer opendomain questions. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages 18701879, Vancouver, Canada. Association for Computational Linguistics.
- Rodrigo Nogueira and Kyunghyun Cho. 2017. Taskoriented query reformulation with reinforcement learning. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing , pages 574-583, Copenhagen, Denmark. Association for Computational Linguistics.
- Peilin Yang, Hui Fang, and Jimmy Lin. 2017. Anserini: Enabling the use of lucene for information retrieval research. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval , pages 1253-1256.
Cited by
Sorted by citations
What Makes Good In-Context Examples for GPT-3?
Liu, J., Shen, D., Zhang, Y., Dolan, B., Carin, L., & Chen, W. (2022) · Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures · doi:10.18653/v1/2022.deelio-1.10 · Cited by 563 · see citing works
Self-citationQu, Y., Ding, Y., Liu, J., Liu, K., Ren, R., Zhao, W. X., Dong, D., Wu, H. R., & Wang, H. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.466 · Cited by 479 · see citing works
Alkhalaf, M., Yu, P., Yin, M., & Deng, C. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104662 · Cited by 156 · see citing works
RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation
Zhang, F., Chen, B., Zhang, Y., Keung, J., Liu, J., Zan, D., Mao, Y., Lou, J.-G., & Chen, W. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.151 · Cited by 173 · see citing works
Self-citationFrom local to global: a graph rag approach to query-focused summarization
Edge, D., Trinh, H., Cheng, N., Bradley, J., Chao, A., Mody, A., Truitt, S., Metropolitansky, D., Ness, R. O., & Larson, J. (2024) · arXiv · doi:10.48550/arxiv.2404.16130 · Cited by 159 · see citing works
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking
Ren, R., Qu, Y., Liu, J., Zhao, W. X., She, Q., Wu, H. R., Wang, H., & Wen, J.-R. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.224 · Cited by 159 · see citing works
Retrieving and Reading: A Comprehensive Survey on Open-domain Question AnsweringPreprint
Zhu, F., Lei, W., Wang, C., Zheng, J., Poria, S., & Chua, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.00774 · Cited by 237 · see citing works
Semantic Models for the First-Stage Retrieval: A Comprehensive Review
Guo, J., Cai, Y., Fan, Y., Sun, F., Zhang, R., & Cheng, X. (2022) · ACM Transactions on Information Systems · doi:10.1145/3486250 · Cited by 130 · see citing works
Qu, Y., Ding, Y., Liu, J., Liu, K., Ren, R., Zhao, W. X., Dong, D., Wu, H. R., & Wang, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.08191 · Cited by 66 · see citing works
Pre-training Methods in Information Retrieval
Fan, Y., Xie, X., Cai, Y., Chen, J., Ma, X., Li, X., Zhang, R., & Guo, J. (2022) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000100 · Cited by 64 · see citing works
Domain-matched Pre-training Tasks for Dense Retrieval
Oğuz, B., Lakhotia, K., Gupta, A., Lewis, P., Karpukhin, V., Piktus, A., Chen, X., Riedel, S., Yih, S., Gupta, S., et al. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.114 · Cited by 46 · see citing works
Understanding the planning of LLM agents: A survey
Huang, X., Liu, W., Chen, X., Wang, X., Wang, H., Lian, D., Wang, Y., Tang, R., & Chen, E. (2024) · arXiv · doi:10.48550/arxiv.2402.02716 · Cited by 47 · see citing works
R2-D2: A Modular Baseline for Open-Domain Question Answering
Fajcik, M., Docekal, M., Ondrej, K., & Smrz, P. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.73 · Cited by 36 · see citing works
Reader-Guided Passage Reranking for Open-Domain Question Answering
Mao, Y., He, P., Liu, X., Shen, Y., Gao, J., Han, J., & Chen, W. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.29 · Cited by 30 · see citing works
Self-citationLearning to Rank in Generative Retrieval
Li, Y., Yang, N., Wang, L., Wei, F., & Li, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i8.28717 · Cited by 27 · see citing works
A Replication Study of Dense Passage RetrieverPreprint
Ma, X., Sun, K., Pradeep, R., & Lin, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.05740 · Cited by 44 · see citing works
Virtual Reality and Language Models, a New Frontier in Learning.
Izquierdo-Domenech, J., Linares-Pellicer, J., & Ferri-Molla, I. (2024) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2024.02.007 · Cited by 28 · see citing works
Dense Hierarchical Retrieval for Open-domain Question Answering
Liu, Y., Hashimoto, K., Zhou, Y., Yavuz, S., Xiong, C., & Yu, P. S. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.19 · Cited by 26 · see citing works
A Brief Survey of Question Answering Systems
Caballero, M. (2021) · International Journal of Artificial Intelligence & Applications · doi:10.5121/ijaia.2021.12501 · Cited by 21 · see citing works
What’s in a Name? Answer Equivalence For Open-Domain Question Answering
Si, C., Zhao, C., & Boyd-Graber, J. L. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.757 · Cited by 17 · see citing works
Alami, H., Mahdaouy, A. E., Benlahbib, A., En-Nahnahi, N., Berrada, I., & Alaoui, S. O. E. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.101709 · Cited by 15 · see citing works
KARMA: Augmenting Embodied AI Agents with Long-and-Short Term Memory Systems
Wang, Z., Yu, B., Zhao, J., Sun, W., Hou, S., Liang, S., Hu, X., Han, Y., & Gan, Y. (2025) · 2025 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra55743.2025.11128047 · Cited by 11 · see citing works
LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text RetrievalPreprint
Sun, S., Chen, Y.-C., Li, L., Wang, S., Fang, Y., & Liu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.08784 · Cited by 6 · see citing works
Building a literature knowledge base towards transparent biomedical AIPreprint
Huang, Y., Han, Z., Luo, X., Luo, X., Gao, Y., Zhao, M., Tang, F., Wang, Y., Chen, J., Li, C., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.09.22.614323 · Cited by 6 · see citing works
Adaptive Batch Scheduling for Open-Domain Question Answering
Choi, D., Shin, M., Kim, E., & Shin, D. R. (2021) · IEEE Access · doi:10.1109/access.2021.3103963 · Cited by 5 · see citing works
Pruning the Index Contents for Memory Efficient Open-Domain QAPreprint
Fajčík, M., Dočekal, M., Ondrej, K., & Smrž, P. (2021) · arXiv (Cornell University) · doi:10.13140/rg.2.2.32959.02727 · Cited by 6 · see citing works
Faster Feedback with AI? A Test Prioritization Study
Mattis, T., Böhme, L., Krebs, E., Rinard, M., & Hirschfeld, R. (2024) · International Conference on Art, Science, and Engineering of Programming (<Programming>) · doi:10.1145/3660829.3660837 · Cited by 2 · see citing works
Wang, C. G., Bosson, N., Rahimian, R., Schlesinger, S. A., Whitfield, D. A., & Toy, J. (2026) · Prehospital Emergency Care · doi:10.1080/10903127.2026.2668008 · Cited by 1 · see citing works
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingPreprint
Ren, R., Qu, Y., Liu, J., Zhao, W. X., She, Q., Wu, H. R., Wang, H., & Wen, J.-R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07367 · Cited by 34 · see citing works
Recent Advances in Automated Question Answering In Biomedical DomainPreprint
Baksi, K. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05937 · Cited by 1 · see citing works
What's in a Name? Answer Equivalence For Open-Domain Question AnsweringPreprint
Si, C., Zhao, C., & Boyd-Graber, J. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.05289
Language Models Can Remember: Improving Memory and Knowled Retrieval Ability for Closed-Book QaPreprint
Duan, F., Wang, K., Li, R., Wang, S., Yin, C., & Rong, W. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4782275
Citation-augmented text reuse detection
Muther, R. (2024) · doi:10.17760/d20649817
- Authors
- Mao, Y., He, P., Liu, X., Shen, Y., Gao, J., Han, J., & Chen, W.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Microsoft (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2009.08553
- OpenAlex
- W3087273879
- Cited by
- 31
- References
- 39
- Citations by year
- 2026: 1 · 2024: 9 · 2023: 1 · 2022: 4 · 2021: 15 · 2020: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- open-domain question answering, query expansion, text generation, BM25, dense retrieval, DPR, extractive question answering, Natural Questions, TriviaQA
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
