Passage Re-ranking with BERT
Open accessAbstract
Recently, neural models pretrained on a language modeling task, such as ELMo (Peters et al., 2017), OpenAI GPT (Radford et al., 2018), and BERT (Devlin et al., 2018), have achieved impressive results on various natural language processing tasks such as question-answering and natural language inference. In this paper, we describe a simple re-implementation of BERT for query-based passage re-ranking. Our system is the state of the art on the TREC-CAR dataset and the top entry in the leaderboard of the MS MARCO passage retrieval task, outperforming the previous state of the art by 27% (relative) in MRR@10. The code to reproduce our results is available at https://github.com/nyu-dl/dl4marco-bert
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · see citing works
Bidirectional Attention Flow for Machine ComprehensionPreprint
Seo, M., Kembhavi, A., Farhadi, A., & Hajishirzi, H. (2016) · International Conference on Learning Representations · doi:10.48550/arxiv.1611.01603 · Cited by 2,322 · see citing works
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Joshi, M., Choi, E., Weld, D., & Zettlemoyer, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1147 · Cited by 1,690 · see citing works
Reading Wikipedia to answer open-domain questions
Chen, D., Fisch, A., Weston, J., & Bordes, A. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1171 · Cited by 1,546 · see citing works
MS MARCO: A Human Generated MAchine Reading COmprehension DatasetPreprint
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T. G., et al. (2016) · arXiv (Cornell University) · doi:10.4230/lipics.giscience.2025.5 · Cited by 1,190 · see citing works
QANet: Combining Local Convolution with Global Self-Attention for Reading ComprehensionPreprint
Yu, A. W., Dohan, D., Luong, M.-T., Zhao, R., Chen, K., Norouzi, M., & Le, Q. V. (2018) · International Conference on Learning Representations · doi:10.48550/arxiv.1804.09541 · Cited by 1,169 · see citing works
A Deep Relevance Matching Model for Ad-hoc Retrieval
Guo, J., Fan, Y., Ai, Q., & Croft, W. B. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983769 · Cited by 821 · see citing works
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · arXiv · doi:10.48550/arxiv.1606.05250 · Cited by 678 · see citing works
Semi-supervised sequence tagging with bidirectional language models
Peters, M., Ammar, W., Bhagavatula, C., & Power, R. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1161 · Cited by 655 · see citing works
Learning to Match using Local and Distributed Representations of Text for Web Search
Mitra, B., Díaz, F., & Craswell, N. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3038912.3052579 · Cited by 458 · see citing works
Simple and Effective Multi-Paragraph Reading Comprehension
Clark, C., & Gardner, M. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1078 · Cited by 402 · see citing works
SearchQA: A New Q&A Dataset Augmented with Context from a Search Engine
Dunn, M., Sagun, L., Higgins, M., Guney, V. U., Cirik, V., & Cho, K. (2017) · arXiv · doi:10.48550/arxiv.1704.05179 · Cited by 359 · see citing works
Self-citationConvolutional Neural Networks for Soft-Matching N-Grams in Ad-hoc Search
Dai, Z., Xiong, C., Callan, J., & Liu, Z. (2018) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3159652.3159659 · Cited by 350 · see citing works
Yang, P., Fang, H., & Lin, J. (2018) · Journal of Data and Information Quality · doi:10.1145/3239571 · Cited by 222 · see citing works
The Neural Hype and Comparisons Against Weak Baselines
Lin, J. (2019) · ACM SIGIR Forum · doi:10.1145/3308774.3308781 · Cited by 141 · see citing works
Quasar: Datasets for Question Answering by Search and ReadingPreprint
Dhingra, B., Mazaitis, K., & Cohen, W. W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.03904 · Cited by 137 · see citing works
Hui, K., Yates, A., Berberich, K., & de Melo, G. (2018) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3159652.3159689 · Cited by 124 · see citing works
TREC Complex Answer Retrieval Overview.
Dietz, L., Verma, M., Radlinski, F., & Craswell, N. (2017) · Text REtrieval Conference · Cited by 84 · see citing works
Contextualized PACRR for Complex Answer Retrieval.
MacAvaney, S., Yates, A., & Hui, K. (2017) · Text REtrieval Conference · Cited by 6 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Danqi Chen, Adam Fisch, Jason Weston, and Antoine Bordes. Reading wikipedia to answer opendomain questions. arXiv preprint arXiv:1704.00051 , 2017. · arXiv
- Kai Hui, Andrew Yates, Klaus Berberich, and Gerard de Melo. Co-pacrr: A context-aware neural ir model for ad-hoc retrieval. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining , pp. 279-287. ACM, 2018.
- Chenyan Xiong, Zhuyun Dai, Jamie Callan, Zhiyuan Liu, and Russell Power. End-to-end neural adhoc ranking with kernel pooling. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval , pp. 55-64. ACM, 2017.
- Peilin Yang, Hui Fang, and Jimmy Lin. Anserini: Reproducible ranking baselines using lucene. Journal of Data and Information Quality (JDIQ) , 10(4):16, 2018.
Cited by
Sorted by citations
Dense passage retrieval for open-domain question answering
Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W.-T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.550 · Cited by 3,575 · see citing works
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101 · see citing works
ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT
Khattab, O., & Zaharia, M. (2020) · Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3397271.3401075 · Cited by 1,301 · see citing works
Retrieval-Augmented Generation for AI-Generated Content: A Survey
Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., & Cui, B. (2026) · Data Science and Engineering · doi:10.1007/s41019-025-00335-5 · Cited by 549 · see citing works
Document Ranking with a Pretrained Sequence-to-Sequence Model
Nogueira, R. F., Jiang, Z., Pradeep, R., & Lin, J. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.63 · Cited by 521 · see citing works
Self-citationQu, Y., Ding, Y., Liu, J., Liu, K., Ren, R., Zhao, W. X., Dong, D., Wu, H. R., & Wang, H. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.466 · Cited by 479 · see citing works
End-to-End Open-Domain Question Answering with BERTserini
Yang, W., Xie, Y., Lin, A., Li, X., Tan, L., Xiong, K., Li, M., & Lin, J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-4013 · Cited by 472 · see citing works
SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking
Formal, T., Piwowarski, B., & Clinchant, S. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463098 · Cited by 427 · see citing works
Deeper Text Understanding for IR with Contextual Neural Language Modeling
Dai, Z., & Callan, J. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331303 · Cited by 423 · see citing works
Salazar, J., Liang, D., Nguyen, T. Q., & Kirchhoff, K. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.240 · Cited by 414 · see citing works
Document Expansion by Query PredictionPreprint
Nogueira, R. F., Yang, W., Lin, J., & Cho, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.08375 · Cited by 382 · see citing works
Self-citationApproximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
Xiong, L., Xiong, C., Li, Y., Tang, K., Liu, J., Bennett, P. N., Ahmed, J., & Overwikj, A. (2021) · International Conference on Learning Representations · Cited by 376 · see citing works
Sparse, Dense, and Attentional Representations for Text Retrieval
Luan, Y., Eisenstein, J., Toutanova, K., & Collins, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00369 · Cited by 363 · see citing works
Multi-Stage Document Ranking with BERTPreprint
Nogueira, R. F., Yang, W., Cho, K., & Lin, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.14424 · Cited by 358 · see citing works
Self-citationColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction
Santhanam, K., Khattab, O., Saad-Falcon, J., Potts, C., & Zaharia, M. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.272 · Cited by 353 · see citing works
MacAvaney, S., Yates, A., Cohan, A., & Goharian, N. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331317 · Cited by 347 · see citing works
Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling
Hofstätter, S., Lin, S.-C., Yang, J.-H., Lin, J., & Hanbury, A. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462891 · Cited by 318 · see citing works
BERT applications in natural language processing: a review
Gardazi, N. M., Daud, A. Y., Malik, M. K., Bukhari, A. A., Alsahfi, T., & Alshemaimri, B. K. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11162-5 · Cited by 307 · see citing works
Pretrained Transformers for Text Ranking: BERT and Beyond
Lin, J., Nogueira, R. F., & Yates, A. (2021) · Synthesis lectures on human language technologies · doi:10.2200/s01123ed1v01y202108hlt053 · Cited by 273 · see citing works
Self-citationIs ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents
Sun, W., Yan, L., Ma, X., Wang, S., Ren, P., Chen, Z., Yin, D., & Ren, Z. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.923 · Cited by 270 · see citing works
ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTPreprint
Khattab, O., & Zaharia, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12832 · Cited by 270 · see citing works
Optimizing Dense Retrieval Model Training with Hard Negatives
Zhan, J., Mao, J., Liu, Y., Guo, J., Zhang, M., & Ma, S. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3462880 · Cited by 248 · see citing works
Taming Pretrained Transformers for Extreme Multi-label Text Classification
Chang, W.-C., Yu, H., Zhong, K., Yang, Y., & Dhillon, I. S. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403368 · Cited by 240 · see citing works
COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List
Gao, L., Dai, Z., & Callan, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.241 · Cited by 209 · see citing works
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
Xiong, L., Xiong, C., Li, Y., Tang, K.-F., Liu, J., Bennett, P., Ahmed, J., & Overwijk, A. (2020) · arXiv · doi:10.48550/arxiv.2007.00808 · Cited by 204 · see citing works
Understanding the Behaviors of BERT in Ranking
Qiao, Y., Xiong, C., Liu, Z., & Liu, Z. (2019) · arXiv · doi:10.48550/arxiv.1904.07531 · Cited by 201 · see citing works
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Ma, X., Wang, L., Yang, N., Wei, F., & Lin, J. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657951 · Cited by 187 · see citing works
Pretrained Transformers for Text Ranking: BERT and Beyond
Yates, A., Nogueira, R. F., & Lin, J. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441667 · Cited by 183 · see citing works
Self-citationBlockwise Self-Attention for Long Document Understanding
Qiu, J., Ma, H., Levy, O., Yih, W.-T., Wang, S., & Tang, J. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.232 · Cited by 179 · see citing works
Information Retrieval: Recent Advances and Beyond
Hambarde, K., & Proença, H. P. M. C. (2023) · IEEE Access · doi:10.1109/access.2023.3295776 · Cited by 176 · see citing works
Jin, Q., Kim, W., Chen, Q., Comeau, D. C., Yeganova, L., Wilbur, W. J., & Lu, Z. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad651 · Cited by 175 · see citing works
BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language ModelPreprint
Wang, A., & Cho, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.04094 · Cited by 174 · see citing works
Self-citationContext-Aware Sentence/Passage Term Importance Estimation For First Stage RetrievalPreprint
Dai, Z., & Callan, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.10687 · Cited by 171 · see citing works
Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting
Qin, Z., Jagerman, R., Hui, K., Zhuang, H., Wu, J., Yan, L. W., Shen, J., Liu, T., Liu, J., Metzler, D., et al. (2024) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2024.findings-naacl.97 · Cited by 165 · see citing works
CodeS: Towards Building Open-source Language Models for Text-to-SQL
Li, H., Zhang, J., Liu, H., Fan, J., Zhang, X., Zhu, J., Wei, R., Pan, H., Li, C., & Chen, H. (2024) · Proceedings of the ACM on Management of Data · doi:10.1145/3654930 · Cited by 160 · see citing works
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking
Ren, R., Qu, Y., Liu, J., Zhao, W. X., She, Q., Wu, H. R., Wang, H., & Wen, J.-R. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.224 · Cited by 159 · see citing works
Learning Passage Impacts for Inverted Indexes
Mallia, A., Khattab, O., Suel, T., & Tonellotto, N. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463030 · Cited by 158 · see citing works
Simple Applications of BERT for Ad Hoc Document RetrievalPreprint
Yang, W., Zhang, H., & Lin, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.10972 · Cited by 153 · see citing works
Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering
Asai, A., Hashimoto, K., Hajishirzi, H., Socher, R., & Xiong, C. (2019) · arXiv · doi:10.48550/arxiv.1911.10470 · Cited by 152 · see citing works
SPLADE v2: Sparse Lexical and Expansion Model for Information RetrievalPreprint
Formal, T., Lassance, C., Piwowarski, B., & Clinchant, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.10086 · Cited by 147 · see citing works
Few-Shot Generative Conversational Query Rewriting
Shi, Y., Liu, J., Yang, J., Xiong, C., Bennett, P. N., Gao, J., & Liu, Z. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401323 · Cited by 143 · see citing works
PARADE: Passage Representation Aggregation forDocument Reranking
Li, C., Yates, A., MacAvaney, S., He, B., & Sun, Y. (2023) · ACM Transactions on Information Systems · doi:10.1145/3600088 · Cited by 143 · see citing works
Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challenges
Wang, J., Huang, J. X., Tu, X., Wang, J., Huang, A. J., Laskar, M. T. R., & Bhuiyan, A. (2024) · ACM Computing Surveys · doi:10.1145/3648471 · Cited by 142 · see citing works
Zou, W., Hu, X., Pan, Z., Li, C., Cai, Y. C., & Liu, M. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106582 · Cited by 139 · see citing works
Cross-Domain Modeling of Sentence-Level Evidence for Document Retrieval
Yilmaz, Z. A., Yang, W., Zhang, H., & Lin, J. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1352 · Cited by 138 · see citing works
That is a Known Lie: Detecting Previously Fact-Checked Claims
Shaar, S., Babulkov, N., Martino, G. D. S., & Nakov, P. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.332 · Cited by 137 · see citing works
Context-Aware Term Weighting For First Stage Passage Retrieval
Dai, Z., & Callan, J. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401204 · Cited by 131 · see citing works
Context-Aware Document Term Weighting for Ad-Hoc Search
Dai, Z., & Callan, J. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380258 · Cited by 130 · see citing works
Semantic Models for the First-Stage Retrieval: A Comprehensive Review
Guo, J., Cai, Y., Fan, Y., Sun, F., Zhang, R., & Cheng, X. (2022) · ACM Transactions on Information Systems · doi:10.1145/3486250 · Cited by 130 · see citing works
In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval
Lin, S.-C., Yang, J.-H., & Lin, J. (2021) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/2021.repl4nlp-1.17 · Cited by 123 · see citing works
Re2G: Retrieve, Rerank, Generate
Glass, M., Rossiello, G., Chowdhury, M. F. M., Naik, A., Cai, P., & Gliozzo, A. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.194 · Cited by 122 · see citing works
Efficient Document Re-Ranking for Transformers by Precomputing Term Representations
MacAvaney, S., Nardini, F. M., Perego, R., Tonellotto, N., Goharian, N., & Frieder, O. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401093 · Cited by 121 · see citing works
Expansion via Prediction of Importance with Contextualization
MacAvaney, S., Nardini, F. M., Perego, R., Tonellotto, N., Goharian, N., & Frieder, O. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401262 · Cited by 121 · see citing works
RepBERT: Contextualized Text Embeddings for First-Stage RetrievalPreprint
Zhan, J., Mao, J., Liu, Y., Zhang, M., & Ma, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15498 · Cited by 121 · see citing works
The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence ModelsPreprint
Pradeep, R., Nogueira, R. F., & Lin, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.05667 · Cited by 119 · see citing works
Self-citationTraining Neural Response Selection for Task-Oriented Dialogue Systems
Henderson, M., Vulić, I., Gerz, D., Casanueva, I., Budzianowski, P., Coope, S., Spithourakis, G., Wen, T.-H., Mrkšić, N., & Su, P.-H. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1536 · Cited by 112 · see citing works
Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering
Asai, A. (2025) · TIB Data Manager · doi:10.57702/2jfyctjr · Cited by 109 · see citing works
Wang, F., Zhang, Z., Zhang, X., Wu, Z., Mo, T., Lu, Q., Wang, W., Li, R., Xu, J., Tang, X., et al. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3768165 · Cited by 106 · see citing works
Zero-shot Neural Passage Retrieval via Domain-targeted Synthetic Question Generation
Ma, J., Korotkov, I., Yang, Y., Hall, K., & McDonald, R. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.92 · Cited by 104 · see citing works
PyTerrier: Declarative Experimentation in Python from BM25 to Dense Retrieval
Macdonald, C., Tonellotto, N., MacAvaney, S., & Ounis, I. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482013 · Cited by 103 · see citing works
Distilling Knowledge from Reader to Retriever for Question Answering
Izacard, G., & Grave, E. (2020) · arXiv · doi:10.48550/arxiv.2012.04584 · Cited by 102 · see citing works
Few-Shot Conversational Dense Retrieval
Yu, S., Liu, Z., Xiong, C., Feng, T., & Liu, Z. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462856 · Cited by 101 · see citing works
COBERT: COVID-19 Question Answering System Using BERT
Alzubi, J. A. A., Jain, R., Singh, A., Parwekar, P., & Gupta, M. (2021) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-021-05810-5 · Cited by 100 · see citing works
Proceedings of the 18th BioNLP Workshop and Shared Task
(2019) · doi:10.18653/v1/w19-50 · Cited by 100 · see citing works
Leading Conversational Search by Suggesting Useful Questions
Rosset, C., Xiong, C., Song, X., Campos, D., Craswell, N., Tiwary, S., & Bennett, P. N. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380193 · Cited by 99 · see citing works
Applying BERT to Document Retrieval with Birch
Yilmaz, Z. A., Wang, S., Yang, W., Zhang, H., & Lin, J. (2019) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/d19-3004 · Cited by 98 · see citing works
Distilling Dense Representations for Ranking using Tightly-Coupled TeachersPreprint
Lin, S.-C., Yang, J.-H., & Lin, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11386 · Cited by 94 · see citing works
Assessing Generalizability of CodeBERT
Zhou, X., Han, D., & Lo, D. (2021) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme52107.2021.00044 · Cited by 93 · see citing works
SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarization
Ravaut, M., Joty, S., & Chen, N. F. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.309 · Cited by 93 · see citing works
Local Self-Attention over Long Text for Efficient Document Retrieval
Hofstätter, S., Zamani, H., Mitra, B., Craswell, N., & Hanbury, A. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401224 · Cited by 92 · see citing works
Masked graph modeling for molecule generation
Mahmood, O., Mansimov, E., Bonneau, R., & Cho, K. (2021) · Nature Communications · doi:10.1038/s41467-021-23415-2 · Cited by 92 · see citing works
Self-citationBERT-QE: Contextualized Query Expansion for Document Re-ranking
Zheng, Z., Hui, K., He, B., Han, X., Sun, L., & Yates, A. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.424 · Cited by 91 · see citing works
Complement Lexical Retrieval Model with Semantic Residual Embeddings
Gao, L., Dai, Z., Chen, T., Fan, Z., Durme, B. V., & Callan, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72113-8_10 · Cited by 91 · see citing works
Rethink Training of BERT Rerankers in Multi-stage Retrieval Pipeline
Gao, L., Dai, Z., & Callan, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72240-1_26 · Cited by 89 · see citing works
TILDE: Term Independent Likelihood moDEl for Passage Re-ranking
Zhuang, S., & Zuccon, G. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462922 · Cited by 84 · see citing works
GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval
Wang, K., Thakur, N., Reimers, N., & Gurevych, I. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.168 · Cited by 83 · see citing works
(2024) · ACM eBooks · doi:10.1145/3674127 · Cited by 82 · see citing works
Learning-to-Rank with BERT in TF-RankingPreprint
Han, S., Wang, X., Bendersky, M., & Najork, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.08476 · Cited by 82 · see citing works
PROP: Pre-training with Representative Words Prediction for Ad-hoc Retrieval
Ma, X., Guo, J., Zhang, R., Fan, Y., Ji, X., & Cheng, X. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441777 · Cited by 78 · see citing works
Scells, H., Zhuang, S., & Zuccon, G. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531766 · Cited by 75 · see citing works
KnowIT VQA: Answering Knowledge-Based Questions about Videos
García, N., Otani, M., Chu, C., & Nakashima, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6713 · Cited by 4 · see citing works
ANTIQUE: A Non-factoid Question Answering Benchmark
Hashemi, H., Aliannejadi, M., Zamani, H., & Croft, W. B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45442-5_21 · Cited by 73 · see citing works
Rekabsaz, N., Kopeinik, S., & Schedl, M. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462949 · Cited by 73 · see citing works
An Efficiency Study for SPLADE Models
Lassance, C., & Clinchant, S. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531833 · Cited by 73 · see citing works
Lin, S.-C., Yang, J.-H., Nogueira, R. F., Tsai, M.-F., Wang, C., & Lin, J. (2021) · ACM Transactions on Information Systems · doi:10.1145/3446426 · Cited by 70 · see citing works
Self-citationFast Passage Re-ranking with Contextualized Exact Term Matching and Efficient Passage ExpansionPreprint
Zhuang, S., & Zuccon, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.08513 · Cited by 70 · see citing works
(2022) · doi:10.1145/3511808.3557325 · Cited by 67 · see citing works
Open-Domain Question Answering
Chen, D., & Yih, W.-T. (2020) · doi:10.18653/v1/2020.acl-tutorials.8 · Cited by 67 · see citing works
GERE: Generative Evidence Retrieval for Fact Verification
Chen, J., Zhang, R., Guo, J., Fan, Y., & Cheng, X. (2022) · Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3477495.3531827 · Cited by 66 · see citing works
BERT-based Dense Retrievers Require Interpolation with BM25 for Effective Passage Retrieval
Wang, S., Zhuang, S., & Zuccon, G. (2021) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3471158.3472233 · Cited by 66 · see citing works
Fast changeset-based bug localization with BERT
Ciborowska, A., & Damevski, K. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510042 · Cited by 66 · see citing works
Globalizing BERT-based Transformer Architectures for Long Document Summarization
Grail, Q., Pérez, J., & Gaussier, É. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.154 · Cited by 65 · see citing works
Hashemi, H., Zamani, H., & Croft, W. B. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401061 · Cited by 64 · see citing works
Pre-training Methods in Information Retrieval
Fan, Y., Xie, X., Cai, Y., Chen, J., Ma, X., Li, X., Zhang, R., & Guo, J. (2022) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000100 · Cited by 64 · see citing works
Complementing Lexical Retrieval with Semantic Residual EmbeddingPreprint
Gao, L., Dai, Z., Chen, T., Fan, Z., Van Durme, B., & Callan, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13969 · Cited by 64 · see citing works
MIRACL : A Multilingual Retrieval Dataset Covering 18 Diverse Languages
Zhang, X., Thakur, N., Ogundepo, O., Kamalloo, E., Alfonso-Hermelo, D., Li, X., Liu, Q., Rezagholizadeh, M., & Lin, J. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00595 · Cited by 63 · see citing works
Entity alignment based on relational semantics augmentation for multilingual knowledge graphs
Akhtar, M. U., Liu, J., Xie, Z., Liu, X., Ahmed, S., & Huang, B. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109494 · Cited by 62 · see citing works
Table Search Using a Deep Contextualized Language Model
Chen, Z., Trabelsi, M., Heflin, J., Xu, Y., & Davison, B. D. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401044 · Cited by 62 · see citing works
Adversarial Retriever-Ranker for dense text retrievalPreprint
Zhang, H., Gong, Y., Shen, Y., Lv, J., Duan, N., & Chen, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.03611 · Cited by 61 · see citing works
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
Yu, D., Zhu, C., Fang, Y., Yu, W., Wang, S., Xu, Y., Ren, X., Yang, Y., & Zeng, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.340 · Cited by 60 · see citing works
- Authors
- Nogueira, R., & Cho, K.
- Affiliations
- New York University (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1901.04085
- OpenAlex
- W2909544278
- Cited by
- 615
- References
- 20
- Citations by year
- 2026: 8 · 2025: 26 · 2024: 59 · 2023: 89 · 2022: 90 · 2021: 164 · 2020: 136 · 2019: 43
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- BERT, query-based retrieval, passage retrieval, MS MARCO, natural language inference, question answering, pre-trained language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review