The DOI matches its DataCite record; 22 of the 22 references it cites were found in a registry or an index.
Passage Re-ranking with BERT
Open accessAbstract
Recently, neural models pretrained on a language modeling task, such as ELMo (Peters et al., 2017), OpenAI GPT (Radford et al., 2018), and BERT (Devlin et al., 2018), have achieved impressive results on various natural language processing tasks such as question-answering and natural language inference. In this paper, we describe a simple re-implementation of BERT for query-based passage re-ranking. Our system is the state of the art on the TREC-CAR dataset and the top entry in the leaderboard of the MS MARCO passage retrieval task, outperforming the previous state of the art by 27% (relative) in MRR@10. The code to reproduce our results is available at https://github.com/nyu-dl/dl4marco-bert
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“There is significant work on learning to retrieve documents in information retrieval, more recently with pre-trained, neural language models [44, 26] similar to ours.”
From Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (2020) · cites this paper as [44]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T., et al. (2016) · arXiv · doi:10.48550/arxiv.1611.09268 · Cited by 2,473
Bidirectional Attention Flow for Machine ComprehensionPreprint
Seo, M. J., Kembhavi, A., Farhadi, A., & Hajishirzi, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01603 · Cited by 1,698
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Joshi, M., Choi, E., Weld, D., & Zettlemoyer, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1147 · Cited by 1,690
Reading Wikipedia to answer open-domain questions
Chen, D., Fisch, A., Weston, J., & Bordes, A. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1171 · Cited by 1,546
QANet: Combining Local Convolution with Global Self-Attention for Reading ComprehensionPreprint
Yu, A. W., Dohan, D., Luong, M.-T., Zhao, R., Chen, K., Norouzi, M., & Le, Q. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.09541 · Cited by 882
A Deep Relevance Matching Model for Ad-hoc Retrieval
Guo, J., Fan, Y., Ai, Q., & Croft, W. B. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983769 · Cited by 858
Research works printed but not linked: 4
- Danqi Chen, Adam Fisch, Jason Weston, and Antoine Bordes. Reading wikipedia to answer opendomain questions. arXiv preprint arXiv:1704.00051 , 2017. · arXiv
- Kai Hui, Andrew Yates, Klaus Berberich, and Gerard de Melo. Co-pacrr: A context-aware neural ir model for ad-hoc retrieval. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining , pp. 279-287. ACM, 2018.
- Chenyan Xiong, Zhuyun Dai, Jamie Callan, Zhiyuan Liu, and Russell Power. End-to-end neural adhoc ranking with kernel pooling. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval , pp. 55-64. ACM, 2017.
- Peilin Yang, Hui Fang, and Jimmy Lin. Anserini: Reproducible ranking baselines using lucene. Journal of Data and Information Quality (JDIQ) , 10(4):16, 2018.
Cited by
Sorted by citations
Dense passage retrieval for open-domain question answering
Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W.-T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.550 · Cited by 3,575
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101
ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT
Khattab, O., & Zaharia, M. (2020) · Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3397271.3401075 · Cited by 1,301
Retrieval-Augmented Generation for AI-Generated Content: A Survey
Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., & Cui, B. (2026) · Data Science and Engineering · doi:10.1007/s41019-025-00335-5 · Cited by 871
Document Ranking with a Pretrained Sequence-to-Sequence Model
Nogueira, R. F., Jiang, Z., Pradeep, R., & Lin, J. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.63 · Cited by 686
Self-citationQu, Y., Ding, Y., Liu, J., Liu, K., Ren, R., Zhao, W. X., Dong, D., Wu, H. R., & Wang, H. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.466 · Cited by 597
End-to-End Open-Domain Question Answering with BERTserini
Yang, W., Xie, Y., Lin, A., Li, X., Tan, L., Xiong, K., Li, M., & Lin, J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-4013 · Cited by 535
SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking
Formal, T., Piwowarski, B., & Clinchant, S. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463098 · Cited by 526
Deeper Text Understanding for IR with Contextual Neural Language Modeling
Dai, Z., & Callan, J. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331303 · Cited by 445
Salazar, J., Liang, D., Nguyen, T. Q., & Kirchhoff, K. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.240 · Cited by 510
Document Expansion by Query PredictionPreprint
Nogueira, R. F., Yang, W., Lin, J., & Cho, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.08375 · Cited by 562
Self-citationApproximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
Xiong, L., Xiong, C., Li, Y., Tang, K., Liu, J., Bennett, P. N., Ahmed, J., & Overwikj, A. (2021) · International Conference on Learning Representations · Cited by 376
Sparse, Dense, and Attentional Representations for Text Retrieval
Luan, Y., Eisenstein, J., Toutanova, K., & Collins, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00369 · Cited by 363
Multi-Stage Document Ranking with BERTPreprint
Nogueira, R. F., Yang, W., Cho, K., & Lin, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.14424 · Cited by 510
Self-citationColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction
Santhanam, K., Khattab, O., Saad-Falcon, J., Potts, C., & Zaharia, M. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.272 · Cited by 353
MacAvaney, S., Yates, A., Cohan, A., & Goharian, N. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331317 · Cited by 370
Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling
Hofstätter, S., Lin, S.-C., Yang, J.-H., Lin, J., & Hanbury, A. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462891 · Cited by 374
BERT applications in natural language processing: a review
Gardazi, N. M., Daud, A. Y., Malik, M. K., Bukhari, A. A., Alsahfi, T., & Alshemaimri, B. K. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11162-5 · Cited by 354
Pretrained Transformers for Text Ranking: BERT and Beyond
Lin, J., Nogueira, R. F., & Yates, A. (2021) · Synthesis lectures on human language technologies · doi:10.2200/s01123ed1v01y202108hlt053 · Cited by 328
Self-citationIs ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents
Sun, W., Yan, L., Ma, X., Wang, S., Ren, P., Chen, Z., Yin, D., & Ren, Z. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.923 · Cited by 270
ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTPreprint
Khattab, O., & Zaharia, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12832 · Cited by 376
Optimizing Dense Retrieval Model Training with Hard Negatives
Zhan, J., Mao, J., Liu, Y., Guo, J., Zhang, M., & Ma, S. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3462880 · Cited by 248
Taming Pretrained Transformers for Extreme Multi-label Text Classification
Chang, W.-C., Yu, H., Zhong, K., Yang, Y., & Dhillon, I. S. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403368 · Cited by 260
COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List
Gao, L., Dai, Z., & Callan, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.241 · Cited by 265
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
Xiong, L., Xiong, C., Li, Y., Tang, K.-F., Liu, J., Bennett, P., Ahmed, J., & Overwijk, A. (2020) · arXiv · doi:10.48550/arxiv.2007.00808 · Cited by 204
Understanding the Behaviors of BERT in Ranking
Qiao, Y., Xiong, C., Liu, Z., & Liu, Z. (2019) · arXiv · doi:10.48550/arxiv.1904.07531 · Cited by 201
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Ma, X., Wang, L., Yang, N., Wei, F., & Lin, J. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657951 · Cited by 313
Pretrained Transformers for Text Ranking: BERT and Beyond
Yates, A., Nogueira, R. F., & Lin, J. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441667 · Cited by 194
Self-citationBlockwise Self-Attention for Long Document Understanding
Qiu, J., Ma, H., Levy, O., Yih, W.-T., Wang, S., & Tang, J. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.232 · Cited by 247
Information Retrieval: Recent Advances and Beyond
Hambarde, K., & Proença, H. P. M. C. (2023) · IEEE Access · doi:10.1109/access.2023.3295776 · Cited by 212
Jin, Q., Kim, W., Chen, Q., Comeau, D. C., Yeganova, L., Wilbur, W. J., & Lu, Z. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad651 · Cited by 175
BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language ModelPreprint
Wang, A., & Cho, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.04094 · Cited by 234
Self-citationContext-Aware Sentence/Passage Term Importance Estimation For First Stage RetrievalPreprint
Dai, Z., & Callan, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.10687 · Cited by 222
Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting
Qin, Z., Jagerman, R., Hui, K., Zhuang, H., Wu, J., Yan, L. W., Shen, J., Liu, T., Liu, J., Metzler, D., et al. (2024) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2024.findings-naacl.97 · Cited by 216
CodeS: Towards Building Open-source Language Models for Text-to-SQL
Li, H., Zhang, J., Liu, H., Fan, J., Zhang, X., Zhu, J., Wei, R., Pan, H., Li, C., & Chen, H. (2024) · Proceedings of the ACM on Management of Data · doi:10.1145/3654930 · Cited by 241
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking
Ren, R., Qu, Y., Liu, J., Zhao, W. X., She, Q., Wu, H. R., Wang, H., & Wen, J.-R. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.224 · Cited by 177
Learning Passage Impacts for Inverted Indexes
Mallia, A., Khattab, O., Suel, T., & Tonellotto, N. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463030 · Cited by 174
Simple Applications of BERT for Ad Hoc Document RetrievalPreprint
Yang, W., Zhang, H., & Lin, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.10972 · Cited by 176
Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering
Asai, A., Hashimoto, K., Hajishirzi, H., Socher, R., & Xiong, C. (2019) · arXiv · doi:10.48550/arxiv.1911.10470 · Cited by 152
SPLADE v2: Sparse Lexical and Expansion Model for Information RetrievalPreprint
Formal, T., Lassance, C., Piwowarski, B., & Clinchant, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.10086 · Cited by 297
Few-Shot Generative Conversational Query Rewriting
Shi, Y., Liu, J., Yang, J., Xiong, C., Bennett, P. N., Gao, J., & Liu, Z. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401323 · Cited by 152
PARADE: Passage Representation Aggregation forDocument Reranking
Li, C., Yates, A., MacAvaney, S., He, B., & Sun, Y. (2023) · ACM Transactions on Information Systems · doi:10.1145/3600088 · Cited by 184
Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challenges
Wang, J., Huang, J. X., Tu, X., Wang, J., Huang, A. J., Laskar, M. T. R., & Bhuiyan, A. (2024) · ACM Computing Surveys · doi:10.1145/3648471 · Cited by 156
Zou, W., Hu, X., Pan, Z., Li, C., Cai, Y. C., & Liu, M. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106582 · Cited by 147
Cross-Domain Modeling of Sentence-Level Evidence for Document Retrieval
Yilmaz, Z. A., Yang, W., Zhang, H., & Lin, J. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1352 · Cited by 144
That is a Known Lie: Detecting Previously Fact-Checked Claims
Shaar, S., Babulkov, N., Martino, G. D. S., & Nakov, P. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.332 · Cited by 158
Context-Aware Term Weighting For First Stage Passage Retrieval
Dai, Z., & Callan, J. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401204 · Cited by 150
Context-Aware Document Term Weighting for Ad-Hoc Search
Dai, Z., & Callan, J. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380258 · Cited by 136
Semantic Models for the First-Stage Retrieval: A Comprehensive Review
Guo, J., Cai, Y., Fan, Y., Sun, F., Zhang, R., & Cheng, X. (2022) · ACM Transactions on Information Systems · doi:10.1145/3486250 · Cited by 153
In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval
Lin, S.-C., Yang, J.-H., & Lin, J. (2021) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/2021.repl4nlp-1.17 · Cited by 156
Re2G: Retrieve, Rerank, Generate
Glass, M., Rossiello, G., Chowdhury, M. F. M., Naik, A., Cai, P., & Gliozzo, A. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.194 · Cited by 186
Efficient Document Re-Ranking for Transformers by Precomputing Term Representations
MacAvaney, S., Nardini, F. M., Perego, R., Tonellotto, N., Goharian, N., & Frieder, O. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401093 · Cited by 130
Expansion via Prediction of Importance with Contextualization
MacAvaney, S., Nardini, F. M., Perego, R., Tonellotto, N., Goharian, N., & Frieder, O. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401262 · Cited by 134
RepBERT: Contextualized Text Embeddings for First-Stage RetrievalPreprint
Zhan, J., Mao, J., Liu, Y., Zhang, M., & Ma, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15498 · Cited by 152
The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence ModelsPreprint
Pradeep, R., Nogueira, R. F., & Lin, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.05667 · Cited by 177
Self-citationTraining Neural Response Selection for Task-Oriented Dialogue Systems
Henderson, M., Vulić, I., Gerz, D., Casanueva, I., Budzianowski, P., Coope, S., Spithourakis, G., Wen, T.-H., Mrkšić, N., & Su, P.-H. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1536 · Cited by 122
Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering
Asai, A. (2025) · TIB Data Manager · doi:10.57702/2jfyctjr · Cited by 109
Wang, F., Zhang, Z., Zhang, X., Wu, Z., Mo, T., Lu, Q., Wang, W., Li, R., Xu, J., Tang, X., et al. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3768165 · Cited by 106
Zero-shot Neural Passage Retrieval via Domain-targeted Synthetic Question Generation
Ma, J., Korotkov, I., Yang, Y., Hall, K., & McDonald, R. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.92 · Cited by 104
PyTerrier: Declarative Experimentation in Python from BM25 to Dense Retrieval
Macdonald, C., Tonellotto, N., MacAvaney, S., & Ounis, I. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482013 · Cited by 103
Distilling Knowledge from Reader to Retriever for Question Answering
Izacard, G., & Grave, E. (2020) · arXiv · doi:10.48550/arxiv.2012.04584 · Cited by 102
Few-Shot Conversational Dense Retrieval
Yu, S., Liu, Z., Xiong, C., Feng, T., & Liu, Z. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462856 · Cited by 116
COBERT: COVID-19 Question Answering System Using BERT
Alzubi, J. A. A., Jain, R., Singh, A., Parwekar, P., & Gupta, M. (2021) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-021-05810-5 · Cited by 100
Proceedings of the 18th BioNLP Workshop and Shared Task
(2019) · doi:10.18653/v1/w19-50 · Cited by 100
Leading Conversational Search by Suggesting Useful Questions
Rosset, C., Xiong, C., Song, X., Campos, D., Craswell, N., Tiwary, S., & Bennett, P. N. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380193 · Cited by 102
Applying BERT to Document Retrieval with Birch
Yilmaz, Z. A., Wang, S., Yang, W., Zhang, H., & Lin, J. (2019) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/d19-3004 · Cited by 104
Distilling Dense Representations for Ranking using Tightly-Coupled TeachersPreprint
Lin, S.-C., Yang, J.-H., & Lin, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11386 · Cited by 141
Assessing Generalizability of CodeBERT
Zhou, X., Han, D., & Lo, D. (2021) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme52107.2021.00044 · Cited by 97
SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarization
Ravaut, M., Joty, S., & Chen, N. F. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.309 · Cited by 109
Local Self-Attention over Long Text for Efficient Document Retrieval
Hofstätter, S., Zamani, H., Mitra, B., Craswell, N., & Hanbury, A. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401224 · Cited by 92
Masked graph modeling for molecule generation
Mahmood, O., Mansimov, E., Bonneau, R., & Cho, K. (2021) · Nature Communications · doi:10.1038/s41467-021-23415-2 · Cited by 98
Self-citationBERT-QE: Contextualized Query Expansion for Document Re-ranking
Zheng, Z., Hui, K., He, B., Han, X., Sun, L., & Yates, A. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.424 · Cited by 109
Complement Lexical Retrieval Model with Semantic Residual Embeddings
Gao, L., Dai, Z., Chen, T., Fan, Z., Durme, B. V., & Callan, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72113-8_10 · Cited by 100
Rethink Training of BERT Rerankers in Multi-stage Retrieval Pipeline
Gao, L., Dai, Z., & Callan, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72240-1_26 · Cited by 108
TILDE: Term Independent Likelihood moDEl for Passage Re-ranking
Zhuang, S., & Zuccon, G. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462922 · Cited by 92
GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval
Wang, K., Thakur, N., Reimers, N., & Gurevych, I. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.168 · Cited by 83
(2024) · ACM eBooks · doi:10.1145/3674127 · Cited by 86
Learning-to-Rank with BERT in TF-RankingPreprint
Han, S., Wang, X., Bendersky, M., & Najork, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.08476 · Cited by 97
PROP: Pre-training with Representative Words Prediction for Ad-hoc Retrieval
Ma, X., Guo, J., Zhang, R., Fan, Y., Ji, X., & Cheng, X. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441777 · Cited by 86
Scells, H., Zhuang, S., & Zuccon, G. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531766 · Cited by 83
KnowIT VQA: Answering Knowledge-Based Questions about Videos
García, N., Otani, M., Chu, C., & Nakashima, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6713 · Cited by 6
ANTIQUE: A Non-factoid Question Answering Benchmark
Hashemi, H., Aliannejadi, M., Zamani, H., & Croft, W. B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45442-5_21 · Cited by 77
Rekabsaz, N., Kopeinik, S., & Schedl, M. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462949 · Cited by 79
An Efficiency Study for SPLADE Models
Lassance, C., & Clinchant, S. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531833 · Cited by 81
Lin, S.-C., Yang, J.-H., Nogueira, R. F., Tsai, M.-F., Wang, C., & Lin, J. (2021) · ACM Transactions on Information Systems · doi:10.1145/3446426 · Cited by 79
Self-citationFast Passage Re-ranking with Contextualized Exact Term Matching and Efficient Passage ExpansionPreprint
Zhuang, S., & Zuccon, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.08513 · Cited by 94
(2022) · doi:10.1145/3511808.3557325 · Cited by 67
Open-Domain Question Answering
Chen, D., & Yih, W.-T. (2020) · doi:10.18653/v1/2020.acl-tutorials.8 · Cited by 67
GERE: Generative Evidence Retrieval for Fact Verification
Chen, J., Zhang, R., Guo, J., Fan, Y., & Cheng, X. (2022) · Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3477495.3531827 · Cited by 66
BERT-based Dense Retrievers Require Interpolation with BM25 for Effective Passage Retrieval
Wang, S., Zhuang, S., & Zuccon, G. (2021) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3471158.3472233 · Cited by 84
Fast changeset-based bug localization with BERT
Ciborowska, A., & Damevski, K. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510042 · Cited by 77
Globalizing BERT-based Transformer Architectures for Long Document Summarization
Grail, Q., Pérez, J., & Gaussier, É. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.154 · Cited by 68
Hashemi, H., Zamani, H., & Croft, W. B. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401061 · Cited by 72
Pre-training Methods in Information Retrieval
Fan, Y., Xie, X., Cai, Y., Chen, J., Ma, X., Li, X., Zhang, R., & Guo, J. (2022) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000100 · Cited by 69
Complementing Lexical Retrieval with Semantic Residual EmbeddingPreprint
Gao, L., Dai, Z., Chen, T., Fan, Z., Van Durme, B., & Callan, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13969 · Cited by 73
MIRACL : A Multilingual Retrieval Dataset Covering 18 Diverse Languages
Zhang, X., Thakur, N., Ogundepo, O., Kamalloo, E., Alfonso-Hermelo, D., Li, X., Liu, Q., Rezagholizadeh, M., & Lin, J. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00595 · Cited by 87
Entity alignment based on relational semantics augmentation for multilingual knowledge graphs
Akhtar, M. U., Liu, J., Xie, Z., Liu, X., Ahmed, S., & Huang, B. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109494 · Cited by 63
Table Search Using a Deep Contextualized Language Model
Chen, Z., Trabelsi, M., Heflin, J., Xu, Y., & Davison, B. D. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401044 · Cited by 70
Adversarial Retriever-Ranker for dense text retrievalPreprint
Zhang, H., Gong, Y., Shen, Y., Lv, J., Duan, N., & Chen, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.03611 · Cited by 61
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
Yu, D., Zhu, C., Fang, Y., Yu, W., Wang, S., Xu, Y., Ren, X., Yang, Y., & Zeng, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.340 · Cited by 72
Metadata
- Authors
- Nogueira, R., & Cho, K.
- Affiliations
- New York University (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1901.04085
- OpenAlex
- W2909544278
- Cited by
- 615
- References
- 20
- Citations by year
- 2026: 8 · 2025: 26 · 2024: 59 · 2023: 89 · 2022: 90 · 2021: 164 · 2020: 136 · 2019: 43
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- BERT, query-based retrieval, passage retrieval, MS MARCO, natural language inference, question answering, pre-trained language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
