The DOI matches its DataCite record; 22 of the 22 references it cites were found in a registry or an index.
Passage Re-ranking with BERT
Open accessAbstract
Recently, neural models pretrained on a language modeling task, such as ELMo (Peters et al., 2017), OpenAI GPT (Radford et al., 2018), and BERT (Devlin et al., 2018), have achieved impressive results on various natural language processing tasks such as question-answering and natural language inference. In this paper, we describe a simple re-implementation of BERT for query-based passage re-ranking. Our system is the state of the art on the TREC-CAR dataset and the top entry in the leaderboard of the MS MARCO passage retrieval task, outperforming the previous state of the art by 27% (relative) in MRR@10. The code to reproduce our results is available at https://github.com/nyu-dl/dl4marco-bert
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“There is significant work on learning to retrieve documents in information retrieval, more recently with pre-trained, neural language models [44, 26] similar to ours.”
From Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (2020) · cites this paper as [44]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T., et al. (2016) · arXiv · doi:10.48550/arxiv.1611.09268 · Cited by 2,473
Bidirectional Attention Flow for Machine ComprehensionPreprint
Seo, M. J., Kembhavi, A., Farhadi, A., & Hajishirzi, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01603 · Cited by 1,698
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Joshi, M., Choi, E., Weld, D., & Zettlemoyer, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1147 · Cited by 1,690
Reading Wikipedia to answer open-domain questions
Chen, D., Fisch, A., Weston, J., & Bordes, A. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1171 · Cited by 1,546
QANet: Combining Local Convolution with Global Self-Attention for Reading ComprehensionPreprint
Yu, A. W., Dohan, D., Luong, M.-T., Zhao, R., Chen, K., Norouzi, M., & Le, Q. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.09541 · Cited by 882
A Deep Relevance Matching Model for Ad-hoc Retrieval
Guo, J., Fan, Y., Ai, Q., & Croft, W. B. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983769 · Cited by 858
Flagged first, then by citations
Research works printed but not linked: 4
- Danqi Chen, Adam Fisch, Jason Weston, and Antoine Bordes. Reading wikipedia to answer opendomain questions. arXiv preprint arXiv:1704.00051 , 2017. · arXiv
- Kai Hui, Andrew Yates, Klaus Berberich, and Gerard de Melo. Co-pacrr: A context-aware neural ir model for ad-hoc retrieval. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining , pp. 279-287. ACM, 2018.
- Chenyan Xiong, Zhuyun Dai, Jamie Callan, Zhiyuan Liu, and Russell Power. End-to-end neural adhoc ranking with kernel pooling. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval , pp. 55-64. ACM, 2017.
- Peilin Yang, Hui Fang, and Jimmy Lin. Anserini: Reproducible ranking baselines using lucene. Journal of Data and Information Quality (JDIQ) , 10(4):16, 2018.
Cited by
Sorted by citations
Items 101–200 of 1,004
(2021) · doi:10.18653/v1/2021.naacl-tutorials.1 · Cited by 59
Self-citationPRADA: Practical Black-box Adversarial Attacks against Neural Ranking Models
Wu, C. H., Zhang, R., Guo, J., de Rijke, M., Fan, Y., & Cheng, X. (2022) · ACM Transactions on Information Systems · doi:10.1145/3576923 · Cited by 59
Task-Aware Representation of Sentences for Generic Text Classification
Halder, K., Akbik, A., Krapac, J., & Vollgraf, R. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.285 · Cited by 65
Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access
Kim, S., Eric, M., Gopalakrishnan, K., Hedayatnia, B., Liu, Y., & Hakkani-Tür, D. Z. (2020) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2020.sigdial-1.35 · Cited by 64
Pre-trained Language Model based Ranking in Baidu Search
Zou, L., Zhang, S., Cai, H., Ma, D., Cheng, S., Wang, S., Shi, D., Cheng, Z., & Yin, D. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467147 · Cited by 61
BioMedBERT: A Pre-trained Biomedical Language Model for QA and IR
Chakraborty, S., Bisong, E., Bhatt, S., Wagner, T., Elliott, R., & Mosconi, F. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.59 · Cited by 61
Retrieve Fast, Rerank Smart: Cooperative and Joint Approaches for Improved Cross-Modal Retrieval
Geigle, G., Pfeiffer, J., Reimers, N., Vulić, I., & Gurevych, I. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00473 · Cited by 60
MS MARCO: Benchmarking Ranking Models in the Large-Data Regime
Craswell, N., Mitra, B., Yılmaz, E., Campos, D., & Lin, J. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462804 · Cited by 66
Encoding History with Context-aware Representation Learning for Personalized Search
Zhou, Y., Dou, Z., & Wen, J.-R. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401175 · Cited by 58
Shallow pooling for sparse labels
Arabzadeh, N., Vtyurina, A., Yan, X., & Clarke, C. L. A. (2022) · Information Retrieval · doi:10.1007/s10791-022-09411-0 · Cited by 61
An objective metric for Explainable AI: How and why to estimate the degree of explainability
Sovrano, F., & Vitali, F. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110866 · Cited by 60
A Transformer-based Embedding Model for Personalized Product Search
Bi, K., Ai, Q., & Croft, W. B. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401192 · Cited by 60
Comparison and Evaluation of Different Methods for the Feature Extraction from Educational Contents
Aguilar, J., Salazar, C., Velasco, H., Monsalve-Pulido, J. A., & Montoya, E. (2020) · Computation · doi:10.3390/computation8020030 · Cited by 53
Modularized Transfomer-based Ranking Framework
Gao, L., Dai, Z., & Callan, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.342 · Cited by 54
Early Exiting BERT for Efficient Document Ranking
Xin, J., Nogueira, R. F., Yu, Y., & Lin, J. (2020) · Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) · doi:10.18653/v1/2020.sustainlp-1.11 · Cited by 55
Self-citationNeural ranking models for document retrieval
Trabelsi, M., Chen, Z., Davison, B. D., & Heflin, J. (2021) · Information Retrieval · doi:10.1007/s10791-021-09398-0 · Cited by 56
Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Coding
Yang, Z., Wang, S., Rawat, B. P. S., Mitra, A., & Yu, H. Q. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.127 · Cited by 49
TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising
Yang, Z., Zhu, C., Gmyr, R., Zeng, M., Huang, X., & Darve, E. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.168 · Cited by 51
Kuzi, S., Zhang, M., Li, C., Bendersky, M., & Najork, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01195 · Cited by 76
Transformer based contextual text representation framework for intelligent information retrieval
Bhopale, A. P., & Tiwari, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121629 · Cited by 53
Deep learning on information retrieval and its applications
Zhu, R., Tu, X., & Huang, J. X. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-819764-6.00008-9 · Cited by 48
An Analysis of BERT in Document Ranking
Zhan, J., Mao, J., Liu, Y., Zhang, M., & Ma, S. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401325 · Cited by 48
Do neural ranking models intensify gender bias?
Rekabsaz, N., & Schedl, M. (2020) · Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3397271.3401280 · Cited by 64
CEQE: Contextualized Embeddings for Query Expansion
Naseri, S., Dalton, J., Yates, A., & Allan, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72113-8_31 · Cited by 54
Evaluating the Robustness of Retrieval Pipelines with Query Variation Generators
Penha, G., Câmara, A., & Hauff, C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-99736-6_27 · Cited by 58
Contextualized Query Embeddings for Conversational Search
Lin, S.-C., Yang, J.-H., & Lin, J. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.77 · Cited by 55
Cross-lingual Language Model Pretraining for Retrieval
Yu, P., Fei, H., & Li, P. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449830 · Cited by 48
Investigating the Successes and Failures of BERT for Passage Re-RankingPreprint
Padigela, H., Zamani, H., & Croft, W. B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.01758 · Cited by 51
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models
Thakur, N., Reimers, N., Rücklé, A., Srivastava, A., & Gurevych, I. (2021) · arXiv · doi:10.48550/arxiv.2104.08663 · Cited by 45
Understanding BERT Rankers Under Distillation
Gao, L., Dai, Z., & Callan, J. (2020) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3409256.3409838 · Cited by 51
Multi-View Document Representation Learning for Open-Domain Dense Retrieval
Zhang, S., Liang, Y., Gong, M., Jiang, D., & Duan, N. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.414 · Cited by 54
Curriculum Learning Strategies for IR
Penha, G., & Hauff, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45439-5_46 · Cited by 45
A proposed conceptual framework for a representational approach to information retrieval
Lin, J. (2021) · ACM SIGIR Forum · doi:10.1145/3527546.3527552 · Cited by 57
An Updated Duet Model for Passage Re-rankingPreprint
Mitra, B., & Craswell, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.07666 · Cited by 52
Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillation
Hofstätter, S., Althammer, S., Schröder, M., Sertkan, M., & Hanbury, A. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4068215 · Cited by 45
Robust Layout-aware IE for Visually Rich Documents with Pre-trained Language Models
Wei, M., He, Y., & Zhang, Q. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401442 · Cited by 48
A Collaborative AI-Enabled Pretrained Language Model for AIoT Domain Question Answering
Zhu, H., Tiwari, P., Ghoneim, A., & Hossain, M. S. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3097183 · Cited by 46
Pseudo Relevance Feedback with Deep Language Models and Dense Retrievers: Successes and Pitfalls
Li, H., Mourad, A., Zhuang, S., Koopman, B., & Zuccon, G. (2023) · ACM Transactions on Information Systems · doi:10.1145/3570724 · Cited by 52
ABNIRML: Analyzing the Behavior of Neural IR Models
MacAvaney, S., Feldman, S., Goharian, N., Downey, D., & Cohan, A. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00457 · Cited by 57
How Deep is your Learning: the DL-HARD Annotated Deep Learning Dataset
Mackie, I., Dalton, J., & Yates, A. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463262 · Cited by 43
Algorithms in Future Capital Markets
Koshiyama, A., Firoozye, N. B., & Treleaven, P. C. (2020) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3383455.3422539 · Cited by 48
Stealing Machine Learning Models: Attacks and Countermeasures for Generative Adversarial Networks
Hu, H., & Pang, J. (2021) · Annual Computer Security Applications Conference · doi:10.1145/3485832.3485838 · Cited by 54
Dealing with Typos for BERT-based Passage Retrieval and Ranking
Zhuang, S., & Zuccon, G. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.225 · Cited by 49
Beyond [CLS] through Ranking by Generation
dos Santos, C. N., Ma, X., Nallapati, R. M., Huang, Z., & Xiang, B. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.134 · Cited by 44
Predicting Efficiency/Effectiveness Trade-offs for Dense vs. Sparse Retrieval Strategy Selection
Arabzadeh, N., Yan, X., & Clarke, C. L. A. (2021) · Proceedings of the 30th ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482159 · Cited by 41
How Does Generative Retrieval Scale to Millions of Passages?
Pradeep, R., Hui, K., Gupta, J. P., Lelkes, A. D., Zhuang, H., Lin, J., Metzler, D., & Tran, V. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.83 · Cited by 70
Rethinking Query Expansion for BERT Reranking
Padaki, R., Dai, Z., & Callan, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45442-5_37 · Cited by 41
Reranking for Efficient Transformer-based Answer Selection
Matsubara, Y., Vu, T., & Moschitti, A. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401266 · Cited by 44
Contrastive Learning of User Behavior Sequence for Context-Aware Document Ranking
Zhu, Y., Nie, J., Dou, Z., Ma, Z., Zhang, X., Du, P., Zuo, X., & Jiang, H. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482243 · Cited by 43
Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Ranking
Zhuang, S., Liu, B., Koopman, B., & Zuccon, G. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.590 · Cited by 65
DynamicRetriever: A Pre-trained Model-based IR System Without an Explicit Index
Zhou, Y., Yao, J., Dou, Z., Wu, L., & Wen, J.-R. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1373-9 · Cited by 39
Embedding-based Zero-shot Retrieval through Query GenerationPreprint
Liang, D., Xu, P., Shakeri, S., dos Santos, C. N., Nallapati, R. M., Huang, Z., & Xiang, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.10270 · Cited by 39
Synthesizing scientific literature with retrieval-augmented language models
Asai, A., He, J., Shao, R., Shi, W., Singh, A., Chang, J. C., Lo, K., Soldaini, L., Feldman, S., D’Arcy, M., et al. (2026) · Nature · doi:10.1038/s41586-025-10072-4 · Cited by 38
UDAPDR: Unsupervised Domain Adaptation via LLM Prompting and Distillation of Rerankers
Saad-Falcon, J., Khattab, O., Santhanam, K., Florian, R., Franz, M., Roukos, S., Sil, A., Sultan, M. A., & Potts, C. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.693 · Cited by 53
Automatic detection of COVID-19 vaccine misinformation with graph link prediction
Weinzierl, M., & Harabagiu, S. M. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103955 · Cited by 40
Interpretable & Time-Budget-Constrained Contextualization for Re-RankingPreprint
Hofstätter, S., Zlabinger, M., & Hanbury, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.01854 · Cited by 38
Multiview Identifiers Enhanced Generative Retrieval
Li, Y., Yang, N., Wang, L., Wei, F., & Li, W. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.366 · Cited by 37
HopRAG: Multi-Hop Reasoning for Logic-Aware Retrieval-Augmented Generation
Liu, H., Wang, Z., Chen, X., Li, Z., Xiong, F., Yu, Q., & Zhang, W. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.97 · Cited by 71
Multi-step Entity-centric Information Retrieval for Multi-Hop Question Answering
Das, R., Godbole, A., Kavarthapu, D., Gong, Z., Singhal, A., Yu, M., Guo, X., Gao, T., Zamani, H., Zaheer, M., et al. (2019) · Workshop on Machine Reading for Question Answering (MRQA) · doi:10.18653/v1/d19-5816 · Cited by 41
Question Rewriting for Conversational Question Answering
Vakulenko, S., Longpre, S., Tu, Z., & Anantha, R. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441748 · Cited by 42
Ma, X., Guo, J., Zhang, R., Fan, Y., Li, Y., & Cheng, X. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462869 · Cited by 41
StruBERT: Structure-aware BERT for Table Search and Matching
Trabelsi, M., Chen, Z., Zhang, S., Davison, B. D., & Heflin, J. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3511972 · Cited by 47
R2-D2: A Modular Baseline for Open-Domain Question Answering
Fajcik, M., Docekal, M., Ondrej, K., & Smrz, P. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.73 · Cited by 36
Askari, A., Verberne, S., Abolghasemi, A., Kraaij, W., & Pasi, G. (2023) · ACM Transactions on Information Systems · doi:10.1145/3631938 · Cited by 39
Pre-training for Ad-hoc Retrieval
Ma, Z., Dou, Z., Xu, W. X., Zhang, X., Jiang, H., Cao, Z., & Wen, J.-R. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482286 · Cited by 38
Alaofi, M., Thomas, P., Scholer, F., & Sanderson, M. (2024) · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) · doi:10.1145/3673791.3698431 · Cited by 47
Selective Weak Supervision for Neural Information Retrieval
Zhang, K., Xiong, C., Liu, Z., & Liu, Z. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380131 · Cited by 38
A Comparison of Question Rewriting Methods for Conversational Passage Retrieval
Vakulenko, S., Voskarides, N., Tu, Z., & Longpre, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72240-1_43 · Cited by 35
Questions Are All You Need to Train a Dense Passage Retriever
Sachan, D. S., Lewis, M., Yogatama, D., Zettlemoyer, L., Pineau, J., & Zaheer, M. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00564 · Cited by 35
Todd, A., Bowden, J., & Moshfeghi, Y. (2024) · Intelligent systems in accounting, finance and management/Intelligent systems in accounting, finance & management · doi:10.1002/isaf.1549 · Cited by 37
FIRST: Faster Improved Listwise Reranking with Single Token Decoding
Reddy, R. G., Doo, J., Xu, Y., Sultan, M. A., Swain, D., Sil, A., & Ji, H. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.491 · Cited by 70
Hofstätter, S., Mitra, B., Zamani, H., Craswell, N., & Hanbury, A. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462889 · Cited by 40
Leveraging Lead Bias for Zero-shot Abstractive News Summarization
Zhu, C., Yang, Z., Gmyr, R., Zeng, M., & Huang, X. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462846 · Cited by 36
Adaptive Re-Ranking with a Corpus Graph
MacAvaney, S., Tonellotto, N., & Macdonald, C. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557231 · Cited by 46
Sensitive Data Detection and Classification in Spanish Clinical Text: Experiments with BERTPreprint
Pablos, A. G., Pérez, N., & Cuadros, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.03106 · Cited by 34
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingPreprint
Ren, R., Qu, Y., Liu, J., Zhao, W. X., She, Q., Wu, H. R., Wang, H., & Wen, J.-R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07367 · Cited by 34
Learning a Product Relevance Model from Click-Through Data in E-Commerce
Yao, S., Tan, J., Chen, X., Yang, K., Xiao, R., Deng, H., & Wan, X. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3450129 · Cited by 33
FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
Weller, O., Chang, B., MacAvaney, S., Lo, K., Cohan, A., Durme, B. V., Lawrie, D., & Soldaini, L. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.597 · Cited by 76
BERTnesia: Investigating the capture and forgetting of knowledge in BERT
Wallat, J., Singh, J., & Anand, A. (2020) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2020.blackboxnlp-1.17 · Cited by 40
Speech Recognition by Simply Fine-Tuning Bert
Huang, W.-C., Wu, C.-H., Luo, S.-B., Chen, K., Wang, H., & Toda, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413668 · Cited by 33
LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrieval
Xu, C., Guo, D., Duan, N., & McAuley, J. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.281 · Cited by 36
AI-based Question Answering Assistance for Analyzing Natural-language Requirements
Ezzini, S., Abualhaija, S., Arora, C., & Sabetzadeh, M. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00113 · Cited by 39
Cross-Lingual Relevance Transfer for Document RetrievalPreprint
Shi, P., & Lin, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.02989 · Cited by 36
Is Retriever Merely an Approximator of Reader?Preprint
Yang, S., & Seo, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.10999 · Cited by 50
Clickbait Spoiling via Question Answering and Passage Retrieval
Hagen, M., Fröbe, M., Jurk, A., & Potthast, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.484 · Cited by 35
A Technical Question Answering System with Transfer Learning
Yu, W., Wu, L., Deng, Y., Mahindru, R., Zeng, Q., Güven, S., & Jiang, M. (2020) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2020.emnlp-demos.13 · Cited by 32
Althammer, S., Askari, A., Verberne, S., & Hanbury, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.03937 · Cited by 40
Explaining Documents' Relevance to Search QueriesPreprint
Rahimi, R., Kim, Y., Zamani, H., & Allan, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.01314 · Cited by 37
Contextualized query expansion via unsupervised chunk selection for text retrieval
Zheng, Z., Hui, K., He, B., Han, X., Sun, L., & Yates, A. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102672 · Cited by 32
Agosti, M., Marchesin, S., & Silvello, G. (2020) · ACM Transactions on Information Systems · doi:10.1145/3417996 · Cited by 30
Reader-Guided Passage Reranking for Open-Domain Question Answering
Mao, Y., He, P., Liu, X., Shen, Y., Gao, J., Han, J., & Chen, W. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.29 · Cited by 32
A White Box Analysis of ColBERT
Formal, T., Piwowarski, B., & Clinchant, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72240-1_23 · Cited by 34
Learning To Retrieve: How to Train a Dense Retrieval Model Effectively and EfficientlyPreprint
Zhan, J., Mao, J., Liu, Y., Zhang, M., & Ma, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.10469 · Cited by 30
Chen, Y., & Xu, H. (2026) · International Journal of Graphic Design · doi:10.51903/ijgd.v4i1.3552 · Cited by 33
Towards Axiomatic Explanations for Neural Ranking Models
Völske, M., Bondarenko, A., Fröbe, M., Stein, B., Singh, J., Hagen, M., & Anand, A. (2021) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3471158.3472256 · Cited by 29
Comparison of Transfer Learning and Traditional Machine Learning Approach for Text Classification
Taneja, K. K., & Vashishtha, J. (2022) · International Conference on Computing for Sustainable Global Development · doi:10.23919/indiacom54597.2022.9763279 · Cited by 30
Ranked List Truncation for Large Language Model-based Re-Ranking
Meng, C., Arabzadeh, N., Askari, A., Aliannejadi, M., & de Rijke, M. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657864 · Cited by 28
Open-RAG: Enhanced Retrieval Augmented Reasoning with Open-Source Large Language Models
Islam, S. B., Rahman, M. A., Hossain, K. S. M. T., Hoque, E., Joty, S., & Parvez, M. R. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.831 · Cited by 37
MarkedBERT: Integrating Traditional IR Cues in Pre-trained Language Models for Passage Retrieval
Boualili, L., Moreno, J. G., & Boughanem, M. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401194 · Cited by 28
On the Calibration and Uncertainty of Neural Learning to Rank Models for Conversational Search
Penha, G., & Hauff, C. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.12 · Cited by 34
Metadata
- Authors
- Nogueira, R., & Cho, K.
- Affiliations
- New York University (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1901.04085
- OpenAlex
- W2909544278
- Cited by
- 615
- References
- 20
- Citations by year
- 2026: 8 · 2025: 26 · 2024: 59 · 2023: 89 · 2022: 90 · 2021: 164 · 2020: 136 · 2019: 43
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- BERT, query-based retrieval, passage retrieval, MS MARCO, natural language inference, question answering, pre-trained language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review