The DOI matches its DataCite record; the references it cites are not checked yet.
Unsupervised Dense Information Retrieval with Contrastive Learning
Open accessAbstract
Recently, information retrieval has seen the emergence of dense retrievers, using neural networks, as an alternative to classical sparse methods based on term-frequency. These models have obtained state-of-the-art results on datasets and tasks where large training sets are available. However, they do not transfer well to new applications with no training data, and are outperformed by unsupervised term-frequency methods such as BM25. In this work, we explore the limits of contrastive learning as a way to train unsupervised dense retrievers and show that it leads to strong performance in various retrieval settings. On the BEIR benchmark our unsupervised model outperforms BM25 on 11 out of 15 datasets for the Recall@100. When used as pre-training before fine-tuning, either on a few thousands in-domain examples or on the large MS~MARCO dataset, our contrastive model leads to improvements on the BEIR benchmark. Finally, we evaluate our approach for multi-lingual retrieval, where training data is even scarcer than for English, and show that our approach leads to strong unsupervised performance. Our model also exhibits strong cross-lingual transfer when fine-tuned on supervised English data only and evaluated on low resources language such as Swahili. We show that our unsupervised models can perform cross-lingual retrieval between different scripts, such as retrieving English documents from Arabic queries, which would not be possible with term matching methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Based on our review of existing work, we identify two primary retrieval methods suitable for non-parametric memory including sparse methods based on bag-of-words models and dense methods based on deep representation learning for vector encoding and relevance score calculation [269, 270, 232, 271].”
From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [232]
The cited source says what the claim attributes to it.
In the citing paper
“The retrieval of non-parametric memory involves locating the most relevant K memory fragments. This process consists of two main steps. It first calculates the relevance score between the query q and each fragment m in the non-parametric memory, and then ranks the fragments m based on their relevance scores and selects the topK fragments m with the highest scores to form the retrieval results [267”
From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [232]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Offdiagonal entries show that records optimized for one encoder largely retain effectiveness on others, with most cross-transfer pairs exceeding 70% AHR.”
From MemMorph: Tool Hijacking in LLM Agents via Memory Poisoning (2026) · cites this paper as Izacard et al., 2021
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The similarity score of HotpotQA distractors is not substantially larger than that of the least similar supporting passages, meaning that these distractors are not very effective.”
From HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models (2024) · cites this paper as [35]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“However, it can be seen that the distribution of the distractor scores in HotpotQA is much closer to the lower bound of the support passage scores compared to the other two datasets.”
From HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models (2024) · cites this paper as [35]
Experimental — accuracy not yet measured
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“We compare HippoRAG with existing RAG methods on multi-hop question answering (QA) and show that our method outperforms the state-of-the-art methods remarkably, by up to 20 %.”
From HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models (2024) · cites this paper as [35]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 58
- Akari Asai, Xinyan Yu, Jungo Kasai, and Hannaneh Hajishirzi. One question answering model for many languages with cross-lingual dense passage retrieval. CoRR , abs/2107.11976, 2021. URL https://arxiv. org/abs/2107.11976 . 10, 11 · arXiv
- Payal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Majumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, et al. Ms marco: A human generated machine reading comprehension dataset. arXiv preprint arXiv:1611.09268 , 2016. 3, 6 · arXiv
- Adam Berger, Rich Caruana, David Cohn, Dayne Freitag, and Vibhu Mittal. Bridging the lexical chasm: statistical approaches to answer-finding. In Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval , pp. 192-199, 2000. 1
- Mathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou, Julien Mairal, Piotr Bojanowski, and Armand Joulin. Emerging properties in self-supervised vision transformers. arXiv preprint arXiv:2104.14294 , 2021. 2 · arXiv
- Wei-Cheng Chang, Felix X Yu, Yin-Wen Chang, Yiming Yang, and Sanjiv Kumar. Pre-training tasks for embedding-based large-scale retrieval. arXiv preprint arXiv:2002.03932 , 2020. 2, 3 · arXiv
- Danqi Chen, Adam Fisch, Jason Weston, and Antoine Bordes. Reading Wikipedia to answer open-domain questions. In Proc. ACL , 2017a. 1
- Ting Chen, Yizhou Sun, Yue Shi, and Liangjie Hong. On sampling strategies for neural network-based collaborative filtering. arXiv preprint arXiv:1706.07881 , 2017b. 5 · arXiv
- Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. A simple framework for contrastive learning of visual representations. In International conference on machine learning , pp. 1597-1607. PMLR, 2020. 2, 4, 5
- Xilun Chen, Kushal Lakhotia, Barlas Oğuz, Anchit Gupta, Patrick Lewis, Stan Peshterliev, Yashar Mehdad, Sonal Gupta, and Wen-tau Yih. Salient phrase aware dense retrieval: Can a dense retriever imitate a sparse one?, 2021. URL https://arxiv.org/abs/2110.06918 . 3 · arXiv
- Jonathan H. Clark, Eunsol Choi, Michael Collins, Dan Garrette, Tom Kwiatkowski, Vitaly Nikolaev, and Jennimaria Palomaki. Tydi QA: A benchmark for information-seeking question answering in typologically diverse languages. CoRR , abs/2003.05002, 2020. URL https://arxiv.org/abs/2003.05002 . 9 · arXiv
- Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. Unsupervised cross-lingual representation learning at scale. CoRR , abs/1911.02116, 2019. URL http://arxiv.org/abs/1911.02116 . 9, 10, 19 · arXiv
- Scott Deerwester, Susan T Dumais, George W Furnas, Thomas K Landauer, and Richard Harshman. Indexing by latent semantic analysis. Journal of the American society for information science , 41(6):391-407, 1990. 2
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proc. NAACL , 2019. 3, 4
- Hongchao Fang, Sicheng Wang, Meng Zhou, Jiayuan Ding, and Pengtao Xie. Cert: Contrastive self-supervised learning for language understanding. arXiv preprint arXiv:2005.12766 , 2020. 3 · arXiv
- Thibault Formal, Carlos Lassance, Benjamin Piwowarski, and Stéphane Clinchant. Splade v2: Sparse lexical and expansion model for information retrieval. arXiv preprint arXiv:2109.10086 , 2021. 7 · arXiv
- Luyu Gao and Jamie Callan. Unsupervised corpus aware language model pre-training for dense passage retrieval. arXiv preprint arXiv:2108.05540 , 2021. 3 · arXiv
- Tianyu Gao, Xingcheng Yao, and Danqi Chen. Simcse: Simple contrastive learning of sentence embeddings. arXiv preprint arXiv:2104.08821 , 2021. 5, 7 · arXiv
- Daniel Gillick, Alessandro Presta, and Gaurav Singh Tomar. End-to-end retrieval in continuous space. arXiv preprint arXiv:1811.08008 , 2018. 3 · arXiv
- John M Giorgi, Osvald Nitski, Gary D Bader, and Bo Wang. Declutr: Deep contrastive learning for unsupervised textual representations. arXiv preprint arXiv:2006.03659 , 2020. 3 · arXiv
- Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Ming-Wei Chang. Realm: Retrieval-augmented language model pre-training. arXiv preprint arXiv:2002.08909 , 2020. 3, 5, 7 · arXiv
- Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross Girshick. Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pp. 9729-9738, 2020. 2, 6, 17
- Sebastian Hofstätter, Sheng-Chieh Lin, Jheng-Hong Yang, Jimmy Lin, and Allan Hanbury. Efficiently teaching an effective dense retriever with balanced topic aware sampling. arXiv preprint arXiv:2104.06967 , 2021. 7 · arXiv
- Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, and Larry Heck. Learning deep structured semantic models for web search using clickthrough data. In Proceedings of the 22nd ACM international conference on Information & Knowledge Management , pp. 2333-2338, 2013. 2, 4
- Samuel Humeau, Kurt Shuster, Marie-Anne Lachaux, and Jason Weston. Poly-encoders: Transformer architectures and pre-training strategies for fast and accurate multi-sentence scoring. arXiv preprint arXiv:1905.01969 , 2019. 3 · arXiv
- Gautier Izacard and Edouard Grave. Distilling knowledge from reader to retriever for question answering, 2020a. URL https://arxiv.org/abs/2012.04584 . 3, 7 · arXiv
- Gautier Izacard and Edouard Grave. Leveraging passage retrieval with generative models for open domain question answering. arXiv preprint arXiv:2007.01282 , 2020b. 6 · arXiv
- Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Sebastian Riedel, and Edouard Grave. A memory efficient baseline for open domain question answering. arXiv preprint arXiv:2012.15156 , 2020. 3 · arXiv
- Yacine Jernite, Samuel R Bowman, and David Sontag. Discourse-based objectives for fast unsupervised sentence representation learning. arXiv preprint arXiv:1705.00557 , 2017. 3 · arXiv
- Jeff Johnson, Matthijs Douze, and Hervé Jégou. Billion-scale similarity search with gpus. IEEE Transactions on Big Data , 2019. 3
- Karen Sparck Jones. A statistical interpretation of term specificity and its application in retrieval. Journal of documentation , 1972. 2
- Mandar Joshi, Eunsol Choi, Daniel S. Weld, and Luke Zettlemoyer. Triviaqa: A large scale distantly supervised challenge dataset for reading comprehension. In Proc. ACL , 2017. 6, 7
- Vladimir Karpukhin, Barlas Oğuz, Sewon Min, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. Dense passage retrieval for open-domain question answering. arXiv preprint arXiv:2004.04906 , 2020. 3, 4, 5, 7 · arXiv
- Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, et al. Natural questions: a benchmark for question answering research. Transactions of the Association for Computational Linguistics , 7:453-466, 2019. 1, 6, 7
- Jungmin Kwon, Jeongseop Kim, Hyunseo Park, and In Kwon Choi. ASAM: adaptive sharpness-aware minimization for scale-invariant learning of deep neural networks. arXiv preprint arXiv:2102.11600 , 2021. 17 · arXiv
- Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. Albert: A lite bert for self-supervised learning of language representations. arXiv preprint arXiv:1909.11942 , 2019. 3 · arXiv
- Kenton Lee, Ming-Wei Chang, and Kristina Toutanova. Latent retrieval for weakly supervised open domain question answering. In Proc. ACL , 2019. 2, 3, 4, 5, 6
- Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, Armen Aghajanyan, Sida Wang, and Luke Zettlemoyer. Pre-training via paraphrasing. arXiv preprint arXiv:2006.15020 , 2020. 3 · arXiv
- Jimmy Lin, Rodrigo Nogueira, and Andrew Yates. Pretrained transformers for text ranking: Bert and beyond. arXiv preprint arXiv:2010.06467 , 2020. 2 · arXiv
- Shayne Longpre, Yi Lu, and Joachim Daiber. MKQA: A linguistically diverse benchmark for multilingual open domain question answering. CoRR , abs/2007.15207, 2020. URL https://arxiv.org/abs/2007.15207 . 9 · arXiv
- Yi Luan, Jacob Eisenstein, Kristina Toutanova, and Michael Collins. Sparse, dense, and attentional representations for text retrieval. arXiv preprint arXiv:2005.00181 , 2020. 3 · arXiv
- Christopher D Manning, Hinrich Schütze, and Prabhakar Raghavan. Introduction to information retrieval . Cambridge university press, 2008. 2
- Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, and Xia Song. Coco-lm: Correcting and contrasting text sequences for language model pretraining. arXiv preprint arXiv:2102.08473 , 2021. 3 · arXiv
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems , pp. 3111-3119, 2013. 3
- Bhaskar Mitra, Nick Craswell, et al. An introduction to neural information retrieval. Foundations and Trends® in Information Retrieval , 13(1):1-126, 2018. 2
- Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, and Li Deng. Ms marco: A human generated machine reading comprehension dataset. In CoCo@ NIPS , 2016. 1
- Rodrigo Nogueira and Kyunghyun Cho. Passage re-ranking with bert. arXiv preprint arXiv:1901.04085 , 2019. 2, 4 · arXiv
- Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, and Rabab Ward. Deep sentence embedding using long short-term memory networks: Analysis and application to information retrieval. IEEE/ACM Transactions on Audio, Speech, and Language Processing , 24(4):694-707, 2016. 2
- Ori Ram, Gal Shachaf, Omer Levy, Jonathan Berant, and Amir Globerson. Learning to retrieve passages without supervision, 2021. URL https://arxiv.org/abs/2112.07708 . 3 · arXiv
- Nils Reimers and Iryna Gurevych. Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084 , 2019. 3, 4 · arXiv
- Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, and Grégoire Mesnil. Learning semantic representations using convolutional neural networks for web search. In Proceedings of the 23rd international conference on world wide web , pp. 373-374, 2014. 2
- Nandan Thakur, Nils Reimers, Andreas Rücklé, Abhishek Srivastava, and Iryna Gurevych. Beir: A heterogenous benchmark for zero-shot evaluation of information retrieval models. arXiv preprint arXiv:2104.08663 , 2021. 2, 6, 18, 19 · arXiv
- James Thorne, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. Fever: a large-scale dataset for fact extraction and verification. arXiv preprint arXiv:1803.05355 , 2018. 1 · arXiv
- Guillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, Vishrav Chaudhary, Francisco Guzmán, Armand Joulin, and Edouard Grave. CCNet: Extracting high quality monolingual datasets from web crawl data. In Proceedings of the 12th Language Resources and Evaluation Conference , 2020. 6, 9, 17
- Zhirong Wu, Yuanjun Xiong, Stella X Yu, and Dahua Lin. Unsupervised feature learning via non-parametric instance discrimination. In Proceedings of the IEEE conference on computer vision and pattern recognition , pp. 3733-3742, 2018. 2, 4, 6
- Zhuofeng Wu, Sinong Wang, Jiatao Gu, Madian Khabsa, Fei Sun, and Hao Ma. Clear: Contrastive learning for sentence representation. arXiv preprint arXiv:2012.15466 , 2020. 3 · arXiv
- Lee Xiong, Chenyan Xiong, Ye Li, Kwok-Fung Tang, Jialin Liu, Paul Bennett, Junaid Ahmed, and Arnold Overwijk. Approximate nearest neighbor negative contrastive learning for dense text retrieval. arXiv preprint arXiv:2007.00808 , 2020. 3, 4, 7 · arXiv
- Sohee Yang and Minjoon Seo. Is retriever merely an approximator of reader? arXiv preprint arXiv:2010.10999 , 2020. 3 · arXiv
- Xinyu Zhang, Xueguang Ma, Peng Shi, and Jimmy Lin. Mr. tydi: A multi-lingual benchmark for dense retrieval. CoRR , abs/2108.08787, 2021. URL https://arxiv.org/abs/2108.08787 . 9, 10 · arXiv
Cited by
Sorted by citations
Lost in the Middle: How Language Models Use Long Contexts
Liu, N. F., Lin, K., Hewitt, J., Paranjape, A., Bevilacqua, M., Petroni, F., & Liang, P. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00638 · Cited by 1,612
“When retrieving from Wikipedia to answer queries from NaturalQuestions-Open, we find that model performance saturates long before retriever re-call saturates, indicating that current models fail to effectively use additional retrieved doc-uments—using 50 documents instead of 20 retrieved documents only marginally impr…”
MethodInfluentialC-Pack: Packed Resources For General Chinese Embeddings
Xiao, S., Liu, Z., Zhang, P., Muennighoff, N., Lian, D., & Nie, J.-Y. (2024) · Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3626772.3657878 · Cited by 523
In-Context Retrieval-Augmented Language Models
Ram, O., Levine, Y., Dalmedigos, I., Muhlgay, D., Shashua, A., Leyton-Brown, K., & Shoham, Y. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00605 · Cited by 449
MTEB: Massive Text Embedding Benchmark
Muennighoff, N., Tazi, N., Magne, L., & Reimers, N. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.148 · Cited by 548
Precise Zero-Shot Dense Retrieval without Relevance Labels
Gao, L., Ma, X., Lin, J., & Callan, J. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.99 · Cited by 362
Mallen, A., Asai, A., Zhong, V., Das, R., Khashabi, D., & Hajishirzi, H. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.546 · Cited by 340
A comprehensive survey on contrastive learning
Hu, H., Wang, X., Zhang, Y. T., Chen, Q., & Guan, Q. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128645 · Cited by 274
Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy
Shao, Z., Gong, Y., Shen, Y., Huang, M., Duan, N., & Chen, W. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.620 · Cited by 200
Jin, Q., Kim, W., Chen, Q., Comeau, D. C., Yeganova, L., Wilbur, W. J., & Lu, Z. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad651 · Cited by 175
Retrieval-augmented generation for educational application: A systematic survey
Li, Z., Wang, Z., Wang, W., Hung, K., Xie, H., & Wang, F. L. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100417 · Cited by 151
Text Embeddings by Weakly-Supervised Contrastive Pre-training
Wang, L., Yang, N., Huang, X., Jiao, B., Yang, L., Jiang, D., Majumder, R., & Wei, F. (2022) · arXiv · doi:10.48550/arxiv.2212.03533 · Cited by 135
One Embedder, Any Task: Instruction-Finetuned Text Embeddings
Su, H., Shi, W., Kasai, J., Wang, Y., Hu, Y., Mari Ostendorf, E., Yih, W.-T., Smith, N. A., Zettlemoyer, L., & Yu, T. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.71 · Cited by 190
Evaluating Open-Domain Question Answering in the Era of Large Language Models
Kamalloo, E., Dziri, N., Clarke, C. L. A., & Rafiei, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.307 · Cited by 232
Asai, A., Wu, Z., Wang, Y., Sil, A., & Hajishirzi, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.11511 · Cited by 101
“By default, we use the top five documents from Contriever-MS MARCO (Izacard et al., 2022a); for biographies and open-domain QA, we use additional top five documents retrieved by a web search engine, following Luo et al. (2023); for ASQA, we use the author-provided top 5 documents by GTR-XXL (Ni et al., 2022) across al…”
MethodInfluentialLongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression
Jiang, H., Wu, Q., Luo, X., Li, D., Lin, C.-Y., Yang, Y., & Qiu, L. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.91 · Cited by 400
Improving Passage Retrieval with Zero-Shot Question Generation
Sachan, D., Lewis, M., Joshi, M., Aghajanyan, A., Yih, W.-T., Pineau, J., & Zettlemoyer, L. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.249 · Cited by 90
Retrieval-based Language Models and Applications
Asai, A., Min, S., Zhong, Z., & Chen, D. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 6: Tutorial Abstracts) · doi:10.18653/v1/2023.acl-tutorials.6 · Cited by 81
Few-shot In-context Learning on Knowledge Base Question Answering
Li, T., Ma, X., Zhuang, A., Gu, Y., Su, Y., & Chen, W. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.385 · Cited by 126
Cognitive Architectures for Language Agents
Sumers, T. R., Yao, S., Narasimhan, K., & Griffiths, T. L. (2023) · arXiv · doi:10.48550/arxiv.2309.02427 · Cited by 72
“, 2023a) or retrieval distillion (Izacard et al., 2021) may be helpful for language agents to learn better retrieval procedures.”
BackgroundMemGPT: Towards LLMs as Operating Systems
Packer, C., Wooders, S., Lin, K., Fang, V., Patil, S. G., Stoica, I., & Gonzalez, J. E. (2023) · arXiv · doi:10.48550/arxiv.2310.08560 · Cited by 64
“In the example shown, the user asks a question that can only be answered using information from a prior session (no longer in-context).”
BackgroundMethodMIRACL : A Multilingual Retrieval Dataset Covering 18 Diverse Languages
Zhang, X., Thakur, N., Ogundepo, O., Kamalloo, E., Alfonso-Hermelo, D., Li, X., Liu, Q., Rezagholizadeh, M., & Lin, J. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00595 · Cited by 87
Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaboration
Wu, Y., Zhou, S., Liu, Y., Lü, W., Liu, X., Zhang, Y., Sun, C., Wu, F., & Kuang, K. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.740 · Cited by 100
How to Train Your Dragon: Diverse Augmentation Towards Generalizable Dense Retrieval
Lin, S.-C., Asai, A., Li, M., Oğuz, B., Lin, J., Mehdad, Y., Yih, W.-T., & Chen, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.423 · Cited by 147
Adapting Language Models to Compress Contexts
Chevalier, A., Wettig, A., Ajith, A., & Chen, D. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.232 · Cited by 59
Generative Relevance Feedback with Large Language Models
Mackie, I., Chatterjee, S., & Dalton, J. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591992 · Cited by 65
Poisoning Retrieval Corpora by Injecting Adversarial Passages
Zhong, Z., Huang, Z., Wettig, A., & Chen, D. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.849 · Cited by 62
Task-aware Retrieval with Instructions
Asai, A., Schick, T., Lewis, P., Chen, X., Izacard, G., Riedel, S., Hajishirzi, H., & Yih, W.-T. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.225 · Cited by 46
Self-citationSimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval
Wang, L., Yang, N., Huang, X., Jiao, B., Yang, L., Jiang, D., Majumder, R., & Wei, F. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.125 · Cited by 111
Salient Phrase Aware Dense Retrieval: Can a Dense Retriever Imitate a Sparse One?
Chen, X., Lakhotia, K., Oğuz, B., Gupta, A., Lewis, P., Peshterliev, S., Mehdad, Y., Gupta, S., & Yih, W.-T. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.19 · Cited by 40
Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Ranking
Zhuang, S., Liu, B., Koopman, B., & Zuccon, G. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.590 · Cited by 65
Large Language Models are Built-in Autoregressive Search Engines
Ziems, N., Yu, W., Zhang, Z., & Jiang, M. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.167 · Cited by 53
Questions Are All You Need to Train a Dense Passage Retriever
Sachan, D. S., Lewis, M., Yogatama, D., Zettlemoyer, L., Pineau, J., & Zaheer, M. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00564 · Cited by 35
Lin, S.-C., Li, M., & Lin, J. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00556 · Cited by 35
UDAPDR: Unsupervised Domain Adaptation via LLM Prompting and Distillation of Rerankers
Saad-Falcon, J., Khattab, O., Santhanam, K., Florian, R., Franz, M., Roukos, S., Sil, A., Sultan, M. A., & Potts, C. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.693 · Cited by 53
Unsupervised Dense Retrieval with Relevance-Aware Contrastive Pre-Training
Lei, Y., Ding, L., Cao, Y. H., Zan, C., Yates, A., & Tao, D. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.695 · Cited by 42
Soft prompt tuning for augmenting dense retrieval with large language models
Peng, Z., Wu, X., Wang, Q., & Fang, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112758 · Cited by 43
Towards Effective and Efficient Sparse Neural Information Retrieval
Formal, T., Lassance, C., Piwowarski, B., & Clinchant, S. (2023) · ACM Transactions on Information Systems · doi:10.1145/3634912 · Cited by 30
Budakoglu, G., & Emekci, H. (2025) · IEEE Access · doi:10.1109/access.2025.3542334 · Cited by 34
Labeling-free RAG-enhanced LLM for intelligent fault diagnosis via reinforcement learning
Xu, J., Xu, Z., Jiang, Z., Chen, Z., Luo, H., Wang, Y., & Gui, W. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103864 · Cited by 27
Huang, W., Zhou, G., Lapata, M., Vougiouklis, P., Montella, S., & Pan, J. Z. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113648 · Cited by 29
Yu, Y., Xiong, C., Sun, S., Zhang, C., & Overwijk, A. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.95 · Cited by 58
ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval
Yu, Y., Zhuang, Y., Zhang, R., Yu, M., Shen, J., & Zhang, C. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.748 · Cited by 28
FIT-RAG: Black-Box RAG with Factual Information and Token Reduction
Mao, Y., Dong, X., Xu, W., Gao, Y., Wei, B., & Zhang, Y. (2024) · ACM Transactions on Information Systems · doi:10.1145/3676957 · Cited by 39
HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models
Gutiérrez, B. J., Shu, Y., Gu, Y., Yasunaga, M., & Su, Y. (2024) · arXiv · doi:10.48550/arxiv.2405.14831 · Cited by 152
“This capacity for single-step multi-hop retrieval yields strong performance improvements of around 3 and 20 points over current RAG methods [8, 27, 41, 53, 54] on two popular multi-hop QA benchmarks, MuSiQue [60] and 2WikiMultiHopQA [25].”
InfluentialShall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study
Wang, B., Ping, W., Xu, P., McAfee, L., Liu, Z., Shoeybi, M., Dong, Y., Kuchaiev, O., Li, B., Xiao, C., et al. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.482 · Cited by 21
JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claims
Zeng, F., & Gao, W. G. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00649 · Cited by 28
Towards evidence-aware retrieval-augmented generation via self-corrective chain-of-thought
Li, Y., Ke, W., Liu, J., Wang, P., Liu, J., & He, Y. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104369 · Cited by 24
Yang, H., Li, Z., Zhang, Y., Wang, J., Cheng, N., Li, M., & Xiao, J. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.326 · Cited by 23
Generating Is Believing: Membership Inference Attacks against Retrieval-Augmented Generation
Li, Y., Liu, G., Wang, C., & Yang, Y. (2024) · arXiv · doi:10.48550/arxiv.2406.19234 · Cited by 17
“We use Con-treiver [33] and DPR [34] as the retrievers, setting them to retrieve the 5 most similar samples from the external database.”
Generating Is Believing: Membership Inference Attacks against Retrieval-Augmented Generation
Li, Y., Liu, G., Wang, C., & Yang, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889013 · Cited by 52
Augmentation-Adapted Retriever Improves Generalization of Language Models as Generic Plug-In
Yu, Z., Xiong, C., Shi, Y., & Liu, Z. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.136 · Cited by 65
Augmentation-Adapted Retriever Improves Generalization of Language Models as Generic Plug-In
Yu, Z., Xiong, C., Yu, S., & Liu, Z. (2023) · arXiv · doi:10.48550/arxiv.2305.17331 · Cited by 17
In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents
Tan, Z., Yan, J., Hsu, I.-H., Han, R., Wang, Z., Le, L., Song, Y., Chen, Y., Palangi, H., Lee, G., et al. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.413 · Cited by 16
Chain-of-Skills: A Configurable Model for Open-Domain Question Answering
Ma, K., Cheng, H., Zhang, Y., Liu, X., Nyberg, E., & Gao, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.89 · Cited by 29
Learning Retrieval Augmentation for Personalized Dialogue Generation
Huang, Q., Fu, S., Liu, X., Wang, W., Ko, T., Zhang, Y., & Tang, L. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.154 · Cited by 26
Weakly-Supervised Scientific Document Classification via Retrieval-Augmented Multi-Stage Training
Xu, R., Yu, Y., Ho, J. C., & Yang, C. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3592085 · Cited by 17
Evaluating Embedding APIs for Information Retrieval
Kamalloo, E., Zhang, X., Ogundepo, O., Thakur, N., Alfonso-Hermelo, D., Rezagholizadeh, M., & Lin, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-industry.50 · Cited by 24
Query Rewriting for Retrieval-Augmented Large Language Models
Ma, X., Gong, Y., He, P., Zhao, H., & Duan, N. (2023) · arXiv · doi:10.48550/arxiv.2305.14283 · Cited by 14
“Earlier works strengthen the retrieve algorithm (Wu et al., 2022; Izacard et al., 2021) or jointly fine-tuning the reader model (Lewis et al.”
MethodSLIM: Sparsified Late Interaction for Multi-Vector Retrieval with Inverted Indexes
Li, M., Lin, S.-C., Ma, X., & Lin, J. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591977 · Cited by 15
Feng, Y., Wang, J., He, R., Zhou, L., & Li, Y. (2025) · GigaScience · doi:10.1093/gigascience/giaf109 · Cited by 24
Reasoning over Public and Private Data in Retrieval-Based Systems
Arora, S., Lewis, P., Fan, A., Kahn, J., & Ré, C. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00580 · Cited by 18
Lo, K., Shen, Z., Newman, B., Chang, J., Authur, R., Bransom, E., Candra, S., Chandrasekhar, Y., Huff, R., Kuehl, B., et al. (2023) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2023.emnlp-demo.45 · Cited by 19
Harnessing Multi-Role Capabilities of Large Language Models for Open-Domain Question Answering
Sun, H., Liu, Y., Wu, C., Yan, H., Tai, C., Gao, X., Shang, S., & Yan, R. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645670 · Cited by 15
What Are You Token About? Dense Retrieval as Distributions Over the Vocabulary
Ram, O., Bezalel, L., Zicher, A., Belinkov, Y., Berant, J., & Globerson, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.140 · Cited by 35
Toward Best Practices for Training Multilingual Dense Retrieval Models
Zhang, X., Ogueji, K., Ma, X., & Lin, J. (2023) · ACM Transactions on Information Systems · doi:10.1145/3613447 · Cited by 33
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression
Jiang, H., Wu, Q., Luo, X., Li, D., Lin, C.-Y., Yang, Y., & Qiu, L. (2023) · arXiv · Cited by 12
“Each example in the dataset contains a question and k related documents, utilizing the Contriever retrieval system (Izacard et al., 2022), one of which includes a document with the correct answer.”
MethodDual-Feedback Knowledge Retrieval for Task-Oriented Dialogue Systems
Shi, T., Li, L., Lin, Z., Yang, T., Quan, X., & Wang, Q. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.405 · Cited by 19
Enhancing Communication and Data Transmission Security in RAG Using Large Language Models
Gummadi, V., Udayaraju, P., Sarabu, V. R., Ravulu, C., Seelam, D. R., & Venkataramana, S. (2024) · 2024 4th International Conference on Sustainable Expert Systems (ICSES) · doi:10.1109/icses63445.2024.10763024 · Cited by 12
Ranking-Enhanced Unsupervised Sentence Representation Learning
Seonwoo, Y., Wang, G., Seo, C., Choudhary, S., Li, J., Li, X., Xu, P., Park, S., & Oh, A. H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.879 · Cited by 19
Retrieval-Pretrained Transformer: Long-range Language Modeling with Self-retrieval
Rubin, O., & Berant, J. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00693 · Cited by 38
ConFit: Improving Resume-Job Matching using Data Augmentation and Contrastive Learning
Yu, X., Zhang, J., & Yu, Z. (2024) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3640457.3688108 · Cited by 24
Xiong, Y., Tu, X., & Zhao, W. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104232 · Cited by 13
Li, M., Lin, S.-C., Oğuz, B., Ghoshal, A., Lin, J., Mehdad, Y., Yih, W.-T., & Chen, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.663 · Cited by 31
Kazi, S., Khoja, S., & Daud, A. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100756 · Cited by 9
Decker: Double Check with Heterogeneous Knowledge for Commonsense Fact Verification
Zou, A., Zhang, Z., & Zhao, H. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.752 · Cited by 13
Query Obfuscation for Information Retrieval Through Differential Privacy
Faggioli, G., & Ferro, N. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-56027-9_17 · Cited by 9
W-RAG: Weakly Supervised Dense Retrieval in RAG for Open-domain Question Answering
Nian, J., Peng, Z., Wang, Q., & Fang, Y. (2025) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3731120.3744578 · Cited by 17
Getting MoRE out of Mixture of Language Model Reasoning Experts
Si, C., Shi, W., Zhao, C., Zettlemoyer, L., & Boyd-Graber, J. L. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.552 · Cited by 32
Efficient Multimodal Selection for Retrieval in Knowledge-Based Visual Question Answering
Luo, L., Lai, H., Pan, Y., & Yin, J. P. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3527032 · Cited by 12
Zhao, Z., Jin, Q., Chen, F., Peng, T., & Yu, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.13876 · Cited by 9
Decomposing Complex Queries for Tip-of-the-tongue Retrieval
Lin, K., Lo, K., Gonzalez, J. E., & Klein, D. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.367 · Cited by 26
Towards large language models with human-like episodic memory
Dong, C., Lu, Q., Norman, K. A., & Michelmann, S. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2025.06.016 · Cited by 12
BehnamGhader, P., Miret, S., & Reddy, S. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1036 · Cited by 23
Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrieval
Giorgi, J., Soldaini, L., Wang, B., Bader, G. D., Lo, K., Wang, L. L., & Cohan, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.549 · Cited by 11
He, J., Zhang, B., Rouhizadeh, H., Chen, Y., Yang, R., Lu, J. S., Chen, X., Liu, N., & Teodoro, D. (2026) · Artificial Intelligence Review · doi:10.21203/rs.3.rs-8330917/v1 · Cited by 27
A Question Answering Framework for Decontextualizing User-facing Snippets from Scientific Documents
Newman, B., Soldaini, L., Fok, R., Cohan, A., & Lo, K. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.193 · Cited by 14
On the Way to LLM Personalization: Learning to Remember User Conversations
Magister, L. C., Metcalf, K., Zhang, Y., & ter Hoeve, M. (2024) · arXiv · doi:10.48550/arxiv.2411.13405 · Cited by 6
“} We choose BM25, because of its enduring strong performance (Salemi et al., 2024a; Izacard et al., 2022).”
Xiao, C., Long, Y., & Moubayed, N. A. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.778 · Cited by 10
The Effect of Scaling, Retrieval Augmentation and Form on the Factual Consistency of Language Models
Hagström, L., Saynova, D., Norlund, T., Johansson, M., & Johansson, R. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.332 · Cited by 6
Decoy Effect in Search Interaction: Understanding User Behavior and Measuring System Vulnerability
Chen, N., Liu, J., Fang, H., Luo, Y., Sakai, T., & Wu, X.-M. (2024) · ACM Transactions on Information Systems · doi:10.1145/3708884 · Cited by 12
Efficient Tuning of Large Language Models for Knowledge-Grounded Dialogue Generation
Zhang, B., Ma, H., Li, D., Ding, J., Wang, J., Xu, B., & Lin, H. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.17 · Cited by 5
NLP-Crowdsourcing Hybrid Framework for Inter-Researcher Similarity Detection
Correia, A., Guimarães, D., Paredes, H., Fonseca, B., Paulino, D., Trigo, L., Brazdil, P., Schneider, D., Grover, A., & Jameel, S. (2023) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2023.3319290 · Cited by 5
WebGLM: Towards an Efficient and Reliable Web-Enhanced Question-Answering System
Lai, H., Liu, X., Yu, H., Xu, Y., Iong, I. L., Yao, S., Zeng, A., Du, Z., Dong, Y., & Tang, J. (2025) · ACM Transactions on Information Systems · doi:10.1145/3729421 · Cited by 7
ExaRanker: Synthetic Explanations Improve Neural Rankers
Ferraretto, F., Laitz, T., Lotufo, R., & Nogueira, R. F. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3592067 · Cited by 24
Why Does Zero-Shot Cross-Lingual Generation Fail? An Explanation and a Solution
Li, T., & Murray, K. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.789 · Cited by 11
QAEA-DR: A Unified Text Augmentation Framework for Dense Retrieval
Tan, H., Zhan, S., Lin, H., Zheng, H.-T., & Chan, W. K. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3543203 · Cited by 9
NoLiMa: Long-Context Evaluation Beyond Literal Matching
Modarressi, A., Deilamsalehy, H., Dernoncourt, F., Bui, T., Rossi, R. A., Yoon, S., & Schütze, H. (2025) · arXiv · doi:10.48550/arxiv.2502.05167 · Cited by 3
“For this step, we use an embedding function, Contriever (Izacard et al., 2022), to find similar words in the haystack to the keywords of the questions.”
AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents
Anokhin, P., Semenov, N., Sorokin, A., Evseev, D., Kravchenko, A., Burtsev, M., & Burnaev, E. (2024) · arXiv · doi:10.48550/arxiv.2407.04363 · Cited by 8
Crafting the Path: Robust Query Rewriting for Information Retrieval
Baek, I., Lee, J., Yang, J., & Lee, H. (2025) · IEEE Access · doi:10.1109/access.2025.3538665 · Cited by 14
Metadata
- Authors
- Izacard, G., Caron, M., Hosseini, L., Riedel, S., Bojanowski, P., Joulin, A., & Grave, E.
- Affiliations
- Université Paris Sciences et Lettres (FR)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2112.09118
- OpenAlex
- W4320813768
- Cited by
- 172
- References
- 0
- Citations by year
- 2026: 14 · 2025: 44 · 2024: 29 · 2023: 79 · 2022: 6
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- contrastive learning, pre-training, cross-lingual transfer, low-resource languages, Swahili language, BEIR benchmark, MS MARCO
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
