CoChat
Sign Up
Cited by 214Information Retrieval and Search BehaviorTopic ModelingAdvanced Image and Video Retrieval Techniques

The DOI matches its Crossref record, with a small difference in title or year; 155 of the 156 references it cites were found in a registry or an index.

Dense Text Retrieval Based on Pretrained Language Models: A Survey

Open access
Zhao, Wayne Xin, Liu, Jing, Ren, Ruiyang, Wen, Ji-Rong·2024·ACM Transactions on Information Systems
DOI 10.1145/3637870
Open this paper in CoChat — free accountOpen PDF

Abstract

Text retrieval is a long-standing research topic on information seeking, where a system is required to return relevant information resources to user’s queries in natural language. From heuristic-based retrieval methods to learning-based ranking functions, the underlying retrieval models have been continually evolved with the ever-lasting technical innovation. To design effective retrieval models, a key point lies in how to learn text representations and model the relevance matching. The recent success of pretrained language models (PLM) sheds light on developing more capable text-retrieval approaches by leveraging the excellent modeling capacity of PLMs. With powerful PLMs, we can effectively learn the semantic representations of queries and texts in the latent representation space, and further construct the semantic matching function between the dense vectors for relevance modeling. Such a retrieval approach is called dense retrieval , since it employs dense vectors to represent the texts. Considering the rapid progress on dense retrieval, this survey systematically reviews the recent progress on PLM-based dense retrieval. Different from previous surveys on dense retrieval, we take a new perspective to organize the related studies by four major aspects, including architecture, training, indexing and integration, and thoroughly summarize the mainstream techniques for each aspect. We extensively collect the recent advances on this topic, and include 300+ reference papers. To support our survey, we create a website for providing useful resources, and release a code repository for dense retrieval. This survey aims to provide a comprehensive, practical reference focused on the major progress for dense text retrieval.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3637870

Cites

155 of 155 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 165

  1. Negar Arabzadeh, Bhaskar Mitra, and Ebrahim Bagheri. 2021. MS MARCO chameleons: Challenging the MS MARCO leaderboard with extremely obstinate queries. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management. 4426–4435.
  2. Martin Aumüller, Erik Bernhardsson, and Alexander Faithfull. 2017. ANN-benchmarks: A benchmarking tool for approximate nearest-neighbor algorithms. In Proceedings of the International Conference on Similarity Search and Applications (SISAP’17).
  3. Ricardo Baeza-Yates and Berthier A. Ribeiro-Neto. 2011. Modern Information Retrieval—The Concepts and Technology Behind Search, 2nd Ed.
  4. Petr Baudiš and Jan Šedivỳ. 2015. Modeling of the question answering task in the YodaQA system. In Proceedings of the International Conference of the Cross-language Evaluation Forum for European Languages. Springer, 222–228.
  5. Yoshua Bengio, Réjean Ducharme, and Pascal Vincent. 2000. A neural probabilistic language model. In Proceedings of the Advances in Neural Information Processing Systems 13, Papers from Neural Information Processing Systems (NIPS’00). 932–938.
  6. Nitin Bhatia and Vandana. 2010. Survey of nearest-neighbor techniques. Retrieved from https://arXiv:1007.0085
  7. Alexander Bondarenko, Maik Fröbe, Meriem Beloucif, Lukas Gienapp, Yamen Ajjour, Alexander Panchenko, Chris Biemann, Benno Stein, Henning Wachsmuth, Martin Potthast, and Matthias Hagen. 2020. Overview of touché 2020: Argument retrieval. In Proceedings of the Conference and Labs of the Evaluation Forum (CLEF’20).
  8. Vera Boteva, Demian Gholipour, Artem Sokolov, and Stefan Riezler. 2016. A full-text learning to rank dataset for medical information retrieval. In Proceedings of the European Conference on Information Retrieval. Springer, 716–722.
  9. Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford,Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. In Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems (NeurIPS’20).
  10. Yinqiong Cai Yixing Fan Jiafeng Guo Fei Sun Ruqing Zhang and Xueqi Cheng. 2021. Semantic models for the first-stage retrieval: A comprehensive review. Retrieved from https://arXiv:2103.04831
  11. Yinqiong Cai Jiafeng Guo Yixing Fan Qingyao Ai Ruqing Zhang and Xueqi Cheng. 2022. Hard negatives or false negatives: Correcting pooling bias in training neural ranking models. Retrieved from https://arXiv:2209.05072
  12. Wei-Cheng Chang, Felix X. Yu, Yin-Wen Chang, Yiming Yang, and Sanjiv Kumar. 2020. Pre-training tasks for embedding-based large-scale retrieval. In Proceedings of the 8th International Conference on Learning Representations (ICLR’20).
  13. Jiangui Chen, Ruqing Zhang, Jiafeng Guo, Yixing Fan, and Xueqi Cheng. 2022. GERE: Generative evidence retrieval for fact verification. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’22). 2184–2189.
  14. Qi Chen, Haidong Wang, Mingqin Li, Gang Ren, Scarlett Li, Jeffery Zhu, Jason Li, Chuanjie Liu, Lintao Zhang, and Jingdong Wang. 2018. SPTAG: A Library for Fast Approximate Nearest Neighbor Search.
  15. Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, and Jingdong Wang. 2021. SPANN: Highly efficient billion-scale approximate nearest-neighbor search. In Proceedings of the Annual Conference on Neural Information Processing Systems (NeurIPS’21).
  16. Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey E. Hinton. 2020. A simple framework for contrastive learning of visual representations. In Proceedings of the 37th International Conference on Machine Learning (ICML’20). 1597–1607.
  17. Tao Chen, Mingyang Zhang, Jing Lu, Michael Bendersky, and Marc-Alexander Najork. 2022. Out-of-domain semantics to the rescue! zero-shot hybrid retrieval models. In Proceedings of the Advances in Information Retrieval 44th European Conference on IR Research (ECIR’22).
  18. Xuanang Chen, Jian Luo, Ben He, Le Sun, and Yingfei Sun. 2022. Towards robust dense retrieval via local ranking alignment. In Proceedings of the 31st International Joint Conference on Artificial Intelligence (IJCAI’22). 1980–1986.
  19. Kyunghyun Cho, Bart van Merriënboer, Dzmitry Bahdanau, and Yoshua Bengio. 2014. On the properties of neural machine translation: encoder–decoder approaches. In Proceedings of the 8th Workshop on Syntax, Semantics and Structure in Statistical Translation (SSST’14). 103–111.
  20. Alexis Conneau and Douwe Kiela. 2018. SentEval: An evaluation toolkit for universal sentence representations. In Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC’18).
  21. Nick Craswell, Daniel Campos, Bhaskar Mitra, Emine Yilmaz, and Bodo Billerbeck. 2020. ORCAS: 20 million clicked query-document pairs for analyzing search. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management (CIKM’20). 2983–2989.
  22. Nick Craswell Bhaskar Mitra Emine Yilmaz and Daniel Campos. 2021. Overview of the TREC 2020 deep learning track. Retrieved from https://arXiv:2102.07662 · DOI
  23. Nick Craswell Bhaskar Mitra Emine Yilmaz Daniel Campos and Jimmy Lin. [n.d.]. TREC 2021 Deep Learning Track Guidelines. Retrieved from https://microsoft.github.io/msmarco/TREC-Deep-Learning.html · DOI
  24. Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, and Jimmy Lin. 2022. Overview of the TREC 2021 deep learning track. In Proceedings of the Text Retrieval Conference (TREC’22).
  25. Nick Craswell Bhaskar Mitra Emine Yilmaz Daniel Campos and Ellen M. Voorhees. 2020. Overview of the TREC 2019 deep learning track. Retrieved from https://arXiv:2003.07820 · DOI
  26. Andrew M. Dai and Quoc V. Le. 2015. Semi-supervised sequence learning. In Proceedings of the Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems (NeurIPS’15). 3079–3087.
  27. Zhuyun Dai and Jamie Callan. 2020. Context-aware document term weighting for ad hoc search. In Proceedings of the Web Conference (WWW’20). 1897–1907.
  28. Zhuyun Dai and Jamie Callan. 2020. Context-aware term weighting for first stage passage retrieval. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’20). 1533–1536.
  29. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4171–4186.
  30. Thomas Diggelmann Jordan Boyd-Graber Jannis Bulian Massimiliano Ciaramita and Markus Leippold. 2020. CLIMATE-FEVER: A dataset for verification of real-world climate claims. Retrieved from https://arXiv:2012.00614
  31. Miao Fan, Jiacheng Guo, Shuai Zhu, Shuo Miao, Mingming Sun, and Ping Li. 2019. MOBIUS: Towards the next generation of query-ad matching in baidu’s sponsored search. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’19). 2509–2517.
  32. Yixing Fan Xiaohui Xie Yinqiong Cai Jia Chen Xinyu Ma Xiangsheng Li Ruqing Zhang Jiafeng Guo and Yiqun Liu. 2021. Pre-training methods in information retrieval. Retrieved from https://arXiv:2111.13853
  33. Hui Fang, Tao Tao, and ChengXiang Zhai. 2004. A formal study of information retrieval heuristics. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’04).
  34. Hui Fang and ChengXiang Zhai. 2005. An exploration of axiomatic approaches to information retrieval. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’05).
  35. Thibault Formal, Benjamin Piwowarski, and Stéphane Clinchant. 2021. SPLADE: Sparse lexical and expansion model for first stage ranking. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2288–2292. · DOI
  36. Thibault Formal, Benjamin Piwowarski, and Stéphane Clinchant. 2021. A white box analysis of ColBERT. In Proceedings of the European Conference on Information Retrieveal (ECIR’21).
  37. Luyu Gao, Zhuyun Dai, and Jamie Callan. 2021. COIL: Revisit exact lexical match in information retrieval with contextualized inverted list. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 3030–3042.
  38. Luyu Gao, Zhuyun Dai, and Jamie Callan. 2021. Rethink training of BERT rerankers in multi-stage retrieval pipeline. In Proceedings of the Advances in Information Retrieval 43rd European Conference on IR Research (ECIR’21), Vol. 12657. 280–286.
  39. Tianyu Gao, Xingcheng Yao, and Danqi Chen. 2021. SimCSE: Simple contrastive learning of sentence embeddings. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’21).
  40. Tiezheng Ge, Kaiming He, Qifa Ke, and Jian Sun. 2013. Optimized product quantization for approximate nearest-neighbor search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’13). 2946–2953.
  41. Aristides Gionis, Piotr Indyk, Rajeev Motwani et al. 1999. Similarity search in high dimensions via hashing. In Proceedings of the International Conference on Very Large Data Bases (VLDB’99), Vol. 99. 518–529.
  42. Jiafeng Guo, Yixing Fan, Xiang Ji, and Xueqi Cheng. 2019. MatchZoo: A learning, practicing, and developing system for neural text matching. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’19). 1297–1300.
  43. Ruiqi Guo, Philip Sun, Erik Lindgren, Quan Geng, David Simcha, Felix Chern, and Sanjiv Kumar. 2020. Accelerating large-scale inference with anisotropic vector quantization. In Proceedings of the 37th International Conference on Machine Learning (ICML’20)(Proceedings of Machine Learning Research, Vol. 119). 3887–3896.
  44. Kiana Hajebi, Yasin Abbasi-Yadkori, Hossein Shahbazi, and Hong Zhang. 2011. Fast approximate nearest-neighbor search with k-nearest-neighbor graph. In Proceedings of the 22nd International Joint Conference on Artificial Intelligence (IJCAI’11). 1312–1317.
  45. Junxian He, Graham Neubig, and Taylor Berg-Kirkpatrick. 2021. Efficient nearest-neighbor language models. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’21).
  46. Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross B. Girshick. 2020. Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR’20). 9726–9735.
  47. Matthew Henderson Rami Al-Rfou Brian Strope Yun-Hsuan Sung László Lukács Ruiqi Guo Sanjiv Kumar Balint Miklos and Ray Kurzweil. 2017. Efficient natural language response suggestion for smart reply. Retrieved from https://arXiv:1705.00652
  48. Jonathan Herzig, Thomas Müller, Syrine Krichene, and Julian Eisenschlos. 2021. Open domain question answering over tables via dense retrieval. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 512–519.
  49. Sebastian Hofstätter Sophia Althammer Michael Schröder Mete Sertkan and Allan Hanbury. 2020. Improving efficient neural ranking models with cross-architecture knowledge distillation. Retrieved from https://arXiv:2010.02666
  50. Wu Hong, Zhuosheng Zhang, Jinyuan Wang, and Hai Zhao. 2022. Sentence-aware contrastive learning for open-domain passage retrieval. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics. 1062–1074.
  51. Jui-Ting Huang, Ashish Sharma, Shuying Sun, Li Xia, David Zhang, Philip Pronin, Janani Padmanabhan, Giuseppe Ottaviano, and Linjun Yang. 2020. Embedding-based retrieval in facebook search. In Proceedings of the 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD’20). 2553–2561.
  52. Samuel Humeau, Kurt Shuster, Marie-Anne Lachaux, and Jason Weston. 2020. Poly-encoders: Architectures and pre-training strategies for fast and accurate multi-sentence scoring. In Proceedings of the 8th International Conference on Learning Representations (ICLR’20).
  53. Piotr Indyk and Rajeev Motwani. 1998. Approximate nearest neighbors: Towards removing the curse of dimensionality. In Proceedings of the 30th Annual ACM Symposium on Theory of Computing (STOC’98).
  54. Gautier Izacard, Mathilde Caron, Lucas Hosseini, Sebastian Riedel, Piotr Bojanowski, Armand Joulin, and Edouard Grave. 2021. Towards unsupervised dense information retrieval with contrastive learning. Retrieved fromhttps://abs/2112.09118
  55. Gautier Izacard and Edouard Grave. 2021. Distilling knowledge from reader to retriever for question answering. In Proceedings of the International Conference on Learning Representations.
  56. Soyeong Jeong, Jinheon Baek, Sukmin Cho, Sung Ju Hwang, and Jong C. Park. 2022. Augmenting document representations for dense retrieval with interpolation and perturbation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics. 442–452.
  57. Mandar Joshi, Eunsol Choi, Daniel Weld, and Luke Zettlemoyer. 2017. TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. 1601–1611.
  58. Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, and Mike Lewis. 2020. Generalization through memorization: Nearest neighbor language models. In Proceedings of the 8th International Conference on Learning Representations (ICLR’20).
  59. Omar Khattab and Matei Zaharia. 2020. ColBERT: Efficient and effective passage search via contextualized late interaction over BERT. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’20). 39–48.
  60. Jon M. Kleinberg. 2000. The small-world phenomenon: An algorithmic perspective. In Proceedings of the 32nd Annual ACM Symposium on Theory of Computing. 163–170.
  61. Jinhyuk Lee Alexander Wettig and Danqi Chen. 2021. Phrase retrieval learns passage retrieval too. Retrieved from https://arXiv:2109.08133
  62. Patrick S. H. Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2020. Retrieval-augmented generation for knowledge-intensive NLP tasks. In Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems (NeurIPS’20).
  63. Hang Li Ahmed Mourad Shengyao Zhuang Bevan Koopman and Guido Zuccon. 2021. Pseudo relevance feedback with deep language models and dense retrievers: Successes and pitfalls. Retrieved from https://arXiv:2108.11044
  64. Yongqi Li, Nan Yang, Liang Wang, Furu Wei, and Wenjie Li. 2023. Multiview identifiers enhanced generative retrieval. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 6636–6648.
  65. Zehan Li Nan Yang Liang Wang and Furu Wei. 2022. Learning diverse document representations with deep query interactions for dense retrieval. Retrieved from https://arXiv:2208.04232
  66. Davis Liang Peng Xu Siamak Shakeri Cicero Nogueira dos Santos Ramesh Nallapati Zhiheng Huang and Bing Xiang. 2020. Embedding-based zero-shot retrieval through query generation. Retrieved from https://arXiv:2009.10270
  67. Sheng-Chieh Lin, Minghan Li, and Jimmy Lin. 2022. Aggretriever: A simple approach to aggregate textual representation for robust dense passage retrieval. Retrieved fromhttps://abs/2208.00511
  68. Sheng-Chieh Lin Jheng-Hong Yang and Jimmy Lin. 2020. Distilling dense representations for ranking using tightly-coupled teachers. Retrieved from https://arXiv:2010.11386
  69. Fangyu Liu Serhii Havrylov Yunlong Jiao Jordan Massiah and Emine Yilmaz. 2021. Trans-encoder: Unsupervised sentence-pair modelling through self-and mutual-distillations. Retrieved from https://arXiv:2109.13059
  70. Jiduan Liu Jiahao Liu Yang Yang Jingang Wang Wei Wu Dongyan Zhao and Rui Yan. 2022. GNN-encoder: Learning a dual-encoder architecture via graph neural networks for passage retrieval. Retrieved from https://arXiv:2204.08241
  71. Ye Liu, Kazuma Hashimoto, Yingbo Zhou, Semih Yavuz, Caiming Xiong, and S Yu Philip. 2021. Dense hierarchical retrieval for open-domain question answering. In Proceedings of the Association for Computational Linguistics (EMNLP’21). 188–200.
  72. Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized BERT pretraining approach. Retrieved from https://arXiv:1907.11692
  73. Zhenghao Liu, Kaitao Zhang, Chenyan Xiong, Zhiyuan Liu, and Maosong Sun. 2021. OpenMatch: An open source library for Neu-IR research. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’21). 2531–2535.
  74. Jing Lu, Gustavo Hernández Ábrego, Ji Ma, Jianmo Ni, and Yinfei Yang. 2021. Multi-stage training with improved negative contrast for neural passage retrieval. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 6091–6103.
  75. Shuai Lu, Nan Duan, Hojae Han, Daya Guo, Seung-won Hwang, and Alexey Svyatkovskiy. 2022. ReACC: A retrieval-augmented code completion framework. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL’22). 6227–6240.
  76. Shuqi Lu, Di He, Chenyan Xiong, Guolin Ke, Waleed Malik, Zhicheng Dou, Paul Bennett, Tie-Yan Liu, and Arnold Overwijk. 2021. Less is more: Pretrain a strong siamese encoder for dense text retrieval using a weak decoder. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’21). 2780–2791.
  77. Man Luo, Arindam Mitra, Tejas Gokhale, and Chitta Baral. 2022. Improving biomedical information retrieval with neural retrievers. In Proceedings of the 36th AAAI Conference on Artificial Intelligence (AAAI’22), 34th Conference on Innovative Applications of Artificial Intelligence (IAAI’22), and the 12th Symposium on Educational Advances in Artificial Intelligence (EAAI’22). 11038–11046.
  78. Xinyu Ma, Jiafeng Guo, Ruqing Zhang, Yixing Fan, and Xueqi Cheng. 2022. Pre-train a discriminative text encoder for dense retrieval via contrastive span prediction. In Proceedings of the 45rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 848–858.
  79. Xinyu Ma, Jiafeng Guo, Ruqing Zhang, Yixing Fan, Yingyan Li, and Xueqi Cheng. 2021. B-PROP: Bootstrapped pre-training with representative words prediction for ad hoc retrieval. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’21). 1318–1327.
  80. Xinyu Ma Ruqing Zhang Jiafeng Guo Yixing Fan and Xueqi Cheng. 2022. A contrastive pre-training approach to learn discriminative autoencoder for dense retrieval. Retrieved from https://arXiv:2208.09846
  81. Zhengyi Ma, Zhicheng Dou, Wei Xu, Xinyu Zhang, Hao Jiang, Zhao Cao, and Ji-Rong Wen. 2021. Pre-training for ad hoc retrieval: Hyperlink is also you need. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management. 1212–1221.
  82. Sean MacAvaney Sergey Feldman Nazli Goharian Doug Downey and Arman Cohan. 2020. ABNIRML: Analyzing the behavior of neural IR models. Retrieved from https://arXiv:2011.00696
  83. Sean MacAvaney, Andrew Yates, Arman Cohan, and Nazli Goharian. 2019. CEDR: Contextualized embeddings for document ranking. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’19). 1101–1104.
  84. Macedo Maia, Siegfried Handschuh, André Freitas, Brian Davis, Ross McDermott, Manel Zarrouk, and Alexandra Balahur. 2018. WWW’18 open challenge: Financial opinion mining and question answering. In Proceedings of the Web Conference (WWW’18). 1941–1942.
  85. Kelong Mao Zhicheng Dou Haonan Chen Fengran Mo and Hongjin Qian. 2023. Large language models know your contextual search intent: A prompting framework for conversational search. Retrieved from https://arXiv:2303.06573
  86. Tomás Mikolov, Ilya Sutskever, Kai Chen, Gregory S. Corrado, and Jeffrey Dean. 2013. Distributed representations of words and phrases and their compositionality. In Proceedings of the Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems (NeurIPS’13). 3111–3119.
  87. Bhaskar Mitra and Nick Craswell. 2017. Neural models for information retrieval. Retrieved from https://arXiv:1705.01509
  88. Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, and Li Deng. 2016. MS MARCO: A human generated machine reading comprehension dataset. In Proceedings of the Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches Co-located with the 30th Annual Conference on Neural Information Processing Systems (NIPS’16).
  89. Jianmo Ni, Chen Qu, Jing Lu, Zhuyun Dai, Gustavo Hern’andez ’Abrego, Ji Ma, Vincent Zhao, Yi Luan, Keith Hall, Ming-Wei Chang, and Yinfei Yang. 2021. Large dual encoders are generalizable retrievers. Retrieved fromhttps://abs/2112.07899
  90. Rodrigo Nogueira, Zhiying Jiang, Ronak Pradeep, and Jimmy Lin. 2020. Document ranking with a pretrained sequence-to-sequence model. In Proceedings of the Association for Computational Linguistics (EMNLP’20). 708–718.
  91. Rodrigo Nogueira Jimmy Lin and AI Epistemic. 2019. From doc2query to docTTTTTquery. Online Preprint 6 (2019) 2.
  92. Barlas Oguz Xilun Chen Vladimir Karpukhin Stan Peshterliev Dmytro Okhonko Michael Schlichtkrull Sonal Gupta Yashar Mehdad and Scott Yih. 2020. Unik-qa: Unified representations of structured and unstructured knowledge for open-domain question answering. Retrieved from https://arXiv:2012.14610
  93. Baolin Peng Michel Galley Pengcheng He Hao Cheng Yujia Xie Yu Hu Qiuyuan Huang Lars Liden Zhou Yu Weizhu Chen et al. 2023. Check your facts and try again: Improving large language models with external knowledge and automated feedback. Retrieved from https://arXiv:2302.12813
  94. Fabio Petroni, Aleksandra Piktus, Angela Fan, Patrick Lewis, Majid Yazdani, Nicola De Cao, James Thorne, Yacine Jernite, Vladimir Karpukhin, Jean Maillard, Vassilis Plachouras, Tim Rocktäschel, and Sebastian Riedel. 2021. KILT: A benchmark for knowledge intensive language tasks. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2523–2544.
  95. Tao Qin, Wei Chen, and Tie-Yan Liu. 2014. Sponsored search auctions: Recent advances and future directions. ACM Trans. Intell. Syst. Technol. 5, 4 (2014), 60:1–60:34.
  96. Yingqi Qu, Yuchen Ding, Jing Liu, Kai Liu, Ruiyang Ren, Wayne Xin Zhao, Daxiang Dong, Hua Wu, and Haifeng Wang. 2021. RocketQA: An optimized training approach to dense passage retrieval for open-domain question answering. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 5835–5847.
  97. Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learning transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning (ICML’21). 8748–8763.
  98. Alec Radford and Karthik arasimhan. 2018. Improving language understanding by generative pre-training. Online preprint (2018).
  99. Revanth Gangi Reddy Vikas Yadav Md Arafat Sultan Martin Franz Vittorio Castelli Heng Ji and Avirup Sil. 2021. Towards robust neural retrieval models with synthetic pre-training. Retrieved from https://arXiv:2104.07800
  100. Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-networks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP’19). 3982–3992.
  101. Ruiyang Ren, Shangwen Lv, Yingqi Qu, Jing Liu, Wayne Xin Zhao, QiaoQiao She, Hua Wu, Haifeng Wang, and Ji-Rong Wen. 2021. PAIR: Leveraging passage-centric similarity relation for improving dense passage retrieval. In Proceedings of the Association for Computational Linguistics (ACL-IJCNLP’21). 2173–2183.
  102. Ruiyang Ren, Yingqi Qu, Jing Liu, Wayne Xin Zhao, Qiaoqiao She, Hua Wu, Haifeng Wang, and Ji-Rong Wen. 2021. RocketQAv2: A joint training method for dense passage retrieval and passage re-ranking. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 2825–2835.
  103. Ruiyang Ren, Yingqi Qu, Jing Liu, Wayne Xin Zhao, Qifei Wu, Yuchen Ding, Hua Wu, Haifeng Wang, and Ji-Rong Wen. 2023. A thorough examination on zero-shot dense retrieval. In Proceedings of the Association for Computational Linguistics (EMNLP’23).
  104. Ruiyang Ren Yuhao Wang Yingqi Qu Wayne Xin Zhao Jing Liu Hao Tian Hua Wu Ji-Rong Wen and Haifeng Wang. 2023. Investigating the factual knowledge boundary of large language models with retrieval augmentation. Retrieved from https://arXiv:2307.11019
  105. Ruiyang Ren, Wayne Xin Zhao, Jing Liu, Hua Wu, Ji-Rong Wen, and Haifeng Wang. 2023. TOME: A two-stage approach for model-based retrieval. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 6102–6114.
  106. Stephen E. Robertson, Steve Walker, Susan Jones, Micheline M. Hancock-Beaulieu, Mike Gatford et al. 1995. Okapi at TREC-3. Nist Special Publ. 109 (1995), 109.
  107. Corby Rosset, Bhaskar Mitra, Chenyan Xiong, Nick Craswell, Xia Song, and Saurabh Tiwary. 2019. An axiomatic approach to regularizing neural ranking models. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’19), Benjamin Piwowarski, Max Chevalier, Éric Gaussier, Yoelle Maarek, Jian-Yun Nie, and Falk Scholer (Eds.). ACM, 981–984.
  108. Devendra Sachan, Mostofa Patwary, Mohammad Shoeybi, Neel Kant, Wei Ping, William L. Hamilton, and Bryan Catanzaro. 2021. End-to-end training of neural retrievers for open-domain question answering. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. 6648–6662.
  109. Devendra Singh Sachan Mike Lewis Dani Yogatama Luke Zettlemoyer Joelle Pineau and Manzil Zaheer. 2022. Questions are all you need to train a dense passage retriever. Retrieved from https://arXiv:2206.10658
  110. Gerard Salton. 1962. Some experiments in the generation of word and document associations. In Proceedings of the Computer Conference of the American Federation of Information Processing Societies (AFIPS’62). 234–250.
  111. Christopher Sciavolino, Zexuan Zhong, Jinhyuk Lee, and Danqi Chen. 2021. Simple entity-centric questions challenge dense retrievers. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’21).
  112. Minjoon Seo, Jinhyuk Lee, Tom Kwiatkowski, Ankur Parikh, Ali Farhadi, and Hannaneh Hajishirzi. 2019. Real-time open-domain question answering with dense-sparse phrase index. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 4430–4441.
  113. Siamak Shakeri, Cicero Nogueira dos Santos, Henghui Zhu, Patrick Ng, Feng Nan, Zhiguo Wang, Ramesh Nallapati, and Bing Xiang. 2020. End-to-end synthetic data generation for domain adaptation of question answering systems. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’20). 5445–5460.
  114. Anshumali Shrivastava and Ping Li. 2014. Asymmetric LSH (ALSH) for sublinear time maximum inner product search (MIPS). In Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems. 2321–2329.
  115. Georgios Sidiropoulos and Evangelos Kanoulas. 2022. Analysing the robustness of dual encoders for dense retrieval against misspellings. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’22). 2132–2136.
  116. Ian Soboroff, Shudong Huang, and Donna Harman. 2019. TREC 2019 news track overview. In Proceedings of the Text Retrieval Conference (TREC’19).
  117. Richard Socher, Eric H. Huang, Jeffrey Pennington, Andrew Y. Ng, and Christopher D. Manning. 2011. Dynamic pooling and unfolding recursive autoencoders for paraphrase detection. In Proceedings of the Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems. 801–809.
  118. Richard Socher, Jeffrey Pennington, Eric H. Huang, Andrew Y. Ng, and Christopher D. Manning. 2011. Semi-supervised recursive autoencoders for predicting sentiment distributions. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 151–161.
  119. Axel Suarez, Dyaa Albakour, David Corney, Miguel Martinez, and José Esquivel. 2018. A data collection for evaluating the retrieval of related tweets to news articles. In Proceedings of the European Conference on Information Retrieval. Springer, 780–786.
  120. Suhas Jayaram Subramanya, Fnu Devvrit, Harsha Vardhan Simhadri, Ravishankar Krishnaswamy, and Rohan Kadekodi. 2019. DiskANN: Fast accurate billion-point nearest-neighbor search on a single node. In Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems (NeurIPS’19).
  121. Yu Sun, Shuohuan Wang, Yu-Kun Li, Shikun Feng, Hao Tian, Hua Wu, and Haifeng Wang. 2020. ERNIE 2.0: A continual pre-training framework for language understanding. In Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI’20), the 32nd Innovative Applications of Artificial Intelligence Conference (IAAI’20), the 10th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI’20). 8968–8975.
  122. Hongyin Tang, Xingwu Sun, Beihong Jin, Jingang Wang, Fuzheng Zhang, and Wei Wu. 2021. Improving document representations by generating pseudo query embeddings for dense retrieval. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. 5054–5064.
  123. Zhengyang Tang Benyou Wang and Ting Yao. 2022. DPTDR: Deep prompt tuning for dense passage retrieval. Retrieved from https://arXiv:2208.11503
  124. Nandan Thakur, Nils Reimers, Johannes Daxenberger, and Iryna Gurevych. 2021. Augmented SBERT: Data augmentation method for improving bi-encoders for pairwise sentence scoring tasks. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 296–310.
  125. Nandan Thakur Nils Reimers Andreas Rücklé Abhishek Srivastava and Iryna Gurevych. 2021. BEIR: A heterogenous benchmark for zero-shot evaluation of information retrieval models. Retrieved from https://arXiv:2104.08663
  126. James Thorne, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. 2018. FEVER: A large-scale dataset for fact extraction and VERification. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 809–819.
  127. Naftali Tishby and Noga Zaslavsky. 2015. Deep learning and the information bottleneck principle. In Proceedings of the IEEE Information Theory Workshop (ITW’15). 1–5.
  128. Nicola Tonellotto and Craig Macdonald. 2021. Query embedding pruning for dense retrieval. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management. 3453–3457.
  129. Saúl Vargas. 2014. Novelty and diversity enhancement and evaluation in recommender systems and information retrieval. In Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’14). 1281.
  130. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems. 5998–6008.
  131. Michael Völske, Alexander Bondarenko, Maik Fröbe, Benno Stein, Jaspreet Singh, Matthias Hagen, and Avishek Anand. 2021. Towards axiomatic explanations for neural ranking models. In Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval. 13–22.
  132. Ellen M. Voorhees et al. 1999. The trec-8 question answering track report. In Proceedings of the Text Retrieval Conference (TREC’99), Vol. 99. 77–82.
  133. Henning Wachsmuth, Shahbaz Syed, and Benno Stein. 2018. Retrieval of the best counterargument without prior topic knowledge. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics. 241–251.
  134. David Wadden, Shanchuan Lin, Kyle Lo, Lucy Lu Wang, Madeleine van Zuylen, Arman Cohan, and Hannaneh Hajishirzi. 2020. Fact or fiction: Verifying scientific claims. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’20). 7534–7550.
  135. Kexin Wang, Nils Reimers, and Iryna Gurevych. 2021. TSDAE: Using transformer-based sequential denoising auto-encoder for unsupervised sentence embedding learning. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’21).
  136. Xiao Wang, Craig Macdonald, Nicola Tonellotto, and Iadh Ounis. 2021. Pseudo-relevance feedback for multiple representation dense retrieval. In Proceedings of the ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR’21). 297–306.
  137. Yumeng Wang, Lijun Lyu, and Avishek Anand. 2022. BERT rankers are brittle: A study using adversarial document perturbations. In Proceedings of the ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR’22). 115–120.
  138. Zhiguo Wang, Patrick Ng, Xiaofei Ma, Ramesh Nallapati, and Bing Xiang. 2019. Multi-passage BERT: A globally normalized bert model for open-domain question answering. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP’19). 5878–5882.
  139. Ledell Wu, Fabio Petroni, Martin Josifoski, Sebastian Riedel, and Luke Zettlemoyer. 2020. Scalable zero-shot entity linking with dense entity retrieval. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’20). 6397–6407.
  140. Xing Wu Guangyuan Ma Meng Lin Zijia Lin Zhongyuan Wang and Songlin Hu. 2022. ConTextual mask auto-encoder for dense passage retrieval. Retrieved from https://arXiv:2208.07670
  141. Chenyan Xiong, Zhuyun Dai, Jamie Callan, Zhiyuan Liu, and Russell Power. 2017. End-to-end neural ad hoc ranking with kernel pooling. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. 55–64.
  142. Lee Xiong, Chenyan Xiong, Ye Li, Kwok-Fung Tang, Jialin Liu, Paul N. Bennett, Junaid Ahmed, and Arnold Overwijk. 2021. Approximate nearest-neighbor negative contrastive learning for dense text retrieval. In Proceedings of the 9th International Conference on Learning Representations (ICLR’21).
  143. Canwen Xu Daya Guo Nan Duan and Julian McAuley. 2022. LaPraDoR: Unsupervised pretrained dense retriever for zero-shot text retrieval. Retrieved from https://arXiv:2203.06169
  144. Shicheng Xu Liang Pang Huawei Shen Xueqi Cheng and Tat-seng Chua. 2023. Search-in-the-chain: Towards the accurate credible and traceable content generation for complex knowledge-intensive tasks. Retrieved from https://arXiv:2304.14732
  145. Ikuya Yamada, Akari Asai, and Hannaneh Hajishirzi. 2021. Efficient passage retrieval with hashing for open-domain question answering. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. 979–986.
  146. Ming Yan Chenliang Li Chen Wu Bin Bi Wei Wang Jiangnan Xia and Luo Si. 2019. IDST at TREC 2019 deep learning track: deep cascade ranking with generation-based document expansion and pre-trained language modeling. In Proceedings of the 28th Text Retrieval Conference (TREC’19)(NIST Special Publication Vol. 1250). · DOI
  147. Yuanmeng Yan, Rumei Li, Sirui Wang, Fuzheng Zhang, Wei Wu, and Weiran Xu. 2021. ConSERT: A contrastive framework for self-supervised sentence representation transfer. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. 5065–5075.
  148. Peilin Yang, Hui Fang, and Jimmy Lin. 2017. Anserini: Enabling the use of lucene for information retrieval research. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1253–1256.
  149. Yinfei Yang, Ning Jin, Kuo Lin, Mandy Guo, and Daniel Cer. 2021. Neural retrieval for question answering with cross-attention supervised data augmentation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. 263–268.
  150. Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William Cohen, Ruslan Salakhutdinov, and Christopher D. Manning. 2018. HotpotQA: A dataset for diverse, explainable multi-hop question answering. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 2369–2380.
  151. HongChien Yu, Chenyan Xiong, and Jamie Callan. 2021. Improving query representations for dense retrieval with pseudo relevance feedback. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management. 3592–3596.
  152. Shi Yu, Zhenghao Liu, Chenyan Xiong, Tao Feng, and Zhiyuan Liu. 2021. Few-shot conversational dense retrieval. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’21). 829–838.
  153. Hansi Zeng, Hamed Zamani, and Vishwa Vinay. 2022. Curriculum learning for dense retrieval distillation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’22). 1979–1983.
  154. Jingtao Zhan Jiaxin Mao Yiqun Liu Jiafeng Guo Min Zhang and Shaoping Ma. 2021. Interpreting dense retrieval as mixture of topics. Retrieved from https://arXiv:2111.13957
  155. Jingtao Zhan, Jiaxin Mao, Yiqun Liu, Jiafeng Guo, Min Zhang, and Shaoping Ma. 2021. Jointly optimizing query encoder and product quantization to improve retrieval performance. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management. 2487–2496.
  156. Hang Zhang Yeyun Gong Yelong Shen Jiancheng Lv Nan Duan and Weizhu Chen. 2021. Adversarial retriever-ranker for dense text retrieval. Retrieved from https://arXiv:2110.03611
  157. Michael J. Q. Zhang and Eunsol Choi. 2021. SituatedQA: Incorporating extra-linguistic contexts into QA. Retrieved from https://arXiv:2109.06157
  158. Shunyu Zhang, Yaobo Liang, Ming Gong, Daxin Jiang, and Nan Duan. 2022. Multi-view document representation learning for open-domain dense retrieval. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics. 5990–6000.
  159. Wayne Xin Zhao Kun Zhou Junyi Li Tianyi Tang Xiaolei Wang Yupeng Hou Yingqian Min Beichen Zhang Junjie Zhang Zican Dong et al. 2023. A survey of large language models. Retrieved from https://arXiv:2303.18223
  160. Chunting Zhou, Jiatao Gu, and Graham Neubig. 2020. Understanding knowledge distillation in non-autoregressive machine translation. In Proceedings of the 8th International Conference on Learning Representations (ICLR’20).
  161. Jiawei Zhou, Xiaoguang Li, Lifeng Shang, Lan Luo, Ke Zhan, Enrui Hu, Xinyu Zhang, Hao Jiang, Zhao Cao, Fan Yu et al. 2022. Hyperlink-induced pre-training for passage retrieval in open-domain question answering. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics. 7135–7146.
  162. Kun Zhou, Beichen Zhang, Xin Zhao, and Ji-Rong Wen. 2022. Debiased contrastive learning of unsupervised sentence representations. In Proceedings of the Association for Computational Linguistics (ACL’22). 6120–6130.
  163. Mu Zhu. 2004. Recall, precision and average precision. Dept. Stat. Actuar. Sci. (University of Waterloo, Waterloo) 2, 30 (2004), 6.
  164. Yutao Zhu Huaying Yuan Shuting Wang Jiongnan Liu Wenhan Liu Chenlong Deng Zhicheng Dou and Ji-Rong Wen. 2023. Large language models for information retrieval: A survey. Retrieved from https://arXiv:2308.07107
  165. Shengyao Zhuang and Guido Zuccon. 2022. CharacterBERT and self-teaching for improving the robustness of dense retrievers on queries with typos. In Proceedings of the 45rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1444–1454.

Cited by

Sorted by citations

See all 214

Related

See all

Metadata

Authors
Zhao, W. X., Liu, J., Ren, R., & Wen, J.-R.
Affiliations
  • Renmin University of China (CN)
  • Baidu (China) (CN)
ORCID
Venue
ACM Transactions on Information Systems
Publisher
Association for Computing Machinery (ACM)
Published
2024-02-09
Volume
42
Issue
4
Pages
1-60
ISSN
  • 1046-8188 (ISSN-L)
  • 1558-2868
DOI
10.1145/3637870
OpenAlex
W4389921502
Cited by
211
References
156
Citations by year
2026: 72 · 2025: 79 · 2024: 40
FWCI
49.52
Type
journal article
Language
en
Open access
Licence
www.acm.org/publications/policies/copyright_policy#Background (vor)
Locations
  • ACM Transactions on Information Systems (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Natural Science Foundation of China (62222215, and U2001212)
  • Beijing Natural Science Foundation (4222027)
Topics
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
Keywords
pre-trained language models, semantic matching, relevance modeling, text representation learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review