Recent Advances in Generative Information Retrieval
Open accessThe DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Generative retrieval (GR) has become a highly active area of information retrieval (IR) that has witnessed significant growth recently. Compared to the traditional “index-retrieve-then-rank” pipeline, the GR paradigm aims to consolidate all information within a corpus into a single model. Typically, a sequence-to-sequence model is trained to directly map a query to its relevant document identifiers (i.e., docids). This tutorial offers an introduction to the core concepts of the GR paradigm and a comprehensive overview of recent advances in its foundations and applications. We start by providing preliminary information covering foundational aspects and problem formulations of GR. Then, our focus shifts towards recent progress in docid design, training approaches, inference strategies, and the applications of GR. We end by outlining remaining challenges and issuing a call for future GR research. This tutorial is intended to be beneficial to both researchers and industry practitioners interested in developing novel GR solutions or applying them in real-world scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069
Learning deep structured semantic models for web search using clickthrough data
Huang, P.-S., He, X., Gao, J., Deng, L., Acero, A., & Heck, L. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2505665 · Cited by 2,009
Recommender Systems with Generative RetrievalPreprint
Rajput, S., Mehta, N., Singh, A., Keshavan, R. H., Vu, T., Heldt, L., Hong, L.-C., Tay, Y., Tran, V. Q., Samost, J., et al. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2305.05065 · Cited by 533
Short Text Similarity with Word Embeddings
Kenter, T., & de Rijke, M. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806475 · Cited by 440
A Deep Look into neural ranking models for information retrieval
Guo, J., Fan, Y., Pang, L., Yang, L., Ai, Q., Zamani, H., Wu, C., Croft, W. B., & Cheng, X. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.102067 · Cited by 349
Self-citationWeb question answering: is more always better?
Dumais, S., Banko, M., Brill, E., Lin, J., & Ng, A. (2002) · Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/564376.564428 · Cited by 289
A Dual Embedding Space Model for Document RankingPreprint
Mitra, B., Nalisnick, E., Craswell, N., & Caruana, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.01137 · Cited by 155
High accuracy retrieval with multiple nested ranker
Matveeva, I., Burges, C., Burkard, T., Laucius, A., & Wong, L. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148246 · Cited by 128
Transformer Memory as a Differentiable Search Index
Tay, Y., Tran, V., Dehghani, M., Ni, J., Bahri, D., Mehta, H., Qin, Z., Hui, K., Zhao, Z., Gupta, J., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1587 · Cited by 128
Shah, C., & Bender, E. M. (2022) · ACM SIGIR Conference on Human Information Interaction and Retrieval · doi:10.1145/3498366.3505816 · Cited by 115
Rethinking search: making domain experts out of dilettantes
Metzler, D., Tay, Y., Bahri, D., & Najork, M. (2021) · ACM SIGIR Forum · doi:10.1145/3476415.3476428 · Cited by 112
Cascade Ranking for Operational E-commerce Search
Liu, S., Xiao, F., Ou, W., & Si, L. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098011 · Cited by 109
Ultron: An Ultimate Retriever on Corpus with a Model-based IndexerPreprint
Zhou, Y., Yao, J., Dou, Z., Wu, L., Zhang, P., & Wen, J.-R. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.09257 · Cited by 102
Efficient Cost-Aware Cascade Ranking in Multi-Stage Retrieval
Chen, R.-C., Gallagher, L., Blanco, R., & Culpepper, J. S. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080819 · Cited by 93
A Neural Corpus Indexer for Document Retrieval
Wang, Y., Hou, Y., Wang, H., Miao, Z., Wu, S., Chen, Q., Xia, Y., Chi, C., Zhao, G., Liu, Z., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1856 · Cited by 69
Overview of the TREC 2019 deep learning track
Craswell, N., Mitra, B., Yilmaz, E., Campos, D., & Voorhees, E. M. (2020) · arXiv · doi:10.48550/arxiv.2003.07820 · Cited by 68
CorpusBrain: Pre-train a Generative Retrieval Model for Knowledge-Intensive Language Tasks
Chen, J., Zhang, R., Guo, J., Liu, Y., Fan, Y., & Cheng, X. (2022) · Proceedings of the 31st ACM International Conference on Information & Knowledge Management · doi:10.1145/3511808.3557271 · Cited by 57
Self-citationDynamicRetriever: A Pre-trained Model-based IR System Without an Explicit Index
Zhou, Y., Yao, J., Dou, Z., Wu, L., & Wen, J.-R. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1373-9 · Cited by 52
Using graded-relevance metrics for evaluating community QA answer selection
Sakai, T., Ishikawa, D., Kando, N., Seki, Y., Kuriyama, K., & Lin, C.-Y. (2011) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/1935826.1935864 · Cited by 51
Continual Learning for Generative Retrieval over Dynamic Corpora
Chen, J., Zhang, R., Guo, J., de Rijke, M., Chen, W., Fan, Y., & Cheng, X. (2023) · Proceedings of the 32nd ACM International Conference on Information and Knowledge Management · doi:10.1145/3583780.3614821 · Cited by 40
Self-citationLearning to Tokenize for Generative Retrieval
Sun, W., Yan, L., Chen, Z., Wang, S., Zhu, H., Ren, P., Chen, Z., Yin, D., de Rijke, M., & Ren, Z. (2023) · arXiv · doi:10.48550/arxiv.2304.04171 · Cited by 36
Self-citationA Unified Generative Retriever for Knowledge-Intensive Language Tasks via Prompt Learning
Chen, J., Zhang, R., Guo, J., de Rijke, M., Liu, Y., Fan, Y., & Cheng, X. (2023) · Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3539618.3591631 · Cited by 32
Self-citationSemantic-Enhanced Differentiable Search Index Inspired by Learning Strategies
Tang, Y., Zhang, R., Guo, J., Chen, J., Zhu, Z., Wang, S., Yin, D., & Cheng, X. (2023) · Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599903 · Cited by 29
Self-citationHow Does Generative Retrieval Scale to Millions of Passages?
Pradeep, R., Hui, K., Gupta, J., Lelkes, A., Zhuang, H., Lin, J., Metzler, D., & Tran, V. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.83 · Cited by 28
Learning to Rank in Generative Retrieval
Li, Y., Yang, N., Wang, L., Wei, F., & Li, W. (2023) · arXiv · doi:10.48550/arxiv.2306.15222 · Cited by 27
Learning to Rank in Generative Retrieval
Li, Y., Yang, N., Wang, L., Wei, F., & Li, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i8.28717 · Cited by 27
DSI++: Updating Transformer Memory with New Documents
Mehta, S., Gupta, J., Tay, Y., Dehghani, M., Tran, V., Rao, J., Najork, M., Strubell, E., & Metzler, D. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.510 · Cited by 21
Generative Multi-hop Retrieval
Lee, H., Yang, S., Oh, H., & Seo, M. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.92 · Cited by 15
CodeDSI: Differentiable Code SearchPreprint
Nadeem, U., Ziems, N., & Wu, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.00328 · Cited by 15
TOME: A Two-stage Approach for Model-based Retrieval
Ren, R., Zhao, W. X., Liu, J., Wu, H., Wen, J.-R., & Wang, H. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.336 · Cited by 14
Gen-IR@SIGIR 2023: The First Workshop on Generative Information Retrieval
Bénédict, G., Zhang, R., & Metzler, D. (2023) · Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3539618.3591923 · Cited by 13
Self-citationUnderstanding Differential Search Index for Text Retrieval
Chen, X., Liu, Y., He, B., Sun, L., & Sun, Y. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.681 · Cited by 13
Generative Retrieval via Term Set GenerationPreprint
Zhang, P., Liu, Z., Zhou, Y., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.13859 · Cited by 3
DSI++: Updating Transformer Memory with New DocumentsPreprint
Mehta, S. V., Gupta, J. P., Tay, Y., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.09744 · Cited by 3
Exploring the Practicality of Generative Retrieval on Dynamic CorporaPreprint
Kim, C.-E., Yoon, S.-Y., Lee, H., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.18952
Research works printed but not linked: 15
- Michele Bevilacqua Giuseppe Ottaviano Patrick Lewis Wen-tau Yih Sebastian Riedel and Fabio Petroni. 2022. Autoregressive Search Engines: Generating Substrings as Document Identifiers. In NeurIPS. 31668–31683.
- Jiangui Chen, Ruqing Zhang, Jiafeng Guo, Yixing Fan, and Xueqi Cheng. 2022. GERE: Generative Evidence Retrieval for Fact Verification. In SIGIR. 2184–2189.
- Nicola De Cao Gautier Izacard Sebastian Riedel and Fabio Petroni. 2021. Autoregressive Entity Retrieval. In ICLR.
- Jianfeng Gao Xiaodong He and Jian-Yun Nie. 2010. Clickthrough-based Translation Models for Web Search: From Word Models to Phrase Models. In CIKM.
- Kelvin Guu Kenton Lee Zora Tung Panupong Pasupat and Mingwei Chang. 2020. Retrieval Augmented Language Model Pre-training. In ICML. 3929–3938.
- Hyunji Lee, Jaeyoung Kim, Hoyeon Chang, Hanseok Oh, Sohee Yang, Vladimir Karpukhin, Yi Lu, and Minjoon Seo. 2023. Nonparametric Decoding for Generative Retrieval. In Findings of the ACL 2023. 12642–12661.
- Yongqi Li Nan Yang Liang Wang Furu Wei and Wenjie Li. 2023. Multiview Identifiers Enhanced Generative Retrieval. In ACL. 6636–6648.
- Yu-An Liu Ruqing Zhang Jiafeng Guo Wei Chen and Xueqi Cheng. 2023. On the Robustness of Generative Retrieval Models: An Out-of-Distribution Perspective. In Gen-IR@SIGIR.
- Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, and Li Deng. 2016. MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. In Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches.
- Thong Nguyen and Andrew Yates. 2023. Generative Retrieval as Dense Retrieval. In Gen-IR@SIGIR.
- Daniel E. Rose and Danny Levinson. 2004. Understanding User Goals in Web Search. In WWW.
- James Thorne. 2022. Data-efficient Autoregressive Document Retrieval for Fact Verification. In Workshop on SENLP.
- Zihan Wang, Yujia Zhou, Yiteng Tu, and Zhicheng Dou. 2023. NOVO: Learnable and Interpretable Document Identifiers for Model-Based IR. In CIKM.
- Caiming Xiong Victor Zhong and Richard Socher. 2017. DCN+: Mixed Objective And Deep Residual Coattention for Question Answering. In ICLR.
- Shengyao Zhuang Houxing Ren Linjun Shou Jian Pei Ming Gong Guido Zuccon and Daxin Jiang. 2023. Bridging the Gap between Indexing and Retrieval for Differentiable Search Index with Query Generation. In Gen-IR@SIGIR.
Cited by
OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference AlignmentPreprint
Deng, J., Wang, S., Cai, K., Ren, L., Hu, Q., Ding, W., Luo, Q., & Zhou, G. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.18965 · Cited by 467
From Matching to Generation: A Survey on Generative Information Retrieval
Li, X., Jin, J., Zhou, Y., Zhang, Y., Zhang, P., Zhu, Y., & Dou, Z. (2025) · ACM Transactions on Information Systems · doi:10.1145/3722552 · Cited by 172
EGA-V2: An End-to-end Generative Framework for Industrial AdvertisingPreprint
Zheng, Z., Wang, Z., Yang, F., Fan, J., Zhang, T. L., Wang, Y., & Wang, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.17549 · Cited by 40
Luo, Y., Liu, T., Pang, P. C.-I., McKay, D., Chen, Z., Buchanan, G. R., & Chang, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.19434 · Cited by 23
Generative Retrieval Meets Multi-Graded Relevance
Tang, Y., Zhang, R., Guo, J., de Rijke, M., Chen, W., & Cheng, X. (2024) · neural information processing systems · doi:10.52202/079017-2317 · Cited by 22
Self-citation
Metadata
- Authors
- Tang, Y., Zhang, R., Guo, J., & de Rijke, M.
- Affiliations
- Institute of Computing Technology (CN)
- Chinese Academy of Sciences (CN)
- University of Amsterdam, The Netherlands
- Venue
- Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region
- Publisher
- ACM
- Published
- 2023-11-26
- Pages
- 294-297
- OpenAlex
- W4388955883
- Cited by
- 22
- References
- 19
- Citations by year
- 2026: 13 · 2025: 6 · 2024: 3
- FWCI
- 5.66
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) (publishedVersion, cc-by)
- Funders
- Lenovo-CAS Joint Lab Youth Scientist Project
- Hybrid Intelligence Center, a 10-year program funded by the Dutch Ministry of Education, Culture and Science through the Netherlands Organisation for Scientific Research
- NONE (No. JCKY2022130C039)
- the National Natural Science Foundation of China (NSFC) (No. 62006218)
- project LESSEN (NWA.1389.20.183 of the research program NWA ORC 2020/21)
- the China Scholarship Council (No. 202104910234)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- generative retrieval, document retrieval, sequence-to-sequence models, information retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.