Recent Advances in Generative Information Retrieval
Open accessThe DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Generative retrieval (GR) has become a highly active area of information retrieval (IR) that has witnessed significant growth recently. Compared to the traditional “index-retrieve-then-rank” pipeline, the GR paradigm aims to consolidate all information within a corpus into a single model. Typically, a sequence-to-sequence model is trained to directly map a query to its relevant document identifiers (i.e., docids). This tutorial offers an introduction to the core concepts of the GR paradigm and a comprehensive overview of recent advances in its foundations and applications. We start by providing preliminary information covering foundational aspects and problem formulations of GR. Then, our focus shifts towards recent progress in docid design, training approaches, inference strategies, and the applications of GR. We end by outlining remaining challenges and issuing a call for future GR research. This tutorial is intended to be beneficial to both researchers and industry practitioners interested in developing novel GR solutions or applying them in real-world scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069
Learning deep structured semantic models for web search using clickthrough data
Huang, P.-S., He, X., Gao, J., Deng, L., Acero, A., & Heck, L. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2505665 · Cited by 2,009
Recommender Systems with Generative RetrievalPreprint
Rajput, S., Mehta, N., Singh, A., Keshavan, R. H., Vu, T., Heldt, L., Hong, L.-C., Tay, Y., Tran, V. Q., Samost, J., et al. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2305.05065 · Cited by 533
Short Text Similarity with Word Embeddings
Kenter, T., & de Rijke, M. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806475 · Cited by 440
A Deep Look into neural ranking models for information retrieval
Guo, J., Fan, Y., Pang, L., Yang, L., Ai, Q., Zamani, H., Wu, C., Croft, W. B., & Cheng, X. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.102067 · Cited by 349
Self-citationWeb question answering: is more always better?
Dumais, S., Banko, M., Brill, E., Lin, J., & Ng, A. (2002) · Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/564376.564428 · Cited by 289
A Dual Embedding Space Model for Document RankingPreprint
Mitra, B., Nalisnick, E., Craswell, N., & Caruana, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.01137 · Cited by 155
High accuracy retrieval with multiple nested ranker
Matveeva, I., Burges, C., Burkard, T., Laucius, A., & Wong, L. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148246 · Cited by 128
Transformer Memory as a Differentiable Search Index
Tay, Y., Tran, V., Dehghani, M., Ni, J., Bahri, D., Mehta, H., Qin, Z., Hui, K., Zhao, Z., Gupta, J., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1587 · Cited by 128
Shah, C., & Bender, E. M. (2022) · ACM SIGIR Conference on Human Information Interaction and Retrieval · doi:10.1145/3498366.3505816 · Cited by 115
Research works printed but not linked: 15
- Michele Bevilacqua Giuseppe Ottaviano Patrick Lewis Wen-tau Yih Sebastian Riedel and Fabio Petroni. 2022. Autoregressive Search Engines: Generating Substrings as Document Identifiers. In NeurIPS. 31668–31683.
- Jiangui Chen, Ruqing Zhang, Jiafeng Guo, Yixing Fan, and Xueqi Cheng. 2022. GERE: Generative Evidence Retrieval for Fact Verification. In SIGIR. 2184–2189.
- Nicola De Cao Gautier Izacard Sebastian Riedel and Fabio Petroni. 2021. Autoregressive Entity Retrieval. In ICLR.
- Jianfeng Gao Xiaodong He and Jian-Yun Nie. 2010. Clickthrough-based Translation Models for Web Search: From Word Models to Phrase Models. In CIKM.
- Kelvin Guu Kenton Lee Zora Tung Panupong Pasupat and Mingwei Chang. 2020. Retrieval Augmented Language Model Pre-training. In ICML. 3929–3938.
- Hyunji Lee, Jaeyoung Kim, Hoyeon Chang, Hanseok Oh, Sohee Yang, Vladimir Karpukhin, Yi Lu, and Minjoon Seo. 2023. Nonparametric Decoding for Generative Retrieval. In Findings of the ACL 2023. 12642–12661.
- Yongqi Li Nan Yang Liang Wang Furu Wei and Wenjie Li. 2023. Multiview Identifiers Enhanced Generative Retrieval. In ACL. 6636–6648.
- Yu-An Liu Ruqing Zhang Jiafeng Guo Wei Chen and Xueqi Cheng. 2023. On the Robustness of Generative Retrieval Models: An Out-of-Distribution Perspective. In Gen-IR@SIGIR.
- Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, and Li Deng. 2016. MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. In Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches.
- Thong Nguyen and Andrew Yates. 2023. Generative Retrieval as Dense Retrieval. In Gen-IR@SIGIR.
- Daniel E. Rose and Danny Levinson. 2004. Understanding User Goals in Web Search. In WWW.
- James Thorne. 2022. Data-efficient Autoregressive Document Retrieval for Fact Verification. In Workshop on SENLP.
- Zihan Wang, Yujia Zhou, Yiteng Tu, and Zhicheng Dou. 2023. NOVO: Learnable and Interpretable Document Identifiers for Model-Based IR. In CIKM.
- Caiming Xiong Victor Zhong and Richard Socher. 2017. DCN+: Mixed Objective And Deep Residual Coattention for Question Answering. In ICLR.
- Shengyao Zhuang Houxing Ren Linjun Shou Jian Pei Ming Gong Guido Zuccon and Daxin Jiang. 2023. Bridging the Gap between Indexing and Retrieval for Differentiable Search Index with Query Generation. In Gen-IR@SIGIR.
Cited by
OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference AlignmentPreprint
Deng, J., Wang, S., Cai, K., Ren, L., Hu, Q., Ding, W., Luo, Q., & Zhou, G. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.18965 · Cited by 467
From Matching to Generation: A Survey on Generative Information Retrieval
Li, X., Jin, J., Zhou, Y., Zhang, Y., Zhang, P., Zhu, Y., & Dou, Z. (2025) · ACM Transactions on Information Systems · doi:10.1145/3722552 · Cited by 172
EGA-V2: An End-to-end Generative Framework for Industrial AdvertisingPreprint
Zheng, Z., Wang, Z., Yang, F., Fan, J., Zhang, T. L., Wang, Y., & Wang, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.17549 · Cited by 40
Luo, Y., Liu, T., Pang, P. C.-I., McKay, D., Chen, Z., Buchanan, G. R., & Chang, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.19434 · Cited by 23
Generative Retrieval Meets Multi-Graded Relevance
Tang, Y., Zhang, R., Guo, J., de Rijke, M., Chen, W., & Cheng, X. (2024) · neural information processing systems · doi:10.52202/079017-2317 · Cited by 22
Self-citation
Metadata
- Authors
- Tang, Y., Zhang, R., Guo, J., & de Rijke, M.
- Affiliations
- Institute of Computing Technology (CN)
- Chinese Academy of Sciences (CN)
- University of Amsterdam, The Netherlands
- Venue
- Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region
- Publisher
- ACM
- Published
- 2023-11-26
- Pages
- 294-297
- OpenAlex
- W4388955883
- Cited by
- 22
- References
- 19
- Citations by year
- 2026: 13 · 2025: 6 · 2024: 3
- FWCI
- 5.66
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) (publishedVersion, cc-by)
- Funders
- Lenovo-CAS Joint Lab Youth Scientist Project
- Hybrid Intelligence Center, a 10-year program funded by the Dutch Ministry of Education, Culture and Science through the Netherlands Organisation for Scientific Research
- NONE (No. JCKY2022130C039)
- the National Natural Science Foundation of China (NSFC) (No. 62006218)
- project LESSEN (NWA.1389.20.183 of the research program NWA ORC 2020/21)
- the China Scholarship Council (No. 202104910234)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- generative retrieval, document retrieval, sequence-to-sequence models, information retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Recent Advances in Generative Information Retrieval. https://app.cochat.ai/papers/10.1145/3624918.3629547
- The paper
- Tang, Y., Zhang, R., Guo, J., & de Rijke, M. (2023). Recent Advances in Generative Information Retrieval. Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region. https://doi.org/10.1145/3624918.3629547
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.