Recent Advances in Generative Information Retrieval
Open accessThe DOI matches its Crossref record; 19 of the 20 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Generative retrieval (GR) has witnessed significant growth recently in the area of information retrieval. Compared to the traditional "index-retrieve-then-rank'' pipeline, the GR paradigm aims to consolidate all information within a corpus into a single model. Typically, a sequence-to-sequence model is trained to directly map a query to its relevant document identifiers (i.e., docids). This tutorial offers an introduction to the core concepts of the GR paradigm and a comprehensive overview of recent advances in its foundations and applications. We start by providing preliminary information covering foundational aspects and problem formulations of GR. Then, our focus shifts towards recent progress in docid design, training approaches, inference strategies, and applications of GR. We end by outlining challenges and issuing a call for future GR research. Throughout the tutorial we highlight the availability of relevant resources so as to enable a broad audience to contribute to this topic. This tutorial is intended to be beneficial to both researchers and industry practitioners interested in developing novel GR solutions or applying them in real-world scenarios.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Short Text Similarity with Word Embeddings
Kenter, T., & de Rijke, M. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806475 · Cited by 440
Transformer Memory as a Differentiable Search Index
Tay, Y., Tran, V., Dehghani, M., Ni, J., Bahri, D., Mehta, H., Qin, Z., Hui, K., Zhao, Z., Gupta, J., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1587 · Cited by 128
Rethinking search: making domain experts out of dilettantes
Metzler, D., Tay, Y., Bahri, D., & Najork, M. (2021) · ACM SIGIR Forum · doi:10.1145/3476415.3476428 · Cited by 112
Cascade Ranking for Operational E-commerce Search
Liu, S., Xiao, F., Ou, W., & Si, L. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098011 · Cited by 109
Transformer Memory as a Differentiable Search IndexPreprint
Tay, Y., Tran, V. Q., Dehghani, M., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.06991 · Cited by 80
A Neural Corpus Indexer for Document Retrieval
Wang, Y., Hou, Y., Wang, H., Miao, Z., Wu, S., Chen, Q., Xia, Y., Chi, C., Zhao, G., Liu, Z., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1856 · Cited by 69
CorpusBrain: Pre-train a Generative Retrieval Model for Knowledge-Intensive Language Tasks
Chen, J., Zhang, R., Guo, J., Liu, Y., Fan, Y., & Cheng, X. (2022) · Proceedings of the 31st ACM International Conference on Information & Knowledge Management · doi:10.1145/3511808.3557271 · Cited by 57
Self-citationDynamicRetriever: A Pre-trained Model-based IR System Without an Explicit Index
Zhou, Y., Yao, J., Dou, Z., Wu, L., & Wen, J.-R. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1373-9 · Cited by 52
A Neural Corpus Indexer for Document RetrievalPreprint
Wang, Y., Hou, Y., Wang, H., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.02743 · Cited by 47
Continual Learning for Generative Retrieval over Dynamic Corpora
Chen, J., Zhang, R., Guo, J., de Rijke, M., Chen, W., Fan, Y., & Cheng, X. (2023) · Proceedings of the 32nd ACM International Conference on Information and Knowledge Management · doi:10.1145/3583780.3614821 · Cited by 40
Self-citation
Research works printed but not linked: 17
- Gabriel Bénédict, Ruqing Zhang, Donald Metzler, Andrew Yates, Romain Deffayet, Philipp Hager, and Sami Jullien. 2024. Report on the 1st Workshop on Generative Information Retrieval (Gen-IR 2023) at SIGIR 2023. SIGIR Forum, Vol. 57, 2, Article 13 (jan 2024), bibinfonumpages23 pages.
- Michele Bevilacqua Giuseppe Ottaviano Patrick Lewis Wen-tau Yih Sebastian Riedel and Fabio Petroni. 2022. Autoregressive Search Engines: Generating Substrings as Document Identifiers. In NeurIPS. 31668--31683.
- Jiangui Chen, Ruqing Zhang, Jiafeng Guo, Yixing Fan, and Xueqi Cheng. 2022a. GERE: Generative evidence retrieval for fact verification. In SIGIR. 2184--2189.
- Nick Craswell, W. Bruce Croft, Jiafeng Guo, Bhaskar Mitra, and Maarten de Rijke. 2016. Neu-IR: The SIGIR 2016 Workshop on Neural Information Retrieval. In SIGIR 2016: 39th international ACM SIGIR conference on Research and development in information retrieval. ACM, 1245--1246.
- Nicola De Cao, Gautier Izacard, Sebastian Riedel, and Fabio Petroni. 2021. Autoregressive Entity Retrieval. In Int. Conf. on Learning Representations.
- Romain Deffayet, Thibaut Thonet, Jean-Michel Renders, and Maarten de Rijke. 2023. Generative Slate Recommendation with Reinforcement Learning. In WSDM 2023: The Sixteenth International Conference on Web Search and Data Mining. ACM, 580--588.
- Hyunji Lee, Jaeyoung Kim, Hoyeon Chang, Hanseok Oh, Sohee Yang, Vladimir Karpukhin, Yi Lu, and Minjoon Seo. 2023. Nonparametric Decoding for Generative Retrieval. In Findings of the ACL 2023. 12642--12661.
- Yongqi Li Nan Yang Liang Wang Furu Wei and Wenjie Li. 2023 b. Multiview Identifiers Enhanced Generative Retrieval. In ACL. 6636--6648.
- Yu-An Liu Ruqing Zhang Jiafeng Guo Wei Chen and Xueqi Cheng. 2023. On the Robustness of Generative Retrieval Models: An Out-of-Distribution Perspective. In Gen-IR@SIGIR.
- Thong Nguyen and Andrew Yates. 2023. Generative Retrieval as Dense Retrieval. In Gen-IR@SIGIR.
- Ronak Pradeep, Kai Hui, Jai Gupta, Adam D. Lelkes, Honglei Zhuang, Jimmy Lin, Donald Metzler, and Vinh Q. Tran. 2023. How Does Generative Retrieval Scale to Millions of Passages?. In Gen-IR@SIGIR.
- Yubao Tang, Ruqing Zhang, Jiafeng Guo, Maarten de Rijke, Wei Chen, and Xueqi Cheng. 2024. Listwise Generative Retrieval Models via a Sequential Learning Process. ACM Transactions on Information Systems (2024). To appear.
- Zihan Wang, Yujia Zhou, Yiteng Tu, and Zhicheng Dou. 2023. NOVO: Learnable and Interpretable Document Identifiers for Model-Based IR. In CIKM. 2656--2665.
- Soyoung Yoon, Chaeeun Kim, Hyunji Lee, Joel Jang, and Minjoon Seo. 2023. Continually Updating Generative Retrieval on Dynamic Corpora. arXiv preprint arXiv:2305.18952 (2023). · arXiv
- Peitian Zhang, Zheng Liu, Yujia Zhou, Zhicheng Dou, and Zhao Cao. 2023. Term-Sets Can Be Strong Document Identifiers For Auto-Regressive Search Engines. arXiv preprint arXiv:2305.13859 (2023). · arXiv
- Yujia Zhou, Jing Yao, Zhicheng Dou, Ledell Wu, Peitian Zhang, and Ji-Rong Wen. 2022. Ultron: An Ultimate Retriever on Corpus with a Model-based Indexer. arXiv preprint arXiv:2208.09257 (2022). · arXiv
- Shengyao Zhuang Houxing Ren Linjun Shou Jian Pei Ming Gong Guido Zuccon and Daxin Jiang. 2023. Bridging the Gap between Indexing and Retrieval for Differentiable Search Index with Query Generation. In Gen-IR@SIGIR.
Cited by
Gómez, Á. Q. (2026) · Prisma social · doi:10.65598/rps.5975 · Cited by 8
Boosting Retrieval-Augmented Generation with Generation-Augmented Retrieval: A Co-Training Approach
Tang, Y., Zhang, R., Guo, J., de Rijke, M., Fan, Y., & Cheng, X. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3729907 · Cited by 7
Self-citationA Parametric Memory Head for Continual Generative Retrieval
Mekonnen, K. A., Tang, Y., & de Rijke, M. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809725 · Cited by 4
Self-citationReport on the 1st Workshop on Information Retrieval for Climate Impact (MANILA24) at SIGIR 2024
de Rijke, M., van den Hurk, B., Salim, F., Khourdajie, A. A., Bai, N., Calzone, R., Curran, D., Demil, G., Frew, L., Gießing, N., et al. (2025) · ACM SIGIR Forum · doi:10.1145/3769733.3769737 · Cited by 4
Lightweight and Direct Document Relevance Optimization for Generative Information Retrieval
Mekonnen, K. A., Tang, Y., & de Rijke, M. (2025) · Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3726302.3730023 · Cited by 3
Self-citationInformation Retrieval for Climate ImpactPreprint
de Rijke, M., Hurk, B. V. D., Salim, F., Khourdajie, A. A., Bai, N., Calzone, R., Curran, D., Demil, G., Frew, L., Gießing, N., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.01162 · Cited by 3
Lost in Decoding? Reproducing and Stress-Testing the Look-Ahead Prior in Generative Retrieval
Mekonnen, K. A., Li, Y., Tang, Y., Lupart, S., & de Rijke, M. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808567 · Cited by 2
Self-citationПрименение generative engine optimization в маркетинге коммерческой недвижимости
Арамовна, К. С. (2026) · The Applied Economic Researches Journal · doi:10.47576/2949-1908.2026.2.2.021
Neighborhood-Aware Unlearning for Generative RecommendationPreprint
Lubitzsch, P., Tang, Y., de Rijke, M., & Schelter, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.27232
Self-citation
Metadata
- Authors
- Tang, Y., Zhang, R., Ren, Z., Guo, J., & de Rijke, M.
- Affiliations
- Institute of Computing Technology (CN)
- Leiden University (NL)
- University of Amsterdam, Amsterdam, Netherlands
- Venue
- Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval
- Publisher
- ACM
- Published
- 2024-07-10
- Pages
- 3005-3008
- OpenAlex
- W4400529053
- Cited by
- 4
- References
- 16
- Citations by year
- 2026: 2 · 2025: 2
- FWCI
- 1.52
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) (publishedVersion, cc-by)
- Funders
- Lenovo-CAS Joint Lab Youth Scientist Project
- FINDHR project (No 101070212)
- Project (No. JCKY2022130C039)
- National Key Research and Development Program of China (No. 2023YFA1011602)
- the Strategic Priority Research Program of the CAS (No. XDB0680102)
- Project LESSEN (NWA.1389.20.183)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- generative retrieval, document retrieval, sequence-to-sequence models, information retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.