Generative Retrieval for Book Search
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
In book search, relevant book information should be returned in response to a query. Books contain complex, multi-faceted information such as metadata, outlines, and main text, where the outline provides hierarchical information between chapters and sections. Generative retrieval (GR) is a new retrieval paradigm that consolidates corpus information into a single model to generate identifiers of documents that are relevant to a given query. How can GR be applied to book search? Directly applying GR to book search is a challenge due to the unique characteristics of book search: The model needs to retain the complex, multi-faceted information of the book, which increases the demand for labeled data. Splitting book information and treating it as a collection of separate segments for learning might result in a loss of hierarchical information.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., & Hovy, E. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1174 · Cited by 4,712
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
Dense passage retrieval for open-domain question answering
Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W.-T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.550 · Cited by 3,575
Transformer Memory as a Differentiable Search Index
Tay, Y., Tran, V., Dehghani, M., Ni, J., Bahri, D., Mehta, H., Qin, Z., Hui, K., Zhao, Z., Gupta, J., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1587 · Cited by 128
Rethinking search: making domain experts out of dilettantes
Metzler, D., Tay, Y., Bahri, D., & Najork, M. (2021) · ACM SIGIR Forum · doi:10.1145/3476415.3476428 · Cited by 112
Transformer Memory as a Differentiable Search IndexPreprint
Tay, Y., Tran, V. Q., Dehghani, M., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.06991 · Cited by 80
A Neural Corpus Indexer for Document Retrieval
Wang, Y., Hou, Y., Wang, H., Miao, Z., Wu, S., Chen, Q., Xia, Y., Chi, C., Zhao, G., Liu, Z., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1856 · Cited by 69
CorpusBrain: Pre-train a Generative Retrieval Model for Knowledge-Intensive Language Tasks
Chen, J., Zhang, R., Guo, J., Liu, Y., Fan, Y., & Cheng, X. (2022) · Proceedings of the 31st ACM International Conference on Information & Knowledge Management · doi:10.1145/3511808.3557271 · Cited by 57
Self-citationA Neural Corpus Indexer for Document RetrievalPreprint
Wang, Y., Hou, Y., Wang, H., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.02743 · Cited by 47
Research works printed but not linked: 33
- Federico Barrios, Federico López, Luis Argerich, and Rosa Wachenchauzer. 2016. Variations of the Similarity Function of TextRank for Automated Summarization. CoRR abs/1602.03606 (2016). arXiv:1602.03606 http://arxiv.org/abs/1602.03606 · arXiv
- Michele Bevilacqua Giuseppe Ottaviano Patrick Lewis Wen-tau Yih Sebastian Riedel and Fabio Petroni. 2022. Autoregressive Search Engines: Generating Substrings as Document Identifiers. In Advances in Neural Information Processing Systems. 31668--31683.
- Avi Bleiweiss. 2017. A Hierarchical Book Representation ofWord Embeddings for Effective Semantic Clustering and Search. In International Conference on Agents and Artificial Intelligence, Vol. 2. SCITEPRESS, 154--163.
- Shubham Chatterjee and Laura Dietz. 2021. Entity Retrieval Using Fine-grained Entity Aspects. In proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval. 1662--1666.
- Djork-Arné Clevert, Thomas Unterthiner, and Sepp Hochreiter. 2015. Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs). arXiv preprint arXiv:1511.07289 (2015). · arXiv
- Arman Cohan, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Seokhwan Kim, Walter Chang, and Nazli Goharian. 2018. A Discourse-aware Attention Model for Abstractive Summarization of Long Documents. arXiv preprint arXiv:1804.05685 (2018). · arXiv
- Nicola De Cao, Gautier Izacard, Sebastian Riedel, and Fabio Petroni. 2021. Autoregressive Entity Retrieval. In International Conference on Learning Representations.
- Zican Dong, Tianyi Tang, Lunyi Li, and Wayne Xin Zhao. 2023. A Survey on Long Text Modeling with Transformers. arXiv preprint arXiv:2302.14502 (2023). · arXiv
- Zhenyu He, Guhao Feng, Shengjie Luo, Kai Yang, Di He, Jingjing Xu, Zhi Zhang, Hongxia Yang, and LiweiWang. 2024. Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation. arXiv preprint arXiv:2401.16421 (2024). · arXiv
- Angelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas, and François Fleuret. 2020. Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention. In International Conference on Machine Learning. PMLR, 5156--5165.
- Shah Khusro, Irfan Ullah, Azhar Rauf, and Saeed Mahfooz. 2014. Issues and Challenges in Book Information Retrieval. International Information Institute (Tokyo). Information 17, 6 (2014), 2055.
- Yongqi Li, Nan Yang, LiangWang, FuruWei, and Wenjie Li. 2023. Multiview Identifiers Enhanced Generative Retrieval. In 61st Annual Meeting of the Association for Computational Linguistics. 6636--6648.
- Kevin Lin, Kyle Lo, Joseph E Gonzalez, and Dan Klein. 2023. Decomposing Complex Queries for Tip-of-the-tongue Retrieval. arXiv preprint arXiv:2305.15053 (2023). · arXiv
- Tsendsuren Munkhdalai, Manaal Faruqui, and Siddharth Gopal. 2024. Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention. arXiv preprint arXiv:2404.07143 (2024). · arXiv
- Tsendsuren Munkhdalai, Alessandro Sordoni, Tong Wang, and Adam Trischler. 2019. Metalearned Neural Memory. Advances in Neural Information Processing Systems 32 (2019).
- Rodrigo Nogueira and Jimmy Lin. 2019. From doc2query to docTTTTTquery. An MS MARCO Passage Retrieval Task Publication. University of Waterloo.
- 10.5555/3455716.3455856 · doi:10.5555/3455716.3455856
- Stephen E. Robertson Steve Walker Susan Jones Micheline M. Hancock-Beaulieu and Mike Gatford. 1995. Okapi at TREC-3. In TREC. 109--126. · doi:10.6028/nist.sp.500-225.city
- Imanol Schlag, Tsendsuren Munkhdalai, and Jürgen Schmidhuber. 2020. Learning Associative Inference using FastWeight Memory. arXiv preprint arXiv:2011.07831 (2020). · arXiv
- Peter Shaw, Jakob Uszkoreit, and Ashish Vaswani. 2018. Self-attention with Relative Position Representations. arXiv preprint arXiv:1803.02155 (2018). · arXiv
- Zhuoran Shen, Mingyuan Zhang, Haiyu Zhao, Shuai Yi, and Hongsheng Li. 2021. Efficient Attention: Attention with Linear Complexities. In Proceedings of the IEEE/CVF winter conference on applications of computer vision. 3531--3539.
- Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. 2024. Roformer: Enhanced Transformer with Rotary Position Embedding. Neurocomputing 568 (2024), 127063.
- Weiwei Sun, Lingyong Yan, Zheng Chen, Shuaiqiang Wang, Haichao Zhu, Pengjie Ren, Zhumin Chen, Dawei Yin, Maarten de Rijke, and Zhaochun Ren. 2023. Learning to Tokenize for Generative Retrieval. In Advances in Neural Information Processing Systems, Vol. 36.
- Yubao Tang, Ruqing Zhang, Jiafeng Guo, and Maarten de Rijke. 2023. Recent Advances in Generative Information Retrieval. In SIGIR-AP 2023: 1st International ACM SIGIR Conference on Information Retrieval in the Asia Pacific. ACM, 294--297.
- Haihua Xie, Zhiyou Chen, Yabo Li, Shaoling Jing, Xiaoqing Lyu, and Zhi Tang. 2020. Sembrs: A Semantic Analysis Based Book Retrieval Approach. In 2020 IEEE conference on multimedia information processing and retrieval (MIPR). IEEE, 101--104.
- Caiming Xiong, Victor Zhong, and Richard Socher. 2017. DCN: Mixed Objective And Deep Residual Coattention for Question Answering. In International Conference on Learning Representations.
- Tianchi Yang, Minghui Song, Zihan Zhang, Haizhen Huang, Weiwei Deng, Feng Sun, and Qi Zhang. 2023. Auto Search Indexer for End-to-End Document Retrieval. In Findings of the Association for Computational Linguistics: EMNLP 2023.
- Hansi Zeng, Chen Luo, Bowen Jin, Sheikh Muhammad Sarwar, Tianxin Wei, and Hamed Zamani. 2024. Scalable and Effective Generative Information Retrieval. In The 2024 ACM Web Conference.
- Jingtao Zhan, Jiaxin Mao, Yiqun Liu, Min Zhang, and Shaoping Ma. 2020. Rep-BERT: Contextualized Text Embeddings for First-stage Retrieval. arXiv preprint arXiv:2006.15498 (2020). · arXiv
- Zhuosheng Zhang, Hanqing Zhang, Keming Chen, Yuhang Guo, Jingyun Hua, Yulong Wang, and Ming Zhou. 2021. Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinese. arXiv:2110.06696 [cs.CL] · arXiv
- Yujia Zhou, Jing Yao, Zhicheng Dou, Ledell Wu, Peitian Zhang, and Ji-Rong Wen. 2022. Ultron: An Ultimate Retriever on Corpus with a Model-based Indexer. arXiv preprint arXiv:2208.09257 (2022). · arXiv
- Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, and Sujian Li. 2023. Pose: Efficient Context Window Extension of LLMs via Positional Skip-wise Training. arXiv preprint arXiv:2309.10400 (2023). · arXiv
- Shengyao Zhuang Houxing Ren Linjun Shou Jian Pei Ming Gong Guido Zuccon and Daxin Jiang. 2023. Bridging the Gap between Indexing and Retrieval for Differentiable Search Index with Query Generation. In Gen-IR@SIGIR 2023: The First Workshop on Generative Information Retrieval.
Cited by
Lightweight and Direct Document Relevance Optimization for Generative Information Retrieval
Mekonnen, K. A., Tang, Y., & de Rijke, M. (2025) · Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3726302.3730023 · Cited by 3
Self-citationLi, K., Yu, H., Fang, Y., & Lei, C. (2025) · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) · doi:10.1145/3767695.3769474 · Cited by 7
Multi-Step Semantic Reasoning in Generative Retrieval
Dong, S., Tang, Y., & de Rijke, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21300-6_17 · Cited by 4
Self-citationOne-Pass Decoding for Generative Recommendation with WFST-Constrained A* Search
Wang, P., Zhang, Y., Zhang, R., Guo, J., & Cheng, X. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809884 · Cited by 4
Self-citationGenerative Legal Document Retrieval in Multi-Law-Code Scenarios
Qin, W., Li, M., Yu, W., Xu, Y., Chen, L., Xu, J., & Wen, J.-R. (2026) · ACM Transactions on Information Systems · doi:10.1145/3856807
Metadata
- Authors
- Tang, Y., Zhang, R., Guo, J., de Rijke, M., Liu, S., Wang, S., Yin, D., & Cheng, X.
- Affiliations
- Chinese Academy of Sciences (CN)
- Institute of Computing Technology (CN)
- University of Amsterdam, Amsterdam, Netherlands
- Baidu (China) (CN)
- ORCID
- Venue
- Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1
- Publisher
- ACM
- Published
- 2025-07-20
- Pages
- 2606-2617
- OpenAlex
- W4409150075
- Cited by
- 5
- References
- 17
- Citations by year
- 2026: 3 · 2025: 2
- FWCI
- 6.00
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- Dutch Research Council (KICH3.LTP.20.006)
- European Union's Horizon Europe research and innovation program (No 101070212)
- Project Management (No. JCKY2022130C039)
- Dutch Research Council (NWO), DPG Media, RTL, and the Dutch Ministry of Economic Affairs and Climate Policy (LTP KIC 2020-2023)
- National Natural Science Foundation of China (No. 62472408)
- LESSEN (NWA.1389.20.183)
- Strategic Priority Research Program of the CAS (No. XDB0680102)
- Lenovo-CAS Joint Lab Youth Scientist Project (Null)
- National Key Research and Development Program of China (No. 2023YFA1011602)
- Dutch Ministry of Education (nr.\ 024.004.022)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- generative retrieval, book searching, hierarchical information, book metadata, document identifiers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.