CoChat

Generative Retrieval for Book Search

Open access
Tang, Yubao, Zhang, Ruqing, Guo, Jiafeng, de Rijke, Maarten, Liu, Shihao, Wang, Shuaiqiang, Yin, Dawei, Cheng, Xueqi · 2025 · Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1

The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.

Abstract

In book search, relevant book information should be returned in response to a query. Books contain complex, multi-faceted information such as metadata, outlines, and main text, where the outline provides hierarchical information between chapters and sections. Generative retrieval (GR) is a new retrieval paradigm that consolidates corpus information into a single model to generate identifiers of documents that are relevant to a given query. How can GR be applied to book search? Directly applying GR to book search is a challenge due to the unique characteristics of book search: The model needs to retain the complex, multi-faceted information of the book, which increases the demand for labeled data. Splitting book information and treating it as a collection of separate segments for learning might result in a loss of hierarchical information.

Overview

Integrity signals

Registry

Crossref · 10.1145/3690624.3709435

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 20 references

Research works printed but not linked: 33

  1. Federico Barrios, Federico López, Luis Argerich, and Rosa Wachenchauzer. 2016. Variations of the Similarity Function of TextRank for Automated Summarization. CoRR abs/1602.03606 (2016). arXiv:1602.03606 http://arxiv.org/abs/1602.03606 · arXiv
  2. Michele Bevilacqua Giuseppe Ottaviano Patrick Lewis Wen-tau Yih Sebastian Riedel and Fabio Petroni. 2022. Autoregressive Search Engines: Generating Substrings as Document Identifiers. In Advances in Neural Information Processing Systems. 31668--31683.
  3. Avi Bleiweiss. 2017. A Hierarchical Book Representation ofWord Embeddings for Effective Semantic Clustering and Search. In International Conference on Agents and Artificial Intelligence, Vol. 2. SCITEPRESS, 154--163.
  4. Shubham Chatterjee and Laura Dietz. 2021. Entity Retrieval Using Fine-grained Entity Aspects. In proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval. 1662--1666.
  5. Djork-Arné Clevert, Thomas Unterthiner, and Sepp Hochreiter. 2015. Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs). arXiv preprint arXiv:1511.07289 (2015). · arXiv
  6. Arman Cohan, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Seokhwan Kim, Walter Chang, and Nazli Goharian. 2018. A Discourse-aware Attention Model for Abstractive Summarization of Long Documents. arXiv preprint arXiv:1804.05685 (2018). · arXiv
  7. Nicola De Cao, Gautier Izacard, Sebastian Riedel, and Fabio Petroni. 2021. Autoregressive Entity Retrieval. In International Conference on Learning Representations.
  8. Zican Dong, Tianyi Tang, Lunyi Li, and Wayne Xin Zhao. 2023. A Survey on Long Text Modeling with Transformers. arXiv preprint arXiv:2302.14502 (2023). · arXiv
  9. Zhenyu He, Guhao Feng, Shengjie Luo, Kai Yang, Di He, Jingjing Xu, Zhi Zhang, Hongxia Yang, and LiweiWang. 2024. Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation. arXiv preprint arXiv:2401.16421 (2024). · arXiv
  10. Angelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas, and François Fleuret. 2020. Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention. In International Conference on Machine Learning. PMLR, 5156--5165.
  11. Shah Khusro, Irfan Ullah, Azhar Rauf, and Saeed Mahfooz. 2014. Issues and Challenges in Book Information Retrieval. International Information Institute (Tokyo). Information 17, 6 (2014), 2055.
  12. Yongqi Li, Nan Yang, LiangWang, FuruWei, and Wenjie Li. 2023. Multiview Identifiers Enhanced Generative Retrieval. In 61st Annual Meeting of the Association for Computational Linguistics. 6636--6648.
  13. Kevin Lin, Kyle Lo, Joseph E Gonzalez, and Dan Klein. 2023. Decomposing Complex Queries for Tip-of-the-tongue Retrieval. arXiv preprint arXiv:2305.15053 (2023). · arXiv
  14. Tsendsuren Munkhdalai, Manaal Faruqui, and Siddharth Gopal. 2024. Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention. arXiv preprint arXiv:2404.07143 (2024). · arXiv
  15. Tsendsuren Munkhdalai, Alessandro Sordoni, Tong Wang, and Adam Trischler. 2019. Metalearned Neural Memory. Advances in Neural Information Processing Systems 32 (2019).
  16. Rodrigo Nogueira and Jimmy Lin. 2019. From doc2query to docTTTTTquery. An MS MARCO Passage Retrieval Task Publication. University of Waterloo.
  17. 10.5555/3455716.3455856 · doi:10.5555/3455716.3455856
  18. Stephen E. Robertson Steve Walker Susan Jones Micheline M. Hancock-Beaulieu and Mike Gatford. 1995. Okapi at TREC-3. In TREC. 109--126. · doi:10.6028/nist.sp.500-225.city
  19. Imanol Schlag, Tsendsuren Munkhdalai, and Jürgen Schmidhuber. 2020. Learning Associative Inference using FastWeight Memory. arXiv preprint arXiv:2011.07831 (2020). · arXiv
  20. Peter Shaw, Jakob Uszkoreit, and Ashish Vaswani. 2018. Self-attention with Relative Position Representations. arXiv preprint arXiv:1803.02155 (2018). · arXiv
  21. Zhuoran Shen, Mingyuan Zhang, Haiyu Zhao, Shuai Yi, and Hongsheng Li. 2021. Efficient Attention: Attention with Linear Complexities. In Proceedings of the IEEE/CVF winter conference on applications of computer vision. 3531--3539.
  22. Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. 2024. Roformer: Enhanced Transformer with Rotary Position Embedding. Neurocomputing 568 (2024), 127063.
  23. Weiwei Sun, Lingyong Yan, Zheng Chen, Shuaiqiang Wang, Haichao Zhu, Pengjie Ren, Zhumin Chen, Dawei Yin, Maarten de Rijke, and Zhaochun Ren. 2023. Learning to Tokenize for Generative Retrieval. In Advances in Neural Information Processing Systems, Vol. 36.
  24. Yubao Tang, Ruqing Zhang, Jiafeng Guo, and Maarten de Rijke. 2023. Recent Advances in Generative Information Retrieval. In SIGIR-AP 2023: 1st International ACM SIGIR Conference on Information Retrieval in the Asia Pacific. ACM, 294--297.
  25. Haihua Xie, Zhiyou Chen, Yabo Li, Shaoling Jing, Xiaoqing Lyu, and Zhi Tang. 2020. Sembrs: A Semantic Analysis Based Book Retrieval Approach. In 2020 IEEE conference on multimedia information processing and retrieval (MIPR). IEEE, 101--104.
  26. Caiming Xiong, Victor Zhong, and Richard Socher. 2017. DCN: Mixed Objective And Deep Residual Coattention for Question Answering. In International Conference on Learning Representations.
  27. Tianchi Yang, Minghui Song, Zihan Zhang, Haizhen Huang, Weiwei Deng, Feng Sun, and Qi Zhang. 2023. Auto Search Indexer for End-to-End Document Retrieval. In Findings of the Association for Computational Linguistics: EMNLP 2023.
  28. Hansi Zeng, Chen Luo, Bowen Jin, Sheikh Muhammad Sarwar, Tianxin Wei, and Hamed Zamani. 2024. Scalable and Effective Generative Information Retrieval. In The 2024 ACM Web Conference.
  29. Jingtao Zhan, Jiaxin Mao, Yiqun Liu, Min Zhang, and Shaoping Ma. 2020. Rep-BERT: Contextualized Text Embeddings for First-stage Retrieval. arXiv preprint arXiv:2006.15498 (2020). · arXiv
  30. Zhuosheng Zhang, Hanqing Zhang, Keming Chen, Yuhang Guo, Jingyun Hua, Yulong Wang, and Ming Zhou. 2021. Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinese. arXiv:2110.06696 [cs.CL] · arXiv
  31. Yujia Zhou, Jing Yao, Zhicheng Dou, Ledell Wu, Peitian Zhang, and Ji-Rong Wen. 2022. Ultron: An Ultimate Retriever on Corpus with a Model-based Indexer. arXiv preprint arXiv:2208.09257 (2022). · arXiv
  32. Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, and Sujian Li. 2023. Pose: Efficient Context Window Extension of LLMs via Positional Skip-wise Training. arXiv preprint arXiv:2309.10400 (2023). · arXiv
  33. Shengyao Zhuang Houxing Ren Linjun Shou Jian Pei Ming Gong Guido Zuccon and Daxin Jiang. 2023. Bridging the Gap between Indexing and Retrieval for Differentiable Search Index with Query Generation. In Gen-IR@SIGIR 2023: The First Workshop on Generative Information Retrieval.

Cited by

See all 5

Metadata

Authors
Tang, Y., Zhang, R., Guo, J., de Rijke, M., Liu, S., Wang, S., Yin, D., & Cheng, X.
Affiliations
  • Chinese Academy of Sciences (CN)
  • Institute of Computing Technology (CN)
  • University of Amsterdam, Amsterdam, Netherlands
  • Baidu (China) (CN)
Venue
Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1
Publisher
ACM
Published
2025-07-20
Pages
2606-2617
OpenAlex
W4409150075
Cited by
5
References
17
Citations by year
2026: 3 · 2025: 2
FWCI
6.00
Type
conference paper
Language
en
Open access
Locations
  • ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • Dutch Research Council (KICH3.LTP.20.006)
  • European Union's Horizon Europe research and innovation program (No 101070212)
  • Project Management (No. JCKY2022130C039)
  • Dutch Research Council (NWO), DPG Media, RTL, and the Dutch Ministry of Economic Affairs and Climate Policy (LTP KIC 2020-2023)
  • National Natural Science Foundation of China (No. 62472408)
  • LESSEN (NWA.1389.20.183)
  • Strategic Priority Research Program of the CAS (No. XDB0680102)
  • Lenovo-CAS Joint Lab Youth Scientist Project (Null)
  • National Key Research and Development Program of China (No. 2023YFA1011602)
  • Dutch Ministry of Education (nr.\ 024.004.022)
Topics
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
Keywords
generative retrieval, book searching, hierarchical information, book metadata, document identifiers

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.