Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index; 5 of the 16 sources its claims cite were checked for support.

Generative Agents Navigating Digital Libraries

Open access
Zerhoudi, Saber, Granitzer, Michael · 2025 · Lecture notes in computer science

Published version of a preprint

Overview

CoChat Summary

TL;DR

Agent4DL is an LLM-based generative user simulator for digital library search, with profile, memory, and interaction modules, validated against real user data from EconBiz and Sowiport/SUSS. It generates realistic query, click, and stopping behavior and augmented data that improves IR ranking tasks, while showing limitations around metadata and scholarly search complexity.

Key findings

  • For preference prediction, RoBERTa trained on Agent4DL data (3000 sessions) reached MRR 41.32, nDCG@1 22.66, and nDCG@3 35.19, outperforming BM25 (34.89, 15.12, 26.03) and RoBERTa trained on SUSS (34.15, 13.91, 26.45); even 1000 Agent4DL sessions reached 39.27, 20.37, 33.09.
  • For relevance prediction, Agent4DL 3000 reached MRR 37.71, nDCG@1 18.90, and nDCG@3 32.78, compared with BM25 (32.11, 11.65, 24.21) and RoBERTa/SUSS (33.10, 12.36, 25.54).
  • Query generation similarity was highest for Agent4DL: term overlap τ = 0.87 (±0.08), BLEU = 0.40 (±0.06), BERTScore = 0.83 (±0.04), above Popular, Random, and Discriminative Selection baselines.
  • Click/stopping results: Agent4DL click accuracy 78.35, P@10 41.71, R@10 65.59, F1 50.99; stopping accuracy 84.14, P@10 82.90, R@10 39.89, F1 53.86. Augmenting SUSS with academic traits and research interests improved MRR from 59.12 to 64.37.

Methods

  • Agent4DL uses LLM generative agents with three modules: profile (academic traits—depth, breadth, recency bias, interdisciplinarity—and research interests), memory (factual and emotional memories with retrieval, writing, reflection), and interaction (search-driven and emotion-driven actions), using ReAct and Chain-of-Thought prompting.
  • Data come from EconBiz (August–November 2020, approximately 420,000 sessions, 15 GB) and Sowiport/SUSS (484,437 sessions, 179,796 queries, April 2014–April 2015); profiles are initialized from benchmark datasets and evaluated by training RoBERTa ranking models (5 epochs, batch size 128, learning rate 5e-6) with MRR, nDCG@1, nDCG@3, accuracy, P@10, R@10, and F1.
  • Additional experiments simulate information overload over four rounds and use DirectLiNGAM to learn a causal graph for open access and resource usage.

Limitations

  • Stated in the paper: Agent4DL relies heavily on rich metadata that is not uniformly available across digital libraries; its action space omits citation chaining, consultation with colleagues, and serendipitous browsing; and the LLM sometimes struggled with domain-specific or recent knowledge, producing anachronistic queries or misjudging cutting-edge relevance.
  • Evident from the text: evaluation is limited to EconBiz and Sowiport/SUSS; Agent4DL does not effectively capture position bias and uses zero-shot learning; stopping behavior has lower recall and F1 than some baselines; and some components depend on ChatGPT/gpt-3.5-turbo-0125 and API-accessible digital libraries.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/978-981-96-0865-2_14

Cites

42 of 43 references verified0 citation errors · 1 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

3 Valid · 2 Not valid · 9 Not checked · 55 Own results and interpretations

36 more claims

Create a free account to see all 69 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 16
  • It may state two separate claims as one. 20
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 34 references

Research works printed but not linked: 4

  1. Pearl, J., Glymour, M., Jewell, N.P.: Causal Inference in Statistics: A Primer. Wiley (2016)
  2. Ross, S.M.: Simulation. Statistical Modeling and Decision Science, 2nd edn. Academic Press (1997)
  3. Walsh, J.A., et al.: “The library is open!”: open data and an open API for the HathiTrust Digital Library. In: Sela, A., Jannidis, F., Romanowska, I. (eds.) Proceedings of the Computational Humanities Research Conference 2023, Paris, France, 6–8 December 2023. CEUR Workshop Proceedings, vol. 3558, pp. 703–714. CEUR-WS.org (2023). https://ceur-ws.org/Vol-3558/paper7875.pdf
  4. Zerhoudi, S., Granitzer, M., Seifert, C., Schlötterer, J.: Simulating user interaction and search behaviour in digital libraries. In: Nunzio, G.M.D., Portelli, B., Redavid, D., Silvello, G. (eds.) Proceedings of the 18th Italian Research Conference on Digital Libraries, Padua, Italy, 24–25 February 2022 (Hybrid Event). CEUR Workshop Proceedings, vol. 3160. CEUR-WS.org (2022). https://ceur-ws.org/Vol-3160/paper8.pdf

Cited by

See all 1

Metadata

Authors
Zerhoudi, S., & Granitzer, M.
Affiliations
University of Passau (DE)
Corresponding author
Zerhoudi, Saber
Venue
Lecture notes in computer science
Published
2024-12-06
Pages
171-188
ISSN
  • 0302-9743 (ISSN-L)
  • 1611-3349
OpenAlex
W4405025781
Cited by
1
References
34
Citations by year
2026: 1
FWCI
0.38
Type
conference paper
Language
en
Open access
Licence
Locations
  • Lecture notes in computer science (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Social Sciences › Library and Information Sciences › Library Science and Information
  • Social Sciences › Library and Information Sciences › Library Science and Information Literacy
Keywords
digital libraries, large language models, generative AI agents, user profiles, search sessions, user interaction modeling

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Generative Agents Navigating Digital Libraries. https://app.cochat.ai/papers/10.1007/978-981-96-0865-2_14
The paper
Zerhoudi, S., & Granitzer, M. (2025). Generative Agents Navigating Digital Libraries. Lecture notes in computer science. https://doi.org/10.1007/978-981-96-0865-2_14

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.