Generative Agents Navigating Digital Libraries
Open accessPublished version of a preprint
The DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index; 5 of the 16 sources its claims cite were checked for support.
Overview
CoChat Summary
TL;DR
Agent4DL is an LLM-based generative user simulator for digital library search, with profile, memory, and interaction modules, validated against real user data from EconBiz and Sowiport/SUSS. It generates realistic query, click, and stopping behavior and augmented data that improves IR ranking tasks, while showing limitations around metadata and scholarly search complexity.
Key findings
- For preference prediction, RoBERTa trained on Agent4DL data (3000 sessions) reached MRR 41.32, nDCG@1 22.66, and nDCG@3 35.19, outperforming BM25 (34.89, 15.12, 26.03) and RoBERTa trained on SUSS (34.15, 13.91, 26.45); even 1000 Agent4DL sessions reached 39.27, 20.37, 33.09.
- For relevance prediction, Agent4DL 3000 reached MRR 37.71, nDCG@1 18.90, and nDCG@3 32.78, compared with BM25 (32.11, 11.65, 24.21) and RoBERTa/SUSS (33.10, 12.36, 25.54).
- Query generation similarity was highest for Agent4DL: term overlap τ = 0.87 (±0.08), BLEU = 0.40 (±0.06), BERTScore = 0.83 (±0.04), above Popular, Random, and Discriminative Selection baselines.
- Click/stopping results: Agent4DL click accuracy 78.35, P@10 41.71, R@10 65.59, F1 50.99; stopping accuracy 84.14, P@10 82.90, R@10 39.89, F1 53.86. Augmenting SUSS with academic traits and research interests improved MRR from 59.12 to 64.37.
Methods
- Agent4DL uses LLM generative agents with three modules: profile (academic traits—depth, breadth, recency bias, interdisciplinarity—and research interests), memory (factual and emotional memories with retrieval, writing, reflection), and interaction (search-driven and emotion-driven actions), using ReAct and Chain-of-Thought prompting.
- Data come from EconBiz (August–November 2020, approximately 420,000 sessions, 15 GB) and Sowiport/SUSS (484,437 sessions, 179,796 queries, April 2014–April 2015); profiles are initialized from benchmark datasets and evaluated by training RoBERTa ranking models (5 epochs, batch size 128, learning rate 5e-6) with MRR, nDCG@1, nDCG@3, accuracy, P@10, R@10, and F1.
- Additional experiments simulate information overload over four rounds and use DirectLiNGAM to learn a causal graph for open access and resource usage.
Limitations
- Stated in the paper: Agent4DL relies heavily on rich metadata that is not uniformly available across digital libraries; its action space omits citation chaining, consultation with colleagues, and serendipitous browsing; and the LLM sometimes struggled with domain-specific or recent knowledge, producing anachronistic queries or misjudging cutting-edge relevance.
- Evident from the text: evaluation is limited to EconBiz and Sowiport/SUSS; Agent4DL does not effectively capture position bias and uses zero-shot learning; stopping behavior has lower recall and F1 than some baselines; and some components depend on ChatGPT/gpt-3.5-turbo-0125 and API-accessible digital libraries.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 2 Not valid · 9 Not checked · 55 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Simulating user search behaviors has emerged as a promising alternative, offering a controlled and repeatable way to study complex user interactions without the drawbacks of real-world studies [2].”
What the sources say
- Supportedcites [2] Balog, K., Zhai, C.: User simulation for evaluating information access systems. CoRR abs/2306.08550 (2023). https://doi.org/10.48550/ARXIV.2306.08550 source
The Introduction (p. 9) says simulation can enable repeatable, reproducible evaluations at low cost and show how performance changes under different conditions and user behaviours. The Overview (pp. 30–31) contrasts this with the cost and difficulty of reproducing experiments with real users, and says simulated users can be reused in a controlled manner. (LLM, conf=0.93)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“When these highly-used items are incorporated into new training datasets, information retrieval systems tend to rank them higher in subsequent iterations, resulting in the open access citation advantage[13].”
What the sources say
- Partly supportedcites [13] He, Y., et al.: CausPref: causal preference learning for out-of-distribution recommendation. In: Laforest, F., et al. (eds.) WWW 2022: The ACM Web Conference 2022, Virtual Event, Lyon, France, 25–29 April 2022, pp. 410–421. ACM (2022). https://doi.org/10.1145/3485447.3511969 sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) says popular items may have more chances to be exposed, and §4 EXPERIMENTS says unpopular items receive less exposure. The paper does not establish that incorporating highly used items into later training datasets raises their rankings, or that this produces an open-access citation advantage. (LLM, conf=0.82)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Incorporating user profiles and memory modules into agent systems allows them to display a range of behaviors similar to humans, based on their current observations [33].”
What the sources say
- Partly supportedcites [33] Yao, S., et al.: ReAct: synergizing reasoning and acting in language models. In: The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, 1–5 May 2023. OpenReview.net (2023). https://openreview.net/pdf?id=WE_vluYUL-X sourceExperimental — accuracy not yet measured
Section 2 (p. 3) describes an agent acting on observations and reasoning over its current context; the Abstract (p. 1) describes human-like task-solving trajectories. Neither passage supports the claim that incorporating user profiles and memory modules produces those behaviors, and searches for those terms found no such account. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“This design is motivated by the need to monitor emotional states, particularly frustration with complex queries and satisfaction with search results, which play important roles in shaping search experiences and decision-making processes [25].”
What the sources say
- Could not verifycites [25] Park, J.S., O’Brien, J.C., Cai, C.J., Morris, M.R., Liang, P., Bernstein, M.S.: Generative agents: interactive simulacra of human behavior. In: Follmer, S., Han, J., Steimle, J., Riche, N.H. (eds.) Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, UIST 2023, San Francisco, CA, USA, 29 October–1 November 2023, pp. 2:1–2:22. ACM (2023). https://doi.org/10.1145/3586183.3606763 sourceExperimental — accuracy not yet measured
Section 4.1 (Memory and Retrieval; page unavailable) discusses how simulated agents retrieve relevant memories in response to queries, not people's emotions during search. Searches for frustration, satisfaction with search results, and emotional states found no passage addressing their effects on search experiences or decision-making. (LLM, conf=0.76)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Notably, Agent4DL demonstrates competitive performance compared to existing user search simulators such as SimIIR 2.0, particularly in its ability to generate more diverse and context-aware user behaviors.”
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
36 more claims
Create a free account to see all 69 claims and every source verdict.
- Probably not a substantial claim. 16
- It may state two separate claims as one. 20
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4.3 Simulation Consistency · p. 5
“Agent4DL achieves a 87.6% Term Overlap Rate ( 𝜏 ) between LLM-generated and human queries”
§ 4.3 Simulation Consistency · p. 5
“| Agent4DL | 0.87 ( ± 0.08) | 0.40 ( ± 0.06) | 0.83 ( ± 0.04) |”
Citations
Cites
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · cited 3×
“Popular Selection considers word weights, resulting in a higher BLEU score.”
InfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606763 · Cited by 2,187
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Dong, Z., Hou, Y., Zhang, B., Min, Y., Zhang, J., Liu, P., et al. (2026) · Frontiers of Computer Science · doi:10.1007/s11704-026-60308-3 · Cited by 2,093
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18223 · Cited by 2,090
Cognitive neuroscience of emotional memory
LaBar, K. S., & Cabeza, R. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1825 · Cited by 1,834 · cited 1×
“This dual approach aligns with cognitive research highlighting the influence of emotions on decision-making and personal history formation [17].”
The Rise and Potential of Large Language Model Based Agents: A Survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.07864 · Cited by 972 · cited 1×
“However, recent advancements have utilized Large Language Models (LLMs) to develop more dynamic and realistic simulations of user behavior in various contexts, such as web search, reasoning, and social interaction [25, 32, 34, 38].”
The rise and potential of large language model based agents: a survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4222-0 · Cited by 970
Web search behavior of Internet experts and newbies
Hölscher, C., & Strube, G. (2000) · Computer Networks · doi:10.1016/s1389-1286(00)00031-1 · Cited by 647 · cited 1×
“Key contributions include session search and click models [6, 14, 15], which analyze query-click data patterns to gain insights into user behavior [4, 11, 36].”
ReAct: Synergizing Reasoning and Acting in Language Models
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.03629 · Cited by 608 · cited 2×
“However, recent advancements have utilized Large Language Models (LLMs) to develop more dynamic and realistic simulations of user behavior in various contexts, such as web search, reasoning, and social interaction [25, 32, 34, 38].”
A dynamic bayesian network click model for web search ranking
Chapelle, O., & Zhang, Y. (2009) · Proceedings of the 18th international conference on World wide web · doi:10.1145/1526709.1526711 · Cited by 537 · cited 1×
“Key contributions include session search and click models [6, 14, 15], which analyze query-click data patterns to gain insights into user behavior [4, 11, 36].”
A user browsing model to predict search engine click data from past observations.
Dupret, G. E., & Piwowarski, B. (2008) · Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1390334.1390392 · Cited by 442 · cited 1×
“Key contributions include session search and click models [6, 14, 15], which analyze query-click data patterns to gain insights into user behavior [4, 11, 36].”
Lin, J., Ma, X., Lin, S.-C., Yang, J.-H., Pradeep, R., & Nogueira, R. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3463238 · Cited by 360 · cited 1×
“Interestingly, the classic BM25 model [18] remains competitive, surpassing some semantic models trained on search behavior datasets.”
Understanding PubMed(R) user search behavior through log analysis
Islamaj Dogan, R., Murray, G. C., Neveol, A., & Lu, Z. (2009) · Database · doi:10.1093/database/bap018 · Cited by 265 · cited 1×
“To establish a reliable foundation, benchmark datasets (e.g., Pubmed [10], Sowiport [22]) are used for initialization.”
Information Overload: An Introduction
Bawden, D., & Robinson, L. (2020) · Oxford Research Encyclopedia of Politics · doi:10.1093/acrefore/9780190228637.013.1360 · Cited by 249
Large Language Models for Information Retrieval: A Survey
Zhu, Y., Yuan, H., Wang, S., Liu, J., Liu, W., Deng, C., Chen, H., Liu, Z., Dou, Z., & Wen, J.-R. (2026) · ACM Transactions on Information Systems · doi:10.1145/3748304 · Cited by 225 · cited 1×
“…context has recently started to be explored, driven by the need for robust and scalable simulation methods that can replicate the full range of user interactions in search environments, from initial query formulation to complex navigational decisions and interactions with search results [40].”
Exploratory Search: Beyond the Query—Response Paradigm
White, R. W., & Roth, R. A. (2009) · Synthesis Lectures on Information Concepts, Retrieval, and Services · doi:10.1007/978-3-031-02260-9 · Cited by 182
Defining a session on Web search engines
Jansen, B. J., Spink, A., Blakely, C., & Koshman, S. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20564 · Cited by 166
The Depth and Breadth of Google Scholar: An Empirical Study
Neuhaus, C., Neuhaus, E., Asher, A., & Wrede, C. (2006) · portal: Libraries and the Academy · doi:10.1353/pla.2006.0026 · Cited by 156 · cited 1×
“Academic traits encompass four key characteristics capturing an individual’s research behavior in digital library scenarios: depth, breadth, recency bias, and interdisciplinarity [8, 9, 23].”
Building simulated queries for known-item topics: an analysis using six european languages
Azzopardi, L., de Rijke, M., & Balog, K. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277820 · Cited by 135 · cited 1×
“We implement Popular, Random, and Discriminative Selection user querying strategies from Azzopardi et al. [1] as baselines.”
The Hidden Agenda User Simulation Model
Schatzmann, J., & Young, S. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2008.2012071 · Cited by 94 · cited 1×
“Early methods focused on simple query generation and heuristic-based stopping behaviors in search tasks [27, 28].”
A Click Sequence Model for Web Search
Borisov, A., Wardenaar, M., Markov, I., & de Rijke, M. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210004 · Cited by 71 · cited 1×
“Key contributions include session search and click models [6, 14, 15], which analyze query-click data patterns to gain insights into user behavior [4, 11, 36].”
Simulating Interactive Information Retrieval: SimIIR: A Framework for the Simulation of Interaction
Maxwell, D., & Azzopardi, L. A. (2016) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2911451.2911469 · Cited by 64 · cited 3×
“Although this training gives SimIIR 2.0 an advantage, Agent4DL’s performance remains competitive Overall, LLM agents demonstrate a high degree of consistency with human behaviors across all dimensions of query, click, and stopping, ensuring the viability of user simulation.”
InfluentialStopping rules and their effect on expected search length
Kraft, D. H., & Lee, T. (1979) · Information Processing & Management · doi:10.1016/0306-4573(79)90007-4 · Cited by 60 · cited 1×
“We compare Agent4DL to the Complex Searcher Model (CSM) in SimIIR [21], including a combination of predefined Frus-tration and Satisfaction Points as described by Kraft et al. [16], and the interaction model in SimIIR 2.0 [37], which uses Markov model-based decisions for clicking and stopping.”
InfluentialUser Simulation for Evaluating Information Access Systems
Balog, K., & Zhai, C. (2024) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000098 · Cited by 52
CausPref: Causal Preference Learning for Out-of-Distribution Recommendation
He, Y., Wang, Z., Cui, P., Zou, H., Zhang, Y., Cui, Q., & Jiang, Y. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3511969 · Cited by 50
Deng, S., & Xia, S. (2020) · Scientometrics · doi:10.1007/s11192-020-03465-x · Cited by 49 · cited 1×
“Academic traits encompass four key characteristics capturing an individual’s research behavior in digital library scenarios: depth, breadth, recency bias, and interdisciplinarity [8, 9, 23].”
Position Bias in Recommender Systems for Digital Libraries
Collins, A., Tkaczyk, D., Aizawa, A., & Beel, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-78105-1_37 · Cited by 44
(2018) · Lecture notes in computer science · doi:10.1007/978-3-319-78105-1 · Cited by 33
Zerhoudi, S., Günther, S., Plassmeier, K., Borst, T., Seifert, C., Hagen, M., & Granitzer, M. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557711 · Cited by 32 · cited 1×
“We compare Agent4DL to the Complex Searcher Model (CSM) in SimIIR [21], including a combination of predefined Frus-tration and Satisfaction Points as described by Kraft et al. [16], and the interaction model in SimIIR 2.0 [37], which uses Markov model-based decisions for clicking and stopping.”
InfluentialSelf-citationGroup based Personalized Search by Integrating Search Behaviour and Friend Network
Zhou, Y., Dou, Z., Wei, B., Xie, R., & Wen, J.-R. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3462918 · Cited by 29 · cited 1×
“Understanding user behavior in digital library searches is crucial for improving these systems to better serve user needs [7, 35, 39].”
User Simulation for Evaluating Information Access Systems
Balog, K., & Zhai, C. (2023) · arXiv · doi:10.48550/arxiv.2306.08550 · Cited by 26
Proceedings of the 30th ACM International Conference on Information & Knowledge Management
Weller, T., & Paulheim, H. (2021) · doi:10.1145/3459637 · Cited by 22
Cognitive styles within an exploratory search system for digital libraries
Goodale, P., Clough, P. D., Fernando, S., Ford, N. J., & Stevenson, M. (2014) · Journal of Documentation · doi:10.1108/jd-03-2014-0045 · Cited by 18 · cited 1×
“The user profile module embodies academic traits and research interests, while the memory and interaction modules, inspired by human cognition [12], enable agents to store, recall, and use past experiences.”
A Comparative Analysis of Human and Automatic Query Variants
Liu, B., Craswell, N., Lu, X., Kurland, O., & Culpepper, J. S. (2019) · Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval · doi:10.1145/3341981.3344223 · Cited by 14 · cited 1×
“𝜏 quantifies shared keywords between paired queries using Jaccard similarity [19], indicating thematic similarity and consistent search intent.”
Incorporating Query Reformulating Behavior into Web Search Evaluation
Chen, J., Liu, Y., Mao, J., Zhang, F., Sakai, T., Ma, W., Zhang, M., & Ma, S. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482438 · Cited by 12 · cited 1×
“Understanding user behavior in digital library searches is crucial for improving these systems to better serve user needs [7, 35, 39].”
Sowiport User Search Sessions Data Set (SUSS)
Mayr, P. (2016) · GESIS Data Archive · doi:10.7802/1380 · Cited by 9 · cited 7×
“The Sowiport User Search Session Data Set (SUSS) [22] comprises 484,437 search sessions and 179,796 queries collected over one year (April 2014 to April 2015).”
InfluentialComparative Analysis: User Interactions in Public and Private Digital Libraries Datasets
Zerhoudi, S., & Granitzer, M. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72440-4_16 · Cited by 2 · cited 1×
“Understanding user behavior in digital library searches is crucial for improving these systems to better serve user needs [7, 35, 39].”
Self-citationACM SIGIR 2018 chairs' welcome
Ounis, I., Allan, J. A., Wen, J.-R., et al. (2018) · UvA-DARE (University of Amsterdam) · doi:10.1145/3209978
Overview of the TREC 2014 Session Track
Carterette, B., Kanoulas, E., Hall, M. M., & Clough, P. D. (2014) · doi:10.6028/nist.sp.500-308.session-overview
Large Language Models for Information Retrieval: A Survey
Zhu, Y., Yuan, H., Wang, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.07107
Research works printed but not linked: 4
- Pearl, J., Glymour, M., Jewell, N.P.: Causal Inference in Statistics: A Primer. Wiley (2016)
- Ross, S.M.: Simulation. Statistical Modeling and Decision Science, 2nd edn. Academic Press (1997)
- Walsh, J.A., et al.: “The library is open!”: open data and an open API for the HathiTrust Digital Library. In: Sela, A., Jannidis, F., Romanowska, I. (eds.) Proceedings of the Computational Humanities Research Conference 2023, Paris, France, 6–8 December 2023. CEUR Workshop Proceedings, vol. 3558, pp. 703–714. CEUR-WS.org (2023). https://ceur-ws.org/Vol-3558/paper7875.pdf
- Zerhoudi, S., Granitzer, M., Seifert, C., Schlötterer, J.: Simulating user interaction and search behaviour in digital libraries. In: Nunzio, G.M.D., Portelli, B., Redavid, D., Silvello, G. (eds.) Proceedings of the 18th Italian Research Conference on Digital Libraries, Padua, Italy, 24–25 February 2022 (Hybrid Event). CEUR Workshop Proceedings, vol. 3160. CEUR-WS.org (2022). https://ceur-ws.org/Vol-3160/paper8.pdf
Cited by
Simulation of Interactive Information Retrieval: A Guided Tour
Zerhoudi, S., Roegiest, A., & Trippas, J. R. (2026) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3786304.3787892 · Cited by 4
“In addition, with the recent rise of large language models (LLMs) and generative models has introduced a new, powerful, but complex class of simulation techniques [4, 8, 10, 12].”
Self-citation
Metadata
- Authors
- Zerhoudi, S., & Granitzer, M.
- Affiliations
- University of Passau (DE)
- Corresponding author
- Zerhoudi, Saber
- Venue
- Lecture notes in computer science
- Publisher
- Springer Nature Singapore
- Published
- 2024-12-06
- Pages
- 171-188
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W4405025781
- Cited by
- 1
- References
- 34
- Citations by year
- 2026: 1
- FWCI
- 0.38
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Lecture notes in computer science (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Social Sciences › Library and Information Sciences › Library Science and Information
- Social Sciences › Library and Information Sciences › Library Science and Information Literacy
- Keywords
- digital libraries, large language models, generative AI agents, user profiles, search sessions, user interaction modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.