Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 58 of the 63 references it cites were found in a registry or an index, and 5 are not checked yet; none of the 37 sources its claims cite is checked for support yet.

AI on the Shoulders of Giants: Using Kuhlthau’s Information Search Process to Improve AI Support for Information-Seeking

Open access
Ravuri, Benhur, Mardis, Marcia A. · 2025 · Library Trends

Abstract

Librarian-patron exchanges parallel chatbot-user interactions: Experienced librarians provide better reference service by prompting users with clarifying questions; likewise, chatbots can improve their responses with better-engineered prompts. A chatbot’s self-assessment mechanisms transform prompt components into predictions formed into responses, a process that enables large language models to continually learn and improve from prompts engineered to produce desired outcomes. Kuhlthau’s Information Search Process (ISP), created to describe library patrons’ information-seeking stages and dispositions, may be useful for understanding and improving users’ interactions with AI-driven chatbots. Kuhlthau has detailed seven stages of information-seeking, with intervention zones and reference mediation levels, for librarians to assist users in reaching satisfying outcomes in offline and online environments. We hypothesize that generative AI agents can use ISP’s zones of intervention and levels of reference mediation to improve their large language models to assist users better. Guided by the overarching question “To what extent does applying ISP to virtual reference transactions present strategies for improving prompt engineering?” we explored a recent virtual reference dataset ( N = 1,959) to determine whether users’ questions reflected Kuhlthau’s ISP and how librarian-patron interactions used clarifying questions and interventions to ascertain users’ information-seeking stage and provide satisfying responses. Our investigation demonstrated that authentic patron questions clustered in ISP’s focus formulation and information gathering stages. When exemplar questions were posed to a chatbot, it demonstrated a strong ability to detect and respond to the information need, often providing scaffolds to the next step of the information-seeking process. These results suggest that chatbots can be improved by blending web searching, database searching, and generative AI to seamlessly meet user needs, while task definition, topic selection, and search assessment should remain human-mediated aspects of information-seeking.

Checked 2026-11-18 · 5 references not checked yet

Overview

CoChat Summary

TL;DR

The paper applies Kuhlthau’s Information Search Process (ISP) to authentic virtual reference questions and tests whether ChatGPT 4o can respond in ways aligned with ISP stages, zones of intervention, and reference mediation levels. It argues chatbots can support middle ISP stages but should be blended with human mediation for task definition, topic selection, and search assessment.

Key findings

  • In Florida Ask a Librarian transactions from October 2023 (N = 1,959), local help was most common (n = 641, 33%), followed by research (n = 608, 31%) and reference (n = 509, 26%); mean transaction duration was 6.0 minutes (median 4.1).
  • Among research questions (n = 608), ISP Stage 3 Prefocus Exploration was most frequent (n = 381, 63%), followed by Stage 5 Information Collection (n = 70, 12%), Stage 1 Task Initiation (n = 63, 10%), Stage 4 Focus Formulation (n = 57, 9%), Stage 2 Topic Selection (n = 33, 5%), and Stage 6 Preparing to Write (n = 4); no questions reflected Stage 7.
  • ChatGPT 4o successfully identified the zone of intervention for exemplar Stage 3, Stage 4, and Stage 5 questions; for Stage 3 and Stage 4 it offered bridges to the next ISP stage, but for Stage 5 it did not suggest additional questions to bridge to Stage 6 or revisit topic focus.
  • The authors conclude chatbots can be improved by blending web searching, database searching, and generative AI, while task definition, topic selection, and search assessment should remain human-mediated.

Methods

  • Exploratory study using Florida’s Ask a Librarian data from October 2023 (N = 1,959), including initial questions, timestamps, transaction duration, and number of questions; AAL provided only initial questions, not full transaction text.
  • Deductively coded all questions by AAL categories (Research, Reference, Local Help, combinations) and coded Research questions (n = 608) for ISP stage, intervention zone, and reference mediation level; two coders resolved differences collaboratively.
  • Ran frequencies and descriptive statistics, then posed three exemplar AAL Research questions representing ISP Stages 3, 4, and 5 to ChatGPT 4o and qualitatively analyzed responses for ISP-linked support elements.

Limitations

  • Stated: AAL privacy policies meant the dataset lacked full reference transaction text, including librarians’ responses and follow-up questions; not all users fit ISP or seek information to complete a specific task; cited virtual reference and chatbot studies may reflect older technologies due to publication lag; the study is exploratory.
  • Evident from the text: only three exemplar questions were posed to one chatbot version (ChatGPT 4o), and chatbot responses were analyzed qualitatively rather than systematically coded; the dataset covers one state service and one month, limiting generalizability.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1353/lib.2025.a961195

Cites

58 of 63 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Transcript of ChatGPT 4o response to an Information Search Process Stage 3, Prefocus Exploration, question (captured December 10, 2024).
Figure 1 Transcript of ChatGPT 4o response to an Information Search Process Stage 3, Prefocus Exploration, question (captured December 10, 2024).CC-BY-NC-ND · From the PDF
Figure 2 Transcript of ChatGPT 4o response to an Information Search Process Stage 4, Focus Formulation, question (captured December 10, 2024).
Figure 2 Transcript of ChatGPT 4o response to an Information Search Process Stage 4, Focus Formulation, question (captured December 10, 2024).CC-BY-NC-ND · From the PDF
Figure 3 Transcript of ChatGPT 4o response to an Information Search Process Stage 5, Information Collection, question (captured December 10, 2024).
Figure 3 Transcript of ChatGPT 4o response to an Information Search Process Stage 5, Information Collection, question (captured December 10, 2024).CC-BY-NC-ND · From the PDF

Verification

Claims the paper makes

0 Valid · 0 Not valid · 34 Not checked · 73 Own results and interpretations

31 more claims

Create a free account to see all 107 claims and to verify the 27 references still open.

See all claims — free account
  • Probably not a substantial claim. 57
  • It may state two separate claims as one. 25
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

5 of 5

Citations

Cites

Show all 58 references

Research works printed but not linked: 4

  1. Kuhlthau, Carol C. 2001. "Rethinking Libraries for the Information Age School: Vital Roles in Inquiry Learning." Keynote address at the International Association of School Librarian- ship Conference & International Research Forum on Research in School Librarianship, Auckland, July 9. https://wp.comminfo.rutgers.edu/ckuhlthau/iasl_notes/.
  2. Kuhlthau, Carol C., Jannica Heinström, and Ross J. Todd. 2008. "The 'Information Search Process' Revisited: Is the Model Still Useful?" Information Research 13 (4): 355. https:// InformationR.net/ir/13-4/paper355.html.
  3. O'Leary, Daniel E. 2024. "Do ChatGPT 4o, 4, and 3.5 Generate 'Similar' Ratings? Findings and Implications." IEEE Intelligent Systems 39 (5): 78-81. https://doi.org/10.1109/MIS .2024.3441136. · doi:10.1109/mis.2024.3441136
  4. Vaswani, Ashish, Noam M. Shazeer, Niki Parmar, et al. 2017. "Attention Is All You Need." In Advances in Neural Information Processing Systems 30 (NIPS 2017), edited by I.

Cited by

See all 9

Metadata

Authors
Ravuri, B., & Mardis, M. A.
Venue
Library Trends
Publisher
Project MUSE
Published
2025-02
Volume
73
Issue
3
Pages
267-296
ISSN
  • 0024-2594 (ISSN-L)
  • 1559-0682
OpenAlex
W4410829856
Cited by
9
References
58
Citations by year
2026: 8 · 2025: 1
FWCI
4.62
Type
journal article
Language
en
Open access
Locations
Library trends (publishedVersion, cc-by-nc-nd)
Topics
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Social Sciences › Library and Information Sciences › Library Science and Information Literacy
  • Social Sciences › Library and Information Sciences › Web and Library Services
Keywords
Kuhlthau's Information Search Process, information seeking, chatbots, virtual reference services, prompt engineering, large language models, generative AI agents, clarification questions, librarian-patron interaction, information needs, information gathering

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-18, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: AI on the Shoulders of Giants: Using Kuhlthau’s Information Search Process to Improve AI Support for Information-Seeking. https://app.cochat.ai/papers/10.1353/lib.2025.a961195
The paper
Ravuri, B., & Mardis, M. A. (2025). AI on the Shoulders of Giants: Using Kuhlthau’s Information Search Process to Improve AI Support for Information-Seeking. Library Trends. https://doi.org/10.1353/lib.2025.a961195

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.