The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index; 3 of the 7 sources its claims cite were checked for support.
A Survey on Student Use of Generative AI Chatbots for Academic Research
Open accessAbstract
Objectives – To understand how many undergraduate and graduate students use generative AI as part of their academic work, how often they use it, and for what tasks they use it. We also sought to identify how trustworthy students find generative AI and how they would feel about a locally maintained generative AI tool. Finally, we explored student interest in trainings related to using generative AI in academic work. This survey will help librarians better understand the rate at which generative AI is being adopted by university students and the need for librarians to incorporate generative AI into their work. Methods – A team of three library staff members and one student intern created, executed, and analyzed a survey of 360 undergraduate and graduate students at Harvard University. The survey was distributed via email lists and at cafes and libraries throughout campus. Data were collected and analyzed using Qualtrics. Results – We found that nearly 65% of respondents have used or plan to use generative AI chatbots for academic work, even though most respondents (65%) do not find their outputs trustworthy enough for academic work. The findings show that students actively use these tools but desire guidance around effectively using them. Conclusion – This research shows students are engaging with generative AI for academic work but do not fully trust the information that it produces. Librarians must be at the forefront of understanding the significant impact this technology will have on information-seeking behaviors and research habits. To effectively support students, librarians must know how to use these tools to advise students on how to critically evaluate AI output and effectively incorporate it into their research.
Overview
CoChat Summary
TL;DR
A survey of 360 Harvard undergraduate and graduate students found that about 64–65% had used or planned to use generative AI chatbots for academic work, even though most distrusted their outputs for academic use. Students wanted guidance on incorporating AI, prompt creation, and how the tools work, and they reported higher trust in a locally maintained AI tool.
Key findings
- Around 64% of respondents had used or planned to use generative AI for academic work; 10% were unsure and 26% said they would not use it. ChatGPT dominated use at 81.18%, and the most common frequency was “occasionally” (39.59%).
- Non-users’ top reasons were “Using AI chatbots feels like plagiarism” (63.6%) and “Using AI chatbots undermines my learning” (59.6%). Among all participants, concerns included factually incorrect information (88.6%), unclear sources (83.1%), and privacy (61.1%).
- Trust was low: about 59% disagreed that AI chatbots are trustworthy enough for academic work, about 66% disagreed that their generated information is trustworthy enough, and about 83% disagreed they could use outputs with minimal editing.
- Students reported higher trust and likely use for a locally maintained AI tool: 68.18% said they would find it generally trustworthy, compared with 58.56% who found broader generative AI tools generally untrustworthy; 67.2% said they would use it, versus the current 65%. Guidance was strongly desired: 74.3% wanted help incorporating AI chatbots into academic work, 72.8% wanted prompt-creation guidance, and 64.7% wanted information on how AI chatbots work.
Methods
- A team of three library staff members and one student intern created and analyzed a survey of 360 undergraduate and graduate students at Harvard University, after IRB approval in August 2023 and a pilot survey. Recruitment used convenience sampling via listserv announcements and tabling at campus locations; the anonymous online survey ran from October 16 to November 6, 2023, and data were collected and analyzed in Qualtrics.
- The survey included closed- and open-ended questions, a screening question, four demographic questions, and branching logic for three paths: no/never use, have used/will use, and unsure. All questions were optional.
- Open-ended responses were inductively coded with thematic codes and interrater reliability meetings; descriptive statistics examined frequencies, and Qualtrics Crosstabs used chi-square tests to identify statistically significant differences between undergraduate and graduate students, with p < 0.05.
Limitations
- The paper states that convenience sampling was used, that respondents were most likely to respond if they used or had strong feelings about generative AI, and that they are therefore not representative of the overall student population.
- The paper notes that at publication the institution had initial guidelines but no official University-wide policy on student generative AI use, and that different institutions will have different adoption rates based on local factors.
- The paper states the survey gives a general look at undergraduate and graduate students and that adoption and attitudes may vary by academic discipline and school; the text also makes evident that findings are self-reported, from a single institution, and based on optional survey questions.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Valid · 2 Not valid · 4 Not checked · 58 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“There has been little research in the library field on how students use generative AI for academic work as it relates to libraries.”
What the sources say
- Could not verifycites Gasparini and Kautonen (2022) sourceExperimental — accuracy not yet measured
Our copy of the 2022 review (literature screened July and October 2020, 126 papers, Section 2 and 3.1) contains no mention of generative AI; its search phrases were limited to 'artificial intelligence' and 'machine learning' combined with academic/university/research libraries. The only gaps it identifies are the underused designerly approaches (Section 4.2, p. n.) and 'few suggestions for strategic or managerial approaches for libraries' (Section 4.3, Limitations), not a scarcity of research on how students use generative AI for academic work. Section 3.3 (Role of the user) does code user roles (e.g., U-6 consumer of AI services, 12/126; U-7 beneficiary in knowledge creation, 8/126) but never claims the student-use-of-generative-AI literature is thin. Searched: 'generative AI / generative adversarial / ChatGPT', 'little research on how students use AI', 'few studies gap research agenda'. (LLM, conf=0.72)
- Not checked — no full text of the sourcecites Hervieux and Wheatley (2021) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Around 59% of respondents disagreed that AI chatbots are trustworthy enough to use as part of completing academic work”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The source of information produced by AI chatbots is unclear: 83.1%”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Significantly more of the students who do not use or do not plan to use generative AI are undergraduates (p-value 0.02373).”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and as something that undermines their learning (p = 0.01934).”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
37 more claims
Create a free account to see all 66 claims and every source verdict.
- Probably not a substantial claim. 9
- The quote only partly states this claim. 2
- It may state two separate claims as one. 17
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“There were 183 (50.2% of total) undergraduate student participants and 181 graduate student participants (48.8% of total).”
Reported 48.8 · recomputed 50.277778
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| Yes, I plan to use them. | 28.57% | 6 | 71.43% | 15 | 5.50% | 21 |”
Reported 5.5 · recomputed 5.833333
Citations
Cites
Students' voices on generative ai: perceptions, benefits, and challenges in higher education
Chan, C. K. Y., & Hu, W. (2023) · arXiv · doi:10.48550/arxiv.2305.00290 · Cited by 2,504
Students’ voices on generative AI: perceptions, benefits, and challenges in higher education
Chan, C. K. Y., & Hu, W. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00411-8 · Cited by 2,301
Exploring the impact of artificial intelligence on teaching and learning in higher education
Popenici, S. A. D., & Kerr, S. (2017) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-017-0062-8 · Cited by 2,019
Artificial intelligence in higher education: the state of the field
Crompton, H., & Burke, D. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00392-8 · Cited by 2,010
Chatting about ChatGPT: how may AI and GPT impact academia and libraries?
Lund, B. D., & Wang, T. (2023) · Library Hi Tech News · doi:10.1108/lhtn-01-2023-0009 · Cited by 1,355
Ethical principles for artificial intelligence in education
Nguyen, A., Ngo, H. N., Hong, Y., Dang, B., & Nguyen, B.-P. T. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11316-w · Cited by 1,228
ChatGPT in education: Strategies for responsible implementation
Halaweh, M. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13036 · Cited by 607
Exploring Students’ Perceptions of ChatGPT: Thematic Analysis and Follow-Up Survey
Shoufan, A. (2023) · IEEE Access · doi:10.1109/access.2023.3268224 · Cited by 499
Generative Artificial Intelligence: Implications and Considerations for Higher Education Practice
Farrelly, T., & Baker, N. (2023) · Education Sciences · doi:10.3390/educsci13111109 · Cited by 414
Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?
Wang, S., Scells, H., Koopman, B., & Zuccon, G. (2023) · Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3539618.3591703 · Cited by 275
Bonsu, E. M., & Baffour-Koduah, D. (2023) · Journal of Education Society & Multiculturalism · doi:10.2478/jesm-2023-0001 · Cited by 231
Artificial intelligence in academic libraries: An environmental scan
Wheatley, A., & Hervieux, S. (2019) · Information Services and Use · doi:10.3233/isu-190065 · Cited by 222
Educational Applications of the ChatGPT AI System: A Systematic Review Research
İpek, Z. H., Gözüm, A. İ. C., Papadakis, S., & Kallogiannakis, M. (2023) · Educational Process International Journal · doi:10.22521/edupij.2023.123.2 · Cited by 201
Challenges for Higher Education in the Era of Widespread Access to Generative AI
Walczak, K., & Cellary, W. (2023) · Economics and Business Review · doi:10.18559/ebr.2023.2.743 · Cited by 196
Learning with ChatGPT 3.5 as a more knowledgeable other: an autoethnographic study
Stojanov, A. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00404-7 · Cited by 169
The Role of Chatbots in Academic Libraries: An Experience-based Perspective
Kaushal, V., & Yadav, R. (2022) · Journal of the Australian Library and Information Association · doi:10.1080/24750158.2022.2106403 · Cited by 161
ChatGPT: Implications for academic libraries
Cox, C., & Tzoc, E. (2023) · College & Research Libraries News · doi:10.5860/crln.84.3.99 · Cited by 153
Hervieux, S., & Wheatley, A. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2020.102270 · Cited by 132
Understanding Artificial Intelligence in Research Libraries – Extensive Literature Review
Gasparini, A., & Kautonen, H. (2022) · LIBER Quarterly: The Journal of the Association of European Research Libraries · doi:10.53377/lq.10934 · Cited by 86
Arlitsch, K., & Newell, B. D. (2017) · Journal of Library Administration · doi:10.1080/01930826.2017.1362912 · Cited by 83
Fourie, I., & Meyer, A. (2015) · Library Hi Tech · doi:10.1108/lht-09-2015-0092 · Cited by 69
Zhu, G., Fan, X., Hou, C., Zhong, T., Seow, P., Chen, S. A., Rajalingam, P., Low, K. Y., & Poh, T. L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.18616 · Cited by 69
Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?
Wang, S., Scells, H., Koopman, B., & Zuccon, G. (2023) · arXiv · doi:10.48550/arxiv.2302.03495 · Cited by 40
ChatGPT conundrums: Probing plagiarism and parroting problems in higher education practices
Teel, Z. A., Wang, T., & Lund, B. D. (2023) · College & Research Libraries News · doi:10.5860/crln.84.6.205 · Cited by 31
Sudirman, I. D., & Rahmatillah, I. (2023) · IEEE World AI IoT Congress (AIIoT) · doi:10.1109/aiiot58121.2023.10174472 · Cited by 17
My new favorite research partner is an AI: What roles can librarians play in the future?
Lo, L. S. (2023) · College & Research Libraries News · doi:10.5860/crln.84.6.209 · Cited by 11
Cited by
Heilala, V., Araya, R., & Hämäläinen, R. (2025) · ACM Symposium on Applied Computing · doi:10.1145/3672608.3707764 · Cited by 68
Morell‐Mengual, V., Fernández‐García, O., Berenguer, C., Ortega-Barón, J., Gil‐Llario, M. D., & Estruch‐García, V. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13650-1 · Cited by 65
“Chatbots are increasingly used by students to synthesize large amounts of information into concise summaries, saving time in the research process (Deschenes & McMahon, 2024 ).”
Generative AI Integration in Leadership Practice: Foundations, Challenges, and Opportunities
Tabata, M., Wildermuth, C. D. M. E. S., Bottomley, K., & Jenkins, D. M. (2025) · Journal of Leadership Studies · doi:10.1002/jls.70005 · Cited by 44
Falling Behind and Getting Ahead: Student Use of Generative AI in Education
Kuzminov, Y. I., Kruchinskaia, E. V., Gruzdev, I., & Naumov, A. (2025) · Высшее образование в России · doi:10.31992/0869-3617-2025-34-6-9-35 · Cited by 40
Baldrich, K., Pérez-García, C., & Santamarina-Sancho, M. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1701238 · Cited by 17
Metadata
- Authors
- Deschenes, A., & McMahon, M.
- Affiliations
- Harvard University (US)
- Venue
- Evidence Based Library and Information Practice
- Publisher
- University of Alberta Libraries
- Published
- 2024-06-14
- Volume
- 19
- Issue
- 2
- Pages
- 2-22
- ISSN
- 1715-720X (ISSN-L)
- OpenAlex
- W4399665471
- Cited by
- 49
- References
- 24
- Citations by year
- 2026: 19 · 2025: 29 · 2024: 1
- FWCI
- 58.55
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Evidence Based Library and Information Practice (publishedVersion, cc-by-nc-sa)
- Érudit (Université de Montréal) (submittedVersion, cc-by-nc-sa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Library and Information Sciences › Library Science and Information Literacy
- Social Sciences › Education › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- generative AI, chatbots, academic research, student use of AI, trust in AI outputs, information seeking, research habits, librarian support, AI training for students, critical evaluation of AI outputs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.