The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: A systematic review
Open accessThe DOI matches its Crossref record; 115 of the 115 references it cites were found in a registry or an index.
Abstract
The growing integration of artificial intelligence (AI) dialogue systems within educational and research settings highlights the importance of learning aids. Despite examination of the ethical concerns associated with these technologies, there is a noticeable gap in investigations on how these ethical issues of AI contribute to students’ over-reliance on AI dialogue systems, and how such over-reliance affects students’ cognitive abilities. Overreliance on AI occurs when users accept AI-generated recommendations without question, leading to errors in task performance in the context of decision-making. This typically arises when individuals struggle to assess the reliability of AI or how much trust to place in its suggestions. This systematic review investigates how students’ over-reliance on AI dialogue systems, particularly those embedded with generative models for academic research and learning, affects their critical cognitive capabilities including decision-making, critical thinking, and analytical reasoning. By using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, our systematic review evaluated a body of literature addressing the contributing factors and effects of such over-reliance within educational and research contexts. The comprehensive literature review spanned 14 articles retrieved from four distinguished databases: ProQuest, IEEE Xplore, ScienceDirect, and Web of Science. Our findings indicate that over-reliance stemming from ethical issues of AI impacts cognitive abilities, as individuals increasingly favor fast and optimal solutions over slow ones constrained by practicality. This tendency explains why users prefer efficient cognitive shortcuts, or heuristics, even amidst the ethical issues presented by AI technologies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Uncritical acceptance of AI outputs may inhibit self-regulation and weaken higher-order reasoning [17,18,34].”
From A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some studies empirically demonstrated that generative AI tools could harm learning, through mechanisms such as overreliance (Zhai et al., 2024).”
From Towards the Pedagogical Steering of Large Language Models for Tutoring: A Case Study with Modeling Productive Failure (2025) · cites this paper as Zhai et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Along these lines, undergraduate learners who interacted frequently with generative-AI-powered chatbots for acquiring academic domain-specific knowledge reported lower learning autonomy relative to students who had infrequent chatbot interactions[9].”
From Distinguishing performance gains from learning when using generative AI (2025) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Excessive reliance on AI tools may yield short-term academic success while masking persistent deficits in language competence (Zhai et al., 2024).”
From Perceptions vs. practices: academic integrity and actual ChatGPT use among EFL students (2026) · cites this paper as Zhai et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Memory retention and autonomous problem-solving face particular risks when students adopt AI as answer-provider rather than thinking partner (Gerlich, 2025; Krsmanović and Deek, 2025; Zhai et al., 2024).”
From Reimagining writing assessment for the AI era: a systematic review on balancing AI support and authentic skill growth (2026) · cites this paper as Zhai et al., 2024
Experimental — accuracy not yet measured
40 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Ahmad, S. F., Han, H., Alam, M. M., Rehmat, M. K., Irshad, M., Arraño-Muñoz, M., & Ariza-Montes, A. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-01787-8 · Cited by 338
RetractedVaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Machine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842 · cited 7×
“According to Carvalho et al. (2019), such transparency is pivotal for enhancing understanding of AI dialogue systems, laying a solid foundation for the challenges and advantages of algorithmic decisions, and ensuring that decision-making processes are both accountable and fair.”
BackgroundInfluentialBenefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
Lee, P., Bubeck, S., & Petro, J. (2023) · New England Journal of Medicine · doi:10.1056/nejmsr2214184 · Cited by 1,738
The role of prefrontal cortex in cognitive control and executive function
Friedman, N. P., & Robbins, T. W. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01132-0 · Cited by 1,737 · cited 1×
“…for academic rigor and avoiding laziness, suggesting that disengagement from challenging cognitive tasks could potentially weaken activities in key neural regions: the ventromedial prefrontal cortex (vmPFC) and the amygdala and prefrontal cortex (PFC) and the hippocampus (Friedman & Robbins, 2022).”
BackgroundGenerative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
Lim, W. M., Gunasekara, A., Pallant, J. L., Pallant, J. I., & Pechenkina, E. (2023) · The International Journal of Management Education · doi:10.1016/j.ijme.2023.100790 · Cited by 1,261
Buçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124 · cited 1×
“Students can inadvertently become overly dependent on AI-generated assistance, potentially detracting from their ability to make independent, well-informed decisions (Buçinca et al., 2021).”
Background
Research works printed but not linked: 7
- Alrazaq, A., AlSaad, R., Alhuwail, D., Ahmed, A., Healy, P. M., Latifi, S., Aziz, S., Damseh, R., Alrazak, S. A., & Sheikh, J. (2023). Large language models in medical education: Opportunities, challenges, and future directions. JMIR Medical Education, 9(1), e48291. https://doi.org/10.2196/48291 · DOI · Paper page
- Ersoy, E., & Baser, N. (2012). Critical thinking trends of primary education second level students. Journal of Education and Training Research, 1(3), 113–122.
- Francke, E., & Bennett, A. (2019). The potential influence of artificial intelligence on plagiarism: A higher education perspective. In European conference on the impact of artificial intelligence and robotics (ECIAIR 2019).
- Kim, Y., Lee, M., Kim, D., & Lee, S.-J. (2023). Towards explainable ai writing assistants for non-native english speakers. arXiv preprint arXiv:2304.02625. · arXiv
- Macdonald, M. E., Siedlikowski, S., Liu, K., & Carnevale, F. A. (2023). Introducing sammsa, a five-step method for producing ‘quality’ qualitative analysis. Qualitative Health Research, 33(4), 334–344. https://doi.org/10.1177/104973232311544 · doi:10.1177/104973232311544
- Scatiggio, V. (2022). Tackling the issue of bias in artificial intelligence to design ai-driven fair and inclusive service systems. How human biases are breaching into ai algorithms, with severe impacts on individuals and societies, and what designers can do to face this phenomenon and change for the better. https://hdl.handle.net/10589/186118
- Wach, K., Duong, C. D., Ejdys, J., Kazlauskaitė, R., Korzynski, P., Mazurek, G., Paliszkiewicz, J., & Ziemba, E. (2023). The dark side of generative artificial intelligence: A critical analysis of controversies and risks of chatgpt. Entrepreneurial Business and Economics Review, 11(2), 7–30. https://doi.org/10.21541/apjess.1293702 · DOI · Paper page
Cited by
AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking
Gerlich, M. (2025) · Societies · doi:10.3390/soc15010006 · Cited by 1,248
“Zhai et al. [25] found that students who heavily relied on AI dialogue systems exhibited diminished decision-making and critical analysis abilities, as these systems allowed them to offload essential cognitive tasks.”
AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking
Gerlich, M. (2025) · doi:10.2139/ssrn.5082524 · Cited by 1,238
AI‐driven adaptive learning for sustainable educational transformation
Strielkowski, W., Grebennikova, V., Lisovskiy, A., Rakhimova, G., & Vasileva, T. (2025) · Sustainable Development · doi:10.1002/sd.3221 · Cited by 581
Higher education students’ perceptions of ChatGPT: A global study of early reactions
Ravšelj, D., Keržič, D., Tomaževič, N., Umek, L., Brezovar, N., A. Iahad, N., Abdulla, A. A., Akopyan, A., Aldana Segura, M. W., AlHumaid, J., et al. (2025) · PLOS ONE · doi:10.1371/journal.pone.0315011 · Cited by 376
Lin, H., & Chen, Q. (2024) · BMC Psychology · doi:10.1186/s40359-024-01979-0 · Cited by 269
Metadata
- Authors
- Zhai, C., Wibowo, S., & Li, L. D.
- Affiliations
- Central Queensland University (AU)
- Corresponding author
- Zhai, Chunpeng
- Venue
- Smart Learning Environments
- Published
- 2024-06-18
- Volume
- 11
- Issue
- 1
- ISSN
- 2196-7091 (ISSN-L)
- OpenAlex
- W4399790131
- Cited by
- 1,567
- References
- 111
- Citations by year
- 2026: 953 · 2025: 567 · 2024: 46
- FWCI
- 90.27
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Smart Learning Environments (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- overreliance on AI, generative AI, critical thinking, analytical thinking, decision-making, heuristics, cognitive shortcuts, trust in AI, AI ethics in education, academic research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: A systematic review. https://app.cochat.ai/papers/10.1186/s40561-024-00316-7
- The paper
- Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: A systematic review. Smart Learning Environments. https://doi.org/10.1186/s40561-024-00316-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.