The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: A systematic review
Open accessThe DOI matches its Crossref record; 115 of the 115 references it cites were found in a registry or an index.
Abstract
The growing integration of artificial intelligence (AI) dialogue systems within educational and research settings highlights the importance of learning aids. Despite examination of the ethical concerns associated with these technologies, there is a noticeable gap in investigations on how these ethical issues of AI contribute to students’ over-reliance on AI dialogue systems, and how such over-reliance affects students’ cognitive abilities. Overreliance on AI occurs when users accept AI-generated recommendations without question, leading to errors in task performance in the context of decision-making. This typically arises when individuals struggle to assess the reliability of AI or how much trust to place in its suggestions. This systematic review investigates how students’ over-reliance on AI dialogue systems, particularly those embedded with generative models for academic research and learning, affects their critical cognitive capabilities including decision-making, critical thinking, and analytical reasoning. By using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, our systematic review evaluated a body of literature addressing the contributing factors and effects of such over-reliance within educational and research contexts. The comprehensive literature review spanned 14 articles retrieved from four distinguished databases: ProQuest, IEEE Xplore, ScienceDirect, and Web of Science. Our findings indicate that over-reliance stemming from ethical issues of AI impacts cognitive abilities, as individuals increasingly favor fast and optimal solutions over slow ones constrained by practicality. This tendency explains why users prefer efficient cognitive shortcuts, or heuristics, even amidst the ethical issues presented by AI technologies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Uncritical acceptance of AI outputs may inhibit self-regulation and weaken higher-order reasoning [17,18,34].”
From A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some studies empirically demonstrated that generative AI tools could harm learning, through mechanisms such as overreliance (Zhai et al., 2024).”
From Towards the Pedagogical Steering of Large Language Models for Tutoring: A Case Study with Modeling Productive Failure (2025) · cites this paper as Zhai et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Along these lines, undergraduate learners who interacted frequently with generative-AI-powered chatbots for acquiring academic domain-specific knowledge reported lower learning autonomy relative to students who had infrequent chatbot interactions[9].”
From Distinguishing performance gains from learning when using generative AI (2025) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Excessive reliance on AI tools may yield short-term academic success while masking persistent deficits in language competence (Zhai et al., 2024).”
From Perceptions vs. practices: academic integrity and actual ChatGPT use among EFL students (2026) · cites this paper as Zhai et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Memory retention and autonomous problem-solving face particular risks when students adopt AI as answer-provider rather than thinking partner (Gerlich, 2025; Krsmanović and Deek, 2025; Zhai et al., 2024).”
From Reimagining writing assessment for the AI era: a systematic review on balancing AI support and authentic skill growth (2026) · cites this paper as Zhai et al., 2024
Experimental — accuracy not yet measured
40 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Ahmad, S. F., Han, H., Alam, M. M., Rehmat, M. K., Irshad, M., Arraño-Muñoz, M., & Ariza-Montes, A. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-01787-8 · Cited by 338
RetractedVaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Machine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842 · cited 7×
“According to Carvalho et al. (2019), such transparency is pivotal for enhancing understanding of AI dialogue systems, laying a solid foundation for the challenges and advantages of algorithmic decisions, and ensuring that decision-making processes are both accountable and fair.”
BackgroundInfluentialBenefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
Lee, P., Bubeck, S., & Petro, J. (2023) · New England Journal of Medicine · doi:10.1056/nejmsr2214184 · Cited by 1,738
The role of prefrontal cortex in cognitive control and executive function
Friedman, N. P., & Robbins, T. W. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01132-0 · Cited by 1,737 · cited 1×
“…for academic rigor and avoiding laziness, suggesting that disengagement from challenging cognitive tasks could potentially weaken activities in key neural regions: the ventromedial prefrontal cortex (vmPFC) and the amygdala and prefrontal cortex (PFC) and the hippocampus (Friedman & Robbins, 2022).”
BackgroundGenerative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
Lim, W. M., Gunasekara, A., Pallant, J. L., Pallant, J. I., & Pechenkina, E. (2023) · The International Journal of Management Education · doi:10.1016/j.ijme.2023.100790 · Cited by 1,261
Buçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124 · cited 1×
“Students can inadvertently become overly dependent on AI-generated assistance, potentially detracting from their ability to make independent, well-informed decisions (Buçinca et al., 2021).”
BackgroundHow to properly use the PRISMA Statement
Sarkis-Onofre, R., Catalá-López, F., Aromataris, E., & Lockwood, C. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01671-z · Cited by 1,104 · cited 1×
“This protocol includes a 27-item checklist and a four-phase flow diagram, offering a structured approach to ensuring the quality and comprehensiveness of the review (Sarkis-Onofre et al., 2021).”
MethodGao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2022) · doi:10.1101/2022.12.23.521610 · Cited by 1,099 · cited 11×
“Ethical concerns have been raised regarding the potential for AI hallucinations (Gao et al., 2022), algorithmic bias (Alrazaq et al., 2023), plagiarism (De Angelis et al., 2023), privacy issues (Dempere et al., 2023), transparency concerns (Dergaa et al., 2023), and over-reliance (Koos & Wachsmann,…”
BackgroundMethodInfluentialGao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00819-6 · Cited by 1,099
Grassini, S. (2023) · Education Sciences · doi:10.3390/educsci13070692 · Cited by 1,048 · cited 6×
“Grassini (2023) identified that algorithmic biases are frequently a result of AI systems being trained on datasets with inherent prejudices, causing users to regard these biased outputs as objective mis-takenly.”
BackgroundInfluentialHiser, J., & Koenigs, M. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.10.030 · Cited by 972
Critical Thinking and Education
McPeck, J. E. (2016) · Routledge eBooks · doi:10.4324/9781315463698 · Cited by 854
Dergaa, I., Chamari, K., Zmijewski, P., & Ben Saad, H. (2023) · Biology of Sport · doi:10.5114/biolsport.2023.125623 · Cited by 796
Algorithmic bias: review, synthesis, and future research directions
Kordzadeh, N., & Ghasemaghaei, M. (2022) · European Journal of Information Systems · doi:10.1080/0960085x.2021.1927212 · Cited by 770 · cited 1×
“Remarkably, even when explicit sensitive attributes are omitted from the input, a proficient machine-learning algorithm might still act upon these attributes due to underlying correlations in the data (Kordzadeh & Ghasemaghaei, 2022).”
BackgroundLarge Language Models in Medical Education: Opportunities, Challenges, and Future Directions
Abd-alrazaq, A., AlSaad, R., Alhuwail, D., Ahmed, A., Healy, P. M., Latifi, S., Aziz, S., Damseh, R., Alabed Alrazak, S., & Sheikh, J. (2023) · JMIR Medical Education · doi:10.2196/48291 · Cited by 722
ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health
De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1166120 · Cited by 708
Towards a standard for identifying and managing bias in artificial intelligence
Schwartz, R., Vassilev, A., Greene, K., Perine, L., Burt, A., & Hall, P. (2022) · doi:10.6028/nist.sp.1270 · Cited by 548 · cited 1×
“These facets include societal, population, representative, aggregation, feedback, and reuse biases throughout the machine-learning lifecycle (Schwartz et al., 2022).”
BackgroundMarzuki, Widiati, U., Rusdin, D., Darwin, & Indrawati, I. (2023) · Cogent Education · doi:10.1080/2331186x.2023.2236469 · Cited by 524 · cited 3×
“Other studies revealed that regular utilization of dialogue systems is linked to a decline in abilities of cognitive abilities, a diminished capacity for information retention, and an increased reliance on these systems for information (Dergaa et al., 2023; Marzuki et al., 2023).”
BackgroundThe impact of ChatGPT on higher education
Dempere, J., Modugu, K., Hesham, A., & Ramasamy, L. K. (2023) · Frontiers in Education · doi:10.3389/feduc.2023.1206936 · Cited by 519 · cited 4×
“Ethical concerns include generating false information (hallucination) (Gao et al., 2022), algorithmic bias (Alrazaq et al., 2023), plagiarism (De Angelis et al., 2023), privacy concerns (Dempere et al., 2023) and transparency concerns (Dergaa et al., 2023).”
BackgroundInfluentialImpact of the Implementation of ChatGPT in Education: A Systematic Review
Montenegro-Rueda, M., Fernández-Cerero, J., Fernández-Batanero, J. M., & López-Meneses, E. (2023) · Computers · doi:10.3390/computers12080153 · Cited by 509 · cited 2×
“This section aligns with the systematic review guidelines recommended by Montenegro-Rueda et al. (2023), offering insights into over-reliance on AI systems for essential cognitive abilities like decision-making, critical thinking, and analytical thinking in research and education.”
BackgroundMethodManaging the Strategic Transformation of Higher Education through Artificial Intelligence
George, B., & Wooden, O. (2023) · Administrative Sciences · doi:10.3390/admsci13090196 · Cited by 508
Transparency in artificial intelligence
Larsson, S., & Heintz, F. (2020) · Internet Policy Review · doi:10.14763/2020.2.1469 · Cited by 458
Exploring Artificial Intelligence in Academic Essay: Higher Education Student's Perspective
Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., Darwis, A., & Marzuki (2023) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2023.100296 · Cited by 418
Köbis, N., & Mossink, L. D. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106553 · Cited by 406 · cited 1×
“Additionally, the ever-dreaded ‘writer’s block’ poses a formidable obstacle, affecting both novice and experienced writers, including students and educators (Köbis & Mossink, 2021).”
BackgroundAthaluri, S. A., Manthena, S. V., Kesapragada, V. S. R. K. M., Yarlagadda, V., Dave, T., & Duddumpudi, R. T. S. (2023) · Cureus · doi:10.7759/cureus.37432 · Cited by 403
ChatGPT for Education and Research: A Review of Benefits and Risks
Sok, S., & Heng, K. (2023) · doi:10.2139/ssrn.4378735 · Cited by 386
ChatGPT for education and research: A review of benefits and risks
Sok, S., & Heng, K. (2023) · Cambodian Journal of Educational Research · doi:10.62037/cjer.2023.03.01.06 · Cited by 382
Will ChatGPT get you caught? Rethinking of Plagiarism DetectionPreprint
Khalil, M., & Er, E. (2023) · Interacción · doi:10.48550/arxiv.2302.04335 · Cited by 369
Decision making with visualizations: a cognitive framework across disciplines
Padilla, L. M., Creem-Regehr, S. H., Hegarty, M., & Stefanucci, J. K. (2018) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-018-0120-9 · Cited by 336
Unveiling security, privacy, and ethical concerns of ChatGPT
Wu, X., Duan, R., & Ni, J. (2024) · Journal of Information and Intelligence · doi:10.1016/j.jiixd.2023.10.007 · Cited by 314
Is ChatGPT Leading Generative AI? What is Beyond Expectations?
AYDIN, Ö., & KARAARSLAN, E. (2023) · Academic Platform Journal of Engineering and Smart Systems · doi:10.21541/apjess.1293702 · Cited by 311
DESCRIPTIVE, NORMATIVE, AND PRESCRIPTIVE INTERACTIONS IN DECISION MAKING
Bell, D. E., Raiffa, H., & Tversky, A. (1988) · Decision Making · doi:10.1017/cbo9780511598951.003 · Cited by 301
Plagiarism in the age of massive generative pre-trained transformers (GPT-3)
Dehouche, N. (2021) · Ethics in Science and Environmental Politics · doi:10.3354/esep00195 · Cited by 296
Externalizing the critical thinking in knowledge development and clinical judgment
Facione, N. C., & Facione, P. A. (1996) · Nursing Outlook · doi:10.1016/s0029-6554(06)80005-9 · Cited by 291
Using AI to write scholarly publications
Hosseini, M., Rasmussen, L. M., & Resnik, D. B. (2024) · Accountability in Research · doi:10.1080/08989621.2023.2168535 · Cited by 286 · cited 1×
“…AI hallucinations, plagiarism, lack of transparency, and algorithmic biases, there arises a critical concern that over-reliance on AI dialogue systems’ decision-making capabilities might potentially impede the cultivation of critical thinking skills (Carobene et al., 2023; Hosseini et al., 2023).”
BackgroundDimensional Analysis: Broadening the Conception of Grounded Theory
Kools, S., McCarthy, M., Durham, R., & Robrecht, L. (1996) · Qualitative Health Research · doi:10.1177/104973239600600302 · Cited by 285
Academic integrity and artificial intelligence: is ChatGPT hype, hero or heresy?
Currie, G. M. (2023) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2023.04.008 · Cited by 283
AI pitfalls and what not to do: mitigating bias in AI
Gichoya, J. W., Thomas, K., Celi, L. A., Safdar, N., Banerjee, I., Banja, J. D., Seyyed-Kalantari, L., Trivedi, H., & Purkayastha, S. (2023) · The British Journal of Radiology · doi:10.1259/bjr.20230023 · Cited by 277 · cited 2×
“Gichoya et al. (2023) argue that AI systems, trained on extensive data-sets sourced from the internet, inherently mirror societal biases.”
BackgroundZhai, C., & Wibowo, S. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100134 · Cited by 261
Self-citationHoly or Unholy? Interview with Open AI’s ChatGPT
Iskender, A. (2023) · European Journal of Tourism Research · doi:10.54055/ejtr.v34i.3169 · Cited by 260
Leveraging ChatGPT for Enhancing Critical Thinking Skills
Guo, Y., & Lee, D. (2023) · Journal of Chemical Education · doi:10.1021/acs.jchemed.3c00505 · Cited by 250 · cited 1×
“The overreliance on AI for information acquisition can negatively impact both critical thinking skills and dispositions (Guo & Lee, 2023).”
BackgroundLiu, C., Hou, J., Tu, Y.-F., Wang, Y., & Hwang, G.-J. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.2012812 · Cited by 231 · cited 1×
“However, there are concerns about the potential negative impact of its widespread use on cognitive abilities, particularly in academic writing (Liu et al., 2023).”
BackgroundCarobene, A., Padoan, A., Cabitza, F., Banfi, G., & Plebani, M. (2023) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2023-1136 · Cited by 219
Dalalah, D., & Dalalah, O. M. A. (2023) · The International Journal of Management Education · doi:10.1016/j.ijme.2023.100822 · Cited by 218
Bankins, S., Formosa, P., Griep, Y., & Richards, D. (2022) · Information Systems Frontiers · doi:10.1007/s10796-021-10223-8 · Cited by 215
Alawida, M., Mejri, S., Mehmood, A., Chikhaoui, B., & Isaac Abiodun, O. (2023) · Information · doi:10.3390/info14080462 · Cited by 210
Xie, Y., Wang, K., & Kong, Y. (2021) · Science and Engineering Ethics · doi:10.1007/s11948-021-00314-9 · Cited by 205 · cited 1×
“Xie et al. (2021) found that over-reliance on unverified AI outputs can cause misclassification and misinterpretation.”
BackgroundHow to cheat on your final paper: Assigning AI for student writing
Fyfe, P. (2023) · AI & SOCIETY · doi:10.1007/s00146-022-01397-z · Cited by 205
The Potential and Concerns of Using AI in Scientific Research: ChatGPT Performance Evaluation
Khlaif, Z. N., Mousa, A., Hattab, M. K., Itmazi, J., Hassan, A. A., Sanmugam, M., & Ayyoub, A. (2023) · JMIR Medical Education · doi:10.2196/47049 · Cited by 205 · cited 2×
“Reasons for AI hallucinations include data inconsist-encies in vast datasets, training inaccuracies during the encoding and decoding phases, and biased sequences (Khlaif et al., 2023).”
BackgroundEl Soufi, N., & See, B. H. (2019) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2018.12.006 · Cited by 183
Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks
Tolan, S., Pesole, A., Martínez-Plumed, F., Fernández-Macías, E., Hernández-Orallo, J., & Gómez, E. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12647 · Cited by 165
Gender bias perpetuation and mitigation in AI technologies: challenges and opportunities
O’Connor, S., & Liu, H. (2024) · AI & SOCIETY · doi:10.1007/s00146-023-01675-4 · Cited by 165
OpenAI ChatGPT-Generated Results: Similarity Index of Artificial Intelligence-Based Contents
Ventayen, R. J. M. (2023) · Advances in intelligent systems and computing · doi:10.1007/978-981-99-3608-3_15 · Cited by 157
On the Governance of Artificial Intelligence through Ethics Guidelines
LARSSON, S. (2020) · Asian Journal of Law and Society · doi:10.1017/als.2020.19 · Cited by 156 · cited 1×
“There is also a comprehensive review of 84 global ethical AI guidelines reveals that transparency (Larsson & Heintz, 2020), along with related concepts like explainability, interpretability, and disclosure, emerges as a predominant ethical principle, cited in 73 of these documents (Larsson, 2020).”
BackgroundThe dark side of artificial intelligence in service: The “watching-eye” effect and privacy concerns
Hu, Y., & Min, H. K. (2023) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2023.103437 · Cited by 155
ChatGPT: potential, prospects, and limitations
Zhou, J., Ke, P., Qiu, X., Huang, M., & Zhang, J. (2024) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2300089 · Cited by 153
Multiple time-scales of decision-making in the hippocampus and prefrontal cortex
Tang, W., Shin, J. D., & Jadhav, S. P. (2021) · eLife · doi:10.7554/elife.66227 · Cited by 149
Decision Making: a Theoretical Review
Morelli, M., Casagrande, M., & Forte, G. (2021) · Integrative Psychological and Behavioral Science · doi:10.1007/s12124-021-09669-x · Cited by 149
An Evaluative Review of Barriers to Critical Thinking in Educational and Real-World Settings
Dwyer, C. P. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11060105 · Cited by 148
Privacy and Artificial Intelligence
Curzon, J., Kosa, T. A., Akalu, R., & El‐Khatib, K. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3088084 · Cited by 147
Kronemann, B., Kizgin, H., Rana, N. P., & Dwivedi, Y. K. (2023) · Spanish Journal of Marketing - ESIC · doi:10.1108/sjme-10-2022-0213 · Cited by 147
Academic Integrity in Higher Education: Understanding and Addressing Plagiarism
Mulenga, R., & Shilongo, H. (2024) · Acta Pedagogia Asiana · doi:10.53623/apga.v3i1.337 · Cited by 129
The neuroscience of morality and social decision-making
Yoder, K. J., & Decety, J. (2017) · Psychology Crime and Law · doi:10.1080/1068316x.2017.1414817 · Cited by 127
Critical thinking, biases and dual processing: The enduring myth of generalisable skills
Monteiro, S., Sherbino, J., Sibbald, M., & Norman, G. R. (2019) · Medical Education · doi:10.1111/medu.13872 · Cited by 127
The neural system of metacognition accompanying decision-making in the prefrontal cortex
Qiu, L., Su, J., Ni, Y., Bai, Y., Zhang, X., Li, X., & Wan, X. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2004037 · Cited by 125 · cited 2×
“The decision-making abilities are influenced by the ventromedial prefrontal cortex (vmPFC) and the amygdala, highlighting the significant overlap between cognitive and emotional aspects of these processes (Ishikawa et al., 2020; Qiu et al., 2018; Tang et al., 2021).”
BackgroundOpenAI ChatGPT Generated Results: Similarity Index of Artificial Intelligence-Based Contents
Ventayen, R. J. M. (2023) · doi:10.2139/ssrn.4332664 · Cited by 123 · cited 1×
“It also highlights a critical issue regarding the lack of transparency in the algorithms that drive these plagiarism detection procedures (Ventayen, 2023).”
BackgroundThe limitations and ethical considerations of ChatGPT
Hua, S., Jin, S., & Jiang, S. (2024) · Data Intelligence · doi:10.1162/dint_a_00243 · Cited by 120 · cited 2×
“Issues such as the generation of inaccurate or misleading content, algorithmic biases, plagiarism, privacy breaches, and transparency concerns have not been adequately addressed (Hua et al., 2023).”
BackgroundWatts, F. M., Dood, A. J., Shultz, G. V., & Rodriguez, J.-M. G. (2023) · Journal of Chemical Education · doi:10.1021/acs.jchemed.3c00664 · Cited by 116
Grinschgl, S., & Neubauer, A. C. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.908261 · Cited by 107
Is ChatGPT a “fire of Prometheus” for non-native English-speaking researchers in academic writing?
Hwang, S. I., Lim, J. S., Lee, R. W., Matsui, Y., Iguchi, T., Hiraki, T., & Ahn, H. (2023) · Korean Journal of Radiology · doi:10.3348/kjr.2023.0773 · Cited by 107
Semrl, N., Feigl, S., Taumberger, N., Bracic, T., Fluhr, H., Blockeel, C., & Kollmann, M. (2023) · Human Reproduction · doi:10.1093/humrep/dead207 · Cited by 107
Feine, J., Gnewuch, U., Morana, S., & Maedche, A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-39540-7_6 · Cited by 99 · cited 1×
“Feine et al. (2020) argue that AI dialogue system designs frequently incorporate gender-specific indicators.”
BackgroundBlurry vision: Supply chain visibility for personal protective equipment during COVID-19
Finkenstadt, D. J., & Handfield, R. (2021) · Journal of Purchasing and Supply Management · doi:10.1016/j.pursup.2021.100689 · Cited by 89 · cited 1×
“Finkenstadt and Handfield (2021) introduced two types of transparency: the visibility and accessibility of information.”
BackgroundEffective human–AI work design for collaborative decision-making
Jain, R., Garg, N., & Khera, S. N. (2023) · Kybernetes · doi:10.1108/k-04-2022-0548 · Cited by 85
Santiago, C. S., Embang, S. I., Acanto, R. B., Ambojia, K. W. P., Aperocho, M. D. B., Balilo, B. B., Cahapin, E. L., Conlu, M. T. N., Lausa, S. M., Laput, E. Y., et al. (2023) · International Journal of Learning Teaching and Educational Research · doi:10.26803/ijlter.22.11.14 · Cited by 76
McKinley, J. (2013) · RELC Journal · doi:10.1177/0033688213488386 · Cited by 76
COVID-19, artificial intelligence, ethical challenges and policy implications
Anshari, M., Hamdan, M., Ahmad, N., Ali, E., & Haidi, H. (2023) · AI & SOCIETY · doi:10.1007/s00146-022-01471-6 · Cited by 67
Alkhatib, O. J. (2019) · Advances in Science and Engineering Technology International Conferences (ASET) · doi:10.1109/icaset.2019.8714232 · Cited by 62
Kaeppel, K. (2021) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2021.100809 · Cited by 62
ChatGPT and other AI Users: Innovative and Creative Utilitarian Value and Mindset Shift
Duhaylungsod, A. V., & Chavez, J. V. (2023) · Journal of Namibian Studies : History Politics Culture · doi:10.59670/jns.v33i.2791 · Cited by 59
Washington, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4538043 · Cited by 55
Liang, W. (2022) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2022.101203 · Cited by 53
Appropriate Reliance on Artificial Intelligence in Radiology Education
Li, M. D., & Little, B. P. (2023) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.04.019 · Cited by 52 · cited 1×
“Li and Little (2023) posit that individuals using AI dialogue systems, irrespective of their expertise level in the subject matter, are at risk of becoming overly reliant on them.”
BackgroundReview: Privacy-Preservation in the Context of Natural Language Processing
Mahendran, D., Luo, C., & McInnes, B. T. (2021) · IEEE Access · doi:10.1109/access.2021.3124163 · Cited by 51
Epistemically violent biases in artificial intelligence design: the case of DALLE-E 2 and Starry AI
Mbalaka, B. (2023) · Digital Transformation and Society · doi:10.1108/dts-01-2023-0003 · Cited by 49
Rodriguez, J.-M. G., & Towns, M. H. (2018) · Journal of Chemical Education · doi:10.1021/acs.jchemed.8b00683 · Cited by 46
Analytical reasoning reduces internet fraud susceptibility
Kelley, N. J., Hurley-Wallace, A. L., Warner, K. L., & Hanoch, Y. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107648 · Cited by 45
Koos, S., & Wachsmann, S. (2023) · Media Iuris · doi:10.20473/mi.v6i2.45270 · Cited by 35
Ishikawa, J., Sakurai, Y., Ishikawa, A., & Mitsushima, D. (2020) · Psychopharmacology · doi:10.1007/s00213-019-05398-7 · Cited by 34
ChatGPT and its impact on education
Pokkakillath, S., & Suleri, J. I. (2023) · Research in Hospitality Management · doi:10.1080/22243534.2023.2239579 · Cited by 34
Sabharwal, D., Kabha, R., & Srivastava, K. (2023) · Journal of Content Community and Communication · doi:10.31620/jccc.06.23/12 · Cited by 33
Chatbot Confabulations Are Not Hallucinations
Hatem, R., Simmons, B., & Thornton, J. E. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.4231 · Cited by 28
Exploring the Connection between Critical Thinking Skills and Academic Writing
Rahmat, N. H., Aripin, N., Lin, N. M., Whanchit, W., & Khairuddin, Z. (2020) · International Journal of Asian Social Science · doi:10.18488/journal.1.2020.102.118.128 · Cited by 26
A Survey of Published Literature on Conversational Artificial Intelligence
Song, X., & Xiong, T. (2021) · International Conference on Information Management · doi:10.1109/icim52229.2021.9417135 · Cited by 20
Users are the North Star for AI TransparencyPreprint
Mei, A., Saxon, M., Chang, S., Lipton, Z. C., & Wang, W. Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.05500 · Cited by 20
Detecting Common Sources of AI Bias: Questions to Ask When Procuring an AI Solution
Tejani, A. S., Retson, T., Moy, L. P., & Cook, T. S. (2023) · Radiology · doi:10.1148/radiol.230580 · Cited by 20
Ferrajão, P. C. (2020) · Journal of Family Trauma, Child Custody & Child Development · doi:10.1080/15379418.2020.1731399 · Cited by 14 · cited 1×
“This over-reliance could lead to a range of issues, including diminished critical thinking (Iskender, 2023), analytical thinking (Ferrajão, 2020), and decision-making abilities (Pokkakillath & Suleri, 2023) susceptibility to AI-generated errors or AI hallucinations (Hatem et al., 2023), increased…”
BackgroundA WGAN-Based Dialogue System for Embedding Humor, Empathy, and Cultural Aspects in Education
Zhai, C., & Wibowo, S. (2023) · IEEE Access · doi:10.1109/access.2023.3294966 · Cited by 13
Self-citationPolitanskyi, R., & Klymash, M. M. (2019) · IEEE International Conference on Advanced Information and Communication Technologies (AICT) · doi:10.1109/aiact.2019.8847908 · Cited by 12
Stromer‐Galley, J., Rossini, P., Kenski, K. M., McKernan, B., Clegg, B. A., Folkestad, J., Østerlund, C. S., Schooler, L. J., Boichak, O., Canzonetta, J., et al. (2020) · Intelligence & National Security · doi:10.1080/02684527.2020.1841466 · Cited by 12
A Multistakeholder Approach Towards Evaluating AI Transparency MechanismsPreprint
Lučić, A., Srikumar, M., Bhatt, U., Xiang, A., Taly, A., Liao, Q. V., & de Rijke, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.14976 · Cited by 12
Krullaars, Z. H., Januardani, A., Zhou, L., & Jonkers, E. (2023) · Gesellschaft für Informatik (GI) · doi:10.18420/muc2023-mci-src-415 · Cited by 8
Ethik der Online-Kommunikation
Beck, K. (2019) · Springer eBooks · doi:10.1007/978-3-658-18016-4_7 · Cited by 6
Lukač, D., & Lazareva, A. (2023) · EDULEARN proceedings · doi:10.21125/edulearn.2023.0343 · Cited by 5
Normative and descriptive theories of decision making under risk
Damnjanović, K., & Jankovic, I. (2014) · Theoria Beograd · doi:10.2298/theo1404025d · Cited by 4
On the Transparency of Artificial Intelligence System
Du, Y. (2022) · Journal of Autonomous Intelligence · doi:10.32629/jai.v5i1.486 · Cited by 4
Lymph node inspired computing: towards immune system inspired human-engineered complex systems
Banerjee, S. (2021) · Interdisciplinary Description of Complex Systems · doi:10.7906/indecs.19.4.4 · Cited by 3
Will Artificial Intelligence Lead to Genuine Stupidity? A Food for ThoughtPreprint
Ismail, A. R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4566781 · Cited by 3
Pressure upon the Faculty to Publish: Is it Really Necessary
Sharma, B. (2020) · SunText Review of Arts & Social Sciences · doi:10.51737/2766-4600.2020.001 · Cited by 2
The Method of Trisociation: Augmenting Creativity Using Generative AIPreprint
Eapen, T. T. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4603145 · Cited by 1
Research works printed but not linked: 7
- Alrazaq, A., AlSaad, R., Alhuwail, D., Ahmed, A., Healy, P. M., Latifi, S., Aziz, S., Damseh, R., Alrazak, S. A., & Sheikh, J. (2023). Large language models in medical education: Opportunities, challenges, and future directions. JMIR Medical Education, 9(1), e48291. https://doi.org/10.2196/48291 · DOI · Paper page
- Ersoy, E., & Baser, N. (2012). Critical thinking trends of primary education second level students. Journal of Education and Training Research, 1(3), 113–122.
- Francke, E., & Bennett, A. (2019). The potential influence of artificial intelligence on plagiarism: A higher education perspective. In European conference on the impact of artificial intelligence and robotics (ECIAIR 2019).
- Kim, Y., Lee, M., Kim, D., & Lee, S.-J. (2023). Towards explainable ai writing assistants for non-native english speakers. arXiv preprint arXiv:2304.02625. · arXiv
- Macdonald, M. E., Siedlikowski, S., Liu, K., & Carnevale, F. A. (2023). Introducing sammsa, a five-step method for producing ‘quality’ qualitative analysis. Qualitative Health Research, 33(4), 334–344. https://doi.org/10.1177/104973232311544 · doi:10.1177/104973232311544
- Scatiggio, V. (2022). Tackling the issue of bias in artificial intelligence to design ai-driven fair and inclusive service systems. How human biases are breaching into ai algorithms, with severe impacts on individuals and societies, and what designers can do to face this phenomenon and change for the better. https://hdl.handle.net/10589/186118
- Wach, K., Duong, C. D., Ejdys, J., Kazlauskaitė, R., Korzynski, P., Mazurek, G., Paliszkiewicz, J., & Ziemba, E. (2023). The dark side of generative artificial intelligence: A critical analysis of controversies and risks of chatgpt. Entrepreneurial Business and Economics Review, 11(2), 7–30. https://doi.org/10.21541/apjess.1293702 · DOI · Paper page
Cited by
AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking
Gerlich, M. (2025) · Societies · doi:10.3390/soc15010006 · Cited by 1,248
“Zhai et al. [25] found that students who heavily relied on AI dialogue systems exhibited diminished decision-making and critical analysis abilities, as these systems allowed them to offload essential cognitive tasks.”
AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking
Gerlich, M. (2025) · doi:10.2139/ssrn.5082524 · Cited by 1,238
AI‐driven adaptive learning for sustainable educational transformation
Strielkowski, W., Grebennikova, V., Lisovskiy, A., Rakhimova, G., & Vasileva, T. (2025) · Sustainable Development · doi:10.1002/sd.3221 · Cited by 581
Higher education students’ perceptions of ChatGPT: A global study of early reactions
Ravšelj, D., Keržič, D., Tomaževič, N., Umek, L., Brezovar, N., A. Iahad, N., Abdulla, A. A., Akopyan, A., Aldana Segura, M. W., AlHumaid, J., et al. (2025) · PLOS ONE · doi:10.1371/journal.pone.0315011 · Cited by 376
Lin, H., & Chen, Q. (2024) · BMC Psychology · doi:10.1186/s40359-024-01979-0 · Cited by 269
Metadata
- Authors
- Zhai, C., Wibowo, S., & Li, L. D.
- Affiliations
- Central Queensland University (AU)
- Corresponding author
- Zhai, Chunpeng
- Venue
- Smart Learning Environments
- Published
- 2024-06-18
- Volume
- 11
- Issue
- 1
- ISSN
- 2196-7091 (ISSN-L)
- OpenAlex
- W4399790131
- Cited by
- 1,567
- References
- 111
- Citations by year
- 2026: 953 · 2025: 567 · 2024: 46
- FWCI
- 90.27
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Smart Learning Environments (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- overreliance on AI, generative AI, critical thinking, analytical thinking, decision-making, heuristics, cognitive shortcuts, trust in AI, AI ethics in education, academic research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.