CoChat
Sign Up
Cited by 229Artificial Intelligence in EducationArtificial Intelligence in Healthcare and EducationIntelligent Tutoring Systems and Adaptive Learning

The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.

How ChatGPT impacts student engagement from a systematic review and meta-analysis study

Open access
Heung, Yuk Mui Elly, Chiu, Thomas K.F.·2025·Computers and Education: Artificial Intelligence
DOI 10.1016/j.caeai.2025.100361
Open this paper in CoChat — free account

Abstract

Generative artificial intelligence, such as ChatGPT, has been increasingly integrated into education to change student learning experience. Current empirical studies have mixed results on how ChatGPT impacts student behavioral, cognitive, and emotional engagement. This systematic literature review and meta-analysis explores whether and how ChatGPT impacts student behavioral, cognitive, and emotional engagement. We used the PRISMA method to select, analyze, and report the results. We screened 766 articles from four databases and identified 17 empirical studies with 1735 students for analysis. We compared the effect on student engagement between ChatGPT-based and non-ChatGPT learning. We found a medium effect size on overall student engagement in ChatGPT-based learning in the random effects model. Our analyses further suggest that ChatGPT-based learning is more effective in fostering student behavioral (medium effective size), cognitive (large effective size), and emotional engagement (medium effective size) than non-ChatGPT learning. Our findings revealed ChatGPT is an effective tool for engaging students in learning. We also suggested three roles ChatGPT plays in fostering student engagement: personalized tutoring, programming and technical assistance, and content generation and collaboration. Our systematic literature review revealed potential risks and results in student disengagement, such as over-reliance.

Overview

Integrity signals

Registry

Crossref · 10.1016/j.caeai.2025.100361

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 34

  1. Al Shloul, 2024, Role of activity-based learning and ChatGPT on students' performance in education, Computers and Education: Artificial Intelligence, 6
  2. Alneyadi, 2023, ChatGPT: Revolutionizing student achievement in the electronic magnetism unit for eleventh-grade students in Emirates schools, Contemporary Educational Technology, 15, 448, 10.30935/cedtech/13417 · DOI · Paper page
  3. Bakker, 2015, Student engagement and performance: A weekly diary study on the role of openness, Motivation and Emotion, 39, 49, 10.1007/s11031-014-9422-5 · DOI
  4. Benavides-Varela, 2020, Effectiveness of digital-based interventions for children with mathematical learning difficulties: A meta-analysis, Computers & Education, 157, 10.1016/j.compedu.2020.103953 · DOI
  5. Bilal Khallel, 2024, Examining students' self-regulation skills, confidence to learn online, and perception of satisfaction and usefulness of online classes in three suggested online learning environments that integrates ChatGPT, Online learning (Newburyport, Mass.), 28
  6. Boghossian, 2006, Behaviorism, constructivism, and socratic pedagogy, Educational Philosophy and Theory, 38, 10.1111/j.1469-5812.2006.00226.x · DOI
  7. Chiu, 2024, Teacher support and student motivation to learn with artificial intelligence (AI) chatbot, Interactive Learning Environments, 32, 3240
  8. Christenson, 2012, Handbook of research on student engagement [doi:10.1007/978-1-4614-2018-7], Springer Science + Business Media · DOI · Paper page
  9. Dindorf, 2024, Exploring decision-making competence in sugar-substitute choices: A cross-disciplinary investigation among chemistry and sports and health students, Education Sciences, 14, 531, 10.3390/educsci14050531 · DOI
  10. Fryer, 2019, Chatbot learning partners: Connecting learning experiences, interest and competence, Computers in Human Behavior, 93, 279, 10.1016/j.chb.2018.12.023 · DOI · Paper page
  11. Huesca, 2024, Effectiveness of using ChatGPT as a tool to strengthen benefits of the flipped learning strategy, Education Sciences, 14, 660, 10.3390/educsci14060660 · DOI
  12. Jing, 2024, What factors will affect the effectiveness of using ChatGPT to solve programming problems? A quasi-experimental study, Humanities & social sciences communications, 11, 319, 10.1057/s41599-024-02751-w · DOI
  13. Kahu, 2013, Framing student engagement in higher education, Studies in Higher Education, 38, 758, 10.1080/03075079.2011.598505 · DOI · Paper page
  14. Kerr, 2016, Adaptive learning, ELT Journal, 70, 88, 10.1093/elt/ccv055 · DOI
  15. Kosar, 2024, Computer science education in ChatGPT era: Experiences from an experiment in a programming course for novice programmers, Mathematics, 12, 629, 10.3390/math12050629 · DOI
  16. Li, 2024, Systematics review on artificial intelligence chatbots and ChatGPT for language learning and research from self-determination theory (SDT): What are the roles of teachers?, Interactive Learning Environments, 1
  17. Ng, 2024, Empowering student self-regulated learning and science education through ChatGPT: A pioneering pilot study, British Journal of Educational Technology, 55, 1328, 10.1111/bjet.13454 · DOI
  18. Qureshi, 2023, Exploring the use of ChatGPT as a tool for learning and assessment in undergraduate computer science curriculum: Opportunities and challenges, arXiv.org
  19. Reed, 2008, Predictive validity evidence for medical education research study quality instrument scores: Quality of submissions to JGIM's medical education special issue, Journal of General Internal Medicine, 23, 903, 10.1007/s11606-008-0664-3 · DOI
  20. Reeve, 2013, How students create motivationally supportive learning environments for themselves: The concept of agentic engagement, Journal of Educational Psychology, 105, 579, 10.1037/a0032690 · DOI · Paper page
  21. Saritepeci, 2024, Effectiveness of artificial intelligence integration in design-based learning on design thinking mindset, creative and reflective thinking skills: An experimental study, Education and Information Technologies, 10.1007/s10639-024-12829-2 · DOI
  22. Sinatra, 2015, The challenges of defining and measuring student engagement in science, Educational Psychologist, 50, 1, 10.1080/00461520.2014.1002924 · DOI · Paper page
  23. Sun, 2024, Would ChatGPT-facilitated programming mode impact college students' programming behaviors, performances, and perceptions? An empirical study, International Journal of Educational Technology in Higher Education, 21, 14, 10.1186/s41239-024-00446-5 · DOI · Paper page
  24. Turner, 2013, Publication bias, with a focus on psychiatry: Causes and solutions, CNS Drugs, 27, 457, 10.1007/s40263-013-0067-9 · DOI
  25. Wardat, 2024, Integrating ChatGPT in grade 12 Quantum theory education: An exploratory study at emirate school (UAE), International Journal of Information and Education Technology, 14, 389, 10.18178/ijiet.2024.14.3.2061 · DOI
  26. Weng, 2023, Competency development of pre-service teachers during video-based learning: A systematic literature review and meta-analysis, Computers and education, 199, 10.1016/j.compedu.2023.104790 · DOI
  27. Wu, 2024, Promoting self-regulation progress and knowledge construction in blended learning via ChatGPT-based learning aid, Journal of Educational Computing Research, 61, 3, 10.1177/07356331231191125 · DOI
  28. Yildiz Durak, 2023, Conversational agent-based guidance: Examining the effect of chatbot usage frequency and satisfaction on visual design self-efficacy, engagement, satisfaction, and learner autonomy, Education and Information Technologies, 28, 471, 10.1007/s10639-022-11149-7 · DOI
  29. Yilmaz, 2023, The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation, Computers and Education: Artificial Intelligence, 4
  30. Yin, 2021, Conversation technology with micro-learning: The impact of chatbot-based learning on students' learning motivation and performance, Journal of Educational Computing Research, 59, 10.1177/0735633120952067 · DOI · Paper page
  31. Zhan, 2022, The effectiveness of gamification in programming education: Evidence from a meta-analysis, Computers and Education: Artificial Intelligence, 3
  32. Zhao, 2023, The impact of the use of ChatGPT in enhancing students' engagement and learning outcomes in higher education: A review, International Journal of Academic Research in Business and Social Sciences, 13, 10.6007/IJARBSS/v13-i12/20258 · DOI
  33. Zimmerman, 2000, Chapter 2-attaining self-regulation: A social cognitive perspective, 13
  34. Zimmerman, 2008, Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects, American Educational Research Journal, 45, 166, 10.3102/0002831207312909 · DOI · Paper page

Cited by

Sorted by citations

Metadata

Authors
Heung, Y. M. E., & Chiu, T. K. F.
Affiliations
Chinese University of Hong Kong (HK)
Corresponding author
Chiu, Thomas K.F.
ORCID
Venue
Computers and Education: Artificial Intelligence
Publisher
Elsevier BV
Published
2025-06
Volume
8
Pages
100361
ISSN
2666-920X (ISSN-L)
DOI
10.1016/j.caeai.2025.100361
OpenAlex
W4406071412
Cited by
229
References
17
Citations by year
2026: 149 · 2025: 80
FWCI
24.22
Type
journal article
Language
en
Open access
Licence
Locations
  • Computers and Education Artificial Intelligence (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Education › Artificial Intelligence in Education
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
Keywords
ChatGPT, generative AI in education, student engagement, behavioral engagement, cognitive engagement, emotional engagement, personalized tutoring, overreliance on AI, student disengagement, content creation, collaboration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review