CoChat

Effect of generative artificial intelligence on university students learning outcomes: A systematic review and meta-analysis

Chen, Shuzhen, Cheung, Alan C.K. · 2025 · Educational Research Review
Cited by 78

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.

Overview

Integrity signals

Registry

Crossref · 10.1016/j.edurev.2025.100737

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 37 references

Research works printed but not linked: 76

  1. Alemdag, 2025, The effect of chatbots on learning: A meta-analysis of empirical research, Journal of Research on Technology in Education, 57, 459, 10.1080/15391523.2023.2255698 · DOI · Paper page
  2. Almerich, 2024, ICT integration by teachers: A basic model of ICT use, pedagogical beliefs, and personal and contextual factors, Teaching and Teacher Education, 145, 10.1016/j.tate.2024.104617 · DOI
  3. Andersen, 2025, Generative artificial Intelligence (GenAI) in the research process–A survey of researchers' practices and perceptions, Technology in Society, 81, 10.1016/j.techsoc.2025.102813 · DOI
  4. Belkina, 2025, Implementing generative AI (GenAI) in higher education: A systematic review of case studies, Computers and Education: Artificial Intelligence
  5. Chen, 2025, Big five personality traits and university students' academic performance: A meta-analysis, Personality and Individual Differences, 240, 10.1016/j.paid.2025.113163 · DOI
  6. Chiu, 2023, Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education, Computers and Education: Artificial Intelligence, 4
  7. Deng, 2023, A review of eye tracking research on video-based learning, Education and Information Technologies, 28, 7671, 10.1007/s10639-022-11486-7 · DOI
  8. Deng, 2024, Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies, Computers & Education
  9. Di Pietro, 2025, A meta-analysis on the effect of technology on the achievement of less advantaged students, Computers & Education, 226, 10.1016/j.compedu.2024.105197 · DOI
  10. Egger, 1997, Bias in meta-analysis detected by a simple, graphical test, BMJ, 315, 629, 10.1136/bmj.315.7109.629 · DOI · Paper page
  11. Essel, 2024, ChatGPT effects on cognitive skills of undergraduate students: Receiving instant responses from AI-based conversational large language models (LLMs), Computers and Education: Artificial Intelligence, 6
  12. Gökoğlu, 2025, The effects of GenAI on learning performance: A meta-analysis study, Educational Technology & Society, 28, 1
  13. Guay, 2022, Applying self-determination theory to education: Regulations types, psychological needs, and autonomy supporting behaviors, Canadian Journal of School Psychology, 37, 75, 10.1177/08295735211055355 · DOI · Paper page
  14. Hakiki, 2023, Exploring the impact of using Chat-GPT on student learning outcomes in technology learning: The comprehensive experiment, Advances in Mobile Learning Educational Research, 3, 859, 10.25082/AMLER.2023.02.013 · DOI
  15. Huang, 2023, Personalized intervention based on the early prediction of at-risk students to improve their learning performance, Educational Technology & Society, 26, 69
  16. Hui, 2025, Application of ChatGPT-assisted problem-based learning teaching method in clinical medical education, BMC Medical Education, 25, 50, 10.1186/s12909-024-06321-1 · DOI
  17. Johnson, 2022, Integrating human knowledge into artificial intelligence for complex and ill-structured problems: Informed artificial intelligence, International Journal of Information Management, 64, 10.1016/j.ijinfomgt.2022.102479 · DOI
  18. Jonassen, 1999, Activity theory as a framework for designing constructivist learning environments, Educational Technology Research & Development, 47, 61, 10.1007/BF02299477 · DOI · Paper page
  19. Karaoglan Yilmaz, 2025, Exploring the role of self-regulated learnings skills, cognitive flexibility, and metacognitive awareness on generative artificial intelligence attitude, Innovations in Education & Teaching International, 1
  20. Kosar, 2024, Computer science education in chatgpt era: Experiences from an experiment in a programming course for novice programmers, Mathematics, 12, 629, 10.3390/math12050629 · DOI · Paper page
  21. Krakowski, 2025, Human-AI agency in the age of generative AI, Information and Organization, 35, 10.1016/j.infoandorg.2025.100560 · DOI · Paper page
  22. Laun, 2025, Chatbots in education: Hype or help? A meta-analysis, Learning and Individual Differences, 119, 10.1016/j.lindif.2025.102646 · DOI
  23. Lee, 2024, Meta-analysis on effects of artificial intelligence education in K-12 South Korean classrooms, Education and Information Technologies, 1
  24. Liu, 2022, Improving students' higher order thinking skills and achievement using WeChat based flipped classroom in higher education, Education and Information Technologies, 27, 7281, 10.1007/s10639-022-10922-y · DOI
  25. Liu, 2025, Can AI chatbots effectively improve EFL learners' learning effects? A meta-analysis of empirical research from 2022–2024, Computer Assisted Language Learning, 1
  26. Nouri, 2023, Power distance: Moderating effect on positive youth development in Malaysian co-curricular programs, Journal of Applied Developmental Psychology, 85, 10.1016/j.appdev.2023.101520 · DOI
  27. Okonkwo, 2021, Chatbots applications in education: A systematic review, Computers and Education: Artificial Intelligence, 2
  28. Page, 2021, The PRISMA 2020 statement: An updated guideline for reporting systematic reviews, BMJ, 372
  29. Salas-Pilco, 2020, The impact of AI and robotics on physical, social‐emotional and intellectual learning outcomes: An integrated analytical framework, British Journal of Educational Technology, 51, 1808, 10.1111/bjet.12984 · DOI · Paper page
  30. Scherrer, 2025, The stability of students' academic achievement in school: A meta-analysis of longitudinal studies, Educational Research Review, 10.1016/j.edurev.2025.100687 · DOI
  31. Shafiee Rad, 2024, Revolutionizing L2 speaking proficiency, willingness to communicate, and perceptions through artificial intelligence: A case of speeko application, Innovation in Language Learning and Teaching, 18, 364, 10.1080/17501229.2024.2309539 · DOI
  32. Slavin, 2009, The relationship between sample sizes and effect sizes in systematic reviews in education, Educational Evaluation and Policy Analysis, 31, 500, 10.3102/0162373709352369 · DOI · Paper page
  33. Svendsen, 2024, Short-term learning effect of ChatGPT on pharmacy students' learning, Exploratory Research in Clinical and Social Pharmacy, 15, 10.1016/j.rcsop.2024.100478 · DOI
  34. Tlili, 2025, Investigating the effect of artificial intelligence in education (AIEd) on learning achievement: A meta-analysis and research synthesis, Information Development, 10.1177/02666669241304407 · DOI
  35. Trigui, 2024, Exploring AI governance in the Middle East and North Africa (MENA) region: Gaps, efforts, and initiatives, Data & Policy, 6, e83, 10.1017/dap.2024.85 · DOI
  36. Vargas-Montoya, 2023, ICT use for learning and students' outcomes: Does the country's development level matter?, Socio-Economic Planning Sciences, 87, 10.1016/j.seps.2023.101550 · DOI
  37. Wang, 2024, Robots' social behaviors for language learning: A systematic review and meta-analysis, Review of Educational Research
  38. Wang, 2024, Does chatting with chatbots improve language learning performance? A meta-analysis of chatbot-assisted language learning, Review of Educational Research
  39. Wiboolyasarin, 2024, Synergizing collaborative writing and AI feedback: An investigation into enhancing L2 writing proficiency in wiki-based environments, Computers and Education: Artificial Intelligence, 6
  40. Wu, 2025, Application of ChatGPT-based blended medical teaching in clinical education of hepatobiliary surgery, Medical Teacher, 47, 445, 10.1080/0142159X.2024.2339412 · DOI · Paper page
  41. Yan, 2023, Educational dilemmas in East Asia: The impact of Confucianism in modern society, Lecture Notes in Education, Psychology and Public Media, 18, 272, 10.54254/2753-7048/18/20231340 · DOI
  42. Yilmaz, 2023, The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation, Computers and Education: Artificial Intelligence, 4
  43. Yilmaz, 2023, Augmented intelligence in programming learning: Examining student views on the use of ChatGPT for programming learning, Computers in Human Behavior: Artificial Humans, 1
  44. Zhai, 2023, A systematic review on artificial intelligence dialogue systems for enhancing English as foreign language students' interactional competence in the university, Computers and Education: Artificial Intelligence, 4
  45. Zhang, 2007, A cultural look at information and communication technologies in eastern education, Educational Technology Research & Development, 55, 301, 10.1007/s11423-007-9040-y · DOI
  46. Zhu, 2025, Exploring the impact of generative artificial intelligence on students' learning outcomes: A meta-analysis, Education and Information Technologies, 1
  47. Zohar, 2009, Paving a clear path in a thick forest: A conceptual analysis of a metacognitive component, Metacognition and Learning, 4, 177, 10.1007/s11409-009-9044-6 · DOI
  48. Abdulla, 2024, Using ChatGPT in teaching computer programming and studying its impact on students performance, Electronic Journal of E-Learning, 22, 66, 10.34190/ejel.22.6.3380 · DOI
  49. Ali, 2025, Impact of artificial intelligence on the academic performance and test anxiety of pharmacy students in objective structured clinical examination: A randomized controlled trial, International Journal of Clinical Pharmacy, 1
  50. Arkün-Kocadere, 2024, Video lectures with AI-generated instructors: Low video engagement, same performance as human instructors, International Review of Research in Open and Distance Learning, 25, 350, 10.19173/irrodl.v25i3.7815 · DOI
  51. Avello Martínez, 2024, Is ChatGPT helpful for graduate students in acquiring knowledge about digital storytelling and reducing their cognitive load? An experiment, Evista de Educación a Distancia, 24, 1
  52. Azamatova, 2023, The effect of using artificial intelligence and digital learning tools based on project-based learning approach in foreign language teaching on students' success and motivation, International Journal of Education in Mathematics, Science and Technology, 11, 1458, 10.46328/ijemst.3712 · DOI
  53. Başaran, 2024, The impact of kahoot and ChatGPT educational technologies on nursing students' sexual health knowledge and attitudes: A quasi-experimental study, Sexuality and Disability, 1
  54. Boudouaia, 2024, A study on ChatGPT-4 as an innovative approach to enhancing English as a foreign language writing learning, Journal of Educational Computing Research, 62, 1509, 10.1177/07356331241247465 · DOI
  55. Cubillos, 2025, Generative artificial intelligence in computer programming: Does it enhance learning, motivation, and the learning environment?, IEEE Access, 13, 40438, 10.1109/ACCESS.2025.3532883 · DOI
  56. Essel, 2025, Exploring the impact of VoiceBots on multimedia programming education among Ghanaian university students, British Journal of Educational Technology, 56, 276, 10.1111/bjet.13504 · DOI
  57. Fakher Ajabshir, 2024, A comparative study of teacher feedback and chatbot feedback on second language learners' pragmalinguistic and sociopragmatic competences, International Journal of Human-Computer Interaction, 1
  58. Gao, 2024, Can artificial intelligence give a hand to open and distributed learning? A probe into the state of undergraduate students' academic emotions and test anxiety in learning via ChatGPT, International Review of Research in Open and Distance Learning, 25, 199, 10.19173/irrodl.v25i3.7742 · DOI
  59. Hijón-Neira, 2024, AI-generated context for teaching robotics to improve computational thinking in early childhood education, Education Sciences, 14, 1401, 10.3390/educsci14121401 · DOI
  60. Hu, 2024, Improving ethical dilemma learning: Featuring thinking aloud pair problem solving (TAPPS) and AI-assisted virtual learning companion, Education and Information Technologies, 1
  61. Hu, 2025, Enhancing student engagement in online collaborative writing through a generative AI-based conversational agent, The Internet and Higher Education, 65, 10.1016/j.iheduc.2024.100979 · DOI
  62. Huesca, 2024, Effectiveness of using ChatGPT as a tool to strengthen benefits of the flipped learning strategy, Education Sciences, 14, 660, 10.3390/educsci14060660 · DOI
  63. Ironsi, 2025, Experimental evidence for the efficacy of generative AI in improving students' writing skills, Quality Assurance in Education, 33, 237, 10.1108/QAE-04-2024-0065 · DOI · Paper page
  64. Jiang, 2025, Interaction and dialogue: Integration and application of artificial intelligence in blended mode writing feedback, The Internet and Higher Education, 64, 10.1016/j.iheduc.2024.100975 · DOI
  65. Kavadella, 2024, Evaluation of ChatGPT's real-life implementation in undergraduate dental education: Mixed methods study, JMIR Medical Education, 10
  66. Kucuk, 2024, ChatGPT integrated grammar teaching and learning in EFL classes: A study on tishk international university students in Erbil, Iraq, Arab World English Journal, 100, 10.24093/awej/ChatGPT.6 · DOI
  67. Liao, 2024, Scaffolding computational thinking with ChatGPT, IEEE Transactions on Learning Technologies, 17, 1628, 10.1109/TLT.2024.3392896 · DOI
  68. Liu, 2023, The influence of AI ChatGPT on improving teachers' creative thinking, International Journal of Learning, Teaching and Educational Research, 22, 124, 10.26803/ijlter.22.12.7 · DOI
  69. Naamati-Schneider, 2024, Beyond digital literacy: The era of AI-powered assistants and evolving user skills, Education and Information Technologies, 29, 21263, 10.1007/s10639-024-12694-z · DOI
  70. Shi, 2024, A study on the impact of generative artificial intelligence supported situational interactive teaching on students'‘flow’experience and learning effectiveness-a case study of legal education in China, Asia Pacific Journal of Education, 44, 112, 10.1080/02188791.2024.2305161 · DOI
  71. Wang, 2025, A study on the efficacy of ChatGPT-4 in enhancing students' English communication skills, Sage Open, 15, 10.1177/21582440241310644 · DOI
  72. Wei, 2023, Artificial intelligence in language instruction: Impact on English learning achievement, L2 motivation, and self-regulated learning, Frontiers in Psychology, 14, 10.3389/fpsyg.2023.1261955 · DOI · Paper page
  73. Wu, 2025, Integrating peer assessment cycle into ChatGPT for STEM education: A randomised controlled trial on knowledge, skills, and attitudes enhancement, Journal of Computer Assisted Learning, 41, 10.1111/jcal.13085 · DOI
  74. Yin, 2024, Using educational chatbots with metacognitive feedback to improve science learning, Applied Sciences, 14, 9345, 10.3390/app14209345 · DOI
  75. Zhang, 2024, Artificial intelligence in EFL speaking: Impact on enjoyment, anxiety, and willingness to communicate, System, 121, 10.1016/j.system.2024.103259 · DOI · Paper page
  76. Zhang, 2024, Chatbot-based learning of logical fallacies in EFL writing: Perceived effectiveness in improving target knowledge and learner motivation, Interactive Learning Environments, 32, 5552, 10.1080/10494820.2023.2220374 · DOI · Paper page

Cited by

Metadata

Authors
Chen, S., & Cheung, A. C. K.
Venue
Educational Research Review
Publisher
Elsevier BV
Published
2025-11
Volume
49
Pages
100737
ISSN
1747-938X
Cited by
78
References
37
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Effect of generative artificial intelligence on university students learning outcomes: A systematic review and meta-analysis. https://app.cochat.ai/papers/10.1016/j.edurev.2025.100737
The paper
Chen, S., & Cheung, A. C. K. (2025). Effect of generative artificial intelligence on university students learning outcomes: A systematic review and meta-analysis. Educational Research Review. https://doi.org/10.1016/j.edurev.2025.100737

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.