Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 9

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.

Exploring the effect of GenAI on learning outcomes in higher education: a three-level meta-analysis

Fan, Changxin, Ke, Lele, Chen, Zexiong, Lv, Pin · 2026 · Frontiers in Psychology

Abstract

Introduction: As generative artificial intelligence (GenAI) becomes increasingly integrated into higher education, greater clarity is needed regarding its impact on student learning. Methods: This study conducted a three-level meta-analysis of 36 empirical studies, synthesizing 132 effect sizes from 7,229 participants. Learning outcomes were classified using the Learning Outcomes Thematic Group (LOTG) framework, and seven study-level moderators were examined. Results: The results indicate a significant medium overall effect of GenAI on learning outcomes ( g = 0.499). Stronger effects were found for understanding, cognitive and creative outcomes ( g = 0.669) and higher-order learning ( g = 0.504), with moderate effects for dispositions ( g = 0.452) and attainments ( g = 0.363). Evidence was insufficient for the Using and Membership/inclusion/self-worth outcome categories. Teaching method was the only significant moderator, with collaborative learning ( g = 1.026) and blended learning ( g = 0.633) yielding the strongest effects, while other moderators showed no significant influence. Discussion: These findings suggest that GenAI is most effective when embedded in interactive and collaborative pedagogies. The study introduces a GenAI-Learning Alignment Perspective and outlines implications for instructional design, assessment practices, and teacher professional development.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fpsyg.2026.1758670

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 37 references

Research works printed but not linked: 57

  1. Anderson, 1982, Acquisition of cognitive skill, Psychol. Rev., 89, 369, 10.1037/0033-295X.89.4.369 · DOI · Paper page
  2. Anderson, 1983, The Architecture of Cognition
  3. Balduzzi, 2019, How to perform a meta-analysis with R: a practical tutorial, Evid. Based Mental Health, 22, 153, 10.1136/ebmental-2019-300117 · DOI · Paper page
  4. Biggs, 1996, Enhancing teaching through constructive alignment, Higher Educ., 32, 347, 10.1007/BF00138871 · DOI · Paper page
  5. Caspersen, 2017, Higher education learning outcomes-transforming higher education?, Eur. J. Educ., 52, 3, 10.1111/ejed.12204 · doi:10.1111/ejed.12204
  6. Chang, 2025, Generative AI-assisted reflective writing for improving students' higher order thinking, Educ. Technol. Soc., 28, 270, 10.30191/ETS.202501_28(1).TP03 · doi:10.30191/ets.202501_28(1).tp03
  7. Chang, From empathy to quality long-term care: a generative AI-based art therapy approach based on the self-directed learning model, Interact. Learn. Environ, 33, 3333, 10.1080/10494820.2024.2443072 · DOI
  8. Chen, 2025, Investigating the effect of role-play activity with GenAI agent on EFL students' speaking performance, J. Educ. Comp. Res., 63, 99, 10.1177/07356331241299058 · DOI
  9. Chi, 2014, The ICAP framework: linking cognitive engagement to active learning outcomes, Educ. Psychol., 49, 219, 10.1080/00461520.2014.965823 · DOI · Paper page
  10. Clark, 1983, Reconsidering research on learning from media, Rev. Educ. Res., 53, 445, 10.3102/00346543053004445 · DOI · Paper page
  11. Cohen, 2013, Statistical Power Analysis for the Behavioral Sciences, 10.4324/9780203771587 · DOI · Paper page
  12. Cubillos, 2025, Generative artificial intelligence in computer programming: does it enhance learning, motivation, and the learning environment?, IEEE Access, 13, 40438, 10.1109/ACCESS.2025.3532883 · DOI
  13. Doo, 2023, Influence of self-directed learning on learning outcomes in MOOCs: a meta-analysis, Distance Educ., 44, 86, 10.1080/01587919.2022.2155618 · DOI
  14. Gökoglu, 2025, The effects of GenAI on learning performance: a meta-analysis study, Educ. Technol. Soc., 28, 263, 10.30191/ETS.202507_28(3).TP04 · DOI
  15. Hakiki, 2023, Exploring the impact of using Chat-GPT on student learning outcomes in technology learning: the comprehensive experiment, Adv. Mobile Learn. Educ. Res., 3, 859, 10.25082/AMLER.2023.02.013 · DOI
  16. Hu, 2025, Enhancing student engagement in online collaborative writing through a generative AI-based conversational agent, Internet Higher Educ., 65, 100979, 10.1016/j.iheduc.2024.100979 · DOI
  17. Hu, 2024, Improving ethical dilemma learning: featuring thinking aloud pair problem solving (TAPPS) and AI-assisted virtual learning companion, Educ. Inf. Technol., 29, 22969, 10.1007/s10639-024-12754-4 · DOI
  18. Huang, 2023, Personalized intervention based on the early prediction of at-risk students to improve their learning performance, Educ. Technol. Soc., 26, 69, 10.30191/ets.202310_26(4)0.0005 · doi:10.30191/ets.202310_26(4)0.0005
  19. Huang, 2024, Promoting students' creative and design thinking with generative AI-supported co-regulated learning: evidence from digital game development projects in healthcare courses, Educ. Technol. Soc., 27, 487, 10.30191/ETS.202410_27(4).TP04 · DOI
  20. Huang, 2024, The impact of AI chatbot-supported guided discovery learning on pre-service teachers' learning performance and motivation, J. Sci. Educ. Technol., 34, 1286, 10.1007/s10956-024-10179-9 · DOI · Paper page
  21. Hussey, 2008, Learning outcomes: a conceptual analysis, Teach. Higher Educ., 13, 107, 10.1080/13562510701794159 · doi:10.1080/13562510701794159
  22. James, 2005, Grasping the TLRP nettle: preliminary analysis and some enduring issues surrounding the improvement of learning outcomes, Curriculum J., 16, 7, 10.1080/0958517042000336782 · doi:10.1080/0958517042000336782
  23. Ji, 2023, “The effectiveness of ChatGPT on pre-service teachers' STEM teaching literacy, learning performance, and cognitive load in a teacher training course,”, 10.1145/3637907.3637948 · DOI
  24. Jiang, 2025, Interaction and dialogue: integration and application of artificial intelligence in blended mode writing feedback, Internet Higher Educ., 64, 100975, 10.1016/j.iheduc.2024.100975 · DOI
  25. Kosar, 2024, Computer science education in ChatGPT era: experiences from an experiment in a programming course for novice programmers, Mathematics, 12, 629, 10.3390/math12050629 · DOI · Paper page
  26. Li, 2023, Effects of a ChatGPT-based flipped learning guiding approach on learners' courseware project performances and perceptions, Aust. J. Educ. Technol., 39, 40, 10.14742/ajet.8923 · DOI
  27. Li, 2023, Human-computer collaborative deep exploratory teaching mode: taking the human-computer collaborative exploratory learning system developed based on ChatGPT and QQ as an example, Open Educ. Res, 29, 69, 10.13966/j.cnki.kfjyyj.2023.06.008 · doi:10.13966/j.cnki.kfjyyj.2023.06.008
  28. Li, 2024, The efficacy of generative artificial intelligence in developing science education preservice teachers' writing skills: an experimental approach, J. Sci. Educ. Technol, 34, 1260, 10.1007/s10956-024-10148-2 · DOI
  29. Means, 2013, Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies, 10.1037/e615702010-001 · doi:10.1037/e615702010-001
  30. Morris, 2008, Estimating effect sizes from pretest-posttest-control group designs, Organ. Res. Methods, 11, 364, 10.1177/1094428106291059 · DOI · Paper page
  31. Norman, 2013, The Design of Everyday Things (Revised and Expanded Edition)
  32. 2025, What Should Teachers Teach and Students Learn in a Future of Powerful AI?
  33. 2026, OECD Digital Education Outlook 2026: Exploring Effective Uses of Generative AI in Education
  34. 2023, GPT-4 technical report, arXiv [Preprint] arXiv:2303.08774, 10.48550/arXiv.2303.08774 · DOI · Paper page
  35. Pan, 2025, Effects of GenAI-empowered interactive support on university EFL students' self-regulated strategy use and engagement in reading, Internet Higher Educ., 65, 100991, 10.1016/j.iheduc.2024.100991 · DOI
  36. Pellegrino, 2001, Knowing What Students Know
  37. Qi, 2024, The impact of generative artificial intelligence tools on college students' critical thinking and autonomous learning ability, e-Education Research, 45, 67, 10.13811/j.cnki.eer.2024.12.009 · doi:10.13811/j.cnki.eer.2024.12.009
  38. Qureshi, 2023, Exploring the use of ChatGPT as a tool for learning and assessment in undergraduate computer science curriculum: opportunities and challenges, arXiv [Preprint] arXiv:2304.11214, 10.1145/3613944.3613946 · DOI
  39. Russell, 2001, The No Significant Difference Phenomenon: A Comparative Research Annotated Bibliography on Technology for Distance Education
  40. Schwarzer, 2015, “Meta-analysis with binary outcomes,”, 10.1007/978-3-319-21416-0_3 · DOI
  41. Shi, 2024, A study on the impact of generative artificial intelligence supported situational interactive teaching on students' 'flow' experience and learning effectiveness - a case study of legal education in China, Asia Pac. J. Educ., 44, 112, 10.1080/02188791.2024.2305161 · DOI
  42. Song, 2025, Interactions with generative AI chatbots: unveiling dialogic dynamics, students' perceptions, and practical competencies in creative problem-solving, Int. J. Educ. Technol. Higher Educ., 22, 12, 10.1186/s41239-025-00508-2 · DOI
  43. Sun, 2024, Would ChatGPT-facilitated programming mode impact college students' programming behaviors, performances, and perceptions? An empirical study, Int. J. Educ. Technol. Higher Educ, 21, 14, 10.1186/s41239-024-00446-5 · DOI · Paper page
  44. Sweller, 1988, Cognitive load during problem solving, Cognit. Sci., 12, 257, 10.1207/s15516709cog1202_4 · doi:10.1207/s15516709cog1202_4 · Paper page
  45. Sweller, 1985, The use of worked examples as a substitute for problem solving in learning algebra, Cognit. Instr., 2, 59, 10.1207/s1532690xci0201_3 · DOI · Paper page
  46. Thomas, 2004, A process for systematically reviewing the literature: providing the research evidence for public health nursing interventions, Worldviews Evid. Based Nurs., 1, 176, 10.1111/j.1524-475X.2004.04006.x · DOI · Paper page
  47. Trindade, 2025, Teaching mathematical concepts in management with generative artificial intelligence: the power of human oversight in AI-driven learning, Int. J. Manage. Educ., 23, 101104, 10.1016/j.ijme.2024.101104 · DOI
  48. 2023, Guidance for Generative AI in Education and Research
  49. Varela, 2017, Learning outcomes of study-abroad programs: a meta-analysis, Acad. Manag. Learn. Educ., 16, 531, 10.5465/amle.2015.0250 · DOI
  50. Viechtbauer, 2010, Conducting Meta-Analyses in R with the metafor Package, J. Statis. Softw., 36, 1, 10.18637/jss.v036.i03 · DOI · Paper page
  51. Viechtbauer, 2010, Outlier and influence diagnostics for meta-analysis, Res. Synth. Methods, 1, 112, 10.1002/jrsm.11 · DOI · Paper page
  52. Wang, 2024, The impact of different conversational generative AI chatbots on EFL learners: an analysis of willingness to communicate, foreign language speaking anxiety, and self-perceived communicative competence, System, 127, 103533, 10.1016/j.system.2024.103533 · DOI · Paper page
  53. Yan, 2024, AI education empowers the research of higher vocational medical imaging courses: a case study of x-ray imaging technology, Modern Vocational Educ., 23, 98
  54. Yilmaz, 2023, The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation, Comp. Educ. Artif. Intell., 4, 100147, 10.1016/j.caeai.2023.100147 · DOI · Paper page
  55. Zhou, 2025, Supporting English speaking practice in higher education: the impact of AI chatbot-integrated mobile-assisted blended learning framework, Educ. Inf. Technol., 30, 14629, 10.1007/s10639-025-13401-2 · DOI
  56. Zhou, 2024, Innovative music education: an empirical assessment of ChatGPT-4's impact on student learning experiences, Educ. Inf. Technol, 29, 20855, 10.1007/s10639-024-12705-z · DOI
  57. Zhu, 2025, Exploring the impact of generative artificial intelligence on students' learning outcomes: a meta-analysis, Educ. Inf. Technol., 30, 16211, 10.1007/s10639-025-13420-z · DOI

Cited by

See all 9

Metadata

Authors
Fan, C., Ke, L., Chen, Z., & Lv, P.
Affiliations
  • Institute of Education, Xiamen University
  • School of Marxism, NingboTech University
  • School of Educational Science, Shenyang Normal University
Venue
Frontiers in Psychology
Published
2026-05-15
Volume
17
ISSN
1664-1078
Cited by
9
References
37

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Exploring the effect of GenAI on learning outcomes in higher education: a three-level meta-analysis. https://app.cochat.ai/papers/10.3389/fpsyg.2026.1758670
The paper
Fan, C., Ke, L., Chen, Z., & Lv, P. (2026). Exploring the effect of GenAI on learning outcomes in higher education: a three-level meta-analysis. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2026.1758670

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.