The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Exploring the effect of GenAI on learning outcomes in higher education: a three-level meta-analysis
Abstract
Introduction: As generative artificial intelligence (GenAI) becomes increasingly integrated into higher education, greater clarity is needed regarding its impact on student learning. Methods: This study conducted a three-level meta-analysis of 36 empirical studies, synthesizing 132 effect sizes from 7,229 participants. Learning outcomes were classified using the Learning Outcomes Thematic Group (LOTG) framework, and seven study-level moderators were examined. Results: The results indicate a significant medium overall effect of GenAI on learning outcomes ( g = 0.499). Stronger effects were found for understanding, cognitive and creative outcomes ( g = 0.669) and higher-order learning ( g = 0.504), with moderate effects for dispositions ( g = 0.452) and attainments ( g = 0.363). Evidence was insufficient for the Using and Membership/inclusion/self-worth outcome categories. Teaching method was the only significant moderator, with collaborative learning ( g = 1.026) and blended learning ( g = 0.633) yielding the strongest effects, while other moderators showed no significant influence. Discussion: These findings suggest that GenAI is most effective when embedded in interactive and collaborative pedagogies. The study introduces a GenAI-Learning Alignment Perspective and outlines implications for instructional design, assessment practices, and teacher professional development.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“g = 1.026 for collaborative learning”
From Generative AI in Higher Education: Evidence Synthesis of Applied Learning Outcomes (2026) · cites this paper as Fan et al. (2026)
In the citing paper
“a 2026 three-level meta-analysis reported an overall learning effect of g = 0.499 across 36 studies, 132 effect sizes, and 7,229 participants”
From Generative AI in Higher Education: Evidence Synthesis of Applied Learning Outcomes (2026) · cites this paper as Fan et al. (2026)
In the citing paper
“g = 0.633 for blended learning”
From Generative AI in Higher Education: Evidence Synthesis of Applied Learning Outcomes (2026) · cites this paper as Fan et al. (2026)
In the citing paper
“g = 0.669 for cognitive or creative outcomes”
From Generative AI in Higher Education: Evidence Synthesis of Applied Learning Outcomes (2026) · cites this paper as Fan et al. (2026)
In the citing paper
“Fan et al. (2026) reported g = 0.504 for higher-order thinking”
From Generative AI in Higher Education: Evidence Synthesis of Applied Learning Outcomes (2026) · cites this paper as Fan et al. (2026)
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599 · cited 1×
“Dispositional improvements align with feedback-and-motivation explanations, as timely, targeted feedback enhances competence and autonomy in line with formative feedback research and self-determination theory ( Hattie and Timperley, 2007; Shute, 2008; Ryan and Deci, 2000).”
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1×
“Problem resolution tasks yielded slightly higher estimates than knowledge acquisition tasks, a pattern tentatively consistent with cognitive load theory (Sweller, 1988) and expertise-reversal effects (Kalyuga et al., 2003), although the difference was small and not statistically significant.”
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776 · cited 1×
“Inquiry, personalized, and teacher-centered approaches offered fewer opportunities for structured collaboration with GenAI, which aligns with concerns about reduced productive struggle when scaffolding is limited (Kirschner et al., 2006).”
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_4 · Cited by 1,927
Media will never influence learning
Clark, R. E. (1994) · Educational Technology Research and Development · doi:10.1007/bf02299088 · Cited by 1,893
Research works printed but not linked: 57
- Anderson, 1982, Acquisition of cognitive skill, Psychol. Rev., 89, 369, 10.1037/0033-295X.89.4.369 · DOI · Paper page
- Anderson, 1983, The Architecture of Cognition
- Balduzzi, 2019, How to perform a meta-analysis with R: a practical tutorial, Evid. Based Mental Health, 22, 153, 10.1136/ebmental-2019-300117 · DOI · Paper page
- Biggs, 1996, Enhancing teaching through constructive alignment, Higher Educ., 32, 347, 10.1007/BF00138871 · DOI · Paper page
- Caspersen, 2017, Higher education learning outcomes-transforming higher education?, Eur. J. Educ., 52, 3, 10.1111/ejed.12204 · doi:10.1111/ejed.12204
- Chang, 2025, Generative AI-assisted reflective writing for improving students' higher order thinking, Educ. Technol. Soc., 28, 270, 10.30191/ETS.202501_28(1).TP03 · doi:10.30191/ets.202501_28(1).tp03
- Chang, From empathy to quality long-term care: a generative AI-based art therapy approach based on the self-directed learning model, Interact. Learn. Environ, 33, 3333, 10.1080/10494820.2024.2443072 · DOI
- Chen, 2025, Investigating the effect of role-play activity with GenAI agent on EFL students' speaking performance, J. Educ. Comp. Res., 63, 99, 10.1177/07356331241299058 · DOI
- Chi, 2014, The ICAP framework: linking cognitive engagement to active learning outcomes, Educ. Psychol., 49, 219, 10.1080/00461520.2014.965823 · DOI · Paper page
- Clark, 1983, Reconsidering research on learning from media, Rev. Educ. Res., 53, 445, 10.3102/00346543053004445 · DOI · Paper page
- Cohen, 2013, Statistical Power Analysis for the Behavioral Sciences, 10.4324/9780203771587 · DOI · Paper page
- Cubillos, 2025, Generative artificial intelligence in computer programming: does it enhance learning, motivation, and the learning environment?, IEEE Access, 13, 40438, 10.1109/ACCESS.2025.3532883 · DOI
- Doo, 2023, Influence of self-directed learning on learning outcomes in MOOCs: a meta-analysis, Distance Educ., 44, 86, 10.1080/01587919.2022.2155618 · DOI
- Gökoglu, 2025, The effects of GenAI on learning performance: a meta-analysis study, Educ. Technol. Soc., 28, 263, 10.30191/ETS.202507_28(3).TP04 · DOI
- Hakiki, 2023, Exploring the impact of using Chat-GPT on student learning outcomes in technology learning: the comprehensive experiment, Adv. Mobile Learn. Educ. Res., 3, 859, 10.25082/AMLER.2023.02.013 · DOI
- Hu, 2025, Enhancing student engagement in online collaborative writing through a generative AI-based conversational agent, Internet Higher Educ., 65, 100979, 10.1016/j.iheduc.2024.100979 · DOI
- Hu, 2024, Improving ethical dilemma learning: featuring thinking aloud pair problem solving (TAPPS) and AI-assisted virtual learning companion, Educ. Inf. Technol., 29, 22969, 10.1007/s10639-024-12754-4 · DOI
- Huang, 2023, Personalized intervention based on the early prediction of at-risk students to improve their learning performance, Educ. Technol. Soc., 26, 69, 10.30191/ets.202310_26(4)0.0005 · doi:10.30191/ets.202310_26(4)0.0005
- Huang, 2024, Promoting students' creative and design thinking with generative AI-supported co-regulated learning: evidence from digital game development projects in healthcare courses, Educ. Technol. Soc., 27, 487, 10.30191/ETS.202410_27(4).TP04 · DOI
- Huang, 2024, The impact of AI chatbot-supported guided discovery learning on pre-service teachers' learning performance and motivation, J. Sci. Educ. Technol., 34, 1286, 10.1007/s10956-024-10179-9 · DOI · Paper page
- Hussey, 2008, Learning outcomes: a conceptual analysis, Teach. Higher Educ., 13, 107, 10.1080/13562510701794159 · doi:10.1080/13562510701794159
- James, 2005, Grasping the TLRP nettle: preliminary analysis and some enduring issues surrounding the improvement of learning outcomes, Curriculum J., 16, 7, 10.1080/0958517042000336782 · doi:10.1080/0958517042000336782
- Ji, 2023, “The effectiveness of ChatGPT on pre-service teachers' STEM teaching literacy, learning performance, and cognitive load in a teacher training course,”, 10.1145/3637907.3637948 · DOI
- Jiang, 2025, Interaction and dialogue: integration and application of artificial intelligence in blended mode writing feedback, Internet Higher Educ., 64, 100975, 10.1016/j.iheduc.2024.100975 · DOI
- Kosar, 2024, Computer science education in ChatGPT era: experiences from an experiment in a programming course for novice programmers, Mathematics, 12, 629, 10.3390/math12050629 · DOI · Paper page
- Li, 2023, Effects of a ChatGPT-based flipped learning guiding approach on learners' courseware project performances and perceptions, Aust. J. Educ. Technol., 39, 40, 10.14742/ajet.8923 · DOI
- Li, 2023, Human-computer collaborative deep exploratory teaching mode: taking the human-computer collaborative exploratory learning system developed based on ChatGPT and QQ as an example, Open Educ. Res, 29, 69, 10.13966/j.cnki.kfjyyj.2023.06.008 · doi:10.13966/j.cnki.kfjyyj.2023.06.008
- Li, 2024, The efficacy of generative artificial intelligence in developing science education preservice teachers' writing skills: an experimental approach, J. Sci. Educ. Technol, 34, 1260, 10.1007/s10956-024-10148-2 · DOI
- Means, 2013, Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies, 10.1037/e615702010-001 · doi:10.1037/e615702010-001
- Morris, 2008, Estimating effect sizes from pretest-posttest-control group designs, Organ. Res. Methods, 11, 364, 10.1177/1094428106291059 · DOI · Paper page
- Norman, 2013, The Design of Everyday Things (Revised and Expanded Edition)
- 2025, What Should Teachers Teach and Students Learn in a Future of Powerful AI?
- 2026, OECD Digital Education Outlook 2026: Exploring Effective Uses of Generative AI in Education
- 2023, GPT-4 technical report, arXiv [Preprint] arXiv:2303.08774, 10.48550/arXiv.2303.08774 · DOI · Paper page
- Pan, 2025, Effects of GenAI-empowered interactive support on university EFL students' self-regulated strategy use and engagement in reading, Internet Higher Educ., 65, 100991, 10.1016/j.iheduc.2024.100991 · DOI
- Pellegrino, 2001, Knowing What Students Know
- Qi, 2024, The impact of generative artificial intelligence tools on college students' critical thinking and autonomous learning ability, e-Education Research, 45, 67, 10.13811/j.cnki.eer.2024.12.009 · doi:10.13811/j.cnki.eer.2024.12.009
- Qureshi, 2023, Exploring the use of ChatGPT as a tool for learning and assessment in undergraduate computer science curriculum: opportunities and challenges, arXiv [Preprint] arXiv:2304.11214, 10.1145/3613944.3613946 · DOI
- Russell, 2001, The No Significant Difference Phenomenon: A Comparative Research Annotated Bibliography on Technology for Distance Education
- Schwarzer, 2015, “Meta-analysis with binary outcomes,”, 10.1007/978-3-319-21416-0_3 · DOI
- Shi, 2024, A study on the impact of generative artificial intelligence supported situational interactive teaching on students' 'flow' experience and learning effectiveness - a case study of legal education in China, Asia Pac. J. Educ., 44, 112, 10.1080/02188791.2024.2305161 · DOI
- Song, 2025, Interactions with generative AI chatbots: unveiling dialogic dynamics, students' perceptions, and practical competencies in creative problem-solving, Int. J. Educ. Technol. Higher Educ., 22, 12, 10.1186/s41239-025-00508-2 · DOI
- Sun, 2024, Would ChatGPT-facilitated programming mode impact college students' programming behaviors, performances, and perceptions? An empirical study, Int. J. Educ. Technol. Higher Educ, 21, 14, 10.1186/s41239-024-00446-5 · DOI · Paper page
- Sweller, 1988, Cognitive load during problem solving, Cognit. Sci., 12, 257, 10.1207/s15516709cog1202_4 · doi:10.1207/s15516709cog1202_4 · Paper page
- Sweller, 1985, The use of worked examples as a substitute for problem solving in learning algebra, Cognit. Instr., 2, 59, 10.1207/s1532690xci0201_3 · DOI · Paper page
- Thomas, 2004, A process for systematically reviewing the literature: providing the research evidence for public health nursing interventions, Worldviews Evid. Based Nurs., 1, 176, 10.1111/j.1524-475X.2004.04006.x · DOI · Paper page
- Trindade, 2025, Teaching mathematical concepts in management with generative artificial intelligence: the power of human oversight in AI-driven learning, Int. J. Manage. Educ., 23, 101104, 10.1016/j.ijme.2024.101104 · DOI
- 2023, Guidance for Generative AI in Education and Research
- Varela, 2017, Learning outcomes of study-abroad programs: a meta-analysis, Acad. Manag. Learn. Educ., 16, 531, 10.5465/amle.2015.0250 · DOI
- Viechtbauer, 2010, Conducting Meta-Analyses in R with the metafor Package, J. Statis. Softw., 36, 1, 10.18637/jss.v036.i03 · DOI · Paper page
- Viechtbauer, 2010, Outlier and influence diagnostics for meta-analysis, Res. Synth. Methods, 1, 112, 10.1002/jrsm.11 · DOI · Paper page
- Wang, 2024, The impact of different conversational generative AI chatbots on EFL learners: an analysis of willingness to communicate, foreign language speaking anxiety, and self-perceived communicative competence, System, 127, 103533, 10.1016/j.system.2024.103533 · DOI · Paper page
- Yan, 2024, AI education empowers the research of higher vocational medical imaging courses: a case study of x-ray imaging technology, Modern Vocational Educ., 23, 98
- Yilmaz, 2023, The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation, Comp. Educ. Artif. Intell., 4, 100147, 10.1016/j.caeai.2023.100147 · DOI · Paper page
- Zhou, 2025, Supporting English speaking practice in higher education: the impact of AI chatbot-integrated mobile-assisted blended learning framework, Educ. Inf. Technol., 30, 14629, 10.1007/s10639-025-13401-2 · DOI
- Zhou, 2024, Innovative music education: an empirical assessment of ChatGPT-4's impact on student learning experiences, Educ. Inf. Technol, 29, 20855, 10.1007/s10639-024-12705-z · DOI
- Zhu, 2025, Exploring the impact of generative artificial intelligence on students' learning outcomes: a meta-analysis, Educ. Inf. Technol., 30, 16211, 10.1007/s10639-025-13420-z · DOI
Cited by
Generative AI in Higher Education: Evidence Synthesis of Applied Learning Outcomes
Moen, M. N. M. B. A., Rohmatin, A., Nurazizah, M. S., & Kaleem, M. (2026) · International Journal of Applied Research and Innovation · doi:10.65310/x5zzye23
Metadata
- Authors
- Fan, C., Ke, L., Chen, Z., & Lv, P.
- Affiliations
- Institute of Education, Xiamen University
- School of Marxism, NingboTech University
- School of Educational Science, Shenyang Normal University
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2026-05-15
- Volume
- 17
- ISSN
- 1664-1078
- Cited by
- 9
- References
- 37
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Exploring the effect of GenAI on learning outcomes in higher education: a three-level meta-analysis. https://app.cochat.ai/papers/10.3389/fpsyg.2026.1758670
- The paper
- Fan, C., Ke, L., Chen, Z., & Lv, P. (2026). Exploring the effect of GenAI on learning outcomes in higher education: a three-level meta-analysis. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2026.1758670
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.