The impact of generative artificial intelligence on students’ higher order thinking: evidence from a three-level meta-analysis
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Two reviewers independently assessed the quality of the 35 studies using the quality index checklist developed by Montuori et al. (2024) and Nie et al. (2025).
“Two reviewers independently assessed the quality of the 35 studies using the quality index checklist developed by Montuori et al. (2024) and Nie et al. (2025) (see Table 3).”
From Can project-based learning improve students’ mathematics learning outcomes: a three-level meta-analysis (2026) · cites this paper as Nie et al. (2025)
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283 · see citing works
Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry
Flavell, J. H. (1979) · American Psychologist · doi:10.1037/0003-066x.34.10.906 · Cited by 11,282 · cited 1× · see citing works
“Metacognition involves awareness and regulation of cognitive processes during learning, including planning, monitoring, and reflecting (Flavell, 1979 ; Krieglstein et al., 2023; Lu et al., 2024).”
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242 · cited 1× · see citing works
“Research in this domain can be categorized into four areas: profiling and prediction, intelligent tutoring systems, assessment and evaluation, and adaptive systems and personalization (Bond et al., 2024; Zawacki-Richter et al., 2019).”
Methley, A. M., Campbell, S., Chew-Graham, C., McNally, R., & Cheraghi-Sohi, S. (2014) · BMC Health Services Research · doi:10.1186/s12913-014-0579-0 · Cited by 2,706 · see citing works
Estimating effect sizes from pretest-posttest-control group designs
Morris, S. B. (2008) · Organizational Research Methods · doi:10.1177/1094428106291059 · Cited by 2,133 · see citing works
Doing Meta-Analysis with R: A Hands-On Guide
Harrer, M., Cuijpers, P., Furukawa, T. A., & Ebert, D. D. (2021) · doi:10.1201/9781003107347 · Cited by 1,850 · see citing works
Walter, Y. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00448-3 · Cited by 1,113 · cited 1× · see citing works
“…AI literacy courses can help students foster prompt engineering skills, enabling them to obtain desired responses from Gen-AI tools and acquire knowledge through effective interaction, enhancing AI literacy and making learning more engaging and effective (Eager & Brunton, 2023; Walter, 2024).”
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 887 · see citing works
Chiu, T. K. F. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2253861 · Cited by 852 · cited 1× · see citing works
“For instance, ChatGPT’s outputs can be unreliable and contain inaccuracies (Urban et al., 2024), emphasizing the need for critical thinking (Chiu, 2023; Tedla & Chen, 2024).”
Bond, M., Khosravi, H., De Laat, M., Bergdahl, N., Negrea, V., Oxley, E., Pham, P., Chong, S. W., & Siemens, G. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00436-z · Cited by 852 · cited 2× · see citing works
“Research in this domain can be categorized into four areas: profiling and prediction, intelligent tutoring systems, assessment and evaluation, and adaptive systems and personalization (Bond et al., 2024; Zawacki-Richter et al., 2019).”
Do <scp>AI</scp> chatbots improve students learning outcomes? Evidence from a meta‐analysis
Wu, R., & Yu, Z. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13334 · Cited by 576 · cited 1× · see citing works
“Previous meta-analyses have also examined the impact of AI chatbots on learning performance, motivation, self-efficacy, and interest, and found positive effects in all these outcomes (Wu & Yu, 2024).”
Yusuf, A., Pervin, N., & Román-González, M. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00453-6 · Cited by 554 · cited 1× · see citing works
“While some express concerns about over-reliance on Gen-AI (Yusuf et al., 2024), emerging evidence highlights its potential to support learning.”
Promises and challenges of generative artificial intelligence for human learning
Yan, L., Greiff, S., Teuber, Z., & Gašević, D. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02004-5 · Cited by 499 · cited 1× · see citing works
“…phenomenon (repeatedly piecing together information), the “hal-lucinations” (generating false or untrue content), and “sycophantic behavior” (generating biased content to meet users’ expectations), to critically evaluate AI-generated content and identify unreliable information (Yan et al., 2024).”
Rodgers, M. A., & Pustejovsky, J. E. (2021) · Psychological Methods · doi:10.1037/met0000300 · Cited by 492 · cited 1× · see citing works
“The results of Egger’s regression test were reported for both the two-level and three-level models, with the three-level model including 2√N as a predictor (Cui et al., 2024 ; Rodgers & Pustejovsky, 2021; Zhang et al., 2024).”
A study of the impact of project-based learning on student learning effects: a meta-analysis study
Zhang, L., & Ma, Y. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1202728 · Cited by 455 · cited 4× · see citing works
“Drawing on prior meta-analysis studies of HOT (Ilgun Dibek et al., 2024; Wahono et al., 2020; Zhan et al., 2023; Zhang & Ma, 2023), this study incorporates subcat-egories such as critical thinking, metacognitive thinking, reflection, problem-solving, creativity, and computational thinking.”
InfluentialChatGPT improves creative problem-solving performance in university students: An experimental study
Urban, M., Děchtěrenko, F., Lukavský, J., Hrabalová, V., Svacha, F., Brom, C., & Urban, K. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105031 · Cited by 396 · see citing works
Towards hybrid <scp>human‐AI</scp> learning technologies
Molenaar, I. (2022) · European Journal of Education · doi:10.1111/ejed.12527 · Cited by 348 · see citing works
Essel, H. B., Vlachopoulos, D., Essuman, A. B., & Amankwa, J. O. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100198 · Cited by 296 · see citing works
Prompting Higher Education Towards AI-Augmented Teaching and Learning Practice
Eager, B., & Brunton, R. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.5.02 · Cited by 287 · see citing works
Evidence of STEM Enactment Effectiveness in Asian Student Learning Outcomes
Wahono, B., Lin, P.-L., & Chang, C.-Y. (2020) · International Journal of STEM Education · doi:10.1186/s40594-020-00236-1 · Cited by 286 · see citing works
A systematic review of <scp>ChatGPT</scp> use in K‐12 education
Zhang, P., & Tur, G. (2024) · European Journal of Education · doi:10.1111/ejed.12599 · Cited by 280 · see citing works
Lee, H.-Y., Chen, P.-H., Wang, W.-S., Huang, Y.-M., & Wu, T.-T. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00447-4 · Cited by 273 · cited 5× · see citing works
“Artificial intelligence (AI), defined as the ability of machines to demonstrate intelligence and perform functions requiring human-like abilities (Lee & Lee, 2024; Liu et al., 2025), has become a ubiquitous technology in our lives.”
InfluentialBest humans still outperform artificial intelligence in a creative divergent thinking task
Koivisto, M., & Grassini, S. (2023) · Scientific Reports · doi:10.1038/s41598-023-40858-3 · Cited by 247 · see citing works
Dalalah, D., & Dalalah, O. M. A. (2023) · The International Journal of Management Education · doi:10.1016/j.ijme.2023.100822 · Cited by 218 · see citing works
Affordances and challenges of artificial intelligence in K-12 education: a systematic review
Crompton, H., Jones, M. V., & Burke, D. (2024) · Journal of Research on Technology in Education · doi:10.1080/15391523.2022.2121344 · Cited by 213 · cited 1× · see citing works
“Furthermore, university students are more exposed to and integrated with AI technologies in their daily education, while K-12 students face challenges such as limited access to and proficiency in using these technologies (Crompton et al., 2024; Deng et al., 2025; Gao et al., 2014).”
Is Chatgpt a menace for creative writing ability? An experiment
Niloy, A. C., Akter, S., Sultana, N., Sultana, J., & Rahman, S. I. U. (2024) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12929 · Cited by 198 · see citing works
Lu, J., Zheng, R., Gong, Z., & Xu, H. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3369690 · Cited by 144 · see citing works
Large language models for generating medical examinations: systematic review
Artsi, Y., Sorin, V., Konen, E., Glicksberg, B. S., Nadkarni, G., & Klang, E. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05239-y · Cited by 128 · see citing works
The cognitive and academic benefits of Cogmed: A meta-analysis
Aksayli, N. D., Sala, G., & Gobet, F. (2019) · Educational Research Review · doi:10.1016/j.edurev.2019.04.003 · Cited by 123 · cited 1× · see citing works
“Previous studies have indicated that this approach provides more accurate estimates (Aksayli et al., 2019; Montuori et al., 2024; Morris, 2008; Zeng & Luo, 2024; Zhang et al., 2024).”
Development and validation of ChatGPT literacy scale
Lee, S., & Park, G. (2024) · Current Psychology · doi:10.1007/s12144-024-05723-0 · Cited by 100 · see citing works
Wang, F., Cheung, A. C. K., Neitzel, A. J., & Chai, C. S. (2025) · Review of Educational Research · doi:10.3102/00346543241255621 · Cited by 64 · see citing works
Facilitating nursing and health education by incorporating ChatGPT into learning designs
Chang (2024) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.30191/ets.202401_27(1).tp02 · Cited by 61 · see citing works
Influence of artificial intelligence tools on higher order thinking skills: a meta-analysis
Ilgun Dibek, M., Sahin Kursad, M., & Erdogan, T. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2024.2402028 · Cited by 45 · see citing works
Use of large language models might affect our cognitive skills
Heersmink, R. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01859-y · Cited by 44 · see citing works
Wang, W.-S., Lin, C.-J., Lee, H.-Y., Huang, Y.-M., & Wu, T.-T. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2024.2375644 · Cited by 43 · cited 9× · see citing works
“The “Four C” model outlines its progression from mini-c (personal creativity) to little-c (everyday creativity), pro-c (professional creativity), and big-C (genius creativity) (Kaufman & Beghetto, 2009; Wang et al., 2024c).”
InfluentialA Meta-analysis of the Effect of Multimedia Technology on Creative Performance
Liu, M., Pang, W., Guo, J., & Zhang, Y. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-10981-1 · Cited by 25 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Wang, C., Zhang, W., & Cheng, J. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1868415
- Authors
- Nie, X., Tian, Y., Liu, M., Wu, D., & Guo, Y.
- Affiliations
- Central China Normal University (CN)
- Beijing Normal University (CN)
- Corresponding author
- Tian, Yuan
- Venue
- Education and Information Technologies
- Published
- 2025-09-20
- Volume
- 30
- Issue
- 17
- Pages
- 25359-25390
- ISSN
- 1360-2357 (ISSN-L)
- 1573-7608
- OpenAlex
- W4414372594
- Cited by
- 20
- References
- 36
- Citations by year
- 2026: 20
- FWCI
- 20.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Education and Information Technologies (publishedVersion)
- Funders
- National Natural Science Foundation of China (62377025)
- Fundamental Research Funds for the Central Universities (CCNU24JCPT033)
- Collaborative Innovation Center of Assessment towards Basic Education Quality at Beijing Normal University (BJZK-2024A1-20013)
- Topics
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Social Sciences › Education › Education and Critical Thinking Development
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Keywords
- generative AI, higher-order thinking skills, critical thinking, creativity, problem solving, computational thinking, artificial intelligence in education, student cognitive development, intervention duration, sample size effects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
