AI in informal digital English learning: A meta-analysis of its effectiveness on proficiency, motivation, and self-regulation

Bias in meta-analysis detected by a simple, graphical test

Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722

The Cochrane Collaboration's tool for assessing risk of bias in randomised trials

Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817

Statistical Power Analysis for the Behavioral Sciences

Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373

Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis

Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099

Statistical Methods for Meta-Analysis.

Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,840

Self-determination theory

Deci, E. L., & Ryan, R. M. (2012) · Handbook of Theories of Social Psychology: Volume 1 · doi:10.4135/9781446249215.n21 · Cited by 3,161

Outlier and influence diagnostics for meta-analysis

Viechtbauer, W., & Cheung, M. W.-L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.11 · Cited by 2,949

Standard Quality Assessment Criteria for Evaluating Primary Research Papers from a Variety of Fields

Kmet, L. M., Cook, L. S., & Lee, R. C. (2004) · University of Alberta Library · doi:10.7939/r37m04f16 · Cited by 1,682

Exploratory Data Analysis.

Birch, J. B., & Tukey, J. W. (1978) · Journal of the American Statistical Association · doi:10.2307/2286300 · Cited by 1,465

Ethical principles for artificial intelligence in education

Nguyen, A., Ngo, H. N., Hong, Y., Dang, B., & Nguyen, B.-P. T. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11316-w · Cited by 1,228

The effectiveness of corrective feedback in SLA: A meta-analysis

Li, S. (2010) · Language Learning · doi:10.1111/j.1467-9922.2010.00561.x · Cited by 941

Challenges and Opportunities of Generative AI for Higher Education as Explained by ChatGPT

Michel-Villarreal, R., Vilalta-Perdomo, E., Salinas-Navarro, D. E., Thierry-Aguilera, R., & Gerardou, F. S. (2023) · Education Sciences · doi:10.3390/educsci13090856 · Cited by 877

The impact of Generative AI (GenAI) on practices, policies and research direction in education: a case of ChatGPT and Midjourney

Chiu, T. K. F. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2253861 · Cited by 852

Chatbots for language learning—Are they really useful? A systematic review of chatbot‐supported language learning

Huang, W., Hew, K. F., & Fryer, L. K. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12610 · Cited by 830

Does coaching work? A meta-analysis on the effects of coaching on individual level outcomes in an organizational context

Theeboom, T., Beersma, B., & van Vianen, A. E. M. (2014) · The Journal of Positive Psychology · doi:10.1080/17439760.2013.837499 · Cited by 771

Effectiveness of immersive virtual reality using head‐mounted displays on learning performance: A meta‐analysis

Wu, B., Yu, X., & Gu, X. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.13023 · Cited by 640

Effects of artificial intelligence-enabled personalized recommendations on learners’ learning engagement, motivation, and outcomes in a flipped classroom

Huang, A. Y. Q., Lu, O. H. T., & Yang, S. J. H. (2023) · Computers & Education · doi:10.1016/j.compedu.2022.104684 · Cited by 605

Artificial intelligence in language instruction: impact on English learning achievement, L2 motivation, and self-regulated learning

Wei, L. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1261955 · Cited by 536

Measuring EFL learners’ use of ChatGPT in informal digital learning of English based on the technology acceptance model

Liu, G., & Ma, C. (2024) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2023.2240316 · Cited by 511

Chatbot learning partners: connecting learning experiences, interest and competence

Fryer, L. K., Nakao, K., & Thompson, A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.023 · Cited by 470

Learning in a mobile age: an investigation of student motivation

Ciampa, K. (2013) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12036 · Cited by 453

Artificial intelligence-based language learning: illuminating the impact on speaking skills and self-regulation in Chinese EFL context

Qiao, H., & Zhao, A. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1255594 · Cited by 395

Not quite eye to A.I.: student and teacher perspectives on the use of generative artificial intelligence in the writing process

Barrett, A., & Pack, A. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00427-0 · Cited by 391

Implementation of an AI chatbot as an English conversation partner in EFL speaking classes

Yang, H., Kim, H., Lee, J. H., & Shin, D. (2022) · ReCALL · doi:10.1017/s0958344022000039 · Cited by 373

Educational AI Chatbots for Content and Language Integrated Learning

Mageira, K., Pittou, D., Papasalouros, A., Kotis, K., Zangogianni, P., & Daradoumis, A. (2022) · Applied Sciences · doi:10.3390/app12073239 · Cited by 372

Artificial intelligence in EFL speaking: Impact on enjoyment, anxiety, and willingness to communicate

Zhang, C., Meng, Y., & Ma, X. (2024) · System · doi:10.1016/j.system.2024.103259 · Cited by 334

Impacts of an AI-based chabot on College students' after-class review, academic performance, self-efficacy, learning attitude, and motivation

Lee, Y.-F., Hwang, G.-J., & Chen, P.-Y. (2022) · Educational Technology Research and Development · doi:10.1007/s11423-022-10142-8 · Cited by 323

Language Learning and Teaching Beyond the Classroom: An Introduction to the Field

Benson, P. (2011) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230306790_2 · Cited by 309

Beyond the Language Classroom

Benson, P., & Reinders, H. (2011) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230306790 · Cited by 305

Exploring AI-mediated informal digital learning of English (AI-IDLE): a mixed-method investigation of Chinese EFL learners’ AI adoption and experiences

Liu, G. L., Darvin, R., & Ma, C. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2024.2310288 · Cited by 299

Evaluation of various estimators for standardized mean difference in meta‐analysis

Lin, L., & Aloe, A. M. (2021) · Statistics in Medicine · doi:10.1002/sim.8781 · Cited by 297

Enhancing metacognition in self-directed language learning

Victori, M., & Lockhart, W. (1995) · System · doi:10.1016/0346-251x(95)00010-h · Cited by 295

Digital storytelling as an interdisciplinary project to improve students’ English speaking and creative thinking

Yang, Y.-T. C., Chen, Y.-C., & Hung, H. (2020) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1750431 · Cited by 268

Affective variables and informal digital learning of English: Keys to willingness to communicate in a second language

Lee, J. S., & Drajati, N. A. (2019) · Australasian Journal of Educational Technology · doi:10.14742/ajet.5177 · Cited by 266

Examining the roles of social presence and human-likeness on Iranian EFL learners’ motivation using artificial intelligence technology: a case of CSIEC chatbot

Ebadi, S., & Amini, A. (2022) · Interactive Learning Environments · doi:10.1080/10494820.2022.2096638 · Cited by 252

Using automated written corrective feedback in the writing classrooms: effects on L2 writing accuracy

Barrot, J. S. (2023) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1936071 · Cited by 248

Incorporating a reflective thinking promoting mechanism into artificial intelligence-supported English writing environments

Liu, C., Hou, J., Tu, Y.-F., Wang, Y., & Hwang, G.-J. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.2012812 · Cited by 231

Rewards and Intrinsic Motivation: Resolving the Controversy

Cameron, J., & Pierce, W. D. (2002) · Cited by 224

Measuring self-regulated learning and the role of AI: Five years of research using multimodal multichannel data

Molenaar, I., Mooij, S. D., Azevedo, R., Bannert, M., Järvelä, S., & Gašević, D. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107540 · Cited by 217

Using artificial intelligence to foster students’ writing feedback literacy, engagement, and outcome: a case of Wordtune application

Rad, H. S., Alipour, R., & Jafarpour, A. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2208170 · Cited by 214

When IDLE Hands Make an English Workshop: Informal Digital Learning of English and Language Proficiency

Lee, J. S., & Dressman, M. (2017) · TESOL Quarterly · doi:10.1002/tesq.422 · Cited by 209

The learner centric ecology of resources: A framework for using technology to scaffold learning

Luckin, R. (2007) · Computers & Education · doi:10.1016/j.compedu.2007.09.018 · Cited by 208

Relationships between teachers’ technostress, technological pedagogical content knowledge (TPACK), school support and demographic variables: A structural equation modeling

Özgür, H. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106468 · Cited by 201

Modeling students’ perceptions of artificial intelligence assisted language learning

An, X., Chai, C. S., Li, Y., Zhou, Y., & Yang, B. (2023) · Computer Assisted Language Learning · doi:10.1080/09588221.2023.2246519 · Cited by 196

Effects of technology-enhanced language learning on reducing EFL learners’ public speaking anxiety

Chen, Y.-C. (2024) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2055083 · Cited by 189

Effects of reading strategy instruction in English as a second language on students’ academic reading comprehension

Yapp, D. J., de Graaff, R., & van den Bergh, H. (2021) · Language Teaching Research · doi:10.1177/1362168820985236 · Cited by 167

A latent profile analysis of EFL learners’ self-efficacy: Associations with academic emotions and language proficiency

Wang, Y., Shen, B., & Yu, X. (2021) · System · doi:10.1016/j.system.2021.102633 · Cited by 166

New technology, new role of parents: How parents' beliefs and behavior affect students’ digital media self-efficacy

Hammer, M., Scheiter, K., & Stürmer, K. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106642 · Cited by 164

Integrating generative AI in knowledge building

Chen, B., Zhu, X., & Díaz del Castillo H., F. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100184 · Cited by 159

Artificial Intelligence image recognition using self-regulation learning strategies: effects on vocabulary acquisition, learning anxiety, and learning behaviours of English language learners

Hsu, T., Chang, C., & Jen, T. H. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2023.2165508 · Cited by 158

An empirical study of the efficacy of AI chatbots for English as a foreign language learning in primary education

Yuan, Y. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2282112 · Cited by 148

Using Generative Artificial Intelligence for Language Education Research: Insights from Using OpenAI 's ChatGPT

Pack, A., & Maloney, J. S. (2023) · TESOL Quarterly · doi:10.1002/tesq.3253 · Cited by 140

Fostering Secondary School Students’ AI Literacy through Making AI-Driven Recycling Bins

Ng, D. T. K., Su, J., & Chu, S. K. W. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-12183-9 · Cited by 130

Mobile-assisted vocabulary learning: Investigating receptive and productive vocabulary knowledge of Chinese EFL learners

Li, Y., & Hafner, C. A. (2021) · ReCALL · doi:10.1017/s0958344021000161 · Cited by 128

Untitled work

(2021) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 127

Quantity and diversity of informal digital learning of English

Lee, J. S. (2019) · Language Learning & Technology · doi:10.64152/10125/44675 · Cited by 123

Proposing a task-oriented chatbot system for EFL learners speaking practice

Hsu, M.-H., Chen, P.-S., & Yu, C.-S. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1960864 · Cited by 119

Providing graduated corrective feedback in an intelligent computer-assisted language learning environment

Ai, H. (2017) · ReCALL · doi:10.1017/s095834401700012x · Cited by 113

Left to their own devices: the everyday realities of one-to-one classrooms

Selwyn, N., Nemorin, S., Bulfin, S., & Johnson, N. F. (2017) · Oxford Review of Education · doi:10.1080/03054985.2017.1305047 · Cited by 99

The role of Informal Digital Learning of English in Korean and Swedish EFL learners’ communication behaviour

Lee, J. S., & Sylvén, L. K. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13082 · Cited by 98

Effects of intelligent personal assistants on EFL learners’ oral proficiency outside the classroom

Tai, T. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2075013 · Cited by 88

Examining the Effectiveness of Peer Feedback in Second Language Writing: A Meta‐Analysis

Vuogan, A., & Li, S. (2022) · TESOL Quarterly · doi:10.1002/tesq.3178 · Cited by 87

Facilitating authentic contextual EFL speaking and conversation with smart mechanisms and investigating its influence on learning achievements

Hwang, W., Guo, B.-C., Hoang, A., Chang, C., & Wu, N.-T. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2095406 · Cited by 83

The impacts of constructivist learning design and learning analytics on students’ engagement and self-regulation

Banihashem, S. K., Farrokhnia, M., Badali, M., & Noroozi, O. (2022) · Innovations in Education and Teaching International · doi:10.1080/14703297.2021.1890634 · Cited by 82

Self-Directed Learning and the Sensemaking Paradox

Butcher, K. R., & Sumner, T. (2011) · Human-Computer Interaction · doi:10.1080/07370024.2011.556552 · Cited by 81

Chatbot-based learning of logical fallacies in EFL writing: perceived effectiveness in improving target knowledge and learner motivation

Zhang, R., Zou, D., & Cheng, G. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2023.2220374 · Cited by 78

Investigation of the Influence of Artificial Intelligence Markup Language-Based LINE ChatBot in Contextual English Learning

Chien, Y.-C., Wu, T., Lai, C., & Huang, Y. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.785752 · Cited by 72

Willingness to communicate in digital and non-digital EFL contexts: scale development and psychometric testing

Lee, J. S., & Drajati, N. A. (2020) · Computer Assisted Language Learning · doi:10.1080/09588221.2019.1588330 · Cited by 70

Effects of regulation on interaction pattern in web-based collaborative writing activity

Wang, L. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2019.1667831 · Cited by 69

Correction for bias in meta‐analysis of little‐replicated studies

Doncaster, C. P., & Spake, R. (2017) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12927 · Cited by 66

Conceptualizing self-regulated reading-to-write in ESL/EFL writing and investigating its relationships to motivation and writing competence

Bai, B., & Wang, J. (2020) · Language Teaching Research · doi:10.1177/1362168820971740 · Cited by 65

Strategies for enhancing self-regulation in e-learning: a review of selected journal publications from 2010 to 2020

Lai, C., & Hwang, G. (2021) · Interactive Learning Environments · doi:10.1080/10494820.2021.1943455 · Cited by 63

Visualizing a disembodied agent: young EFL learners’ perceptions of voice-controlled conversational agents as language partners

Lee, S., & Jeon, J. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2067182 · Cited by 62

Affordances and limitations of learning analytics for computer-assisted language learning: a case study of the VITAL project

Gelan, A., Fastré, G., Verjans, M., Martin, N., Janssenswillen, G., Creemers, M., Lieben, J., Depaire, B., & Thomas, M. (2018) · Computer Assisted Language Learning · doi:10.1080/09588221.2017.1418382 · Cited by 60

Effect‐Driven Sample Sizes in Second Language Instructed Vocabulary Acquisition Research

Nicklin, C., & Vitta, J. P. (2021) · Modern Language Journal · doi:10.1111/modl.12692 · Cited by 56

To ban or not to ban? The effect of permissive versus restrictive laptop policies on student outcomes and teaching evaluations

Elliott-Dorans, L. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.07.008 · Cited by 49

Roles, strategies, and research issues of generative AI in the mobile learning era

Lai, C., & Tu, Y. (2024) · International Journal of Mobile Learning and Organisation · doi:10.1504/ijmlo.2024.141836 · Cited by 49

Learning to construct authorial voice through citations: A longitudinal case study of L2 postgraduate novice writers

Sun, Q., Kuzborska, I., & Soden, B. (2022) · System · doi:10.1016/j.system.2022.102765 · Cited by 46

Autonomy in Language Education

Raya, M. J., & Vieira, F. (2020) · Routledge eBooks · doi:10.4324/9780429261336 · Cited by 44

Leveraging complexity frameworks to refine theories of engagement: Advancing self‐regulated learning in the age of artificial intelligence

Hilpert, J. C., Greene, J. A., & Bernacki, M. L. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13340 · Cited by 41

Ethical content in artificial intelligence systems: A demand explained in three critical points

Correa, A., & Serafim, M. C. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1074787 · Cited by 41

A Preliminary Study on Graduate Student Instructors' Exploration, Perception, and Use of ChatGPT

Bao, Y., & Li, B. (2023) · International Journal of Computer-Assisted Language Learning and Teaching · doi:10.4018/ijcallt.332873 · Cited by 39

Chinese ESL learners’ perceptual errors of English connected speech: Insights into listening comprehension

Wong, S. W. L., Leung, V. W. H., Tsui, J. K. Y., Dealey, J., & Cheung, A. (2021) · System · doi:10.1016/j.system.2021.102480 · Cited by 39

In a World of SMART Technology, Why Learn Another Language?

Godwin‐Jones, R. (2019) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 36

A systematic review of meta-analyses in second language research: current practices, issues, and recommendations

Vuogan, A., & Li, S. (2023) · Applied Linguistics Review · doi:10.1515/applirev-2022-0192 · Cited by 35

Design of blended Learning Mode and Practice Community using Intelligent Cloud Teaching

He, J., Ma, T., & Zhang, Y. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11606-x · Cited by 34

A Framework for Learning Beyond the Classroom

Reinders, H. (2020) · Routledge eBooks · doi:10.4324/9780429261336-6 · Cited by 31

Investigating the impact of computer-assisted pronunciation teaching (CAPT) on improving intermediate EFL learners’ pronunciation ability

Saleh, A. J., & Gilakjani, A. P. (2020) · Education and Information Technologies · doi:10.1007/s10639-020-10275-4 · Cited by 29

Facilitating Global Collaboration and Knowledge Sharing in Higher Education With Generative AI

(2023) · Advances in higher education and professional development book series · doi:10.4018/979-8-3693-0487-7 · Cited by 27

Establishing Connections: Interactivity Factors for a Distance Education Course

Ehrlich, D. (2002) · Cited by 26

Leveraging Generative AI for Cross-Cultural Knowledge Exchange in Higher Education

Mahboob, K., Asif, R., & Laila, U. (2023) · Advances in higher education and professional development book series · doi:10.4018/979-8-3693-0487-7.ch008 · Cited by 23

Doing Meta-Analysis in SLA: Practices, Choices, and Standards

Li, S., Shintani, R., & Ellis, R. (2012) · eSpace (Curtin University) · Cited by 17

An automated self-regulation advising mechanism in mobile learning environment to promote students' learning achievement, self-regulated awareness and approaches to science learning

Chien, S. Y., & Su, Y. (2023) · International Journal of Mobile Learning and Organisation · doi:10.1504/ijmlo.2024.10056692 · Cited by 7

Disclosing Chinese college students’ flow experience in GenAI-assisted informal digital learning of english: A self-determination theory perspective

Wu, H., & Wang, Y. (2025) · Learning and Motivation · doi:10.1016/j.lmot.2025.102134 · Cited by 149

Examining longitudinal development of writing motivation in the GenAI context: A self-determination theory perspective

Teng, M. F. (2025) · Learning and Motivation · doi:10.1016/j.lmot.2025.102157 · Cited by 58

A systematic review and meta-analysis of the effectiveness of Generative Artificial Intelligence (GenAI) on students’ motivation and engagement

Xia, Q., Li, W., Yang, Y., Weng, X., & Chiu, T. K. F. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100455 · Cited by 45

The Motivational Impact of GenAI Tools in Language Learning: a Quasi‐Experiment Study

Jiang, R., Gang, Y., & Shen, Q. (2025) · International Journal of Applied Linguistics · doi:10.1111/ijal.12701 · Cited by 36

A meta-analysis of generative AI effects on language proficiency and affective–cognitive outcomes in language learning

Saarela, M., Gunasekara, S., & Kumarage, P. M. (2026) · Discover Computing · doi:10.1007/s10791-026-10015-1 · Cited by 28

Unveiling the effects of GenAI on motivation of learning English as a second/foreign language: Evidence from meta-analysis

Xiong, M., & Teo, T. P. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100744 · Cited by 20

The cognitive-affective impact of generative AI on EFL/ESL learning: A meta-analysis

Hsu, L., & Wang, Y.-C. (2026) · Language learning & technology · doi:10.64152/10125/73714

Enhancing Language Learning Through Generative Artificial Intelligence in Blended Learning: An Empirical Study on Productive and Receptive of Informal Digital Learning English

Lee, T. H., & Cho, V. (2025) · Journal of Educational Technology Systems · doi:10.1177/00472395241266454 · Cited by 15

Examining generative AI–mediated informal digital learning of English practices with social cognitive theory: a mixed-methods study

Guan, L., Zhang, Y., & Gu, M. M. (2024) · ReCALL · doi:10.1017/s0958344024000259 · Cited by 114