Personalized language learning with an LLM chatbot: effects of immediate vs. delayed corrective feedback
Open accessThe DOI matches its Crossref record; 115 of the 116 references it cites were found in a registry or an index; none of the 97 sources its claims cite is checked for support yet.
Abstract
The emergence of Large Language Models (LLMs) has opened new possibilities for language learning through conversational interaction with chatbots. Yet, little empirical evidence exists on how students experience such interactions and how corrective feedback should be provided. Research suggests that immediate corrective feedback is generally more effective than delayed feedback. Nevertheless, learners' perception of this effectiveness and their preferences for feedback timing, particularly in the domain of Computer-Assisted Language Learning (CALL), remain underexplored. This study investigates the feasibility of providing immediate feedback and examines the impact of feedback timing on user experience and grammar learning gains in English. An in-the-wild experiment was conducted with 66 L2 English learners, who integrated chatbot sessions into their English course as an extracurricular activity over one semester. Participants were randomly assigned to two groups receiving feedback either during or after the conversation. Findings reveal no significant difference in learning gains, but immediate feedback enhanced user experience, leading to overall positive perceptions of the chatbot. Additionally, we explore users' perceptions of the chatbot's social role and personality, offering a roadmap for future enhancements. These results provide valuable insights into the potential of LLMs and chatbots for language learning.
Overview
CoChat Summary
TL;DR
In an in-the-wild experiment with 66 L2 English learners (54 analyzed), an LLM-powered chatbot provided either immediate or delayed corrective feedback over 12 sessions. Immediate feedback improved perceived effectiveness and user experience, but the study found no significant difference in grammar learning gains between feedback timing conditions.
Key findings
- No significant difference in grammar learning outcomes between immediate corrective feedback (ICF) and delayed corrective feedback (DCF): language assessment scores were ICF x = 3.14 vs. DCF x = 2.18, t(47.99) = 1.35, p = 0.092, Cohen’s d = 0.37; overall participants corrected x = 2.62 of 15 mistakes. A GLMM found no significant relationship between error counts and condition, session number, or error type.
- Immediate feedback improved perceived effectiveness: post-questionnaire ICF x = 3.65 vs. DCF x = 3.08, t(47.96) = 2.01, p = 0.0495, Cohen’s d = 0.56; ICF showed a significant paired increase (x = 1.48, t(22) = 2.63, p = 0.015, d = 0.68), while DCF did not (x = 0.43, t(29) = 1.15, p = 0.259, d = 0.23). Pre-test effectiveness did not differ between groups (t(44.28) = 0.25, p = 0.8, d = 0.07).
- Overall pre-post effectiveness ratings improved: sign test found 22 of 31 non-zero changes were positive, p = 0.0294; estimated probability of positive change was 70.97%, 95% CI [51.96%, 85.78%]. 72.22% (39/54) reported learning something in English, χ²(1) = 9.79, p = 0.0017, 95% CI [58.14%, 83.14%].
- The chatbot was perceived anthropomorphically: 56% considered it male, 31% assigned no gender; mean assigned age was 30.94 (s = 12.59); social role choices were 40% “a random person,” 27.3% “friend,” 10.9% “teacher,” and 21.8% “a mobile application.” Experience was moderately positive (x = 3.69, s = 0.72) and politeness high (x = 4.52, s = 0.75); determiners were the most common error type.
Methods
- In-the-wild between-subject experiment: 66 bachelor students enrolled, 54 completed and were analyzed (24 ICF, 30 DCF); ages 18–23 (x = 20.59, s = 0.98), 43 males and 11 females, mostly native Czech speakers, with self-assessed English levels from A2 to C2. Participants completed 12 chatbot sessions over 4 weeks (3 per week), each until 1,000 characters, outside school.
- The chatbot was a web application using OpenAI GPT-3 text-davinci-003 API, Python/Flask/JavaScript, and Gramformer for grammatical error detection/correction. Feedback types were explicit recast, negative evidence, and combined feedback; ICF corrected the first mistake immediately during conversation, while DCF accumulated errors and showed a summary report after the conversation.
- Measures included pre/post questionnaires on effectiveness, ranking, chatbot personality/social role, experience, and politeness; a language assessment of 25 sentences (about 15 containing the participant’s own errors) scored 1 point per corrected mistake; and logged error counts analyzed with a GLMM. Analyses used R 4.3.2 with sign test, independent/paired t-tests, one-sample proportions test, and p < 0.05.
Limitations
- Paper-stated: no comprehensive pre/post language test; learning was measured via participants’ own mistakes, self-reported proficiency may bias results; varying session topics and external factors such as tiredness or mood may affect error counts or attention; no control group; large dropout (12 of 66); small sample limits generalization; one-month duration may be insufficient; asking participants to correct their own errors may have minimal priming; time was not controlled, though the paper argues this was an alternative design choice rather than necessarily a limitation.
- Paper-stated future needs: more controlled designs, larger samples, a control group, within-subject designs, focus on specific structures such as determiners, diverse learner backgrounds, long-term engagement, and more advanced LLMs.
- Evident from the text: attrition produced imbalanced groups (24 ICF vs. 30 DCF); the paper notes N = 54 may have been underpowered to detect subtle grammar acquisition differences; open-domain conversation lacked structured output practice, which the paper suggests may explain comparable gains despite differing perceived salience.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
0 Valid · 7 Not valid · 73 Not checked · 110 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“while the DCF group showed no significant change (x = 0.43), (t(29) = 1.15, p = 0.259, Cohen's d = 0.23) in effectiveness scores.”
§ Personalized language learning with an LLM chatbot: effects of immediate vs. delayed corrective feedback > 5.1.3 Between-condition comparisons
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Using an independent samples t-test, we compared the responses between the two groups from the pre-questionnaire, which showed no significant difference (t(44.28)= 0.25, p = 0.8, Cohen's d = 0.07).”
§ Personalized language learning with an LLM chatbot: effects of immediate vs. delayed corrective feedback > 5.1.3 Between-condition comparisons
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The exact binomial test yielded p value = 0.0294”
§ Personalized language learning with an LLM chatbot: effects of immediate vs. delayed corrective feedback > 5.1.2 Pre-post change
plainn = 54 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Findings reveal no significant difference in learning gains, but immediate feedback enhanced user experience, leading to overall positive perceptions of the chatbot.”
§ Personalized language learning with an LLM chatbot: effects of immediate vs. delayed corrective feedback > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Out of the 31 non-zero changes, 22 displayed an increase in effectiveness ratings.”
§ Personalized language learning with an LLM chatbot: effects of immediate vs. delayed corrective feedback > 5.1.2 Pre-post change
plainn = 54 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
50 more claims
Create a free account to see all 190 claims and to verify the 82 references still open.
- Probably not a substantial claim. 111
- It may state two separate claims as one. 62
Statistics that don’t add up
Each reported p-value recomputed from its test statistic and degrees of freedom.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“t(47.99)= 1.35, p = 0.092”
§ Personalized language learning with an LLM chatbot: effects of immediate vs. delayed corrective feedback > 5.3.2 Objective measure 5.3.2.1 Language assessment
Reported p = .092 · recomputed p = .183
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Doesn’t add upt(47.99) = 1.35reported p = .092 · recomputed p = .183
“t(47.99)= 1.35, p = .092”
- Consistentt(44.28) = 0.25reported p = .8 · recomputed p = .804
“t(44.28)= 0.25, p = .8”
- Consistentt(47.96) = 2.01reported p = .0495 · recomputed p = .050
“t(47.96)= 2.01, p = .0495”
- Consistentt(22) = 2.63reported p = .015 · recomputed p = .015
“t(22) = 2.63, p = .015”
- Consistentt(29) = 1.15reported p = .259 · recomputed p = .260
“t(29) = 1.15, p = .259”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Personalized language learning with an LLM chatbot: effects of immediate vs. delayed corrective feedback > Abstract
“An in-thewild experiment was conducted with 66 L2 English learners, who integrated chatbot sessions into their English course as an extracurricular activity over one semester.”
§ Personalized language learning with an LLM chatbot: effects of immediate vs. delayed corrective feedback > 1.1 Research questions
“In this study, we present an in-the-wild experiment where 66 students interacted with an LLM-powered chatbot over 12 sessions distributed over a one-month period.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Personalized language learning with an LLM chatbot: effects of immediate vs. delayed corrective feedback > 2.4.2 Recent developments in generative AI for language learning
“Since our data collection in early 2022, the release of ChatGPT has accelerated research on generative AI in language education.”
§ Personalized language learning with an LLM chatbot: effects of immediate vs. delayed corrective feedback > 3.2.2 Grammatical error detection and correction
“At the time the study was conducted in late 2022, this was the most advanced model available to us.”
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
The episodic buffer: a new component of working memory?
Baddeley, A. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01538-2 · Cited by 7,359 · cited 1×
“The serial position effect suggests that words or phrases at the beginning (primacy effect) and end (recency effect) of a sequence are better recalled, impacting sentence structure and retention in language processing (Atkinson and Shiffrin, 1968; Baddeley, 2000; Baddeley et al., 2009).”
Human Memory: A Proposed System and its Control Processes
Atkinson, R. C., & Shiffrin, R. M. (1968) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60422-3 · Cited by 7,216
Foreign Language Classroom Anxiety
HORWITZ, E. K., HORWITZ, M. B., & COPE, J. (1986) · The Modern Language Journal · doi:10.1111/j.1540-4781.1986.tb05256.x · Cited by 5,697
The Role of Consciousness in Second Language Learning1
SCHMIDT, R. W. (1990) · Applied Linguistics · doi:10.1093/applin/11.2.129 · Cited by 5,435 · cited 7×
“On top of all, the “Noticing” hypothesis also supports the value of interaction by positing that conscious awareness of linguistic features is a prerequisite for their acquisition (Schmidt, 1990, 2001).”
InfluentialELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“One of the earliest chatbots, ELIZA, was introduced as a virtual psychoanalyst (Weizenbaum, 1966).”
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022
The Role of the Linguistic Environment in Second Language Acquisition
Long, M. H. (1996) · Handbook of Second Language Acquisition · doi:10.1016/b978-012589042-7/50015-3 · Cited by 3,927
(1985) · Medical Entomology and Zoology · Cited by 3,037
CORRECTIVE FEEDBACK AND LEARNER UPTAKE: Negotiation of Form in Communicative Classrooms
Lyster, R., & Ranta, L. (1997) · Studies in Second Language Acquisition · doi:10.1017/s0272263197001034 · Cited by 2,629 · cited 1×
“…compared to more common practices such as recasts, result in higher rates of learner uptake and negotiation of form, it is the customization of these feedback mechanisms to align with the learners’ proficiency levels that significantly enhances the effectiveness of CF (Lyster and Ranta, 1997).”
Effectiveness of L2 instruction: A research synthesis and quantitative meta-analysis
Norris, J. M., & Ortega, L. (2000) · Language Learning · doi:10.1111/0023-8333.00136 · Cited by 2,569
Schmidt, R. (2001) · Cognition and Second Language Instruction · doi:10.1017/cbo9781139524780.003 · Cited by 1,322 · cited 3×
“On top of all, the “Noticing” hypothesis also supports the value of interaction by positing that conscious awareness of linguistic features is a prerequisite for their acquisition (Schmidt, 1990, 2001).”
MARTINUSSEN, R., HAYDEN, J., HOGG-JOHNSON, S., & TANNOCK, R. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/01.chi.0000153228.72591.73 · Cited by 1,297
INPUT, INTERACTION, AND SECOND‐LANGUAGE ACQUISITION
Long, M. H. (1981) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1981.tb42014.x · Cited by 1,259
IMPLICIT AND EXPLICIT CORRECTIVE FEEDBACK AND THE ACQUISITION OF L2 GRAMMAR
Ellis, R., Loewen, S., & Erlam, R. (2006) · Studies in Second Language Acquisition · doi:10.1017/s0272263106060141 · Cited by 1,076 · cited 3×
“CFs are often divided into primarily two encompassing categories: Explicit and Implicit CF (Ellis et al., 2006; Ellis, 2011, 2021; Li, 2023).”
The effectiveness of corrective feedback in SLA: A meta-analysis
Li, S. (2010) · Language Learning · doi:10.1111/j.1467-9922.2010.00561.x · Cited by 941
Language Comprehension as Structure Building
Gernsbacher, M. A. (1990) · doi:10.21236/ada221854 · Cited by 906
A typology of written corrective feedback types
Ellis, R. (2008) · ELT Journal · doi:10.1093/elt/ccn023 · Cited by 872
Evidence in support of written corrective feedback
Bitchener, J. (2008) · Journal of Second Language Writing · doi:10.1016/j.jslw.2007.11.004 · Cited by 871 · cited 1×
“This aligns with Bitchener’s findings, which suggest that targeted, explicit CF on specific linguistic features can lead to significant, lasting improvements in accuracy, underlining the efficacy of focused feedback approaches for lasting language development (Bitchener, 2008).”
Huang, W., Hew, K. F., & Fryer, L. K. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12610 · Cited by 830
The effect of error correction on learners’ ability to write accurately
Truscott, J. (2007) · Journal of Second Language Writing · doi:10.1016/j.jslw.2007.06.003 · Cited by 719
MACINTYRE, P. D. (2007) · The Modern Language Journal · doi:10.1111/j.1540-4781.2007.00623.x · Cited by 670
Linguistic and Conversational Adjustments to Non-Native Speakers
Long, M. H. (1983) · Studies in Second Language Acquisition · doi:10.1017/s0272263100004848 · Cited by 598
Rediscovering the use of chatbots in education: A systematic literature review
Pérez, J. Q., Daradoumis, T., & Puig, J. M. M. (2020) · Computer Applications in Engineering Education · doi:10.1002/cae.22326 · Cited by 483
Input Processing and Grammar Instruction in Second Language Acquisition
Jelinski, J. B., & VanPatten, B. (1997) · Hispania · doi:10.2307/345093 · Cited by 481
Chatbot learning partners: connecting learning experiences, interest and competence
Fryer, L. K., Nakao, K., & Thompson, A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.023 · Cited by 470
Are Sixteen Heads Really Better than One?
Michel, P., Levy, O., & Neubig, G. (2019) · arXiv · doi:10.48550/arxiv.1905.10650 · Cited by 404
LEARNERS’ PROCESSING, UPTAKE, AND RETENTION OF CORRECTIVE FEEDBACK ON WRITING: Case Studies
Storch, N., & Wigglesworth, G. (2010) · Studies in Second Language Acquisition · doi:10.1017/s0272263109990532 · Cited by 398
Making conversations with chatbots more personalized
Shumanov, M., & Johnson, L. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106627 · Cited by 363
Teachable Agents and the Protégé Effect: Increasing the Effort Towards Learning
Chase, C. C., Chin, D. B., Oppezzo, M. A., & Schwartz, D. L. (2009) · Journal of Science Education and Technology · doi:10.1007/s10956-009-9180-4 · Cited by 347
A meta-analysis of effectiveness studies on computer technology-supported language learning
Grgurović, M., Chapelle, C. A., & Shelley, M. C. (2013) · ReCALL · doi:10.1017/s0958344013000013 · Cited by 301
Working memory and binding in sentence recall
Baddeley, A. D., Hitch, G. J., & Allen, R. J. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.05.004 · Cited by 296
The Handbook of Educational Linguistics
Spolsky, B., & Hult, F. M. (2008) · Wiley eBooks · doi:10.1002/9780470694138 · Cited by 279
Artificial Intelligence (AI) Chatbot as Language Learning Medium: An inquiry
Haristiani, N. (2019) · Journal of Physics: Conference Series · doi:10.1088/1742-6596/1387/1/012020 · Cited by 268
DIFFERENTIAL EFFECTS OF ORAL AND WRITTEN CORRECTIVE FEEDBACK IN THE ESL CLASSROOM
Sheen, Y. (2010) · Studies in Second Language Acquisition · doi:10.1017/s0272263109990507 · Cited by 265
The Effect of Direct and Indirect Corrective Feedback on L2 Learners’ Written Accuracy
van Beuningen, C., de Jong, N. H., & Kuiken, F. (2008) · ITL Review of Applied Linguistics · doi:10.1075/itl.156.24beu · Cited by 248
Bringing Chatbots into education: Towards Natural Language Negotiation of Open Learner Models
Kerlyl, A., Hall, P., & Bull, S. (2007) · Applications and Innovations in Intelligent Systems XIV · doi:10.1007/978-1-84628-666-7_14 · Cited by 244
Bots as language learning tools
Fryer, L., & Carpenter, R. (2006) · Language Learning & Technology · doi:10.64152/10125/44068 · Cited by 241
Bots for language learning now: Current and future directions
Fryer, L., Coniam, D., Carpenter, R., & Lăpușneanu, D. (2020) · Language Learning & Technology · doi:10.64152/10125/44719 · Cited by 232
Comparing Generative AI and teacher feedback: student perceptions of usefulness and trustworthiness
Henderson, M., Bearman, M., Chung, J., Fawns, T., Buckingham Shum, S., Matthews, K. E., & de Mello Heredia, J. (2026) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2502582 · Cited by 211
Easifying second language learning
Cohen, A. D., & Aphek, E. (1981) · Studies in Second Language Acquisition · doi:10.1017/s0272263100004198 · Cited by 209
Interlanguage Adjustments as an Outcome of NS‐NNS Negotiated Interaction
Pica, T. (1988) · Language Learning · doi:10.1111/j.1467-1770.1988.tb00401.x · Cited by 203
The Effects of the Timing of Corrective Feedback on the Acquisition of a New Linguistic Structure
LI, S., ZHU, Y., & ELLIS, R. (2016) · The Modern Language Journal · doi:10.1111/modl.12315 · Cited by 181
Bibauw, S., François, T., & Desmet, P. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1535508 · Cited by 160
SHINTANI, N., & AUBREY, S. (2016) · The Modern Language Journal · doi:10.1111/modl.12317 · Cited by 146
Peer interaction in the foreign language classroom: what factors foster a focus on form?
Philp, J., Walter, S., & Basturkmen, H. (2010) · Language Awareness · doi:10.1080/09658416.2010.516831 · Cited by 144
Jia, J., Chen, Y., Ding, Z., & Ruan, M. (2012) · Computers & Education · doi:10.1016/j.compedu.2011.08.002 · Cited by 142
The Effect of Direct and Indirect Corrective Feedback on L2 Learners’ Written Accuracy
van Beuningen, C., de Jong, N. H., & Kuiken, F. (2008) · ITL - International Journal of Applied Linguistics · doi:10.2143/itl.156.0.2034439 · Cited by 132
It’s a Match! The effects of chatbot anthropomorphization and chatbot gender on consumer behavior
Zogaj, A., Mähner, P. M., Yang, L., & Tscheulin, D. K. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.113412 · Cited by 130
The linguistic accuracy of chatbots: usability from an ESL perspective
Coniam, D. (2014) · Text and Talk · doi:10.1515/text-2014-0018 · Cited by 129
Ayedoun, E., Hayashi, Y., & Seta, K. (2019) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-018-0171-6 · Cited by 128
Saito, K., & Akiyama, Y. (2017) · Language Learning · doi:10.1111/lang.12184 · Cited by 123
Delayed versus immediate feedback in children's and adults' vocabulary learning
Metcalfe, J., Kornell, N., & Finn, B. (2009) · Memory & Cognition · doi:10.3758/mc.37.8.1077 · Cited by 115
Timing Matters: The Impact of Immediate and Delayed Feedback on Artificial Language Learning
Opitz, B., Ferdinand, N. K., & Mecklinger, A. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00008 · Cited by 105
Automatic Annotation and Evaluation of Error Types for Grammatical Error Correction
Bryant, C., Felice, M., & Briscoe, T. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1074 · Cited by 100
Effectiveness of written corrective feedback in developing L2 accuracy: A Bayesian meta-analysis
Brown, D., Liu, Q., & Norouzian, R. (2023) · Language Teaching Research · doi:10.1177/13621688221147374 · Cited by 98
The rise of chatbots – new personal assistants in foreign language learning
Dokukina, I., & Gumanova, J. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.02.212 · Cited by 93
Second Language Learning Through Interaction: Multiple Perspectives
Pica, T. (1996) · ScholarlyCommons (University of Pennsylvania) · Cited by 87
Ruan, S., Willis, A., Xu, Q., Davis, G. M., Jiang, L., Brunskill, E., & Landay, J. A. (2019) · Proceedings of the Sixth (2019) ACM Conference on Learning @ Scale · doi:10.1145/3330430.3333643 · Cited by 81
“Chatbot as an intelligent personal assistant for mobile language learning,”
Pham, X. L., Pham, T., Nguyen, Q. M., Nguyen, T. H., & Cao, T. T. H. (2018) · Proceedings of the 2018 2nd International Conference on Education and E-Learning · doi:10.1145/3291078.3291115 · Cited by 77
Corrective feedback and learner uptake in CALL
HEIFT, T. (2004) · ReCALL · doi:10.1017/s0958344004001120 · Cited by 71
EnglishBot: An AI-Powered Conversational System for Second Language Learning
Ruan, S., Jiang, L., Xu, Q., Liu, Z., Davis, G. M., Brunskill, E., & Landay, J. A. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450648 · Cited by 71
Bao, M. (2019) · Arab World English Journal · doi:10.24093/awej/call5.3 · Cited by 70
The effects of immediate and delayed corrective feedback on L2 development
Fu, M., & Li, S. (2022) · Studies in Second Language Acquisition · doi:10.1017/s0272263120000388 · Cited by 66
A Study on Chatbots for Developing Korean College Students' English Listening and Reading Skills
Kim, H.-S. (2018) · Journal of Digital Convergence · doi:10.14400/jdc.2018.16.8.019 · Cited by 64
Wang, D. (2024) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v25i3.7646 · Cited by 62 · cited 1×
“Wang (2024) observed that learners receiving AI-generated feedback exhibited lower writing anxiety and greater improvements in complexity and fluency than those receiving teacher feedback, attributing this to the non-judgmental, low-stakes environment that AI provides.”
Kuhail, M. A., Thomas, J., Alramlawi, S., Shah, S. J. H., & Thornquist, E. (2022) · Informatics · doi:10.3390/informatics9040081 · Cited by 59
Ayedoun, E., Hayashi, Y., & Seta, K. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.08.219 · Cited by 59
Cornillie, F., Clarebout, G., & Desmet, P. (2012) · ReCALL · doi:10.1017/s0958344012000146 · Cited by 58
Talking It Through: Collaborative Dialogue and Second Language Learning
Ammar, A., & Hassan, R. M. (2017) · Language Learning · doi:10.1111/lang.12254 · Cited by 58
User Perception of Text-Based Chatbot Personality
Ruane, E., Farrell, S., & Ventresque, A. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68288-0_3 · Cited by 57
When is corrective feedback most likely to succeed?
Havranek, G. (2002) · International Journal of Educational Research · doi:10.1016/s0883-0355(03)00004-1 · Cited by 55
Interaction, Output, and Communicative Language Learning
Swain, M., & Suzuki, W. (2008) · Wiley eBooks · doi:10.1002/9780470694138.ch39 · Cited by 52
Chatbots and Korean EFL Students' English Vocabulary Learning
Kim, N. (2018) · Journal of Digital Convergence · doi:10.14400/jdc.2018.16.2.001 · Cited by 48
Kim, Y., Choi, B., Kang, S., Kim, B., & Yun, H. (2020) · Foreign Language Annals · doi:10.1111/flan.12443 · Cited by 47
Corrective feedback, learners' perceptions, and second language development
Rassaei, E. (2013) · System · doi:10.1016/j.system.2013.05.002 · Cited by 44
Using Chatbots to Teach Languages
Li, Y., Chen, C.-Y., Yu, D., Davidson, S. R., Hou, R., Yuan, X., Tan, Y., Pham, D., & Yu, Z. (2022) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3491140.3528329 · Cited by 41
Dina, A., & Ciornei, S.-I. (2013) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2013.04.107 · Cited by 35
The effect of conversation engagement on L2 learning opportunities
Chen, W. (2016) · ELT Journal · doi:10.1093/elt/ccw075 · Cited by 35
Canals, L., Granena, G., Yilmaz, Y., & Malicka, A. (2025) · Language Teaching Research · doi:10.1177/13621688211052793 · Cited by 33
Kaliisa, R., Misiejuk, K., López-Pernas, S., & Saqr, M. (2026) · Educational Psychology · doi:10.1080/01443410.2025.2553639 · Cited by 33
Haristiani, N., & Rifa’i, M. M. (2020) · Indonesian Journal of Science and Technology · doi:10.17509/ijost.v5i3.28687 · Cited by 25
Chatbot personality preferences in Global South urban English speakers
Mehra, B. (2021) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2021.100131 · Cited by 23
Tu, J. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1693/1/012216 · Cited by 23
Wahyuni, N., & Afrianti, I. (2021) · Ainara Journal (Jurnal Penelitian dan PKM Bidang Ilmu Pendidikan) · doi:10.54371/ainj.v2i3.88 · Cited by 21
Oral corrective feedback on lexical errors: a systematic review
Tan, X., Reynolds, B. L., & Ha, X. V. (2022) · Applied Linguistics Review · doi:10.1515/applirev-2022-0053 · Cited by 21
Interaction with Native Speakers of Japanese: What Learners Say
Yorozu, M. (2001) · Japanese Studies · doi:10.1080/10371390124213 · Cited by 20
A Study of Chatbot Personality based on the Purposes of Chatbot
강민정 (2018) · The Journal of the Korea Contents Association · doi:10.5392/jkca.2018.18.05.319 · Cited by 19
Adaptive Corrective Feedback in Second Language Learning
de Vries, B. P., Cucchiarini, C., Strik, H., & van Hout, R. W. N. M. (2011) · Communications in computer and information science · doi:10.1007/978-3-642-20074-8_1 · Cited by 17
Nakaya, K., & Murota, M. (2022) · Research and Practice in Technology Enhanced Learning · doi:10.58459/rptel.2013.865-89 · Cited by 16
Effects of timing of formative feedback in computer-assisted learning environments
Candel, C., Vidal‐Abarca, E., Cerdán, R., Lippmann, M., & Narciss, S. (2020) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12439 · Cited by 15
Qun, Y. (2025) · Learning and Motivation · doi:10.1016/j.lmot.2025.102132 · Cited by 12
Campbell, R. N. (1970) · TESOL Quarterly · doi:10.2307/3585777 · Cited by 11
Fu, M., & Li, S. (2019) · Journal of Second Language Studies · doi:10.1075/jsls.19002.fu · Cited by 11
The interplay between corrective feedback timing and foreign language anxiety in L2 development
Rassaei, E. (2026) · Language Teaching Research · doi:10.1177/13621688231195141 · Cited by 11
Alkhazraji, A. M. (2018) · Journal of Language Teaching and Research · doi:10.17507/jltr.0905.27 · Cited by 10
Explicit and Implicit Oral Corrective Feedback
Ellis, R. (2021) · The Cambridge Handbook of Corrective Feedback in Second Language Learning and Teaching · doi:10.1017/9781108589789.017 · Cited by 9
Swain (2005) · doi:10.4324/9781410612700-34 · Cited by 9
Quinn, P. G. (2021) · The Cambridge Handbook of Corrective Feedback in Second Language Learning and Teaching · doi:10.1017/9781108589789.016 · Cited by 8
Xu, M., & Zeng, S. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1026174 · Cited by 7
Evaluating Trust in AI, Human, and Co-produced Feedback Among Undergraduate Students
Zhang, A., Gao, Y., Suraworachet, W., Nazaretsky, T., & Cukurova, M. (2025) · arXiv · doi:10.48550/arxiv.2504.10961 · Cited by 7
Interaction with Native Speakers of Japanese: What Learners Say
Yorozu, M. (2001) · Japanese Studies · doi:10.1080/10371390120074363 · Cited by 7
“Learning to read/type a second language in a chatbot enhanced environment,”
De Gasperis, G., & Florio, N. (2012) · Advances in Intelligent and Soft Computing · doi:10.1007/978-3-642-28801-2_6 · Cited by 6
A Review on Corrective Feedback Research of the Recent 20 Years
Li, H. (2023) · International Journal of Education and Humanities · doi:10.54097/ijeh.v9i3.10621 · Cited by 6
Cheng, X., & Xu, J. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05007-3 · Cited by 6
Soyoof, A., Reynolds, B. L., Rassaei, E., Kao, C.-W., & Van Ha, X. (2026) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100530 · Cited by 6
WİBOOLYASARİN, W., WİBOOLYASARİN, K., & JİNOWAT, N. (2020) · Dil ve Dilbilimi Çalışmaları Dergisi · doi:10.17263/jlls.759344 · Cited by 5
Corrective feedback in language teaching
Ellis, R., & Sheen, Y. (2011) · eSpace (Curtin University) · Cited by 5
Nakaya, K., & Murota, M. (2012) · International Conference on Computers in Education · doi:10.58459/icce.2012.605
Baz (2016) · doi:10.46827/ejfl.v0i0.331
AI, Expert or Peer? Provider Biases and Feedback Uptake Among Pre-Service Teachers
Jacobsen, L. J., Mertens, U., Jansen, T., & Weber, K. E. (2025) · arXiv · doi:10.48550/arxiv.2507.16013
Research works printed but not linked: 5
- Haines, 1995, For and against: pairwork, Modern Engl. Teach, 4, 55
- AI, expert or peer? – examining the impact of perceived feedback source on pre-service teachers feedback Perception and uptake Jacobsen L. J. Mertens U. Jansen T. Weber K. E. arXiv 2025
- Kim, 2019, Future English learning: chatbots and artificial intelligence, Multimedia-Assis. Lang. Learn, 22, 32, 10.15702/mall.2019.22.3.32 · doi:10.15702/mall.2019.22.3.32
- 2023, R: A Language and Environment for Statistical Computing
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI blog, 1, 9
Cited by
Pitychoutis, K. M., & Spathopoulou, F. (2026) · Feedback Research in Second Language · doi:10.32038/frsl.2026.04.02 · Cited by 8
Kafabih, A., Margana, M., Herda, R. K., & Majid, S. (2026) · Research and Innovation in Applied Linguistics-Electronic Journal · doi:10.31963/rial.v4i2.6456 · Cited by 1
Early Language Development in the Digital Age (e-LADDA)Preprint
Kamelabad, A. M., Tüchler, A. F., Diprossimo, L., de Eccher, M., Sivridag, F., Zavala, K., Kalchhauser, T., Aldemir, H., Zantonello, G., Raggioli, L., et al. (2023) · doi:10.17605/osf.io/a4dhq
Wu, J. (2026) · Transactions on Social Science Education and Humanities Research · doi:10.62051/bdwbk164
Shijie, H., Zhao, Y., Yuhan, Z., & Jiani, L. (2026) · American Journal of Artificial Intelligence · doi:10.11648/j.ajai.20261002.14
Metadata
- Authors
- M. Kamelabad, A., Turano, B., Lundin, M., & Skantze, G.
- Affiliations
- Division of Speech, Music, and Hearing, KTH Royal Institute of Technology
- University of Trento (IT)
- KTH Royal Institute of Technology (SE)
- ORCID
- Skantze, Gabriel
- Venue
- Frontiers in Education
- Publisher
- Frontiers Media SA
- Published
- 2026-02-24
- Volume
- 11
- ISSN
- 2504-284X (ISSN-L)
- OpenAlex
- W7131254148
- Cited by
- 13
- References
- 113
- Citations by year
- 2026: 12
- FWCI
- 82.84
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Education (publishedVersion, cc-by)
- DiVA (Digitala Vetenskapliga Arkivet) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Open Science Framework
- Funders
- H2020 Marie Skłodowska-Curie Actions (857897)
- HORIZON EUROPE Marie Sklodowska-Curie Actions (857897)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Education › English Language Learning and Teaching
- Keywords
- large language models, chatbots, corrective feedback, feedback timing, grammar learning, English as a second language, computer-assisted language learning, user experience, learner perceptions, chatbot personality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-20, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-20 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.




