Computer-Mediated Corrective Feedback to Improve L2 Writing Skills: A Meta-Analysis
The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
Written corrective feedback for improving L2 writing skills has been a debatable issue for more than two decades. The aims of this meta-analysis are to (1) provide a quantitative measure of the effect of computer-generated written feedback for improving L2 writing skills and (2) verify how moderators (i.e., adopted technology, task types, and learners’ language proficiency) mitigate the effectiveness of corrective feedback provided by computer technology for developing the L2 students’ writing fluency and accuracy. A comprehensive search was performed to collect the population of computer-mediated corrective feedback (CMCF) studies. The effect sizes were calculated for 14 primary studies with L2 participants (N = 1220). The findings indicate a large overall effect of CMCF (d = 1.21). A medium overall effect was found in using automated writing evaluation (AWE) technology for writing skills, whereas a large effect size was determined in using non-AWE technology. The results further indicate a large overall effect in using CMCF for both writing fluency and accuracy. As for the proficiency level of moderators, the results indicate a large overall effect in using CMCF among beginners and intermediate learners, whereas the overall effect is small among advanced learners. Limitations and recommendations for future studies are also raised in this study.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
(2000) · Cited by 9,198
The Role of Consciousness in Second Language Learning1
SCHMIDT, R. W. (1990) · Applied Linguistics · doi:10.1093/applin/11.2.129 · Cited by 5,435 · cited 1×
“CMCF is guided by many theoretical frameworks of SLA, such as the noticing hypothesis of Schmidt (1990), interactional hypothesis of Long (1996), and monitor theory of Krashen (1981).”
MethodSecond Language Acquisition and Second Language Learning
Bernhardt, E. B., & Krashen, S. D. (1989) · The Modern Language Journal · doi:10.2307/326882 · Cited by 4,614
The Role of the Linguistic Environment in Second Language Acquisition
Long, M. H. (1996) · Handbook of Second Language Acquisition · doi:10.1016/b978-012589042-7/50015-3 · Cited by 3,927 · cited 2×
“…as a scaffolding in which they can interact with the feedback provided by a computer and help achieve a negotiation of meaning until they can ensure that their subsequent writing attempts are correct, thereby leading to L2 writing automaticity (Ellis, 2009; Heift & Hegelheimer, 2017; Long, 1996).”
BackgroundMethodLanguage Learning with Technology: Perspectives from Asia
(2021) · Springer eBooks · doi:10.1007/978-981-16-2697-5 · Cited by 2,206
The Case Against Grammar Correction in L2 Writing Classes
Truscott, J. (1996) · Language Learning · doi:10.1111/j.1467-1770.1996.tb01238.x · Cited by 1,739
The Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research
Wisniewski, B., Zierer, K., & Hattie, J. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.03087 · Cited by 1,199
Chandler, J. (2003) · Journal of Second Language Writing · doi:10.1016/s1060-3743(03)00038-9 · Cited by 1,108
Burston, J. (2013) · IALLT Journal of Language Learning Technologies · doi:10.17161/iallt.v43i2.8528 · Cited by 893
Written Corrective Feedback in Second Language Acquisition and Writing
Bitchener, J., & Ferris, D. R. (2012) · Routledge eBooks · doi:10.4324/9780203832400 · Cited by 711
Corrective Feedback and Teacher Development
Ellis, R. (2009) · L2 Journal · doi:10.5070/l2.v1i1.9054 · Cited by 659 · cited 2×
“…as a scaffolding in which they can interact with the feedback provided by a computer and help achieve a negotiation of meaning until they can ensure that their subsequent writing attempts are correct, thereby leading to L2 writing automaticity (Ellis, 2009; Heift & Hegelheimer, 2017; Long, 1996).”
BackgroundResultClassroom Writing Assessment and Feedback in L2 School Contexts
Lee, I. (2017) · doi:10.1007/978-981-10-3924-9 · Cited by 386 · cited 2×
“Other researchers, such as Lee (2017) and Zhang (2021), have classi fi ed WCF into focused feedback (correcting single types of learners ’ errors), mid-focused feedback (correcting multiple types of learners ’ errors), or unfocused feedback (correcting comprehensive errors committed by learners).”
BackgroundThe Efficacy of Written Corrective Feedback in Improving L2 Written Accuracy: A Meta‐Analysis
Kang, E., & Han, Z. (2015) · The Modern Language Journal · doi:10.1111/modl.12189 · Cited by 385
Teaching English with Technology
(2022) · Teaching English With Technology · doi:10.56297/vaca6841 · Cited by 380
Is feedback pedagogically correct?
Guénette, D. (2007) · Journal of Second Language Writing · doi:10.1016/j.jslw.2007.01.001 · Cited by 326
Digital support for academic writing: A review of technologies and pedagogies
Strobl, C., Ailhaud, E., Benetos, K., Devitt, A., Kruse, O., Proske, A., & Rapp, C. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.12.005 · Cited by 298 · cited 1×
“(d) I consulted references and bibliographies from articles on systematic reviews and meta-analysis studies (e.g., Bahari, 2021; Kang & Han, 2015; Stevenson & Phakiti, 2014; Strobl et al., 2019).”
Method“If I only had more time:” ESL learners' changes in linguistic accuracy on essay revisions
Polio, C., Fleck, C., & leder, N. (1998) · Journal of Second Language Writing · doi:10.1016/s1060-3743(98)90005-4 · Cited by 276
The effects of computer-generated feedback on the quality of writing
Stevenson, M., & Phakiti, A. (2014) · Assessing Writing · doi:10.1016/j.asw.2013.11.007 · Cited by 275 · cited 4×
“(d) I consulted references and bibliographies from articles on systematic reviews and meta-analysis studies (e.g., Bahari, 2021; Kang & Han, 2015; Stevenson & Phakiti, 2014; Strobl et al., 2019).”
BackgroundMethodInfluentialLink, S., Mehrzad, M., & Rahimi, M. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1743323 · Cited by 275
Meta-analysis in Second Language Research: Choices and Challenges
Oswald, F. L., & Plonsky, L. (2010) · Annual Review of Applied Linguistics · doi:10.1017/s0267190510000115 · Cited by 237 · cited 1×
“By contrast, the random effect model directly estimates heterogeneity as a variance estimate (Oswald & Plonsky, 2010).”
BackgroundVan Beuningen, C. (2010) · International Journal of English Studies · doi:10.6018/ijes/2010/2/119171 · Cited by 237
Automated written corrective feedback: how well can students make use of it?
Ranalli, J. (2018) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1428994 · Cited by 228 · cited 3×
“Pro fi ciency level is one of the moderators used in L2 research to investigate what types of learners can bene fi t from the WCF provided by the teacher or computer (Li et al., 2016; Ranalli, 2018; Saricaoglu, 2019; Xu & Zhang, 2021).”
BackgroundMethodWang, Y.-J., Shang, H.-F., & Briody, P. (2013) · Computer Assisted Language Learning · doi:10.1080/09588221.2012.655300 · Cited by 185 · cited 1×
“However, advocates of technology-enhanced L2 writing argue that WCF can aid L2 writing development (Chandler, 2003; Cheng, 2019; Huang & Renandya, 2020; Wang et al., 2013).”
BackgroundThe Effects of the Timing of Corrective Feedback on the Acquisition of a New Linguistic Structure
LI, S., ZHU, Y., & ELLIS, R. (2016) · The Modern Language Journal · doi:10.1111/modl.12315 · Cited by 181
Karim, K., & Nassaji, H. (2020) · Language Teaching Research · doi:10.1177/1362168818802469 · Cited by 164
EXPLORING SECOND LANGUAGE WRITERS’ PAUSING AND REVISION BEHAVIORS: A MIXED-METHODS STUDY
Révész, A., Michel, M., & Lee, M. (2019) · Studies in Second Language Acquisition · doi:10.1017/s027226311900024x · Cited by 164
Critical Feedback on Written Corrective Feedback Research
Storch, N. (2010) · International Journal of English Studies · doi:10.6018/ijes/2010/2/119181 · Cited by 148
SHINTANI, N., & AUBREY, S. (2016) · The Modern Language Journal · doi:10.1111/modl.12317 · Cited by 146
Mediating EFL learners’ academic writing skills in online dynamic assessment using Google Docs
Ebadi, S., & Rahimi, M. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1527362 · Cited by 123
The flipped classroom in second language learning: A meta-analysis
Vitta, J. P., & Al-Hoorie, A. H. (2023) · Language Teaching Research · doi:10.1177/1362168820981403 · Cited by 123
BARKAOUI, K. (2016) · The Modern Language Journal · doi:10.1111/modl.12316 · Cited by 113
Zhai, N., & Ma, X. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1897019 · Cited by 111
Hockly, N. (2019) · ELT Journal · doi:10.1093/elt/ccy044 · Cited by 106
Using online annotations to support error correction and corrective feedback
Yeh, S.-W., & Lo, J. (2009) · Computers & Education · doi:10.1016/j.compedu.2008.12.014 · Cited by 102
Which do students prefer to evaluate their essays: peers or computer program
Lai, Y. (2010) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2009.00959.x · Cited by 92
Computer-Assisted Language Learning: Concepts, Methodologies, Tools, and Applications
(2019) · IGI Global eBooks · doi:10.4018/978-1-5225-7663-1 · Cited by 91
Exploring the integration of automated feedback among lower-proficiency EFL learners
Huang, S., & Renandya, W. A. (2020) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2018.1471083 · Cited by 78
Xu, J., & Zhang, S. (2021) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-021-00577-7 · Cited by 69
Computer‐mediated feedback for L2 learners: Challenges versus affordances
Bahari, A. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12481 · Cited by 64
Automated writing evaluation in an EFL setting: Lessons from China
Tang, J., & Rich, C. S. (2017) · The JALT CALL Journal · doi:10.29140/jaltcall.v13n2.215 · Cited by 56
The impact of automated feedback on L2 learners’ written causal explanations
Saricaoglu, A. (2019) · ReCALL · doi:10.1017/s095834401800006x · Cited by 54
The Evaluation of Scholarly Activity in Computer‐Assisted Language Learning
SMITH, B., & LAFFORD, B. A. (2009) · The Modern Language Journal · doi:10.1111/j.1540-4781.2009.00978.x · Cited by 47
Genre-Based Automated Writing Evaluation for L2 Research Writing
Cotos, E. (2014) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137333377 · Cited by 47
Computer-assisted corrective feedback and language learning
Heift, T., & Hegelheimer, V. (2017) · Corrective Feedback in Second Language Teaching and Learning · doi:10.4324/9781315621432-5 · Cited by 42
Using track changes and word processor to provide corrective feedback to learners in writing
AbuSeileek, A. F. (2013) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12004 · Cited by 40
L1 versus L2 writing processes: What insight can we obtain from a keystroke logging program?
Mohsen, M. A. (2021) · Language Teaching Research · doi:10.1177/13621688211041292 · Cited by 40
Self-citationZhang, T. (2021) · System · doi:10.1016/j.system.2021.102493 · Cited by 39
Feedback for Adolescent Writers in the English Classroom
Ware, P. (2014) · Writing & Pedagogy · doi:10.1558/wap.v6i2.223 · Cited by 27
Analyses of L2 Learners’ Text Writing Strategy: Process-Oriented Perspective
Mohsen, M. A., & Qassem, M. (2020) · Journal of Psycholinguistic Research · doi:10.1007/s10936-020-09693-9 · Cited by 26
Self-citationGao, J., & Ma, S. (2020) · Language Teaching Research · doi:10.1177/1362168820915337 · Cited by 26
Automated Writing Evaluation System: Tapping its Potential for Learner Engagement
Zhang, Z., & Zhang, Y. (2018) · IEEE Engineering Management Review · doi:10.1109/emr.2018.2866150 · Cited by 25
Cheng, G. (2019) · Interactive Learning Environments · doi:10.1080/10494820.2019.1655769 · Cited by 25
Conceptualizing Genre-Based AWE for L2 Research Writing
Cotos, E. (2014) · Genre-Based Automated Writing Evaluation for L2 Research Writing · doi:10.1057/9781137333377_4
Research works printed but not linked: 7
- Al-Olimat S. I., 2015, Teaching English with Technology, 15, 3
- Gao J., 2019, Language Learning & Technology, 23, 65
- Hosseini S. B., 2012, Turkish Online Journal of Distance Education, 13, 95
- Page M. J., 2021, Bmj: British Medical Journal
- Sarré C., 2019, Computer Assisted Language Learning
- Sauro S., 2009, Language Learning & Technology, 13, 96
- Swain M., 2004, Inference and generalizability in applied linguistics: Multiple research perspectives
Cited by
Meyer, J., Jansen, T., Schiller, R., Liebenow, L. W., Steinbach, M., Horbach, A., & Fleckenstein, J. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100199 · Cited by 311
A systematic review of AI-based automated written feedback research
Shi, H., & Aryadoust, V. (2024) · ReCALL · doi:10.1017/s0958344023000265 · Cited by 222
“Our findings resonate with the results of previous meta-analysis research that reported positive effects of AWF on writing (e.g. R. Li, 2023; Mohsen, 2022).”
The Effectiveness of Automated Writing Evaluation on Writing Quality: A Meta-Analysis
Zhai, N., & Ma, X. (2023) · Journal of Educational Computing Research · doi:10.1177/07356331221127300 · Cited by 115
“Mohsen (2022) con fi rmed a large effect size ( d = 1.21) of computer-mediated written feedback (CMWF), including both AWE and non-AWE technologies, on L2 writing skills.”
BackgroundMethodResultInfluentialShi, H., Chai, C. S., Zhou, S., & Aubrey, S. (2026) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2454541 · Cited by 109
The role of generative AI and hybrid feedback in improving L2 writing skills: a comparative study
Zhang, Z., Aubrey, S., Huang, X., & Chiu, T. K. F. (2025) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2025.2503890 · Cited by 83
Metadata
- Authors
- Mohsen, M. A.
- Affiliations
- Najran University (SA)
- Corresponding author
- Mohsen, Mohammed Ali
- ORCID
- Mohsen, Mohammed Ali
- Venue
- Journal of Educational Computing Research
- Publisher
- SAGE Publications
- Published
- 2022-01-18
- Volume
- 60
- Issue
- 5
- Pages
- 1253-1276
- ISSN
- 0735-6331 (ISSN-L)
- 1541-4140
- OpenAlex
- W4205382697
- Cited by
- 56
- References
- 54
- Citations by year
- 2026: 14 · 2025: 15 · 2024: 13 · 2023: 12 · 2022: 2
- FWCI
- 5.34
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Educational Computing Research (publishedVersion)
- Funders
- Najran University (NU/-/SEHRC/10/941)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › English Language Learning and Teaching
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Keywords
- second language writing, automated writing evaluation, writing fluency, writing accuracy, learner proficiency level, task type, effect size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.