The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement
Abstract
Recent years have witnessed an increasing interest in the use of automated writing evaluation (AWE) in second language writing classrooms. This increase is partially due to the belief that AWE can assist teachers by allowing them to devote more feedback to higher-level (HL) writing skills, such as content and organization, while the technology addresses lower-level (LL) skills, such as grammar. As is speculated, student revisions will then be positively impacted. However, little evidence has supported these claims, calling into question the impact of AWE on teaching and learning. The current study explored these claims by comparing two second language writing classes that were assigned to either an AWE + teacher feedback condition or a teacher-only-feedback condition. Findings suggest that using AWE as a complement to teacher feedback did not have a significant impact on the amount of HL teacher feedback, but the teacher who did not use AWE tended to provide a greater amount of LL feedback than AWE alone. Furthermore, students seemed to revise the teacher’s LL feedback more frequently than LL feedback from the computer. Interestingly, students retained their improvement in accuracy in the long-term when they had access to AWE, but students who did not have access appeared to have lower retention. We explain the relevance of our findings in relation to an argument-based validation framework to align our work with state-of-the-art research in the field and contribute to a broader discussion about how AWE can be best provided to support second language writing development.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Link et al. (2022), Huang and Wilson (2021), and Nunes et al. (2022)consistently emphasized the role of AI-powered writing evaluation tools, identifying that these automated systems effectively enhanced learners' writing quality.”
From The Role of AI-Assisted Learning in Academic Writing: A Mixed-Methods Study on Chinese as a Second Language Students (2025) · cites this paper as Link et al., 2022
In the citing paper
“These tools are particularly effective in identifying and addressing surface-level issues, such as grammar, punctuation, and spelling, while enabling teachers to focus on higher-order writing skills like idea development and coherence (Link et al., 2022).”
From Enhancing EFL Writing Revision Practices: The Impact of AI- and Teacher-Generated Feedback and Their Sequences (2025) · cites this paper as Link et al., 2022
Citations
Cites
Language Learning with Technology
Castillo, D. G. (2021) · Springer eBooks · doi:10.1007/978-981-16-2697-5 · Cited by 2,211
Validating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110
How Big Is “Big”? Interpreting Effect Sizes in L2 Research
Plonsky, L., & Oswald, F. L. (2014) · Language Learning · doi:10.1111/lang.12079 · Cited by 1,960
The Case Against Grammar Correction in L2 Writing Classes
Truscott, J. (1996) · Language Learning · doi:10.1111/j.1467-1770.1996.tb01238.x · Cited by 1,874
Formative assessment: a critical review
Bennett, R. E. (2011) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969594x.2010.513678 · Cited by 1,498
Towards an Organic Approach to Investigating CAF in Instructed SLA: The Case of Complexity
Norris, J. M., & Ortega, L. (2009) · Applied Linguistics · doi:10.1093/applin/amp044 · Cited by 1,392
Automatic analysis of syntactic complexity in second language writing
Lu, X. (2010) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.15.4.02lu · Cited by 1,127
Error feedback in L2 writing classes
Ferris, D., & Roberts, B. (2001) · Journal of Second Language Writing · doi:10.1016/s1060-3743(01)00039-x · Cited by 981
Automated Evaluation of Text and Discourse with Coh-Metrix
McNamara, D. S., Graesser, A. C., McCarthy, P. M., & Cai, Z. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9780511894664 · Cited by 932
Lu, X. (2011) · TESOL Quarterly · doi:10.5054/tq.2011.240859 · Cited by 814
The influence of teacher commentary on student revision
Ferris, D. R. (1997) · TESOL Quarterly · doi:10.2307/3588049 · Cited by 618 · cited 1×
“To examine students ’ revision acts, we utilized a framework described in Chapelle et al. (2015), which was first established in Ferris (1997) and modified by Lee and Hegelheimer (2012) to assess revisions based on AWE feedback in research similar to the present study (see Table 1).”
MethodElectronic Journal of Foreign Language Teaching
(2022) · doi:10.56040/e-flt · Cited by 537
Feedback in Second Language Writing
(2019) · Cambridge University Press eBooks · doi:10.1017/9781108635547 · Cited by 534
Li, S., Silva, T. J., & Matsuda, P. K. (2002) · TESOL Quarterly · doi:10.2307/3588251 · Cited by 529
Ferris, D. R. (2010) · Studies in Second Language Acquisition · doi:10.1017/s0272263109990490 · Cited by 523
Dimensions of L2 Performance and Proficiency
Housen, A., Kuiken, F., & Vedder, I. (2012) · Language learning and language teaching · doi:10.1075/lllt.32 · Cited by 482
A framework for evaluation and use of automated scoring
Williamson, D. M., Xi, X., & Breyer, F. J. (2012) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.2011.00223.x · Cited by 430
The Efficacy of Written Corrective Feedback in Improving L2 Written Accuracy: A Meta‐Analysis
Kang, E., & Han, Z. (2015) · The Modern Language Journal · doi:10.1111/modl.12189 · Cited by 385
Rethinking the role of automated writing evaluation (AWE) feedback in ESL writing instruction
Li, J., Link, S., & Hegelheimer, V. H. (2014) · Journal of Second Language Writing · doi:10.1016/j.jslw.2014.10.004 · Cited by 362
Self-citationMeasures of Linguistic Accuracy in Second Language Writing Research
Polio, C. G. (1997) · Language Learning · doi:10.1111/0023-8333.31997003 · Cited by 359
Automated writing evaluation: Defining the classroom research agenda
Warschauer, M., & Ware, P. (2006) · Language Teaching Research · doi:10.1191/1362168806lr190oa · Cited by 337
The Linguistic Development of Students of English as a Second Language in Two Written Genres
Yoon, H., & Polio, C. G. (2016) · TESOL Quarterly · doi:10.1002/tesq.296 · Cited by 321
Chen, C.-F. E., & Cheng, W.-Y. E. C. (2008) · Language Learning & Technology · doi:10.64152/10125/44145 · Cited by 304
Wilson, J., & Czik, A. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.05.004 · Cited by 297
The effects of computer-generated feedback on the quality of writing
Stevenson, M., & Phakiti, A. (2014) · Assessing Writing · doi:10.1016/j.asw.2013.11.007 · Cited by 275
Johnson, M. D. (2017) · Journal of Second Language Writing · doi:10.1016/j.jslw.2017.06.001 · Cited by 266
van Beuningen, C. (2010) · International Journal of English Studies · doi:10.6018/ijes/2010/2/119171 · Cited by 264
Automated Writing Assessment in the Classroom
Warschauer, M., & Grimes, D. (2008) · Pedagogies: An International Journal · doi:10.1080/15544800701771580 · Cited by 243
Teaching ESL Composition, Purpose, Process, and Practice
Claffey, S. (2000) · System · doi:10.1016/s0346-251x(00)00002-6 · Cited by 236
Automated written corrective feedback: how well can students make use of it?
Ranalli, J. (2018) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1428994 · Cited by 228 · cited 1×
“Certainty as to why this result occurred warrants further investigation; however, studies have suggested that inaccuracies in feedback can affect students ’ willingness or ability to use it (Ranalli, 2018).”
ResultLu, X. (2017) · Language Testing · doi:10.1177/0265532217710675 · Cited by 224
A dynamic usage based perspective on L2 writing
Verspoor, M., Schmid, M. S., & Xu, X. (2012) · Journal of Second Language Writing · doi:10.1016/j.jslw.2012.03.007 · Cited by 220
Syntactic complexity in L2 writing: Progress and expansion
Ortega, L. (2015) · Journal of Second Language Writing · doi:10.1016/j.jslw.2015.06.008 · Cited by 219
Methodological synthesis of research on the effectiveness of corrective feedback in L2 writing
Liu, Q., & Brown, D. (2015) · Journal of Second Language Writing · doi:10.1016/j.jslw.2015.08.011 · Cited by 217
Automated Grammatical Error Detection for Language Learners
Leacock, C., Chodorow, M. S., Gamon, M., & Tetreault, J. (2010) · Synthesis lectures on human language technologies · doi:10.2200/s00275ed1v01y201006hlt009 · Cited by 216
Treatment of Error in Second Language Student Writing, Second Edition
Ferris, D. R. (2011) · doi:10.3998/mpub.2173290 · Cited by 215
Karim, K., & Nassaji, H. (2018) · Language Teaching Research · doi:10.1177/1362168818802469 · Cited by 205
Dikli, S., & Bleyle, S. (2014) · Assessing Writing · doi:10.1016/j.asw.2014.03.006 · Cited by 193
Hulstijn, J. H., & Marchena, E. (1989) · Studies in Second Language Acquisition · doi:10.1017/s0272263100008123 · Cited by 190
Johnson, M. D., Mercado, L. A., & Acevedo, A. (2012) · Journal of Second Language Writing · doi:10.1016/j.jslw.2012.05.011 · Cited by 187
An investigation into current measures of linguistic accuracy in second language writing research
Polio, C. G., & Shea, M. C. (2014) · Journal of Second Language Writing · doi:10.1016/j.jslw.2014.09.003 · Cited by 186
Wang, Y.-J., Shang, H.-F., & Briody, P. (2013) · Computer Assisted Language Learning · doi:10.1080/09588221.2012.655300 · Cited by 185
A reflection on ‘the language learning potential’ of written CF
Bitchener, J. (2012) · Journal of Second Language Writing · doi:10.1016/j.jslw.2012.09.006 · Cited by 185
The Effectiveness of feedback for L1-English and L2-writing development: a meta-analysis.
Biber, D., Nekrasova, T., & Horn, B. (2011) · ETS Research Report Series · doi:10.1002/j.2333-8504.2011.tb02241.x · Cited by 175
English language learners and automated scoring of essays: Critical considerations
Weigle, S. C. (2012) · Assessing Writing · doi:10.1016/j.asw.2012.10.006 · Cited by 159
Validity arguments for diagnostic assessment using automated writing evaluation
Chapelle, C. A., Cotos, E., & Lee, J. (2015) · Language Testing · doi:10.1177/0265532214565386 · Cited by 158
Automated scoring and feedback systems: Where are we and where are we heading?
Xi, X. (2010) · Language Testing · doi:10.1177/0265532210364643 · Cited by 144
Complementing human judgment of essays written by English language learners with e-rater ® scoring
Enright, M. K., & Quinlan, T. (2010) · Language Testing · doi:10.1177/0265532210363144 · Cited by 114
Written corrective feedback in second language acquisition and writing studies
Ferris, D. R. (2012) · Language Teaching · doi:10.1017/s0261444812000250 · Cited by 108
Writing Assessment: A Position Statement
CCCC Committee on Assessment (1995) · College Composition and Communication · doi:10.2307/358714 · Cited by 103
Student Perceptions and Use of Technology-Mediated Text and Screencast Feedback in ESL Writing
Cunningham, K. J. (2019) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2019.02.003 · Cited by 102
Shaping a score: Complexity, accuracy, and fluency in integrated writing performances
Plakans, L., Gebril, A., & Bilki, Z. (2016) · Language Testing · doi:10.1177/0265532216669537 · Cited by 96
Stevenson, M. (2016) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2016.05.001 · Cited by 85
Rahimi, M. (2019) · Language Teaching Research · doi:10.1177/1362168819879182 · Cited by 69
Self-citationWorking Smarter, Not Working Harder: Revisiting Teacher Feedback in the L2 Writing Classroom
Lee, I. (2011) · Canadian Modern Language Review/ La Revue canadienne des langues vivantes · doi:10.3138/cmlr.67.3.377 · Cited by 63
New tools for teaching writing
Warschauer, M. (2010) · Language learning & technology · doi:10.64152/10125/44196 · Cited by 63
Computer‐Generated Feedback on Student Writing
Ware, P. (2011) · TESOL Quarterly · doi:10.5054/tq.2011.272525 · Cited by 61
Towards Better ESL Practices for Implementing Automated Writing Evaluation
Link, S., Dursun, A., Karakaya, K., & Hegelheimer, V. H. (2014) · CALICO Journal · doi:10.11139/cj.31.3.323-344 · Cited by 59
Self-citationLi, Z., Feng, H.-H., & Sarıcaoğlu, A. (2017) · CALICO Journal · doi:10.1558/cj.26382 · Cited by 53
The Nature of Automated Essay Scoring Feedback
Dikli, S. (2011) · CALICO Journal · doi:10.11139/cj.28.1.99-134 · Cited by 52
Genre-Based Automated Writing Evaluation for L2 Research Writing
Cotos, E. (2014) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137333377 · Cited by 48
Automated Essay Scoring by Capturing Relative Writing Quality
Chen, H., Xu, J., & He, B. (2013) · The Computer Journal · doi:10.1093/comjnl/bxt117 · Cited by 40
Automated Writing Analysis for Writing Pedagogy
Cotos, E. (2015) · Writing & Pedagogy · doi:10.1558/wap.v7i2-3.26381 · Cited by 37
Chapter 1. Situating the learning-to-write and writing-to-learn dimensions of L2 writing
Manchón, R. M. (2011) · Language learning and language teaching · doi:10.1075/lllt.31.03man · Cited by 35
Teachers’ frequently asked questions about focused written corrective feedback
Lee, I. (2019) · TESOL journal · doi:10.1002/tesj.427 · Cited by 33
Feedback for Adolescent Writers in the English Classroom
Ware, P. (2014) · Writing & Pedagogy · doi:10.1558/wap.v6i2.223 · Cited by 27
Research works printed but not linked: 13
- Attali Y., 2004, Paper presented at the National Council on Measurement in Education (NCME)
- Chen C., 2008, Language Learning & Technology, 12, 94
- Cotos E., 2012, Technology across writing contexts and tasks, CALICO Monograph Series, 10, 81
- Cotos E., 2017, Special Issue in Language Learning and Technology, 21, 104
- Grimes D., 2010, The Journal of Technology, Language, and Assessment, 8
- Karim K., 2018, Language Teaching Research
- Lee J., 2012, A hybrid use of Criterion® and teacher feedback in process writing.
- Plakans L., 2019, Language Testing, 36 (2), 161–179
- Quick Placement Test. (2001). Oxford: Oxford University Press.
- Rahimi M., 2019, Language Teaching Research
- Victori, M. (1995). EFL writing knowledge and strategies: An interactive study (Unpublished PhD dissertation). Universitat Autonoma de Barcelona (Spain), Barcelona.
- Warschauer M., 2010, Language Learning & Technology, 14, 3
- Yoon H.-J., 2016, TESOL Quarterly, 51
Cited by
Sorted by citations
Guo, K., & Wang, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12146-0 · Cited by 449
AI in the Foreign Language Classroom: A Pedagogical Overview of Automated Writing Assistance Tools
Alharbi, W. (2023) · Education Research International · doi:10.1155/2023/4253331 · Cited by 286
Liu, C., Hou, J., Tu, Y.-F., Wang, Y., & Hwang, G.-J. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.2012812 · Cited by 231
A systematic review of AI-based automated written feedback research
Shi, H., & Aryadoust, V. (2024) · ReCALL · doi:10.1017/s0958344023000265 · Cited by 222
Wang, C. (2025) · Technology Knowledge and Learning · doi:10.1007/s10758-024-09744-3 · Cited by 212
“Adopting NLP to analyze language features, diagnose errors, and evaluate essays, AWE was first implemented in high-stakes testing and later adopted in writing classrooms (Link et al., 2022).”
Metadata
- Authors
- Link, S., Mehrzad, M., & Rahimi, M.
- Affiliations
- Oklahoma State University (US)
- Shiraz University (IR)
- Corresponding author
- Rahimi, Mohammad
- Venue
- Computer Assisted Language Learning
- Publisher
- Informa UK Limited
- Published
- 2020-03-26
- Volume
- 35
- Issue
- 4
- Pages
- 605-634
- ISSN
- 0958-8221 (ISSN-L)
- 1744-3210
- OpenAlex
- W3013848609
- Cited by
- 275
- References
- 66
- Citations by year
- 2026: 52 · 2025: 65 · 2024: 60 · 2023: 51 · 2022: 31 · 2021: 12 · 2020: 4
- FWCI
- 114.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Computer Assisted Language Learning (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › English Language Learning and Teaching
- Keywords
- automated writing evaluation, teacher feedback, student revision, second language writing, writing accuracy, grammar feedback, writing development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review