The accuracy of computer-assisted feedback and students’ responses to it
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Various researchers in second language acquisition have argued for the effectiveness of immediate rather than delayed feedback.In writing, truly immediate feedback is impractical, but computer-assisted feedback provides a quick way of providing feedback that also reduces the teacher's workload.We explored the accuracy of feedback from Criterion®, a program developed by Educational Testing Service, and students' responses to it.Thirty-two students received feedback from Criterion on four essays throughout a semester, with 16 receiving the feedback immediately and 16 receiving it several days after writing their essays.Results indicated that 75% of the error codes were correct, but that Criterion missed many language errors.Students responded to the correct error codes 73% of the time and responded to more of the codes over the course of the semester, while the condition-delayed versus immediate-did not affect their response rates nor their accuracy on the first drafts.Although we cannot support claims that immediate feedback may be more helpful, we believe that, with proper training, Criterion can help students correct certain aspects of language.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Faigley, L., & Witte, S. (1981) · College Composition & Communication · doi:10.2307/356602 · Cited by 481
A Meta-Analysis of the Effects of Feedback in Computer-Based Instruction
Azevedo, R., & Bernard, R. M. (1995) · Journal of Educational Computing Research · doi:10.2190/9lmd-3u28-3a0g-ftqt · Cited by 308
Chen, C.-F. E., & Cheng, W.-Y. E. C. (2008) · Language Learning & Technology · doi:10.64152/10125/44145 · Cited by 304 · cited 1×
“For example, when implementing MyAccess!, Chen and Cheng (2008) found that one instructor thought the feedback was too vague to be useful.”
Automated Writing Assessment in the Classroom
Warschauer, M., & Grimes, D. (2008) · Pedagogies: An International Journal · doi:10.1080/15544800701771580 · Cited by 243 · cited 1×
“Instructors and students have reported beneficial effects of Criterion because it can lead to increased writing practice (Myers, 2003), increased motivation for students, and can save teachers' time (Warschauer & Grimes, 2008).”
The relevance of second language acquisition theory to the written error correction debate
Polio, C. (2012) · Journal of Second Language Writing · doi:10.1016/j.jslw.2012.09.004 · Cited by 209 · cited 11×
“In fact, this study was motivated by Polio (2012), who argued that some approaches to SLA suggest that feedback on language needs to be immediate for it to be effective.”
InfluentialSelf-citation
Cited by
Automated written corrective feedback: how well can students make use of it?
Ranalli, J. (2018) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1428994 · Cited by 228
A systematic review of AI-based automated written feedback research
Shi, H., & Aryadoust, V. (2024) · ReCALL · doi:10.1017/s0958344023000265 · Cited by 222
In the face of fallible AWE feedback: how do students respond?
Bai, L., & Hu, G. (2017) · Educational Psychology · doi:10.1080/01443410.2016.1223275 · Cited by 168
“…when they were correcting an error detected by the AWE system, their attention was drawn to the sentence and its context, and they found new errors (Lavolette et al., 2015); on the other hand, most of their revisions elicited immediate feedback, which encouraged them to try new expressions,…”
BackgroundResultInfluentialCrossley, S. (2019) · Journal of Writing Research · doi:10.17239/jowr-2019.11.02.01 · Cited by 58
“As an example, Lavolette, Polio, and Kahng (2015) examined the errors reported by Criterion in a small sample of essays and found that 75% of the errors were accurate with the best accuracy rates reported for capitalization, missing comma, wrong word, and ill-formed verb errors (all of which…”
BackgroundShen, C., Shi, P., Guo, J., Xu, S., & Tian, J. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1258286 · Cited by 42
Metadata
- Authors
- Lavolette, E., Polio, C., & Kahng, J.
- Venue
- Language Learning & Technology
- Published
- 2015-06-01
- Volume
- 19
- Issue
- 2
- Pages
- 50-68
- ISSN
- 1094-3501 (ISSN-L)
- OpenAlex
- W2107862273
- Cited by
- 88
- References
- 6
- FWCI
- 40.93
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.