Does Automated Feedback Help Students Learn to Write?
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
We examined whether an automated essay feedback system could improve the writing performance of college students. Students in a freshmen composition course received no feedback or varying amounts of formative feedback on their first drafts of three practice essays (none, intermittent, or continuous). The students wrote a first and then a revised final draft of an essay in a writing lab held once per week. After a retention interval of 2 weeks, a test essay was written without the use of feedback to assess transfer of learning. Holistic scores showed no reliable gains, but the transfer test showed that students learned to reduce errors of mechanics, usage, grammar, and style. The benefit was found for continuous but not intermittent feedback.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880 · cited 1×
“Another current system, Intelligent Essay Assessor, uses latent semantic analysis (LSA) to provide a holistic essay score (Foltz, Kintsch, & Landauer, 1998; Foltz & Wells, 1999; Landauer, Foltz, & Laham, 1998).”
MethodShute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Schmidt, R. A., & Bjork, R. A. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00029.x · Cited by 1,582 · cited 2×
“Schmidt and Bjork (1992) have argued that intermittent feedback and spaced practice distributed over time (as opposed to massed practice) are actually desirable learning difficulties because of their benefits for retention over the long-term.”
BackgroundThe instructional effect of feedback in test-like events.
Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991) · Review of Educational Research · doi:10.3102/00346543061002213 · Cited by 1,313
Cho, K., Schunn, C. D., & Wilson, R. W. (2006) · Journal of Educational Psychology · doi:10.1037/0022-0663.98.4.891 · Cited by 355 · cited 1×
“In their investigation of a web-based peer assessment system (i.e., Scaffolded Writing and Rewriting in the Disciplines), Cho, Schunn, and Wilson (2006) concluded that “that the aggregate ratings of at least 4 peers on a piece of writing are both highly reliable and as valid as instructor ratings”…”
BackgroundAutomated writing evaluation: Defining the classroom research agenda
Warschauer, M., & Ware, P. (2006) · Language Teaching Research · doi:10.1191/1362168806lr190oa · Cited by 337
Cited by
Guo, K., & Wang, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12146-0 · Cited by 449
“…et al., 2020), and Pigai (Geng & Razali, 2020), have been developed, which have helped increase teachers’ feedback, expedite the process of providing feedback (Wilson & Czik, 2016), accelerate the practice–feed-back loop (Kellogg et al., 2010), and lessen teachers’ feedback burden (Ranalli, 2018).”
Wilson, J., & Czik, A. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.05.004 · Cited by 297
The effects of computer-generated feedback on the quality of writing
Stevenson, M., & Phakiti, A. (2014) · Assessing Writing · doi:10.1016/j.asw.2013.11.007 · Cited by 275
A hierarchical classification approach to automated essay scoring
McNamara, D. S., Crossley, S. A., Roscoe, R. D., Allen, L. K., & Dai, J. (2015) · Assessing Writing · doi:10.1016/j.asw.2014.09.002 · Cited by 241
A systematic review of AI-based automated written feedback research
Shi, H., & Aryadoust, V. (2024) · ReCALL · doi:10.1017/s0958344023000265 · Cited by 222
L2 student engagement with automated feedback on writing: Potential for learning and issues of trust
Ranalli, J. (2021) · Journal of Second Language Writing · doi:10.1016/j.jslw.2021.100816 · Cited by 184
Automated Writing Evaluation and Feedback: Multiple Metrics of Efficacy
Wilson, J., & Roscoe, R. D. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633119830764 · Cited by 176
Automated feedback and writing: a multi-level meta-analysis of effects on students' performance
Fleckenstein, J., Liebenow, L. W., & Meyer, J. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1162454 · Cited by 145
Wilson, J., Ahrendt, C., Fudge, E. A., Raiche, A., Beard, G., & MacArthur, C. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104208 · Cited by 118
Palermo, C., & Thomson, M. M. (2018) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2018.07.002 · Cited by 107
Roscoe, R. D., Wilson, J., Johnson, A. C., & Mayra, C. R. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2016.12.076 · Cited by 98
The Effect of Using Automated Essay Evaluation on ESL Undergraduate Students’ Writing Skill
Aluthman, E. S. (2016) · International Journal of English Linguistics · doi:10.5539/ijel.v6n5p54 · Cited by 45
Shen, C., Shi, P., Guo, J., Xu, S., & Tian, J. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1258286 · Cited by 42
Design and application of automatic feedback scaffolding in forums to promote learning
Wang, Q., Rose, C. P., Ma, N., Jiang, S., Bao, H., & Li, Y. (2022) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2022.3156914 · Cited by 15
Yang, H., Zhang, Y., & Guo, J. (2025) · Behavioral Sciences · doi:10.3390/bs15040518 · Cited by 5
“Studies have shown that as students make diligent revisions based on automated feedback on their compositions, their writing performance improves (M. Zhu et al., 2020; Kellogg et al., 2010).”
Metadata
- Authors
- Kellogg, R. T., Whiteford, A. P., & Quinlan, T.
- Venue
- Journal of Educational Computing Research
- Publisher
- SAGE Publications
- Published
- 2010-02-09
- Volume
- 42
- Issue
- 2
- Pages
- 173-196
- ISSN
- 0735-6331 (ISSN-L)
- 1541-4140
- OpenAlex
- W2051642807
- Cited by
- 88
- References
- 7
- FWCI
- 19.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.