TO ERR IS HUMAN: COMPARING HUMAN AND AUTOMATED CORRECTIVE FEEDBACK
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
The importance of Corrective Feedback (CF) to language learners has been a controversial topic for a long time. While some studies recognised CF's importance for accurate language use, others considered it deterrent to the meaningful acquisition of a second language. Recently, modern types of corrective feedback that utilise the vast advance in IT and Artificial Intelligence (AI) have emerged. This advancement has opened new investigation areas. Up to now, researchers have acknowledged the role of Automated Written Evaluation (AWE) in enhancing students’ writing and motivating them. Other studies have focused on students’ and teachers’ perceptions of such tools. However, the particular variance between this type of CF and the traditional one is still an area to explore. Accordingly, the present study aimed to compare CF provided by teachers to that offered by a well-known writing assistant Grammarly. The descriptive design was used to analyse the CF instances provided by five college professors to the Grammarly suggestions on a corpus of 115 texts, 23700 words, written by college students. The descriptive statistics method was adopted to summarise the findings. The study's main results indicated no significant difference in the number of errors detected by the two techniques. However, human raters outperformed Grammarly in detecting grammatical errors and were more accurate in identifying structure-related mistakes. On the other hand, Grammarly was found more effective in detecting errors related to spelling and punctuation. These findings imply using focused CF to exploit both methods. Teachers can implement their regular CF approach to develop structural aspects of language. Further, they can encourage students to adopt sophisticated writing assistants to develop their writing mechanics. To account for the potential limitations of the current study, further research that employs a larger sample size and is conducted on longitudinal and experimental bases is required.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While methodologically different from Sanosi (2022) and Heintz et al. (2022), the study shares similar findings in that, in terms of accuracy, there are some areas in which AI-based applications can still be improved.”
From DICO-JALF v.1.0: Diponegoro Corpus of Japanese Learners as a Foreign Language in Indonesia with AI Error Annotation and Human Supervision (2025) · cites this paper as Sanosi (2022)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evidence in support of written corrective feedback
Bitchener, J. (2008) · Journal of Second Language Writing · doi:10.1016/j.jslw.2007.11.004 · Cited by 871 · cited 1×
“perspectives and generated different results pointing to controversies regarding how it is viewed [6, 9, 10], approving its positive impact on developing learners’ writing [11], and addressing its different types and styles [12, 13].”
BackgroundFocus on Form in Task-based Language Teaching
Long, M. (2000) · Language Policy and Pedagogy · doi:10.1075/z.96.11lon · Cited by 440
The Efficacy of Written Corrective Feedback in Improving L2 Written Accuracy: A Meta‐Analysis
Kang, E., & Han, Z. (2015) · The Modern Language Journal · doi:10.1111/modl.12189 · Cited by 385
Automated written corrective feedback: how well can students make use of it?
Ranalli, J. (2018) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1428994 · Cited by 228 · cited 1×
“Although some uncertainty arises about its value for L2 learners and regarding errors and consistency in detecting them [36], AWE's ability to check students’ spelling, grammar, wordchoice, tone, and plagiarism is recognised [34, 35].”
BackgroundStop! Grammar time: University students’ perceptions of the automated feedback program Grammarly
ONeill, R., & Russell, A. (2019) · Australasian Journal of Educational Technology · doi:10.14742/ajet.3795 · Cited by 180
Examining the impact of Grammarly on the quality of mobile L2 writing
Dizon, G., & Gayed, J. M. (2021) · The JALT CALL Journal · doi:10.29140/jaltcall.v17n2.336 · Cited by 138
Integrating technology into ESL/EFL writing through Grammarly
Barrot, J. S. (2022) · RELC Journal · doi:10.1177/0033688220966632 · Cited by 96 · cited 2×
“Another study [19] compared 54 students' perception of Grammarly's feedback with 42 students who received traditional grammatical feedback.”
BackgroundQassemzadeh, A., & Soleimani, H. (2016) · Theory and Practice in Language Studies · doi:10.17507/tpls.0609.23 · Cited by 52 · cited 1×
“it has widely been used in EFL settings, Grammarly has attracted researchers' attention, and most studies claimed its convenience, helpfulness, accuracy and efficacy [37, 38, 18, 19, 20, 17].”
Background25 years on, the written error correction debate continues: an interview with John Truscott
Mohebbi, H. (2021) · Asian-Pacific Journal of Second and Foreign Language Education · doi:10.1186/s40862-021-00110-9 · Cited by 24 · cited 9×
“His view was not a one-time opinion; instead, after 25 years, Truscott insists that he is still sceptical about the efficacy of correction.”
BackgroundResultInfluential
Cited by
A systematic review of Grammarly in L2 English writing contexts
Dizon, G., & Gayed, J. M. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2397882 · Cited by 19
“…studies and many others included in the review (Ebadi et al., 2022; Ebyary, 2022; Fan, 2023; Guo et al., 2022; John & Wall, 2020; Koltovskaia, 2020; Sanosi, 2022; Thi et al., 2023; Ventayen & Orlanda-Ventayen, 2018; Yousofi, 2022) reported issues concerning the accuracy, reliability, and/or…”
Prihantoro, P., Ishikawa, S., Liu, T., Fadli, Z. A., Rini, E. I. H. A. N., & Kepirianto, C. (2025) · Jurnal Arbitrer · doi:10.25077/ar.12.3.274-288.2025 · Cited by 2
Metadata
- Authors
- Sanosi, A.
- ORCID
- Sanosi, Abdulaziz
- Venue
- Information Technologies and Learning Tools
- Publisher
- Institute for Digitalisation of Education of the National Academy of Educational Sciences of Ukraine
- Published
- 2022-09-29
- Volume
- 90
- Issue
- 4
- Pages
- 149-161
- ISSN
- 2076-8184
- Cited by
- 7
- References
- 9
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.