The utility of article and preposition error correction systems for English language learners: Feedback and assessment
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
In this paper, we describe and evaluate two state-of-the-art systems for identifying and correcting writing errors involving English articles and prepositions. Criterion SM, developed by Educational Testing Service, and ESL Assistant , developed by Microsoft Research, both use machine learning techniques to build models of article and preposition usage which enable them to identify errors and suggest corrections to the writer. We evaluated the effects of these systems on users in two studies. In one, Criterion provided feedback about article errors to native and non-native speakers who were writing an essay for a college-level psychology course. The results showed a significant reduction in the number of article errors in the final essays of the non-native speakers. In the second study, ESL Assistant was used by non-native speakers who were composing email messages. The results indicated that users were selective in their choices among the system’s suggested corrections and that, as a result, they were able to increase the proportion of valid corrections by making effective use of feedback.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The effect of different types of corrective feedback on ESL student writing
Bitchener, J., Young, S., & Cameron, D. (2005) · Journal of Second Language Writing · doi:10.1016/j.jslw.2005.08.001 · Cited by 900
Effects of differential feedback on students’ examination performance.
Lipnevich, A. A., & Smith, J. K. (2009) · Journal of Experimental Psychology: Applied · doi:10.1037/a0017841 · Cited by 199
Cited by
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242
Preparing teachers for the application of AI-powered technologies in foreign language education
Pokrivcakova, S. (2019) · Journal of Language and Cultural Education · doi:10.2478/jolace-2019-0025 · Cited by 489
Handbook of Automated Essay Evaluation
(2013) · Routledge eBooks · doi:10.4324/9780203122761 · Cited by 463
Rethinking the role of automated writing evaluation (AWE) feedback in ESL writing instruction
Li, J., Link, S., & Hegelheimer, V. (2015) · Journal of Second Language Writing · doi:10.1016/j.jslw.2014.10.004 · Cited by 282
The effects of computer-generated feedback on the quality of writing
Stevenson, M., & Phakiti, A. (2014) · Assessing Writing · doi:10.1016/j.asw.2013.11.007 · Cited by 275
Metadata
- Authors
- Chodorow, M., Gamon, M., & Tetreault, J.
- Venue
- Language Testing
- Publisher
- SAGE Publications
- Published
- 2010-07
- Volume
- 27
- Issue
- 3
- Pages
- 419-436
- ISSN
- 0265-5322 (ISSN-L)
- 1477-0946
- OpenAlex
- W1996725062
- Cited by
- 115
- References
- 2
- FWCI
- 6.46
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.