Automated Essay Feedback Generation and Its Impact on Revision
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Writing an essay is a very important skill for students to master, but a difficult task for them to overcome. It is particularly true for English as Second Language (ESL) students in China. It would be very useful if students could receive timely and effective feedback about their writing. Automatic essay feedback generation is a challenging task, which requires understanding the relationship between the text features of the essay and feedback. In this study, we first analyzed 1,290 teacher comments on their 327 Englishmajor students and annotated the feedback on seven aspects of writing, including the grammar, spelling, sentence diversity, structure, organization, supporting ideas, coherence, and conclusion, for each paper. Then, an automatic feedback classification experiment was conducted with the machine learning approach. Finally, we investigated the impact of the system generated-indirect corrective feedback (ICF) and human teachers' direct corrective feedback (DCF) in two English writing classes (N = 56 in ICF class; N = 54 in DCF class) at a key Chinese university through a web-based assignment management system. The study results indicated the feasibility of this approach that system generated ICF can be as useful as direct comments made by the teachers in terms of improving the quality of the content regarding to the structure, organization, supporting ideas, coherence, and conclusion, and encouraging students to spend more time on self-correction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ferris, D. (2006) · Feedback in Second Language Writing · doi:10.1017/cbo9781139524742.007 · Cited by 662
Response To Student Writing: Implications for Second Language Students
Ferris, D. R. (2003) · doi:10.4324/9781410607201 · Cited by 657
The preferences of ESL students for error correction in college-level writing classes
Leki, I. (1991) · Foreign Language Annals · doi:10.1111/j.1944-9720.1991.tb00464.x · Cited by 516
Predicting second language writing proficiency: the roles of cohesion and linguistic sophistication
Crossley, S. A., & McNamara, D. S. (2012) · Journal of Research in Reading · doi:10.1111/j.1467-9817.2010.01449.x · Cited by 331
The debate on automated essay grading
Hearst, M. A. (2000) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.889104 · Cited by 176
Crossley, S. A., & McNamara, D. S. (2011) · International Journal of Continuing Engineering Education and Life-Long Learning · doi:10.1504/ijceell.2011.040197 · Cited by 103
Cited by
The application of AI technologies in STEM education: a systematic review from 2011 to 2021
Xu, W., & Ouyang, F. (2022) · International Journal of STEM Education · doi:10.1186/s40594-022-00377-5 · Cited by 495
“Second, AIEd is beneficial for improving student-centered learning, such as providing adaptive tutoring (Kose & Arslan, 2017; Myneni et al., 2013), recommending personalized learning resources (Ledesma & García, 2017; Zhang et al., 2020), and diagnosing students’ learning gaps (Liu et al., 2017).”
BackgroundSelf-citationKohnke, L., Moorhouse, B. L., & Zou, D. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100156 · Cited by 309
Deeva, G., Bogdanova, D., Serral, E., Snoeck, M., & De Weerdt, J. (2021) · Computers & Education · doi:10.1016/j.compedu.2020.104094 · Cited by 289
A systematic review of AI-based automated written feedback research
Shi, H., & Aryadoust, V. (2024) · ReCALL · doi:10.1017/s0958344023000265 · Cited by 222
Systematic review for AI-based language learning tools
Woo, J. H., & Choi, H. (2021) · arXiv · doi:10.48550/arxiv.2111.04455 · Cited by 107
Metadata
- Authors
- Liu, M., Li, Y., Xu, W., & Liu, L.
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2017-10-01
- Volume
- 10
- Issue
- 4
- Pages
- 502-513
- ISSN
- 1939-1382 (ISSN-L)
- OpenAlex
- W2523258810
- Cited by
- 77
- References
- 6
- FWCI
- 8.85
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.