The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Automated writing evaluation for formative assessment of second language writing: investigating the accuracy and usefulness of feedback as part of argument-based validation
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Their effects depend on how learners interpret feedback, trust or distrust the system, decide what to revise, and develop the feedback literacy needed to use external input productively”
From Impostor-related experiences and generative AI in a Jordanian EFL writing course (2026) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Answering the Call for a Standard Reliability Measure for Coding Data
Hayes, A. F., & Krippendorff, K. (2007) · Communication Methods and Measures · doi:10.1080/19312450709336664 · Cited by 4,225 · cited 1×
“At the end of training and calibration, we had co-rated a set of 360 errors and were consistently achieving an agreement rate of greater than .7 using Krippendorff’s alpha 4 (Hayes & Krippendorff, 2007).”
MethodMayer, R. E. (2001) · doi:10.1017/cbo9781139164603 · Cited by 2,304
Validating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110
Formative assessment: a critical review
Bennett, R. E. (2011) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969594x.2010.513678 · Cited by 1,498
Help Seeking and Help Design in Interactive Learning Environments
Aleven, V., Stahl, E., Schworm, S., Fischer, F., & Wallace, R. (2003) · Review of Educational Research · doi:10.3102/00346543073003277 · Cited by 609 · cited 2×
“Even if help options are perceived as useful, learners may refrain from using them if addressing the task while simultaneously processing the help imposes too much cognitive load (Aleven et al., 2003).”
BackgroundA framework for evaluation and use of automated scoring
Williamson, D. M., Xi, X., & Breyer, F. J. (2012) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.2011.00223.x · Cited by 430 · cited 1×
“Assessment experts characterise this as a ‘low-stakes’ application of AWE (Chapelle & Chung, 2010; Williamson, Xi, & Breyer, 2012; Weigle, 2013a), but for students and instructors, time, effort and funding are limited resources, and decisions about where to invest them are not inconsequential.”
Chen, C.-F. E., & Cheng, W.-Y. E. C. (2008) · Language Learning & Technology · doi:10.64152/10125/44145 · Cited by 304
Automated Writing Assessment in the Classroom
Warschauer, M., & Grimes, D. (2008) · Pedagogies: An International Journal · doi:10.1080/15544800701771580 · Cited by 243 · cited 1×
“…greater autonomy for students while potentially freeing up instructors to devote their feedback efforts to aspects of writing that require human evaluation (Chen & Cheng, 2008; Li, Link, & Hegelheimer, 2015; Warschauer & grimes, 2008) such as audience awareness and communicative effectiveness.”
Background
Research works printed but not linked: 30
- Aryadoust V., 2013, Building a validity argument for a listening test of academic proficiency
- Bereiter C., 1987, The psychology of written composition
- Burstein J., 2004, AI Magazine, 25, 27
- 10.11139/cj.27.1 · doi:10.11139/cj.27.1
- 10.5054/tq.2010.219941 · DOI
- 10.1177/0265532211417211 · doi:10.1177/0265532211417211
- 10.1177/0265532210364405 · DOI
- 10.1177/0265532214565386 · DOI
- Chapelle C. A., 2008, Building a validity argument for the Test of English as a Foreign Language
- Chen C., 2008, Language Learning & Technology, 12, 94
- 10.1177/0265532210364391 · DOI
- 10.1207/S15324818AME1504_05 · DOI
- 10.1080/15434303.2014.1002925 · DOI
- 10.3998/mpub.2173290 · DOI · Paper page
- 10.2307/356600 · doi:10.2307/356600 · Paper page
- Friedl J. E., 2006, Mastering regular expressions: Powerful techniques for Perl and other tools
- 10.1017/S1351324906004190 · DOI · Paper page
- 10.1037/0033-2909.112.3.527 · DOI · Paper page
- 10.1177/0265532211417210 · DOI · Paper page
- 10.1111/jedm.2013.50.issue-1 · doi:10.1111/jedm.2013.50.issue-1
- 10.1080/0969594x.2015.1060192 · DOI
- 10.2200/S00275ED1V01Y201006HLT009 · doi:10.2200/s00275ed1v01y201006hlt009 · Paper page
- 10.1016/j.jslw.2014.10.004 · DOI · Paper page
- 10.1075/lllt.31 · DOI · Paper page
- 10.1207/s15326985ep3801_8 · DOI · Paper page
- 10.1002/j.2333-8504.2009.tb02158.x · DOI
- Schmidt R. W., 1994, AILA review, 11, 11
- 10.5054/tq.2011.272525 · DOI
- Weigle S. C., 2013, Handbook of automated essay evaluations: Current applications and new directions, 36
- 10.1016/j.asw.2012.10.006 · DOI
Cited by
Koltovskaia, S. (2020) · Assessing Writing · doi:10.1016/j.asw.2020.100450 · Cited by 447
AI in the Foreign Language Classroom: A Pedagogical Overview of Automated Writing Assistance Tools
Alharbi, W. (2023) · Education Research International · doi:10.1155/2023/4253331 · Cited by 286
Liu, C., Hou, J., Tu, Y.-F., Wang, Y., & Hwang, G.-J. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.2012812 · Cited by 231
“More strategically, Ranalli et al. (2017) integrated automated writing evaluation (AWE) with formative assessment to promote students ’ English writing skills.”
BackgroundAutomated written corrective feedback: how well can students make use of it?
Ranalli, J. (2018) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1428994 · Cited by 228
Self-citationA systematic review of AI-based automated written feedback research
Shi, H., & Aryadoust, V. (2024) · ReCALL · doi:10.1017/s0958344023000265 · Cited by 222
Metadata
- Authors
- Ranalli, J., Link, S., & Chukharev-Hudilainen, E.
- Venue
- Educational Psychology
- Publisher
- Informa UK Limited
- Published
- 2016-02
- Volume
- 37
- Issue
- 1
- Pages
- 8-25
- ISSN
- 0144-3410
- 1469-5820
- Cited by
- 129
- References
- 11
- Language
- en
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automated writing evaluation for formative assessment of second language writing: investigating the accuracy and usefulness of feedback as part of argument-based validation. https://app.cochat.ai/papers/10.1080/01443410.2015.1136407
- The paper
- Ranalli, J., Link, S., & Chukharev-Hudilainen, E. (2017). Automated writing evaluation for formative assessment of second language writing: investigating the accuracy and usefulness of feedback as part of argument-based validation. Educational Psychology. https://doi.org/10.1080/01443410.2015.1136407
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.