The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
In the face of fallible AWE feedback: how do students respond?
Abstract
Automated writing evaluation (AWE) systems can provide immediate computer-generated quantitative assessments and qualitative diagnostic feedback on an enormous number of submitted essays. However, limited research attention has been paid to locally designed AWE systems used in English as a foreign language (EFL) classroom contexts. This study explored the precision of feedback provided by a Chinese AWE programme Pigai and students’ uptake of such feedback. Data comprising Pigai feedback, students’ revised submissions, incorporated Pigai suggestions and proportions of ‘good’, ‘neutral’ and ‘bad’ revisions were collected from 210 drafts by 30 undergraduate students in an EFL writing class. Results show that (1) the precision rates of AWE feedback differed across categories of feedback (ie grammar, collocations and mechanics); (2) students were selective in their utilisation of AWE feedback and able to adjust their uptake of AWE suggestions according to the accuracy of the feedback. Survey and interview data demonstrated that the students were cognisant of the strengths and limitations of the AWE system as a source of feedback for improving their writing. These results indicate that AWE feedback can usefully supplement peer and instructor feedback in the EFL writing classroom but cannot replace the latter, given the low precision and accuracy rates of the former in identifying a range of errors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chen, C.-F. E., & Cheng, W.-Y. E. C. (2008) · Language Learning & Technology · doi:10.64152/10125/44145 · Cited by 304
The effects of computer-generated feedback on the quality of writing
Stevenson, M., & Phakiti, A. (2014) · Assessing Writing · doi:10.1016/j.asw.2013.11.007 · Cited by 275
The Nature of Automated Essay Scoring Feedback
Dikli, S. (2011) · CALICO Journal · doi:10.11139/cj.28.1.99-134 · Cited by 52
EFL business writing behaviors in differing feedback environments
Warden, C. A. (2000) · Language Learning · doi:10.1111/0023-8333.00141 · Cited by 34
Research works printed but not linked: 49
- 10.4304/tpls.3.6.1070-1079 · DOI
- 10.1093/elt/54.2.153 · DOI · Paper page
- 10.1093/elt/47.1.56 · DOI · Paper page
- Benson M., 2009, The BBI combinatory dictionary of English: Your guide to collocations and grammar
- Bitchener J., 2012, Written corrective feedback in second language acquisition and writing, 10.4324/9780203832400 · DOI · Paper page
- Brashi A., 2009, Reflection on English Language Teaching, 8, 21
- Brent E., 2006, Machine scoring of student essays: Truth and consequences, 177, 10.2307/j.ctt4cgq0p.16 · doi:10.2307/j.ctt4cgq0p.16
- 10.3115/1598834.1598847 · DOI
- Burstein J., 2003, Proceedings of the 15th Annual Conference on Innovative Applications of Artificial Intelligence, 3
- 10.1177/0265532214565386 · DOI
- Chen J. F., 1997, TESL-EJ, 2
- Chen C. F. E., 2008, Language Learning & Technology, 12, 94
- 10.1177/0265532210364391 · DOI
- 10.11139/cj.28.1 · doi:10.11139/cj.28.1
- 10.1016/j.asw.2014.03.006 · DOI · Paper page
- 10.2307/356602 · doi:10.2307/356602 · Paper page
- 10.1515/iral.1995.33.4.315 · doi:10.1515/iral.1995.33.4.315
- Ferris D. R., 2003, Response to student writing: Implications for second language students, 10.4324/9781410607201 · DOI · Paper page
- Field A., 2009, Discovering statistics with SPSS
- Foltz, P. W. & Rosenstein, M. (2013, December).Tracking student learning in a state-wide implementation of automated writing scoring. Paper presented at the NIPS Workshop on Data Driven Education, Lake Tahoe, Nevada. Retrieved from http://www.apparent-wind.com/mbr/papers/nips2-13-workshop-foltz-Final.pdf
- 10.2190/EC.38.3.d · DOI · Paper page
- Grimes D, 2010, The Journal of Technology, Language, and Assessment,, 8
- 10.1017/S1351324906004190 · DOI · Paper page
- Herrington A., 2012, Writing assessment in the 21st century: Essays in honor of Edward M. White, 219
- 10.1177/0033688206076160 · DOI
- 10.1016/j.asw.2012.10.001 · DOI
- 10.1111/j.1467-8535.2009.00959.x · DOI · Paper page
- Lavolette E., 2015, Language Learning & Technology, 19, 50
- 10.1016/j.system.2014.02.007 · DOI
- Liu S., 2016, CALICO Journal, 33, 71, 10.1558/cj.v33i1.26380 · DOI
- 10.1093/applin/amu022 · DOI
- Lombard R. J., 1997, Nonnative speaker collocation: A corpus-driven characterization from the writing of native speakers of Mandarin (Unpublished doctoral dissertation)
- 10.2307/327139 · doi:10.2307/327139
- McCarthy M., 1990, Vocabulary
- 10.1093/applin/24.2.223 · DOI · Paper page
- Nesselhauf N., 2004, Collocations in a learner corpus
- Phoocharoensil S., 2011, Journal of Education and Practice, 2, 103
- 10.1016/j.asw.2012.10.005 · DOI
- 10.1080/01443410.2015.1136407 · DOI
- 10.1515/cjal-2012-0006 · DOI
- Rudner L. M., 2006, The Journal of Technology, Learning and Assessment, 4
- Sinclair J., 1991, Corpus concordance collocation
- 10.3115/1599081.1599190 · DOI · Paper page
- 10.1111/lang.2000.50.issue-4 · doi:10.1111/lang.2000.50.issue-4
- 10.1191/1362168806lr190oa · DOI · Paper page
- Weigle S. C., 2013, Handbook of automated essay evaluation: Current applications and new directions, 36
- White E. M., 1994, Teaching and assessing writing: Recent advances in understanding, evaluating, and improving student performance
- 10.1016/j.jslw.2006.09.004 · DOI · Paper page
- 10.1080/09588220701331451 · DOI
Cited by
Comparing the quality of human and ChatGPT feedback of students’ writing
Steiss, J., Tate, T., Graham, S., Cruz, J., Hebert, M., Wang, J., Moon, Y., Tseng, W., Warschauer, M., & Olson, C. B. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.101894 · Cited by 509
Guo, K., & Wang, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12146-0 · Cited by 449
Koltovskaia, S. (2020) · Assessing Writing · doi:10.1016/j.asw.2020.100450 · Cited by 447
Zhang, Z. (. (2020) · Assessing Writing · doi:10.1016/j.asw.2019.100439 · Cited by 256
Barrot, J. S. (2023) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1936071 · Cited by 248
Metadata
- Authors
- Bai, L., & Hu, G.
- Venue
- Educational Psychology
- Publisher
- Informa UK Limited
- Published
- 2016-08-19
- Volume
- 37
- Issue
- 1
- Pages
- 67-81
- ISSN
- 0144-3410 (ISSN-L)
- 1469-5820
- OpenAlex
- W2510521397
- Cited by
- 168
- References
- 4
- FWCI
- 21.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- National Social Science Foundation of China (14BYY085)
- Provincial Natural Science Foundation of Hainan (614230)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: In the face of fallible AWE feedback: how do students respond? https://app.cochat.ai/papers/10.1080/01443410.2016.1223275
- The paper
- Bai, L., & Hu, G. (2017). In the face of fallible AWE feedback: how do students respond? Educational Psychology. https://doi.org/10.1080/01443410.2016.1223275
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.