Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 168

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

In the face of fallible AWE feedback: how do students respond?

Bai, Lifang, Hu, Guangwei·2017·Educational Psychology

Abstract

Automated writing evaluation (AWE) systems can provide immediate computer-generated quantitative assessments and qualitative diagnostic feedback on an enormous number of submitted essays. However, limited research attention has been paid to locally designed AWE systems used in English as a foreign language (EFL) classroom contexts. This study explored the precision of feedback provided by a Chinese AWE programme Pigai and students’ uptake of such feedback. Data comprising Pigai feedback, students’ revised submissions, incorporated Pigai suggestions and proportions of ‘good’, ‘neutral’ and ‘bad’ revisions were collected from 210 drafts by 30 undergraduate students in an EFL writing class. Results show that (1) the precision rates of AWE feedback differed across categories of feedback (ie grammar, collocations and mechanics); (2) students were selective in their utilisation of AWE feedback and able to adjust their uptake of AWE suggestions according to the accuracy of the feedback. Survey and interview data demonstrated that the students were cognisant of the strengths and limitations of the AWE system as a source of feedback for improving their writing. These results indicate that AWE feedback can usefully supplement peer and instructor feedback in the EFL writing classroom but cannot replace the latter, given the low precision and accuracy rates of the former in identifying a range of errors.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1080/01443410.2016.1223275

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 4 references

Research works printed but not linked: 49

  1. 10.4304/tpls.3.6.1070-1079 · DOI
  2. 10.1093/elt/54.2.153 · DOI · Paper page
  3. 10.1093/elt/47.1.56 · DOI · Paper page
  4. Benson M., 2009, The BBI combinatory dictionary of English: Your guide to collocations and grammar
  5. Bitchener J., 2012, Written corrective feedback in second language acquisition and writing, 10.4324/9780203832400 · DOI · Paper page
  6. Brashi A., 2009, Reflection on English Language Teaching, 8, 21
  7. Brent E., 2006, Machine scoring of student essays: Truth and consequences, 177, 10.2307/j.ctt4cgq0p.16 · doi:10.2307/j.ctt4cgq0p.16
  8. 10.3115/1598834.1598847 · DOI
  9. Burstein J., 2003, Proceedings of the 15th Annual Conference on Innovative Applications of Artificial Intelligence, 3
  10. 10.1177/0265532214565386 · DOI
  11. Chen J. F., 1997, TESL-EJ, 2
  12. Chen C. F. E., 2008, Language Learning & Technology, 12, 94
  13. 10.1177/0265532210364391 · DOI
  14. 10.11139/cj.28.1 · doi:10.11139/cj.28.1
  15. 10.1016/j.asw.2014.03.006 · DOI · Paper page
  16. 10.2307/356602 · doi:10.2307/356602 · Paper page
  17. 10.1515/iral.1995.33.4.315 · doi:10.1515/iral.1995.33.4.315
  18. Ferris D. R., 2003, Response to student writing: Implications for second language students, 10.4324/9781410607201 · DOI · Paper page
  19. Field A., 2009, Discovering statistics with SPSS
  20. Foltz, P. W. & Rosenstein, M. (2013, December).Tracking student learning in a state-wide implementation of automated writing scoring. Paper presented at the NIPS Workshop on Data Driven Education, Lake Tahoe, Nevada. Retrieved from http://www.apparent-wind.com/mbr/papers/nips2-13-workshop-foltz-Final.pdf
  21. 10.2190/EC.38.3.d · DOI · Paper page
  22. Grimes D, 2010, The Journal of Technology, Language, and Assessment,, 8
  23. 10.1017/S1351324906004190 · DOI · Paper page
  24. Herrington A., 2012, Writing assessment in the 21st century: Essays in honor of Edward M. White, 219
  25. 10.1177/0033688206076160 · DOI
  26. 10.1016/j.asw.2012.10.001 · DOI
  27. 10.1111/j.1467-8535.2009.00959.x · DOI · Paper page
  28. Lavolette E., 2015, Language Learning & Technology, 19, 50
  29. 10.1016/j.system.2014.02.007 · DOI
  30. Liu S., 2016, CALICO Journal, 33, 71, 10.1558/cj.v33i1.26380 · DOI
  31. 10.1093/applin/amu022 · DOI
  32. Lombard R. J., 1997, Nonnative speaker collocation: A corpus-driven characterization from the writing of native speakers of Mandarin (Unpublished doctoral dissertation)
  33. 10.2307/327139 · doi:10.2307/327139
  34. McCarthy M., 1990, Vocabulary
  35. 10.1093/applin/24.2.223 · DOI · Paper page
  36. Nesselhauf N., 2004, Collocations in a learner corpus
  37. Phoocharoensil S., 2011, Journal of Education and Practice, 2, 103
  38. 10.1016/j.asw.2012.10.005 · DOI
  39. 10.1080/01443410.2015.1136407 · DOI
  40. 10.1515/cjal-2012-0006 · DOI
  41. Rudner L. M., 2006, The Journal of Technology, Learning and Assessment, 4
  42. Sinclair J., 1991, Corpus concordance collocation
  43. 10.3115/1599081.1599190 · DOI · Paper page
  44. 10.1111/lang.2000.50.issue-4 · doi:10.1111/lang.2000.50.issue-4
  45. 10.1191/1362168806lr190oa · DOI · Paper page
  46. Weigle S. C., 2013, Handbook of automated essay evaluation: Current applications and new directions, 36
  47. White E. M., 1994, Teaching and assessing writing: Recent advances in understanding, evaluating, and improving student performance
  48. 10.1016/j.jslw.2006.09.004 · DOI · Paper page
  49. 10.1080/09588220701331451 · DOI

Cited by

See all 168

Metadata

Authors
Bai, L., & Hu, G.
Venue
Educational Psychology
Published
2016-08-19
Volume
37
Issue
1
Pages
67-81
ISSN
  • 0144-3410 (ISSN-L)
  • 1469-5820
OpenAlex
W2510521397
Cited by
168
References
4
FWCI
21.63
Type
journal article
Language
en
Open access
closed
Funders
  • National Social Science Foundation of China (14BYY085)
  • Provincial Natural Science Foundation of Hainan (614230)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: In the face of fallible AWE feedback: how do students respond? https://app.cochat.ai/papers/10.1080/01443410.2016.1223275
The paper
Bai, L., & Hu, G. (2017). In the face of fallible AWE feedback: how do students respond? Educational Psychology. https://doi.org/10.1080/01443410.2016.1223275

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.