Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 170

The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.

A review of AWE feedback: types, learning outcomes, and implications

Fu, Qing-Ke, Zou, Di, Xie, Haoran, Cheng, Gary·2024·Computer Assisted Language Learning

Abstract

Automated writing evaluation (AWE) plays an important role in writing pedagogy and has received considerable research attention recently; however, few reviews have been conducted to systematically analyze the recent publications arising from the many studies in this area. The present review aims to provide a comprehensive analysis of the literature on AWE feedback for writing in terms of methodology, types of learners, types of feedback and its applications, learning outcomes, and implications. A total of 48 articles from Social Science Citation Index journals and four other important journals in the field of language education were collected and analyzed. The findings revealed that most previous studies on AWE applied quantitative research methods, rather than purely qualitative ones. The duration of the experiments in approximately 33% of the studies was shorter than ten weeks, and 10% of the studies were of one session only. The group size of over half of the studies had fewer than 30 participants, and 21% of the studies had medium to large group sizes (from 51 to 100). The focus of most of the articles was on L2 writers with little attention paid to L1 writers and K12 students. AWE feedback to some extent can improve students’ writing from the product-oriented aspect but is not as effective as human feedback (e.g. teacher or peer feedback). Students generally considered AWE feedback useful and were motivated when using it, although they noticed a lack of accuracy and explicitness as the feedback tended to be generic and formulaic. The results of the review have several implications for researchers, teachers, and developers of AWE systems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1080/09588221.2022.2033787

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 20 references

Research works printed but not linked: 87

  1. Bahari, S. F. (2010). Qualitative versus quantitative research strategies: Contrasting epistemological and ontological assumptions. Technology Journal, 52, 18–26.
  2. 10.4324/9781315768960 · DOI
  3. 10.4324/9780203832400 · DOI · Paper page
  4. 10.1016/j.jslw.2009.02.005 · DOI
  5. 10.1002/j.2168-9830.2010.tb01072.x · DOI
  6. 10.1016/j.compedu.2020.103855 · DOI · Paper page
  7. 10.1111/bjet.12907 · DOI · Paper page
  8. Chen, X., Zou, D., Xie, H., & Cheng, G. (2021a). Twenty years of personalized language learning. Educational Technology & Society, 24(1), 205–222.
  9. Chen, X., Zou, D., Xie, H., & Su, F. (2021b). Twenty-five years of computer-assisted language learning: A topic modeling analysis: Twenty-five years of CALL. Language Learning & Technology, 25(3), 151–185.
  10. 10.1186/s41239-020-00239-6 · DOI · Paper page
  11. 10.1007/s10459-014-9509-5 · DOI
  12. 10.1057/9781137333377 · DOI
  13. 10.1111/bjet.12582 · DOI
  14. Devitt, A. (2004). Writing genres. Southern Illinois University Press.
  15. 10.1017/S0958344014000287 · DOI · Paper page
  16. 10.4018/IJDET.2020070103 · DOI
  17. Graesser, A. C., McNamara, D. S., & Louwerse, M. M. (2003). What do readers need to learn in order to process coherence relations in narrative and expository text? In A. P. Sweet & C. E. Snow (Eds.), Rethinking reading comprehension (pp. 82–98). Guilford.
  18. 10.3758/bf03195564 · DOI · Paper page
  19. 10.1086/681947 · DOI · Paper page
  20. Grimes, D., & Warschauer, M. (2010). Utility in a fallible tool: A multi-site case study of automated writing evaluation. The Journal of Technology, Learning and Assessment, 8(6), 4–43.
  21. 10.1080/15434303.2016.1230121 · DOI · Paper page
  22. Hsu, Y. C., Ho, H. N. J., Tsai, C. C., Hwang, G. J., Chu, H. C., Wang, C. Y., & Chen, N. S. (2012). Research trends in technology-based learning from 2000 to 2009: A content analysis of publications in selected journals. Educational Technology & Society, 15(2), 354–370.
  23. 10.1080/10494820.2018.1486861 · DOI · Paper page
  24. 10.5054/tq.2010.215253 · DOI
  25. 10.2190/EC.42.2.c · DOI
  26. Leontjev, D. (2014). The effect of automated adaptive corrective feedback: L2 English questions. Apples-Journal of Applied Language Studies, 8(2), 43–66.
  27. 10.1558/cj.v33i1.26380 · DOI
  28. 10.1016/j.compedu.2015.09.010 · DOI
  29. 10.4236/ojml.2017.74015 · DOI · Paper page
  30. Mirmotahari, O., Damsa, C., & Berg, Y. (2018). Individualized assessment and automated feedback in undergraduate computer science education. Proceedings of International Conference of the Learning Sciences, ICLS, 3(2018), 1577–1578.
  31. 10.1111/jcal.12635 · DOI
  32. 10.1177/0741088389006001005 · DOI · Paper page
  33. 10.1080/09720073.2015.11891869 · doi:10.1080/09720073.2015.11891869
  34. 10.1558/cj.v32i2.26857 · DOI
  35. 10.1080/01443410.2015.1136407 · DOI
  36. 10.1080/09588221.2017.1308383 · DOI · Paper page
  37. 10.1016/j.compcom.2016.05.001 · DOI
  38. 10.1080/09588221.2020.1831545 · DOI · Paper page
  39. Tardy, C. M. (2009). Building genre knowledge. Parlor Press.
  40. 10.1016/j.ypmed.2012.07.003 · DOI · Paper page
  41. 10.1016/j.compedu.2016.12.002 · DOI · Paper page
  42. 10.5054/tq.2011.272525 · DOI
  43. Wilson, J., Olinghouse, N. G., & Andrada, G. N. (2014). Does automated feedback improve writing quality? Learning Disabilities: A Contemporary Journal, 12(1), 93–118.
  44. 10.1080/09588221.2020.1744666 · DOI · Paper page
  45. 10.1080/09588221.2021.1880441 · DOI
  46. 10.1080/09588221.2021.1896555 · DOI
  47. 10.1080/01292986.2016.1231210 · DOI
  48. 10.1080/09588221.2020.1839502 · DOI
  49. 10.1016/j.compedu.2015.04.007 · DOI
  50. 10.1080/01443410.2016.1223275 · DOI · Paper page
  51. 10.1016/j.chb.2012.01.003 · DOI
  52. 10.1177/0265532214565386 · DOI
  53. 10.1080/09588221.2013.783873 · DOI · Paper page
  54. 10.1016/j.iheduc.2017.04.002 · DOI
  55. Cotos, E., Link, S., & Huffman, S. (2017). Effects of DDL technology on genre learning. Language Learning & Technology, 21(3), 104–130.
  56. 10.1016/j.asw.2014.03.006 · DOI · Paper page
  57. 10.1080/00220671.1993.9941152 · DOI
  58. 10.1016/j.system.2019.03.007 · DOI
  59. Gao, J. W., & Ma, S. (2019). The effect of two forms of computer-automated metalinguistic corrective feedback. Language Learning & Technology, 23(2), 65–83.
  60. 10.1177/136216882091533.7 · doi:10.1177/136216882091533.7
  61. 10.1080/09588221.2021.1879161 · DOI
  62. 10.3389/fpsyg.2021.752793 · DOI
  63. 10.1111/jcal.12587 · DOI
  64. 10.1080/09588221.2020.1799824 · DOI
  65. 10.1037/xap0000111 · DOI
  66. 10.1111/j.1467-8535.2009.00959.x · DOI · Paper page
  67. 10.1080/00405840802577593 · DOI
  68. 10.1080/09588221.2018.1544152 · DOI
  69. 10.1080/09588220802613807 · DOI
  70. 10.1016/j.jslw.2014.10.004 · DOI · Paper page
  71. 10.1093/elt/ccv058 · DOI
  72. 10.1109/TLT.2016.2612659 · DOI
  73. Morch, A. I., Engeness, I., Cheng, V. C., Cheung, W. K., & Wong, K. C. (2017). EssayCritic: Writing to learn with a knowledge-based design critiquing system. Educational Technology & Society, 20(2), 213–223.
  74. 10.1111/j.1467-9817.2010.01450.x · DOI
  75. 10.1007/s40299-021-00597-3 · DOI
  76. 10.1017/S095834401800006X · DOI
  77. 10.1080/10494820.2019.1629601 · DOI · Paper page
  78. 10.1007/s10639-020-10177-5 · DOI
  79. 10.1016/j.compedu.2015.12.003 · DOI
  80. 10.1016/j.system.2020.102247 · DOI · Paper page
  81. 10.1207/s1532690xci2203_3 · DOI · Paper page
  82. 10.1111/j.1365-2729.2011.00475.x · DOI
  83. 10.1080/09588221.2012.655300 · DOI · Paper page
  84. 10.1016/j.compedu.2018.01.014 · DOI
  85. 10.1093/elt/ccw089 · DOI
  86. 10.1080/09500693.2017.1347303 · DOI
  87. 10.1016/j.compedu.2019.103668 · DOI · Paper page

Cited by

Metadata

Authors
Fu, Q.-K., Zou, D., Xie, H., & Cheng, G.
Venue
Computer Assisted Language Learning
Published
2022-02-16
Volume
37
Issue
1-2
Pages
179-221
ISSN
  • 0958-8221 (ISSN-L)
  • 1744-3210
OpenAlex
W4212949095
Cited by
170
References
20
FWCI
122.42
Type
journal article
Language
en
Open access
closed
Funders
Croucher Foundation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A review of AWE feedback: types, learning outcomes, and implications. https://app.cochat.ai/papers/10.1080/09588221.2022.2033787
The paper
Fu, Q.-K., Zou, D., Xie, H., & Cheng, G. (2024). A review of AWE feedback: types, learning outcomes, and implications. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2022.2033787

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.