The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
A review of AWE feedback: types, learning outcomes, and implications
Abstract
Automated writing evaluation (AWE) plays an important role in writing pedagogy and has received considerable research attention recently; however, few reviews have been conducted to systematically analyze the recent publications arising from the many studies in this area. The present review aims to provide a comprehensive analysis of the literature on AWE feedback for writing in terms of methodology, types of learners, types of feedback and its applications, learning outcomes, and implications. A total of 48 articles from Social Science Citation Index journals and four other important journals in the field of language education were collected and analyzed. The findings revealed that most previous studies on AWE applied quantitative research methods, rather than purely qualitative ones. The duration of the experiments in approximately 33% of the studies was shorter than ten weeks, and 10% of the studies were of one session only. The group size of over half of the studies had fewer than 30 participants, and 21% of the studies had medium to large group sizes (from 51 to 100). The focus of most of the articles was on L2 writers with little attention paid to L1 writers and K12 students. AWE feedback to some extent can improve students’ writing from the product-oriented aspect but is not as effective as human feedback (e.g. teacher or peer feedback). Students generally considered AWE feedback useful and were motivated when using it, although they noticed a lack of accuracy and explicitness as the feedback tended to be generic and formulaic. The results of the review have several implications for researchers, teachers, and developers of AWE systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · cited 1×
“Feedback is normally provided by an agent who assesses and advises students; agents normally include teachers, peers, parents, or the learners themselves (Hattie & Timperley, 2007).”
BackgroundSchool Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581 · cited 1×
“Thus, learner engagement is a multidimensional construct that dynamically involves learners’ cognition, emotions, and behavior (Fredricks et al., 2004), and technology is considered effective in promoting learning through learner engagement (Fatawi et al., 2020).”
BackgroundShute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Student engagement with teacher and automated feedback on L2 writing
Zhang, Z. (., & Hyland, K. (2018) · Assessing Writing · doi:10.1016/j.asw.2018.02.004 · Cited by 546
Digital game-based vocabulary learning: where are we and where are we going?
Zou, D., Huang, Y., & Xie, H. (2021) · Computer Assisted Language Learning · doi:10.1080/09588221.2019.1640745 · Cited by 329
Self-citationA scoping review of research on digital game-based language learning
Hung, H.-T., Yang, J. C., Hwang, G.-J., Chu, H.-C., & Wang, C.-C. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.07.001 · Cited by 319
Chen, C.-F. E., & Cheng, W.-Y. E. C. (2008) · Language Learning & Technology · doi:10.64152/10125/44145 · Cited by 304
Link, S., Mehrzad, M., & Rahimi, M. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1743323 · Cited by 275
The effects of computer-generated feedback on the quality of writing
Stevenson, M., & Phakiti, A. (2014) · Assessing Writing · doi:10.1016/j.asw.2013.11.007 · Cited by 275
Zhang, Z. (. (2020) · Assessing Writing · doi:10.1016/j.asw.2019.100439 · Cited by 256
Research works printed but not linked: 87
- Bahari, S. F. (2010). Qualitative versus quantitative research strategies: Contrasting epistemological and ontological assumptions. Technology Journal, 52, 18–26.
- 10.4324/9781315768960 · DOI
- 10.4324/9780203832400 · DOI · Paper page
- 10.1016/j.jslw.2009.02.005 · DOI
- 10.1002/j.2168-9830.2010.tb01072.x · DOI
- 10.1016/j.compedu.2020.103855 · DOI · Paper page
- 10.1111/bjet.12907 · DOI · Paper page
- Chen, X., Zou, D., Xie, H., & Cheng, G. (2021a). Twenty years of personalized language learning. Educational Technology & Society, 24(1), 205–222.
- Chen, X., Zou, D., Xie, H., & Su, F. (2021b). Twenty-five years of computer-assisted language learning: A topic modeling analysis: Twenty-five years of CALL. Language Learning & Technology, 25(3), 151–185.
- 10.1186/s41239-020-00239-6 · DOI · Paper page
- 10.1007/s10459-014-9509-5 · DOI
- 10.1057/9781137333377 · DOI
- 10.1111/bjet.12582 · DOI
- Devitt, A. (2004). Writing genres. Southern Illinois University Press.
- 10.1017/S0958344014000287 · DOI · Paper page
- 10.4018/IJDET.2020070103 · DOI
- Graesser, A. C., McNamara, D. S., & Louwerse, M. M. (2003). What do readers need to learn in order to process coherence relations in narrative and expository text? In A. P. Sweet & C. E. Snow (Eds.), Rethinking reading comprehension (pp. 82–98). Guilford.
- 10.3758/bf03195564 · DOI · Paper page
- 10.1086/681947 · DOI · Paper page
- Grimes, D., & Warschauer, M. (2010). Utility in a fallible tool: A multi-site case study of automated writing evaluation. The Journal of Technology, Learning and Assessment, 8(6), 4–43.
- 10.1080/15434303.2016.1230121 · DOI · Paper page
- Hsu, Y. C., Ho, H. N. J., Tsai, C. C., Hwang, G. J., Chu, H. C., Wang, C. Y., & Chen, N. S. (2012). Research trends in technology-based learning from 2000 to 2009: A content analysis of publications in selected journals. Educational Technology & Society, 15(2), 354–370.
- 10.1080/10494820.2018.1486861 · DOI · Paper page
- 10.5054/tq.2010.215253 · DOI
- 10.2190/EC.42.2.c · DOI
- Leontjev, D. (2014). The effect of automated adaptive corrective feedback: L2 English questions. Apples-Journal of Applied Language Studies, 8(2), 43–66.
- 10.1558/cj.v33i1.26380 · DOI
- 10.1016/j.compedu.2015.09.010 · DOI
- 10.4236/ojml.2017.74015 · DOI · Paper page
- Mirmotahari, O., Damsa, C., & Berg, Y. (2018). Individualized assessment and automated feedback in undergraduate computer science education. Proceedings of International Conference of the Learning Sciences, ICLS, 3(2018), 1577–1578.
- 10.1111/jcal.12635 · DOI
- 10.1177/0741088389006001005 · DOI · Paper page
- 10.1080/09720073.2015.11891869 · doi:10.1080/09720073.2015.11891869
- 10.1558/cj.v32i2.26857 · DOI
- 10.1080/01443410.2015.1136407 · DOI
- 10.1080/09588221.2017.1308383 · DOI · Paper page
- 10.1016/j.compcom.2016.05.001 · DOI
- 10.1080/09588221.2020.1831545 · DOI · Paper page
- Tardy, C. M. (2009). Building genre knowledge. Parlor Press.
- 10.1016/j.ypmed.2012.07.003 · DOI · Paper page
- 10.1016/j.compedu.2016.12.002 · DOI · Paper page
- 10.5054/tq.2011.272525 · DOI
- Wilson, J., Olinghouse, N. G., & Andrada, G. N. (2014). Does automated feedback improve writing quality? Learning Disabilities: A Contemporary Journal, 12(1), 93–118.
- 10.1080/09588221.2020.1744666 · DOI · Paper page
- 10.1080/09588221.2021.1880441 · DOI
- 10.1080/09588221.2021.1896555 · DOI
- 10.1080/01292986.2016.1231210 · DOI
- 10.1080/09588221.2020.1839502 · DOI
- 10.1016/j.compedu.2015.04.007 · DOI
- 10.1080/01443410.2016.1223275 · DOI · Paper page
- 10.1016/j.chb.2012.01.003 · DOI
- 10.1177/0265532214565386 · DOI
- 10.1080/09588221.2013.783873 · DOI · Paper page
- 10.1016/j.iheduc.2017.04.002 · DOI
- Cotos, E., Link, S., & Huffman, S. (2017). Effects of DDL technology on genre learning. Language Learning & Technology, 21(3), 104–130.
- 10.1016/j.asw.2014.03.006 · DOI · Paper page
- 10.1080/00220671.1993.9941152 · DOI
- 10.1016/j.system.2019.03.007 · DOI
- Gao, J. W., & Ma, S. (2019). The effect of two forms of computer-automated metalinguistic corrective feedback. Language Learning & Technology, 23(2), 65–83.
- 10.1177/136216882091533.7 · doi:10.1177/136216882091533.7
- 10.1080/09588221.2021.1879161 · DOI
- 10.3389/fpsyg.2021.752793 · DOI
- 10.1111/jcal.12587 · DOI
- 10.1080/09588221.2020.1799824 · DOI
- 10.1037/xap0000111 · DOI
- 10.1111/j.1467-8535.2009.00959.x · DOI · Paper page
- 10.1080/00405840802577593 · DOI
- 10.1080/09588221.2018.1544152 · DOI
- 10.1080/09588220802613807 · DOI
- 10.1016/j.jslw.2014.10.004 · DOI · Paper page
- 10.1093/elt/ccv058 · DOI
- 10.1109/TLT.2016.2612659 · DOI
- Morch, A. I., Engeness, I., Cheng, V. C., Cheung, W. K., & Wong, K. C. (2017). EssayCritic: Writing to learn with a knowledge-based design critiquing system. Educational Technology & Society, 20(2), 213–223.
- 10.1111/j.1467-9817.2010.01450.x · DOI
- 10.1007/s40299-021-00597-3 · DOI
- 10.1017/S095834401800006X · DOI
- 10.1080/10494820.2019.1629601 · DOI · Paper page
- 10.1007/s10639-020-10177-5 · DOI
- 10.1016/j.compedu.2015.12.003 · DOI
- 10.1016/j.system.2020.102247 · DOI · Paper page
- 10.1207/s1532690xci2203_3 · DOI · Paper page
- 10.1111/j.1365-2729.2011.00475.x · DOI
- 10.1080/09588221.2012.655300 · DOI · Paper page
- 10.1016/j.compedu.2018.01.014 · DOI
- 10.1093/elt/ccw089 · DOI
- 10.1080/09500693.2017.1347303 · DOI
- 10.1016/j.compedu.2019.103668 · DOI · Paper page
Cited by
Perkins, M. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.02.07 · Cited by 839
Guo, K., & Wang, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12146-0 · Cited by 449
A systematic review of AI-based automated written feedback research
Shi, H., & Aryadoust, V. (2024) · ReCALL · doi:10.1017/s0958344023000265 · Cited by 222
Ding, L., & Zou, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12402-3 · Cited by 122
Self-citationGenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Education
Perkins, M., Roe, J., Vu, B. H., Postma, D., Hickerson, D., McGaughran, J., & Khuat, H. Q. (2024) · arXiv · doi:10.48550/arxiv.2403.19148 · Cited by 116
Metadata
- Authors
- Fu, Q.-K., Zou, D., Xie, H., & Cheng, G.
- Venue
- Computer Assisted Language Learning
- Publisher
- Informa UK Limited
- Published
- 2022-02-16
- Volume
- 37
- Issue
- 1-2
- Pages
- 179-221
- ISSN
- 0958-8221 (ISSN-L)
- 1744-3210
- OpenAlex
- W4212949095
- Cited by
- 170
- References
- 20
- FWCI
- 122.42
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- Croucher Foundation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A review of AWE feedback: types, learning outcomes, and implications. https://app.cochat.ai/papers/10.1080/09588221.2022.2033787
- The paper
- Fu, Q.-K., Zou, D., Xie, H., & Cheng, G. (2024). A review of AWE feedback: types, learning outcomes, and implications. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2022.2033787
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.