The Effects of Teacher Feedback and Automated Feedback on Cognitive and Psychological Aspects of Foreign Language Writing: A Mixed-Methods Research
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Feedback plays a crucial role in the writing processes. However, in the literature on foreign language (FL) writing, there is a dearth of studies that compare the effects of teacher feedback and automated feedback on both cognitive and psychological aspects of FL writing. To fill this gap, the current study compared the effects of teacher feedback and automated feedback on both revision quality and writing proficiency development (i.e., the cognitive aspects), and perceived usefulness and perceived ease of use of the feedback (i.e., the psychological aspects) in English writing among English learners as an FL (EFLs) in China. It also investigated students’ perceptions of the strengths and weaknesses of the two types of feedback. The study adopted a mixed-methods design. The quantitative method collected the data through (1) a pre-test and a post-test, which measured the participants’ English writing proficiency development; (2) a writing task, which received either teacher feedback or automated feedback; and (3) a close-ended questionnaire, which examined students’ perceived usefulness and perceived ease of use of the feedback. The qualitative method collected the data through an open-ended questionnaire, which examined the participants’ perceptions of the strengths and weaknesses of teacher feedback or automated feedback depending on the type of feedback they received. Chinese university EFLs in two English classes (n = 35 in each class) taught by the same English teacher participated in the study: one class received teacher feedback while the other received automated feedback using Pigaiwang. While the students in the two classes did not differ significantly on the pre-test of students’ writing proficiency, students who received teacher feedback scored significantly higher on revision than those who received automated feedback. Students in the teacher feedback class also had significantly higher ratings on perceived usefulness and perceived ease of use of the feedback than those in the automated feedback class. However, students in the automated feedback class obtained significantly higher scores on the post-test of the writing proficiency. The qualitative results identified three themes of strengths and two themes of weaknesses for the teacher feedback and the automated feedback, respectively. The results suggest that while teacher feedback has a more positive effect on the psychological aspect of FL writing, automated feedback may be more effective in developing FL writing proficiency in the long run.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Technology Acceptance Model 3 and a Research Agenda on Interventions
Venkatesh, V., & Bala, H. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00192.x · Cited by 8,159
Evidence in support of written corrective feedback
Bitchener, J. (2008) · Journal of Second Language Writing · doi:10.1016/j.jslw.2007.11.004 · Cited by 871 · cited 2×
“On the other hand, the selective approach is more appropriate for less proficient learners, because selective feedback can avoid overwhelming learners, at the same time enable them to notice the focused types of errors (Sheen, 2007; Bitchener, 2008; Bitchener and Ferris, 2012).”
BackgroundSHEEN, Y. (2007) · TESOL Quarterly · doi:10.1002/j.1545-7249.2007.tb00059.x · Cited by 791
Ferris, D. (2006) · Feedback in Second Language Writing · doi:10.1017/cbo9781139524742.007 · Cited by 662
The influence of teacher commentary on student revision
Ferris, D. R. (1997) · TESOL Quarterly · doi:10.2307/3588049 · Cited by 618 · cited 2×
“Research has reported that teachers’ positive comments and encouraging language could build students’ confidence, which is considered important in the revising processes (Ferris, 1997).”
BackgroundUsing peer feedback in the ESL writing class
Rollinson, P. (2005) · ELT Journal · doi:10.1093/elt/cci003 · Cited by 581 · cited 1×
“Some students mentioned that they either did not understand teacher feedback or they found teachers’ language in the feedback was ambiguous, hence they had to ignore these comments in the revising processes (Ferris, 1997; Conrad and Goldstein, 1999; Rollinson, 2005; Kim, 2015).”
BackgroundWhat makes for effective feedback: staff and student perspectives
Dawson, P., Henderson, M., Mahoney, P., Phillips, M., Ryan, T., Boud, D., & Molloy, E. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1467877 · Cited by 514
The impact of teacher written feedback on individual writers
Hyland, F. (1998) · Journal of Second Language Writing · doi:10.1016/s1060-3743(98)90017-0 · Cited by 456 · cited 1×
“The effect of teacher feedback on learners’ writing proficiency development may not be as effective as on the revision quality, as learners may simply directly copy teacher corrective feedback without understanding the errors (Hyland, 1998; Lee, 2007; Zhao, 2010).”
BackgroundClassroom Writing Assessment and Feedback in L2 School Contexts
Lee, I. (2017) · doi:10.1007/978-981-10-3924-9 · Cited by 386
Chen, C.-F. E., & Cheng, W.-Y. E. C. (2008) · Language Learning & Technology · doi:10.64152/10125/44145 · Cited by 304
Wilson, J., & Czik, A. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.05.004 · Cited by 297
Link, S., Mehrzad, M., & Rahimi, M. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1743323 · Cited by 275
The effects of computer-generated feedback on the quality of writing
Stevenson, M., & Phakiti, A. (2014) · Assessing Writing · doi:10.1016/j.asw.2013.11.007 · Cited by 275
Zhang, Z. (. (2020) · Assessing Writing · doi:10.1016/j.asw.2019.100439 · Cited by 256
Automated Writing Assessment in the Classroom
Warschauer, M., & Grimes, D. (2008) · Pedagogies: An International Journal · doi:10.1080/15544800701771580 · Cited by 243
Dikli, S., & Bleyle, S. (2014) · Assessing Writing · doi:10.1016/j.asw.2014.03.006 · Cited by 193
Saito, H. (1994) · TESL Canada Journal · doi:10.18806/tesl.v11i2.633 · Cited by 183
The Effectiveness of feedback for L1-English and L2-writing development: a meta-analysis.
Biber, D., Nekrasova, T., & Horn, B. (2011) · ETS Research Report Series · doi:10.1002/j.2333-8504.2011.tb02241.x · Cited by 175 · cited 2×
“Researchers suggest that the good practice of writing feedback should cover both form and content in writing (Biber et al., 2011).”
BackgroundError Correction in the L2 Writing Classroom: What Do Students Think?
Lee, I. (2005) · TESL Canada Journal · doi:10.18806/tesl.v22i2.84 · Cited by 136 · cited 2×
“Some FL writers perceive that the comments on contents and structures are the most important and useful feedback (Semke, 1984; Zamel, 1985; Zhan, 2016), whereas others value feedback on form over content (Saito, 1994; Hedgcock and Lefkowitz, 1996; Ashwell, 2000; Lee, 2005).”
BackgroundPotential of automated writing evaluation feedback
Cotos, E. (2011) · CALICO Journal · doi:10.11139/cj.28.2.420-459 · Cited by 95
The Nature of Automated Essay Scoring Feedback
Dikli, S. (2011) · CALICO Journal · doi:10.11139/cj.28.1.99-134 · Cited by 52 · cited 1×
“For instance, some popular automated feedback systems, such as Criterion and My Access!, predominantly focus on detecting language errors (Dikli, 2010), but are limited in identifying high-level problems, such as content and logic (Deane, 2013).”
BackgroundEFL business writing behaviors in differing feedback environments
Warden, C. A. (2000) · Language Learning · doi:10.1111/0023-8333.00141 · Cited by 34 · cited 1×
“To date, only a small number of studies have compared the effects of teacher feedback and automated feedback on FL writing (Warden, 2000; Wang and Wang, 2012; Dikli and Bleyle, 2014; Wilson and Czik, 2016; Link et al., 2020).”
Background
Cited by
Barrett, A., & Pack, A. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00427-0 · Cited by 391
A systematic review of AI-based automated written feedback research
Shi, H., & Aryadoust, V. (2024) · ReCALL · doi:10.1017/s0958344023000265 · Cited by 222
Zou, S., Guo, K., Wang, J., & Liu, Y. (2026) · Computer Assisted Language Learning · doi:10.1080/09588221.2024.2447279 · Cited by 79
Metadata
- Authors
- Wang, Z., & Han, F.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2022-07-28
- Volume
- 13
- Pages
- 909802-909802
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W4288084873
- Cited by
- 42
- References
- 23
- FWCI
- 27.31
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.