Beyond the design of automated writing evaluation: Pedagogical practices and perceived learning effectiveness in EFL writing classes?
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Automated writing evaluation (AWE) software is designed to provide instant computergenerated scores for a submitted essay along with diagnostic feedback.Most studies on AWE have been conducted on psychometric evaluations of its validity; however, studies on how effectively AWE is used in writing classes as a pedagogical tool are limited.This study employs a naturalistic classroom-based approach to explore the interaction between how an AWE program, MY Access!, was implemented in three different ways in three EFL college writing classes in Taiwan and how students perceived its effectiveness in improving writing.The findings show that, although the implementation of AWE was not in general perceived very positively by the three classes, it was perceived comparatively more favorably when the program was used to facilitate students' early drafting and revising process, followed by human feedback from both the teacher and peers during the later process.This study also reveals that the autonomous use of AWE as a surrogate writing coach with minimal human facilitation caused frustration to students and limited their learning of writing.In addition, teachers' attitudes toward AWE use and their technology-use skills, as well as students' learner characteristics and goals for learning to write, may also play vital roles in determining the effectiveness of AWE.With limitations inherent in the design of AWE technology, language teachers need to be more critically aware that the implementation of AWE requires well thought-out pedagogical designs and thorough considerations for its relevance to the objectives of the learning of writing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AWE feedback has discernible advantages over teacher feedback in terms of timeliness, convenience, multiple drafting, and even potential learner autonomy, which have also been shown in the previous studies (Chen & Cheng, 2008;Dikli, 2006).”
From Student engagement with teacher and automated feedback on L2 writing (2018) · cites this paper as Chen & Cheng, 2008
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
This paper’s reference list could not be split into single entries.
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152
Feedback on second language students' writing
Hyland, K., & Hyland, F. (2006) · Language Teaching · doi:10.1017/s0261444806003399 · Cited by 1,016
AUTOMATED ESSAY SCORING WITH E‐RATER® V.2.0
Attali, Y., & Burstein, J. (2004) · ETS Research Report Series · doi:10.1002/j.2333-8504.2004.tb01972.x · Cited by 622
Automated Essay Scoring: A Cross-disciplinary Perspective
(2003) · Routledge eBooks · doi:10.4324/9781410606860 · Cited by 501
Language Testing and Validation: An Evidence-Based Approach
Weir, C. J. (2004) · Cited by 463
(2006) · The Journal of Technology, Learning and Assessment (Boston College) · Cited by 424
Teaching & Researching: Computer-Assisted Language Learning
Beatty, K. (2013) · doi:10.4324/9781315833774 · Cited by 375
Automated writing evaluation: Defining the classroom research agenda
Warschauer, M., & Ware, P. (2006) · Language Teaching Research · doi:10.1191/1362168806lr190oa · Cited by 337
Stumping e-rater:challenging the validity of automated essay scoring
Powers, D. E., Burstein, J. C., Chodorow, M. S., Fowles, M. E., & Kukich, K. (2002) · Computers in Human Behavior · doi:10.1016/s0747-5632(01)00052-8 · Cited by 155
Page, E. B. (2003) · Cited by 148
Cited by
Exploring the potential of using an AI language model for automated essay scoring
Mizumoto, A., & Eguchi, M. (2023) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2023.100050 · Cited by 647
Student engagement with teacher and automated feedback on L2 writing
Zhang, Z. (., & Hyland, K. (2018) · Assessing Writing · doi:10.1016/j.asw.2018.02.004 · Cited by 546
Koltovskaia, S. (2020) · Assessing Writing · doi:10.1016/j.asw.2020.100450 · Cited by 447
The motivational dimension of language teaching
Lamb, M. (2017) · Language Teaching · doi:10.1017/s0261444817000088 · Cited by 361
Wilson, J., & Czik, A. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.05.004 · Cited by 297
Rethinking the role of automated writing evaluation (AWE) feedback in ESL writing instruction
Li, J., Link, S., & Hegelheimer, V. (2015) · Journal of Second Language Writing · doi:10.1016/j.jslw.2014.10.004 · Cited by 282
Link, S., Mehrzad, M., & Rahimi, M. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1743323 · Cited by 275
“Automated writing evaluation (AWE) is increasingly used as a learning affordance in classroom instruction (Chen & Cheng, 2008; Cotos, 2012; Grimes & Warschauer, 2010).”
BackgroundMethodResultInfluentialThe effects of computer-generated feedback on the quality of writing
Stevenson, M., & Phakiti, A. (2014) · Assessing Writing · doi:10.1016/j.asw.2013.11.007 · Cited by 275
“It has also been claimed to have positive effects on student autonomy (Chen & Cheng, 2008).”
BackgroundThe Rise of Artificial Intelligence in Educational Measurement: Opportunities and Ethical Challenges
Bulut, O., & Beiting-Parrish, M. (2024) · Chinese/English Journal of Educational Measurement and Evaluation · doi:10.59863/miql7785 · Cited by 126
Zhang, Z. (. (2020) · Assessing Writing · doi:10.1016/j.asw.2019.100439 · Cited by 256
Utility in a Fallible Tool: A Multi-Site Case Study of Automated Writing Evaluation.
Grimes, D., & Warschauer, M. (2010) · The Journal of Technology, Learning and Assessment (Boston College) · Cited by 373
Automated written corrective feedback: how well can students make use of it?
Ranalli, J. (2018) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1428994 · Cited by 228
A systematic review of AI-based automated written feedback research
Shi, H., & Aryadoust, V. (2024) · ReCALL · doi:10.1017/s0958344023000265 · Cited by 222
Ranalli, J., Link, S., & Chukharev-Hudilainen, E. (2017) · Educational Psychology · doi:10.1080/01443410.2015.1136407 · Cited by 129
“This suggests that the use of Criterion may be more justified in courses where there is a congruent focus on form, supporting previous research showing that the manner in which AWE is integrated into instruction influences its acceptance by students (Chen & Cheng, 2008; Li et al., 2015).”
BackgroundMethodResultDikli, S., & Bleyle, S. (2014) · Assessing Writing · doi:10.1016/j.asw.2014.03.006 · Cited by 193
Formative and shared assessment in higher education. Lessons learned and challenges for the future
López-Pastor, V., & Sicilia-Camacho, A. (2017) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2015.1083535 · Cited by 187
“In recent years, technology has been increasingly used to enhance formative assessment practice in the classroom such as the use of automated writing evaluation tools to assist writing (Chen and Cheng 2008).”
MethodWang, Y.-J., Shang, H.-F., & Briody, P. (2013) · Computer Assisted Language Learning · doi:10.1080/09588221.2012.655300 · Cited by 185
“…in terms of accuracy (Dikli, 2006; Kern & Warschauer, 2000; Milton, 2006; Ware & Warschauer, 2006; Yeh, Liou, & Yu, 2007), learner autonomy (Chen & Cheng, 2008; Diab, 2010; Dikli, 2006; Griffiths & Nicolls, 2010; Hoon, 2006; Lee, 2004; Li, 2007), and interaction (Ferris & Hedgcock, 2005;…”
BackgroundMethodResultInfluentialKoltovskaia, S., Rahmati, P., & Saeli, H. (2024) · Journal of Second Language Writing · doi:10.1016/j.jslw.2024.101130 · Cited by 181
Stop! Grammar time: University students’ perceptions of the automated feedback program Grammarly
ONeill, R., & Russell, A. (2019) · Australasian Journal of Educational Technology · doi:10.14742/ajet.3795 · Cited by 180
A review of AWE feedback: types, learning outcomes, and implications
Fu, Q.-K., Zou, D., Xie, H., & Cheng, G. (2024) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2033787 · Cited by 170
“As AWE-assisted writing is a complicated process, careful pedagogical design of the instruction is viewed as necessary, and more research in various contexts is necessary before generalizing its effects (Chen & Cheng, 2008).”
BackgroundMethodInfluentialIn the face of fallible AWE feedback: how do students respond?
Bai, L., & Hu, G. (2017) · Educational Psychology · doi:10.1080/01443410.2016.1223275 · Cited by 168
“Chen and Cheng (2008) also reported that students generally held negative perceptions of AWE feedback, especially when it was used without any instructor facilitation. on the other hand, positive attitudes towards AWE feedback were reported in other studies (eg Dikli & Bleyle, 2014; Grimes &…”
BackgroundResultInfluentialGuo, Q., Feng, R., & Hua, Y. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1879161 · Cited by 112
“Studies on automated written corrective feedback (AWCF) provided by AWE tools have gathered evidence for its contribution to desired changes in students’ writing (e.g., Chen & Cheng, 2008; Lai, 2010; Stevenson & Phakiti, 2014).”
BackgroundMethodGraduate Theses and Dissertations
Davis, M., Davis, K. J., & Dunagan, M. M. (2012) · Scientific Papers and Presentations · doi:10.1016/b978-0-12-384727-0.00006-9 · Cited by 164
Automated Writing Evaluation Tools in the Improvement of the Writing Skill
Assoc. Prof. Faculty of Education, L. D., Parra G., L., Calero S., X., & Assoc. Prof. Faculty of Education, L. D. (2019) · International Journal of Instruction · doi:10.29333/iji.2019.12214a · Cited by 123
Automated scoring and feedback systems: Where are we and where are we heading?
Xi, X. (2010) · Language Testing · doi:10.1177/0265532210364643 · Cited by 153
“This line of research has addressed the extent to which automated feedback impacts the products or the process of writing (Warden, 2000; Yao and Warden, 1996), and how automated feedback is perceived by learners in classroom settings (Chen and Cheng, 2008).”
BackgroundZhai, N., & Ma, X. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1897019 · Cited by 111
“However, students’ perceptions may AWE’s effectiveness in facilitating learning to write and have direct linkages with the learning outcome (Chen & Cheng, 2008).”
BackgroundTechnology and Motivation in English-Language Teaching and Learning
Stockwell, G. (2013) · International Perspectives on Motivation · doi:10.1057/9781137000873_9 · Cited by 131
New Spaces and Old Places: An Analysis of Writing Assessment Software
Vojak, C., Kline, S. M., Cope, B., McCarthey, S. J., & Kalantzis, M. (2011) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2011.04.004 · Cited by 141
“…“reading” the work, the student may learn to focus on surface features of writing that correlate with a good score but not necessarily a good essay (Chen & Cheng, 2008), for example vocabulary and essay length (Attali & Burstein, 2006,); absence of mechanical errors (Jones, 2006); and structure…”
BackgroundMethodSecond language writing online: An update.
Godwin‐Jones, R. (2018) · Language learning & technology · doi:10.64152/10125/44574 · Cited by 196
The effectiveness of automated writing evaluation in EFL/ESL writing: a three-level meta-analysis
Ngo, T. T.-N., Chen, H. H.-J., & Lai, K. K.-W. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2022.2096642 · Cited by 81
“Second, students learning motivation and autonomy are facilitated through the learning environment that can support the sca ff olding practices throughout the multiple drafting process of AWE (Chen & Cheng, 2008; Cotos, 2011).”
BackgroundDing, L., & Zou, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12402-3 · Cited by 122
Student engagement with computer-generated feedback: a case study
Zhang, Z. (. (2016) · ELT Journal · doi:10.1093/elt/ccw089 · Cited by 107
The role of automated writing evaluation holistic scores in the ESL classroom
Li, Z., Link, S., Ma, H., Yang, H., & Hegelheimer, V. H. (2014) · System · doi:10.1016/j.system.2014.02.007 · Cited by 119
The impact of online automated feedback on students' reflective journal writing in an EFL course
Cheng, G. (2017) · The Internet and Higher Education · doi:10.1016/j.iheduc.2017.04.002 · Cited by 120
Sarı, E., & Han, T. (2024) · Journal of Computer Assisted Learning · doi:10.1111/jcal.13004 · Cited by 123
Using automated writing evaluation to reduce grammar errors in writing
Liao, H.-C. (2016) · ELT Journal · doi:10.1093/elt/ccv058 · Cited by 81
Stevenson, M. (2016) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2016.05.001 · Cited by 112
INVITED COMMENTARY: NEW TOOLS FOR TEACHING WRITING
Warschauer, M. (2010) · Cited by 105
Exploring the integration of automated feedback among lower-proficiency EFL learners
Huang, S., & Renandya, W. A. (2020) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2018.1471083 · Cited by 78
“…technical terms (see Li, Link, and Hegelheimer 2015), only a small number ( N = 3) of the participants commented on the lack of feedback on content and organization, which was often a major concern in previous studies (e.g. Chen and Cheng 2008; Lai 2010; Li, Link, and Hegelheimer 2015; Yang 2004).”
BackgroundResultInfluentialUTILIZING GRAMMARLY IN EVALUATING ACADEMIC WRITING: A NARRATIVE RESEARCH ON EFL STUDENTS’ EXPERIENCE
Nova, M. (2018) · Premise: Journal of English Education · doi:10.24127/pj.v7i1.1300 · Cited by 68
Jiang, L., Yu, S., & Wang, C. (2020) · System · doi:10.1016/j.system.2020.102302 · Cited by 71
Appropriating automated feedback in L2 writing: experiences of Chinese EFL student writers
Jiang, L., & Yu, S. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1799824 · Cited by 81
“This aligns with decades-long calls for focusing on the effectiveness of using technology in various learning contexts rather than on the effectiveness of the technology itself (Warschauer & Ware, 2006; Chen & Cheng, 2008; Wilson & Czik, 2016).”
BackgroundMethodResultInfluentialPotential of automated writing evaluation feedback
Cotos, E. (2011) · CALICO Journal · doi:10.11139/cj.28.2.420-459 · Cited by 95
“Theoretically, AWE may be able to motivate and guide student revision and to foster learner autonomy (Chen & Cheng, 2008).”
BackgroundLi, R., Meng, Z., Tian, M., Zhang, Z., Ni, C., & Xiao, W. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1540433 · Cited by 86
“In terms of the adoption of CALL technologies, pigaiwang is actually an Internet-based CALL system that requires EFL learners to submit writing assignments online via computers or other larger screen devices, e.g. iPads (Chen & Cheng, 2008).”
BackgroundMethodThe accuracy of computer-assisted feedback and students’ responses to it
Lavolette, E., Polio, C., & Kahng, J. (2015) · Language Learning & Technology · doi:10.64152/10125/44417 · Cited by 88
“For example, when implementing MyAccess!, Chen and Cheng (2008) found that one instructor thought the feedback was too vague to be useful.”
EFL students’ perception on the use of Grammarly and teacher feedback
Fahmi, M. A., & Cahyono, B. Y. (2021) · JEES (Journal of English Educators Society) · doi:10.21070/jees.v6i1.849 · Cited by 60
“The AWE Programs cannot merely replace teacher feedback since the students still need help from the teacher to enrich the content of their writing (Chen & Cheng, 2008; Zhang, 2020).”
BackgroundMethodResultInfluentialExploring the Potential of Using an Ai Language Model for Automated Essay ScoringPreprint
Mizumoto, A., & Eguchi, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4373111 · Cited by 96
Waer, H. (2023) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2021.1914062 · Cited by 60
“It also might enhance grammatical accuracy in subsequent writing tasks, as reported in some AWE and teacher feedback studies (Chen and Cheng 2008; Li, Link, and Hegelheimer2015; Liao 2015; Saadi and Saadat 2015).”
BackgroundResultInfluentialThe grass is not always greener: Teacher vs. GPT-assisted written corrective feedback
Lin, S., & Crosthwaite, P. (2024) · System · doi:10.1016/j.system.2024.103529 · Cited by 86
Zhang, Z. (., & Hyland, K. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2023.2256815 · Cited by 66
“Other studies have investigated students’ attitudes toward AWE feed-back, with responses varying widely depending on how the system was used (Chen & Cheng, 2008; Dikli & Bleyle, 2014; Grimes & Warschauer, 2010).”
An investigation on the use of automated feedback in Turkish EFL students’ writing classes
Han, T., & Sari, E. (2024) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2067179 · Cited by 64
“…this problem, some computer programs have been developed to provide instant and individualized feedback on students’ written texts (e.g., Criterion by ETS, MyAccess by Vantage Learning, and WriteToLearn by Pearson Knowledge Technologies) (Chen & Cheng, 2008; Dikli, 2006; Warschauer & Grimes, 2008).”
BackgroundInfluentialWoodworth, J., & Barkaoui, K. (2020) · TESL Canada Journal · doi:10.18806/tesl.v37i2.1340 · Cited by 59
“In a study by Chen and Cheng (2008), learners noticed some discrepancies between teacher and AWE scores, which led them to question and distrust AWE scores and feedback.”
BackgroundInfluentialEnhancing the grammatical accuracy of EFL writing by using an AWE-assisted process approach
Liao, H.-C. (2016) · System · doi:10.1016/j.system.2016.02.007 · Cited by 82
(2016) · Grantee Submission · Cited by 79
Wang, Z., & Han, F. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.909802 · Cited by 42
Automated Feedback and Second Language Writing
Stevenson, M., & Phakiti, A. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635547.009 · Cited by 97
Wilson, J., Huang, Y., Palermo, C., Beard, G., & MacArthur, C. A. (2021) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00236-w · Cited by 65
“…et al. 2013) — it is important to note, however, that college-aged English learners, particularly in English as a Second Language and English as a Foreign Language contexts have been critical of AWE ’ s error correction and feedback capabilities (e.g., Bai and Hu 2017; Chen and Cheng 2008).”
BackgroundWale, B. D., & Kassahun, Y. F. (2024) · Human Behavior and Emerging Technologies · doi:10.1155/2024/9221377 · Cited by 77
“Similarly, Chen and Cheng [4] also reported that most of the students found the My Access!”
BackgroundResultInfluentialLee, C. (2020) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1544152 · Cited by 59
“Both parties hold a positive view toward the usefulness of corrective feedback (Chen & Cheng, 2008; Zhang & Hyland, 2018).”
Backgroundالکنعان, ه. م. ن. (2022) · International Journal of Instruction · doi:10.29333/iji.2022.15348a · Cited by 90
“The design of early programs to evaluate writing features has improved rapidly since the mid-1990s thanks to the contribution of artificial intelligence technology which has served positively in the process of natural language and the tutoring of intelligent language system (Chen & Cheng, 2008).”
Zheng, B., Warschauer, M., & Farkas, G. (2013) · Journal of Educational Computing Research · doi:10.2190/ec.48.3.a · Cited by 57
“Although some research suggests that automated scoring engines are flawed for evaluating classroom writing (Chen & Cheng, 2008), studies by Grimes and Warschauer (2008, 2010) find that such software may assist teachers to manage large classes by keeping learners positively engaged.”
BackgroundComputer‐Generated Feedback on Student Writing
Ware, P. (2011) · TESOL Quarterly · doi:10.5054/tq.2011.272525 · Cited by 78
Exploring the Feedback Quality of an Automated Writing Evaluation System Pigai
Gao, J. (2021) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v16i11.19657 · Cited by 68
“In Chen and Cheng's research [11], 50% of the respondents did not think that online automatic feedback was helpful in improving their writing.”
BackgroundXu, J., & Zhang, S. (2021) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-021-00577-7 · Cited by 69
“Although some studies indicated the necessity of an inclusion of language proficiency (Bai & Hu, 2017; Chen & Cheng, 2008; Dikli & Bleyle, 2014), the empirical research addressing this issue is still sparse.”
BackgroundInfluentialYao, Y., Wang, W., & Yang, X. (2021) · Assessing Writing · doi:10.1016/j.asw.2021.100568 · Cited by 69
Towards Better ESL Practices for Implementing Automated Writing Evaluation
Link, S., Dursun, A., Karakaya, K., & Hegelheimer, V. (2014) · CALICO Journal · doi:10.11139/cj.31.3.323-344 · Cited by 59
An automated writing evaluation (AWE) in higher education
(2021) · Pegem Journal of Education and Instruction · doi:10.47750/pegegog.11.04.12 · Cited by 32
The impact of automated feedback on L2 learners’ written causal explanations
Saricaoglu, A. (2019) · ReCALL · doi:10.1017/s095834401800006x · Cited by 54
““ AWE programs … are designed to foster learner autonomy by performing error diagnosis of learner input, generating individualized feedback, and offering self-access resources such as dictionaries, thesauri, editing tools, and student portfolios ” (Chen & Cheng, 2008: 97).”
BackgroundMethodKoltovskaia, S. (2022) · ReCALL · doi:10.1017/s0958344022000179 · Cited by 68
Barrot, J. S. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-12083-y · Cited by 71
“Meanwhile, Chen and Cheng (2008) theoretically anchored their study on sociocognitive theory to find out how AWE shaped teachers’ pedagogical practices and facilitated learning effectiveness college students.”
Assessing second-language academic writing: AI vs. Human raters
Geçkin, V., Kızıltaş, E., & ÇINAR, Ç. (2023) · Journal of Educational Technology and Online Learning · doi:10.31681/jetol.1336599 · Cited by 69
“For one, these tools did not prove to be effective, and students do not favor such assessment tools (Chen & Cheng, 2008).”
Sun, B., & Fan, T. (2021) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2021.101123 · Cited by 68
Zhang, Z., & Xu, L. (2024) · Journal of Multilingual and Multicultural Development · doi:10.1080/01434632.2022.2102175 · Cited by 46
“Some automated writing evaluation (AWE) systems, such as Criterion®, My Access!, Grammarly and Pigai, have already been applied in university classrooms to assist student learning (e.g. Chen and Cheng 2008; Li, Link, and Hegelheimer 2015; Ranalli 2021; Zhang 2017).”
Long, L., & Kim, M. (2024) · Australasian Journal of Educational Technology · doi:10.14742/ajet.8821 · Cited by 69
“(e.g., Chen & Cheng, 2008) and Pigaiwang (e.g., Zhang, 2020), because they appear more suitable for academic writing classes with prescribed topics.”
BackgroundMethodInfluentialWang, Q., & Gayed, J. M. (2024) · Computer Assisted Language Learning · doi:10.1080/09588221.2024.2371395 · Cited by 68
Voluntary use of automated writing evaluation by content course students
Saricaoglu, A., & Bilki, Z. (2021) · ReCALL · doi:10.1017/s0958344021000021 · Cited by 40
Using automated feedback to develop writing proficiency
Huang, Y., & Wilson, J. (2021) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2021.102675 · Cited by 58
The Nature of Automated Essay Scoring Feedback
Dikli, S. (2011) · CALICO Journal · doi:10.11139/cj.28.1.99-134 · Cited by 52
Hassanzadeh, M., & Fotoohnejad, S. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12587 · Cited by 40
Thi, N. K., Nikolov, M., & Simon, K. (2023) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2022.2122476 · Cited by 40
“As suggested by Chen and Cheng (2008), learners at a more advanced language proficiency tended to write with more flexibility and creativity. At the same time, they need feedback focusing on meaning rather than machine-controlled feedback on language. As Grammarly feedback failed to focus on meaning, it is very likely…”
BackgroundInfluentialAutomated writing evaluation use in second language classrooms: A research synthesis
Karatay, Y., & Karatay, L. (2024) · System · doi:10.1016/j.system.2024.103332 · Cited by 49
“For example, L2 learners seem to be dissatisfied when the audience of their writing switches from teacher to AWE (Chen & Cheng, 2008).”
InfluentialCausal discourse analyzer: improving automated feedback on academic ESL writing
Chukharev‐Hudilainen, E., & Sarıcaoğlu, A. (2014) · Computer Assisted Language Learning · doi:10.1080/09588221.2014.991795 · Cited by 58
“Some research suggests that automated writing evaluation (AWE) systems, which provide feedback on student writing, can mostly help learners in improving their grammatical correctness (Chen & Cheng, 2008; LinHuang, 2010; Wang, 2013).”
BackgroundIntegrating technology into English learning in higher education: a bibliometric analysis
Yan, W., & Kabilan, M. K. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2404201 · Cited by 52
“The articles written by Sullivan and Pratt (1996), Chen and Cheng (2008), and Gao and Zhang (2020) demonstrate an impressive diversity of references, ranging from 159 to 180.”
Chen, H., & Pan, J. (2022) · Asian-Pacific Journal of Second and Foreign Language Education · doi:10.1186/s40862-022-00171-4 · Cited by 55
“…on three aspects: the impact of AES systems on students' writing pro�ciency (El Ebyary & Windeatt, 2010; Parra G. & Calero S., 2019), the attitude of teachers and students in regards to AES systems (Chen & Cheng, 2008), and the application of AES systems in English writing teaching (Koh, 2017).”
BackgroundLi, Z., Dursun, A., & Hegelheimer, V. H. (2017) · Wiley eBooks · doi:10.1002/9781118914069.ch6 · Cited by 58
Luo, M., Hu, X., & Zhong, C. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13488-7 · Cited by 50
“…in English writing vary by age and academic level; university students often critique the accuracy of AI feed - back in identifying errors (C. E. Chen & Cheng, 2008), whereas younger learners in elementary grades show more openness, reporting it as a confidence booster in their writing…”
Emerging Technologies in Adult Literacy and Language Education
Warschauer, M., & Liaw, M. (2010) · PsycEXTRA Dataset · doi:10.1037/e529982011-001 · Cited by 44
“There, implementation of AWE was most successful when computer-based scoring and feedback on earlier drafts of writing was combined with teacher response to later or final drafts (Chen & Cheng, 2008).”
MethodShen, C., Shi, P., Guo, J., Xu, S., & Tian, J. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1258286 · Cited by 42
Sherafati, N., & Largani, F. M. (2022) · Journal of Computers in Education · doi:10.1007/s40692-022-00221-3 · Cited by 46
“…of the studies was on two issues: the use of computers for presenting the materials and assessing the writings (e.g., Attali, & Burstein, 2006; Chen & Cheng, 2008; Wilson & Czik, 2016); and the use of computers for feedback provision (e.g., Brunfaut et al., 2018; Li et al., 2015; Sherafati et…”
MethodAutomated Writing Analysis for Writing Pedagogy
Cotos, E. (2015) · Writing & Pedagogy · doi:10.1558/wap.v7i2-3.26381 · Cited by 47
Bailey, D., & Lee, A. R. (2020) · TESOL journal (Laguna) · Cited by 41
Modeling the Continuance Intention to Use Automated Writing Evaluation Among Chinese EFL Learners
Li, R. (2021) · SAGE Open · doi:10.1177/21582440211060782 · Cited by 43
“Automated Writing Evaluation (AWE) is increasingly recognized as an effective tool in the field of computer assisted language learning (CALL) as it can support learners’ drafting and revising process in writing (Chen & Cheng, 2008; Cotos, 2014).”
BackgroundMethodTeaching Writing with Language Feedback Technology
Lim, F. V., & Phua, J. (2019) · Computers and Composition · doi:10.1016/j.compcom.2019.102518 · Cited by 39
The impact of automated writing evaluation (AWE) on EFL learners’ peer and self-editing
Al-Inbari, F. A. Y., & Al-Wasy, B. Q. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11458-x · Cited by 43
“It had been in use since the 1960s (Chen & Cheng, 2008).”
MethodSherafati, N., Largani, F. M., & Amini, S. (2020) · Education and Information Technologies · doi:10.1007/s10639-020-10177-5 · Cited by 39
“EFL learners ’ experience with Automated Writing Evaluation (AWE) was also examined by Chen and Cheng (2008).”
MethodZou, B. (2013) · Computer Assisted Language Learning · doi:10.1080/09588221.2011.631143 · Cited by 44
“Such teacher support reinforces classroom computer-based learning (Bax, 2003; Chambers & Bax, 2006), so teachers should provide pedagogical design in CALL environments (Chen & Cheng, 2008).”
BackgroundWale, B. D. (2024) · Jurnal Cakrawala Pendidikan · doi:10.21831/cp.v43i1.67715 · Cited by 37
Alsalem, M. S. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2430865 · Cited by 41
“Similar findings were reported in earlier studies (Chen & Cheng, 2008; Li et al., 2015; Link et al., 2014).”
InfluentialEnhancing language learning through generative AI feedback on picture-cued writing tasks
Zhuang, Y., Zhao, R., Xie, Z., & Yu, P. L. H. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100450 · Cited by 45
Metadata
- Authors
- Chen, C.-F. E., & Cheng, W.-Y. E. C.
- Affiliations
- National Kaohsiung First University of Science and Technology (TW)
- Venue
- Language Learning & Technology
- Published
- 2008-06-01
- Volume
- 12
- Issue
- 2
- Pages
- 94-112
- ISSN
- 1094-3501 (ISSN-L)
- OpenAlex
- W2122946606
- Cited by
- 304
- References
- 17
- Citations by year
- 2026: 22 · 2025: 17 · 2024: 33 · 2023: 32 · 2022: 28 · 2021: 29 · 2020: 15 · 2019: 16 · 2018: 19 · 2017: 11 · 2016: 17 · 2015: 17 · 2014: 13 · 2013: 13 · 2012: 9
- FWCI
- 43.13
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Language learning & technology (publishedVersion, cc-by-nc-nd)
- ScholarSpace (University of Hawaii at Manoa) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Language learning & technology (cc-by-nc-nd)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › English Language Learning and Teaching
- Social Sciences › Education › Student Assessment and Feedback
- Keywords
- automated writing evaluation, EFL writing, writing instruction, student perceptions, human feedback, peer feedback, teacher attitudes, learner characteristics, technology-enhanced language learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.