Beyond the design of automated writing evaluation: Pedagogical practices and perceived learning effectiveness in EFL writing classes?
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Automated writing evaluation (AWE) software is designed to provide instant computergenerated scores for a submitted essay along with diagnostic feedback.Most studies on AWE have been conducted on psychometric evaluations of its validity; however, studies on how effectively AWE is used in writing classes as a pedagogical tool are limited.This study employs a naturalistic classroom-based approach to explore the interaction between how an AWE program, MY Access!, was implemented in three different ways in three EFL college writing classes in Taiwan and how students perceived its effectiveness in improving writing.The findings show that, although the implementation of AWE was not in general perceived very positively by the three classes, it was perceived comparatively more favorably when the program was used to facilitate students' early drafting and revising process, followed by human feedback from both the teacher and peers during the later process.This study also reveals that the autonomous use of AWE as a surrogate writing coach with minimal human facilitation caused frustration to students and limited their learning of writing.In addition, teachers' attitudes toward AWE use and their technology-use skills, as well as students' learner characteristics and goals for learning to write, may also play vital roles in determining the effectiveness of AWE.With limitations inherent in the design of AWE technology, language teachers need to be more critically aware that the implementation of AWE requires well thought-out pedagogical designs and thorough considerations for its relevance to the objectives of the learning of writing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AWE feedback has discernible advantages over teacher feedback in terms of timeliness, convenience, multiple drafting, and even potential learner autonomy, which have also been shown in the previous studies (Chen & Cheng, 2008;Dikli, 2006).”
From Student engagement with teacher and automated feedback on L2 writing (2018) · cites this paper as Chen & Cheng, 2008
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
This paper’s reference list could not be split into single entries.
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152
Feedback on second language students' writing
Hyland, K., & Hyland, F. (2006) · Language Teaching · doi:10.1017/s0261444806003399 · Cited by 1,016
AUTOMATED ESSAY SCORING WITH E‐RATER® V.2.0
Attali, Y., & Burstein, J. (2004) · ETS Research Report Series · doi:10.1002/j.2333-8504.2004.tb01972.x · Cited by 622
Automated Essay Scoring: A Cross-disciplinary Perspective
(2003) · Routledge eBooks · doi:10.4324/9781410606860 · Cited by 501
Language Testing and Validation: An Evidence-Based Approach
Weir, C. J. (2004) · Cited by 463
(2006) · The Journal of Technology, Learning and Assessment (Boston College) · Cited by 424
Teaching & Researching: Computer-Assisted Language Learning
Beatty, K. (2013) · doi:10.4324/9781315833774 · Cited by 375
Automated writing evaluation: Defining the classroom research agenda
Warschauer, M., & Ware, P. (2006) · Language Teaching Research · doi:10.1191/1362168806lr190oa · Cited by 337
Stumping e-rater:challenging the validity of automated essay scoring
Powers, D. E., Burstein, J. C., Chodorow, M. S., Fowles, M. E., & Kukich, K. (2002) · Computers in Human Behavior · doi:10.1016/s0747-5632(01)00052-8 · Cited by 155
Page, E. B. (2003) · Cited by 148
Cited by
Items 101–200 of 316
Corpora and Language Assessment: The State of the Art
Park, K. (2014) · Language Assessment Quarterly · doi:10.1080/15434303.2013.872647 · Cited by 46
“With an enhanced performance, AES systems can be used gainfully for areas in language assessment including rater training, an interactive language test, and visualization of a student’s performance longitudinally (Chen & Cheng, 2008; Warschauer & Ware, 2006).”
MethodChapter 3. Asynchronous and Synchronous Modalities
Mick, C. S., & Middlebrook, G. (2015) · doi:10.37514/per-b.2015.0650.2.03 · Cited by 52
Correnti, R. J., Matsumura, L. C., Wang, E. L., Litman, D. J., & Zhang, H. (2022) · Computers and Education Open · doi:10.1016/j.caeo.2022.100084 · Cited by 40
Discourse Classification into Rhetorical Functions for AWE Feedback
Cotos, E., & Pendar, N. (2016) · CALICO Journal · doi:10.1558/cj.v33i1.27047 · Cited by 36
“The amount of empirical evidence suggesting their effectiveness and potential benefits for language learners is accumulating (Attali, 2004; Chen & Cheng, 2008; Cotos, 2014) and is, therefore, motivating the development of new intelligent writing applications.”
BackgroundLinking text readability and learner proficiency using linguistic complexity feature vector distance
Chen, X., & Meurers, D. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1527358 · Cited by 36
“As for the latter, automatic learner language analysis is applicable in automatic writing evaluation (e.g. Chen & Cheng, 2008; Shermis & Burstein, 2013), detection of production errors (e.g. Rimrott & Heift, 2008), providing benchmark data on frequent mistakes for language educators (e.g. Granger,…”
MethodJingxin, G., & Razali, A. B. (2020) · Universal Journal of Educational Research · doi:10.13189/ujer.2020.082638 · Cited by 39
“The key to the success of the implementation of the AWE program is found to be users’ high frequency of its use [6].”
BackgroundEfficiency of Online Grammar Checker in English Writing Performance and Students’ Perceptions
Jin, Y. H. (2018) · Korean Journal of English Language and Linguistics · doi:10.15738/kjell.18.3.201809.328 · Cited by 39
Alhaisoni, E., Al-zuoud, K. M., & Gaudel, D. R. (2015) · English Language Teaching · doi:10.5539/elt.v8n3p185 · Cited by 34
“Chen and Cheng (2008) and Coombe and Barlow (2008) focusing on grammar, pronunciation, and spelling argue that these linguistic features play the role in understanding the factors underlying proficient and less proficient writing.”
BackgroundAldosemani, T. I., Assalahi, H. M., Lhothali, A., & Albsisi, M. (2023) · International Journal of Computer-Assisted Language Learning and Teaching · doi:10.4018/ijcallt.329962 · Cited by 38
Collaborative tasks in wiki-based environment in EFL learning
Xing, M., Wang, D., & Zou, B. (2015) · Cited by 33
Assessing L2 writing in the digital age: Opportunities and challenges
Li, J., & Li, M. (2022) · Journal of Second Language Writing · doi:10.1016/j.jslw.2022.100913 · Cited by 34
Can Automated Writing Evaluation Programs Help Students Improve Their English Writing?
Wang, P. (2013) · International Journal of Applied Linguistics & English Literature · doi:10.7575/ijalel.v.2n.1p.6 · Cited by 30
“1.2 Importance of the Problem At present, My Access and Criterion are the two most popular AWE programs in Taiwan.”
BackgroundInfluentialReilly, E. D., Wiliams, K. M., Stafford, R. E., Corliss, S. B., Walkow, J. C., & Kidwell, D. K. (2016) · Online Learning · doi:10.24059/olj.v20i2.638 · Cited by 33
Miranty, D., Widiati, U., Cahyono, B. Y., & Sharif, T. I. S. T. (2023) · International Journal of Evaluation and Research in Education (IJERE) · doi:10.11591/ijere.v12i3.24958 · Cited by 29
Chen, Q. (2025) · International Journal of Changes in Education · doi:10.47852/bonviewijce52025580 · Cited by 33
“In contrast, human feedback offers personalized, metalinguistic guidance that can help students think critically and address higher-order concerns such as essay structure and content development [29, 30].”
Online individualized corrective feedback on EFL learners’ grammatical error correction
Ko, C.-J. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2118783 · Cited by 33
“…and researchers investigate it, many related studies have investigated the effects of technology on L2 writing using existing systems or social networking websites (Chen & Cheng, 2008; Elola & Oskoz, 2017; Li, 2021; Lim & Phua, 2019; Nazari et al., 2021, Zhai & Ma, 2021; Zheng & Warschauer, 2017).”
Influential"Grammarly" as English Writing Assistant from EFL Students’ Perspective
Armanda, M. L., Nugraheni, A. F., Wulansari, A., & Ali Imron, A. M. (2022) · English Education Journal of English Teaching and Research · doi:10.29407/jetar.v7i2.17988 · Cited by 34
“It leads to writing at the lexical, syntactic, discourse, and grammar levels (Chen & Cheng, 2008).”
BackgroundDesigning automated guidance for concept diagrams in inquiry instruction
Ryoo, K., & Linn, M. C. (2016) · Journal of Research in Science Teaching · doi:10.1002/tea.21321 · Cited by 29
Khasawneh, M. A. S. (2024) · Research Journal in Advanced Humanities · doi:10.58256/4fd2qt78 · Cited by 27
“Chen & Cheng (2008) state that even with poor content, an essay can still receive a good score if it is long and uses certain lexico-grammatical elements that the scoring systems value.”
BackgroundMethodInfluentialElementary English learners’ engagement with automated feedback
Wilson, J., Palermo, C., & Wibowo, A. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.101890 · Cited by 27
Spelling: computerised feedback for self-correction
Lawley, J. (2015) · Computer Assisted Language Learning · doi:10.1080/09588221.2015.1069746 · Cited by 26
“As Chen and Cheng (2008) suggest, if teachers can off-load some work to reliable software, more time will be freed up in writing classes for instruction in areas where software is less helpful, such as genre, content and organisation.”
BackgroundTabari, M. A., Kushki, A., & Wang, Y. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2561608 · Cited by 27
Neural automated writing evaluation for Korean L2 writing
Lim, K., Song, J., & Park, J. (2022) · Natural Language Engineering · doi:10.1017/s1351324922000298 · Cited by 29
“2001; Rudner, Garcia, and Welch 2006; Wang and Brown 2007) or English as a second language (ESL) writers (Chen and Cheng 2008; Choi and Lee 2010).”
BackgroundCorpus-Based Evaluation Models for Quality Assurance Of AI-Generated ESL Learning Materials
Habib, F., & Bangladesh (2022) · doi:10.63125/m33q0j38 · Cited by 24
Electronic feedback on second language writing
Chang, C. Y.-H., Cunningham, K. J., Satar, M., & Strobl, C. (2018) · Writing & Pedagogy · doi:10.1558/wap.32515 · Cited by 27
Guo, X. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2024.2445177 · Cited by 23
“…2018) regarding the influence of language proficiency on engagement with WCF. Students engaged in dialog with ChatGPT, a departure from traditional automated WCF platforms, contrasting with the findings of (Chen & Cheng, 2008; Ranalli, 2018), which offered a more transactional feedback experience.”
EFL writers’ cognitive engagement with AWE feedback
Gießler, R. (2023) · Language Awareness · doi:10.1080/09658416.2023.2269088 · Cited by 26
“AWE research has been increasingly addressing students’ use of AWE feedback in instructional contexts (Chen & Cheng 2008; Jiang & Yu, 2022; Koltovskaia, 2020, p. 2; Waer, 2023; Warschauer & Grimes, 2008; Warschauer & Ware, 2006).”
BackgroundAI WRITING CORRECTION TOOLS: TEACHERS AND STUDENTS’ PERCEPTION
Putra, M. (2023) · JURNAL TATSQIF · doi:10.20414/jtq.v21i1.7963 · Cited by 25
“Very limited research has investigated this topic, particularly in balancing teachers' and students' perspectives, because their perceptions may affect AWE's effectiveness in supporting writing learning and have direct links to learning outcomes (Chen & Cheng, 2008).”
BackgroundPerceptions of L1 Glossed Feedback in Automated Writing Evaluation: A Case Study
Wilken, J. L. (2017) · CALICO Journal · doi:10.1558/cj.26383 · Cited by 22
Predictors of middle school students’ perceptions of automated writing evaluation
Wilson, J., Zhang, F., Palermo, C., Cordero, T. M. C., Myers, M. C., Eacker, H., Potter, A., & Coles, J. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104985 · Cited by 28
“…AWE systems are less precise than instructors at classifying grammatical errors and identify fewer errors overall (i.e., less ‘recall ’ ) (Shadiev & Feng, 2023), which can undermine students ’ trust and positive regard for AWE (e.g., Bai & Hu, 2017; Chen & Cheng, 2008, c. f., Dikli & Bleyle, 2014).”
BackgroundGrammarly in Teaching Writing to EFL Learners at Low Levels: How Useful Is It?
Guba, M. N. A., Guba, M. N. A., & Hashaad, N. (2024) · World Journal of English Language · doi:10.5430/wjel.v14n3p1 · Cited by 26
Wang, Q. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11179-1 · Cited by 21
“…but studies have shown that while such tools show satisfactory performance in evaluating form-focused writing tasks with relatively mature grammar and syntax analysis algorithms, they are not effective in understanding the meaning of a text (see for example Chen & Cheng, 2008; Cheville, 2004).”
BackgroundSystematic Literature Review of Automated Writing Evaluation as a Formative Learning Tool
Hibert, A. I. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29736-7_15 · Cited by 22
Ariyanto, M. S. A., Mukminatien, N., & Tresnadewi, S. (2021) · Jurnal Ilmu Pendidikan · doi:10.17977/um048v27i1p41-51 · Cited by 25
“This study supports many findings that also find students who engage superficially or perform a low level behavioral engagement with AWE program (Chen & Cheng, 2008; Zhang, 2016; Zhang & Hyland, 2018).”
BackgroundMethodResultInfluentialLillo-Fuentes, F., René Venegas, V., & Lobos, I. (2023) · Perspectiva educacional · doi:10.4151/07189729-vol.62-iss.2-art.1420 · Cited by 26
Yildiz, H., & Gönen, S. İ. K. (2024) · Turkish Online Journal of Distance Education · doi:10.17718/tojde.1169727 · Cited by 20
Teng, L. S., Deng, X., & Yang, J. (2026) · System · doi:10.1016/j.system.2026.103970 · Cited by 19
Artificial Intelligence as a Provider of Feedback on EFL Student Compositions
Alghannam, M. S. M. (2024) · World Journal of English Language · doi:10.5430/wjel.v15n2p161 · Cited by 18
Chapter 10. Nontraditional Student Access to OWI
Gos, M. W. (2015) · doi:10.37514/per-b.2015.0650.2.10 · Cited by 20
EFL Teachers Perceptions of Automated Written Corrective Feedback and Grammarly
Ali Dinçay, A. Y. A. N., & Erdemir, N. (2023) · Ahmet Keleşoğlu Eğitim Fakültesi Dergisi · doi:10.38151/akef.2023.106 · Cited by 19
Wilson, J., Zhang, S., Palermo, C., Cordero, T. M. C., Zhang, F., Myers, M. C., Potter, A. A., Eacker, H., & Coles, J. (2024) · Computers and Education Open · doi:10.1016/j.caeo.2024.100194 · Cited by 17
“While previous studies have examined general perceptions of fairness in AWE scoring [14,17,49], our findings expand this literature by revealing specific factors that can compromise students ’ perceptions of the validity of automated scoring.”
ResultImpact of AWE Rubrics and Automated Assessment on EFL Writing Instruction
Tang, J., & Wu, Y. (2017) · International Journal of Computer-Assisted Language Learning and Teaching · doi:10.4018/ijcallt.2017040104 · Cited by 18
Research on Reliability and Validity of Mobile Networks-Based Automated Writing Evaluation
Lang, F., Li, S., & Zhang, S. (2018) · International Journal of Mobile Computing and Multimedia Communications · doi:10.4018/ijmcmc.2019010102 · Cited by 18
Mehrabi-Yazdi, O. (2018) · Journal of Second Language Writing · doi:10.1016/j.jslw.2018.05.004 · Cited by 21
The effectiveness of an online grammar study scheme for Chinese undergraduate students
Windsor, R. J. (2021) · Smart Learning Environments · doi:10.1186/s40561-021-00147-w · Cited by 16
“In addition, although the present study ’ s significant results for learning grammar on-line generally corroborate with previous studies (Chen & Cheng, 2008; Kan & Tang, 2018; Liao, 2016; O ’ Neill & Russell, 2019), it also found support for Liao ’ s idea that “ human scaffolding should be provided…”
ResultCortés, J. A. N., & da Cunha, I. (2022) · Círculo de lingüística aplicada a la comunicación · doi:10.5209/clac.73906 · Cited by 16
Automatic Assessment of English CEFR Levels Using BERT Embeddings
Schmalz, V. J., & Brutti, A. (2022) · Accademia University Press eBooks · doi:10.4000/books.aaccademia.10828 · Cited by 18
The impact of Automated Essay Scoring (AES) for improving English language learner's essay writing
Choi, J. (2010) · Cited by 23
The Impact of Online Automated Writing Evaluation: A Case Study from Dalian
Rich, C. S. (2012) · Chinese Journal of Applied Linguistics · doi:10.1515/cjal-2012-0006 · Cited by 15
“Researchers and teachers are gaining understanding in utilizing AWE technology effectively to benefit both teachers and students (Grimes, 2008; Grimes & Warschauer, 2010; Chen & Cheng, 2008; Tang & Rich, 2011).”
BackgroundAn Investigation of the Use of Wikis in English Language Learning
Zou, B., Xiang, C. H., & Jeaco, S. (2012) · Chinese Journal of Applied Linguistics · doi:10.1515/cjal-2012-0008 · Cited by 16
“Teachers should provide support and pedagogical designs in ComputerAssisted Language Learning (CALL) environments, to reinforce students’ computerbased learning (Bax, 2003; Chambers & Bax, 2006; Chen & Cheng, 2008).”
BackgroundThe Impact of Using Automated Writing Feedback in ESL/EFL Classroom Contexts
Benali, A. (2021) · English Language Teaching · doi:10.5539/elt.v14n12p189 · Cited by 18
Goldshtein, M., Alhashim, A. G., & Roscoe, R. D. (2024) · Computers · doi:10.3390/computers13070160 · Cited by 16
“Indeed, these technologies can evaluate large numbers of essays with speed, consistency, and accuracy [15–19], and deliver actionable recommendations for students to revise and improve [20–25].”
BackgroundTomorrowland? Technical Innovation and Feedback on Writing
Hyland, K. (2025) · RELC Journal · doi:10.1177/00336882251357675 · Cited by 15
“Zhang and Hyland (2018) found that students saw the opportunity to revise an essay multiple times at their own pace without the need to wait as a major advantage of AWE feedback, while other studies have shown that it can promote multi-drafting and learner autonomy (Chen and Cheng, 2008).”
Koka, N. A., & Nisar Ahmad Koka, A. S. K. (2023) · Journal of Southwest Jiaotong University · doi:10.35741/issn.0258-2724.58.5.6 · Cited by 18
Students’ and Teacher’s Perceptions towards the Implementation of ProWritingAid and Teacher Feedback
Ariyanto, M. S. A., Mukminatien, N., & Tresnadewi, S. (2019) · Jurnal Pendidikan Teori Penelitian dan Pengembangan · doi:10.17977/jptpp.v4i10.12843 · Cited by 19
“It was also highlighted that an AWE program is not favourable to be used as a tool to replace the teacher because the students also need help to enrich the content of their texts (Chen & Cheng, 2008).”
BackgroundMethodInfluentialWrite to improve: exploring the impact of an automated feedback tool on Bahraini learners of English
Wali, F. A., & Huijser, H. (2018) · Learning and Teaching in Higher Education Gulf Perspectives · doi:10.18538/lthe.v15.n1.293 · Cited by 21
“Automated Writing Evaluation (AWE) or Automated Essay Scoring (AES) software (Chen & Cheng, 2008), which are about providing feedback to students, have been studied in recent years.”
MethodMy Access and Writing Error Corrections of EFL College Pre-intermediate Students
Chou, H.-N. C., Moslehpour, M., & Yang, C.-Y. (2016) · International Journal of Education · doi:10.5296/ije.v8i1.9209 · Cited by 16
“In addition, an extensive body of research has been conducted either in English-speaking contexts such as the United States or with English majors and advanced students in ESL/EFL contexts (Chen & Cheng, 2008; Fang, 2010; Grimes & Warschauer, 2010; Yeh et al., 2007).”
BackgroundMethodResultInfluentialReconsidering Teacher, Peer, and Computer‐Generated Feedback
Chong, I. (2017) · TESOL Journal · doi:10.1002/tesj.334 · Cited by 16
Link, S., & Koltovskaia, S. (2023) · Springer eBooks · doi:10.1007/978-3-031-36033-6_21 · Cited by 14
Learner Fit in Scaling Up Automated Writing Evaluation
Cotos, E., & Huffman, S. R. (2013) · International Journal of Computer-Assisted Language Learning and Teaching · doi:10.4018/ijcallt.2013070105 · Cited by 14
“Similarly, Chen and Cheng (2008), who also targeted EFL classrooms, found that AWE was perceived more favorably at earlier stages of drafting and revision, when the writing task is relatively new and demanding.”
BackgroundResultInfluentialTechnology-enhanced English Language Writing Assessment in the Classroom
Tang, J., Rich, C. S., & Wang, Y. (2012) · Chinese Journal of Applied Linguistics · doi:10.1515/cjal-2012-0029 · Cited by 13
Vakili, S., Ebadi, S., & Popescu, M. M. (2019) · Cogent Education · doi:10.1080/2331186x.2019.1571289 · Cited by 12
“Page 23 of 26 The pedagogical implication of the present study lies in the fact that DA based academic writing instruction can be more facilitative if the context in which it is provided (Chen & Cheng, 2008) and its different potentials for writing development (Lahuerta, 2017) are considered.”
BackgroundYu, B. (2015) · International Journal of Information and Education Technology · doi:10.7763/ijiet.2015.v5.616 · Cited by 12
The Analysis of Argument-Counterargument Structure in Chinese EFL Learners’ Argumentative Writing
Du, F. (2017) · Journal of Studies in Education · doi:10.5296/jse.v7i3.11275 · Cited by 12
Collins, P., Hwang, J. K., Zheng, B., & Warschauer, M. (2014) · Writing & Pedagogy · doi:10.1558/wap.v5i2.203 · Cited by 11
Structural Features of Undergraduate Writing: A Computational Approach
Arthurs, N. (2018) · The Journal of Writing Analytics · doi:10.37514/jwa-j.2018.2.1.06 · Cited by 10
Chapter 9. Multilingual Writers and OWI
Miller-Cochran, S. K. (2015) · doi:10.37514/per-b.2015.0650.2.09 · Cited by 13
Chen, J., & Parameshachari, B. D. (2023) · International Conference on Data Science and Network Security (ICDSNS) · doi:10.1109/icdsns58469.2023.10245381 · Cited by 12
“After a semester of teaching practice of the feedback system in English writing class based on AI feedback system, researchers selected 11 types of errors according to the frequency of errors in the writing process of learners in the experimental and control group in real-time writing data recorded by the AI-based fee…”
BackgroundMethodStudents’ perceptions of automated writing evaluation in autonomous learning
Wang, X. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13378-y · Cited by 10
“Due to its potential in enhancing learning outcomes, scholarly interest in the perceptions of AWE systems is experiencing a significant surge (Chen & Cheng, 2008; Wang et al., 2012; Grimes & Warschauer, 2010; Roscoe et al., 2014, 2017; Wilson et al., 2021a, 2024).”
InfluentialFormative Feedback in Online Distance Language Learning: Boosting Motivation With Automated Feedback
Taşkıran, A., & Yazıcı, M. (2021) · Advances in mobile and distance learning book series · doi:10.4018/978-1-7998-7681-6.ch005 · Cited by 15
Shiyao, W. (2021) · Frontiers in Educational Research · doi:10.25236/fer.2021.041117 · Cited by 11
“To the best knowledge of the researcher, the investigation with regard to the use of AWE tools has been limited to a single course level [4] [16] [17].”
BackgroundTowards Effective Integration and Positive Impact of Automated Writing Evaluation in L2 Writing
Cotos, E. (2012) · Iowa State University Digital Repository (Iowa State University) · Cited by 15
Rkiki, A., Nadif, B., Sakale, S., & Bidari, S. (2025) · The Journal of Quality in Education · doi:10.37870/joqie.v15i25.472 · Cited by 9
“Chen & Cheng (2008), Ferster et al (2012), Leow, (2020), Leow, 2023; Leow & Suh, (2021), O’Neill & Russell (2019), Chou et al. (2016), and Kotos (2011) note how this process can help users save time from the tedious task of manually checking and grading.”
Zhang, L., & Luo, T. (2025) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2025.2569481 · Cited by 11
“Researchers warn against technological over-dependence that may circumvent essential cognitive processes fundamental to language acquisition (Chen and Cheng 2008; Zhang 2020).”
Chapter 14. Preparing for the Rhetoricity of OWI
DePew, K. E. (2015) · doi:10.37514/per-b.2015.0650.2.14 · Cited by 15
Middle school teachers’ implementation and perceptions of automated writing evaluation
Wilson, J., Delgado, A. M., Palermo, C., Cordero, T. M. C., Myers, M. C., Eacker, H., Potter, A. A., Coles, J., & Zhang, S. (2024) · Computers and Education Open · doi:10.1016/j.caeo.2024.100231 · Cited by 10
“In the present study, when such alignment was absent, teachers experienced an unwanted burden of helping students interpret scores and understand limitations of automated scoring, a burden reported by teachers in prior research as well [27,31,22,25].”
Wang, S., & Li, R. (2019) · International Journal of Language and Linguistics · doi:10.11648/j.ijll.20190705.16 · Cited by 9
“The third type of research concentrates on the survey of teachers’ and students’ attitudes toward AWEs and indicates slightly positive feelings [3, 32, 43-47] mixed with few negative ones [48].”
BackgroundWang, J., & Bai, L. (2021) · International Journal of English Linguistics · doi:10.5539/ijel.v11n2p68 · Cited by 9
The Evaluation of a Blended Teaching Mode Based on an AI Language Learning Platform
Li, B., & Peng, M. (2021) · International Conference on Information Science and Education (ICISE-IE) · doi:10.1109/icise-ie53922.2021.00320 · Cited by 8
“Therefore, an English writing teaching mode was proposed to combine AES and other feedback methods, such as teacher feedback, peer review, etc. to achieve a comprehensive effect [9].”
MethodEnhancing the English writing skills of in-service students using marking mate automated feedback
Huynh-Cam, T.-T., Agrawal, S., Bui, T.-T., Nalluri, V., & Chen, L. (2023) · Asia Pacific Education Review · doi:10.1007/s12564-023-09904-7 · Cited by 8
“They provide learners with AF in the form of suggestions for improvement upon revision and automated essay scores to support learners in improving writing performance (Chen & Cheng, 2008; Foltz et al., 1999; Huang & Wilson, 2021; Knight et al., 2020).”
Song, Z. (2019) · English Language and Literature Studies · doi:10.5539/ells.v9n3p20 · Cited by 8
Qiang, Z. (2014) · International Journal of English Language Teaching · doi:10.5430/ijelt.v1n2p35 · Cited by 8
English-as-a-Foreign-Language Assessment in Taiwan
Vongpumivitch, V. (2012) · Language Assessment Quarterly · doi:10.1080/15434303.2012.649592 · Cited by 8
“To date, only one article about diagnostic assessment has been published in an international journal (C.-F. Chen & Cheng, 2008).”
BackgroundHuman Systems Engineering and Educational Technology
Roscoe, R. D., Branaghan, R. J., Cooke, N. J., & Craig, S. D. (2017) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-2639-1.ch001 · Cited by 8
Crusan, D. J. (2013) · Wiley eBooks · doi:10.1002/9781118411360.wbcla067 · Cited by 8
(2023) · Journal of Robotics and Automation Research · doi:10.33140/jrar.04.01.02 · Cited by 10
Su, Y. (2024) · Journal of Electrical Systems · doi:10.52783/jes.3904 · Cited by 9
Online Open-Source Writing Aid as a Pedagogical Tool
Sevcikova, B. L. (2018) · English Language Teaching · doi:10.5539/elt.v11n8p126 · Cited by 12
ENHANCING WRITING SKILLS OF EFL LEARNERS THROUGH AUTOMATED FEEDBACK: AN EMPIRICAL INVESTIGATION
Pariyanto, & Tungka, N. F. (2024) · Jurnal Ilmiah Spectral · doi:10.47255/gymtcf78 · Cited by 9
“Chen and Cheng (2008) found that scholars were not inclined toward using automated feedback in writing classes.”
BackgroundMethodResultInfluentialInvestigating effects of automated feedback on EFL students' reflective learning skills
Cheng, G., Ellie, L., & Wong, T.-L. (2016) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale.2016.7851798 · Cited by 7
“More importantly, students can become involved in an active, iterative and self-directed process of producing, evaluating and revising their own writing with reference to the machine feedback [3, 4].”
BackgroundReflexiones y percepciones sobre la evaluación automatizada del discurso escrito
Benítez, R. (2019) · Enunciación · doi:10.14483/22486798.14311 · Cited by 7
Natural Language Processing: Writing Analytics
Gibson, A., & Shibani, A. (2022) · Solar eBooks · doi:10.18608/hla22.010 · Cited by 12
Bibliometrically and systematically analyzing automated writing evaluation for English learning
Wu, T., & Yu, Z. (2024) · Forum for Linguistic Studies · doi:10.59400/fls.v5i3.1907 · Cited by 9
“Complete AWE feedback without humans could result in frustration for students and limit their development of writing skills (C. F. E. Chen and Cheng, 2008).”
BackgroundWare, P. (2018) · Wiley eBooks · doi:10.1002/9781118784235.eelt0543 · Cited by 7
GenAI and human assessments of L2 Chinese writing: Interrater reliability and rater bias
Lu, Y., Liles, X., & Ma, X. (2025) · Assessing Writing · doi:10.1016/j.asw.2025.100989 · Cited by 6
A Study of the Effectiveness of Student Perception-Based AI Feedback in College Writing Classes
Cheong, Y. (2024) · The Korean Association of General Education · doi:10.46392/kjge.2024.18.5.159 · Cited by 6
Integration of Automated Feedback Tools in EFL Academic Writing Classes: Teachers’ Perspective
Merkviladze, M. (2024) · Journal of Education in Black Sea Region · doi:10.31578/jebs.v10i1.323 · Cited by 6
“Higher Education Institution teachers can take advantage of the positive aspects of AI-driven feedback technologies as well as human feedback systems to help learners become more proficient writers and autonomous learners (Chen & Cheng, 2008).”
Chinese language learners’ anxiety toward chat partners in computer-mediated communication
Wang, Y., Crooks, S. M., & Borst, S. (2017) · Chinese as a Second Language (漢語教學研究—美國中文教師學會學報) The journal of the Chinese Language Teachers Association USA · doi:10.1075/csl.52.2.02wan · Cited by 8
Deng, X. (2022) · International Journal of Technology-Enhanced Education · doi:10.4018/ijtee.305807 · Cited by 6
Building a pedagogic spellchecker for L2 learners of Spanish
Blázquez-Carretero, M. (2023) · ReCALL · doi:10.1017/s0958344023000150 · Cited by 6
“As such, teachers would significantly save time that could potentially be allotted to more pressing aspects of L2 writing acquisition requiring human attention, like content, argumentation, organisational structure, or register (Chen & Cheng, 2008).”
Background
Metadata
- Authors
- Chen, C.-F. E., & Cheng, W.-Y. E. C.
- Affiliations
- National Kaohsiung First University of Science and Technology (TW)
- Venue
- Language Learning & Technology
- Published
- 2008-06-01
- Volume
- 12
- Issue
- 2
- Pages
- 94-112
- ISSN
- 1094-3501 (ISSN-L)
- OpenAlex
- W2122946606
- Cited by
- 304
- References
- 17
- Citations by year
- 2026: 22 · 2025: 17 · 2024: 33 · 2023: 32 · 2022: 28 · 2021: 29 · 2020: 15 · 2019: 16 · 2018: 19 · 2017: 11 · 2016: 17 · 2015: 17 · 2014: 13 · 2013: 13 · 2012: 9
- FWCI
- 43.13
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Language learning & technology (publishedVersion, cc-by-nc-nd)
- ScholarSpace (University of Hawaii at Manoa) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Language learning & technology (cc-by-nc-nd)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › English Language Learning and Teaching
- Social Sciences › Education › Student Assessment and Feedback
- Keywords
- automated writing evaluation, EFL writing, writing instruction, student perceptions, human feedback, peer feedback, teacher attitudes, learner characteristics, technology-enhanced language learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.