Automated Writing Evaluation and Feedback: Multiple Metrics of Efficacy

Using multivariate statistics

Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 79,888 · see citing works

Comparative fit indexes in structural models.

Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266 · see citing works

Structural Equations with Latent Variables

Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,512 · see citing works

Confirmatory factor analysis for applied research

Brown, T. A. (2007) · Choice Reviews Online · doi:10.5860/choice.44-2769 · Cited by 15,613 · see citing works

Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge

Mishra, P., & Koehler, M. J. (2006) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1111/j.1467-9620.2006.00684.x · Cited by 12,604 · see citing works

A Reliability Coefficient for Maximum Likelihood Factor Analysis

Tucker, L. R., & Lewis, C. (1973) · Psychometrika · doi:10.1007/bf02291170 · Cited by 7,330 · cited 1× · see citing works

SOCIAL VALIDITY: THE CASE FOR SUBJECTIVE MEASUREMENT or HOW APPLIED BEHAVIOR ANALYSIS IS FINDING ITS HEART ¹

Wolf, M. M. (1978) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1978.11-203 · Cited by 3,176 · see citing works

Statistical methods in psychology journals: Guidelines and explanations.

Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791 · see citing works

Statistically based tests for the number of common factors

Steiger, J. H. (1980) · Medical Entomology and Zoology · Cited by 2,413 · see citing works

Handbook of Writing Research

MacArthur, C. A., Graham, S. W., & Fitzgerald, J. (2005) · Cited by 2,327 · see citing works

Addressing first- and second-order barriers to change: Strategies for technology integration

Ertmer, P. A. (1999) · Educational Technology Research and Development · doi:10.1007/bf02299597 · Cited by 2,189 · see citing works

Integrating technology into K-12 teaching and learning: current knowledge gaps and recommendations for future research

Hew, K. F., & Brush, T. A. (2006) · Educational Technology Research and Development · doi:10.1007/s11423-006-9022-5 · Cited by 2,147 · see citing works

SELF-EFFICACY BELIEFS, MOTIVATION, AND ACHIEVEMENT IN WRITING: A REVIEW OF THE LITERATURE

Pajares, F. (2003) · Reading & Writing Quarterly · doi:10.1080/10573560308222 · Cited by 1,398 · see citing works

The Journal of Teacher Education

(1956) · Journal of Teacher Education · doi:10.1177/002248715600700102 · Cited by 1,201 · see citing works

Understanding the relationship between teachers’ pedagogical beliefs and technology use in education: a systematic review of qualitative evidence

Tondeur, J., van Braak, J., Ertmer, P. A., & Ottenbreit-Leftwich, A. T. (2016) · Educational Technology Research and Development · doi:10.1007/s11423-016-9481-2 · Cited by 1,146 · see citing works

Missing Data in Educational Research: A Review of Reporting Practices and Suggestions for Improvement

Peugh, J., & Enders, C. K. (2004) · Review of Educational Research · doi:10.3102/00346543074004525 · Cited by 1,107 · see citing works

Modeling and remodeling writing

Hayes, J. R. (2012) · Written Communication · doi:10.1177/0741088312451260 · Cited by 893 · see citing works

Training writing skills: a cognitive developmental perspective

Kellogg, R. T. (2008) · Journal of Writing Research · doi:10.17239/jowr-2008.01.01.1 · Cited by 868 · see citing works

A meta-analysis of writing instruction for students in the elementary grades.

Graham, S., McKeown, D., Kiuhara, S. A., & Harris, K. R. (2012) · Journal of Educational Psychology · doi:10.1037/a0029185 · Cited by 828 · see citing works

Teachers' perceptions of the barriers to technology integration and practices with technology under situated professional development

Kopcha, T. J. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.05.014 · Cited by 569 · see citing works

Untitled work

(2007) · Cited by 563 · see citing works

Automated Essay Scoring

Shermis, M. D., & Burstein, J. C. (2003) · Routledge eBooks · doi:10.4324/9781410606860 · Cited by 504 · see citing works

Handbook of Automated Essay Evaluation

(2013) · Routledge eBooks · doi:10.4324/9780203122761 · Cited by 491 · see citing works

Examining dimensions of self-efficacy for writing

Bruning, R., Dempsey, M., Kauffman, D. F., McKim, C., & Zumbrunn, S. (2013) · Journal of Educational Psychology · doi:10.1037/a0029692 · Cited by 470 · see citing works

Untitled work

(2003) · Cited by 449 · see citing works

Self-efficacy beliefs and the writing performance of entering high school students

Pajares, F., & Johnson, M. J. (1998) · Psychology in the Schools · doi:10.1002/(sici)1520-6807(199604)33:2 · Cited by 394 · see citing works

Teaching Writing to Elementary Students in Grades 4–6: A National Survey

Gilbert, J. K., & Graham, S. (2010) · The Elementary School Journal · doi:10.1086/651193 · Cited by 386 · see citing works

Sources of Writing Self-Efficacy Beliefs of Elementary, Middle, and High School Students

Pajares, F., Johnson, M. J., & Usher, E. L. (2007) · Research in the Teaching of English · doi:10.58680/rte20076485 · Cited by 373 · see citing works

Formative Assessment and Writing: A Meta-Analysis

Graham, S., Hebert, M., & Harris, K. R. (2015) · The Elementary School Journal · doi:10.1086/681947 · Cited by 340 · see citing works

Automated writing evaluation: Defining the classroom research agenda

Warschauer, M., & Ware, P. (2006) · Language Teaching Research · doi:10.1191/1362168806lr190oa · Cited by 337 · see citing works

Automated essay evaluation software in English Language Arts classrooms: Effects on teacher feedback, student motivation, and writing quality

Wilson, J., & Czik, A. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.05.004 · Cited by 297 · see citing works

The structural relationship between writing attitude and writing achievement in first and third grade students

Graham, S., Berninger, V. W., & Fan, W. (2007) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2007.01.002 · Cited by 294 · see citing works

The effects of computer-generated feedback on the quality of writing

Stevenson, M., & Phakiti, A. (2014) · Assessing Writing · doi:10.1016/j.asw.2013.11.007 · Cited by 275 · see citing works

On the relation between automated essay scoring and modern views of the writing construct

Deane, P. (2012) · Assessing Writing · doi:10.1016/j.asw.2012.10.002 · Cited by 274 · see citing works

Improving the writing skills of college students

Kellogg, R. T., & Raulerson, B. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194058 · Cited by 270 · see citing works

Training Advanced Writing Skills: The Case for Deliberate Practice

Kellogg, R. T., & Whiteford, A. P. (2009) · Educational Psychologist · doi:10.1080/00461520903213600 · Cited by 262 · see citing works

Automated Writing Assessment in the Classroom

Warschauer, M., & Grimes, D. (2008) · Pedagogies: An International Journal · doi:10.1080/15544800701771580 · Cited by 243 · see citing works

State-of-the-art automated essay scoring: Competition, results, and future directions from a United States demonstration

Shermis, M. D. (2014) · Assessing Writing · doi:10.1016/j.asw.2013.04.001 · Cited by 227 · see citing works

Relationships between writing motivation, writing activity, and writing performance: effects of grade, sex, and ability

Troia, G. A., Harbaugh, A. G., Shankland, R. K., Wolbers, K. A., & Lawrence, A. M. (2012) · Reading and Writing · doi:10.1007/s11145-012-9379-2 · Cited by 215 · see citing works

Teaching writing to middle school students: a national survey

Graham, S., Capizzi, A. M., Harris, K. R., Hebert, M. A., & Morphy, P. (2013) · Reading and Writing · doi:10.1007/s11145-013-9495-7 · Cited by 211 · see citing works

Word processing programs and weaker writers/readers: a meta-analysis of research findings

Morphy, P., & Graham, S. (2011) · Reading and Writing · doi:10.1007/s11145-010-9292-5 · Cited by 197 · see citing works

Automated Essay Scoring feedback for second language writers: How does it compare to instructor feedback?

Dikli, S., & Bleyle, S. (2014) · Assessing Writing · doi:10.1016/j.asw.2014.03.006 · Cited by 193 · see citing works

Do students' beliefs about writing relate to their writing self-efficacy, apprehension, and performance?

Sanders‐Reio, J., Alexander, P. A., Reio, T. G., & Newman, I. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2014.02.001 · Cited by 183 · see citing works

Validity arguments for diagnostic assessment using automated writing evaluation

Chapelle, C. A., Cotos, E., & Lee, J. (2015) · Language Testing · doi:10.1177/0265532214565386 · Cited by 158 · see citing works

Motivation Research in Writing: Theoretical and Empirical Considerations

Troia, G. A., Shankland, R. K., & Wolbers, K. A. (2012) · Reading & Writing Quarterly · doi:10.1080/10573569.2012.632729 · Cited by 157 · see citing works

Teacher Feedback, Writing Assignment Quality, and Third-Grade Students' Revision in Lower-And Higher-Achieving Urban Schools

Matsumura, L. C., Patthey‐Chavez, G. G., Valdés, R., & Garnier, H. (2002) · The Elementary School Journal · doi:10.1086/499713 · Cited by 147 · see citing works

Automated scoring and feedback systems: Where are we and where are we heading?

Xi, X. (2010) · Language Testing · doi:10.1177/0265532210364643 · Cited by 144 · see citing works

Writing pal: Feasibility of an intelligent writing strategy tutor in the high school classroom.

Roscoe, R. D., & McNamara, D. S. (2013) · Journal of Educational Psychology · doi:10.1037/a0032340 · Cited by 144 · see citing works

When “the state of the art” is counting words

Perelman, L. (2014) · Assessing Writing · doi:10.1016/j.asw.2014.05.001 · Cited by 129 · see citing works

Large-scale assessment, locally-developed measures, and automated scoring of essays: Fishing for red herrings?

Condon, W. (2012) · Assessing Writing · doi:10.1016/j.asw.2012.11.001 · Cited by 113 · see citing works

Teacher implementation of Self-Regulated Strategy Development with an automated writing evaluation system: Effects on the argumentative writing performance of middle school students

Palermo, C., & Thomson, M. M. (2018) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2018.07.002 · Cited by 107 · see citing works

Presentation, expectations, and experience: Sources of student perceptions of automated writing evaluation

Roscoe, R. D., Wilson, J., Johnson, A. C., & Mayra, C. R. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2016.12.076 · Cited by 98 · see citing works

Does Automated Feedback Help Students Learn to Write?

Kellogg, R. T., Whiteford, A. P., & Quinlan, T. (2010) · Journal of Educational Computing Research · doi:10.2190/ec.42.2.c · Cited by 88 · see citing works

A Critical Interpretative Synthesis: The Integration of Automated Writing Evaluation into Classroom Writing Instruction

Stevenson, M. (2016) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2016.05.001 · Cited by 85 · see citing works

Progress feedback effects on students' writing mastery goal, self-efficacy beliefs, and performance

Duijnhouwer, H., Prins, F. J., & Stokking, K. M. (2010) · Educational Research and Evaluation · doi:10.1080/13803611003711393 · Cited by 77 · see citing works

Research in Higher Education

Horowitz, M. (2013) · Research in Higher Education · doi:10.1007/11162.1573-188x · Cited by 76 · see citing works

Trait Ratings for Automated Essay Grading

Shermis, M. D., Koch, C. M., Page, E. B., Keith, T. Z., & Harrington, S. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062001001 · Cited by 67 · see citing works

Automated Scoring Technologies and the Rising Influence of Error

Cheville, J. (2004) · The English Journal · doi:10.2307/4128980 · Cited by 66 · see citing works

IEEE Transactions on Learning Technologies

(2022) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2022.3224333 · Cited by 57 · see citing works

Student Use of Automated Essay Evaluation Technology During Revision

Moore, N. S., & MacArthur, C. A. (2016) · Journal of Writing Research · doi:10.17239/jowr-2016.08.01.05 · Cited by 51 · see citing works

Awaiting a new wave: The status of state writing assessment in the United States

Behizadeh, N., & Pang, M. E. (2016) · Assessing Writing · doi:10.1016/j.asw.2016.05.003 · Cited by 50 · see citing works

CCCC Position Statement on Teaching, Learning, and Assessing Writing in Digital Environments

(2004) · College Composition and Communication · doi:10.58680/ccc20042788 · Cited by 46 · see citing works

Utility and usability as factors influencing teacher decisions about software integration

Okumuş, S., Lewis, L., Wiebe, E., & Hollebrands, K. F. (2016) · Educational Technology Research and Development · doi:10.1007/s11423-016-9455-4 · Cited by 38 · see citing works

Automated Writing Analysis for Writing Pedagogy

Cotos, E. (2015) · Writing & Pedagogy · doi:10.1558/wap.v7i2-3.26381 · Cited by 37 · see citing works

Does Automated Feedback Improve Writing Quality

Wilson, J., Olinghouse, N. G., & Andrada, G. N. (2014) · Learning disabilities · Cited by 35 · see citing works

Social validity: Perceptions of check and connect with early literacy support

Lyst, A. M., Gabriel, S., O'Shaughnessy, T. E., Meyers, J. P., & Meyers, B. (2005) · Journal of School Psychology · doi:10.1016/j.jsp.2005.04.004 · Cited by 34 · see citing works

Associated effects of automated essay evaluation software on growth in writing quality for students with and without disabilities

Wilson, J. (2016) · Reading and Writing · doi:10.1007/s11145-016-9695-z · Cited by 34 · see citing works

Universal screening with automated essay scoring: Evaluating classification accuracy in grades 3 and 4

Wilson, J. (2018) · Journal of School Psychology · doi:10.1016/j.jsp.2017.12.005 · Cited by 34 · see citing works

Text-based writing of low-skilled postsecondary students: relation to comprehension, self-efficacy and teacher judgments

Perin, D., Lauterbach, M. D., Raufman, J., & Kalamkarian, H. S. (2016) · Reading and Writing · doi:10.1007/s11145-016-9706-0 · Cited by 33 · see citing works

Using Automated Feedback to Improve Writing Quality

Wilson, J., & Andrada, G. N. (2015) · Advances in higher education and professional development book series · doi:10.4018/978-1-4666-9441-5.ch026 · Cited by 31 · see citing works

On the vulnerability of automated scoring to construct-irrelevant response strategies (CIRS): An illustration

Bejar, I. I., Flor, M., Futagi, Y., & Ramineni, C. (2014) · Assessing Writing · doi:10.1016/j.asw.2014.06.001 · Cited by 28 · see citing works

The Impact of Automated Essay Scoring on Writing Outcomes

Shermis, M. D., GARVAN, C. W., & Diao, Y. (2008) · Cited by 23 · see citing works

An Examination of How a Teacher's Use of Digital Tools Empowers and Constrains Language Arts Instruction

Hutchison, A. C., & Woodward, L. (2014) · Computers in the Schools · doi:10.1080/07380569.2014.967629 · Cited by 21 · see citing works

Automated Scoring in Assessment Systems

Bunch, M. B., Vaughn, D., & Miel, S. (2015) · Advances in higher education and professional development book series · doi:10.4018/978-1-4666-9441-5.ch023 · Cited by 17 · see citing works

Trait Ratings for Automated Essay Grading

Shermis, M. D., Koch, C. M., Page, E. B., et al. (2002) · Educational and Psychological Measurement · doi:10.1177/001316440206200101 · Cited by 14 · see citing works

Revealing the iceberg: Creative writing, process & deliberate practice

Monk, J. (2015) · English in Education · doi:10.1111/eie.12091 · Cited by 12 · see citing works

Comparing the quality of human and ChatGPT feedback of students’ writing

Steiss, J., Tate, T., Graham, S., Cruz, J., Hebert, M., Wang, J., Moon, Y., Tseng, W., Warschauer, M., & Olson, C. B. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.101894 · Cited by 509 · see citing works

Application of Artificial Intelligence powered digital writing assistant in higher education: randomized controlled trial

Nazari, N., Shabbir, M. S., & Setiawan, R. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e07014 · Cited by 405 · see citing works

Assessment in the age of artificial intelligence

Swiecki, Z., Khosravi, H., Chen, G., Martinez-Maldonado, R., Lodge, J. M., Milligan, S., Selwyn, N., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100075 · Cited by 409 · see citing works

Using LLMs to bring evidence-based feedback into the classroom: AI-generated feedback increases secondary students’ text revision, motivation, and positive emotions

Meyer, J., Jansen, T., Schiller, R., Liebenow, L. W., Steinbach, M., Horbach, A., & Fleckenstein, J. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100199 · Cited by 311 · see citing works

A systematic review of AI-based automated written feedback research

Shi, H., & Aryadoust, V. (2024) · ReCALL · doi:10.1017/s0958344023000265 · Cited by 222 · see citing works

A review of AWE feedback: types, learning outcomes, and implications

Fu, Q.-K., Zou, D., Xie, H., & Cheng, G. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2033787 · Cited by 173 · see citing works

Instructional design and learning outcomes of intelligent computer assisted language learning: Systematic review in the field

Weng, X., & Chiu, T. K. F. (2023) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2022.100117 · Cited by 181 · see citing works

Should You Fine-Tune BERT for Automated Essay Scoring?

Mayfield, E., & Black, A. W. (2020) · Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/2020.bea-1.15 · Cited by 150 · see citing works

Automated feedback and writing: a multi-level meta-analysis of effects on students' performance

Fleckenstein, J., Liebenow, L. W., & Meyer, J. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1162454 · Cited by 145 · see citing works

Effectiveness of automated writing evaluation systems in school settings: A systematic review of studies from 2000 to 2020

Nunes, A., Cordeiro, C., Limpo, T., & Castro, S. L. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12635 · Cited by 167 · see citing works

The Rise of Artificial Intelligence in Educational Measurement: Opportunities and Ethical Challenges

Bulut, O., Beiting-Parrish, M., Casabianca, J., Slater, S. C., Jiao, H., Song, D., Ormerod, C., Fabiyi, D. G., Ivan, R., Walsh, C., et al. (2024) · Chinese/English Journal of Educational Measurement and Evaluation · doi:10.59863/miql7785 · Cited by 83 · see citing works

The Effectiveness of Automated Writing Evaluation on Writing Quality: A Meta-Analysis

Zhai, N., & Ma, X. (2022) · Journal of Educational Computing Research · doi:10.1177/07356331221127300 · Cited by 169 · see citing works

Elementary teachers' perceptions of automated feedback and automated scoring: Transforming the teaching and learning of writing using automated writing evaluation

Wilson, J., Ahrendt, C., Fudge, E. A., Raiche, A., Beard, G., & MacArthur, C. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104208 · Cited by 118 · see citing works

Exploring ChatGPT-supported teacher feedback in the EFL context

Han, J., & Li, M. (2024) · System · doi:10.1016/j.system.2024.103502 · Cited by 116 · see citing works

An error-analysis study from an EFL writing context: Human and Automated Essay Scoring Approaches

Almusharraf, N., & Alotaibi, H. M. (2022) · Technology Knowledge and Learning · doi:10.1007/s10758-022-09592-z · Cited by 86 · see citing works

Implementing Automated Writing Evaluation in Different Instructional Contexts: A Mixed-Methods Study

Palermo, C., & Wilson, J. (2020) · Journal of Writing Research · doi:10.17239/jowr-2020.12.01.04 · Cited by 87 · see citing works

Types of teacher-AI collaboration in K-12 classroom instruction: Chinese teachers’ perspective

Kim, J. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12523-3 · Cited by 90 · see citing works

Using automated corrective feedback tools in language learning: a review study

Shadiev, R., & Feng, Y. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2022.2153145 · Cited by 71 · see citing works

Exploring ChatGPT as a writing assessment tool

Bucol, J. L., & Sangkawong, N. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2024.2363901 · Cited by 79 · see citing works

A systematic review and meta‐analysis of <scp>AI</scp> ‐enabled assessment in language learning: Design, implementation, and effectiveness

Chen, A., Zhang, Y., Jia, J., Liang, M., Cha, Y., & Lim, C. P. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.13064 · Cited by 67 · see citing works

Automated Feedback and Automated Scoring in the Elementary Grades: Usage, Attitudes, and Associations with Writing Outcomes in a Districtwide Implementation of MI Write

Wilson, J., Huang, Y., Palermo, C., Beard, G., & MacArthur, C. A. (2021) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00236-w · Cited by 71 · see citing works

An investigation on the use of automated feedback in Turkish EFL students’ writing classes

Han, T., & Sarı, E. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2067179 · Cited by 64 · see citing works

Equity Beyond Bias in Language Technologies for Education

Mayfield, E., Madaio, M., Prabhumoye, S., Gerritsen, D., McLaughlin, B., Dixon-Román, E., & Black, A. W. (2019) · Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/w19-4446 · Cited by 62 · see citing works

Automated writing evaluation: Does spelling and grammar feedback support high-quality writing and revision?

McCarthy, K. S., Roscoe, R. D., Allen, L. K., Likens, A. D., & McNamara, D. S. (2022) · Assessing Writing · doi:10.1016/j.asw.2022.100608 · Cited by 61 · see citing works

Automated Evaluation of Writing – 50 Years and Counting

Klebanov, B. B., & Madnani, N. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.697 · Cited by 60 · see citing works

The effect of integrating automated writing evaluation on EFL writing apprehension and grammatical knowledge

Waer, H. (2021) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2021.1914062 · Cited by 60 · see citing works

Perspectives on Using Automated Writing Evaluation Systems to Provide Written Corrective Feedback in the ESL Classroom

Woodworth, J., & Barkaoui, K. (2020) · TESL Canada Journal · doi:10.18806/tesl.v37i2.1340 · Cited by 60 · see citing works

The impact of automated writing evaluation on English as a foreign language learners' writing self‐efficacy, self‐regulation, anxiety, and performance

Sarı, E., & Han, T. (2024) · Journal of Computer Assisted Learning · doi:10.1111/jcal.13004 · Cited by 57 · see citing works

Still a fallible tool? Revisiting effects of automated writing evaluation from activity theory perspective

Li, R. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13294 · Cited by 60 · see citing works

Understanding AWE Feedback and English Writing of Learners with Different Proficiency Levels in an EFL Classroom: A Sociocultural Perspective

Xu, J., & Zhang, S. (2021) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-021-00577-7 · Cited by 58 · see citing works

Trends in automated writing evaluation systems research for teaching, learning, and assessment: A bibliometric analysis

Barrot, J. S. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-12083-y · Cited by 47 · see citing works

An Integrated Automatic Writing Evaluation and SVVR Approach to Improve Students’ EFL Writing Performance

Wang, Y., Luo, X., Liu, C., Tu, Y., & Wang, N. (2022) · Sustainability · doi:10.3390/su141811586 · Cited by 61 · see citing works

The future of standardised assessment: Validity and trust in algorithms for assessment and scoring

Aloisi, C. (2023) · European Journal of Education · doi:10.1111/ejed.12542 · Cited by 44 · see citing works

Using automated feedback to develop writing proficiency

Huang, Y., & Wilson, J. (2021) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2021.102675 · Cited by 43 · see citing works

The effects of an AWE-aided assessment approach on business English writing performance and writing anxiety: A contextual consideration

Sun, B., & Fan, T. (2021) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2021.101123 · Cited by 43 · see citing works

AI-assisted automated scoring of picture-cued writing tasks for language assessment

Zhao, R., Zhuang, Y., Zou, D., Xie, Q., & Yu, P. L. H. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11473-y · Cited by 40 · see citing works

Effective writing instruction for students in grades 6 to 12: a best evidence meta-analysis

Graham, S., Cao, Y.-C., Kim, Y., Lee, J., Tate, T., Collins, P., Cho, M., Moon, Y., Chung, H. Q., & Olson, C. B. (2024) · Reading & Writing · doi:10.1007/s11145-024-10539-2 · Cited by 46 · see citing works

Language learning development in human-AI interaction: A thematic review of the research landscape

Wang, F., Cheung, A., & Chai, C. S. (2024) · System · doi:10.1016/j.system.2024.103424 · Cited by 42 · see citing works

Exploring ChatGPT as a virtual tutor: A multi-dimensional analysis of large language models in academic support

Al-Abri, A. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13484-x · Cited by 44 · see citing works

Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing

Chen, H., & Pan, J. (2022) · Asian-Pacific Journal of Second and Foreign Language Education · doi:10.1186/s40862-022-00171-4 · Cited by 33 · see citing works

Towards automated writing evaluation: A comprehensive review with bibliometric, scientometric, and meta-analytic approaches

Xue, Y. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12596-0 · Cited by 33 · see citing works

Building a validity argument for an automated writing evaluation system (eRevise) as a formative assessment

Correnti, R. J., Matsumura, L. C., Wang, E. L., Litman, D. J., & Zhang, H. (2022) · Computers and Education Open · doi:10.1016/j.caeo.2022.100084 · Cited by 28 · see citing works

Comparing self-reflection and peer feedback practices in an academic writing task: a student self-efficacy perspective

Wei, W., Cheong, C. M., Zhu, X., & Lu, Q. (2022) · Teaching in Higher Education · doi:10.1080/13562517.2022.2042242 · Cited by 33 · see citing works

Effectiveness of the Automated Writing Evaluation Program on Improving Undergraduates’ Writing Performance

Geng, J., & Razali, A. B. (2022) · English Language Teaching · doi:10.5539/elt.v15n7p49 · Cited by 26 · see citing works

The Platformization of Writing Instruction: Considering Educational Equity in New Learning Ecologies

Stornaiuolo, A., Higgs, J., Nichols, T. P., LeBlanc, R. J., & de Roock, R. S. (2023) · Review of Research in Education · doi:10.3102/0091732x241227431 · Cited by 31 · see citing works

Classification accuracy and efficiency of writing screening using automated essay scoring

Wilson, J., & Rodrigues, J. (2020) · Journal of School Psychology · doi:10.1016/j.jsp.2020.08.008 · Cited by 25 · see citing works

Artificial Intelligence, Teacher Tasks and Individualized PedagogyPreprint

Ferman, B., Lima, L., & Riva, F. (2021) · doi:10.31235/osf.io/qw249 · Cited by 23 · see citing works

Analytical Techniques for Developing Argumentative Writing in STEM: A Pilot Study

Davies, P., Passonneau, R. J., Muresan, S., & Gao, Y. (2021) · IEEE Transactions on Education · doi:10.1109/te.2021.3116202 · Cited by 21 · see citing works

Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications

(2020) · doi:10.18653/v1/2020.bea-1 · Cited by 22 · see citing works

Automated Writing Evaluation for ESL Learners : A Case Study of Pigai System

Yao, D. (2021) · The Journal of AsiaTEFL · doi:10.18823/asiatefl.2021.18.3.14.949 · Cited by 20 · see citing works

The Sensitivity of a Scenario-Based Assessment of Written Argumentation to School Differences in Curriculum and Instruction

Deane, P., Wilson, J., Zhang, M., Li, C., van Rijn, P. W., Guo, H., Roth, A., Winchester, E., & Richter, T. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00227-x · Cited by 18 · see citing works

Automated Writing Evaluation in EFL Contexts

Aldosemani, T. I., Assalahi, H. M., Lhothali, A., & Albsisi, M. (2023) · International Journal of Computer-Assisted Language Learning and Teaching · doi:10.4018/ijcallt.329962 · Cited by 27 · see citing works

Exploring the Potential of ChatGPT for Evaluating English Essays in a Criterion‐Based Assessment

Gjorevski, A., Li, M., & Cox, T. L. (2025) · TESOL Quarterly · doi:10.1002/tesq.70011 · Cited by 19 · see citing works

Predictors of middle school students’ perceptions of automated writing evaluation

Wilson, J., Zhang, F., Palermo, C., Cordero, T. M. C., Myers, M. C., Eacker, H., Potter, A., & Coles, J. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104985 · Cited by 17 · see citing works

Effectiveness of Generative AI in Automated Written Corrective Feedback With Prompting

Wu, J., Li, J., Ge, Z.-G., Xu, M., Li, L., & Zhang, R. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251359430 · Cited by 18 · see citing works

Statewide implementation of automated writing evaluation: analyzing usage and associations with state test performance in grades 4-11

Potter, A., & Wilson, J. (2021) · Educational Technology Research and Development · doi:10.1007/s11423-021-10004-9 · Cited by 15 · see citing works

Automated Feedback on Writing

Cotos, E. (2023) · Springer eBooks · doi:10.1007/978-3-031-36033-6_22 · Cited by 15 · see citing works

Facilitating self-directed language learning in real-life scene description tasks with automated evaluation

Zhao, R., Zhuang, Y., Xie, Z., & Yu, P. L. H. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105106 · Cited by 22 · see citing works

Automatic Assessment of English CEFR Levels Using BERT Embeddings

Schmalz, V. J., & Brutti, A. (2022) · Accademia University Press eBooks · doi:10.4000/books.aaccademia.10828 · Cited by 15 · see citing works

The potential of deep learning in improving K‐12 students' writing skills: A systematic review

Bal, M., & Öztürk, E. (2025) · British Educational Research Journal · doi:10.1002/berj.4120 · Cited by 14 · see citing works

Capturing the Challenges in Assessing Writing

Dockrell, J. E., & Connelly, V. J. (2021) · doi:10.1093/oso/9780198863564.003.0005 · Cited by 12 · see citing works

AI's effectiveness in language testing and feedback provision

Alshehri, A. (2025) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2025.101892 · Cited by 11 · see citing works

Evaluación automatizada y semiautomatizada de la calidad de textos escritos: una revisión sistemática

Lillo-Fuentes, F., René Venegas, V., & Lobos, I. (2023) · Perspectiva educacional · doi:10.4151/07189729-vol.62-iss.2-art.1420 · Cited by 11 · see citing works

A comparative study of rule-based, machine learning and large language model approaches in automated writing evaluation (AWE)

Yeung, S. (2025) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3706468.3706566 · Cited by 14 · see citing works

Bringing Automatic Scoring into the Classroom – Measuring the Impact of Automated Analytic Feedback on Student Writing Performance

Horbach, A., Laarmann-Quante, R., Liebenow, L. W., Jansen, T., Keller, S., Meyer, J., Zesch, T., & Fleckenstein, J. (2022) · Linköping electronic conference proceedings · doi:10.3384/ecp190008 · Cited by 11 · see citing works

The early automated writing evaluation (eAWE) framework

McNamara, D. S., & Kendeou, P. (2022) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2022.2037509 · Cited by 12 · see citing works

Literacy: From the Perspective of Text and Discourse Theory

McNamara, D. S., Roscoe, R. D., Allen, L. K., Balyan, R., & McCarthy, K. S. (2019) · Journal of language and Education · doi:10.17323/jle.2019.10196 · Cited by 10 · see citing works

Technology use in secondary level of English language teaching: A Literature Review

Luthfiyyah, R., Hafifah, G. N., Ivone, F. M., & Tresnadewi, S. (2021) · JEES (Journal of English Educators Society) · doi:10.21070/jees.v6i1.1020 · Cited by 18 · see citing works

Can human-machine feedback in a smart learning environment enhance learners’ learning performance? A meta-analysis

Liao, M., Zhu, K., & Wang, G. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1288503 · Cited by 12 · see citing works

Evaluating the Construct Validity of an Automated Writing Evaluation System with a Randomization Algorithm

Myers, M. C., & Wilson, J. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-022-00301-6 · Cited by 9 · see citing works

Automated writing evaluation tools for Indonesian undergraduate English as a foreign language students’ writing

Miranty, D., Widiati, U., Cahyono, B. Y., & Sharif, T. I. S. T. (2023) · International Journal of Evaluation and Research in Education (IJERE) · doi:10.11591/ijere.v12i3.24958 · Cited by 19 · see citing works

Upper-Elementary Students’ Metacognitive Knowledge about Writing and Its Relationship to Writing Outcomes across Genres

Wilson, J., & Wen, H. (2022) · The Elementary School Journal · doi:10.1086/720562 · Cited by 9 · see citing works

An Automated English Essay Scoring Engine Based on Neutrosophic Ontology for Electronic Education Systems

Darwish, S. M., Ali, R. A., & El-Zoghabi, A. A. (2023) · Applied Sciences · doi:10.3390/app13158601 · Cited by 8 · see citing works

Incorporating ChatGPT as an automated written corrective feedback tool into L2 writing class

Zhang, Y. (2024) · Journal of Language Teaching · doi:10.54475/jlt.2024.024 · Cited by 11 · see citing works

Avaliação Automática de Redação: Uma revisão sistemática

de Lima, T. B., da Silva, I. L. A., Freitas, E., & Mello, R. F. (2023) · Revista Brasileira de Informática na Educação · doi:10.5753/rbie.2023.2869 · Cited by 8 · see citing works

Writing motivation and ability profiles and transition during a technology-based writing intervention

Cordero, T. M. C., Wilson, J., Myers, M. C., Palermo, C., Eacker, H., Potter, A. A., & Coles, J. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1196274 · Cited by 10 · see citing works

Evaluating the consistency between human raters and three AI systems on the scoring of argumentative essays

Kim, S., & McCrudden, M. T. (2026) · Assessing Writing · doi:10.1016/j.asw.2026.101031 · Cited by 9 · see citing works

An empirical study of the effects of intelligent cognitive diagnostic feedback strategy on L2 writing performance, epistemic structure, and transferability

Yang, G., Zhou, W., Zhou, H., Li, J., Chen, X., & Tu, Y. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11905-3 · Cited by 8 · see citing works

Exploring the Long-Term Effects of the Statewide Implementation of an Automated Writing Evaluation System on Students’ State Test ELA Performance

Yue, H., Wilson, J., & May, H. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00443-9 · Cited by 10 · see citing works

Students’ perceptions of automated writing evaluation in autonomous learning

Wang, X. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13378-y · Cited by 7 · see citing works

Automated Essay Scoring

Klebanov, B. B., & Madnani, N. (2021) · Synthesis lectures on human language technologies · doi:10.2200/s01121ed1v01y202108hlt052 · Cited by 7 · see citing works

AUTOMATED WRITING EVALUATION SYSTEM FOR FEEDBACK IN THE DIGITAL WORLD: AN ONLINE LEARNING OPPORTUNITY FOR ENGLISH AS A FOREIGN LANGUAGE STUDENTS

Yildiz, H., & Gönen, S. İ. K. (2024) · Turkish Online Journal of Distance Education · doi:10.17718/tojde.1169727 · Cited by 6 · see citing works

Automatic Scoring System for English Writing Based on Natural Language Processing: Assessment of Accuracy and Educational Effect

Cui, Y. (2024) · Forum for Linguistic Studies · doi:10.30564/fls.v6i6.7135 · Cited by 6 · see citing works

Comparative Study About the Impacts of Chinese Automated Writing Evaluation (AWE) Feedback and Teacher Feedback on Middle School Students’ Writing Practice

Liu, S., Boudouaia, A., Chen, X., & Li, Y. (2024) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-024-00903-9 · Cited by 6 · see citing works

Middle school teachers’ implementation and perceptions of automated writing evaluation

Wilson, J., Delgado, A. M., Palermo, C., Cordero, T. M. C., Myers, M. C., Eacker, H., Potter, A. A., Coles, J., & Zhang, S. (2024) · Computers and Education Open · doi:10.1016/j.caeo.2024.100231 · Cited by 6 · see citing works

Automated strategy feedback can improve the readability of physicians’ electronic communications to simulated patients

Roscoe, R. D., Balyan, R., McNamara, D. S., Banawan, M., & Schillinger, D. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103059 · Cited by 6 · see citing works

The Effects of Automated Writing Evaluation (AWE)+Human Feedback on the Quality of Argumentative Writing by Chinese EFL Learners

Yan, Z., Jalaluddin, I. B., Mamat, R. B., & Zhao, T. (2025) · Journal of Language Teaching and Research · doi:10.17507/jltr.1603.20 · Cited by 5 · see citing works

The Effect of Feedback on Informative Text Writing: AI or Teacher?

Baz, M. A., & Hasırcı, S. (2025) · Open Praxis · doi:10.55982/openpraxis.17.3.871 · Cited by 12 · see citing works

A Bibliometric Analysis of Automated Writing Evaluation in Education Using VOSviewer and CitNetExplorer from 2008 to 2022

Deng, X. (2022) · International Journal of Technology-Enhanced Education · doi:10.4018/ijtee.305807 · Cited by 5 · see citing works

A Research on the Blended Evaluation Mode in College English Writing Course

Liu, S. (2022) · Journal of Language Teaching and Research · doi:10.17507/jltr.1304.09 · Cited by 5 · see citing works

Exploring the Effectiveness of Large‐Scale Automated Writing Evaluation Implementation on State Test Performance Using Generalised Boosted Modelling

Yue, H., & Wilson, J. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70009 · Cited by 6 · see citing works

Lower secondary school teachers facilitation of students’ writing process: a study of automated feedback and peer feedback approaches

Segaran, M. K., Engeness, I., & Gamlem, S. M. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2539154 · Cited by 4 · see citing works

Automatic Punctuation Verification of School Students’ Essay in Portuguese

de Lima, T. B., Rodrigues, L., Macario, V., Freitas, E., & Mello, R. F. (2023) · doi:10.5753/eniac.2023.233559 · Cited by 4 · see citing works

Cost analysis and cost-effectiveness of hand-scored and automated approaches to writing screening

Matta, M., Keller‐Margulis, M. A., & Mercer, S. H. (2022) · Journal of School Psychology · doi:10.1016/j.jsp.2022.03.003 · Cited by 5 · see citing works

Academic Writing Problems in L2 Settings: Realities and Need for Intervention

Al-Khulaidi, M. A., & Abdulkhalek, M. M. (2022) · Journal of English Studies in Arabia Felix · doi:10.56540/jesaf.v1i1.15 · Cited by 4 · see citing works

Review of Feedback in Automated Essay ScoringPreprint

Jong, Y.-J., Kim, Y.-J., & Ri, O.-C. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4462105 · Cited by 4 · see citing works

Automated Subjective Answer Evaluation Using Machine LearningPreprint

Aggarwal, I., Gautam, P., & Parashar, G. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4483888 · Cited by 4 · see citing works

Consequences of Response Formats on Racial and Ethnic Bias and Fairness in Writing Assessments

Matta, M., & Hamsho, N. F. (2025) · School Psychology Review · doi:10.1080/2372966x.2025.2462984 · Cited by 3 · see citing works

Impact of Automated Writing Evaluation (AWE) on Middle School Students’ Writing Outcomes

Wilson, J., Palermo, C., Myers, M. C., Cordero, T. M. C., Eacker, H., Potter, A., Coles, J., May, H., & Zhang, F. (2025) · American Educational Research Journal · doi:10.3102/00028312251388655 · Cited by 3 · see citing works

Improving Argument-Based Explanation Writing in Inclusive High School Science Class for Students with and without Exceptionalities

Drew, S. V., Thomas, J. D., & Nagle, C. (2024) · Exceptionality · doi:10.1080/09362835.2024.2376527 · Cited by 3 · see citing works

Effectiveness of automated writing evaluation systems in school settings: A systematic review of studies from 2000 to 2020

Nunes, A., Cordeiro, C., Limpo, T., & Castro, S. L. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12635 · Cited by 167 · see citing works

The Effectiveness of Automated Writing Evaluation on Writing Quality: A Meta-Analysis

Zhai, N., & Ma, X. (2022) · Journal of Educational Computing Research · doi:10.1177/07356331221127300 · Cited by 169 · see citing works

A Systematic Review of Automated Writing Evaluation Feedback: Validity, Effects and Students’ Engagement

Liu, W. (2024) · Language Teaching Research Quarterly · doi:10.32038/ltrq.2024.45.05 · Cited by 22 · see citing works

The Effects of Automated Writing Evaluation (AWE) Feedback on Students’ English Writing Quality: A Systematic Literature Review

Fan, N., & Ma, Y. (2022) · Language Teaching Research Quarterly · doi:10.32038/ltrq.2022.28.03 · Cited by 33 · see citing works

Exploring the Effectiveness of Large‐Scale Automated Writing Evaluation Implementation on State Test Performance Using Generalised Boosted Modelling

Yue, H., & Wilson, J. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70009 · Cited by 6 · see citing works