The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Student engagement with automated written corrective feedback (AWCF) provided by Grammarly: A multiple case study
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Our study supports previous studies on improving writing engagement with AWCF (Koltovskaia, 2020; Zhang, 2020).”
From Application of Artificial Intelligence powered digital writing assistant in higher education: randomized controlled trial (2021) · cites this paper as Koltovskaia, 2020
In the citing paper
“Research has shown that students often accept automated feedback with little cognitive engagement, highlighting the risk of thoughtless reliance on AI tools (Koltovskaia, 2020).”
From Measuring undergraduate students’ reliance on generative AI during problem-solving: Scale development and validation. (2025) · cites this paper as Koltovskaia, 2020
Citations
Cites
(1984) · Cited by 81,983
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
Creswell, J. W. (1994) · Cited by 35,212
Research design: qualitative, quantitative, and mixed methods approaches
Caldas, M. (2003) · Revista de Administração Contemporânea · doi:10.1590/s1415-65552003000100015 · Cited by 18,688
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581
(2008) · Cited by 7,674
Case study research: Design and methods
McCorcle, M. D., & Bell, E. L. (1986) · Evaluation and Program Planning · doi:10.1016/0149-7189(86)90052-2 · Cited by 5,884
SWAIN, M., & LAPKIN, S. (1995) · Applied Linguistics · doi:10.1093/applin/16.3.371 · Cited by 1,407
Stimulated Recall Methodology in Second Language Research
Gass, S. M., Gass, S. M., Mackey, A., & Mackey, A. (2013) · Routledge eBooks · doi:10.4324/9781410606006 · Cited by 969
AUTOMATED ESSAY SCORING WITH E‐RATER® V.2.0
Attali, Y., & Burstein, J. C. (2004) · ETS Research Report Series · doi:10.1002/j.2333-8504.2004.tb01972.x · Cited by 641
Research works printed but not linked: 1
- Ranalli, J., & Yamashita, T. (2019, March). Synchronous automated written corrective feedback: Effects on L2 college students’ revision behavior and text quality. Paper presented at the American Association for Applied Linguistics (AAAL) Annual Conference.
Cited by
Sorted by citations
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.9 · Cited by 1,806
Impact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation
Yan, D. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11742-4 · Cited by 713
Exploring the potential of using an AI language model for automated essay scoring
Mizumoto, A., & Eguchi, M. (2023) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2023.100050 · Cited by 647
AI-generated feedback on writing: insights into efficacy and ENL student preference
Escalante, J., Pack, A., & Barrett, A. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00425-2 · Cited by 589
Guo, K., & Wang, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12146-0 · Cited by 449
Warschauer, M., Tseng, W., Yim, S., Webster, T. J., Jacob, S. R., Du, Q., & Tate, T. P. (2023) · Journal of Second Language Writing · doi:10.1016/j.jslw.2023.101071 · Cited by 427
Warschauer, M., Tseng, W., Yim, S., Webster, T., Jacob, S., Du, Q., & Tate, T. (2023) · doi:10.2139/ssrn.4404380 · Cited by 425
Nazari, N., Shabbir, M. S., & Setiawan, R. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e07014 · Cited by 405
Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study
Mahapatra, S. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00295-9 · Cited by 398
AI in the Foreign Language Classroom: A Pedagogical Overview of Automated Writing Assistance Tools
Alharbi, W. (2023) · Education Research International · doi:10.1155/2023/4253331 · Cited by 286
AI and English language teaching: Affordances and challenges
Crompton, H., Edmett, A., Ichaporia, N., & Burke, D. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13460 · Cited by 282
Barrot, J. S. (2023) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1936071 · Cited by 248
Co-Writing with Opinionated Language Models Affects Users’ Views
Jakesch, M., Bhat, A., Buschek, D., Zalmanson, L., & Naaman, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581196 · Cited by 265
Fostering student engagement with feedback: An integrated approach
Zhang, Z., & Hyland, K. (2021) · Assessing Writing · doi:10.1016/j.asw.2021.100586 · Cited by 351
A systematic review of AI-based automated written feedback research
Shi, H., & Aryadoust, V. (2024) · ReCALL · doi:10.1017/s0958344023000265 · Cited by 222
Affordances and challenges of artificial intelligence in K-12 education: a systematic review
Crompton, H., Jones, M. V., & Burke, D. (2024) · Journal of Research on Technology in Education · doi:10.1080/15391523.2022.2121344 · Cited by 213
Wang, C. (2025) · Technology Knowledge and Learning · doi:10.1007/s10758-024-09744-3 · Cited by 212
“One prominent application is automatic written evaluation (AWE), which comprises two main elements: a scoring engine producing automatic scores and a feedback engine delivering automated written corrective feedback (AWCF) (Koltovskaia, 2020).”
Koltovskaia, S., Rahmati, P., & Saeli, H. (2024) · Journal of Second Language Writing · doi:10.1016/j.jslw.2024.101130 · Cited by 241
Self-citationL2 student engagement with automated feedback on writing: Potential for learning and issues of trust
Ranalli, J. (2021) · Journal of Second Language Writing · doi:10.1016/j.jslw.2021.100816 · Cited by 184
Zhan, Y., & Yan, Z. (2026) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2471821 · Cited by 162
Delcker, J., Heil, J., Ifenthaler, D., Seufert, S., & Spirgi, L. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00452-7 · Cited by 198
Pack, A., & Maloney, J. S. (2023) · TESOL Quarterly · doi:10.1002/tesq.3253 · Cited by 140
Ou, A. W., Stöhr, C., & Malmström, H. (2024) · System · doi:10.1016/j.system.2024.103225 · Cited by 224
Utami, S. P. T., Andayani, A., Winarni, R., & Sumarwati, S. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13419 · Cited by 124
Ding, L., & Zou, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12402-3 · Cited by 122
Wilson, J., Ahrendt, C., Fudge, E. A., Raiche, A., Beard, G., & MacArthur, C. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104208 · Cited by 118
Guo, Q., Feng, R., & Hua, Y. (2021) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1879161 · Cited by 112
Sadoughi, M., & Hejazi, S. Y. (2022) · Current Psychology · doi:10.1007/s12144-022-03045-7 · Cited by 125
Testing the viability of ChatGPT as a companion in L2 writing accuracy assessment
Mizumoto, A., Shintani, N., Sasaki, M., & Teng, M. F. (2024) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2024.100116 · Cited by 104
Integrating technology into ESL/EFL writing through Grammarly
Barrot, J. S. (2022) · RELC Journal · doi:10.1177/0033688220966632 · Cited by 96
Using Artificial Intelligence in TESOL: Some Ethical and Pedagogical Considerations
Pack, A., & Maloney, J. S. (2024) · TESOL Quarterly · doi:10.1002/tesq.3320 · Cited by 122
Kohnke, L. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100279 · Cited by 126
Yan, D., & Zhang, S. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03543-y · Cited by 90
Yang, H., Gao, C., & Shen, H. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11991-3 · Cited by 141
Cheng, X., & Liu, Y. (2022) · System · doi:10.1016/j.system.2022.102880 · Cited by 99
Appropriating automated feedback in L2 writing: experiences of Chinese EFL student writers
Jiang, L. G., & Yu, S. (2020) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1799824 · Cited by 88
How Teacher and Grammarly Feedback Complement One Another in Myanmar EFL Students’ Writing
Thi, N. K., & Nikolov, M. (2022) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-021-00625-2 · Cited by 77
Sevgi, U. T., Erol, G., Doğruel, Y., Sönmez, O. F., Tubbs, R. S., & Güngör, A. (2023) · Neurosurgical Review · doi:10.1007/s10143-023-01998-2 · Cited by 80
Mantello, P. A., Ho, T. M., Nguyen, M., & Vuong, Q. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-01837-1 · Cited by 92
Exploring the Potential of Using an Ai Language Model for Automated Essay ScoringPreprint
Mizumoto, A., & Eguchi, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4373111 · Cited by 86
Using automated corrective feedback tools in language learning: a review study
Shadiev, R., & Feng, Y. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2022.2153145 · Cited by 71
Maphoto, K. B., Sevnarayan, K., Mohale, N. E., Suliman, Z., Ntsopi, T. J., & Mokoena, D. (2024) · Open Praxis · doi:10.55982/openpraxis.16.2.649 · Cited by 129
Ye, Y., Li, H., & Sawaengdist, A. (2024) · Language Learning in Higher Education · doi:10.1515/cercles-2023-0006 · Cited by 100
Zare, J., Ranjbaran, F., & Derakhshan, A. (2025) · Applied Linguistics · doi:10.1093/applin/amaf045 · Cited by 78
Hou, C., Zhu, G., Sudarshan, V., Lim, F. S., & Ong, Y. S. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105329 · Cited by 70
Artificial Intelligence-Based Tools in Research Writing
Adams, D., & Chuah, K.-M. (2022) · CRC Press eBooks · doi:10.1201/9781003184157-9 · Cited by 81
Leveraging AI tools to develop the writer rather than the writing
Ingley, S. J., & Pack, A. (2023) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2023.05.007 · Cited by 65
Yeung, S. (2025) · Journal of Second Language Writing · doi:10.1016/j.jslw.2025.101203 · Cited by 70
Cheng, X., & Zhang, L. J. (2024) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2024.101337 · Cited by 62
Yao, Y., Wang, W., & Yang, X. (2021) · Assessing Writing · doi:10.1016/j.asw.2021.100568 · Cited by 63
McCarthy, K. S., Roscoe, R. D., Allen, L. K., Likens, A. D., & McNamara, D. S. (2022) · Assessing Writing · doi:10.1016/j.asw.2022.100608 · Cited by 61
Cortez, P., Ong, A. K. S., Diaz, J. F. T., German, J. D., & Jagdeep, S. J. S. S. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e25896 · Cited by 75
Understanding student engagement with teacher and peer feedback in L2 writing
Cheng, X., Liu, Y., & Wang, C. (2023) · System · doi:10.1016/j.system.2023.103176 · Cited by 78
Kohnke, L., Zou, D., & Su, F. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100371 · Cited by 109
Investigating students’ engagement in chatbot-supported classroom debates
Guo, K., Zhong, Y., Li, D., & Chu, S. K. W. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2023.2207181 · Cited by 66
Li, J., Huang, J., Wu, W., & Whipple, P. B. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03755-2 · Cited by 104
AI Language Models as Educational Allies: Enhancing Instructional Support in Higher Education
Zekaj, R. (2023) · International Journal of Learning Teaching and Educational Research · doi:10.26803/ijlter.22.8.7 · Cited by 54
Potential Benefits and Risks of Artificial Intelligence in Education
Özer, M. (2024) · Bartın University Journal of Faculty of Education · doi:10.14686/buefad.1416087 · Cited by 72
Automated writing evaluation use in second language classrooms: A research synthesis
Karatay, Y., & Karatay, L. (2024) · System · doi:10.1016/j.system.2024.103332 · Cited by 49
Xu, S., Su, Y., & Liu, K. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13457-0 · Cited by 98
Vo, H. (2022) · Language Teaching Research · doi:10.1177/13621688221075781 · Cited by 56
Barrot, J. S. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-12083-y · Cited by 47
Generative AI for scalable feedback to multimodal exercises
Jürgensmeier, L., & Skiera, B. (2024) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2024.05.005 · Cited by 59
Using Peerceptiv to support AI-based online writing assessment across the disciplines
Li, A. W. (2023) · Assessing Writing · doi:10.1016/j.asw.2023.100746 · Cited by 44
Fan, N. (2023) · SAGE Open · doi:10.1177/21582440231181296 · Cited by 44
Fokides, E., & Peristeraki, E. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12912-8 · Cited by 59
Shen, C., Shi, P., Guo, J., Xu, S., & Tian, J. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1258286 · Cited by 42
Koltovskaia, S. (2022) · ReCALL · doi:10.1017/s0958344022000179 · Cited by 42
Self-citationInvestigating the Effects of UsingGrammarlyin EFL Writing: The Case of Articles
Ebadi, S., Gholami, M., & Vakili, S. (2022) · Computers in the Schools · doi:10.1080/07380569.2022.2150067 · Cited by 52
Rahimi, M., Fathi, J., & Zou, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12896-5 · Cited by 89
Thi, N. K., Nikolov, M., & Simon, K. (2022) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2022.2122476 · Cited by 45
Voluntary use of automated writing evaluation by content course students
Sarıcaoğlu, A., & Bilki, Z. (2021) · ReCALL · doi:10.1017/s0958344021000021 · Cited by 50
Khabib, S. (2022) · Teaching English as a Foreign Language Journal · doi:10.12928/tefl.v1i2.249 · Cited by 39
Gozali, I., Wijaya, A. R. T., Lie, A., Cahyono, B. Y., & Suryati, N. (2024) · The JALT CALL Journal · doi:10.29140/jaltcall.v20n1.1200 · Cited by 82
Rong, M., Yao, Y., Li, Q., & Chen, X. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2539979 · Cited by 48
Using Grammarly to support students’ source-based writing practices
Dong, Y., & Shi, L. (2021) · Assessing Writing · doi:10.1016/j.asw.2021.100564 · Cited by 38
Exploring artificial intelligence using automated writing evaluation for writing skills
Abdul Rahman, N. A., Zulkornain, L. H., & Hamzah, N. H. (2022) · Environment-Behaviour Proceedings Journal · doi:10.21834/ebpj.v7isi9.4304 · Cited by 36
Long-Lasting Conceptual Change in Science Education
Li, X., Li, Y., & Wang, W. (2021) · Science & Education · doi:10.1007/s11191-021-00288-x · Cited by 48
Chen, H., & Pan, J. (2022) · Asian-Pacific Journal of Second and Foreign Language Education · doi:10.1186/s40862-022-00171-4 · Cited by 33
Long, L., & Kim, M. (2024) · Australasian Journal of Educational Technology · doi:10.14742/ajet.8821 · Cited by 55
Xue, Y. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12596-0 · Cited by 33
Exploring the dynamics of student engagement with receiving peer feedback in L2 writing
Zhang, Y., & Gao, Y. (2024) · Assessing Writing · doi:10.1016/j.asw.2024.100842 · Cited by 39
Toward a Motivation-Regulated Learner Engagement WCF Model of L2 Writing Performance
Tsao, J.-J., Tseng, W., Hsiao, T., Wang, C., & Gao, X. A. (2021) · SAGE Open · doi:10.1177/21582440211023172 · Cited by 35
Pearson, W. S. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1285954 · Cited by 54
Yeo, S., Lim, G., Gao, J., Zhang, W., & Perrault, S. T. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642530 · Cited by 43
INTEGRATING INSTAGRAM INTO EFL WRITING TO FOSTER STUDENT ENGAGEMENT
Prasetyawati, O. A., & Ardi, P. (2020) · Universitas Sanata Dharma Repository (Universitas Sanata Dharma) · Cited by 30
Exploring Learner Engagement With Multiple Sources of Feedback on L2 Writing Across Genres
Shi, Y. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.758867 · Cited by 45
Lyu, B., & Lai, C. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2030364 · Cited by 29
Zhu, X., Yao, Y., Pang, W., & Zhu, S. (2022) · Journal of Psycholinguistic Research · doi:10.1007/s10936-022-09923-2 · Cited by 32
Feedback seeking abilities of L2 writers using ChatGPT: a mixed method multiple case study
Yan, D. “. (2024) · Kybernetes · doi:10.1108/k-09-2023-1933 · Cited by 33
Potentials and implications of ChatGPT for ESL writing instruction
Ibrahim, K., & Kirkpatrick, R. (2024) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v25i3.7820 · Cited by 28
L2 Learner Cognitive Psychological Factors About Artificial Intelligence Writing Corrective Feedback
Wu, L., Wu, Y., & Zhang, X. (2021) · English Language Teaching · doi:10.5539/elt.v14n10p70 · Cited by 31
Early prediction of writing quality using keystroke logging
Conijn, R., Cook, C. L., van Zaanen, M. M., & Waes, L. V. (2021) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00268-w · Cited by 26
Wang, C., Wang, B., & Xu, D. (2025) · Learning and Motivation · doi:10.1016/j.lmot.2025.102131 · Cited by 34
Has artificial intelligence rendered language teaching obsolete?
Handley, Z. L. (2024) · Modern Language Journal · doi:10.1111/modl.12929 · Cited by 35
Cheng, X., & Zhang, L. J. (2024) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-024-00877-8 · Cited by 31
Yu, S., Yuan, K., & Wu, P. (2022) · Journal of Second Language Writing · doi:10.1016/j.jslw.2022.100961 · Cited by 24
Guo, X. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2024.2445177 · Cited by 23
ChatGPT-generated versus human direct corrective feedback on L2 writing
Muñoz Muñoz, B. C., Nassaji, H., & Bello Carrillo, F. I. (2025) · System · doi:10.1016/j.system.2025.103805 · Cited by 22
Shadiev, R., Feng, Y., Zhussupova, R. F., & Altınay, F. (2024) · Computer Assisted Language Learning · doi:10.1080/09588221.2024.2430761 · Cited by 22
Metadata
- Authors
- Koltovskaia, S.
- Affiliations
- Oklahoma State University (US)
- Corresponding author
- Koltovskaia, Svetlana
- Venue
- Assessing Writing
- Publisher
- Elsevier BV
- Published
- 2020-04
- Volume
- 44
- Pages
- 100450
- ISSN
- 1075-2935 (ISSN-L)
- OpenAlex
- W3011057862
- Cited by
- 447
- References
- 45
- Citations by year
- 2026: 133 · 2025: 105 · 2024: 96 · 2023: 61 · 2022: 31 · 2021: 18 · 2020: 3
- FWCI
- 121.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Assessing Writing (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › English Language Learning and Teaching
- Keywords
- Grammarly, student engagement, automated writing evaluation, second language writing, cognitive engagement, emotional engagement, behavioral engagement, feedback acceptance, technology dependence, draft revision
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review