Exploring EFL Students' Writing Performance and Their Acceptance of AI-based Automated Writing Feedback
Abstract
This study examined the EFL writing performance of using AI-based writing feedback called Grammarly and students’ acceptance of this new technology. Fifty-three EFL students from two convenience sample classes in China participated in this quasi-experimental design study. They were randomly assigned to the experimental and control groups. The students in the experimental group (EG) applied Grammarly to edit and revise their essays, while those in the control group (CG) received traditional instruction without Grammarly intervention. A total of five essays were implemented during the 16-week intervention period. EG students' perceptions of Grammarly via a survey were additionally collected by the researchers at the end of the intervention. Results from an independent t-test showed that students in the EG significantly outperformed those in the CG in respect of posttest writing performance. The effect size value of the Cohen's d = 0.603, indicating a medium effect. Results from a survey with open-ended questions showed that students appreciated the AI-based instant grammar correction given by Grammarly. The disadvantages of Grammarly and future teaching strategies in EFL writing classrooms are provided.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the General context, systems commonly provided suggestions for revisions which could be integrated directly into the writing area, aiding efficiency and idea exploration in the text.
“Systems commonly provided suggestions for revisions which could be integrated directly into the writing area [14,18,75], aiding efficiency and idea exploration in the text.”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [18]
Some systems present suggestions directly in the user's workspace, creating a more integrated experience but potentially blurring boundaries between user and AI contributions.
“Some systems present suggestions directly in the user's workspace [8,14,18], creating a more integrated experience but potentially blurring boundaries between user and AI contributions.”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [18]
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,588 · see citing works
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · see citing works
The Technology Acceptance Model: Its past and its future in health care
Holden, R. J., & Karsh, B.-T. (2010) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.07.002 · Cited by 2,669 · see citing works
The Technology Acceptance Model: Past, Present, and Future
Lee, Y., Kozar, K. A., & Larsen, K. R. T. (2003) · Communications of the Association for Information Systems · doi:10.17705/1cais.01250 · Cited by 2,572 · see citing works
Chung, J. E., Park, N., Wang, H., Fulk, J. L., & McLaughlin, M. L. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.06.016 · Cited by 435 · see citing works
Park, N., Rhoads, M., Hou, J., & Lee, K. M. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.048 · Cited by 206 · see citing works
Park, N., Lee, K. M., & Cheong, P. H. (2007) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2007.00391.x · Cited by 191 · see citing works
Stop! Grammar time: University students’ perceptions of the automated feedback program Grammarly
ONeill, R., & Russell, A. (2019) · Australasian Journal of Educational Technology · doi:10.14742/ajet.3795 · Cited by 180 · see citing works
The Role of Grammarly in Assessing English as a Foreign Language (EFL) Writing
Ghufron, M. A., & Rosyida, F. (2018) · Lingua Cultura · doi:10.21512/lc.v12i4.4582 · Cited by 176 · see citing works
UTILIZING GRAMMARLY IN EVALUATING ACADEMIC WRITING: A NARRATIVE RESEARCH ON EFL STUDENTS’ EXPERIENCE
Nova, M. (2018) · Premise Journal of English Education · doi:10.24127/pj.v7i1.1332 · Cited by 84 · see citing works
(2016) · Journal of academic language and learning · Cited by 75 · see citing works
Qassemzadeh, A., & Soleimani, H. (2016) · Theory and Practice in Language Studies · doi:10.17507/tpls.0609.23 · Cited by 52 · see citing works
Japos, G. V. (2013) · JPAIR Institutional Research · doi:10.7719/irj.v1i1.207 · Cited by 11 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Song, C., & Song, Y. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1260843 · Cited by 717 · see citing works
Marzuki, Widiati, U., Rusdin, D., Darwin, & Indrawati, I. (2023) · Cogent Education · doi:10.1080/2331186x.2023.2236469 · Cited by 524 · see citing works
“Here, AI writing tools can provide instantaneous feedback and suggestions for reorganizing sentences and paragraphs, thus helping students improve the structure of their writing (T. S. Chang et al., 2021).”
BackgroundImpact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study
Mahapatra, S. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00295-9 · Cited by 398 · see citing works
The Effectiveness of Automated Writing Evaluation on Writing Quality: A Meta-Analysis
Zhai, N., & Ma, X. (2022) · Journal of Educational Computing Research · doi:10.1177/07356331221127300 · Cited by 169 · see citing works
Han, Y., Qiu, Z., Cheng, J., & Lc, R. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642133 · Cited by 110 · see citing works
The effectiveness of automated writing evaluation in EFL/ESL writing: a three-level meta-analysis
Ngo, T. T.-N., Chen, H. H.-J., & Lai, K. K.-W. (2022) · Interactive Learning Environments · doi:10.1080/10494820.2022.2096642 · Cited by 108 · see citing works
A systematic review of artificial intelligence technologies used for story writing
Fang, X., Ng, D. T. K., Leung, J. K. L., & Chu, S. K. W. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11741-5 · Cited by 82 · see citing works
Santiago, C. S., Embang, S. I., Acanto, R. B., Ambojia, K. W. P., Aperocho, M. D. B., Balilo, B. B., Cahapin, E. L., Conlu, M. T. N., Lausa, S. M., Laput, E. Y., et al. (2023) · International Journal of Learning Teaching and Educational Research · doi:10.26803/ijlter.22.11.14 · Cited by 54 · see citing works
EFL Learners’ English Writing Feedback and Their Perception of Using ChatGPT
Mun, C.-Y. (2024) · STEM Journal · doi:10.16875/stem.2024.25.2.26 · Cited by 74 · see citing works
Multimodal composing with generative AI: Examining preservice teachers’ processes and perspectives
Smith, B. E., Shimizu, A. Y., Burriss, S. K., Hundley, M. K., & Pendergrass, E. (2024) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2024.102896 · Cited by 43 · see citing works
Kaliisa, R., Misiejuk, K., López‐Pernas, S., & Saqr, M. (2025) · Educational Psychology · doi:10.1080/01443410.2025.2553639 · Cited by 50 · see citing works
Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
Reza, M., Thomas-Mitchell, J., Dushniku, P., Laundry, N., Williams, J. J., & Kuzminykh, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757566 · Cited by 37 · see citing works
Zhou, C., & Wang, Y. (2026) · European Journal of Education · doi:10.1111/ejed.70478 · Cited by 29 · see citing works
Artificial Intelligence in Education
Delello, J. A., Bailey, J., & Garcia-Lopez, A. (2024) · Advances in business information systems and analytics book series · doi:10.4018/979-8-3693-3003-6.ch001 · Cited by 21 · see citing works
Bui, T. T. U., & Tong, T. V. A. (2025) · AsiaCALL Online Journal · doi:10.54855/acoj.251615 · Cited by 30 · see citing works
Shofiah, N., & Putera, Z. F. (2024) · Research Square · doi:10.21203/rs.3.rs-3871916/v1 · Cited by 26 · see citing works
TALAYHAN, Ö. G. (2023) · JOURNAL OF CURRENT DEBATES IN SOCIAL SCIENCES · doi:10.29228/cudes.71701 · Cited by 30 · see citing works
Yu-peng, L., & Yu, Z. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03861-1 · Cited by 23 · see citing works
Tajik, A. (2025) · Research Square · doi:10.21203/rs.3.rs-5788599/v1 · Cited by 26 · see citing works
Alghasab, M. B. (2025) · Cogent Education · doi:10.1080/2331186x.2025.2505304 · Cited by 17 · see citing works
Student and Faculty Perceptions of Generative Artificial Intelligence in Student Writing
Hostetter, A. B., Call, N., Frazier, G., James, T., Linnertz, C., Nestle, E., & Tucci, M. (2024) · Teaching of Psychology · doi:10.1177/00986283241279401 · Cited by 15 · see citing works
Evaluating the Impact of AI Tools on Grammar Mastery: A Comparative Study of Learning Outcomes
Lalira, J. E., Pangemanan, Y. A. T., Scipio, J. E., Lumi, S. M., Merentek, T. C., & Tumuju, V. N. (2024) · Voices of English Language Education Society · doi:10.29408/veles.v8i3.27856 · Cited by 24 · see citing works
Pham, N. N. H. (2025) · International journal of AI in language education. · doi:10.54855/ijaile.25213 · Cited by 24 · see citing works
Grammar and engagement in focus: Evaluating Gemini AI’s impact on an educational environment
Ng, M. L., Behforouz, B., & Ghaithi, A. A. (2025) · Computers and Education Open · doi:10.1016/j.caeo.2025.100302 · Cited by 16 · see citing works
Overviewing the Maze of Research Integrity and False Positives Within AI-Enabled Detectors
Abubakari, M. S. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-0884-4.ch013 · Cited by 12 · see citing works
Liang, H., & Mao, X. (2025) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2025.103434 · Cited by 12 · see citing works
Wu, Q., & Xu, A. (2025) · British Educational Research Journal · doi:10.1002/berj.4119 · Cited by 17 · see citing works
RetractedStudent and Faculty Perceptions of Artificial Intelligence in Student WritingPreprint
Hostetter, A. B., Call, N., Frazier, G., James, T., Linnertz, C., Nestle, E., & Tucci, M. (2023) · doi:10.31234/osf.io/7dnk9 · Cited by 10 · see citing works
Utilization of Artificial Intelligence in Academic Writing Class: L2 Learners Perspective
Junio, D. A., & Bandala, A. A. (2023) · IEEE International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (HNICEM) · doi:10.1109/hnicem60674.2023.10589003 · Cited by 10 · see citing works
Ding, J., & Song, Y. (2025) · Educational Psychology · doi:10.1080/01443410.2025.2568189 · Cited by 13 · see citing works
CoCo Matrix: Taxonomy of Cognitive Contributions in Co-writing with Intelligent Agents
Wan, R., Gebreegziabher, S. A., Li, T. J.-J., & Badillo-Urquiola, K. (2024) · Creativity and Cognition · doi:10.1145/3635636.3664260 · Cited by 9 · see citing works
Assessing Human Evaluations of Cover Letters Written or Edited by AI and Non-Native English Speakers
Tian, X., Hahn, H. M., Carangui, M. K. L., Si, Y., Chen, J., Li, X., & Fussell, S. R. (2024) · International ACM SIGGROUP Conference on Supporting Group Work (GROUP) · doi:10.1145/3688828.3699644 · Cited by 8 · see citing works
Heydarnejad, T. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100494 · Cited by 16 · see citing works
Teaching Chatbot Prompt Strategies in EFL Essay Writing Instruction
Huang, H.-W., Teng, D. C.-E., & Wu, R. (2023) · International Workshop on Artificial Intelligence and Education (WAIE) · doi:10.1109/waie60568.2023.00010 · Cited by 6 · see citing works
Self-citationKhojasteh, L., Karimian, Z., Nasiri, E., Kafipour, R., & Farahmandi, A. Y. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08288-z · Cited by 7 · see citing works
Exploring Higher Education EFL Students’ Perception of AI Writing Tools in the 5.0 Era
Safitri, M., & Fithriani, R. (2024) · Cetta: Jurnal Ilmu Pendidikan · doi:10.37329/cetta.v7i1.3158 · Cited by 18 · see citing works
Alas, D. K., & Pehlivan, A. (2025) · International Online Journal of Primary Education · doi:10.55020/iojpe.1707387 · Cited by 4 · see citing works
Al-shaboul, I. A., Rousan, R. M. A., Kalsoom, T., & Al-Awawdeh, N. (2024) · Research Journal in Advanced Humanities · doi:10.58256/pjf6en83 · Cited by 8 · see citing works
Hoàng, N. H. (2025) · The JALT CALL Journal · doi:10.29140/jaltcall.v21n2.102429 · Cited by 9 · see citing works
Elia, J. (2024) · Studies in big data · doi:10.1007/978-3-031-71213-5_11 · Cited by 4 · see citing works
Haddadian, G., Kim, M. K., & Haddadian, N. (2025) · Research Synthesis in Applied Linguistics · doi:10.1080/29984475.2025.2598266 · Cited by 3 · see citing works
Ai-RACE as a Framework for Writing Assignment Design in Higher Education
El-Soussi, A., & Yousef, D. (2026) · Education Sciences · doi:10.3390/educsci16010119 · Cited by 4 · see citing works
Abobaker, R., & Moleta, S. (2024) · Advances in educational marketing, administration, and leadership book series · doi:10.4018/979-8-3693-5443-8.ch004 · Cited by 3 · see citing works
Campoverde-Quezada, D. A., & Valdiviezo-Ramírez, E. A. (2024) · Revista Metropolitana de Ciencias Aplicadas · doi:10.62452/y9pfb437 · Cited by 3 · see citing works
Yang, C., Shao, J., & Guo, Y. (2025) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2025.2609877 · Cited by 3 · see citing works
Scherer, S., Graham, S., & Busse, V. (2026) · Assessing Writing · doi:10.1016/j.asw.2026.101034 · Cited by 2 · see citing works
Ekşi, S., FURTUN, S., & FURTUN, M. H. K. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1860972 · Cited by 4 · see citing works
Exploring undergraduate students' usage and perceptions of AI writing tools
Bensalem, E., Harizi, R., & Boujlida, A. (2024) · Global Journal of Foreign Language Teaching · doi:10.18844/gjflt.v14i2.9344 · Cited by 15 · see citing works
EXPLORING THE POWER OF GENERATIVE AI: ENHANCING BUSINESS EMAIL WRITING SKILLS FOR L2 LEARNERS
Shafie, L. A., Aidura, A., & Najmi, N. A. N. (2024) · International Journal of Entrepreneurship and Management Practices · doi:10.35631/ijemp.725017 · Cited by 1 · see citing works
Luo, L., Jun, L., & Xing, Q. (2024) · International Conference on Educational Technology (ICET) · doi:10.1109/icet62460.2024.10868044 · Cited by 1 · see citing works
From Prompts to Context: An Ontology-Driven Framework for Human-Generative AI Collaboration
Lê, N. L., Abel, M., & Laforge, B. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10754-y · Cited by 2 · see citing works
Writing Feedback from a Research Perspective
Raitskaya, L., & Тихонова, Е. В. (2022) · Journal of language and Education · doi:10.17323/jle.2022.16377 · Cited by 1 · see citing works
Nazim, M. (2024) · International Journal of English Linguistics · doi:10.5539/ijel.v14n3p93 · Cited by 7 · see citing works
An Exploratory Research on Effects of AI Chabots on Syntactic Complexity of L2 Writing
Xiao, Q., & Liu, N. (2024) · International Conference on Educational Technology Management (ICETM) · doi:10.1145/3711403.3711447 · Cited by 2 · see citing works
Tajik, A. (2025) · Research Square · doi:10.21203/rs.3.rs-6848571/v1 · Cited by 2 · see citing works
Rahimi, Z., Nazari, S., & Fakharzadeh, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4893104
Revolutionizing Education: Supporting Digital Transformation with ChatGPT
Baytiyeh, H. (2024) · Springer eBooks · doi:10.1007/978-3-031-70779-7_5
Defining the Indicator System for AWE for Portuguese Classes in Chinese Higher Education
Jiang, L., Sun, Y., & Hoi, L. M. (2024) · International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC) · doi:10.1109/cyberc62439.2024.00043
An Empirical Research on AI Chatbot-assisted Continuation Writing Task
Xiao, Q., & Liu, N. (2024) · International Conference on Educational Technology Management (ICETM) · doi:10.1145/3711403.3711426
Estrella, F. (2025) · Journal of Applied Research in Higher Education · doi:10.1108/jarhe-10-2024-0529 · Cited by 2 · see citing works
Farneste, M., & Bicjutko, T. (2025) · Baltic Journal of English Language Literature and Culture · doi:10.22364/bjellc.15.2025.03 · Cited by 1 · see citing works
Roles of AI in Supporting Ongoing EFL/ESL Teacher Development
Bergil, A. S. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-0969-9.ch009
Exploring Ai-Powered Pedagogy in Enhancing Academic Writing Skills
Junio, D. A., & Bandala, A. A. (2024) · IEEE International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (HNICEM) · doi:10.1109/hnicem64917.2024.11258765
Smart Learning in English Studies
Ajraoui, T. E. (2026) · IGI Global eBooks · doi:10.4018/979-8-3693-8352-0.ch004
Huang, X. (2025) · International Workshop on Artificial Intelligence and Education (WAIE) · doi:10.1109/waie67422.2025.11381276
Practical Applications of GenAI in TESOL
Savvidou, C. (2026) · Springer eBooks · doi:10.1007/978-3-032-14502-4_4
Han, Y. (2026) · Journal of China Computer-Assisted Language Learning · doi:10.1515/jccall-2025-0020
iRULER: Intelligible Rubric-Based User-Defined LLM Evaluation for Revision
Bai, J., Cheong, W. S., Müller, P., & Lim, B. Y. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790539 · Cited by 1 · see citing works
Klyshbekova, M., & Forsberg, A. (2026) · Cogent Education · doi:10.1080/2331186x.2026.2650254
Xiao, Q.-M., & Liu, N.-H. (2025) · International Conference on Education and E-Learning (ICEEL) · doi:10.1145/3789859.3789895
Exploring AI-assisted Homework Completion from the Perspective of English Teachers
Xiao, Q.-M., & Liu, N.-H. (2025) · International Conference on Education and E-Learning (ICEEL) · doi:10.1145/3789859.3789894
Generative AI for Academic Writing among Indonesian History Education Lecturers
Kurniawan, P. W., Maximilian, A., Zulianti, H., & Hidayat, N. (2026) · Proceeding International Conference on Digital Education and Social Science · doi:10.55506/icdess.v3i1.176
Carial, G. M., & Amada, A. T. (2026) · Psychology and Education A Multidisciplinary Journal · doi:10.70838/pemj.600708
- Authors
- Chang, T.-S., Li, Y., Huang, H.-W., & Whitfield, B.
- Affiliations
- Independent researcher, China
- Fujian University of Technology (CN)
- University of Idaho (US)
- Venue
- 2021 2nd International Conference on Education Development and Studies
- Publisher
- ACM
- Published
- 2021-03-09
- Pages
- 31-35
- OpenAlex
- W3195589482
- Cited by
- 74
- References
- 13
- Citations by year
- 2026: 12 · 2025: 24 · 2024: 27 · 2023: 8 · 2022: 3
- FWCI
- 85.79
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Education Development and Studies (ICEDS) (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Physical Sciences › Computer Science › Information Systems › English Language Learning and Teaching
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Keywords
- EFL writing, automated writing feedback, Grammarly, student acceptance of technology, writing performance, essay revision, immediate feedback, EFL writing instruction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review