Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students
Open accessThe DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index; 20 of the 47 sources its claims cite were checked for support.
Abstract
A mixed-methods study of 50 Chinese EFL students randomly assigned to AI-assisted ChatGPT versus traditional instruction, reporting significant improvements in writing skills and motivation.
Overview
CoChat Summary
TL;DR
This mixed-methods study found that 12 weeks of ChatGPT-assisted writing instruction improved Chinese EFL students’ academic writing skills and writing motivation more than traditional instruction. Qualitative interviews with experimental-group students were largely positive but raised concerns about contextual accuracy, over-reliance, and long-term sustainability.
Key findings
- The experimental group outperformed the control group on global writing post-test after controlling for pre-test scores: M = 59.12 vs. 45.18; ANCOVA F(1, 47) = 19.01, p = 0.00, partial eta squared = 0.27; t-test t(48) = 3.79, p < 0.001, Cohen’s d = 0.76.
- Specific writing dimensions favored the experimental group: content F(1, 47) = 12.61, p = 0.00, partial eta squared = 0.19; organization F(1, 47) = 23.16, p = 0.00, partial eta squared = 0.34; language use F(1, 47) = 9.86, p = 0.01, partial eta squared = 0.11.
- Writing motivation was significantly higher in the experimental group: M = 20.06 vs. 18.21; ANCOVA F(1, 47) = 29.62, p = 0.00, partial eta squared = 0.38; t-test t(48) = 3.34, p = 0.001, Cohen’s d = 0.52.
- Qualitative themes included positive perceptions of innovation and assistance, writing skill enhancements, motivation and engagement gains, recognized advantages such as accessibility and personalized feedback, acknowledged challenges including contextual accuracy and over-reliance, and concerns about long-term impact and sustainability.
Methods
- Mixed-methods design with 50 Chinese EFL undergraduates at a national university, matched for proficiency and randomly assigned to experimental (ChatGPT-assisted instruction) or control (traditional teacher-led instruction) groups; intervention lasted 12 weeks, with AI sessions twice weekly for approximately 60 minutes.
- Pre-test and post-test IELTS academic writing tasks 1 and 2 were scored with IELTS band descriptors by two raters (inter-rater reliability r = 0.88); writing motivation was measured with a 7-item Writing Motivation Scale on a 5-point Likert scale (Cronbach’s α = 0.86); semi-structured interviews were conducted with 9 experimental-group students for about 30 minutes each and analyzed thematically.
- Quantitative analysis used one-way ANCOVA controlling for pre-test scores, independent samples t-tests, and effect sizes.
Limitations
- Stated by the paper: generalizability is constrained by the specific sample of Chinese EFL students; the sample size of 50 is relatively small; the intervention duration was relatively short; possible contamination between experimental and control groups; no long-term follow-up to assess sustainability; and potential unintended plagiarism or over-reliance on AI-generated content despite ethical guidance.
- Evident from the text: writing motivation was measured only by self-report questionnaire, and qualitative interviews were conducted only with experimental-group students, so control-group perceptions and experiences were not captured.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
14 Valid · 3 Not valid · 17 Not checked · 81 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Importantly, feedback is recognized as a critical component in enhancing writing performance and motivation in the context of language learning (Bakla, 2020; Liu et al., 2022; Zhang and Zou, 2023).”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Literature review > Theoretical framework
What the sources say
- Supportedcites Bakla, 2020 matched to “A mixed-methods study of feedback modes in EFL writing” (2020) source
The Introduction describes feedback as an essential part of second-language writing instruction and explains how it can facilitate learning. The Results from the Essay-Revision Task report successful revisions following feedback, while the Discussion says digital feedback motivated students to work on their writing. These passages support the broad claim, though they do not establish that one feedback mode improves performance more than another. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites Liu et al., 2022 matched to “Flipping writing metacognitive strategies and writing skills in an English as a foreign language collaborative writing context: a mixed-methods study” (2022) source
- Not checked — no full text of the sourcecites Zhang and Zou, 2023 matched to “A review of research on technology-enhanced peer feedback for second language writing based on the activity theory framework” (2023) source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This heightened engagement, facilitated by the AI tool’s responsiveness, contributes to the observed improvements in writing skills and motivation (Liu et al., 2021; Utami and Winarni, 2023).”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Literature review > Theoretical framework
What the sources say
- Not checked — no full text of the sourcecites Liu et al., 2021 matched to “Incorporating a reflective thinking promoting mechanism into artificial intelligence-supported English writing environments” (2023) source
- Partly supportedcites Utami and Winarni, 2023 matched to “Utilization of artificial intelligence technology in an academic writing class: How do Indonesian students perceive?” (2023) sourceExperimental — accuracy not yet measured
The Discussion reports that students perceived improved motivation, and the writing-skills findings report perceived benefits, with observed writing-quality improvement limited to creativity of ideas (section labeled “3.74”; page unavailable). The paper does not establish that the tool’s responsiveness heightened engagement or that such engagement caused improvements in skills and motivation. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The identified contextual accuracy concerns resonate with previous studies highlighting the need for careful consideration when incorporating AI-generated feedback (Utami and Winarni, 2023).”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Discussion
What the sources say
- Partly supportedcites Utami and Winarni, 2023 matched to “Utilization of artificial intelligence technology in an academic writing class: How do Indonesian students perceive?” (2023) sourceExperimental — accuracy not yet measured
In “Students’ perception of usefulness of artificial intelligence technology utilization” (page unavailable), a participant says users must decide whether to accept AI-offered sentences and rearrange drafts so they remain logical. This supports careful consideration of AI writing suggestions, but the paper does not identify contextual accuracy problems in AI-generated feedback specifically; it says participants did not use the tools for revising and editing. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The intervention’s effectiveness in enhancing organization and coherence within their essays demonstrates the potential of AI-assisted tools in scaffolding the writing process (Zhao, 2022; Barrot, 2023).”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Discussion
What the sources say
- Partly supportedcites Zhao, 2022 matched to “Leveraging artificial intelligence (AI) technology for English writing: introducing Wordtune as a digital writing assistant for EFL writers” (2023) sourceExperimental — accuracy not yet measured
The Introduction (p. 2) says Wordtune supports EFL writers during the writing process, and the Conclusion and Limitations (p. 6) says it can help improve writing quality. But this tech review does not report an intervention or demonstrate improvements in essay organization and coherence. (LLM, conf=0.87)
- Not checked — no full text of the sourcecites Barrot, 2023 matched to “Using ChatGPT for second language writing: pitfalls and potentials” (2023) source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Significant differences were observed in writing motivation between the two groups, as presented in Table 7 [F(1, 47) = 29.62, p = 0.00, partial eta squared = 0.38].”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
44 more claims
Create a free account to see all 115 claims and every source verdict.
- It may state two separate claims as one. 26
- Probably not a substantial claim. 42
- Borderline: one of the tests for a substantial claim is unclear. 2
- Not yet classified. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These findings align with studies from other EFL settings [31] where instructors appreciate AI's ability to streamline lesson planning and increase productivity.”
From Teachers' Use of Generative AI in Jordanian Universities: Practices and Perceptions (2025) · cites this paper as [31]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior research suggests that technology-assisted learning environments can enhance learners' confidence when tools are perceived as facilitators of understanding rather than substitutes for thinking (Heo et al., 2021; Ma and Lee, 2021; Song and Song, 2023).”
From Cognitive offloading through digital tools and its relationship with critical thinking, task persistence, and learning depth (2026) · cites this paper as Song and Song, 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Students were found to engage actively with AI-generated suggestions, selectively modifying or rejecting content, which indicated maintained agency and thoughtful decision making.”
From AI-Integrated Scaffolding to Enhance Agency and Creativity in K-12 English Language Learners: A Systematic Review (2025) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Students gained confidence in using ChatGPT for IELTS tasks.Evidence of growing ownership and self-direction, though creativity limited by the assessment format.”
From AI-Integrated Scaffolding to Enhance Agency and Creativity in K-12 English Language Learners: A Systematic Review (2025) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Students gained confidence in using ChatGPT for IELTS tasks.Evidence of growing ownership and self-direction, though creativity limited by the assessment format.”
From AI-Integrated Scaffolding to Enhance Agency and Creativity in K-12 English Language Learners: A Systematic Review (2025) · cites this paper as [7]
Experimental — accuracy not yet measured
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Statistics that don’t add up
Each reported p-value recomputed from its test statistic and degrees of freedom, each partial η² from its F, and each ratio, mean difference or B printed with a p checked against its own confidence interval.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“t(48) = 3.34, p = 0.001”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
Reported p = .001 · recomputed p = .002
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“t(48) = 3.01, p = 0.003”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
Reported p = .003 · recomputed p = .004
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“F(1, 47) = 23.16, p = 0.00, partial eta squared = 0.34”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
Reported ηp² = .34 · recomputed ηp² = .3301
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“F(1, 47) = 9.86, p = 0.01, partial eta squared = 0.11”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
Reported ηp² = .11 · recomputed ηp² = .1734
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“F(1, 47) = 12.61, p = 0.00, partial eta squared = 0.19”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
Reported ηp² = .19 · recomputed ηp² .2115–.2116
2 more findings
Create a free account to see every finding of this check.
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Doesn’t add upt(48) = 3.01reported p = .003 · recomputed p = .004
“t(48) = 3.01, p = .003”
- Doesn’t add upt(48) = 3.34reported p = .001 · recomputed p = .002
“t(48) = 3.34, p = .001”
- Consistentt(48) = 3.79reported p < .001 · recomputed p < .001
“t(48) = 3.79, p < .001”
- Consistentt(48) = 4.12reported p < .001 · recomputed p < .001
“t(48) = 4.12, p < .001”
- Consistentt(48) = 4.34reported p < .001 · recomputed p < .001
“t(48) = 4.34, p < .001”
5 more recomputed tests
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
“Furthermore, the ANCOVA results for the two groups’ language use are depicted in Table 6.”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
“Table 5 reveals significant distinctions between the two groups in terms of language use [F(1, 47) = 9.86, p = 0.01, partial eta squared = 0.11].”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
“Also, the ANCOVA results for the two groups’ writing organization are displayed in Table 4.”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
“Significant disparities between the two groups in terms of writing organization were observed, as indicated by the results presented in Table 5”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Method > Procedure
“Table 1 indicates the summary of the intervention details for both groups.”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
“Table 1 presents descriptive statistics for the pre-and post-test scores in both the experimental and control groups.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Method > Instruments
“Semi-structured interviews (see Appendix C) were conducted with nine EFL students from the experimental classroom group”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Qualitative results
“Likewise, thinking about the long-lasting effects, participant S14 said”
Citations
Cites
(1998) · Cited by 13,501
Becoming a Self-Regulated Learner: An Overview
Zimmerman, B. J. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4102_2 · Cited by 10,197 · cited 1×
“The AI tool acts as a facilitator, guiding learners to internalize effective writing strategies and enabling them to complete tasks independently (Zimmerman, 2002).”
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242
(2016) · Open Research Online (The Open University) · Cited by 1,410
Evolution and Revolution in Artificial Intelligence in Education
Roll, I., & Wylie, R. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0110-3 · Cited by 1,229 · cited 1×
“…of technology in English language classrooms is widely recognized as a means to overcome certain obstacles in language learning processes (Roll and Wylie, 2016; Knox, 2020), particularly in writing tasks where time constraints often arise (Stapleton and Radia, 2010; Kessler, 2020; Rahimi…”
Fredricks, J. A., Filsecker, M., & Lawson, M. A. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.02.002 · Cited by 851 · cited 1×
“Engagement, as a crucial aspect of the learning process, is influenced by the dynamic interaction between learners and their learning environment (Fredricks et al., 2016).”
Can artificial intelligence help for scientific writing?
Salvagno, M., Taccone, F. S., & Gerli, A. G. (2023) · Critical Care · doi:10.1186/s13054-023-04380-2 · Cited by 827 · cited 1×
“Additionally, learners can expedite their writing development as AI tools help them identify and rectify grammatical and lexical errors, while also suggesting alternative sentence structures to enhance the overall writing quality and structure (Zhao, 2022; Chen, 2023; Salvagno et al., 2023).”
Using ChatGPT for second language writing: pitfalls and potentials
Barrot, J. S. (2023) · Assessing Writing · doi:10.1016/j.asw.2023.100745 · Cited by 770 · cited 4×
“This is consistent with studies by Barrot (2023) and Zhao (2022), which emphasize how immediate feedback can significantly contribute to enhanced writing proficiency.”
InfluentialImpact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation
Yan, D. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11742-4 · Cited by 713 · cited 8×
“This includes the use of advanced artificial intelligence (AI)-based computer and mobile programs, which offer interactive and personalized tools for honing writing abilities as well as enhanced motivation (Jiang, 2022; Meunier et al., 2022; Yan, 2023).”
InfluentialHuang, A. Y. Q., Lu, O. H. T., & Yang, S. J. H. (2023) · Computers & Education · doi:10.1016/j.compedu.2022.104684 · Cited by 605
Research works printed but not linked: 3
- Pallant J. (2013). SPSS survival manual. New York, NY: McGrow-Hill.
- University of Cambridge ESOL Examinations. (2011). Score processing, reporting and interpretation. Available at: www.ielts.org/researchers/score_processing_and_reporting.aspx (accessed November 11, 2011).
- Vygotsky L. S. (1984). The problem of age. Pedagogical
Cited by
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13544 · Cited by 805
Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025) · Computers & Education · doi:10.1016/j.compedu.2024.105224 · Cited by 531
Using AI-driven chatbots to foster Chinese EFL students’ academic engagement: An intervention study
Wang, Y., & Xue, L. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108353 · Cited by 328
Wang, J., & Fan, W. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04787-y · Cited by 322
“The meta-analysis results show that ChatGPT effectively enhances student learning performance across different types of courses, as has been shown by prior studies (Ba et al. 2024; Li, 2023; Song and Song, 2023).”
RetractedHalkiopoulos, C., & Gkintoni, E. (2024) · Electronics · doi:10.3390/electronics13183762 · Cited by 328
“Interactivity and personalized feedback have thus become crucial variables for effective language learning [191].”
Wang, H., Dang, A., Wu, Z., & Mac, S. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100326 · Cited by 272
“In addition, some students experienced a lack of critical thinking and a decline in learning motivation due to overreliance on these tools (Escalante et al., 2023; Harunasari, 2022; Mahapatra, 2024; Song and Song, 2023).”
BackgroundKarataş, F., Abedi, F. Y., Ozek Gunyel, F., Karadeniz, D., & Kuzgun, Y. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12574-6 · Cited by 252
Dahri, N. A., Yahaya, N., Al-Rahmi, W. M., Aldraiweesh, A., Alturki, U., Almutairy, S., Shutaleva, A., & Soomro, R. B. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e29317 · Cited by 239
“…use of AI tools in pre-service teacher education can be advantageous for pursuing a career in teaching, especially, ChatGPT is a generative AI tool created by OpenAI that has attracted a lot of attention due to its ability to give students real-time feedback, explanations, and advice [1,24,27,40].”
BackgroundWang, C., Zou, B., Du, Y., & Wang, Z. (2024) · System · doi:10.1016/j.system.2024.103533 · Cited by 194
Mohebbi, A. (2025) · Cogent Education · doi:10.1080/2331186x.2024.2433814 · Cited by 161
“Studies like Yuan et al. (2024) and Song and Song (2023) warned that learners might become too dependent on AI-generated content, reducing their engagement in critical thinking, creativity, and independent problem-solving.”
Wang, X., Gao, Y., Wang, Q., & Zhang, P. (2024) · European Journal of Education · doi:10.1111/ejed.12874 · Cited by 181
Lo, C. K., Yu, P. L. H., Xu, S., Ng, D. T. K., & Jong, M. S.-Y. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00342-5 · Cited by 138
Boudouaia, A., Mouas, S., & Kouider, B. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331241247465 · Cited by 127
Almulla, M. A. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e32220 · Cited by 118
Shi, H., Chai, C. S., Zhou, S., & Aubrey, S. (2026) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2454541 · Cited by 109
“Quite a few studies have started examining the effect of AWE and ChatGPT on motivation and found positive impacts (Huang & Mizumoto, 2024; Song & Song, 2023; Wilson & Czik, 2016).”
InfluentialDai, K., & Liu, Q. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108354 · Cited by 109
The impact of ChatGPT feedback on the development of EFL students’ writing skills
Polakova, P., & Ivenz, P. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2410101 · Cited by 104
Li, J., Zong, H., Wu, E., Wu, R., Peng, Z., Zhao, J., Yang, L., Xie, H., & Shen, B. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05738-y · Cited by 104
“Students received AI-assisted instruction exhibited improved proficiency in multiple aspects of writing, organization, coherence, grammar, and vocabulary [15].”
Wang, Q., Gao, Y., & Wang, X. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2400403 · Cited by 129
Qu, K., & Wu, X. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12598-y · Cited by 99
Guo, K., & Li, D. (2024) · System · doi:10.1016/j.system.2024.103362 · Cited by 149
Modeling AI-assisted writing: How self-regulated learning influences writing outcomes
Jin, F., Lin, C.-H., & Lai, C. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108538 · Cited by 93
Chen, C., & Gong, Y. (. (2025) · Education Sciences · doi:10.3390/educsci15020141 · Cited by 90
Liu, X., Guo, B., He, W., & Hu, X. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251329185 · Cited by 89
Wang, Y., & Guo, Y. (2026) · Journal of Computer Assisted Learning · doi:10.1002/jcal.70189 · Cited by 122
Liu, G., Zou, M., Soyoof, A., & Chiu, M. M. (2024) · European Journal of Education · doi:10.1111/ejed.12846 · Cited by 123
(2024) · International Journal of TESOL Studies · doi:10.58304/ijts.20240304 · Cited by 87
Li, B., Tan, Y. L., Wang, C., & Lowell, V. L. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100445 · Cited by 289
The role of generative AI and hybrid feedback in improving L2 writing skills: a comparative study
Zhang, Z., Aubrey, S., Huang, X., & Chiu, T. K. F. (2025) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2025.2503890 · Cited by 83
Zhang, X., Zhang, P., Shen, Y., Liu, M., Wang, Q., Gašević, D., & Fan, Y. (2024) · Frontiers of Digital Education · doi:10.1007/s44366-024-0028-5 · Cited by 83
Mekheimer, M. (2025) · Discover Education · doi:10.1007/s44217-025-00602-7 · Cited by 88
Shaping integrity: why generative artificial intelligence does not have to undermine education
Tan, M. J. T., & Maravilla, N. M. A. T. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1471224 · Cited by 78
“By analyzing a student’s writing style and providing real-time feedback on grammar, tone, and narrative structure, the AI helps students refine their skills (Song & Song, 2023).”
BackgroundWang, Y. (2024) · System · doi:10.1016/j.system.2024.103505 · Cited by 79
Wu, X.-Y. (2024) · System · doi:10.1016/j.system.2024.103498 · Cited by 148
Zhu, Y., Liu, Q., & Zhao, L. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13420-z · Cited by 141
Kruk, M., & Kałużna, A. (2024) · European Journal of Education · doi:10.1111/ejed.12859 · Cited by 127
Students’ appraisals post-ChatGPT use: Students’ narrative after using ChatGPT for writing
Nugroho, A., Andriyanti, E., Widodo, P., & Mutiaraningrum, I. (2025) · Innovations in Education and Teaching International · doi:10.1080/14703297.2024.2319184 · Cited by 69
ChatGPT as a tool for self-learning English among EFL learners: A multi-methods study
Tram, N. H. M., Nguyen, T. T., & Tran, C. D. (2024) · System · doi:10.1016/j.system.2024.103528 · Cited by 130
Annamalai, N., Bervell, B., Mireku, D. O., & Andoh, R. P. K. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100346 · Cited by 144
Balancing AI and authenticity: EFL students' experiences with ChatGPT in academic writing
Werdiningsih, I., Marzuki, & Rusdin, D. (2024) · Cogent Arts & Humanities · doi:10.1080/23311983.2024.2392388 · Cited by 65
“…also underscores the confidence-boosting aspect of ai tools, allowing students to feel more secure in their writing abilities (marzuki et al., 2023; song & song, 2023). ultimately, this method demonstrates how ai can be effectively integrated as a supportive tool to enhance the quality and…”
Yeung, S. (2025) · Journal of Second Language Writing · doi:10.1016/j.jslw.2025.101203 · Cited by 70
Rezai, A., Soyoof, A., & Reynolds, B. L. (2024) · European Journal of Education · doi:10.1111/ejed.12752 · Cited by 96
Biju, N., Abdelrasheed, N. S. G., Bakiyeva, K., Prasad, K. D. V., & Jember, B. (2024) · Language Testing in Asia · doi:10.1186/s40468-024-00322-z · Cited by 119
Chatbots in education: Hype or help? A meta-analysis
Laun, M., & Wolff, F. (2025) · Learning and Individual Differences · doi:10.1016/j.lindif.2025.102646 · Cited by 107
Li, H., Wang, Y., Luo, S., & Huang, C. (2025) · Journal of Asian Public Policy · doi:10.1080/17516234.2024.2363128 · Cited by 60
Xu, Y., Zhu, J., Wang, M., Qian, F., Yang, Y., & Zhang, J. (2024) · Applied Sciences · doi:10.3390/app14156418 · Cited by 60
Effects of adaptive feedback generated by a large language model: A case study in teacher education
Kinder, A., Briese, F. J., Jacobs, M., Dern, N., Glodny, N., Jacobs, S., & Leßmann, S. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100349 · Cited by 133
Ma, W., Wen-jing, M., Hu, Y., & Xinyu, B. I. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13128-6 · Cited by 93
Li, J., Huang, J., Wu, W., & Whipple, P. B. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03755-2 · Cited by 132
Jin, F., Sun, L., Pan, Y., & Lin, C.-H. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105248 · Cited by 54
Incorporating ChatGPT for EFL Writing and Its Effects on Writing Engagement
Teng, M. F., & Huang, J. (2025) · International Journal of Computer-Assisted Language Learning and Teaching · doi:10.4018/ijcallt.367874 · Cited by 53
“Similarly, Athanassopoulos et al. (2023) and Song and Song (2023) observed gains in vocabulary, grammar, and overall language proficiency among L2 and EFL learners.”
Liu, J., Sihes, A. J. B., & Lu, Y. (2025) · Smart Learning Environments · doi:10.1186/s40561-025-00406-0 · Cited by 52
Ahn, S. (2024) · The Korean Journal of Physiology & Pharmacology · doi:10.4196/kjpp.2024.28.5.393 · Cited by 51
“These tools have also been used to facilitate language learning and improve technical writing skills for non-native English speakers, which is particularly meaningful for scholars using English as a non-primary language [33].”
BackgroundSun, F., Mendoza, L., Wang, J., & Li, H. (2025) · Behavioral Sciences · doi:10.3390/bs15070983 · Cited by 63
Nguyen, L., & Barrot, J. S. (2024) · Assessing Writing · doi:10.1016/j.asw.2024.100899 · Cited by 72
Zhai, X., Zhao, R., Jiang, Y., & Wu, H. (2024) · Behavioral Sciences · doi:10.3390/bs14090838 · Cited by 50
Wang, C., Li, X., & Zou, B. (2025) · European Journal of Education · doi:10.1111/ejed.70054 · Cited by 63
Khoso, A. K., Hong-gang, W., & Darazi, M. A. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100627 · Cited by 104
The use of AI tools in English academic writing by Saudi undergraduates
Ozfidan, B., El-Dakhs, D. A. S., & Alsalim, L. A. (2024) · Contemporary Educational Technology · doi:10.30935/cedtech/15013 · Cited by 45
Xia, Q., Li, W., Yang, Y., Weng, X., & Chiu, T. K. F. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100455 · Cited by 45
The Impact of ChatGPT on Students' Academic Achievement: A Meta‐Analysis
Liu, Z., Zuo, H., & Lu, Y. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70096 · Cited by 44
Writing with AI: What College Students Learned from Utilizing ChatGPT for a Writing Assignment
Wang, C., Aguilar, S. J., Bankard, J. S., Bui, E., & Nye, B. (2024) · Education Sciences · doi:10.3390/educsci14090976 · Cited by 49
“Regarding the weaknesses, students in [22] also pointed out in interviews that ChatGPT was limited in contextual accuracy and personal writing style, which are like “lacking personal voice” in our findings.”
Kristiawan, D. Y., Bashar, K., & Pradana, D. A. (2024) · The Art of Teaching English as a Foreign Language · doi:10.36663/tatefl.v5i2.912 · Cited by 115
Xiao, F., Zhu, S., & (辛闻), W. X. (2025) · ECNU Review of Education · doi:10.1177/20965311241310881 · Cited by 118
ChatGPT in Education: An Effect in Search of a Cause
Weidlich, J., Gašević, D., Drachsler, H., & Kirschner, P. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70105 · Cited by 52
EFL Learners’ English Writing Feedback and Their Perception of Using ChatGPT
Mun, C.-Y. (2024) · STEM Journal · doi:10.16875/stem.2024.25.2.26 · Cited by 101
Li, M., & Wilson, J. (2025) · Information · doi:10.3390/info16070519 · Cited by 49
Giray, L., Sevnarayan, K., & Ranjbaran, F. (2025) · Internet Reference Services Quarterly · doi:10.1080/10875301.2024.2437174 · Cited by 78
Chen, S., & Cheung, A. C. K. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100737 · Cited by 78
Sun, F., Wang, J., Mendoza, L., & Li, H. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.106237 · Cited by 47
Hwang, H., Chang, X., & Sun, J. (2025) · Journal of Second Language Writing · doi:10.1016/j.jslw.2025.101230 · Cited by 86
Exploring Learner Prompting Behavior and Its Effect on ChatGPT-Assisted English Writing Revision
Hwang, M., Jeens, R., & Lee, H.-K. (2024) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-024-00930-6 · Cited by 59
Educators’ perspective on artificial intelligence: equity, preparedness, and development
Gayed, J. M. (2025) · Cogent Education · doi:10.1080/2331186x.2024.2447169 · Cited by 82
Which Contributions Deserve Credit? Perceptions of Attribution in Human-AI Co-Creation
He, J., Houde, S., & Weisz, J. D. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713522 · Cited by 36
Wang, C., Du, Y., & Zou, B. (2025) · International Journal of Applied Linguistics · doi:10.1111/ijal.12827 · Cited by 57
Liu, Z., Zhang, W., & Yang, P. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2456512 · Cited by 54
Fraidan, A. A. A. (2025) · Acta Psychologica · doi:10.1016/j.actpsy.2024.104684 · Cited by 54
Xu, L., Zhang, L., Ling, O., & Wang, D. (2025) · Journal of Second Language Writing · doi:10.1016/j.jslw.2025.101227 · Cited by 46
Shen, Y., & Chen, L. (2026) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2479141 · Cited by 30
“This is highly relevant to this study, as students’ ChatGPT-assisted writing involves social interactions (e.g. communicating with the tool and processing its value-laden information for context-specific writing (Song & Song, 2023; Vargas-Murillo et al., 2023).”
Effects of GenAI Interventions on Student Academic Performance: A Meta-Analysis
Gu, J., & Yan, Z. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251349620 · Cited by 30
“Students may also have more positive psychological reactions (e.g., higher motivation, Song & Song, 2023; higher self-ef fi cacy, Teng, 2024; and less nervousness, Hsu et al., 2023) when interacting with GenAI tools.”
Oubibi, M., Hryshayeva, K., & Huang, R. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2454445 · Cited by 50
Wale, B. D., & Kassahun, Y. F. (2024) · Human Behavior and Emerging Technologies · doi:10.1155/2024/9221377 · Cited by 87
Shi, L., Li, S., & Xing, J. (2025) · European Journal of Education · doi:10.1111/ejed.70241 · Cited by 44
Enhancing Critical Writing Through AI Feedback: A Randomized Control Study
Zhang, K. (2025) · Behavioral Sciences · doi:10.3390/bs15050600 · Cited by 68
Cui, Y. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100391 · Cited by 26
Morell‐Mengual, V., Fernández‐García, O., Berenguer, C., Ortega-Barón, J., Gil‐Llario, M. D., & Estruch‐García, V. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13650-1 · Cited by 69
Alyasiri, O. M., Salisu, S., Younis, H., Salman, A. M., Sahib, T. M., Akhtom, D., & Hayder, I. M. (2024) · Journal of Stomatology Oral and Maxillofacial Surgery · doi:10.1016/j.jormas.2024.101842 · Cited by 42
AI in the language classroom: Insights from pre-service English teachers
Yetkin, R., & Altınkaya, Z. Ö. (2024) · E-Learning and Digital Media · doi:10.1177/20427530241267011 · Cited by 33
Guo, X. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2024.2445177 · Cited by 23
Pawlak, M., Kruk, M., Shirvan, M. E., Taherian, T., & Karimpour, S. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2498094 · Cited by 30
Xu, S., Chen, P., & Zhang, G. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e39845 · Cited by 41
Wang, C., Wang, B., & Xu, D. (2025) · Learning and Motivation · doi:10.1016/j.lmot.2025.102131 · Cited by 40
Shen, L., Wang, S., & Xin, Y. (2025) · Learning and Motivation · doi:10.1016/j.lmot.2025.102168 · Cited by 26
ChatGPT-generated versus human direct corrective feedback on L2 writing
Muñoz Muñoz, B. C., Nassaji, H., & Bello Carrillo, F. I. (2025) · System · doi:10.1016/j.system.2025.103805 · Cited by 22
Zhang, Q., Siraj, S. B., & Razak, R. A. (2025) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2025.2515111 · Cited by 51
Galindo‐Domínguez, H., Delgado, N., Urruzola, M. V., Urbieta, J. M. E., & Campo, L. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70020 · Cited by 43
Yang, M., Wu, X., & Deris, F. D. (2025) · British Educational Research Journal · doi:10.1002/berj.4184 · Cited by 30
RetractedJamshed, M., Ahmed, A. S. M. M., Sarfaraj, M., & Warda, W. U. (2024) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v18i19.50361 · Cited by 24
Alotaibi, H. M., Sonbul, S., & El‐Dakhs, D. A. S. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04945-2 · Cited by 54
Xia, Q., Zhang, P., Huang, W., & Chiu, T. K. F. (2025) · Asia Pacific Journal of Education · doi:10.1080/02188791.2025.2530503 · Cited by 44
Metadata
- Authors
- Song, C., & Song, Y.
- Affiliations
- North Minzu University (CN)
- Central South University (CN)
- Corresponding author
- Song, Cuiping
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2023-12-15
- Volume
- 14
- Pages
- 1260843-1260843
- ISSN
- 1664-1078 (ISSN-L)
- PMC
- PMC10754989
- OpenAlex
- W4389793309
- Cited by
- 717
- References
- 70
- Citations by year
- 2026: 297 · 2025: 296 · 2024: 123 · 2023: 1
- FWCI
- 802.96
- Type
- journal article
- Language
- en
- Update notices
- correction (2026-07-22)
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › English Language Learning and Teaching
- Keywords
- ChatGPT, AI-assisted language learning, academic writing, writing skills, writing motivation, EFL learners, Chinese learners of English, generative AI in education, overreliance on AI, writing instruction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
