Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students
Open accessThe DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index; 20 of the 47 sources its claims cite were checked for support.
Abstract
A mixed-methods study of 50 Chinese EFL students randomly assigned to AI-assisted ChatGPT versus traditional instruction, reporting significant improvements in writing skills and motivation.
Overview
CoChat Summary
TL;DR
This mixed-methods study found that 12 weeks of ChatGPT-assisted writing instruction improved Chinese EFL students’ academic writing skills and writing motivation more than traditional instruction. Qualitative interviews with experimental-group students were largely positive but raised concerns about contextual accuracy, over-reliance, and long-term sustainability.
Key findings
- The experimental group outperformed the control group on global writing post-test after controlling for pre-test scores: M = 59.12 vs. 45.18; ANCOVA F(1, 47) = 19.01, p = 0.00, partial eta squared = 0.27; t-test t(48) = 3.79, p < 0.001, Cohen’s d = 0.76.
- Specific writing dimensions favored the experimental group: content F(1, 47) = 12.61, p = 0.00, partial eta squared = 0.19; organization F(1, 47) = 23.16, p = 0.00, partial eta squared = 0.34; language use F(1, 47) = 9.86, p = 0.01, partial eta squared = 0.11.
- Writing motivation was significantly higher in the experimental group: M = 20.06 vs. 18.21; ANCOVA F(1, 47) = 29.62, p = 0.00, partial eta squared = 0.38; t-test t(48) = 3.34, p = 0.001, Cohen’s d = 0.52.
- Qualitative themes included positive perceptions of innovation and assistance, writing skill enhancements, motivation and engagement gains, recognized advantages such as accessibility and personalized feedback, acknowledged challenges including contextual accuracy and over-reliance, and concerns about long-term impact and sustainability.
Methods
- Mixed-methods design with 50 Chinese EFL undergraduates at a national university, matched for proficiency and randomly assigned to experimental (ChatGPT-assisted instruction) or control (traditional teacher-led instruction) groups; intervention lasted 12 weeks, with AI sessions twice weekly for approximately 60 minutes.
- Pre-test and post-test IELTS academic writing tasks 1 and 2 were scored with IELTS band descriptors by two raters (inter-rater reliability r = 0.88); writing motivation was measured with a 7-item Writing Motivation Scale on a 5-point Likert scale (Cronbach’s α = 0.86); semi-structured interviews were conducted with 9 experimental-group students for about 30 minutes each and analyzed thematically.
- Quantitative analysis used one-way ANCOVA controlling for pre-test scores, independent samples t-tests, and effect sizes.
Limitations
- Stated by the paper: generalizability is constrained by the specific sample of Chinese EFL students; the sample size of 50 is relatively small; the intervention duration was relatively short; possible contamination between experimental and control groups; no long-term follow-up to assess sustainability; and potential unintended plagiarism or over-reliance on AI-generated content despite ethical guidance.
- Evident from the text: writing motivation was measured only by self-report questionnaire, and qualitative interviews were conducted only with experimental-group students, so control-group perceptions and experiences were not captured.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
14 Valid · 3 Not valid · 17 Not checked · 81 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Importantly, feedback is recognized as a critical component in enhancing writing performance and motivation in the context of language learning (Bakla, 2020; Liu et al., 2022; Zhang and Zou, 2023).”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Literature review > Theoretical framework
What the sources say
- Supportedcites Bakla, 2020 source
The Introduction describes feedback as an essential part of second-language writing instruction and explains how it can facilitate learning. The Results from the Essay-Revision Task report successful revisions following feedback, while the Discussion says digital feedback motivated students to work on their writing. These passages support the broad claim, though they do not establish that one feedback mode improves performance more than another. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites Liu et al., 2022 source
- Not checked — no full text of the sourcecites Zhang and Zou, 2023 source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This heightened engagement, facilitated by the AI tool’s responsiveness, contributes to the observed improvements in writing skills and motivation (Liu et al., 2021; Utami and Winarni, 2023).”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Literature review > Theoretical framework
What the sources say
- Not checked — no full text of the sourcecites Liu et al., 2021 source
- Partly supportedcites Utami and Winarni, 2023 sourceExperimental — accuracy not yet measured
The Discussion reports that students perceived improved motivation, and the writing-skills findings report perceived benefits, with observed writing-quality improvement limited to creativity of ideas (section labeled “3.74”; page unavailable). The paper does not establish that the tool’s responsiveness heightened engagement or that such engagement caused improvements in skills and motivation. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The identified contextual accuracy concerns resonate with previous studies highlighting the need for careful consideration when incorporating AI-generated feedback (Utami and Winarni, 2023).”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Discussion
What the sources say
- Partly supportedcites Utami and Winarni, 2023 sourceExperimental — accuracy not yet measured
In “Students’ perception of usefulness of artificial intelligence technology utilization” (page unavailable), a participant says users must decide whether to accept AI-offered sentences and rearrange drafts so they remain logical. This supports careful consideration of AI writing suggestions, but the paper does not identify contextual accuracy problems in AI-generated feedback specifically; it says participants did not use the tools for revising and editing. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The intervention’s effectiveness in enhancing organization and coherence within their essays demonstrates the potential of AI-assisted tools in scaffolding the writing process (Zhao, 2022; Barrot, 2023).”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Discussion
What the sources say
- Partly supportedcites Zhao, 2022 sourceExperimental — accuracy not yet measured
The Introduction (p. 2) says Wordtune supports EFL writers during the writing process, and the Conclusion and Limitations (p. 6) says it can help improve writing quality. But this tech review does not report an intervention or demonstrate improvements in essay organization and coherence. (LLM, conf=0.87)
- Not checked — no full text of the sourcecites Barrot, 2023 source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Significant differences were observed in writing motivation between the two groups, as presented in Table 7 [F(1, 47) = 29.62, p = 0.00, partial eta squared = 0.38].”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
44 more claims
Create a free account to see all 115 claims and every source verdict.
- It may state two separate claims as one. 26
- Probably not a substantial claim. 42
- Borderline: one of the tests for a substantial claim is unclear. 2
- Not yet classified. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These findings align with studies from other EFL settings [31] where instructors appreciate AI's ability to streamline lesson planning and increase productivity.”
From Teachers' Use of Generative AI in Jordanian Universities: Practices and Perceptions (2025) · cites this paper as [31]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior research suggests that technology-assisted learning environments can enhance learners' confidence when tools are perceived as facilitators of understanding rather than substitutes for thinking (Heo et al., 2021; Ma and Lee, 2021; Song and Song, 2023).”
From Cognitive offloading through digital tools and its relationship with critical thinking, task persistence, and learning depth (2026) · cites this paper as Song and Song, 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Students were found to engage actively with AI-generated suggestions, selectively modifying or rejecting content, which indicated maintained agency and thoughtful decision making.”
From AI-Integrated Scaffolding to Enhance Agency and Creativity in K-12 English Language Learners: A Systematic Review (2025) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Students gained confidence in using ChatGPT for IELTS tasks.Evidence of growing ownership and self-direction, though creativity limited by the assessment format.”
From AI-Integrated Scaffolding to Enhance Agency and Creativity in K-12 English Language Learners: A Systematic Review (2025) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Students gained confidence in using ChatGPT for IELTS tasks.Evidence of growing ownership and self-direction, though creativity limited by the assessment format.”
From AI-Integrated Scaffolding to Enhance Agency and Creativity in K-12 English Language Learners: A Systematic Review (2025) · cites this paper as [7]
Experimental — accuracy not yet measured
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Statistics that don’t add up
Each reported p-value recomputed from its test statistic and degrees of freedom.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“t(48) = 3.01, p = 0.003”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
Reported p = .003 · recomputed p = .004
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“t(48) = 3.34, p = 0.001”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
Reported p = .001 · recomputed p = .002
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Doesn’t add upt(48) = 3.01reported p = .003 · recomputed p = .004
“t(48) = 3.01, p = .003”
- Doesn’t add upt(48) = 3.34reported p = .001 · recomputed p = .002
“t(48) = 3.34, p = .001”
- Consistentt(48) = 3.79reported p < .001 · recomputed p < .001
“t(48) = 3.79, p < .001”
- Consistentt(48) = 4.12reported p < .001 · recomputed p < .001
“t(48) = 4.12, p < .001”
- Consistentt(48) = 4.34reported p < .001 · recomputed p < .001
“t(48) = 4.34, p < .001”
5 more recomputed tests
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Method > Procedure
“Table 1 indicates the summary of the intervention details for both groups.”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
“Table 1 presents descriptive statistics for the pre-and post-test scores in both the experimental and control groups.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Method > Instruments
“Semi-structured interviews (see Appendix C) were conducted with nine EFL students from the experimental classroom group”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Qualitative results
“Likewise, thinking about the long-lasting effects, participant S14 said”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
“Furthermore, the ANCOVA results for the two groups’ language use are depicted in Table 6.”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
“Table 5 reveals significant distinctions between the two groups in terms of language use [F(1, 47) = 9.86, p = 0.01, partial eta squared = 0.11].”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
“Also, the ANCOVA results for the two groups’ writing organization are displayed in Table 4.”
§ Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students > Results > Quantitative results
“Significant disparities between the two groups in terms of writing organization were observed, as indicated by the results presented in Table 5”
Citations
Cites
(1998) · Cited by 13,501
Becoming a Self-Regulated Learner: An Overview
Zimmerman, B. J. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4102_2 · Cited by 10,197 · cited 1×
“The AI tool acts as a facilitator, guiding learners to internalize effective writing strategies and enabling them to complete tasks independently (Zimmerman, 2002).”
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242
(2016) · Open Research Online (The Open University) · Cited by 1,410
Evolution and Revolution in Artificial Intelligence in Education
Roll, I., & Wylie, R. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0110-3 · Cited by 1,229 · cited 1×
“…of technology in English language classrooms is widely recognized as a means to overcome certain obstacles in language learning processes (Roll and Wylie, 2016; Knox, 2020), particularly in writing tasks where time constraints often arise (Stapleton and Radia, 2010; Kessler, 2020; Rahimi…”
Fredricks, J. A., Filsecker, M., & Lawson, M. A. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.02.002 · Cited by 851 · cited 1×
“Engagement, as a crucial aspect of the learning process, is influenced by the dynamic interaction between learners and their learning environment (Fredricks et al., 2016).”
Can artificial intelligence help for scientific writing?
Salvagno, M., Taccone, F. S., & Gerli, A. G. (2023) · Critical Care · doi:10.1186/s13054-023-04380-2 · Cited by 827 · cited 1×
“Additionally, learners can expedite their writing development as AI tools help them identify and rectify grammatical and lexical errors, while also suggesting alternative sentence structures to enhance the overall writing quality and structure (Zhao, 2022; Chen, 2023; Salvagno et al., 2023).”
Using ChatGPT for second language writing: pitfalls and potentials
Barrot, J. S. (2023) · Assessing Writing · doi:10.1016/j.asw.2023.100745 · Cited by 770 · cited 4×
“This is consistent with studies by Barrot (2023) and Zhao (2022), which emphasize how immediate feedback can significantly contribute to enhanced writing proficiency.”
InfluentialImpact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation
Yan, D. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11742-4 · Cited by 713 · cited 8×
“This includes the use of advanced artificial intelligence (AI)-based computer and mobile programs, which offer interactive and personalized tools for honing writing abilities as well as enhanced motivation (Jiang, 2022; Meunier et al., 2022; Yan, 2023).”
InfluentialHuang, A. Y. Q., Lu, O. H. T., & Yang, S. J. H. (2023) · Computers & Education · doi:10.1016/j.compedu.2022.104684 · Cited by 605
Hadwin, A., & Oshige, M. (2011) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811111300204 · Cited by 603
Collaborating with ChatGPT in argumentative writing classrooms
Su, Y., Lin, Y., & Lai, C. (2023) · Assessing Writing · doi:10.1016/j.asw.2023.100752 · Cited by 563
Student engagement with teacher and automated feedback on L2 writing
Zhang, Z. (., & Hyland, K. (2018) · Assessing Writing · doi:10.1016/j.asw.2018.02.004 · Cited by 546
OXFORD, R. L. (1997) · The Modern Language Journal · doi:10.1111/j.1540-4781.1997.tb05510.x · Cited by 545
Artificial intelligence and education in China
Knox, J. (2020) · Learning, Media and Technology · doi:10.1080/17439884.2020.1754236 · Cited by 489 · cited 1×
“…in English language classrooms is widely recognized as a means to overcome certain obstacles in language learning processes (Roll and Wylie, 2016; Knox, 2020), particularly in writing tasks where time constraints often arise (Stapleton and Radia, 2010; Kessler, 2020; Rahimi and Fathi, 2022;…”
Xia, Q., Chiu, T. K. F., Lee, M., Sanusi, I. T., Dai, Y., & Chai, C. S. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104582 · Cited by 469
Design of online intelligent English teaching platform based on artificial intelligence techniques
Sun, Z., Anbarasan, M., & Praveen Kumar, D. (2021) · Computational Intelligence · doi:10.1111/coin.12351 · Cited by 409
Nazari, N., Shabbir, M. S., & Setiawan, R. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e07014 · Cited by 405
Classroom Writing Assessment and Feedback in L2 School Contexts
Lee, I. (2017) · doi:10.1007/978-981-10-3924-9 · Cited by 386
Zhang, R., & Zou, D. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1744666 · Cited by 345
Exploring an AI-based writing Assistant's impact on English language learners
Gayed, J. M., Carlon, M. K. J., Oriola, A. M., & Cross, J. S. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100055 · Cited by 340
Trends, Research Issues and Applications of Artificial Intelligence in Language Education
(2023) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.30191/ets.202301_26(1).0009 · Cited by 290
The role of ChatGPT in scientific communication: writing better scientific review articles.
(2023) · PubMed Central · Cited by 289
Fitria, T. N. (2023) · ELT Forum: Journal of English Language Teaching · doi:10.15294/elt.v12i1.64069 · Cited by 283
The Contribution of Collaborative and Individual Tasks to the Acquisition of L2 Vocabulary
KIM, Y. (2008) · The Modern Language Journal · doi:10.1111/j.1540-4781.2008.00690.x · Cited by 277
ChatGPT and other artificial intelligence applications speed up scientific writing
Chen, T.-J. (2023) · Journal of the Chinese Medical Association · doi:10.1097/jcma.0000000000000900 · Cited by 240 · cited 1×
“Additionally, learners can expedite their writing development as AI tools help them identify and rectify grammatical and lexical errors, while also suggesting alternative sentence structures to enhance the overall writing quality and structure (Zhao, 2022; Chen, 2023; Salvagno et al., 2023).”
Foreign language acquisition via artificial intelligence and extended reality: design and evaluation
Divekar*, R. R., Drozdal*, J., Chabot*, S., Zhou, Y., Su, H., Chen, Y., Zhu, H., Hendler, J. A., & Braasch, J. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1879162 · Cited by 237
Liu, C., Hou, J., Tu, Y.-F., Wang, Y., & Hwang, G.-J. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.2012812 · Cited by 231
Grammarly as AI-powered English Writing Assistant: Students' Alternative for Writing English
Fitria, T. N. (2021) · Metathesis: Journal of English Language, Literature, and Teaching · doi:10.31002/metathesis.v5i1.3519 · Cited by 221 · cited 2×
“While a select few studies, such as those by Rahman et al. (2022) and Fitria (2021), have ventured into the realm of writing skills, the scope has remained limited to the correction of grammatical errors and broader language proficiency (e.g., Liu et al., 2021; Gayed et al., 2022).”
Zhao, X. (2023) · RELC Journal · doi:10.1177/00336882221094089 · Cited by 192 · cited 6×
“By leveraging the capabilities of AI, learners can receive immediate and targeted feedback, enabling them to identify areas for improvement and enhance their writing performance accordingly.”
InfluentialBetter by You, better than Me? ChatGPT-3 as writing assistance in students’ essays.
Bašić, Ž., Banovac, A., Kružić, I., & Jerković, I. (2023) · doi:10.35542/osf.io/n5m7s · Cited by 189
Waller, L., & Papi, M. (2017) · Journal of Second Language Writing · doi:10.1016/j.jslw.2017.01.004 · Cited by 189
The future of higher education in the light of artificial intelligence transformations
Aldosari, S. A. M. (2020) · International Journal of Higher Education · doi:10.5430/ijhe.v9n3p145 · Cited by 185 · cited 1×
“AI can be defined as a system incorporating intelligent programs that collaborate with humans to perform various tasks (Aldosari, 2020).”
Jiang, R. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1049401 · Cited by 181 · cited 1×
“This includes the use of advanced artificial intelligence (AI)-based computer and mobile programs, which offer interactive and personalized tools for honing writing abilities as well as enhanced motivation (Jiang, 2022; Meunier et al., 2022; Yan, 2023).”
A Computer Wrote this Paper: What ChatGPT Means for Education, Research, and WritingPreprint
Shaver, L. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4338981 · Cited by 173
Rahimi, M., & Fathi, J. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1888753 · Cited by 163
Constructivism and Learning in the Age of Social Media: Changing Minds and Learning Communities
Schrader, D. E. (2015) · New Directions for Teaching and Learning · doi:10.1002/tl.20160 · Cited by 159
Utami, S. P. T., Andayani, A., Winarni, R., & Sumarwati, S. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13419 · Cited by 124 · cited 7×
“This heightened engagement, facilitated by the AI tool’s responsiveness, contributes to the observed improvements in writing skills and motivation (Liu et al., 2021; Utami and Winarni, 2023).”
InfluentialWang, Z. (2022) · Library Hi Tech · doi:10.1108/lht-05-2020-0113 · Cited by 116
Sociological perspectives on artificial intelligence: A typological reading
Liu, Z. (2021) · Sociology Compass · doi:10.1111/soc4.12851 · Cited by 105
Hwang, W.-Y., Nurtantyana, R., Purba, S. W. D., Hariyanti, U., Indrihapsari, Y., & Surjono, H. D. (2023) · Journal of Educational Computing Research · doi:10.1177/07356331221137253 · Cited by 104 · cited 2×
“Consistent with the findings of Hwang et al. (2023), the present study suggests that the positive outcomes can be attributed to the personalized language learning experience facilitated by the AI-assisted language learning tool during collaborative writing tasks.”
MethodResultL2 learners' perceptions of a chatbot as a potential independent language learning tool
Kohnke, L. (2023) · International Journal of Mobile Learning and Organisation · doi:10.1504/ijmlo.2023.128339 · Cited by 100
An analysis of Chinese EFL students’ use of first and second language in peer feedback of L2 writing
Yu, S., & Lee, I. (2014) · System · doi:10.1016/j.system.2014.08.007 · Cited by 100
Concordancing in L2 writing class: an overview of research and issues
Yoon, C. (2011) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2011.03.003 · Cited by 94
Jia, F., Sun, D., Ma, Q., & Looi, C.-K. (2022) · Sustainability · doi:10.3390/su142315527 · Cited by 90 · cited 1×
“The emergence of AI-powered writing tools, accessible on mobile devices, provides a novel avenue to address the challenges associated with developing writing proficiency through traditional training methods (Zawacki-Richter et al., 2019; Jia et al., 2022; Kohnke, 2023).”
Fathi, J., & Rahimi, M. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1825097 · Cited by 88
Loncar, M., Schams, W., & Liang, J.-S. (2023) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1943452 · Cited by 86
Kessler, M. (2020) · Computers and Composition · doi:10.1016/j.compcom.2020.102542 · Cited by 75
Chang, T.-S., Li, Y., Huang, H.-W., & Whitfield, B. (2021) · 2021 2nd International Conference on Education Development and Studies · doi:10.1145/3459043.3459065 · Cited by 74
Hsiao, J.-C., & Chang, J. S. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2207187 · Cited by 73
A mixed-methods study of feedback modes in EFL writing
Bakla, A. (2020) · Language Learning & Technology · doi:10.64152/10125/44712 · Cited by 59
Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers
Ippolito, D., Yuan, A., Coenen, A., & Burnam, S. (2022) · arXiv · doi:10.48550/arxiv.2211.05030 · Cited by 52
Liu, S., Kang, L., Liu, Z., Fang, J., Yang, Z., Sun, J., Wang, M., & Hu, M. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1927115 · Cited by 42 · cited 2×
“…on AI-assisted language learning, numerous studies have made valuable contributions to our understanding of its impact on language acquisition and the broader field of language learning (e.g., Suryana et al., 2020; Divekar et al., 2021; Liu, 2021; Bašić et al., 2023; Bishop, 2023; Fitria, 2023).”
InfluentialLiu, G., Rahimi, M., & Fathi, J. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12707 · Cited by 41
Introduction to Artificial Intelligence
Sajja, P. S. (2020) · Studies in computational intelligence · doi:10.1007/978-981-15-9589-9_1 · Cited by 41
Teaching Writing with Language Feedback Technology
Lim, F. V., & Phua, J. (2019) · Computers and Composition · doi:10.1016/j.compcom.2019.102518 · Cited by 39 · cited 1×
“However, the process of monitoring and providing insightful feedback on student writing poses challenges in terms of time, effort, and subjectivity (Yu and Lee, 2014; Lim and Phua, 2019).”
ARTIFICIAL INTELLIGENCE TO MASTER ENGLISH LISTENING SKILLS FOR NON-ENGLISH MAJOR STUDENTS
Suryana, I., Asrianto, A., & Murwantono, D. (2020) · Journal of Languages and Language Teaching · doi:10.33394/jollt.v8i1.2221 · Cited by 38
The impact of portfolio-based writing instruction on writing performance and anxiety of EFL students
Fathi, J., Derakhshan, A., & Safdari, M. (2020) · Polish Psychological Bulletin · doi:10.24425/ppb.2020.134729 · Cited by 37
Zhang, R., & Zou, D. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11469-8 · Cited by 36
Exploring artificial intelligence using automated writing evaluation for writing skills
Abdul Rahman, N. A., Zulkornain, L. H., & Hamzah, N. H. (2022) · Environment-Behaviour Proceedings Journal · doi:10.21834/ebpj.v7isi9.4304 · Cited by 36
Tech-era L2 writing: towards a new kind of process
Stapleton, P., & Radia, P. (2010) · ELT Journal · doi:10.1093/elt/ccp038 · Cited by 36
Teaching academic writing in higher education
Vancouver Island University, & Campbell, M. (2019) · Education Quarterly Reviews · doi:10.31014/aior.1993.02.03.92 · Cited by 36
Developing personalised education for personal mobile technologies with the pluralisation agenda
Kucirkova, N. I., & Littleton, K. (2017) · Oxford Review of Education · doi:10.1080/03054985.2017.1305046 · Cited by 35
THE IMPACT OF CHAT GPT ON STUDENT'S WRITING SKILLS: AN EXPLORATION OF AI-ASSISTED WRITING TOOLS
Abdullayeva, M., & Muzaffarovna, M. Z. (2023) · Zenodo · doi:10.5281/zenodo.7876800 · Cited by 30
Fathi, J., Rahimi, M., & Liu, G. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12772 · Cited by 26
L2 Learner Cognitive Psychological Factors About Artificial Intelligence Writing Corrective Feedback
Wu, L., Wu, Y., & Zhang, X. (2021) · English Language Teaching · doi:10.5539/elt.v14n10p70 · Cited by 26
Computer Science and Education
(2023) · doi:10.1007/978-981-99-2449-3 · Cited by 25
Fostering Students' Academic Writing Skills: Feedback Model for an AI-enabled Support Environment.
Seufert, S., Burkhard, M., & Handschuh, S. (2021) · Alexandria (UniSG) (University of St.Gallen) · Cited by 12
Editorial: New perspectives of L2 acquisition related to human-computer interaction (HCI)
Meunier, F., Pikhart, M., & Klímová, B. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1098208 · Cited by 11
Hsiao, P.-W., Kong, L. Q., & Ye, Y. L. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2023.2212716 · Cited by 4
Language learning in an era of datafication and personalized learning
Fulton, L., Hoffman, D. L., & Paek, S. (2021) · Educational Technology Research and Development · doi:10.1007/s11423-020-09903-0 · Cited by 4
Research works printed but not linked: 2
- Pallant, 2013, SPSS survival manual
- Vygotsky, 1984, The problem of age, Pedagogical
Cited by
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13544 · Cited by 805
Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025) · Computers & Education · doi:10.1016/j.compedu.2024.105224 · Cited by 531
Using AI-driven chatbots to foster Chinese EFL students’ academic engagement: An intervention study
Wang, Y., & Xue, L. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108353 · Cited by 328
Wang, J., & Fan, W. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04787-y · Cited by 322
“The meta-analysis results show that ChatGPT effectively enhances student learning performance across different types of courses, as has been shown by prior studies (Ba et al. 2024; Li, 2023; Song and Song, 2023).”
RetractedHalkiopoulos, C., & Gkintoni, E. (2024) · Electronics · doi:10.3390/electronics13183762 · Cited by 328
“Interactivity and personalized feedback have thus become crucial variables for effective language learning [191].”
Metadata
- Authors
- Song, C., & Song, Y.
- Affiliations
- North Minzu University (CN)
- Central South University (CN)
- Corresponding author
- Song, Cuiping
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2023-12-15
- Volume
- 14
- Pages
- 1260843-1260843
- ISSN
- 1664-1078 (ISSN-L)
- PMC
- PMC10754989
- OpenAlex
- W4389793309
- Cited by
- 717
- References
- 70
- Citations by year
- 2026: 297 · 2025: 296 · 2024: 123 · 2023: 1
- FWCI
- 802.96
- Type
- journal article
- Language
- en
- Update notices
- correction (2026-07-22)
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › English Language Learning and Teaching
- Keywords
- ChatGPT, AI-assisted language learning, academic writing, writing skills, writing motivation, EFL learners, Chinese learners of English, generative AI in education, overreliance on AI, writing instruction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
