The Impact of ChatGPT on Academic Writing Skills and Knowledge: An Investigation of Its Use in Argumentative Essays
Open accessThe DOI matches its Crossref record; 43 of the 45 references it cites were found in a registry or an index, and 2 are not checked yet.
Abstract
This study investigates the impact of ChatGPT on EFL students' argumentative writing development of 30 third-year English majors. The research examines writing quality improvements, student perceptions, and patterns of AI tool usage across a 16-week period. This study employed a mixed-methods design to investigate both students' writing development and their perceptions of AI integration. Writing development was assessed through comparative analysis of participants' first and fifth drafts as pre-test and post-test assessments, while perceptions data were collected through a validated 17-item questionnaire (Cronbach's α = 0.89) focusing on confidence and concerns in AI-assisted writing. Essays were evaluated using an adapted AIAS framework focusing on six dimensions: content, organization, language use, critical thinking, AI integration, and academic integrity. The quantitative analysis revealed significant enhancements in writing performance, with the most substantial improvements in academic integrity (+3.0 points. Furthermore, the thematic analysis of the draft comparisons demonstrated marked progression in argument construction, evidence integration, and academic voice. This research provides insights for developing pedagogical frameworks that optimize AI integration while fostering independent writing competencies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“For example, studies examining AI-assisted writing tasks report that students often produce more fluent and well-structured text, while improvements in argument quality or conceptual reasoning remain limited [10][11][12].”
From Fluency Illusion: A Review on Influence of ChatGPT in Classroom Settings (2026) · cites this paper as [12]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Intervention studies have shown that using ChatGPT as a formative feedback tool can enhance writing accuracy, organization, and learner engagement while reducing anxiety (Khampusaen, 2025; Mahapatra, 2024).”
From Perceptions vs. practices: academic integrity and actual ChatGPT use among EFL students (2026) · cites this paper as Khampusaen, 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“align with the intervention results of (Khampusaen 2025) and (Mahapatra 2024), who reported that ethically integrated AI feedback enhanced writing fluency and confidence.”
From Perceptions vs. practices: academic integrity and actual ChatGPT use among EFL students (2026) · cites this paper as Khampusaen 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Full authorship substitution AI generates most or all of the final text High-quality surface output with minimal effort Limited development of writing, reasoning, and conceptual understanding [12,37]”
From Fluency Illusion: A Review on Influence of ChatGPT in Classroom Settings (2026) · cites this paper as [12]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reflecting on reflexive thematic analysis
Braun, V., & Clarke, V. (2019) · Qualitative Research in Sport, Exercise and Health · doi:10.1080/2159676x.2019.1628806 · Cited by 19,677 · cited 1×
“This began when the essays were imported into NVivo 14, where a thematic analysis was conducted through a systematic coding process following the Braun and Clarke' (2019) six-phase framework.”
Research design: qualitative, quantitative, and mixed methods approaches
Caldas, M. P. (2003) · Revista de Administração Contemporânea · doi:10.1590/s1415-65552003000100015 · Cited by 18,745 · cited 2×
“Second, their successful completion of fundamental writing courses ensured a basic understanding of academic writing conventions, providing a solid foundation for the study (Creswell & Creswell, 2018).”
Cohen, L., Manion, L., & Morrison, K. (2017) · doi:10.4324/9781315456539 · Cited by 6,018 · cited 1×
“The pre-post intervention design, as outlined by Cohen et al (2017), provides a foundational methodology for measuring writing development.”
Toward a Psychology of Human Agency
Bandura, A. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00011.x · Cited by 3,459
Chatting about ChatGPT: how may AI and GPT impact academia and libraries?
Lund, B. D., & Wang, T. (2023) · Library Hi Tech News · doi:10.1108/lhtn-01-2023-0009 · Cited by 1,355
Discovering Statistics Using IBM SPSS Statistics: And Sex and Drugs and Rock “N” Roll
(2014) · Pflege · doi:10.1024/1012-5302/a000397 · Cited by 1,224 · cited 1×
“ANOVA is applied using IBM SPSS Statistics 29 to examine differences in argument quality across various groups, following Field's (2009) statistical procedures.”
Chatting about ChatGPT: How May AI and GPT Impact Academia and Libraries?Preprint
Lund, B. D., & Wang, T. (2023) · Social Science Research Network · doi:10.2139/ssrn.4333415 · Cited by 1,093 · cited 2×
“It is however necessary to consider ongoing evaluation and adjustment to ensure they effectively serve both pedagogical objectives and student needs, as emphasized by Lund et al. (2023) in their analysis of AI integration challenges and opportunities in academic settings.”
Hyland, K. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511667251 · Cited by 1,067
Perkins, M. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.02.07 · Cited by 839
Teaching by Principles: An Interactive Approach to Language Pedagogy
Lander, J. A., & Brown, H. D. (1995) · Language · doi:10.2307/415773 · Cited by 826 · cited 1×
“First, as third-year English majors, these students demonstrated the required language proficiency level necessary for engaging in complex argumentative writing tasks (Brown & Lee, 2015).”
Research works printed but not linked: 8
- Creswell, J. W., & Clark, V. L. P. (2017). Designing and conducting mixed methods research. SAGE Publications.
- Etikan, I. (2016). Comparison of convenience sampling and purposive sampling. American Journal of Theoretical and Applied Statistics, 5, 1. https://doi.org/10.11648/j.ajtas.20160501. · doi:10.11648/j.ajtas.20160501
- Mahmood Khan, W. (2024). Analyzing the AI tools' impact on critical thinking in BS English students at Pakistani Universities. Journal of Applied Linguistics and TESOL, 7(4).
- Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook, 2nd ed. (pp. xiv, 338). Sage Publications, Inc.
- Nguyen, T., Lai, N., & Nguyen, Q. (2024). Artificial intelligence (AI) in education: A case study on ChatGPT's influence on student learning behaviors. Educational Process International Journal, 13, 105-121. https://doi.org/10.22521/edupij.2024.132. · doi:10.22521/edupij.2024.132
- Patty, J. (2024). Addressing student writing challenges: A review of difficulties and effective strategies. Education Journal: Journal Educational Research and Development, 8, 369-392. https://doi.org/10.31537/ej.v8i2.1938 · doi:10.31537/ej.v8i2.1938
- Saldana, J. (2013). The coding manual for qualitative researchers (2nd ed.). SAGE Publications Ltd. https://emotrab.ufba.br/wp- content/uploads/2020/09/Saldana-2013- TheCodingManualforQualitativeResearchers.pdf
- Zou, B., & Lertlit, S. (2022). Oxford's strategy inventory for language learning: English learning of Chinese students in Thai University. Language Education and Acquisition Research Network, 15(2), 705-723.
Cited by
Fluency Illusion: A Review on Influence of ChatGPT in Classroom Settings
Kumar, S., Mikayelyan, A., & Vorfolomeyeva, O. (2026) · Information · doi:10.3390/info17030299 · Cited by 11
Perceptions vs. practices: academic integrity and actual ChatGPT use among EFL students
Alsadoon, R. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1796737 · Cited by 8
“Intervention studies have shown that using ChatGPT as a formative feedback tool can enhance writing accuracy, organization, and learner engagement while reducing anxiety (Khampusaen, 2025; Mahapatra, 2024).”
Li, X., & Awang, M. M. B. (2026) · European Journal of Education · doi:10.1111/ejed.70490 · Cited by 7
Zhang, R., Zou, D., Xie, H., & Wang, F. L. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100489 · Cited by 9
Anthony, A., Sharma, S., & Sharma, S. (2025) · Bulletin of Science Technology & Society · doi:10.1177/02704676251353105 · Cited by 12
“ChatGPT has emerged as a powerful academic aid, streamlining tasks like brainstorming, drafting, and editing (Burger et al., 2023; Khampusaen, 2025; Siegerink et al., 2023).”
Mohale, N. E., Sevnarayan, K., Maphoto, K. B., & Suliman, Z. (2025) · Online Journal of Communication and Media Technologies · doi:10.30935/ojcmt/17484 · Cited by 5
AI-Integrated Language Learning Transforming Pedagogical Paradigms in ELT
Kotamjani, S. S., Jafary, M., & Amoozegar, A. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3755-5.ch001 · Cited by 3
EFFICIENCY, ENGAGEMENT, AND COGNITIVE OFFLOADING: A REVIEW OF GENERATIVE AI IN EDUCATION
Khalid, N., Kasbun, R., & Rahman, N. F. A. (2026) · International Journal of Education Psychology and Counseling · doi:10.35631/ijepc.1162072 · Cited by 5
Muthmainnah, M., Cardoso, L., Matari, A. S. A., Espinosa, K. P. M., Misdi, M., & Yakin, A. M. A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-15806-2_4 · Cited by 4
Artificial intelligence in academic writing: A decade of trends and influences
Ghosh, P. L., Barua, S., & Golder, U. (2026) · Sustainable Futures · doi:10.1016/j.sftr.2026.102034 · Cited by 3
Thai EFL University Students’ Writing in the Digital Age: Error Analysis Revisited
Chuanpipatpong, A. (2025) · PASAA · doi:10.58837/chula.pasaa.70.10 · Cited by 4
Clarity Without Credibility? Human Versus AI Abstracts in Otolaryngology
Hack, S., Attal, R., Levi, L., Liu, D. T., Manavi, M. S., Locatello, L. G., Fieux, M., de Joya, E. M., Gutovitz, J. M., Eliahu, S., et al. (2026) · World Journal of Otorhinolaryngology - Head and Neck Surgery · doi:10.1002/wjo2.70104 · Cited by 3
“Since the public release of ChatGPT (GPT) and similar systems in late 2022, investigators have shown that LLMs can generate convincing academic abstracts and manuscripts that are difficult to distinguish from human writing [11–23].”
Liang, H. (2025) · Preprints.org · doi:10.20944/preprints202506.1967.v1 · Cited by 5
Thinking Along the Lines Generated by GenAI? A Systematic Mapping Study on Academic Writing
Kaczkó, É., Ivanjek, L., Norz, L.-M., & Ammenwerth, E. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-11108-1_35 · Cited by 1
AI Guilt and the Learner-User Paradox: Extending Student Feedback Literacy for the AI Era
Mei-seung, C. (2026) · Lecture notes in educational technology · doi:10.1007/978-981-95-8824-4_3
Ethical Use of ChatGPT and Critic-AI in Academic Writing and ResearchPreprint
Yaprak, Z. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6539730
The Student as Prompt Engineer: Culturing Precision, Intentionality, and Metacognition
Kour, J., Kaur, S., & Bhatia, R. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8027-8.ch008
Jecha, J., Liang, Y., Han, J., & Nassor, H. (2026) · Research Square · doi:10.21203/rs.3.rs-9461812/v1 · Cited by 2
Between Curiosity and Caution: What Drives and Deters AI Adoption in Adult Learning
Gay, G. H. E., & Franklyn, S. G. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-8800-7.ch003
Divya, T. J., & Alamelu, C. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1838463 · Cited by 1
“The study by Khampusaen (2024), for example, highlighted that the use of ChatGPT enhanced EFL university learners’ AW in terms of the development of arguments, the integration of evidence and improvement of academic tone, along with notable enhancement in their academic integrity.”
Turós, M., Soltész-Várhelyi, K., & Szűts, Z. (2026) · Education Sciences · doi:10.3390/educsci16060920 · Cited by 1
Lee, J., Borchers, C., Alvero, A., Joachims, T., & Kizilcec, R. F. (2026) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3774398.3811620 · Cited by 8
“LLMs can support brainstorming, drafting, paraphrasing, and editing, lowering barriers to writing and potentially expanding access to high-quality feedback [16, 30, 33, 47, 60].”
The Impact of Generative AI Tools on Student Academic Performance: Machine Learning Approach
Čolić, V., Sukić, E., Tufegdžić, M., Mojsilović, M., & Spasojević, V. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-30110-9_28 · Cited by 1
Making Students “Safe” Writers with the SAFE Model in the Age of AI
Nuthihar, R., Anshori, D. S., Cahyani, I., & Sastromiharjo, A. (2026) · Discourses on Culture · doi:10.2478/doc-2026-0008
ChatGPT in EFL academic writing instruction in Asian higher education: A scoping review
Heng, B., & Nawas, A. (2026) · Review of Education · doi:10.1002/rev3.70213 · Cited by 2
Tangkiengsirisin, S., Canh, L. V., & Techasan, S. (2026) · LEARN Journal : Language Education and Acquisition Research Network · doi:10.70730/jfow3489
Atta, A., & Kosar, H. (2026) · International Journal of Emerging Multidisciplinaries Social Science · doi:10.54938/ijemdss.2026.05.1.768
“The most widely used are general-purpose conversational assistants like ChatGPT and Claude, which are helpful for a variety of writing, coding, and analytical tasks (Anthony et al., 2025; Khampusaen, 2025).”
Argumentative Writing and Technology: A Systematic Review (2010-2025)Preprint
Kia, A. J., & Farsani, M. A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7388022
Zainuddin, N. M., Mohamad, M. B., & You, H. W. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7389911
The bright highlights and the dark shadows of artificial intelligence in higher education
Sejdiu, N. P., Rosner, M., & Sejdiu, S. (2026) · Open Research Europe · doi:10.12688/openreseurope.24951.1
Vinte, J. V., & Kurt, M. (2026) · Discover Computing · doi:10.1007/s10791-026-10604-0
“By contrast, tools such as ChatGPT, Gemini and DeepSeek were AI-native, developed from the outset as large language model (LLM)-based generators [21–23].”
Metadata
- Authors
- Khampusaen, D.
- Affiliations
- Khon Kaen University (TH)
- Corresponding author
- Khampusaen, Dararat
- ORCID
- Khampusaen, Dararat
- Venue
- LEARN Journal: Language Education and Acquisition Research Network
- Publisher
- Thammasat University
- Published
- 2025-01-31
- Volume
- 18
- Issue
- 1
- Pages
- 963-988
- ISSN
- 2630-0672 (ISSN-L)
- 2672-9431
- OpenAlex
- W4407061908
- Cited by
- 31
- References
- 30
- Citations by year
- 2026: 24 · 2025: 7
- FWCI
- 32.50
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- LEARN Journal : Language Education and Acquisition Research Network (publishedVersion, cc-by)
- Funders
- Khon Kaen University
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › English Language Learning and Teaching
- Keywords
- ChatGPT, AI-assisted writing, argumentative essay writing, EFL writing, academic writing skills, academic integrity, student perceptions of AI, writing development, evidence integration, academic voice, critical thinking, English majors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
