The DOI matches its Crossref record; 43 of the 45 references it cites were found in a registry or an index, and 2 are not checked yet.
The Impact of ChatGPT on Academic Writing Skills and Knowledge: An Investigation of Its Use in Argumentative Essays
Open accessAbstract
This study investigates the impact of ChatGPT on EFL students' argumentative writing development of 30 third-year English majors. The research examines writing quality improvements, student perceptions, and patterns of AI tool usage across a 16-week period. This study employed a mixed-methods design to investigate both students' writing development and their perceptions of AI integration. Writing development was assessed through comparative analysis of participants' first and fifth drafts as pre-test and post-test assessments, while perceptions data were collected through a validated 17-item questionnaire (Cronbach's α = 0.89) focusing on confidence and concerns in AI-assisted writing. Essays were evaluated using an adapted AIAS framework focusing on six dimensions: content, organization, language use, critical thinking, AI integration, and academic integrity. The quantitative analysis revealed significant enhancements in writing performance, with the most substantial improvements in academic integrity (+3.0 points. Furthermore, the thematic analysis of the draft comparisons demonstrated marked progression in argument construction, evidence integration, and academic voice. This research provides insights for developing pedagogical frameworks that optimize AI integration while fostering independent writing competencies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“For example, studies examining AI-assisted writing tasks report that students often produce more fluent and well-structured text, while improvements in argument quality or conceptual reasoning remain limited [10][11][12].”
From Fluency Illusion: A Review on Influence of ChatGPT in Classroom Settings (2026) · cites this paper as [12]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Intervention studies have shown that using ChatGPT as a formative feedback tool can enhance writing accuracy, organization, and learner engagement while reducing anxiety (Khampusaen, 2025; Mahapatra, 2024).”
From Perceptions vs. practices: academic integrity and actual ChatGPT use among EFL students (2026) · cites this paper as Khampusaen, 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“align with the intervention results of (Khampusaen 2025) and (Mahapatra 2024), who reported that ethically integrated AI feedback enhanced writing fluency and confidence.”
From Perceptions vs. practices: academic integrity and actual ChatGPT use among EFL students (2026) · cites this paper as Khampusaen 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Full authorship substitution AI generates most or all of the final text High-quality surface output with minimal effort Limited development of writing, reasoning, and conceptual understanding [12,37]”
From Fluency Illusion: A Review on Influence of ChatGPT in Classroom Settings (2026) · cites this paper as [12]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reflecting on reflexive thematic analysis
Braun, V., & Clarke, V. (2019) · Qualitative Research in Sport, Exercise and Health · doi:10.1080/2159676x.2019.1628806 · Cited by 19,677 · cited 1×
“This began when the essays were imported into NVivo 14, where a thematic analysis was conducted through a systematic coding process following the Braun and Clarke' (2019) six-phase framework.”
Research design: qualitative, quantitative, and mixed methods approaches
Caldas, M. P. (2003) · Revista de Administração Contemporânea · doi:10.1590/s1415-65552003000100015 · Cited by 18,745 · cited 2×
“Second, their successful completion of fundamental writing courses ensured a basic understanding of academic writing conventions, providing a solid foundation for the study (Creswell & Creswell, 2018).”
Cohen, L., Manion, L., & Morrison, K. (2017) · doi:10.4324/9781315456539 · Cited by 6,018 · cited 1×
“The pre-post intervention design, as outlined by Cohen et al (2017), provides a foundational methodology for measuring writing development.”
Toward a Psychology of Human Agency
Bandura, A. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00011.x · Cited by 3,459
Chatting about ChatGPT: how may AI and GPT impact academia and libraries?
Lund, B. D., & Wang, T. (2023) · Library Hi Tech News · doi:10.1108/lhtn-01-2023-0009 · Cited by 1,355
Discovering Statistics Using IBM SPSS Statistics: And Sex and Drugs and Rock “N” Roll
(2014) · Pflege · doi:10.1024/1012-5302/a000397 · Cited by 1,224 · cited 1×
“ANOVA is applied using IBM SPSS Statistics 29 to examine differences in argument quality across various groups, following Field's (2009) statistical procedures.”
Chatting about ChatGPT: How May AI and GPT Impact Academia and Libraries?Preprint
Lund, B. D., & Wang, T. (2023) · Social Science Research Network · doi:10.2139/ssrn.4333415 · Cited by 1,093 · cited 2×
“It is however necessary to consider ongoing evaluation and adjustment to ensure they effectively serve both pedagogical objectives and student needs, as emphasized by Lund et al. (2023) in their analysis of AI integration challenges and opportunities in academic settings.”
Hyland, K. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511667251 · Cited by 1,067
Perkins, M. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.02.07 · Cited by 839
Teaching by Principles: An Interactive Approach to Language Pedagogy
Lander, J. A., & Brown, H. D. (1995) · Language · doi:10.2307/415773 · Cited by 826 · cited 1×
“First, as third-year English majors, these students demonstrated the required language proficiency level necessary for engaging in complex argumentative writing tasks (Brown & Lee, 2015).”
Research works printed but not linked: 8
- Creswell, J. W., & Clark, V. L. P. (2017). Designing and conducting mixed methods research. SAGE Publications.
- Etikan, I. (2016). Comparison of convenience sampling and purposive sampling. American Journal of Theoretical and Applied Statistics, 5, 1. https://doi.org/10.11648/j.ajtas.20160501. · doi:10.11648/j.ajtas.20160501
- Mahmood Khan, W. (2024). Analyzing the AI tools' impact on critical thinking in BS English students at Pakistani Universities. Journal of Applied Linguistics and TESOL, 7(4).
- Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook, 2nd ed. (pp. xiv, 338). Sage Publications, Inc.
- Nguyen, T., Lai, N., & Nguyen, Q. (2024). Artificial intelligence (AI) in education: A case study on ChatGPT's influence on student learning behaviors. Educational Process International Journal, 13, 105-121. https://doi.org/10.22521/edupij.2024.132. · doi:10.22521/edupij.2024.132
- Patty, J. (2024). Addressing student writing challenges: A review of difficulties and effective strategies. Education Journal: Journal Educational Research and Development, 8, 369-392. https://doi.org/10.31537/ej.v8i2.1938 · doi:10.31537/ej.v8i2.1938
- Saldana, J. (2013). The coding manual for qualitative researchers (2nd ed.). SAGE Publications Ltd. https://emotrab.ufba.br/wp- content/uploads/2020/09/Saldana-2013- TheCodingManualforQualitativeResearchers.pdf
- Zou, B., & Lertlit, S. (2022). Oxford's strategy inventory for language learning: English learning of Chinese students in Thai University. Language Education and Acquisition Research Network, 15(2), 705-723.
Cited by
Fluency Illusion: A Review on Influence of ChatGPT in Classroom Settings
Kumar, S., Mikayelyan, A., & Vorfolomeyeva, O. (2026) · Information · doi:10.3390/info17030299 · Cited by 11
Perceptions vs. practices: academic integrity and actual ChatGPT use among EFL students
Alsadoon, R. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1796737 · Cited by 8
“Intervention studies have shown that using ChatGPT as a formative feedback tool can enhance writing accuracy, organization, and learner engagement while reducing anxiety (Khampusaen, 2025; Mahapatra, 2024).”
Li, X., & Awang, M. M. B. (2026) · European Journal of Education · doi:10.1111/ejed.70490 · Cited by 7
Zhang, R., Zou, D., Xie, H., & Wang, F. L. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100489 · Cited by 9
Anthony, A., Sharma, S., & Sharma, S. (2025) · Bulletin of Science Technology & Society · doi:10.1177/02704676251353105 · Cited by 12
“ChatGPT has emerged as a powerful academic aid, streamlining tasks like brainstorming, drafting, and editing (Burger et al., 2023; Khampusaen, 2025; Siegerink et al., 2023).”
Metadata
- Authors
- Khampusaen, D.
- Affiliations
- Khon Kaen University (TH)
- Corresponding author
- Khampusaen, Dararat
- ORCID
- Khampusaen, Dararat
- Venue
- LEARN Journal: Language Education and Acquisition Research Network
- Publisher
- Thammasat University
- Published
- 2025-01-31
- Volume
- 18
- Issue
- 1
- Pages
- 963-988
- ISSN
- 2630-0672 (ISSN-L)
- 2672-9431
- OpenAlex
- W4407061908
- Cited by
- 31
- References
- 30
- Citations by year
- 2026: 24 · 2025: 7
- FWCI
- 32.50
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- LEARN Journal : Language Education and Acquisition Research Network (publishedVersion, cc-by)
- Funders
- Khon Kaen University
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › English Language Learning and Teaching
- Keywords
- ChatGPT, AI-assisted writing, argumentative essay writing, EFL writing, academic writing skills, academic integrity, student perceptions of AI, writing development, evidence integration, academic voice, critical thinking, English majors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Impact of ChatGPT on Academic Writing Skills and Knowledge: An Investigation of Its Use in Argumentative Essays. https://app.cochat.ai/papers/10.70730/pgcq9242
- The paper
- Khampusaen, D. (2025). The Impact of ChatGPT on Academic Writing Skills and Knowledge: An Investigation of Its Use in Argumentative Essays. LEARN Journal: Language Education and Acquisition Research Network. https://doi.org/10.70730/pgcq9242
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
