The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Does ChatGPT Argue Like Students? Bundles in Argumentative Essays
Abstract
The advent of ChatGPT, a novel AI-powered language model able to create grammatically accurate and coherent texts, has generated considerable concern among educationalists anxious about its potential to enable cheating among students and to undermine the development of critical thinking, problem-solving, and literacy skills. The similarities and differences between ChatGPT texts and human writing, however, remain underexplored. This study aims to bridge this gap by comparing the use of 3-word bundles in A-level argumentative essays written by British students with those generated by ChatGPT. Our findings show that ChatGPT essays contain a lower frequency of bundles but these have a higher type/token ratio, suggesting that its bundles are more rigid and formulaic. We also found noun and preposition-based bundles are more prevalent in ChatGPT texts, employed for abstract descriptions and to provide transitional and structuring cues. Student essays are characterized by more epistemic stances and authorial presence, crucial in persuasive argumentation. We attribute these distinct patterns in ChatGPT’s output to its processing of vast training data and underlying statistical algorithms. The study points to pedagogical implications for incorporating ChatGPT in writing instruction.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Longman Grammar of Spoken and Written English
Broussard, K. M., Biber, D., Johansson, S., Leech, G., Conrad, S., & Finegan, E. (2000) · TESOL Quarterly · doi:10.2307/3587792 · Cited by 8,193
The Cambridge Grammar of the English Language
Huddleston, R., & Pullum, G. K. (2002) · Cambridge University Press eBooks · doi:10.1017/9781316423530 · Cited by 4,136
Stance and engagement: a model of interaction in academic discourse
Hyland, K. (2005) · Discourse Studies · doi:10.1177/1461445605050365 · Cited by 1,998
Self-citationChatGPT: five priorities for research
van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023) · Nature · doi:10.1038/d41586-023-00288-7 · Cited by 1,842
If you look at …: Lexical Bundles in University Teaching and Textbooks
Biber, D. (2004) · Applied Linguistics · doi:10.1093/applin/25.3.371 · Cited by 1,539
ChatGPT for Language Teaching and Learning
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023) · RELC Journal · doi:10.1177/00336882231162868 · Cited by 1,371
As can be seen: Lexical bundles and disciplinary variation
Hyland, K. (2008) · English for Specific Purposes · doi:10.1016/j.esp.2007.06.001 · Cited by 1,250
Self-citationGao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00819-6 · Cited by 1,099
An Academic Formulas List: New Methods in Phraseology Research
Simpson-Vlach, R., & Ellis, N. C. (2010) · Applied Linguistics · doi:10.1093/applin/amp058 · Cited by 863
Lexical bundles in published and student disciplinary writing: Examples from history and biology
Cortes, V. (2004) · English for Specific Purposes · doi:10.1016/j.esp.2003.12.001 · Cited by 839
Research works printed but not linked: 4
- Halliday, 1994, Functional grammar
- Hyland, 2005, Metadiscourse
- Murgia, 2023, ‘Generative AI exists because of the transformer,’, Financial Times
- Skrabut, 2023, 80 ways to use ChatGPT in the classroom: Using AI to enhance teaching and learning
Cited by
Li, B., Tan, Y. L., Wang, C., & Lowell, V. L. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100445 · Cited by 285
Do LLMs write like humans? Variation in grammatical and rhetorical styles
Reinhart, A., Markey, B., Laudenbach, M., Pantusen, K., Yurko, R., Weinberg, G., & Brown, D. W. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2422455122 · Cited by 107
Mo, Z., & Crosthwaite, P. R. (2025) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2025.101499 · Cited by 87
Generative AI and Second Language Writing
Li, S. (2025) · Digital studies in language and literature · doi:10.1515/dsll-2025-0007 · Cited by 111
“In direct methods, human writers and GenAI are asked to write essays based on the same prompt, and a corpus analysis is conducted to identify the differences and commonalities between the two sets of essays (Jiang and Hyland 2024).”
InfluentialDoes ChatGPT Write Like a Student? Engagement Markers in Argumentative Essays
Jiang, F. (., & Hyland, K. (2025) · Written Communication · doi:10.1177/07410883251328311 · Cited by 52
“Interestingly, Jiang and Hyland (2024) similarly identified significantly fewer 3-word stance bundles (e.g., it is possible, this never is, in my opinion ) in the ChatGPT essays than used by human writers.”
Self-citationRhetorical distinctions: Comparing metadiscourse in essays by ChatGPT and students
Jiang, F. (., & Hyland, K. (2025) · English for Specific Purposes · doi:10.1016/j.esp.2025.03.001 · Cited by 44
Self-citationGenerative AI and its dilemmas: exploring AI from a translanguaging perspective
Jeon, J., Wei, L., Tai, K. W. H., & Lee, S. (2025) · Applied Linguistics · doi:10.1093/applin/amaf049 · Cited by 60
Metadiscursive nouns in academic argument: ChatGPT vs student practices
Jiang, F. K., & Hyland, K. (2025) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2025.101514 · Cited by 51
Self-citationZhang, M., & Crosthwaite, P. (2026) · International Review of Applied Linguistics in Language Teaching · doi:10.1515/iral-2024-0196 · Cited by 26
“Yet , while studies exploring the nature of GenAI academic vocabulary are now coming to the fore (e.g. Jiang and Hyland 2024), the fi eld still lacks research investigating lexical and collocation di ff erences between texts generated by ChatGPT and human L2 writers.”
InfluentialIdentity and investment in the age of generative AI
Darvin, R. (2025) · Annual Review of Applied Linguistics · doi:10.1017/s0267190525100135 · Cited by 34
“Jiang and Hyland (2024) compared the linguistic features of ChatGPT texts and human writing, while Woo et al. (2024) examined how the use of AI tools in writing an essay affected the way they were marked in terms of content, language, and organization.”
ChatGPT is incredible (at being average)
Rudko, I., & Bonab, A. B. (2025) · Ethics and Information Technology · doi:10.1007/s10676-025-09845-2 · Cited by 32
“More generally, models’ outputs are more rigid and formulaic than human-written texts (Jiang & Hyland, 2024b) and tend to like chatbots—missing the nuances and ironies, obsessed with false precision of saying only what they really want to say, etc.” (Žižek, 2024: p. 178) 12 .”
Lu, D., & Zeng, Y. (2025) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2025.2525341 · Cited by 42
EAP in a changing world: Towards a new research agenda
Jiang, F. K., & Hyland, K. (2026) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2026.101647 · Cited by 22
Self-citationCritical digital literacies, generative AI, and the negotiation of agency in human-AI interactions
Lim, K. Y., & Darvin, R. (2025) · System · doi:10.1016/j.system.2025.103904 · Cited by 35
Huang, L., & Deng, J. (2024) · System · doi:10.1016/j.system.2024.103578 · Cited by 16
Belcher, D. (2024) · Journal of English for Research Publication Purposes · doi:10.1075/jerpp.00025.bel · Cited by 18
EFL teachers and feedback fatigue: AI to the rescue?
Hyland, K. (2025) · Language Teaching · doi:10.1017/s0261444825101018 · Cited by 28
“Research shows that AI generated texts exhibit higher density of content with more noun and preposition-based structures (Herbold et al., 2023; Markey et al., 2024), while human-authored texts contained more clause-related bundles and use of stance markers (Jiang & Hyland, 2024).”
Self-citationZare, J., & Ranjbaran, F. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2569342 · Cited by 11
Liu, T., & Zou, B. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2539160 · Cited by 12
Kashiha, H. (2025) · Journal of Second Language Writing · doi:10.1016/j.jslw.2025.101254 · Cited by 14
Enhancing academic writing in English language education through generative AI integration
Zamorano, C. (2025) · Research Studies in English Language Teaching and Learning · doi:10.62583/rseltl.v3i3.87 · Cited by 13
“This contrast focuses on the contemporary imperative of establishing whether GenAI can approximate the requisite nuance of academic discourse, especially where interdisciplinarity is involved (Jiang & Hyland, 2024; Oh & Lee, 2024).”
InfluentialTomorrowland? Technical Innovation and Feedback on Writing
Hyland, K. (2025) · RELC Journal · doi:10.1177/00336882251357675 · Cited by 15
Self-citationLu, D., & Zeng, Y. (2025) · Language Teaching Research · doi:10.1177/13621688251397578 · Cited by 12
Zhang, R., Zou, D., Xie, H., & Wang, F. L. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100489 · Cited by 9
Taking a stance: AI generated versus student written argumentative essays
Jiang, F. K., & Hyland, K. (2026) · Applied Linguistics Review · doi:10.1515/applirev-2025-0188 · Cited by 12
“This shifts the role of AI from that of surrogate writer to that of rhetorical stimulus, opening space for a richer pedagogy of digital literacy, argumentation, and linguistic awareness in the age of generative language models.”
Self-citationLiu, W., & Liu, X. (2025) · PLoS ONE · doi:10.1371/journal.pone.0329410 · Cited by 8
“Moreover, ChatGPT exhibited lower variation than native speakers in many syntactic complexity measures, suggesting a more rigid and formulaic language style [15].”
InfluentialEngagement strategies in human-written and AI-generated academic essays: A corpus-based study
Alghazo, S. M., Rabab'ah, G. A., El‐Dakhs, D. A. S., & Mustafa, A. (2025) · Ampersand · doi:10.1016/j.amper.2025.100237 · Cited by 17
Multi-criteria linguistic optimization for covert communication in secure LLM-based steganography
Woźniak, K., Ogiela, M. R., & Ogiela, L. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113960 · Cited by 5
Yao, G., & Liu, Z. (2025) · Applied Linguistics · doi:10.1093/applin/amaf064 · Cited by 9
Promotion of medical research: Stance in AI-generated and scholar-written highlights
Zou, H., & Fan, Y. (2025) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2025.101593 · Cited by 5
Reconstructing stance in EFL doctoral thesis writing through generative artificial intelligence
Zhao, W. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-06249-x · Cited by 10
Developing Students’ Statistical Expertise Through Writing in the Age of AI
DeLuca, L. S., Reinhart, A., Weinberg, G., Laudenbach, M., Miller, S., & Brown, D. W. (2025) · Journal of Statistics and Data Science Education · doi:10.1080/26939169.2025.2497547 · Cited by 10
“Whatever the reason, the results that follow are consistent with research showing that LLMs–particularly instruction-tuned LLMs— have prose-generating tendencies that are different from those of humans, generally, and students, specifically (Markey et al. 2024; Jiang and Hyland 2024).”
Kendro, K., Maloney, J., & Jarvis, S. (2026) · International Journal of Applied Linguistics · doi:10.1111/ijal.70115 · Cited by 15
“…Köbis & Mossink, 2021; Wen & Laporte, 2025) as well as systematic linguistic analysis to examine whether there are quantifiable differences between the language that GenAI versus humans produce (Berber Sardinha, 2024; Hamat, 2024; Herbold et al., 2023; Jiang & Hyland, 2024; Reviriego et al., 2024).”
Artificial intelligence and foreign language teaching: problems and solutions
Алексич, Е. В. (2025) · Вестник Тамбовского университета. Серия: Гуманитарные науки · doi:10.20310/1810-0201-2025-30-6-1288-1297 · Cited by 3
Exemplification in ChatGPT and student argumentative writing: A local grammar analysis
Jiang, F. K., & Su, H. (2026) · Linguistics and Education · doi:10.1016/j.linged.2026.101533 · Cited by 4
Self-citationRethinking AI in Writing Pedagogy: From Fluency to Rhetorical Competence
Hyland, K. (2026) · Discourses on Culture · doi:10.2478/doc-2026-0007 · Cited by 3
Self-citationZhang, Y. (2025) · International Journal of Applied Linguistics · doi:10.1111/ijal.70071 · Cited by 3
The AI turn in literacy practices: toward an inclusive educational framework
Jeon, J., Coronel-Molina, S. M., & Lee, S. (2025) · Literacy · doi:10.1111/lit.70018 · Cited by 5
“…sound string of words in complete sentences based on statistical probability, which tends to gravitate toward what is already prevalent in society and is predisposed to replicate formulaic features of mainstream discourse, as empirically shown in research (e.g. Jiang and Hyland, 2025).”
Yao, G., & Liu, Z. (2026) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2026.101640 · Cited by 3
Ngula, R. S., & Seru, L. E. (2026) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2026.101653 · Cited by 1
Liu, L., & Jiang, F. K. (2025) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2025.101537
Self-citationThe University in the World of Spiritual Pursuits Amid Technological Interventions
Lehman, I. M., & Anderson, R. (2025) · Discourses on Culture · doi:10.2478/doc-2025-0001 · Cited by 1
Zhang, Y. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5370249
Metapragmatic acts performed by ChatGPT 4o and human authors in research article (RA) abstracts
Gao, Y., Chen, X., & Zhang, J. (2026) · English for Specific Purposes · doi:10.1016/j.esp.2026.05.007
Language in Digital Academic Discourse
Kuteeva, M. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-95504-1.00822-x
Chatbots as a Field of Inquiry in CALL
Jeon, J., & Lee, S. (2025) · Springer eBooks · doi:10.1007/978-3-031-51447-0_288-1
Almulla, N. (2025) · Open Journal of Modern Linguistics · doi:10.4236/ojml.2025.155044 · Cited by 3
Public responses to Malaysia’s exam abolition policy: a metadiscursive analysis
Rashid, R. A., Al‐Smadi, O. A., & Alqaryouti, M. H. (2025) · Asia Pacific Journal of Education · doi:10.1080/02188791.2025.2587114
Describing Images: Linguistic Signatures of AI and Humans
Litvinova, T., Molchanova, V. A., Dekhnich, O. V., & Seredin, P. V. (2025) · Conference of Open Innovations Association (FRUCT) · doi:10.23919/fruct67853.2025.11239274
Jung, Y., & Kim, K. M. (2025) · Applied Corpus Linguistics · doi:10.1016/j.acorp.2025.100171
Corpus Linguistics and Artificial Intelligence
Sardinha, T. B. (2025) · DELTA Documentação de Estudos em Lingüística Teórica e Aplicada · doi:10.1590/1678-460x202541474063
Deng, L., Li, L., & Gao, X. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5957105
Deng, L., Li, L., & Gao, X. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5957106
Li, J. (2026) · International Journal of Applied Linguistics · doi:10.1111/ijal.70096
Kong, L., & Wang, J. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-13048-8_13 · Cited by 1
Li, J., & Guo, Z. (2026) · IRAL - International Review of Applied Linguistics in Language Teaching · doi:10.1515/iral-2025-0197
“Jiang and Hyland (2024) compared trigrams in A-level argumentative essays written by British students with those generated by ChatGPT.”
Alhajailan, D. (2026) · World Journal of English Language · doi:10.2139/ssrn.6253748
Tran, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6512707
Text features associated with students’ generative AI use: Norwegian teachers’ perspectives
Jeffery, J. V., Skar, G. B. U., Kvistad, A. H., & Graham, S. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1792351
Deng, L., Li, L., & Gao, X. (2026) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2026.101731
Qiu, W., & Pan, F. (2026) · Scientometrics · doi:10.1007/s11192-026-05701-2 · Cited by 2
“…argumentative essays have been reported to have higher levels of lexical diversity, syntactic complexity, grammatical accuracy, and cohesion density, compared with student-written essays (e.g., Goulart et al., 2024; Herbold et al., 2023; Jiang & Hyland, 2024; Wu, 2025; Zhang & Crosthwaite, 2025).”
InfluentialMaking Students “Safe” Writers with the SAFE Model in the Age of AI
Nuthihar, R., Anshori, D. S., Cahyani, I., & Sastromiharjo, A. (2026) · Discourses on Culture · doi:10.2478/doc-2026-0008
Jing, Q., & Liu, Y. (2026) · Written Communication · doi:10.1177/07410883261461562
Fan, L., Cheung, A., Li, Y., Li, S., & Liu, W. (2026) · Research Square · doi:10.21203/rs.3.rs-7135863/v1
Towards an Understanding of the Notion of Genre
Yu, H. (2026) · The M. A. K. Halliday library functional linguistics series · doi:10.1007/978-981-95-8632-5_2
Ethical AI use is contextual: focus group insights on students’ decision-making in academic work
Chong, S. L., Balajee, V., & Lee, E. H. (2026) · AI & Society · doi:10.1007/s00146-026-03237-w
Crosthwaite, P. R., Sun, S. A., & Jiang, F. K. (2026) · Modern Language Journal · doi:10.1111/modl.70089 · Cited by 1
Self-citationWho is mimicking whom? The mutual shaping effect between AI and college students’ English writing
Qin, X. (2026) · Computer Assisted Language Learning · doi:10.1080/09588221.2026.2723281
Barabadi, E., Arghavan, A., Fotuhabadi, Z., et al. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7446708
AI-generated lectures for academic listening assessments: Insights from multi-dimensional analysis
Göktürk, N. (2026) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2026.101784
Zhao, H., & Ji, J. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1904852 · Cited by 1
Jiang, F. K. (2026) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.25027.jia
Self-citation
Metadata
- Authors
- Jiang, F. (., & Hyland, K.
- Affiliations
- Jilin University (CN)
- University of East Anglia (GB)
- Corresponding author
- Jiang, Feng (Kevin)
- Venue
- Applied Linguistics
- Publisher
- Oxford University Press (OUP)
- Published
- 2024-08-20
- Volume
- 46
- Issue
- 3
- Pages
- 375-391
- ISSN
- 0142-6001 (ISSN-L)
- 1477-450X
- OpenAlex
- W4401976536
- Cited by
- 76
- References
- 37
- Citations by year
- 2026: 31 · 2025: 43 · 2024: 2
- FWCI
- 341.72
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Applied Linguistics (publishedVersion)
- UEA Digital Repository (University of East Anglia) (submittedVersion)
- Topics
- Social Sciences › Linguistics and Language › Discourse Analysis in Language Studies
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Keywords
- ChatGPT, argumentative essay, student writing, AI-generated text, type-token ratio, epistemic stance, authorial presence, persuasive argumentation, writing instruction, formulaic language
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.