Writing with AI: What College Students Learned from Utilizing ChatGPT for a Writing Assignment
Open accessThe DOI matches its Crossref record; 30 of the 33 references it cites were found in a registry or an index, and 3 are not checked yet.
Abstract
To support the integration of AI in education, this empirical study investigated what lessons college students learned from using Generative AI for writing. We recruited 47 students in the United States from a university writing course. Students completed an assignment in which they used Generative AI tools (e.g., ChatGPT) to draft an application letter or personal statement. Data were collected using a survey of five open-ended questions about their writing process, what worked, what did not work, how to better write with AI, and general lessons learned. We applied thematic analysis and sentiment analysis methods to analyze students’ responses. Results show that (1) students went through multiple rounds of prompting; (2) students identified strengths of AI, such as connection to topic, template generation, and sentence quality; (3) the weaknesses of AI included general language, robotic tone and lacking emotion, lacking personal voice, and lacking critical thinking; (4) students wished to improve AI-generated writing by adding personal stories, connections to posting, feelings and thoughts, and deleting repetitive language; and (5) their overall attitudes toward AI tool were positive. We believe our findings can help relieve some concerns about cheating with AI. We also suggested strategies to regulate the use of AI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior studies have demonstrated that AI tools are increasingly embedded in students' academic workflows, supporting activities such as drafting, revising, summarising, and idea generation (Dempere et al., 2023;Wang et al., 2024).”
From Academic Integrity and Assessment Design in the Era of Generative AI: Perspectives from Vietnamese Universities (2026) · cites this paper as Wang et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The literature suggests that with AI, the function of the writer is being transformed from a producer to an editor or curator of AI-generated content [14, 6].”
From Generative AI and Cognitive Offloading in Higher Education: Implications for Learning, Knowledge Production, and Academic Thinking (2026) · cites this paper as [6]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Instead of independently building arguments or synthesizing a variety of sources, students may be increasingly using AI to create initial outlines, propose relevant information, or write summaries [6, 7].”
From Generative AI and Cognitive Offloading in Higher Education: Implications for Learning, Knowledge Production, and Academic Thinking (2026) · cites this paper as [6]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In particular, in writing-based courses, AI can help with drafting, improving organization and flow of documents, rewording, and responding to prompts within a specific subject area. It can also synthesize a wide variety of documents, offer recommendations for improved conceptual frameworks, and help shift academic work from being refined to being approached differently across the composition, syn”
From Generative AI and Cognitive Offloading in Higher Education: Implications for Learning, Knowledge Production, and Academic Thinking (2026) · cites this paper as [6]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087 · cited 1×
“Our findings can help relieve some concerns about cheating in writing [31,32].”
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
A survey on sentiment analysis methods, applications, and challenges
Wankhade, M., Rao, A. C. S., & Kulkarni, C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10144-1 · Cited by 1,528 · cited 1×
“For Research Question 5, we applied sentiment analysis to students’ responses to the fifth survey question from the Lexicon-based approach [26–28].”
ChatGPT for Language Teaching and Learning
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023) · RELC Journal · doi:10.1177/00336882231162868 · Cited by 1,371 · cited 2×
“The weakness of being too general and repetitive in our findings was also summarized by Kohnke and colleagues [16].”
Strzelecki, A. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2209881 · Cited by 807 · cited 1×
“For example, Strz-elecki [12] conducted a survey on Polish college students’ acceptance and use of ChatGPT; he found that the top three predictors of students’ intention to use ChatGPT are habit, performance expectancy, and hedonic motivation.”
Guidelines for establishing reliability when coding narrative data
Syed, M., & Nelson, S. C. (2015) · Emerging Adulthood · doi:10.1177/2167696815587648 · Cited by 801 · cited 1×
“We started from Q2 and went through 2 iterations of independent coding, comparing results, discussing inconsistencies, and clarifying the coding scheme, until we reached a satisfactory percent agreement [25].”
Prompt Engineering with ChatGPT: A Guide for Academic Writers
Giray, L. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03272-4 · Cited by 776 · cited 1×
“From students’ responses, we know that prompting is an important skill for students to write with AI tools, which is aligned with the rising recognition of prompt engineering [34].”
Song, C., & Song, Y. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1260843 · Cited by 717 · cited 2×
“Regarding the weaknesses, students in [22] also pointed out in interviews that ChatGPT was limited in contextual accuracy and personal writing style, which are like “lacking personal voice” in our findings.”
Impact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation
Yan, D. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11742-4 · Cited by 713 · cited 2×
“Regarding the strengths, students in our study identified the strengths of ChatGPT in always generating good writing templates, which occurred as generally good quality in [21].”
ChatGPT in education: Strategies for responsible implementation
Halaweh, M. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13036 · Cited by 607 · cited 2×
“Students’ positive attitude seems to conflict with the concerning attitude held by many educators and researchers [9,10,15].”
Cited by
Exploring the influence of ChatGPT on student academic success and career readiness
Dahri, N. A., Yahaya, N., & Al-Rahmi, W. M. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13148-2 · Cited by 81
“These findings align with (Humlum & Vestergaard, 2024; Osman, 2024; Wang et al., 2024) who argue that academic achievements foster vital attributes such as confidence, self-efficacy, and readiness for professional roles.”
Wang, L., & Ren, B. (2024) · Education Sciences · doi:10.3390/educsci14121329 · Cited by 38
Peng, J., & Li, Y. (2025) · Applied Sciences · doi:10.3390/app151810096 · Cited by 93
Li, C. G., Cui, H., & Hagedorn, L. S. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100571 · Cited by 103
Galindo‐Domínguez, H., Delgado, N., de la Maza, M. S., & Urbieta, J. M. E. (2026) · Computers in Human Behavior · doi:10.1016/j.chb.2026.108985 · Cited by 35
Reimagining libraries in the AI era: ethical AI literacy and human-centered strategies
Michalak, R., & Ellixson, D. (2026) · AI & Society · doi:10.1007/s00146-025-02827-4 · Cited by 18
“As highlighted by experts in the evolving AI landscape for 2025, three areas of impact emerge: teaching and learning; AI literacy and career readiness; and operations and decision-making (Kelly 2025); Wang et al. (2024).”
Rafi, M. A. A., & Amjad, I. (2025) · Discover Education · doi:10.1007/s44217-025-00503-9 · Cited by 25
“Wang et al. [15] bring another layer to this discussion that AI can enhance writing processes but also risks promoting overdependence.”
Exploring the GenAI Literacy of Chinese University Students in EFL Learning
Li, T., & Ding, Y. (2025) · International Journal of Computer-Assisted Language Learning and Teaching · doi:10.4018/ijcallt.377175 · Cited by 12
“By reducing GenAI to a passive resource akin to a library, students may overlook its potential to foster emotional engagement (Wang et al., 2024b; Yin et al., 2024).”
InfluentialAlnsour, M. M., Almomani, H., Qouzah, L., Momani, M. Q. M., Alamoush, R. A., & AL-Omiri, M. K. (2025) · International Journal for Educational Integrity · doi:10.1007/s40979-025-00206-6 · Cited by 12
Sitepu, M. S., Prasojo, L. D., Hermanto, H., Salido, A., Nurhakim, L. I., Setyorini, E., Disnawati, H., & Wiratsongko, B. (2025) · European Journal of Educational Research · doi:10.12973/eu-jer.15.1.305 · Cited by 16
Teaching Innovation with AI Assistants: Application and Impact Evaluation in Biochemistry Education
Wang, Y., Cheng, G., Ding, B., & Zhao, J. Y. (2025) · Frontiers of digital education. · doi:10.1007/s44366-025-0047-x · Cited by 5
“Many pupils lack a comprehensive understanding of AI’s capabilities, often perceiving it as a study instrument rather than leveraging its unique cognitive and analytical potential (Wang et al., 2024).”
Yusof, I. J., Ashari, Z. M., Ismail, L. H., & Panadi, M. (2025) · BenchCouncil Transactions on Benchmarks Standards and Evaluations · doi:10.1016/j.tbench.2025.100254 · Cited by 3
Zhang, H., & Jiang, R. (2026) · Education and Information Technologies · doi:10.1007/s10639-026-14026-9 · Cited by 6
“However, once AI dependency becomes high, the dominant demand may shift from task completion to oversight of outputs, including monitoring, verifying, and aligning generated content to meet task requirements and quality standards (Wang et al., 2024 ).”
Fogle, E. V., Stephens, L. E., & Reed, K. B. (2025) · Journal of Hospitality & Tourism Education · doi:10.1080/10963758.2025.2558682 · Cited by 3
“Although writing apprehension among undergraduate students has been well researched by numerous scholars (Graham et al., 2024; Sala-Bubaré & Castello, 2018; Wang et al., 2024), writing capacity among students in higher education has become a growing concern.”
InfluentialDuc, T. M. (2026) · European Journal of Applied Science, Engineering and Technology · doi:10.59324/ejaset.2026.4(3).06 · Cited by 2
Kayadibi, S. Y. (2026) · Education Sciences · doi:10.3390/educsci16060832 · Cited by 7
“Related work has also highlighted the need for stronger quantitative analysis of what students actually gain from AI-supported learning tasks (Wang et al., 2024).”
The Impact of Chatbot-Supported Self-Regulation Learning Strategies on Second Language Writing
Eryılmaz, R. (2026) · Dil Eğitimi ve Araştırmaları Dergisi · doi:10.31464/jlere.1721342 · Cited by 1
Zhang‐Wu, Q. (2026) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2026.102983 · Cited by 4
Brynildsen, S. M. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1767132 · Cited by 4
University Students’ Perceptions of Artificial Intelligence-Based Tools Beyond Text Generation
Marchetti, E., Frandsen, T. F., & Sandu, D.-A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-13153-9_4 · Cited by 1
Papanastasiou, E. C., Pittas, E., Rodosthenous-Balafa, M., & Λαμπρόπουλος, Γ. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100603 · Cited by 4
An Exploratory Cross-National Study of K–12 Teachers’ Generative AI Literacy and Classroom Enactment
Xiu, R. L., Aguilar, S. J., Macias, A. J., Xing, Y., Al-Sulaiti, R., Junjunia, M., & Jebril, S. T. (2026) · Education Sciences · doi:10.3390/educsci16050811 · Cited by 2
“At the same time, GenAI increases uncertainty about academic integrity, misinformation, data privacy, and the erosion of student voice (Gruenhagen et al., 2024; Wang et al., 2024).”
Self-citationFirst-Year College Students: Perspectives on Technology and Wellness in Education
Fontenelle-Tereshchuk, D. (2025) · Trends in Higher Education · doi:10.3390/higheredu4010013 · Cited by 1
“However, some studies suggest that focusing on students’ effective learning experiences and technology literacy may guide further practices and policies to regulate and utilize AI technology for education purposes [16,32,34,35].”
InfluentialTran Minh, D. (2026) · Futurity Education · doi:10.57125/fed.2026.06.05
“Prior studies have demonstrated that AI tools are increasingly embedded in students’ academic workflows, supporting activities such as drafting, revising, summarising, and idea generation (Dempere et al., 2023; Wang et al., 2024).”
Research on AI Application in English Writing Instruction
Wang, W. (2025) · Lecture Notes in Education Psychology and Public Media · doi:10.54254/2753-7048/2025.cb23805
Gao, Y. (2025) · Research Square · doi:10.21203/rs.3.rs-7311807/v1
Santos, R. S. D., Jr., & Tulud, D. M. (2025) · Journal of Basic Education Research · doi:10.37251/jber.v6i3.1823
“(IDI4) Meanwhile, the study of Wang et al. [70] noted the importance of enhancing AI-generated content by replacing robotic language with relatable expressions, adding personal anecdotes and emotions to foster connection, and tailoring content to the readers' perspectives.”
Open-Ended Questions: Enhancing Writing and Learning Processes
Fisher, J. (2025) · Journal of Applied Learning in Higher Education · doi:10.57186/jalhe_2025_a7p75-94
The convenience trap: How AI could hinder creativity in education
Worwood, M. J. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-34073-4.00024-1 · Cited by 1
Tovar, L. C. Á., González, G. R., Rogel, E. G., González, Á. E. R., & Escamilla-García, P. E. (2025) · Etic net Revista científica electrónica de Educación y Comunicación en la Sociedad del Conocimiento · doi:10.30827/eticanet.v25i2.31946
“31946 administrative duties (Chan & Hu, 2023), enhancing learning (Tossell et al., 2024), language translation (Xiao & Zhi, 2023), academic writing (Wang et al., 2024; Zhao et al., 2024) and solving complex problems (Hasanein & Sobaih, 2023; Urban et al., 2024).”
Random Knowledge Verification as a Scalable Assessment Strategy in AI Rich Higher EducationPreprint
Duc, T. M. (2026) · Research Square · doi:10.21203/rs.3.rs-9103013/v1
The Reflective Writer: Leveraging AI Feedback in Graduate Nursing Education
Paunan, C. (2026) · Journal of Nursing Education · doi:10.3928/01484834-20260409-03
Lu, Y., & Jia, C. (2026) · Computer Assisted Language Learning · doi:10.1080/09588221.2026.2665351 · Cited by 1
Cummins, L. K., Bedford, L., & Crowe, D. (2026) · Journal of Online Graduate Education · doi:10.65201/001c.161741 · Cited by 1
Why Write in the Age of AI: Rethinking Human Voice and Agency in Algorithmic CulturePreprint
Nikitina, S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6922888
Higher Education Assessment in the Age of Generative AI: A Fairness Framework
Daemen, J., Poamă, A., Evans, K., Belić, J., Lee, J. Y., Mokrosińska, D., Jong, M. S.-D., & Theuns, T. (2026) · Oxford University Press eBooks · doi:10.1093/9780198945215.003.0259
AI overuse in education extending the technology acceptance model with Confucian cultural moderation
Li, J., Huang, L., & Furuoka, F. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1813693 · Cited by 2
“Nevertheless, the sudden normalisation of writing aids provided by AI has also raised public anxiety regarding over-reliance (Yankouskaya et al., 2025), particularly within academia in which writing is associated with professional authority and intellectual integrity (Wang et al., 2024).”
Bailey, D., Byrne, J., He, H., McConnell, J. R., & Bruster, B. G. (2026) · Technology Knowledge and Learning · doi:10.1007/s10758-026-10017-4
He, M. (2026) · Higher education and practice. · doi:10.62381/h261604
Generative AI Chatbots in Writing Education (2023–2025): A Systematic Review of Research
Alhadiah, A. (2026) · SAGE Open · doi:10.1177/21582440261487273
Student Use of and Views on GenAI for Writing
Kuznetsov, A., Sheely, A., & Baker, J. (2026) · Teaching Sociology · doi:10.1177/0092055x261478622
Senali, M. G. (2026) · Education and Information Technologies · doi:10.1007/s10639-026-14145-3 · Cited by 1
“Many HE institutions have updated their academic integrity policies to align with the rapid advancements in AI writing tools (Alsharefeen & Al Sayari, 2025) and many institutions now require students to declare AI use (Wang et al., 2024 ).”
Reimagining Writing Pedagogy with ChatGPT: Expanding Pedagogical Possibilities and Learning Outcomes
Jeikner, A. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-39103-2_10
Galindo‐Domínguez, H., Campo, L., Delgado, N., & Urruzola, M. V. (2026) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2026.102385
Li, J., & O’Reilly, K. (2026) · The Open/Technology in Education Society and Scholarship Association Journal · doi:10.18357/otessaj.2026.6.1.118
“…studies have shown that most students had positive reactions to the use of these tools in writing (e.g., Chan & Hu, 2023; Jin et al., 2024; Wang et al., 2024), an increasing number of scholars have expressed concerns over the performance issues of GenAI tools and the potential risks they…”
Greene, J. E. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7624525
Wittstock, S., Reifman, J. B., Marino, A., Tolman, E., Goldstein, O., & Moock, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7634293
Students’ strategies for revising AI-assisted writing: towards a conceptual framework
Lamichhane, Y. R. (2026) · Cogent Education · doi:10.1080/2331186x.2026.2746221
When Writing Is Worth the Risk
Klein, S. (2026) · Pedagogy Critical Approaches to Teaching Literature Language Composition and Culture · doi:10.1215/15314200-12542789
Metadata
- Authors
- Wang, C., Aguilar, S. J., Bankard, J. S., Bui, E., & Nye, B.
- Affiliations
- University of Southern California (US)
- Corresponding author
- Wang, Changzhao
- Venue
- Education Sciences
- Publisher
- MDPI AG
- Published
- 2024-09-04
- Volume
- 14
- Issue
- 9
- Pages
- 976
- ISSN
- 2227-7102 (ISSN-L)
- OpenAlex
- W4402226845
- Cited by
- 49
- References
- 28
- Citations by year
- 2026: 32 · 2025: 15 · 2024: 2
- FWCI
- 18.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Education Sciences (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- University of Southern California
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- generative AI in education, ChatGPT, university students, student perceptions, AI-assisted writing, cover letters, personal statements, prompting strategies, AI-generated text quality, student attitudes toward AI, academic integrity, AI regulation in education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.