The DOI matches its Crossref record; 30 of the 33 references it cites were found in a registry or an index, and 3 are not checked yet.
Writing with AI: What College Students Learned from Utilizing ChatGPT for a Writing Assignment
Open accessAbstract
To support the integration of AI in education, this empirical study investigated what lessons college students learned from using Generative AI for writing. We recruited 47 students in the United States from a university writing course. Students completed an assignment in which they used Generative AI tools (e.g., ChatGPT) to draft an application letter or personal statement. Data were collected using a survey of five open-ended questions about their writing process, what worked, what did not work, how to better write with AI, and general lessons learned. We applied thematic analysis and sentiment analysis methods to analyze students’ responses. Results show that (1) students went through multiple rounds of prompting; (2) students identified strengths of AI, such as connection to topic, template generation, and sentence quality; (3) the weaknesses of AI included general language, robotic tone and lacking emotion, lacking personal voice, and lacking critical thinking; (4) students wished to improve AI-generated writing by adding personal stories, connections to posting, feelings and thoughts, and deleting repetitive language; and (5) their overall attitudes toward AI tool were positive. We believe our findings can help relieve some concerns about cheating with AI. We also suggested strategies to regulate the use of AI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior studies have demonstrated that AI tools are increasingly embedded in students' academic workflows, supporting activities such as drafting, revising, summarising, and idea generation (Dempere et al., 2023;Wang et al., 2024).”
From Academic Integrity and Assessment Design in the Era of Generative AI: Perspectives from Vietnamese Universities (2026) · cites this paper as Wang et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The literature suggests that with AI, the function of the writer is being transformed from a producer to an editor or curator of AI-generated content [14, 6].”
From Generative AI and Cognitive Offloading in Higher Education: Implications for Learning, Knowledge Production, and Academic Thinking (2026) · cites this paper as [6]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Instead of independently building arguments or synthesizing a variety of sources, students may be increasingly using AI to create initial outlines, propose relevant information, or write summaries [6, 7].”
From Generative AI and Cognitive Offloading in Higher Education: Implications for Learning, Knowledge Production, and Academic Thinking (2026) · cites this paper as [6]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In particular, in writing-based courses, AI can help with drafting, improving organization and flow of documents, rewording, and responding to prompts within a specific subject area. It can also synthesize a wide variety of documents, offer recommendations for improved conceptual frameworks, and help shift academic work from being refined to being approached differently across the composition, syn”
From Generative AI and Cognitive Offloading in Higher Education: Implications for Learning, Knowledge Production, and Academic Thinking (2026) · cites this paper as [6]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087 · cited 1×
“Our findings can help relieve some concerns about cheating in writing [31,32].”
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
A survey on sentiment analysis methods, applications, and challenges
Wankhade, M., Rao, A. C. S., & Kulkarni, C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10144-1 · Cited by 1,528 · cited 1×
“For Research Question 5, we applied sentiment analysis to students’ responses to the fifth survey question from the Lexicon-based approach [26–28].”
ChatGPT for Language Teaching and Learning
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023) · RELC Journal · doi:10.1177/00336882231162868 · Cited by 1,371 · cited 2×
“The weakness of being too general and repetitive in our findings was also summarized by Kohnke and colleagues [16].”
Strzelecki, A. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2209881 · Cited by 807 · cited 1×
“For example, Strz-elecki [12] conducted a survey on Polish college students’ acceptance and use of ChatGPT; he found that the top three predictors of students’ intention to use ChatGPT are habit, performance expectancy, and hedonic motivation.”
Guidelines for establishing reliability when coding narrative data
Syed, M., & Nelson, S. C. (2015) · Emerging Adulthood · doi:10.1177/2167696815587648 · Cited by 801 · cited 1×
“We started from Q2 and went through 2 iterations of independent coding, comparing results, discussing inconsistencies, and clarifying the coding scheme, until we reached a satisfactory percent agreement [25].”
Prompt Engineering with ChatGPT: A Guide for Academic Writers
Giray, L. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03272-4 · Cited by 776 · cited 1×
“From students’ responses, we know that prompting is an important skill for students to write with AI tools, which is aligned with the rising recognition of prompt engineering [34].”
Song, C., & Song, Y. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1260843 · Cited by 717 · cited 2×
“Regarding the weaknesses, students in [22] also pointed out in interviews that ChatGPT was limited in contextual accuracy and personal writing style, which are like “lacking personal voice” in our findings.”
Impact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation
Yan, D. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11742-4 · Cited by 713 · cited 2×
“Regarding the strengths, students in our study identified the strengths of ChatGPT in always generating good writing templates, which occurred as generally good quality in [21].”
ChatGPT in education: Strategies for responsible implementation
Halaweh, M. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13036 · Cited by 607 · cited 2×
“Students’ positive attitude seems to conflict with the concerning attitude held by many educators and researchers [9,10,15].”
Cited by
Exploring the influence of ChatGPT on student academic success and career readiness
Dahri, N. A., Yahaya, N., & Al-Rahmi, W. M. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13148-2 · Cited by 81
“These findings align with (Humlum & Vestergaard, 2024; Osman, 2024; Wang et al., 2024) who argue that academic achievements foster vital attributes such as confidence, self-efficacy, and readiness for professional roles.”
Wang, L., & Ren, B. (2024) · Education Sciences · doi:10.3390/educsci14121329 · Cited by 38
Peng, J., & Li, Y. (2025) · Applied Sciences · doi:10.3390/app151810096 · Cited by 93
Li, C. G., Cui, H., & Hagedorn, L. S. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100571 · Cited by 103
Galindo‐Domínguez, H., Delgado, N., de la Maza, M. S., & Urbieta, J. M. E. (2026) · Computers in Human Behavior · doi:10.1016/j.chb.2026.108985 · Cited by 34
Metadata
- Authors
- Wang, C., Aguilar, S. J., Bankard, J. S., Bui, E., & Nye, B.
- Affiliations
- University of Southern California (US)
- Corresponding author
- Wang, Changzhao
- Venue
- Education Sciences
- Publisher
- MDPI AG
- Published
- 2024-09-04
- Volume
- 14
- Issue
- 9
- Pages
- 976
- ISSN
- 2227-7102 (ISSN-L)
- OpenAlex
- W4402226845
- Cited by
- 49
- References
- 28
- Citations by year
- 2026: 32 · 2025: 15 · 2024: 2
- FWCI
- 18.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Education Sciences (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- University of Southern California
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- generative AI in education, ChatGPT, university students, student perceptions, AI-assisted writing, cover letters, personal statements, prompting strategies, AI-generated text quality, student attitudes toward AI, academic integrity, AI regulation in education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Writing with AI: What College Students Learned from Utilizing ChatGPT for a Writing Assignment. https://app.cochat.ai/papers/10.3390/educsci14090976
- The paper
- Wang, C., Aguilar, S. J., Bankard, J. S., Bui, E., & Nye, B. (2024). Writing with AI: What College Students Learned from Utilizing ChatGPT for a Writing Assignment. Education Sciences. https://doi.org/10.3390/educsci14090976
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.