ChatGPT for Automated Writing Evaluation in Scholarly Writing Instruction
The DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index.
Abstract
Background: Effective strategies for developing scholarly writing skills in postsecondary nursing students are needed. Generative artificial intelligence (GAI) tools, such as ChatGPT, for automated writing evaluation (AWE) hold promise for mitigating challenges associated with scholarly writing instruction in nursing education. This article explores the suitability of ChatGPT for AWE in writing instruction. Method: ChatGPT feedback on 42 nursing student texts from the Michigan Corpus of Upper-Level Student Papers was assessed. Assessment criteria were derived from recent AWE research. Results: ChatGPT demonstrated utility as an AWE tool. Its scoring performance demonstrated stricter grading than human raters, related feedback to macro-level writing features, and supported multiple submissions and learner autonomy. Conclusion: Despite concerns surrounding GAI in academia, educators can accelerate the feedback process without increasing their workload, and students can receive individualized feedback by incorporating AWE provided by ChatGPT into the writing process. [ J Nurs Educ . 2023;62(12):721–727.]
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Primary studies featured small sample sizes and lacked standardised evaluation methods”
From Patterns, advances, and gaps in using ChatGPT and similar technologies in nursing education: A PAGER scoping review (2025) · cites this paper as Parker et al., 2023
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
ChatGPT: five priorities for research
van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023) · Nature · doi:10.1038/d41586-023-00288-7 · Cited by 1,842
ChatGPT is fun, but not an author
Thorp, H. H. (2023) · Science · doi:10.1126/science.adg7879 · Cited by 1,437
Complexity, accuracy and fluency in second language acquisition
Housen, A., & Kuiken, F. (2009) · Applied Linguistics · doi:10.1093/applin/amp048 · Cited by 863
Eysenbach, G. (2023) · JMIR Medical Education · doi:10.2196/46885 · Cited by 840
Introduction: Investigating Form‐Focused Instruction
Ellis, R. (2001) · Language Learning · doi:10.1111/j.1467-1770.2001.tb00013.x · Cited by 826
ChatGPT: the future of discharge summaries?
Patel, S. B., & Lam, K. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00021-3 · Cited by 728
Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse?
O’Connor, S., & ChatGPT (2023) · Nurse Education in Practice · doi:10.1016/j.nepr.2022.103537 · Cited by 585
Research works printed but not linked: 4
- Adams, D., & Chuah, K.-M. (2023). Artificial intelligence based tools in research writing: Current trends and future potentials. In Churi P. P., Joshi S., Elhoseny M., & Omrane A., (Eds.).Artificial intelligence in higher education: A practical approach. CRC Press.
- American Association of Colleges of Nursing. (2021). The essentials: Core competencies for professional nursing education. https://www.aacnnursing.org/Portals/42/AcademicNursing/pdf/Essentials-2021.pdf
- Attali, Y. & Burstein, J. (2006). Automated essay scoring with e-rater® V.2. The Journal of Technology, Learning and Assessment, 4(3). https://ejournals.bc.edu/index.php/jtla/article/view/1650/1492
- Madson, M. J. (Ed.). (2022). Teaching writing in the health professions: Perspectives, problems, and practices. Routledge.
Cited by
Generative AI in education and research: A systematic mapping review
Yusuf, A., Pervin, N., Román‐González, M., & Noor, N. M. (2024) · Review of Education · doi:10.1002/rev3.3489 · Cited by 182
Bui, N. M., & Barrot, J. S. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-12891-w · Cited by 113
“Similar results were reported by Parker et al. (2023), who examined 42 essays produced by nursing students.”
InfluentialNegotiating Meaning with Machines: AI’s Role in Doctoral Writing Pedagogy
Parker, J. L., Richard, V. M., Acabá, A., Escoffier, S., Flaherty, S., Jablonka, S., & Becker, K. P. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00425-x · Cited by 96
“3 Unlike these tools, ChatGPT functions as a conversational agent capable of engaging in extended dialogues while preserving the context throughout the interaction (Parker et al., 2023).”
Self-citationGozali, I., Wijaya, A. R. T., Lie, A., Cahyono, B. Y., & Suryati, N. (2024) · The JALT CALL Journal · doi:10.29140/jaltcall.v20n1.1200 · Cited by 96
Exploratory study on the potential of ChatGPT as a rater of second language writing
Shin, D., & Lee, J. H. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12817-6 · Cited by 82
“Indeed, recent studies (e.g. Escalante et al., 2023; Guo & Wang, 2023; Parker et al., 2023) have started to demonstrate its utility for this purpose by comparing feedback and scoring from human teachers and ChatGPT.”
Metadata
- Authors
- Parker, J. L., Becker, K., & Carroca, C.
- Affiliations
- Massachusetts College of Pharmacy and Health Sciences (US)
- ORCID
- Becker, Kimberly
- Venue
- Journal of Nursing Education
- Publisher
- SLACK, Inc.
- Published
- 2023-12
- Volume
- 62
- Issue
- 12
- Pages
- 721-727
- ISSN
- 0148-4834 (ISSN-L)
- 1938-2421
- OpenAlex
- W4389322683
- Cited by
- 77
- References
- 49
- Citations by year
- 2026: 21 · 2025: 32 · 2024: 22 · 2023: 2
- FWCI
- 18.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Nursing Education (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Student Assessment and Feedback
- Keywords
- ChatGPT, automated writing evaluation, nursing students, generative AI, AI-generated feedback, learner autonomy
- MeSH terms
- Artificial Intelligence, Education, Nursing, Feedback, Humans, Students, Nursing, Writing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ChatGPT for Automated Writing Evaluation in Scholarly Writing Instruction. https://app.cochat.ai/papers/10.3928/01484834-20231006-02
- The paper
- Parker, J. L., Becker, K., & Carroca, C. (2023). ChatGPT for Automated Writing Evaluation in Scholarly Writing Instruction. Journal of Nursing Education. https://doi.org/10.3928/01484834-20231006-02
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.