Using AI to Evaluate a Competency-Based Online Writing Course in Nursing
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Nursing education is transitioning from traditional teaching to competency-based education. Additionally, more nursing courses and programs are now offered online. Scholarly writing is a powerful strategy to teach effective communication and critical thinking, both core competencies for safe and effective nursing practice. However, teaching writing online to nursing students is challenging due to a lack of research evaluating best practices, faculty time constraints, and inconsistent writing assessment. Automated essay scoring systems using artificial intelligence (AI) provide new opportunities for efficient, reliable, and valid assessment of writing skills. We used a quasi-experimental design to investigate the impact of a 14-week fully online competency-based writing course on students’ self-efficacy, task value, and writing performance. The participants were master’s nursing students enrolled in an existing one-semester online competency-based writing course for healthcare professionals. An AI-powered writing assessment, IntelliMetric®, and the SAWSES self-efficacy survey were administered pre- and post-intervention. The results showed statistically significant gains in self-efficacy and writing performance with large effect sizes. This study addresses the gap in nursing education regarding the assessment of online, research-based writing interventions on students’ scholarly writing capacity. Recommendations include implementing a required scholarly writing course in all graduate-level nursing programs, scaffolding students’ competency development with the cognitive apprenticeship model, using best practices from composition research to inform online instruction, and employing AI-powered automated essay scoring to evaluate students’ writing progress and instructional efficacy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Psychological Safety and Learning Behavior in Work Teams
Edmondson, A. (1999) · Administrative Science Quarterly · doi:10.2307/2666999 · Cited by 12,026
Cognitive load theory, learning difficulty, and instructional design
Sweller, J. (1994) · Learning and Instruction · doi:10.1016/0959-4752(94)90003-5 · Cited by 3,801
The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring
BLOOM, B. S. (1984) · Educational Researcher · doi:10.3102/0013189x013006004 · Cited by 2,734
The "Academic Literacies" Model: Theory and Applications
Lea, M. R., & Street, B. V. (2006) · Theory Into Practice · doi:10.1207/s15430421tip4504_11 · Cited by 1,223
A capacity theory of writing: Working memory in composition
McCutchen, D. (1996) · Educational Psychology Review · doi:10.1007/bf01464076 · Cited by 654
Ding, H. (2008) · Written Communication · doi:10.1177/0741088307308660 · Cited by 84
Information literacy in science writing: how students find, identify, and use scientific literature
Klucevsek, K. M., & Brungard, A. B. (2016) · International Journal of Science Education · doi:10.1080/09500693.2016.1253120 · Cited by 37
Students' Perceptions of Quality Across Four Course Development Models
Brown, V. S., Lewis, D., & Toussaint, M. (2018) · Online Learning · doi:10.24059/olj.v22i2.1213 · Cited by 20
Cited by
Ba, S., Yang, L., Yan, Z., Looi, C. K., & Gašević, D. (2025) · Computers and Education Open · doi:10.1016/j.caeo.2025.100284 · Cited by 91
Integrating generative AI in university teaching and learning: A model for balanced guidelines
Cacho, R. (2024) · Online Learning · doi:10.24059/olj.v28i3.4508 · Cited by 59
AI Literacy across Curriculum Design: Investigating College Instructor’s Perspectives
Salhab, R. (2024) · Online Learning · doi:10.24059/olj.v28i2.4426 · Cited by 62
Emerging Artificial Intelligence-Based Pedagogies in Didactic Nursing Education: A Scoping Review
Gerdes, M., Bayne, A., Henry, K., Ludwig, B., Stephenson, L., Vance, A., Wessol, J., & Winston, S. (2025) · Nurse Educator · doi:10.1097/nne.0000000000001746 · Cited by 31
Metadata
- Authors
- Wolf, R. R., & Wolf, A.
- Venue
- Online Learning
- Publisher
- The Online Learning Consortium
- Published
- 2023-09-01
- Volume
- 27
- Issue
- 3
- ISSN
- 1092-8235 (ISSN-L)
- 2472-5730
- 2472-5749
- OpenAlex
- W4386555626
- Cited by
- 19
- References
- 8
- FWCI
- 4.38
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.