Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework
Open accessThe DOI matches its Crossref record; 12 of the 32 references it cites were found in a registry or an index, and 1 are not checked yet; 3 of the 46 sources its claims cite were checked for support.
Abstract
Background Generative artificial intelligence (AI) tools may soon be integrated into health care practice and research. Nurses in leadership roles, many of whom are doctorally prepared, will need to determine whether and how to integrate them in a safe and useful way. Objective This study aimed to develop and evaluate a brief intervention to increase PhD nursing students' knowledge of appropriate applications for using generative AI tools in health care. Methods We created didactic lectures and laboratory-based activities to introduce generative AI to students enrolled in a nursing PhD data science and visualization course. Students were provided with a subscription to Chat Generative Pretrained Transformer (ChatGPT) 4.0, a general-purpose generative AI tool, for use in and outside the class. During the didactic portion, we described generative AI and its current and potential future applications in health care, including examples of appropriate and inappropriate applications. In the laboratory sessions, students were given three tasks representing different use cases of generative AI in health care practice and research (clinical decision support, patient decision support, and scientific communication) and asked to engage with ChatGPT on each. Students (n = 10) independently wrote a brief reflection for each task evaluating safety (accuracy, hallucinations) and usability (ease of use, usefulness, and intention to use in the future). Reflections were analyzed using directed content analysis. Results Students were able to identify the strengths and limitations of ChatGPT in completing all three tasks and developed opinions on whether they would feel comfortable using ChatGPT for similar tasks in the future. All of them reported increasing their self-rated competency in generative AI by one to two points on a five-point rating scale. Conclusion This brief educational intervention supported doctoral nursing students in understanding the appropriate uses of ChatGPT, which may support their ability to appraise and use these tools in their future work.
Verified 2026-10-06 · 1 reference not checked yet
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 3 Not valid · 29 Not checked · 63 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Given the novelty of ChatGPT and generative AI in health care, few educational interventions have been developed to prepare nurses for this new era.18”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Background and Significance
What the sources say
- Could not verifycites [18] matched to “Competency in nursing practice: a concept analysis” (2023) sourceExperimental — accuracy not yet measured
Our copy of Mrayyan et al. (2023) is a Walker-and-Avant concept analysis of 'competency in nursing practice' and never addresses ChatGPT, generative AI or AI-specific educational interventions. Its Discussion > Implications of the findings and Introduction > Definition of competency and role in education speak only to generic in-service competency sessions, curricula integration and the 1980s–1990s competency-based curriculum shift; the Methods > Data sources section shows the literature search was confined to 2000–2021, i.e. pre-dating ChatGPT. Searches for 'ChatGPT generative artificial intelligence educational intervention nurses', 'artificial intelligence technology in nursing education new era', 'large language model AI literacy digital technology training gap' and 'limitations ... future directions' returned no passage bearing on the claim, so nothing here supports or contradicts it. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Many PhD programs in nursing worldwide last 3 to 4 years 24”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Study Design
What the sources say
- Could not verifycites [24] matched to “Artificial intelligence in nursing: Priorities and opportunities from an international invitational think‐tank of the Nursing and Artificial Intelligence Leadership Collaborative” (2021) sourceExperimental — accuracy not yet measured
Our copy of the NAIL think-tank paper (10.1111/jan.14855) discusses nursing education only in terms of AI competencies — entry-level curriculum, continuing education, and graduate nursing education benefiting from 'sub-specializations in AI under health informatics programs' (Discussion, Strategies and opportunities to address priority 1). No passage states or implies how long nursing PhD/doctoral programs last. Searched: 'PhD programs in nursing last 3 to 4 years', 'doctoral degree duration years nursing education program length', 'doctoral students PhD candidates time to complete degree'; the paper is not truncated, so the duration claim simply is not addressed in it. (LLM, conf=0.75)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“The educational intervention was guided by Bloom's Taxonomy of Learning, which describes a hierarchy of cognitive domains associated with learning.28”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Pedagogical Design
What the sources say
- Could not verifycites [28] matched to “The state of artificial intelligence in nursing education: past, present, and future directions” (2023) sourceExperimental — accuracy not yet measured
Our full-text copy of De Gagne (2023) is a viewpoint overview of AI in nursing education and contains no mention of Bloom's Taxonomy or any hierarchy of cognitive domains (searches: 'Bloom's Taxonomy of Learning hierarchy of cognitive domains', 'Bloom taxonomy cognitive learning objectives hierarchy education'). Nor does it describe an educational intervention guided by a learning framework; Section 3 discusses instructional design experts and curriculum development only in general terms (Sections 1-4, References). Since nothing in our copy addresses the claim's point, it can be neither supported nor contradicted here. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All of them reported increasing their self-rated competency in generative AI by one to two points on a five-point rating scale.”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, ChatGPT was considered to be a useful tool for generating lay abstracts and other scientific materials for lay audiences (such as informed consent documents).”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Public Scientific Communication
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
20 more claims
Create a free account to see all 95 claims and to verify the 43 references still open.
- It may state two separate claims as one. 35
- Probably not a substantial claim. 51
- The quote only partly states this claim. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“For students, studies documented improved personalisation and self-directed learning capabilities, where GenAI functions as cognitive scaffolding that helps ' students advance towards the performance of complex tasks '”
From Patterns, advances, and gaps in using ChatGPT and similar technologies in nursing education: A PAGER scoping review (2025) · cites this paper as Turchioe et al., 2024
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Abstract
“All of them reported increasing their self-rated competency in generative AI by one to two points on a five-point rating scale.”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Pre-Post Comparisons of Generative Artificial Intelligence Competencies
“One student who was auditing the course did not complete the competency self-assessments.”
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601
Wing, J. M. (2006) · Communications of the ACM · doi:10.1145/1118178.1118215 · Cited by 8,102
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
Enhancing the quality and credibility of qualitative analysis.
(1999) · PubMed Central · Cited by 4,133
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
Eysenbach, G. (2023) · JMIR Medical Education · doi:10.2196/46885 · Cited by 840
What ChatGPT and generative AI mean for science
Stokel-Walker, C., & Van Noorden, R. (2023) · Nature · doi:10.1038/d41586-023-00340-6 · Cited by 828
Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse?
O’Connor, S., & ChatGPT (2023) · Nurse Education in Practice · doi:10.1016/j.nepr.2022.103537 · Cited by 585 · cited 3×
“10,30 Based on these fi ndings, we identi fi ed two new competencies relevant to generative AI that the students would need: (1) describe generative AI applications in health care and (2) identify appropriate and inappropriate applications of generative AI in health research.”
Ronquillo, C. E., Peltonen, L., Pruinelli, L., Chu, C. H., Bakken, S., Beduschi, A., Cato, K., Hardiker, N., Junger, A., Michalowski, M., et al. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14855 · Cited by 453 · cited 1×
“34 This builds on the recognition that big data and data science are of high relevance to nursing science and practice.”
Rao, A., Pang, M., Kim, J., Kamineni, M., Lie, W., Prasad, A. K., Landman, A., Dreyer, K., & Succi, M. D. (2023) · Journal of Medical Internet Research · doi:10.2196/48659 · Cited by 412
Research works printed but not linked: 4
- American Association of Colleges of Nursing. The Essentials: Core Competencies for Professional Nursing Education. 2021 17 Wing JM. Computational thinking. Commun ACM 2006;49(03): 33-35
- Long D, Magerko B. What is AI Literacy? Competencies and Design Considerations. Paper presented at: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. CHI '20. Association for Computing Machinery; 2020:1-16
- Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Accessed February 21, 2024 at: https://proceedings. neurips.cc/paper/2017/hash/ 8a20a8621978632d76c43dfd28b67767-Abstract.html
- Zou A, Phan L, Chen S, et al. Representation engineering: A top- down approach to AI transparency. arXiv [csLG]. Published online October 2, 2023. Accessed February 21, 2024 at: https://www.ai- transparency.org/
Cited by
The role of artificial intelligence in shaping nursing education: A comprehensive systematic review
Ma, J., Wen, J., Qiu, Y., Wang, Y., Xiao, Q., Liu, T., Zhang, D., Zhao, Y., Lu, Z., & Sun, Z. (2025) · Nurse Education in Practice · doi:10.1016/j.nepr.2025.104345 · Cited by 73
Amankwaa, I., Ekpor, E., Cudjoe, D., Kobiah, E., Fuseini, A.-K. J., Diebieri, M., Gyamfi, S., & Brownie, S. (2025) · Nurse Education Today · doi:10.1016/j.nedt.2025.106822 · Cited by 20
Olawade, D. B., David-Olawade, A. C., Rotifa, O. B., & Wada, O. Z. (2025) · Nurse Education in Practice · doi:10.1016/j.nepr.2025.104511 · Cited by 26
Woods, L. S., Lyons, K., van der Vegt, A. H., Olsen, Q., Huang, W., Khor, J. S., Xu, N., & Sullivan, C. M. (2026) · BMC Medical Education · doi:10.1186/s12909-026-08969-3 · Cited by 16
Zhang, S., Yang, X., Zhang, L., Liu, H., Chen, X., Yang, X., Hu, Y., Liu, Q., & He, Y. (2025) · International Nursing Review · doi:10.1111/inr.70060 · Cited by 14
Metadata
- Authors
- Reading Turchioe, M., Kisselev, S., Van Bulck, L., & Bakken, S.
- Affiliations
- Columbia University School of Nursing, New York, New York, United States
- Columbia University (US)
- Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
- ORCID
- Kisselev, Sergey
- Venue
- Applied Clinical Informatics
- Publisher
- Georg Thieme Verlag KG
- Published
- 2024-07-25
- Volume
- 15
- Issue
- 05
- Pages
- 842-851
- ISSN
- 1869-0327 (ISSN-L)
- PMC
- PMC11483171
- OpenAlex
- W4400969525
- Cited by
- 20
- References
- 29
- Citations by year
- 2026: 12 · 2025: 8
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Applied Clinical Informatics (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion)
- Lirias (KU Leuven) (submittedVersion)
- Funders
- Columbia Center for Teaching and Learning
- NINR (grant no.: R00NR019124)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- generative AI, ChatGPT, AI competencies, artificial intelligence in education, nursing research education, clinical decision support, patient decision support, science communication, AI safety, hallucinations, usability
- MeSH terms
- Artificial Intelligence, Curriculum, Education, Nursing, Graduate, Humans, Students, Nursing, Nursing Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework. https://app.cochat.ai/papers/10.1055/a-2373-3151
- The paper
- Reading Turchioe, M., Kisselev, S., Van Bulck, L., & Bakken, S. (2024). Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework. Applied Clinical Informatics. https://doi.org/10.1055/a-2373-3151
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.