Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework
Open accessThe DOI matches its Crossref record; 12 of the 32 references it cites were found in a registry or an index, and 1 are not checked yet; 3 of the 46 sources its claims cite were checked for support.
Abstract
Background Generative artificial intelligence (AI) tools may soon be integrated into health care practice and research. Nurses in leadership roles, many of whom are doctorally prepared, will need to determine whether and how to integrate them in a safe and useful way. Objective This study aimed to develop and evaluate a brief intervention to increase PhD nursing students' knowledge of appropriate applications for using generative AI tools in health care. Methods We created didactic lectures and laboratory-based activities to introduce generative AI to students enrolled in a nursing PhD data science and visualization course. Students were provided with a subscription to Chat Generative Pretrained Transformer (ChatGPT) 4.0, a general-purpose generative AI tool, for use in and outside the class. During the didactic portion, we described generative AI and its current and potential future applications in health care, including examples of appropriate and inappropriate applications. In the laboratory sessions, students were given three tasks representing different use cases of generative AI in health care practice and research (clinical decision support, patient decision support, and scientific communication) and asked to engage with ChatGPT on each. Students (n = 10) independently wrote a brief reflection for each task evaluating safety (accuracy, hallucinations) and usability (ease of use, usefulness, and intention to use in the future). Reflections were analyzed using directed content analysis. Results Students were able to identify the strengths and limitations of ChatGPT in completing all three tasks and developed opinions on whether they would feel comfortable using ChatGPT for similar tasks in the future. All of them reported increasing their self-rated competency in generative AI by one to two points on a five-point rating scale. Conclusion This brief educational intervention supported doctoral nursing students in understanding the appropriate uses of ChatGPT, which may support their ability to appraise and use these tools in their future work.
Verified 2026-10-06 · 1 reference not checked yet
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 3 Not valid · 29 Not checked · 63 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Given the novelty of ChatGPT and generative AI in health care, few educational interventions have been developed to prepare nurses for this new era.18”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Background and Significance
What the sources say
- Could not verifycites [18] matched to “Competency in nursing practice: a concept analysis” (2023) sourceExperimental — accuracy not yet measured
Our copy of Mrayyan et al. (2023) is a Walker-and-Avant concept analysis of 'competency in nursing practice' and never addresses ChatGPT, generative AI or AI-specific educational interventions. Its Discussion > Implications of the findings and Introduction > Definition of competency and role in education speak only to generic in-service competency sessions, curricula integration and the 1980s–1990s competency-based curriculum shift; the Methods > Data sources section shows the literature search was confined to 2000–2021, i.e. pre-dating ChatGPT. Searches for 'ChatGPT generative artificial intelligence educational intervention nurses', 'artificial intelligence technology in nursing education new era', 'large language model AI literacy digital technology training gap' and 'limitations ... future directions' returned no passage bearing on the claim, so nothing here supports or contradicts it. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Many PhD programs in nursing worldwide last 3 to 4 years 24”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Study Design
What the sources say
- Could not verifycites [24] matched to “Artificial intelligence in nursing: Priorities and opportunities from an international invitational think‐tank of the Nursing and Artificial Intelligence Leadership Collaborative” (2021) sourceExperimental — accuracy not yet measured
Our copy of the NAIL think-tank paper (10.1111/jan.14855) discusses nursing education only in terms of AI competencies — entry-level curriculum, continuing education, and graduate nursing education benefiting from 'sub-specializations in AI under health informatics programs' (Discussion, Strategies and opportunities to address priority 1). No passage states or implies how long nursing PhD/doctoral programs last. Searched: 'PhD programs in nursing last 3 to 4 years', 'doctoral degree duration years nursing education program length', 'doctoral students PhD candidates time to complete degree'; the paper is not truncated, so the duration claim simply is not addressed in it. (LLM, conf=0.75)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“The educational intervention was guided by Bloom's Taxonomy of Learning, which describes a hierarchy of cognitive domains associated with learning.28”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Pedagogical Design
What the sources say
- Could not verifycites [28] matched to “The state of artificial intelligence in nursing education: past, present, and future directions” (2023) sourceExperimental — accuracy not yet measured
Our full-text copy of De Gagne (2023) is a viewpoint overview of AI in nursing education and contains no mention of Bloom's Taxonomy or any hierarchy of cognitive domains (searches: 'Bloom's Taxonomy of Learning hierarchy of cognitive domains', 'Bloom taxonomy cognitive learning objectives hierarchy education'). Nor does it describe an educational intervention guided by a learning framework; Section 3 discusses instructional design experts and curriculum development only in general terms (Sections 1-4, References). Since nothing in our copy addresses the claim's point, it can be neither supported nor contradicted here. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All of them reported increasing their self-rated competency in generative AI by one to two points on a five-point rating scale.”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, ChatGPT was considered to be a useful tool for generating lay abstracts and other scientific materials for lay audiences (such as informed consent documents).”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Public Scientific Communication
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
20 more claims
Create a free account to see all 95 claims and to verify the 43 references still open.
- It may state two separate claims as one. 35
- Probably not a substantial claim. 51
- The quote only partly states this claim. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“For students, studies documented improved personalisation and self-directed learning capabilities, where GenAI functions as cognitive scaffolding that helps ' students advance towards the performance of complex tasks '”
From Patterns, advances, and gaps in using ChatGPT and similar technologies in nursing education: A PAGER scoping review (2025) · cites this paper as Turchioe et al., 2024
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Abstract
“All of them reported increasing their self-rated competency in generative AI by one to two points on a five-point rating scale.”
§ Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework > Pre-Post Comparisons of Generative Artificial Intelligence Competencies
“One student who was auditing the course did not complete the competency self-assessments.”
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601
Wing, J. M. (2006) · Communications of the ACM · doi:10.1145/1118178.1118215 · Cited by 8,102
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
Enhancing the quality and credibility of qualitative analysis.
(1999) · PubMed Central · Cited by 4,133
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
Eysenbach, G. (2023) · JMIR Medical Education · doi:10.2196/46885 · Cited by 840
What ChatGPT and generative AI mean for science
Stokel-Walker, C., & Van Noorden, R. (2023) · Nature · doi:10.1038/d41586-023-00340-6 · Cited by 828
Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse?
O’Connor, S., & ChatGPT (2023) · Nurse Education in Practice · doi:10.1016/j.nepr.2022.103537 · Cited by 585 · cited 3×
“10,30 Based on these fi ndings, we identi fi ed two new competencies relevant to generative AI that the students would need: (1) describe generative AI applications in health care and (2) identify appropriate and inappropriate applications of generative AI in health research.”
Ronquillo, C. E., Peltonen, L., Pruinelli, L., Chu, C. H., Bakken, S., Beduschi, A., Cato, K., Hardiker, N., Junger, A., Michalowski, M., et al. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14855 · Cited by 453 · cited 1×
“34 This builds on the recognition that big data and data science are of high relevance to nursing science and practice.”
Rao, A., Pang, M., Kim, J., Kamineni, M., Lie, W., Prasad, A. K., Landman, A., Dreyer, K., & Succi, M. D. (2023) · Journal of Medical Internet Research · doi:10.2196/48659 · Cited by 412
Using AI-generated suggestions from ChatGPT to optimize clinical decision support
Liu, S., Wright, A. P., Patterson, B. L., Wanderer, J. P., Turer, R. W., Nelson, S. D., McCoy, A. B., Sittig, D. F., & Wright, A. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad072 · Cited by 397
Competencies for the Use of Artificial Intelligence–Based Tools by Health Care Professionals
Russell, R. G., Lovett Novak, L., Patel, M., Garvey, K. V., Craig, K. J. T., Jackson, G. P., Moore, D., & Miller, B. M. (2023) · Academic Medicine · doi:10.1097/acm.0000000000004963 · Cited by 320
Rao, A., Kim, J., Kamineni, M., Pang, M., Lie, W., Dreyer, K. J., & Succi, M. D. (2023) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.05.003 · Cited by 278
Evaluating ChatGPT as an Adjunct for Radiologic Decision-Making
Rao, A., Kim, J., Kamineni, M., Pang, M., Lie, W., & Succi, M. D. (2023) · doi:10.1101/2023.02.02.23285399 · Cited by 257
Nursing Needs Big Data and Big Data Needs Nursing
Brennan, P. F., & Bakken, S. (2015) · Journal of Nursing Scholarship · doi:10.1111/jnu.12159 · Cited by 199 · cited 2×
“Statistics courses have long been included in many baccalau-reate nursing programs 14 and more recently, leading nurse informaticists 15 and the American Association of Colleges of Nursing Essentials (Domain 8 16 ) have advocated for computational thinking 17 and data science 15 competencies to be…”
The state of artificial intelligence in nursing education: past, present, and future directions
De Gagne, J. C. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20064884 · Cited by 191
Moons, P., & Van Bulck, L. (2023) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvad022 · Cited by 118
Competency in nursing practice: a concept analysis
Mrayyan, M. T., Abunab, H. Y., Abu Khait, A., Rababa, M. J., Al-Rawashdeh, S., Algunmeeyn, A., & Abu Saraya, A. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-067352 · Cited by 114 · cited 1×
“” 27 The Columbia University Institutional Review Board (IRB) approved this study.”
How Nature readers are using ChatGPT
Owens, B. (2023) · Nature · doi:10.1038/d41586-023-00500-8 · Cited by 109 · cited 1×
“4,19 Themajor riskswereethical and legal issues including plagiarism, copyright, transparency, risks of bias including the risks of “ infodemics ” biasing results, risks of hallucination (i.e., the phenomenon of models providing fabricated or misleading outputs), models having limited and incorrect…”
Generative AI and large language models in health care: pathways to implementation
Raza, M. M., Venkatesh, K. P., & Kvedar, J. C. (2024) · npj Digital Medicine · doi:10.1038/s41746-023-00988-4 · Cited by 107 · cited 1×
“12 Given the growing role of generative AI in health care, nurse leaders need to understand these tools and their risks and bene fi ts. Nurses in leadership roles will need to determine whether and how to integrate generative AI tools into their work in a safe and useful way.”
The application of Chat Generative Pre-trained Transformer in nursing education
Liu, J., Liu, F., Fang, J., & Liu, S. (2023) · Nursing Outlook · doi:10.1016/j.outlook.2023.102064 · Cited by 103 · cited 1×
“18 Generative AI has been examined as a learning tool within nursing curricula, for example, to assist nursing students in creating evidence-based care plans during clinical simulations, 19 and the potential threats to academic integrity and other risks have been discussed.”
The ChatGPT Effect: Nursing Education and Generative Artificial Intelligence
Topaz, M., Peltonen, L.-M., Michalowski, M., Stiglic, G., Ronquillo, C., Pruinelli, L., Song, J., O'Connor, S., Miyagawa, S., & Fukahori, H. (2025) · Journal of Nursing Education · doi:10.3928/01484834-20240126-01 · Cited by 97 · cited 1×
“10,20,21 Guidelines on the use of generative AI in nursing education and practice have been proposed 22,23 but there is a need for accompanying empirical research evaluating educational interventions teaching nurses about generative AI itself as a potential health care tool they may one day use or…”
Assessing the Value of ChatGPT for Clinical Decision Support Optimization
Liu, S., Wright, A. P., Patterson, B. L., Wanderer, J. P., Turer, R. W., Nelson, S. D., McCoy, A. B., Sittig, D. F., & Wright, A. (2023) · doi:10.1101/2023.02.21.23286254 · Cited by 90 · cited 1×
“4 Studies have described how ChatGPT could be used to train medical students, 5 provide clinical decision support, 6 – 8 summarize clinical guidelines, 9 facilitate data collection, particularly across languages, 9 and write scienti fi c manuscripts.”
The ChatGPT effect and transforming nursing education with generative AI: Discussion paper
Gosak, L., Pruinelli, L., Topaz, M., & Štiglic, G. (2024) · Nurse Education in Practice · doi:10.1016/j.nepr.2024.103888 · Cited by 89 · cited 1×
“35 Much has been written about how to leverage AI as a teaching aid, for example, to teach nurses how to documentthenursingprocess 36 andcreatepatientbackstories for nursing simulation courses.”
Generative AI backstories for simulation preparation
Reed, J. M., & Dodson, T. M. (2024) · Nurse Educator · doi:10.1097/nne.0000000000001590 · Cited by 48 · cited 1×
“37 Speci fi c to generative AI, O ’ Connor and colleaguesdiscussintegrating promptengineer-ing into nursing coursework as an educational tool.”
Prompt engineering when using generative AI in nursing education
O’Connor, S., Peltonen, L.-M., Topaz, M., Chen, L.-Y. A., Michalowski, M., Ronquillo, C., Stiglic, G., Chu, C. H., Hui, V., & Denis-Lalonde, D. (2024) · Nurse Education in Practice · doi:10.1016/j.nepr.2023.103825 · Cited by 42 · cited 6×
“18 Generative AI has been examined as a learning tool within nursing curricula, for example, to assist nursing students in creating evidence-based care plans during clinical simulations, 19 and the potential threats to academic integrity and other risks have been discussed.”
InfluentialMaking explicit the development of PhD-prepared nurses to steward the discipline
Morris, N. S., Wassef, M. E., Sullivan‐Bolyai, S., Bova, C., & Kane, A. T. (2020) · Nursing Outlook · doi:10.1016/j.outlook.2020.08.002 · Cited by 23 · cited 1×
“13 Therefore, they are one of the groups who must become acculturated to generative AI.”
Data Science Trends Relevant to Nursing Practice: A Rapid Review of the 2020 Literature
Douthit, B. J., Walden, R. L., Cato, K., Coviak, C. P., Cruz, C., D’Agostino, F., Forbes, T. H., Gao, G., Kapetanovic, T. A., Lee, M. A., et al. (2022) · Applied Clinical Informatics · doi:10.1055/s-0041-1742218 · Cited by 17 · cited 1×
“35 Much has been written about how to leverage AI as a teaching aid, for example, to teach nurses how to documentthenursingprocess 36 andcreatepatientbackstories for nursing simulation courses.”
High Blood Pressure: ACC/AHA Releases Updated Guideline.
Armstrong, C. (2018) · PubMed · Cited by 16
Evidence-based program requirements: evaluation of statistics as a required course.
Grace, J. T., & D’Aoust, R. (2006) · PubMed · Cited by 14
Generative AI in clinical practice and operations
Carroll, W. M. (2023) · Nursing Management · doi:10.1097/nmg.0000000000000056 · Cited by 6
How to get the most out of ChatGPT? Tips and tricks on prompting
Durieux, B. N., Davis, J., Moons, P., & Bulck, L. V. (2024) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvae016 · Cited by 5 · cited 2×
“Providing more training on prompt engineering may facilitate more predictable interactions, 31 although educators should caution against providing too much guidance on prompting to avoid undermining the learning that organically occurs by interacting creatively with ChatGPT.”
Research works printed but not linked: 4
- American Association of Colleges of Nursing. The Essentials: Core Competencies for Professional Nursing Education. 2021 17 Wing JM. Computational thinking. Commun ACM 2006;49(03): 33-35
- Long D, Magerko B. What is AI Literacy? Competencies and Design Considerations. Paper presented at: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. CHI '20. Association for Computing Machinery; 2020:1-16
- Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Accessed February 21, 2024 at: https://proceedings. neurips.cc/paper/2017/hash/ 8a20a8621978632d76c43dfd28b67767-Abstract.html
- Zou A, Phan L, Chen S, et al. Representation engineering: A top- down approach to AI transparency. arXiv [csLG]. Published online October 2, 2023. Accessed February 21, 2024 at: https://www.ai- transparency.org/
Cited by
The role of artificial intelligence in shaping nursing education: A comprehensive systematic review
Ma, J., Wen, J., Qiu, Y., Wang, Y., Xiao, Q., Liu, T., Zhang, D., Zhao, Y., Lu, Z., & Sun, Z. (2025) · Nurse Education in Practice · doi:10.1016/j.nepr.2025.104345 · Cited by 73
Amankwaa, I., Ekpor, E., Cudjoe, D., Kobiah, E., Fuseini, A.-K. J., Diebieri, M., Gyamfi, S., & Brownie, S. (2025) · Nurse Education Today · doi:10.1016/j.nedt.2025.106822 · Cited by 20
Olawade, D. B., David-Olawade, A. C., Rotifa, O. B., & Wada, O. Z. (2025) · Nurse Education in Practice · doi:10.1016/j.nepr.2025.104511 · Cited by 26
Woods, L. S., Lyons, K., van der Vegt, A. H., Olsen, Q., Huang, W., Khor, J. S., Xu, N., & Sullivan, C. M. (2026) · BMC Medical Education · doi:10.1186/s12909-026-08969-3 · Cited by 16
Zhang, S., Yang, X., Zhang, L., Liu, H., Chen, X., Yang, X., Hu, Y., Liu, Q., & He, Y. (2025) · International Nursing Review · doi:10.1111/inr.70060 · Cited by 14
Metadata
- Authors
- Reading Turchioe, M., Kisselev, S., Van Bulck, L., & Bakken, S.
- Affiliations
- Columbia University School of Nursing, New York, New York, United States
- Columbia University (US)
- Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
- ORCID
- Kisselev, Sergey
- Venue
- Applied Clinical Informatics
- Publisher
- Georg Thieme Verlag KG
- Published
- 2024-07-25
- Volume
- 15
- Issue
- 05
- Pages
- 842-851
- ISSN
- 1869-0327 (ISSN-L)
- PMC
- PMC11483171
- OpenAlex
- W4400969525
- Cited by
- 20
- References
- 29
- Citations by year
- 2026: 12 · 2025: 8
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Applied Clinical Informatics (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion)
- Lirias (KU Leuven) (submittedVersion)
- Funders
- Columbia Center for Teaching and Learning
- NINR (grant no.: R00NR019124)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- generative AI, ChatGPT, AI competencies, artificial intelligence in education, nursing research education, clinical decision support, patient decision support, science communication, AI safety, hallucinations, usability
- MeSH terms
- Artificial Intelligence, Curriculum, Education, Nursing, Graduate, Humans, Students, Nursing, Nursing Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.