The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index; 16 of the 52 sources its claims cite were checked for support.
AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review
Open accessAbstract
Background: Traditional simulation-based nursing education is often constrained by high costs, resource intensity, and limited scalability. AI-powered simulations offer dynamic, scalable, and personalized alternatives. However, the empirical evidence regarding their pedagogical effectiveness and learner acceptance remains fragmented. Objective: This study aimed to systematically evaluate and synthesize evidence on the effectiveness and learner perceptions of AI-powered simulations in nursing education. Methods: Following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, we systematically searched 11 electronic databases (PubMed, CINAHL, Embase, Web of Science, Cochrane Library, Scopus, SinoMed, CNKI, Wanfang, VIP, and Google Scholar) for studies published between January 2014 and September 2025. Two independent reviewers performed study selection, data extraction, and quality appraisal using design-specific tools (risk of bias 2 tool [RoB 2; Cochrane Bias Methods Group] for randomized controlled trials [RCTs], Risk Of Bias in Nonrandomized Studies of Interventions [ROBINS-I; Cochrane Bias Methods Group] for nonrandomized studies, Mixed Methods Appraisal Tool [MMAT] for mixed methods, Joanna Briggs Institute [JBI] for qualitative, and Agency for Healthcare Research and Quality [AHRQ] for cross-sectional studies). Quantitative data were synthesized narratively, and qualitative findings were integrated using JBI meta-aggregation. A convergent segregated approach with joint display was used to generate meta-inferences. Results: Nineteen studies involving 1253 participants (primarily prelicensure nursing students, with some interdisciplinary cohorts) were included. AI modalities comprised generative AI/large language models (n=7), AI-driven virtual patients/mannequins (n=5), AI-enhanced virtual/mixed reality (n=5), and chatbots (n=2). Three studies were RCTs, 4 were quasiexperimental with control groups, 3 were uncontrolled pre-post studies, 4 were mixed methods, 4 were qualitative, and one was a cross-sectional survey. Quantitative synthesis showed that evidence from RCTs and controlled quasiexperimental studies indicates significant improvements in cognitive knowledge and affective outcomes, including self-efficacy and communication confidence; however, effects on complex psychomotor skills were inconsistent, with one RCT finding AI-assisted simulation inferior to standardized patient simulation. Findings from uncontrolled designs are preliminary. Qualitative meta-aggregation revealed that learners valued safe, repeatable, nonjudgmental practice environments that reduced anxiety and bridged the theory-practice gap. Persistent challenges included technical frustrations, “robotic” interactions, lack of nonverbal cues, and system instability, collectively constituting an “authenticity gap.” Conclusions: AI-powered simulations show promise for developing foundational clinical reasoning and communication skills in nursing education, though the evidence base is limited by the predominance of uncontrolled designs, reliance on self-reported measures, and absence of longitudinal data on skill retention or clinical transfer. Due to current technological limitations in replicating physical and emotional authenticity, AI should be implemented as a complementary tool alongside traditional simulation methods and clinical placements, rather than as a replacement. Future research should prioritize longitudinal outcomes, standardized competency measures, RCTs with active comparators, and implementation strategies addressing technical barriers.
Overview
CoChat Summary
TL;DR
This mixed methods systematic review synthesized 19 studies (1253 participants) on AI-powered simulations in nursing education, finding short-term improvements in knowledge, clinical reasoning, communication confidence, and learner acceptance. However, evidence is limited by few RCTs, uncontrolled designs, self-reported outcomes, and a persistent learner-perceived “authenticity gap.”
Key findings
- Nineteen studies involving 1253 participants were included; AI modalities were generative AI/LLMs (n=7), AI-driven virtual patients/mannequins (n=5), AI-enhanced VR/MR (n=5), and chatbots (n=2).
- Among 11 studies assessing knowledge or skills, 8 (73%) reported improvements; among 9 assessing attitudes or self-efficacy, 8 (89%) reported improvements, but one RCT found AI-assisted simulation inferior to standardized patient simulation for breast self-examination skills.
- Usability and acceptance were generally moderate to high: SUS scores ranged from 61.6 to 78.56, TAM perceived usefulness was 5.78/7, and 72%–93% of students expressed willingness to recommend AI simulations.
- Qualitative synthesis identified valued safe, repeatable, nonjudgmental practice but persistent technical frustrations, “robotic” interactions, lack of nonverbal cues, and system instability, collectively termed the “authenticity gap.”
Methods
- PRISMA-guided mixed methods systematic review with a convergent segregated design; protocol registered in PROSPERO (CRD420251208020).
- Searched 11 databases (PubMed, CINAHL, Embase, Web of Science, Cochrane Library, Scopus, SinoMed, CNKI, Wanfang, VIP, Google Scholar) from January 2014 to September 2025; 3181 citations screened, 100 full texts assessed, and 19 studies included.
- Two independent reviewers selected studies, extracted data, and appraised quality using RoB 2, ROBINS-I, MMAT, JBI, and AHRQ tools; quantitative data were synthesized narratively and qualitative findings integrated via JBI meta-aggregation and joint display.
Limitations
- The paper states that heterogeneity in AI modalities, intervention durations, and measurement instruments precluded meta-analysis and standardized effect sizes; most studies used uncontrolled pre-post designs, and no study examined skill retention or clinical transfer beyond short-term postintervention windows.
- The paper also notes small samples, inclusion of some nonnursing learners, near-uniform positive findings suggesting publication bias, and geographic concentration in high-income regions with no studies from Africa, South America, or low-income countries.
- Evident from the text: only 3 RCTs were included, many outcomes relied on self-reported measures, and the review itself could not formally test publication bias due to heterogeneity.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
12 Valid · 2 Not valid · 25 Not checked · 93 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Willingness to recommend AI simulations was high (90%‐93%) across diverse learner groups [51].”
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Results > Outcome
What the sources say
- Partly supportedcites [51] De Mattei, Are artificial intelligence virtual simulated patients (AI-VSP) a valid teaching modality for health professional students?, Clin Simul Nurs sourceExperimental — accuracy not yet measured
The Results report high willingness to recommend the AI virtual patient among four learner groups, but the percentages were 90% for FNP, 84% for PA, 93% for BSN, and 90% for ABSN. The claimed 90%–93% range excludes the PA group, so it does not hold across all the groups studied. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Clinical competence was also significantly improved using a standardized clinical performance scale in a quasiexperimental study (Experimental Group 203.76 vs Control Group 171.11; P=.02) [41].”
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Results > Outcome
What the sources say
- Partly supportedcites [41] Park, Development and effects of a scenario-based labor nursing simulation education program using an artificial intelligence tutor: a quasi-experimental study, Womens Health Nurs sourceExperimental — accuracy not yet measured
The Results (Hypothesis testing; page unavailable) report significantly higher post-intervention clinical performance competency in the experimental group than in the control group (p=.020), but give the experimental-group mean as 203.62, not 203.76. The Methods (Instrument; page unavailable) describe the clinical performance measurement tool. (LLM, conf=0.90)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The one cross-sectional study [51] was evaluated using the AHRQ methodology checklist and was rated as being of moderate quality.”
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Results > Methodological Quality
What the sources say
- Supportedcites [51] De Mattei, Are artificial intelligence virtual simulated patients (AI-VSP) a valid teaching modality for health professional students?, Clin Simul Nurs source
The Methods section identifies this paper as an observational cross-sectional study, which is what citation [51] identifies. The AHRQ checklist and moderate-quality rating describe the citing authors’ evaluation, not a finding attributed to this source. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The CCQ showed significant improvement in one study (Group B improved by 47.68 points; P=.02) [38].”
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Results > Outcome
What the sources say
- Partly supportedcites [38] Fung, Effects of generative artificial intelligence (GenAI) patient simulation on perceived clinical competency among global nursing undergraduates: a cross-over randomised controlled trial, BMC Nurs sourceExperimental — accuracy not yet measured
The Results (Table 3; page not provided) report a 47.68-point within-group improvement in Group B’s CCQ total score at T1. That improvement has p < 0.001; p = 0.020 refers instead to the 16.59-point between-group difference. The claim matches the improvement but attaches the wrong P value to it. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Kotlyar and Krasman [60] indicate that learners’ perceptions of the feedback source directly influence its acceptance and learning outcomes.”
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Discussion > Comparison With Existing Research
What the sources say
- Partly supportedcites [60] Kotlyar, Student reactions to AI versus human feedback in teamwork skills assessment, Int J Educ Technol High Educ sourceExperimental — accuracy not yet measured
The H2b section says perceived credibility and empathy of the feedback source affect feedback acceptance and that learning effectiveness depends in part on those perceptions. The Discussion: study 2 reports that credibility and empathy shaped reactions to feedback, but the Limitations and future directions section says the study captured initial reactions and calls for future research on learning outcomes. The claim’s assertion of a direct influence on learning outcomes is therefore stronger than the paper’s findings. (LLM, conf=0.84)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
56 more claims · 2 with their cited sources checked
Create a free account to see all 132 claims and every source verdict.
- It may state two separate claims as one. 58
- Probably not a substantial claim. 17
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, rigorous experimental research integrating AI-adaptive simulation with decision-support tools in nursing leadership education remains limited [4,9].”
From Artificial Intelligence-Based Adaptive Simulation Integrated With a Workforce Decision-Support System to Improve Simulated Nursing Leadership Performance: A Randomized Controlled Study (2026) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Studies involving AI-supported virtual, narrative, and generative simulations have reported improvements in self-efficacy, communication knowledge, perceived competence, diagnostic reasoning, and clinical decision-making.”
From Artificial Intelligence-Based Adaptive Simulation Integrated With a Workforce Decision-Support System to Improve Simulated Nursing Leadership Performance: A Randomized Controlled Study (2026) · cites this paper as [4]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Nevertheless, some studies suggest that human-led interaction may remain more effective for selected communication-related learning outcomes [3,4,10].”
The cited source says what the claim attributes to it.
In the citing paper
“However, findings vary across outcomes, with some studies reporting stronger effects for structured cognitive tasks than for complex interpersonal or psychomotor performance.”
The cited source says what the claim attributes to it.
In the citing paper
“These outcomes are particularly evident when learners receive real-time feedback and repeated practice within psychologically safe learning environments [4,8-11].”
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Results > AI Technologies
“8 [37-3941-4454undefinedundefinedundefinedundefinedundefined] out of 19 (42%) studies included a parallel control group”
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Results > Outcome
“The 8 [44-51] uncontrolled pre-post/feasibility studies (including mixed methods without control and cross-sectional)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Results > Outcome
“the National Aeronautics and Space Administration Task Load Index (NASA-TLX), also used in 2 studies [4050].”
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Results > Outcome
“Cognitive load was measured using the NASA-TLX in 2 studies [4450]”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Discussion > Strengths and Limitations
“no study examined skill retention beyond the immediate educational context or transfer to clinical practice.”
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Results > Study Characteristics
“Following students’ clinical rotations, clinical instructors were interviewed individually to assess students’ clinical communication skills.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Methods > Study Design
“A convergent segregated mixed methods systematic review design was used.”
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Methods > Data Synthesis
“We adopted a convergent integrated design, integrating quantitative and qualitative findings through joint display tables and narrative synthesis to derive meta-inferences [36].”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Results > AI Technologies
“5 [4048505154] studies focused on AI-enhanced VR or MR simulations”
§ AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review > Results > Outcome
“AI-enhanced VR/MR interventions (n=5) [4048505153]”
Citations
Cites
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329 · cited 1×
“Nonrandomized studies (quasiexperimental, pre-post, cohort, and interrupted time-series designs) were evaluated using the Risk of Bias in Nonrandomized Studies of Interventions (ROBINS-I) tool [33].”
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · cited 1×
“…characteristics (level of nursing education, age, and gender), detailed description of the AI-powered simulation intervention using the Template for Intervention Description and Replication (TiDier) checklist [32], comparator condition, outcome measures, key findings, and author conclusions.”
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 1×
“While these modalities differ in technological implementation, they share a common pedagogical mechanism, including the use of AI to drive interactive, adaptive, and real-time learning experiences that distinguish them from static or rule-based simulations [27].”
The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., et al. (2018) · Education for Information · doi:10.3233/efi-180221 · Cited by 4,737 · cited 1×
“For mixed methods studies, the Mixed Methods Appraisal Tool (MMAT) [35] was used to evaluate the appropriateness of the qualitative, quantitative, and mixed methods components, as well as the overall integration of the findings.”
Lockwood, C., Munn, Z., & Porritt, K. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000062 · Cited by 2,456 · cited 1×
“For qualitative studies, the JBI Critical Appraisal Checklist (10 items) for qualitative research [34] was used to appraise the study’s philosophical perspective, methodology, design, participant representation, data collection, analysis, and interpretation.”
McGaghie, W. C., Issenberg, S. B., Cohen, E. R., Barsuk, J. H., & Wayne, D. B. (2011) · Academic Medicine · doi:10.1097/acm.0b013e318217e119 · Cited by 1,866 · cited 1×
“However, conventional simulation methods face inherent limitations, including high costs, resource intensity, the need for trained facilitators, scheduling constraints, and limited scalability [9, 10].”
Chan, K. S., & Zary, N. (2019) · JMIR Medical Education · doi:10.2196/13930 · Cited by 877 · cited 1×
“The rapid advancement of AI technologies has opened new frontiers in health care education [12].”
Kyaw, B. M., Saxena, N., Posadzki, P., Vseteckova, J., Nikolaou, C. K., George, P. P., Divakar, U., Masiello, I., Kononowicz, A. A., Zary, N., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/12959 · Cited by 859 · cited 1×
“These innovations potentially address the limitations of traditional simulation by offering cost-effective scalability, 24/7 accessibility, personalized learning pathways, objective assessment capabilities, and immediate adaptive feedback [21,22].”
Hong, Q. N., Pluye, P., Bujold, M., & Wassef, M. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0454-2 · Cited by 754 · cited 1×
“We adopted a convergent integrated design, integrating quantitative and qualitative findings through joint display tables and narrative synthesis to derive meta-inferences [36].”
Use of simulation-based learning in undergraduate nurse education: An umbrella systematic review
Cant, R. P., & Cooper, S. J. (2017) · Nurse Education Today · doi:10.1016/j.nedt.2016.11.015 · Cited by 616 · cited 1×
“Traditional clinical training models, which rely heavily on direct patient contact, are constrained by limited clinical placement opportunities, ethical considerations, variability in clinical experiences, and concerns about patient safety during the learning process [3,4].”
Metadata
- Authors
- Jiang, H., Wang, Z., Shen, W., Meng, M., Yang, D., Li, X., & Hao, Y.
- Affiliations
- Beijing University of Chinese Medicine (CN)
- Corresponding author
- Hao, Yufang
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2026-07-21
- Volume
- 28
- Pages
- e95167-e95167
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC13387420
- OpenAlex
- W7169864056
- Semantic Scholar
- ebc662a28526719da327c2ad400f6dd4e55eeb56
- Cited by
- 4
- References
- 65
- Citations by year
- 2026: 4
- FWCI
- 4.16
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Education › Simulation-Based Education in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- nursing education, simulation-based training, large language models, generative AI, virtual patients, chatbots, virtual reality, mixed reality, learner perceptions, self-efficacy, psychomotor skills, standardized patients, prelicensure nursing students, student anxiety, personalized learning, theory-practice gap, standardized test scores
- MeSH terms
- Artificial Intelligence, Education, Nursing, Humans
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review. https://app.cochat.ai/papers/10.2196/95167
- The paper
- Jiang, H., Wang, Z., Shen, W., Meng, M., Yang, D., Li, X., & Hao, Y. (2026). AI-Powered Simulation for Nursing Education: Mixed Methods Systematic Review. Journal of Medical Internet Research. https://doi.org/10.2196/95167
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
