Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index; 19 of the 24 sources its claims cite were checked for support.

Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion

Open access

Abstract

BACKGROUND: Although healthcare providers (HCPs) are the most trusted source of vaccine information, there is a paucity of easily accessible, multidisciplinary educational tools on vaccine communication for them. Virtual simulation games (VSGs) are innovative yet accessible and effective tools in healthcare education. The objectives of our study were to develop VSGs to increase HCP confidence and self-efficacy in vaccine communication, advocacy, and promotion, and evaluate the VSGs' effectiveness using a pre-post self-assessment pilot study. METHODS: A multidisciplinary team of experts in medicine, nursing, pharmacy, and simulation development created three VSGs for HCP learners focused on addressing conversations with vaccine hesitant individuals. We evaluated the VSGs with 24 nursing students, 30 pharmacy students, and 18 medical residents who completed surveys and 6-point Likert scale pre-post self-assessments to measure changes in their confidence and self-efficacy. RESULTS: There were no significant differences in baseline confidence and self-efficacy across the three HCP disciplines, despite varied levels of education. Post-VSG confidence and self-efficacy (median: 5) were significantly higher than pre-VSG (median: 4-5) for all three HCP disciplines (P ≤ 0.0005), highlighting the effectiveness of the VSGs. Medical residents reported significantly lower post-VSG confidence and self-efficacy than nursing and pharmacy learners despite completing the most significant amount of education. CONCLUSIONS: Following the completion of the VSGs, learners in medicine, nursing, and pharmacy showed significant improvement in their self-assessed confidence and self-efficacy in holding vaccine conversations. The VSGs as an educational tool, in combination with existing clinical immunization training, can be used to increase HCP confidence and engagement in vaccine discussions with patients, which may ultimately lead to increased vaccine confidence among patients.

Overview

CoChat Summary

TL;DR

A multidisciplinary team developed three virtual simulation games (VSGs) on vaccine communication using presumptive statements and the PrOTCT framework, then pilot-tested them with nursing, pharmacy, and medical learners. Post-VSG self-assessed confidence and self-efficacy were significantly higher than pre-VSG scores across all three disciplines.

Key findings

  • Among 72 analyzed participants (24 nursing, 30 pharmacy, 18 medical residents), post-VSG confidence and self-efficacy median scores were 5 versus pre-VSG medians of 4–5, with significant improvement for all three disciplines and all three VSGs (P ≤ 0.0005 in the abstract; individual table P values ranged from 0.0005 to < 0.0001).
  • Baseline confidence and self-efficacy did not differ significantly across disciplines on VSG1 and VSG3 (median = 4), though medical and pharmacy learners differed significantly in pre-VSG2 confidence (P < 0.05).
  • Medical residents reported significantly lower post-VSG confidence and self-efficacy than nursing and pharmacy learners on all three post-assessments, except post-VSG2 self-efficacy, despite having completed the most education.
  • Most paired responses improved after each game: 57.5% for VSG1, 55.2% for VSG2, and 53.3% for VSG3; some did not change (33.6%, 39.5%, 24.6%, respectively), and a small proportion decreased (3.3%, 3.8%, 4.4%, respectively).

Methods

  • Three VSGs were created by experts in medicine, nursing, pharmacy, and simulation development using the CAN-Sim VSG design framework, presumptive statements, and the PrOTCT model; each game was designed to take approximately 20 minutes.
  • The pilot evaluation recruited undergraduate nursing students (third/fourth year, University of Calgary), undergraduate pharmacy students (second–fourth year, University of Waterloo), and medical residents from multiple specialties; 81 consented, 9 were excluded, and 72 were analyzed.
  • Participants completed pre- and post-VSG 6-point Likert self-assessments of confidence and self-efficacy; paired differences were tested with one-sided Wilcoxon matched-pairs signed rank tests using Pratt’s method, and discipline comparisons used Kruskal-Wallis with Dunn’s multiple comparison test.

Limitations

  • The paper states that unpaired pre/post responses occurred, especially for VSG3, possibly due to Qualtrics survey issues; convenience sampling yielded fewer participants than anticipated, reducing statistical power, possibly excluding learners with lower initial confidence, and limiting generalizability.
  • The authors also note that ordinal Likert scales and a pre-post design limit statistical analysis and introduce potential social desirability bias; only face validity was established for the outcome measure, with further construct validity and reliability testing needed.
  • Evident from the text: there was no control or comparison group, outcomes were self-reported rather than observed communication behavior, and assessments were immediate pre/post only, so durability of gains was not tested.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s12909-024-05169-9

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Confidence score comparisons between HCP learner disciplines (medicine residents, nursing students, and pharmacy students) for each pre- and post-VSG self-assessment. (ns = P > 0.05, * = P ≤ 0.05, ** = P ≤ 0.01, *** = P ≤ 0.001)
Fig. 1 Confidence score comparisons between HCP learner disciplines (medicine residents, nursing students, and pharmacy students) for each pre- and post-VSG self-assessment. (ns = P > 0.05, * = P ≤ 0.05, ** = P ≤ 0.01, *** = P ≤ 0.001)CC BY · PubMed Central
Fig. 2 Self-efficacy score comparisons between HCP learner disciplines (medicine residents, nursing students, and pharmacy students) for each pre- and post-VSG self-assessment. (ns = P > 0.05, * = P ≤ 0.05, ** = P ≤ 0.01, *** = P ≤ 0.001)
Fig. 2 Self-efficacy score comparisons between HCP learner disciplines (medicine residents, nursing students, and pharmacy students) for each pre- and post-VSG self-assessment. (ns = P > 0.05, * = P ≤ 0.05, ** = P ≤ 0.01, *** = P ≤ 0.001)CC BY · PubMed Central
Fig. 3 Pre- and post-intervention self-assessment response distributions. Likert scale responses ranged from 1 (least amount of confidence/self-efficacy) to 6 (most amount of confidence/self-efficacy)
Fig. 3 Pre- and post-intervention self-assessment response distributions. Likert scale responses ranged from 1 (least amount of confidence/self-efficacy) to 6 (most amount of confidence/self-efficacy)CC BY · PubMed Central

Verification

Claims the paper makes

11 Valid · 1 Not valid · 3 Not checked · 26 Own results and interpretations

9 more claims

Create a free account to see all 41 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 14
  • It may state two separate claims as one. 20
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

4 of 4

Citations

Cites

Show all 23 references

Research works printed but not linked: 1

  1. COVID-19 pandemic. Fuels largest continued backslide in vaccinations in three decades [press release]. Word Health Organization. Geneva/New York, 15 JUL 2022 2022.

Cited by

See all 11

Metadata

Authors
Doucette, E. J., Fullerton, M. M., Pateman, M., Lip, A., Houle, S. K. D., Kellner, J. D., Leal, J., MacDonald, S. E., McNeil, D., Tyerman, J., Luctkar-Flude, M., Davidson, S., & Constantinescu, C.
Affiliations
  • University of Calgary (CA)
  • University of Waterloo (CA)
  • Alberta Health Services (CA)
  • University of Alberta (CA)
  • University of Ottawa (CA)
Corresponding author
Doucette, Emily J.
Venue
BMC Medical Education
Published
2024-02-25
Volume
24
Issue
1
Pages
190-190
ISSN
1472-6920 (ISSN-L)
OpenAlex
W4392140755
Cited by
11
References
23
Citations by year
2026: 4 · 2025: 3 · 2024: 4
FWCI
3.11
Type
journal article
Language
en
Open access
Licence
Locations
  • BMC Medical Education (publishedVersion, other-oa)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • uO Research (University of Ottawa) (submittedVersion, public-domain)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Libraries and Cultural Resources (University of Calgary) (submittedVersion)
Funders
Public Health Agency of Canada (Immunization Partnership Fund)
Topics
  • Social Sciences › Education › Simulation-Based Education in Healthcare
  • Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
  • Social Sciences › Education › Innovations in Medical Education
Keywords
vaccine communication, vaccine hesitancy, self-efficacy, vaccine advocacy, vaccine promotion, healthcare education, nursing students, pharmacy students, medical residents
MeSH terms
Communication, Delivery of Health Care, Humans, Learning, Pilot Projects, Vaccines, Self Efficacy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion. https://app.cochat.ai/papers/10.1186/s12909-024-05169-9
The paper
Doucette, E. J., Fullerton, M. M., Pateman, M., Lip, A., Houle, S. K. D., Kellner, J. D., Leal, J., MacDonald, S. E., McNeil, D., Tyerman, J., Luctkar-Flude, M., Davidson, S., & Constantinescu, C. (2024). Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion. BMC Medical Education. https://doi.org/10.1186/s12909-024-05169-9

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.