The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index; 19 of the 24 sources its claims cite were checked for support.
Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion
Open accessAbstract
BACKGROUND: Although healthcare providers (HCPs) are the most trusted source of vaccine information, there is a paucity of easily accessible, multidisciplinary educational tools on vaccine communication for them. Virtual simulation games (VSGs) are innovative yet accessible and effective tools in healthcare education. The objectives of our study were to develop VSGs to increase HCP confidence and self-efficacy in vaccine communication, advocacy, and promotion, and evaluate the VSGs' effectiveness using a pre-post self-assessment pilot study. METHODS: A multidisciplinary team of experts in medicine, nursing, pharmacy, and simulation development created three VSGs for HCP learners focused on addressing conversations with vaccine hesitant individuals. We evaluated the VSGs with 24 nursing students, 30 pharmacy students, and 18 medical residents who completed surveys and 6-point Likert scale pre-post self-assessments to measure changes in their confidence and self-efficacy. RESULTS: There were no significant differences in baseline confidence and self-efficacy across the three HCP disciplines, despite varied levels of education. Post-VSG confidence and self-efficacy (median: 5) were significantly higher than pre-VSG (median: 4-5) for all three HCP disciplines (P ≤ 0.0005), highlighting the effectiveness of the VSGs. Medical residents reported significantly lower post-VSG confidence and self-efficacy than nursing and pharmacy learners despite completing the most significant amount of education. CONCLUSIONS: Following the completion of the VSGs, learners in medicine, nursing, and pharmacy showed significant improvement in their self-assessed confidence and self-efficacy in holding vaccine conversations. The VSGs as an educational tool, in combination with existing clinical immunization training, can be used to increase HCP confidence and engagement in vaccine discussions with patients, which may ultimately lead to increased vaccine confidence among patients.
Overview
CoChat Summary
TL;DR
A multidisciplinary team developed three virtual simulation games (VSGs) on vaccine communication using presumptive statements and the PrOTCT framework, then pilot-tested them with nursing, pharmacy, and medical learners. Post-VSG self-assessed confidence and self-efficacy were significantly higher than pre-VSG scores across all three disciplines.
Key findings
- Among 72 analyzed participants (24 nursing, 30 pharmacy, 18 medical residents), post-VSG confidence and self-efficacy median scores were 5 versus pre-VSG medians of 4–5, with significant improvement for all three disciplines and all three VSGs (P ≤ 0.0005 in the abstract; individual table P values ranged from 0.0005 to < 0.0001).
- Baseline confidence and self-efficacy did not differ significantly across disciplines on VSG1 and VSG3 (median = 4), though medical and pharmacy learners differed significantly in pre-VSG2 confidence (P < 0.05).
- Medical residents reported significantly lower post-VSG confidence and self-efficacy than nursing and pharmacy learners on all three post-assessments, except post-VSG2 self-efficacy, despite having completed the most education.
- Most paired responses improved after each game: 57.5% for VSG1, 55.2% for VSG2, and 53.3% for VSG3; some did not change (33.6%, 39.5%, 24.6%, respectively), and a small proportion decreased (3.3%, 3.8%, 4.4%, respectively).
Methods
- Three VSGs were created by experts in medicine, nursing, pharmacy, and simulation development using the CAN-Sim VSG design framework, presumptive statements, and the PrOTCT model; each game was designed to take approximately 20 minutes.
- The pilot evaluation recruited undergraduate nursing students (third/fourth year, University of Calgary), undergraduate pharmacy students (second–fourth year, University of Waterloo), and medical residents from multiple specialties; 81 consented, 9 were excluded, and 72 were analyzed.
- Participants completed pre- and post-VSG 6-point Likert self-assessments of confidence and self-efficacy; paired differences were tested with one-sided Wilcoxon matched-pairs signed rank tests using Pratt’s method, and discipline comparisons used Kruskal-Wallis with Dunn’s multiple comparison test.
Limitations
- The paper states that unpaired pre/post responses occurred, especially for VSG3, possibly due to Qualtrics survey issues; convenience sampling yielded fewer participants than anticipated, reducing statistical power, possibly excluding learners with lower initial confidence, and limiting generalizability.
- The authors also note that ordinal Likert scales and a pre-post design limit statistical analysis and introduce potential social desirability bias; only face validity was established for the outcome measure, with further construct validity and reliability testing needed.
- Evident from the text: there was no control or comparison group, outcomes were self-reported rather than observed communication behavior, and assessments were immediate pre/post only, so durability of gains was not tested.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
11 Valid · 1 Not valid · 3 Not checked · 26 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“VSGs can also provide psychological safety and lessen fear, anxiety, and embarrassment in new learners who may worry about making mistakes in front of fellow students and instructors [16–18].”
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Background
What the sources say
- Partly supportedcites [16] Luctkar-Flude M, Tyerman J. The Rise of Virtual Simulation: Pandemic Response or Enduring Pedagogy? Clin. Sim. Nurs., Tyerman J, Luctkar-Flude M, Chumbley L, Lalonde M, Peachey L, McParland T et al. Developing virtual simulation games for presimulation preparation: A user-friendly approach for nurse educators. J Nurs Educ Pract. 2021;11. sourceExperimental — accuracy not yet measured
Section 1.1 (p. 1) lists minimized learner vulnerability and anxiety among the advantages of VSGs. Section 4.2 (p. 7) identifies decreased learner anxiety as an anticipated benefit requiring further research. Neither passage addresses embarrassment or fear of making mistakes in front of fellow students and instructors, so the more specific explanation is not supported by this paper. (LLM, conf=0.86)
- Partly supportedcites [17] El Hussein MT, Hirst SP. High-Fidelity Simulation’s impact on clinical reasoning and patient safety: a scoping review. J Nurs Regul. 2023;13(4):54–65. sourceExperimental — accuracy not yet measured
The Results section says high-fidelity simulation may alleviate students’ anxiety by letting them practice in a safe environment where mistakes do not cause harm. It does not establish this for virtual simulation games or address fear and embarrassment about making mistakes in front of peers and instructors. (LLM, conf=0.86)
- Could not verifycites [18] Ross JG, Carney H. The Effect of Formative Capstone Simulation Scenarios on Novice Nursing Students’ Anxiety and Self-Confidence Related to Initial Clinical Practicum. Clinical simulation in nursing., Opel DJ, Heritage J, Taylor JA, Mangione-Smith R, Salas HS, Devere V et al. The architecture of provider-parent vaccine discussions at health supervision visits. Pediatrics. 2013;132(6):1037-46. sourceExperimental — accuracy not yet measured
The Qualitative and Study Participants sections describe coding training and observation of pediatric vaccine discussions, not virtual simulation games. Searches for psychological safety and for learners’ fear of making mistakes found no passage addressing whether games reduce fear, anxiety, or embarrassment; page numbers were not available in our copy. (LLM, conf=0.78)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“It is well-cited that healthcare providers (HCPs) are patients’ most trusted source of health and immunization information, suggesting that conversations with HCPs about vaccines may be an effective way to address vaccine hesitancy [8–10].”
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Background
What the sources say
- Partly supportedcites [8] MacDougall DM, Halperin BA, MacKinnon-Cameron D, Li L, McNeil SA, Langley JM, et al. The challenge of vaccinating adults: attitudes and beliefs of the Canadian public and healthcare providers. BMJ Open. 2015;5(9):e009062. sourceExperimental — accuracy not yet measured
The Results (Focus groups; page unavailable) describe healthcare providers as being in a trusted position that can influence patients’ vaccination decisions. The Discussion (page unavailable) says provider recommendations strongly influence vaccine acceptance. Neither passage establishes that providers are patients’ *most* trusted source, or addresses health information generally. (LLM, conf=0.86)
- Supportedcites [9] Paterson P, Meurice F, Stanberry LR, Glismann S, Rosenthal SL, Larson HJ. Vaccine hesitancy and healthcare providers. Vaccine. 2016;34(52):6700–6. source
The Conclusions state that HCPs remain the most trusted advisor and influencer of vaccination decisions. The Introduction also describes healthcare sources as among the most trustworthy for health alerts and information about medicines, supporting the citing sentence’s paraphrase. (LLM, conf=0.91)
- Partly supportedcites [10] Benham JL, Atabati O, Oxoby RJ, Mourali M, Shaffer B, Sheikh H, et al. COVID-19 vaccine-related attitudes and beliefs in Canada: National cross-sectional survey and cluster analysis. JMIR Public Health Surveill. 2021;7(12):e30424. sourceExperimental — accuracy not yet measured
The Results sections report that trust in health care institutions is associated with lower COVID-19 vaccine hesitancy and that 61.7% of surveyed Canadians said they would be more likely to take a vaccine if a family doctor, pharmacist, or public health nurse recommended it. They do not establish that healthcare providers are patients’ most trusted source of health and immunization information compared with other sources. (LLM, conf=0.84)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Patients were more likely to accept vaccine recommendations from a HCP if they used presumptive statements (e.g., “Today you will receive two vaccinations, correct?”) rather than participatory (e.g., “Are we going to vaccinate today?”) (21).”
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Background
What the sources say
- Could not verifycites [21] Faul F, Erdfelder E, Buchner A, Lang A-G. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41(4):1149–60. sourceExperimental — accuracy not yet measured
The paper’s §5.2 (Poisson Regression; page unavailable) uses swimmer infection counts to illustrate a power calculation, not vaccine recommendations. Searches for presumptive versus participatory statements and vaccine acceptance found no passage addressing the claim in our copy. (LLM, conf=0.78)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
Every source the paper cites for this claim was checked and supports it.
In the paper
“Despite varied levels of education across the three HCP learner disciplines, participants reported similar baseline scores on all three pre-VSG self-assessments, suggesting that the variable amounts of immunization-related training and clinical experiences in different HCP programs previously identified [22] does not result in any differences in HCP learner confidence or self-efficacy.”
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Discussion
What the sources say
- Supportedcites [22] Pelly LP, Pierrynowski Macdougall DM, Halperin BA, Strang RA, Bowles SK, Baxendale DM, et al. THE VAXED PROJECT: an assessment of immunization education in Canadian health professional programs. BMC Med Educ. 2010;10:86. source
The Results section (National Curriculum Review of Immunization-Related Content; page unavailable) reports variation in time spent on immunization education between and within disciplines, as well as variation in clinical-skills content and participation in immunization campaigns. The citation is attached to that previously identified variation; the statement about similar baseline self-assessments and the resulting inference about confidence are the citing authors’ own. (LLM, conf=0.90)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“PCO, or feelings of accountability for patients when in charge of clinical decision-making [25, 26], has been shown to increase as residents’ seniority increases [25, 27].”
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Discussion
What the sources say
- Could not verifycites [25] Cowley DS, Markman JD, Best JA, Greenberg EL, Grodesky MJ, Murray SB, et al. Understanding ownership of patient care: a dual-site qualitative study of faculty and residents from medicine and psychiatry. Perspect Med Educ. 2017;6(6):405–12. sourceExperimental — accuracy not yet measured
The Results and Discussion describe how residents and faculty define patient-care ownership, but do not report whether ownership increases with residents’ seniority. Searches for seniority, junior versus senior residents, and postgraduate training level found no passage addressing that relationship. (LLM, conf=0.72)
- Supportedcites [27] Fujikawa H, Son D, Aoki T, Eto M. Association between patient care ownership and personal or environmental factors among medical trainees: a multicenter cross-sectional study. BMC Med Educ. 2022;22(1):666. source
The Results report significantly higher patient care ownership scores among senior residents than junior residents. The Implications section also states that PCO scores were higher at higher postgraduate years, supporting the cited claim as an association with seniority. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
9 more claims
Create a free account to see all 41 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 14
- It may state two separate claims as one. 20
- The quote only partly states this claim. 2
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Methods > Target audience and pilot participant recruitment
“we recruited medical residents from the specialties of Internal Medicine (IM), Family Medicine (FM), Obstetrics and Gynecology (OBGYN), Pediatrics (Peds), Emergency Medicine (EM)”
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Results
“| PHPM | | | 2 (11.1) | 2 (11.1) | |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Abstract > Results
“There were no significant differences in baseline confidence and self-efficacy across the three HCP disciplines, despite varied levels of education.”
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Results
“medical and pharmacy learner responses differed significantly in self-confidence before VSG2 (P < 0.05)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Abstract > Results
“Post-VSG confidence and self-efficacy (median: 5) were significantly higher than pre-VSG (median: 4–5) for all three HCP disciplines (P ≤ 0.0005)”
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Results
“| Medicine | Self-efficacy | Post | 32 | 4 (3–6) | < 0.0001 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Methods > Target audience and pilot participant recruitment
“undergraduate nursing students in their third and fourth year from the University of Calgary”
§ Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion > Results
“| 1st | 1 (4.2) | 0 (0.0) | 6 (33.3) | 7 (9.7) | |”
Citations
Cites
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615 · cited 1×
“The target sample size was calculated to be 30 participants from each discipline (medicine, nursing, and pharmacy) to participate in the pilot evaluation of the VSGs. Sample size targets were based on statistical analysis using G*Power [21].”
MethodSelf-efficacy: the exercise of control
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1826 · Cited by 24,281
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731 · cited 1×
“The use of pre-post measurements with Likert scale assessments introduces a potential for initial overconfi-dence bias and post-test overcorrection due to the Dun-ning-Kruger effect [23, 24], where a lack of knowledge can cause someone to overestimate their skills.”
Vaccine hesitancy: Definition, scope and determinants
MacDonald, N. E. (2015) · Vaccine · doi:10.1016/j.vaccine.2015.04.036 · Cited by 5,573 · cited 1×
“Prior to the COVID-19 pandemic, vaccine hesitancy (the delay in acceptance or refusal of vaccination despite vaccine availability) [1] was named one of the top ten global health concerns by the World Health Organization [2].”
BackgroundDeterminants of social desirability bias in sensitive surveys: a literature review
Krumpal, I. (2013) · Quality & Quantity · doi:10.1007/s11135-011-9640-9 · Cited by 2,860 · cited 1×
“Additionally, the use of ordinal Likert scales for self-assessments and a pre-post-test study design limits statistical analysis and introduces potential social desirability bias [28].”
MethodVaccine hesitancy: the next challenge in the fight against COVID-19
Dror, A. A., Eisenbach, N., Taiber, S., Morozov, N. G., Mizrachi, M., Zigron, A., Srouji, S., & Sela, E. (2020) · European Journal of Epidemiology · doi:10.1007/s10654-020-00671-y · Cited by 1,714 · cited 1×
“Following the pandemic, global vaccine hesitancy continues to be a significant factor preventing the public from vaccinating against infectious diseases such as COVID-19 [3, 4].”
BackgroundVaccine hesitancy and healthcare providers
Paterson, P., Meurice, F., Stanberry, L. R., Glismann, S., Rosenthal, S. L., & Larson, H. J. (2016) · Vaccine · doi:10.1016/j.vaccine.2016.10.042 · Cited by 897
The Architecture of Provider-Parent Vaccine Discussions at Health Supervision Visits
Opel, D. J., Heritage, J., Taylor, J. A., Mangione-Smith, R., Salas, H. S., DeVere, V., Zhou, C., & Robinson, J. D. (2013) · Pediatrics · doi:10.1542/peds.2013-2037 · Cited by 507
Virtual simulation in nursing education: a systematic review spanning 1996 to 2018
Foronda, C. L., Fernandez-Burgos, M., Nadeau, C., Kelley, C. N., & Henry, M. N. (2020) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0000000000000411 · Cited by 505 · cited 1×
“Virtual simulation games (VSGs) are a form of digital learning and have been used in clinical nursing education for many years [15], but their development and use have become increasingly common since the COVID-19 pandemic restricted in-person learning [16].”
BackgroundSelf-efficacy beliefs of medical students: a critical review
Klassen, R. M., & Klassen, J. R. L. (2018) · Perspectives on Medical Education · doi:10.1007/s40037-018-0411-3 · Cited by 224 · cited 1×
“While confidence generally describes “a strong self-perceived belief” and can be both positive or negative [11], self-efficacy describes “an individual’s belief in their capacity to execute behaviours necessary to produce specific outcomes” [12, 13].”
Background
Research works printed but not linked: 1
- COVID-19 pandemic. Fuels largest continued backslide in vaccinations in three decades [press release]. Word Health Organization. Geneva/New York, 15 JUL 2022 2022.
Cited by
Chen, B., Zhang, H., & Li, S. (2024) · Education Sciences · doi:10.3390/educsci14111232 · Cited by 27
See, K. C. (2024) · Vaccines · doi:10.3390/vaccines12091038 · Cited by 11
“These simulation games aim to increase confidence and self-efficacy in health communication about COVID-19 vaccination [43].”
BackgroundDoucette, E. J., Pateman, M., Fullerton, M. M., Lip, A., Houle, S. K. D., Kellner, J. D., Leal, J. R., MacDonald, S. E., McNeil, D. A., Davidson, S., et al. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1408871 · Cited by 4
Self-citationInnovative Technology to Improve Simulation Access for Rural Clinicians
Zanno, A. E., Holmes, J., Ferguson, M., et al. (2024) · Pediatric Clinics of North America · doi:10.1016/j.pcl.2024.07.023 · Cited by 2
Arthur, K. C., Wilson, K. B., Berry, B., Binion, B., Becker, M., Derus, A. J., Diop, S. L., Gacuiri, M., Green, B. B., Kone, A. G., et al. (2026) · Health Education Research · doi:10.1093/her/cyag004 · Cited by 1
“Our approach of organizing teams by self-identified race to tailor materials—which differs from other code-sign efforts to support COVID-19 vaccination [36, 44– 47]—led to insights about how shared racial background led to a sense of common ground.”
Metadata
- Authors
- Doucette, E. J., Fullerton, M. M., Pateman, M., Lip, A., Houle, S. K. D., Kellner, J. D., Leal, J., MacDonald, S. E., McNeil, D., Tyerman, J., Luctkar-Flude, M., Davidson, S., & Constantinescu, C.
- Affiliations
- University of Calgary (CA)
- University of Waterloo (CA)
- Alberta Health Services (CA)
- University of Alberta (CA)
- University of Ottawa (CA)
- Corresponding author
- Doucette, Emily J.
- ORCID
- Venue
- BMC Medical Education
- Published
- 2024-02-25
- Volume
- 24
- Issue
- 1
- Pages
- 190-190
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC10895736
- OpenAlex
- W4392140755
- Cited by
- 11
- References
- 23
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 4
- FWCI
- 3.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- other-oa
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- BMC Medical Education (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- uO Research (University of Ottawa) (submittedVersion, public-domain)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Libraries and Cultural Resources (University of Calgary) (submittedVersion)
- Funders
- Public Health Agency of Canada (Immunization Partnership Fund)
- Topics
- Social Sciences › Education › Simulation-Based Education in Healthcare
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- vaccine communication, vaccine hesitancy, self-efficacy, vaccine advocacy, vaccine promotion, healthcare education, nursing students, pharmacy students, medical residents
- MeSH terms
- Communication, Delivery of Health Care, Humans, Learning, Pilot Projects, Vaccines, Self Efficacy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion. https://app.cochat.ai/papers/10.1186/s12909-024-05169-9
- The paper
- Doucette, E. J., Fullerton, M. M., Pateman, M., Lip, A., Houle, S. K. D., Kellner, J. D., Leal, J., MacDonald, S. E., McNeil, D., Tyerman, J., Luctkar-Flude, M., Davidson, S., & Constantinescu, C. (2024). Development and evaluation of virtual simulation games to increase the confidence and self-efficacy of healthcare learners in vaccine communication, advocacy, and promotion. BMC Medical Education. https://doi.org/10.1186/s12909-024-05169-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.