The Emotional and Behavioral Impact of Delivering Bad News to Virtual versus Real Standardized Patients: A Pilot Study
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Phenomenon: Virtual standardized patients (vSPs) are becoming increasingly common in medical education, though one limitation of vSPs is the artificiality of computer-based simulators. Past research on the use of vSPs has not clearly established whether learners have different emotional responses to real SPs (rSPs) compared with vSPs; however, understanding learners’ emotional responses to vSPs is important in providing realistic learning experiences and establishing the validity of this teaching and assessment tool. This study compared the emotional experiences of individuals who interacted with rSPs and vSPs. Approach: Sixty medical students at a medical school in the southeastern United States participated in the study. Participants were randomly assigned to deliver bad news to an rSP or vSP. The vSP for this study used a hybrid intelligence model that allowed a person to “inhabit” the vSP. Salivary cortisol and a self-report measure of mood—the Profile of Mood States, Second Edition (POMS 2)—were gathered before and after delivering the bad news. The SP and 2 independent evaluators rated the behavioral performance of each participant in real and virtual conditions. Participants also rated the performance of the SP. Findings: Participants in both conditions reported increased negative emotionality on the POMS 2 following the SP interaction. There were no significant between-group differences on the POMS 2 or salivary cortisol concentration following the SP interaction. Ratings by the SP and independent evaluators indicated that participants performed similarly on most interpersonal dimensions, except tone of voice. Participants perceived the vSP as less realistic than the rSP. Insights: These results suggest that medical students may have similar emotional and behavioral responses when delivering bad news to a vSP when compared to an rSP. These findings provide support for the continued use of vSPs in training learners to deliver bad news and other communication-based skills and to assess their performance on these tasks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Neither of these groups showed a significant difference between VSs and mannequins or RPs (SMD=–0.12; 95% CI –0.75 to 0.51; I2=88%; P<.001 for undergraduate and SMD=0.93; 95% CI –0.50 to 2.36 for nonundergraduate), with no significant subgroup difference at P=.19.”
Citations
Cites
More powerful procedures for multiple significance testing
Hochberg, Y., & Benjamini, Y. (1990) · Statistics in Medicine · doi:10.1002/sim.4780090710 · Cited by 2,715 · cited 1×
“test was used to control overall family-wise error rate and adjust p values.(24) All statistical models were fit”
MethodPlace illusion and plausibility can lead to realistic behaviour in immersive virtual environments
Slater, M. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2009.0138 · Cited by 2,691 · cited 1×
“Some have hypothesized that the ability of virtual environments to evoke strong situational plausibility and place illusion is central to their effectiveness as teaching or training tools.(19) Empirical evidence suggests that improvements to the realism of a vSP are associated with improvements in participant acceptab…”
BackgroundSalivary cortisol as a biomarker in stress research
Hellhammer, D. H., Wüst, S., & Kudielka, B. M. (2009) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2008.10.026 · Cited by 1,925 · cited 1×
“This finding—that participants’ subjective ratings of emotionality were greater but their salivary cortisol remained within the expected range—may be indicative of a time lag between psychological and endocrine stress responses as well as measurement of two related but different constructs here.(26) Regarding place il…”
BackgroundThe use of virtual patients to teach medical students history taking and communication skills
Stevens, A., Hernandez, J., Johnsen, K., Dickerson, R., Raij, A., Harrison, C., DiPietro, M., Allen, B., Ferdig, R., Foti, S., et al. (2006) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2006.03.002 · Cited by 221
A randomized trial of teaching clinical skills using virtual and live standardized patients
Triola, M., Feldman, H., Kalet, A. L., Zabar, S., Kachur, E. K., Gillespie, C., Anderson, M., Griesser, C., & Lipkin, M. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00421.x · Cited by 211
Efficacy of virtual patients in medical education: A meta-analysis of randomized studies
Consorti, F., Mancuso, R., Nocioni, M., & Piccolo, A. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.04.017 · Cited by 203 · cited 1×
“A recent meta-analysis suggests promising outcomes from early studies that evaluated vSPs as medical teaching tools, though effects were stronger for studies assessing clinical reasoning than for studies assessing communication and ethical reasoning.(8) Other recent studies have evaluated the use of vSPs to teach a va…”
Kron, F. W., Fetters, M. D., Scerbo, M. W., White, C. B., Lypson, M. L., Padilla, M. A., Gliva‐McConvey, G. A., Belfore, L. A., West, T. D., Wallace, A. M., et al. (2016) · Patient Education and Counseling · doi:10.1016/j.pec.2016.10.024 · Cited by 180
Do medical students respond empathetically to a virtual patient?
Deladisma, A. M., Cohen, M., Stevens, A., Wagner, P., Lok, B., Bernard, T., Oxendine, C., Schumacher, L., Johnsen, K., Dickerson, R., et al. (2007) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2007.01.021 · Cited by 160
Wind, L. A., van Dalen, J., Muijtjens, A. M. M., & Rethans, J. (2004) · Medical Education · doi:10.1111/j.1365-2923.2004.01686.x · Cited by 150
Cohen, D., Colliver, J. A., Marcy, M. S., Fried, E. D., & Swartz, M. H. (1996) · Academic Medicine · doi:10.1097/00001888-199601000-00052 · Cited by 115
Research works printed but not linked: 1
- Heuchert JP, 2012, The profile of mood states
Cited by
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Ryan, G. V., Callaghan, S., Rafferty, A., Higgins, M. F., Mangina, E., & McAuliffe, F. (2022) · Journal of Medical Internet Research · doi:10.2196/30082 · Cited by 242
“…The Netherlands Bogomolva et al [55] No significant between-group differences on the POMS o 2 or salivary cortisol concentration following the SP p interaction; students had similar emotional and behavioral responses when delivering bad news to SP or vSP q [56] Clinical skill—break-ing bad news”
Virtual Simulation in Undergraduate Medical Education: A Scoping Review of Recent Practice
Wu, Q., Wang, Y., Lu, L., Chen, Y., Long, H., & Wang, J. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.855403 · Cited by 184
“In addition to the above learning contexts and practical aspects, the remaining 18 articles (15, 21, 24, 27, 40, 41, 43, 54, 73, 77, 83, 87, 89, 95, 100, 102, 103, 105) reported the integration of VS into other case-based learning experiences in virtual patient-care settings.”
BackgroundMethodSociety for Simulation in Healthcare Guidelines for Simulation Training
Stefanidis, D., Cook, D. A., Motamedi, M. K., Muret-Wagstaff, S. L., Calhoun, A. W., Lauridsen, K. G., Paige, J. T., Lockey, A. S., Donoghue, A. J., Hall, A. K., et al. (2024) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0000000000000776 · Cited by 56
Metadata
- Authors
- O’Rourke, S. R., Branford, K. R., Brooks, T. L., Ives, L. T., Nagendran, A., & Compton, S. N.
- Affiliations
- Duke University (US)
- Mursion, Inc, San Francisco, California, USA
- Corresponding author
- O’Rourke, Sarah R.
- Venue
- Teaching and Learning in Medicine
- Publisher
- Informa UK Limited
- Published
- 2019-08-22
- Volume
- 32
- Issue
- 2
- Pages
- 139-149
- ISSN
- 1040-1334 (ISSN-L)
- 1532-8015
- OpenAlex
- W2969448755
- Semantic Scholar
- d4c901b8c1d5b9ed6fe8866d529c6cb3d6e00ff0
- Cited by
- 37
- References
- 25
- Citations by year
- 2026: 3 · 2025: 7 · 2024: 9 · 2023: 2 · 2022: 8 · 2021: 6 · 2020: 1 · 2019: 1
- FWCI
- 2.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Teaching and Learning in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Simulation-Based Education in Healthcare
- Social Sciences › Education › Innovations in Medical Education
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Keywords
- virtual standardized patients, breaking bad news, emotional responses, salivary cortisol, mood, medical students, communication skills training, interpersonal communication, perceived realism, tone of voice
- MeSH terms
- Adult, Communication, Female, Humans, Inservice Training, Male, Pilot Projects, Students, Medical, Truth Disclosure, User-Computer Interface
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Emotional and Behavioral Impact of Delivering Bad News to Virtual versus Real Standardized Patients: A Pilot Study. https://app.cochat.ai/papers/10.1080/10401334.2019.1652180
- The paper
- O’Rourke, S. R., Branford, K. R., Brooks, T. L., Ives, L. T., Nagendran, A., & Compton, S. N. (2020). The Emotional and Behavioral Impact of Delivering Bad News to Virtual versus Real Standardized Patients: A Pilot Study. Teaching and Learning in Medicine. https://doi.org/10.1080/10401334.2019.1652180
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.