CoChat

Virtual Patient Simulations Using Social Robotics Combined With Large Language Models for Clinical Reasoning Training in Medical Education: Mixed Methods Study

Open access
Borg, Alexander, Georg, Carina, Jobs, Benjamin, Huss, Viking, Waldenlind, Kristin, Ruiz, Mini, Edelbring, Samuel, Skantze, Gabriel, Parodis, Ioannis · 2025 · Journal of Medical Internet Research

Published version of a preprint

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.

Abstract

Background: Virtual patients (VPs) are computer-based simulations of clinical scenarios used in health professions education to address various learning outcomes, including clinical reasoning (CR). CR is a crucial skill for health care practitioners, and its inadequacy can compromise patient safety. Recent advancements in large language models (LLMs) and social robots have introduced new possibilities for enhancing VP interactivity and realism. However, their application in VP simulations has been limited, and no studies have investigated the effectiveness of combining LLMs with social robots for CR training. Objective: The aim of the study is to explore the potential added value of a social robotic VP platform combined with an LLM compared to a conventional computer-based VP modality for CR training of medical students. Methods: A Swedish explorative proof-of-concept study was conducted between May and July 2023, combining quantitative and qualitative methodology. In total, 15 medical students from Karolinska Institutet and an international exchange program completed a VP case in a social robotic platform and a computer-based semilinear platform. Students’ self-perceived VP experience focusing on CR training was assessed using a previously developed index, and paired 2-tailed t test was used to compare mean scores (scales from 1 to 5) between the platforms. Moreover, in-depth interviews were conducted with 8 medical students. Results: The social robotic platform was perceived as more authentic (mean 4.5, SD 0.7 vs mean 3.9, SD 0.5; odds ratio [OR] 2.9, 95% CI 0.0-1.0; P=.04) and provided a beneficial overall learning effect (mean 4.4, SD 0.6 versus mean 4.1, SD 0.6; OR 3.7, 95% CI 0.1-0.5; P=.01) compared with the computer-based platform. Qualitative analysis revealed 4 themes, wherein students experienced the social robot as superior to the computer-based platform in training CR, communication, and emotional skills. Limitations related to technical and user-related aspects were identified, and suggestions for improvements included enhanced facial expressions and VP cases simulating multiple personalities. Conclusions: A social robotic platform enhanced by an LLM may provide an authentic and engaging learning experience for medical students in the context of VP simulations for training CR. Beyond its limitations, several aspects of potential improvement were identified for the social robotic platform, lending promise for this technology as a means toward the attainment of learning outcomes within medical education curricula.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/63312

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Violin plots illustrating distributions of scores from students’ responses to questions within quantitative themes (1 to 5) with regard to the social robotic platform versus VIC. Lines within violin plots denote median values and IQRs. Numbers at the bottom of the plots refer to mean values. Statistically significant P values are in italics format. Q: question; VIC: virtual interactive case simulator.
Figure 1 Violin plots illustrating distributions of scores from students’ responses to questions within quantitative themes (1 to 5) with regard to the social robotic platform versus VIC. Lines within violin plots denote median values and IQRs. Numbers at the bottom of the plots refer to mean values. Statistically significant P values are in italics format. Q: question; VIC: virtual interactive case simulator.CC BY · PubMed Central
Figure 2 Violin plots illustrating distributions of summary theme scores of quantitative themes (1 to 5) in the social robotic platform versus VIC. Lines within violin plots denote median values and IQRs. Numbers at the bottom of the plots denote mean values. Statistically significant P values are in italics format. VIC: virtual interactive case simulator.
Figure 2 Violin plots illustrating distributions of summary theme scores of quantitative themes (1 to 5) in the social robotic platform versus VIC. Lines within violin plots denote median values and IQRs. Numbers at the bottom of the plots denote mean values. Statistically significant P values are in italics format. VIC: virtual interactive case simulator.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 1

  1. BrownTMannBRyderNSubbiahMKaplanJDDhariwalPNeelakantanAShyamPSastryGAskellAAgarwalSHerbert-VossAKruegerGHenighanTChildRRameshAZieglerDMLanguage models are few-shot learners2020Advances in Neural Information Processing SystemsDecember 6-12, 2020Vancouver, BC18771901

Cited by

See all 51

Metadata

Authors
Borg, A., Georg, C., Jobs, B., Huss, V., Waldenlind, K., Ruiz, M., Edelbring, S., Skantze, G., & Parodis, I.
Affiliations
  • Karolinska University Hospital (SE)
  • Karolinska Institutet (SE)
  • Örebro University (SE)
  • KTH Royal Institute of Technology (SE)
Corresponding author
Parodis, Ioannis
Venue
Journal of Medical Internet Research
Published
2025-03-03
Volume
27
Pages
e63312
ISSN
1438-8871 (ISSN-L)
OpenAlex
W4408098677
Cited by
51
References
36
Citations by year
2026: 37 · 2025: 14
FWCI
32.82
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, other-oa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Education › Simulation-Based Education in Healthcare
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
Keywords
virtual patients, social robots, large language models, clinical reasoning training, medical students, computer simulation, communication skills, emotional competence, patient safety, health professions education, facial expressions
MeSH terms
Clinical Reasoning, Large Language Models, Adult, Education, Medical, Female, Humans, Language, Male, Robotics, Students, Medical, Sweden, Patient Simulation, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.