CoChat

Application of AI Communication Training Tools in Medical Undergraduate Education: Mixed Methods Feasibility Study Within a Primary Care Context

Open access

The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.

Abstract

Background: Effective communication is fundamental to high-quality health care delivery, influencing patient satisfaction, adherence to treatment plans, and clinical outcomes. However, communication skills training for medical undergraduates often faces challenges in scalability, resource allocation, and personalization. Traditional methods, such as role-playing with standardized patients, are resource intensive and may not provide consistent feedback tailored to individual learners’ needs. Artificial intelligence (AI) offers realistic patient interactions for education. Objective: This study aims to investigate the application of AI communication training tools in medical undergraduate education within a primary care context. The study evaluates the effectiveness, usability, and impact of AI virtual patients (VPs) on medical students’ experience in communication skills practice. Methods: The study used a mixed methods sequential explanatory design, comprising a quantitative survey followed by qualitative focus group discussions. Eighteen participants, including 15 medical students and 3 practicing doctors, engaged with an AI VP simulating a primary care consultation for prostate cancer risk assessment. The AI VP was designed using a large language model and natural voice synthesis to create realistic patient interactions. The survey assessed 5 domains: fidelity, immersion, intrinsic motivation, debriefing, and system usability. Focus groups were used to explore participants’ experiences, challenges, and perceived educational value of the AI tool. Results: Significant positive responses emerged against a neutral baseline, with the following median scores: intrinsic motivation 16.5 of 20.0 (IQR 15.0‐18.0; d =2.09, P <.001), system usability 12.0 of 15.0 (IQR 11.5‐12.5; d =2.18, P <.001), and psychological safety 5.0 of 5.0 (IQR 5.0‐5.0; d =4.78, P <.001). Fidelity (median score 6.0/10.0, IQR 5.2‐7.0; d =–0.08, P =.02) and immersion (median score 8.5/15.0, IQR 7.0‐9.8; d =0.25 P =.08) were moderately rated. The overall Immersive Technology Evaluation Measure scores showed a high positive learning experience: median 47.5 of 65.0 (IQR 43.0‐51.2; d =2.00, P <.001). Qualitative analysis identified 3 major themes across 11 subthemes, with participants highlighting both technical limitations and educational value. Participants valued the safe practice environment and the ability to receive immediate feedback. Conclusions: AI VP technology shows promising potential for communication skills training despite the current realism limitations. While it does not yet match human standardized patient authenticity, the technology has achieved sufficient fidelity to support meaningful educational interactions, and this study identified clear areas for improvement. The integration of AI into medical curricula represents a promising avenue for innovation in medical education, with the potential to improve the quality and effectiveness of training programs.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/70766

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1. Participant recruitment and study protocol. AI: artificial intelligence; PSA: prostate-specific antigen.
Figure 1. Participant recruitment and study protocol. AI: artificial intelligence; PSA: prostate-specific antigen.CC BY · PubMed Central
Figure 2. Violin plot of raw domain scores versus a neutral benchmark.
Figure 2. Violin plot of raw domain scores versus a neutral benchmark.CC BY · PubMed Central
Figure 3. Thematic map displaying the interlinking themes and subthemes. AI: artificial intelligence.
Figure 3. Thematic map displaying the interlinking themes and subthemes. AI: artificial intelligence.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 49 references

Research works printed but not linked: 1

  1. Conover WJ . Practical Nonparametric Statistics. 3rd ed. Wiley; 1999.

Cited by

See all 20

Metadata

Authors
Jacobs, C., Johnson, H., Tan, N., Brownlie, K., Joiner, R., & Thompson, T.
Affiliations
  • University of Bath (GB)
  • University of Bristol (GB)
Corresponding author
Jacobs, Chris
Venue
JMIR Medical Education
Published
2025-10-24
Volume
11
Pages
e70766-e70766
ISSN
2369-3762 (ISSN-L)
OpenAlex
W4414088166
Cited by
20
References
49
Citations by year
2026: 20
FWCI
4.78
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Medical Education (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Education › Simulation-Based Education in Healthcare
  • Social Sciences › Education › Innovations in Medical Education
Keywords
primary care visits, prostate cancer risk assessment, large language models, speech synthesis, medical students, intrinsic motivation, system usability, psychological safety, immersive technologies, debriefing, standardized patients, simulation-based education, artificial intelligence in medical education, patient-provider communication
MeSH terms
Adult, Artificial Intelligence, Communication, Education, Medical, Undergraduate, Feasibility Studies, Female, Humans, Male, Physician-Patient Relations, Primary Health Care, Surveys and Questionnaires, Students, Medical, Focus Groups, Qualitative Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.