Application of AI Communication Training Tools in Medical Undergraduate Education: Mixed Methods Feasibility Study Within a Primary Care Context
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Background: Effective communication is fundamental to high-quality health care delivery, influencing patient satisfaction, adherence to treatment plans, and clinical outcomes. However, communication skills training for medical undergraduates often faces challenges in scalability, resource allocation, and personalization. Traditional methods, such as role-playing with standardized patients, are resource intensive and may not provide consistent feedback tailored to individual learners’ needs. Artificial intelligence (AI) offers realistic patient interactions for education. Objective: This study aims to investigate the application of AI communication training tools in medical undergraduate education within a primary care context. The study evaluates the effectiveness, usability, and impact of AI virtual patients (VPs) on medical students’ experience in communication skills practice. Methods: The study used a mixed methods sequential explanatory design, comprising a quantitative survey followed by qualitative focus group discussions. Eighteen participants, including 15 medical students and 3 practicing doctors, engaged with an AI VP simulating a primary care consultation for prostate cancer risk assessment. The AI VP was designed using a large language model and natural voice synthesis to create realistic patient interactions. The survey assessed 5 domains: fidelity, immersion, intrinsic motivation, debriefing, and system usability. Focus groups were used to explore participants’ experiences, challenges, and perceived educational value of the AI tool. Results: Significant positive responses emerged against a neutral baseline, with the following median scores: intrinsic motivation 16.5 of 20.0 (IQR 15.0‐18.0; d =2.09, P <.001), system usability 12.0 of 15.0 (IQR 11.5‐12.5; d =2.18, P <.001), and psychological safety 5.0 of 5.0 (IQR 5.0‐5.0; d =4.78, P <.001). Fidelity (median score 6.0/10.0, IQR 5.2‐7.0; d =–0.08, P =.02) and immersion (median score 8.5/15.0, IQR 7.0‐9.8; d =0.25 P =.08) were moderately rated. The overall Immersive Technology Evaluation Measure scores showed a high positive learning experience: median 47.5 of 65.0 (IQR 43.0‐51.2; d =2.00, P <.001). Qualitative analysis identified 3 major themes across 11 subthemes, with participants highlighting both technical limitations and educational value. Participants valued the safe practice environment and the ability to receive immediate feedback. Conclusions: AI VP technology shows promising potential for communication skills training despite the current realism limitations. While it does not yet match human standardized patient authenticity, the technology has achieved sufficient fidelity to support meaningful educational interactions, and this study identified clear areas for improvement. The integration of AI into medical curricula represents a promising avenue for innovation in medical education, with the potential to improve the quality and effectiveness of training programs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior studies have demonstrated the technical feasibility of text-based VSPs and AI-assisted automated scoring systems.”
From Development and Validation of CPX-MATE: An End-to-End Medical Education Platform Integrating Voice-Based Virtual Patient Simulation and Automated Real-time Evaluation (2026) · cites this paper as [11]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · cited 1×
“The thematic analysis was conducted following the 6-step framework outlined by Braun and Clarke [30], encompassing getting familiarized with the data, generating initial codes, searching for themes, reviewing themes, defining and naming themes, and producing the final report.”
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · cited 1×
“Technological acceptance on the basis of reasoned action was first proposed as the technology acceptance model [38], which is used to explain the association between acceptance of a computer system and the behavioral intention thereof.”
The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior
Deci, E. L., & Ryan, R. M. (2000) · Psychological Inquiry · doi:10.1207/s15327965pli1104_01 · Cited by 34,210 · cited 1×
“Learning motivation can be seen as a mediator between technological acceptance and self-efficacy on the task [35, 36].”
Ayers, J. W., Poliak, A., Dredze, M., Leas, E. C., Zhu, Z., Kelley, J. B., Faix, D. J., Goodman, A. M., Longhurst, C. A., Hogarth, M., et al. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.1838 · Cited by 2,613 · cited 1×
“Advanced AI models can simulate emotions and empathy in their responses [7,43].”
Schön, D. A. (2017) · doi:10.4324/9781315237473 · Cited by 1,740
The online survey as a qualitative research tool
Braun, V., Clarke, V., Boulton, E., Davey, L., & McEvoy, C. (2021) · International Journal of Social Research Methodology · doi:10.1080/13645579.2020.1805550 · Cited by 1,619 · cited 1×
“Furthermore, the open-ended question dataset was analyzed on the basis of a study by Braun et al [31], who suggest that a reduced transcript length can be both concise and informative, retaining the unguarded perspectives of participants.”
The impact of simulation-based training in medical education: A review
Elendu, C., Amaechi, D. C., Okatta, A. U., Amaechi, E. C., Elendu, T. C., Ezeh, C. P., & Elendu, I. D. (2024) · Medicine · doi:10.1097/md.0000000000038813 · Cited by 994 · cited 2×
“AI platforms offer an opportunity to simulate such scenarios with high fidelity while ensuring accessibility and scalability, thus addressing key gaps in current educational approaches [14-16].”
Chiu, T. K. F. (2022) · Journal of Research on Technology in Education · doi:10.1080/15391523.2021.1891998 · Cited by 834 · cited 1×
“The high intrinsic motivation score suggests that students found the AI tool engaging and beneficial for their learning, which is crucial for the adoption of new educational technologies [34].”
Preiksaitis, C., & Rose, C. (2023) · JMIR Medical Education · doi:10.2196/48785 · Cited by 552 · cited 1×
“Previous studies have used AI in primary care education [17,18]; however, publications using advanced language models to simulate VP encounters remain limited, as the vast majority are discussion papers and viewpoints [19].”
Research works printed but not linked: 1
- Conover WJ . Practical Nonparametric Statistics. 3rd ed. Wiley; 1999.
Cited by
Sun, N., Zhou, X., Yang, Z., Zhou, Y., Ma, R., & Wang, Z. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1768518 · Cited by 5
“…no significant between-group differences were observed for Process scores, and improvements were limited to approximately 2–2.5 additional items compared with pre-intervention performance, consistent with prior reports of constrained short-term gains in higher-order communication skills (26, 27).”
InfluentialPallavi, L. C., Suryavanshi, C. A., Prabhu, K., Chauhan, A., Nayak, K. R., & Komattil, R. (2026) · PLoS ONE · doi:10.1371/journal.pone.0343202 · Cited by 3
“Integrating technology into medical education has become increasingly essential, especially for promoting active and flexible learning [6].”
Thind, B. S., Javidi, D., & Schwartz, L. M. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1830254 · Cited by 6
Jeong, I. H., Kim, H., & Hwang, H. (2026) · Kosin Medical Journal · doi:10.7180/kmj.26.173 · Cited by 2
“LLM-based virtual patients can simulate emotionally nuanced interactions, enabling learners to practice communication skills such as histo-ry-taking, delivering difficult news, shared clinical decision-making, and cross-cultural communication [35].”
AI-Simulated Patients for Training Shared Decision-Making: Feasibility Study in Medical Education
Herschbach, L., Wietek, T. F., Sonanini, A., Holderried, F., Albrecht, T., Herrmann, B., & Herrmann‐Werner, A. (2026) · JMIR Medical Education · doi:10.2196/100467 · Cited by 2
Metadata
- Authors
- Jacobs, C., Johnson, H., Tan, N., Brownlie, K., Joiner, R., & Thompson, T.
- Affiliations
- University of Bath (GB)
- University of Bristol (GB)
- Corresponding author
- Jacobs, Chris
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2025-10-24
- Volume
- 11
- Pages
- e70766-e70766
- ISSN
- 2369-3762 (ISSN-L)
- PMC
- PMC12551969
- OpenAlex
- W4414088166
- Cited by
- 20
- References
- 49
- Citations by year
- 2026: 20
- FWCI
- 4.78
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Simulation-Based Education in Healthcare
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- primary care visits, prostate cancer risk assessment, large language models, speech synthesis, medical students, intrinsic motivation, system usability, psychological safety, immersive technologies, debriefing, standardized patients, simulation-based education, artificial intelligence in medical education, patient-provider communication
- MeSH terms
- Adult, Artificial Intelligence, Communication, Education, Medical, Undergraduate, Feasibility Studies, Female, Humans, Male, Physician-Patient Relations, Primary Health Care, Surveys and Questionnaires, Students, Medical, Focus Groups, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.