CoChat

The Role of Large Language Models in Medical Education: Applications and Implications

Open access
Safranek, Conrad W, Sidamon-Eristoff, Anne Elizabeth, Gilson, Aidan, Chartash, David · 2023 · JMIR Medical Education

Published version of a preprint

The DOI matches its Crossref record; its reference list is not available.

Abstract

Large language models (LLMs) such as ChatGPT have sparked extensive discourse within the medical education community, spurring both excitement and apprehension. Written from the perspective of medical students, this editorial offers insights gleaned through immersive interactions with ChatGPT, contextualized by ongoing research into the imminent role of LLMs in health care. Three distinct positive use cases for ChatGPT were identified: facilitating differential diagnosis brainstorming, providing interactive practice cases, and aiding in multiple-choice question review. These use cases can effectively help students learn foundational medical knowledge during the preclinical curriculum while reinforcing the learning of core Entrustable Professional Activities. Simultaneously, we highlight key limitations of LLMs in medical education, including their insufficient ability to teach the integration of contextual and external information, comprehend sensory and nonverbal cues, cultivate rapport and interpersonal interaction, and align with overarching medical education and patient care goals. Through interacting with LLMs to augment learning during medical school, students can gain an understanding of their strengths and weaknesses. This understanding will be pivotal as we navigate a health care landscape increasingly intertwined with LLMs and artificial intelligence.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/50945

Cites

Statistics

Figures

Figure 1 Example of using ChatGPT to help brainstorm differential diagnoses (left). Follow-up questions could include, for example, which physical exam maneuvers (right), laboratory studies, or diagnostic tests could be used to narrow the selection of each differential diagnosis.
Figure 1 Example of using ChatGPT to help brainstorm differential diagnoses (left). Follow-up questions could include, for example, which physical exam maneuvers (right), laboratory studies, or diagnostic tests could be used to narrow the selection of each differential diagnosis.CC BY · PubMed Central
Figure 2 Example of using ChatGPT to generate an interactive medical practice case.
Figure 2 Example of using ChatGPT to generate an interactive medical practice case.CC BY · PubMed Central
Figure 3 Example of applying ChatGPT to past practice exams. In this case, the student is using a multiple-choice question from a previous midterm that they answered incorrectly. The answer key provided for the exam was insufficient at explaining the physiologic reasoning behind the correct answer.
Figure 3 Example of applying ChatGPT to past practice exams. In this case, the student is using a multiple-choice question from a previous midterm that they answered incorrectly. The answer key provided for the exam was insufficient at explaining the physiologic reasoning behind the correct answer.CC BY · PubMed Central
Figure 4 Demonstration of a negative use case. This example dialogue illustrates a scenario where a user requests the single most probable diagnosis in an ambiguous clinical scenario, and ChatGPT responds with an assertive and convincing, yet likely incorrect, response.
Figure 4 Demonstration of a negative use case. This example dialogue illustrates a scenario where a user requests the single most probable diagnosis in an ambiguous clinical scenario, and ChatGPT responds with an assertive and convincing, yet likely incorrect, response.CC BY · PubMed Central
Figure 5 Examples of how ChatGPT can be integrated into medical education: practicing differential diagnoses, streamlining the wide array of study resources to assist with devising a study plan, serving as a simulated patient or medical professor for interactive clinical cases, helping students review multiple-choice questions or generating new questions for additional practice, digesting lecture outlines and generating materials for flash cards, and organizing information into tables to help build scaffolding for students to connect new information to previous knowledge.
Figure 5 Examples of how ChatGPT can be integrated into medical education: practicing differential diagnoses, streamlining the wide array of study resources to assist with devising a study plan, serving as a simulated patient or medical professor for interactive clinical cases, helping students review multiple-choice questions or generating new questions for additional practice, digesting lecture outlines and generating materials for flash cards, and organizing information into tables to help build scaffolding for students to connect new information to previous knowledge.CC BY · PubMed Central
Figure 6 A few examples of how ChatGPT may be integrated into health care, derived from current news sources and research projects within the clinical informatics community.
Figure 6 A few examples of how ChatGPT may be integrated into health care, derived from current news sources and research projects within the clinical informatics community.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

References 28 · Cited by 233

Research works printed but not linked: 5

  1. BrantsTPopatACXuPOchFJDeanJLarge language models in machine translationProceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning2007EMNLP-CoNLLJune 2007Prague858867
  2. Ouyang, L, 2022, Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 27730
  3. Nori, H, arXiv.
  4. Jones, E, arXiv.
  5. Hersh, W, 2020, Health Systems Science. 2nd Edition, 105

Metadata

Authors
Safranek, C. W., Sidamon-Eristoff, A. E., Gilson, A., & Chartash, D.
Affiliations
  • Yale University (US)
  • University College Dublin (IE)
Corresponding author
Chartash, David
Venue
JMIR Medical Education
Published
2023-08-14
Volume
9
Pages
e50945
ISSN
2369-3762 (ISSN-L)
OpenAlex
W4385266429
Cited by
233
References
28
Citations by year
2026: 56 · 2025: 86 · 2024: 79 · 2023: 12
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Medical Education (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Yale University
  • National Institutes of Health
  • National Heart, Lung, and Blood Institute (T35HL007649)
  • National Institute of General Medical Sciences (T32GM136651)
  • National Institute of Diabetes and Digestive and Kidney Diseases (T35DK104689)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Education › Innovations in Medical Education
  • Social Sciences › Education › Artificial Intelligence in Education
Keywords
large language models, ChatGPT, medical education, medical students, differential diagnosis, preclinical curriculum, entrustable professional activities, artificial intelligence in healthcare

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Role of Large Language Models in Medical Education: Applications and Implications. https://app.cochat.ai/papers/10.2196/50945
The paper
Safranek, C. W., Sidamon-Eristoff, A. E., Gilson, A., & Chartash, D. (2023). The Role of Large Language Models in Medical Education: Applications and Implications. JMIR Medical Education. https://doi.org/10.2196/50945

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.