CoChat

Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review

Open access
Preiksaitis, Carl, Rose, Christian · 2023 · JMIR Medical Education

Published version of a preprint

The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index; 119 of the 161 sources its claims cite were checked for support.

Abstract

Background: Generative artificial intelligence (AI) technologies are increasingly being utilized across various fields, with considerable interest and concern regarding their potential application in medical education. These technologies, such as Chat GPT and Bard, can generate new content and have a wide range of possible applications. Objective: This study aimed to synthesize the potential opportunities and limitations of generative AI in medical education. It sought to identify prevalent themes within recent literature regarding potential applications and challenges of generative AI in medical education and use these to guide future areas for exploration. Methods: We conducted a scoping review, following the framework by Arksey and O'Malley, of English language articles published from 2022 onward that discussed generative AI in the context of medical education. A literature search was performed using PubMed, Web of Science, and Google Scholar databases. We screened articles for inclusion, extracted data from relevant studies, and completed a quantitative and qualitative synthesis of the data. Results: Thematic analysis revealed diverse potential applications for generative AI in medical education, including self-directed learning, simulation scenarios, and writing assistance. However, the literature also highlighted significant challenges, such as issues with academic integrity, data accuracy, and potential detriments to learning. Based on these themes and the current state of the literature, we propose the following 3 key areas for investigation: developing learners’ skills to evaluate AI critically, rethinking assessment methodology, and studying human-AI interactions. Conclusions: The integration of generative AI in medical education presents exciting opportunities, alongside considerable challenges. There is a need to develop new skills and competencies related to AI as well as thoughtful, nuanced approaches to examine the growing use of generative AI in medical education.

Overview

CoChat Summary

TL;DR

This scoping review synthesizes 41 articles published in 2023 on generative AI in medical education, identifying opportunities such as self-directed learning, simulation, and writing assistance alongside challenges including academic integrity, accuracy/hallucination, and potential learning harms. It proposes three future investigation areas: learners’ critical AI evaluation skills, rethinking assessment, and studying human-AI interaction.

Key findings

  • From 2761 unique titles, after removing 168 duplicates, 2593 studies were screened; 2425 were unrelated and 127 were excluded, yielding 41 included articles. Of these, 21/41 (51.2%) were opinion pieces and 20/41 (48.8%) were original research; 16 original research articles reported generative AI performance on standardized assessments. All included studies were published in 2023.
  • Thematic analysis identified potential benefits in test performance/preparation, novel learning strategies (personalized learning plans/materials, feedback, communication skills training, clinical image generation, medical humanities exercises), and writing/research assistance (assisting non-native speakers, translations, literature review/summarization).
  • Challenges included academic integrity concerns (cheating, technological plagiarism, need for policy and disclosure guidance), accuracy/dependability issues (reliance on training data, lack of up-to-date information, hallucination, unwarranted confidence, misinformation propagation, limited accuracy in specific areas), and potential detriments to learning (overdependence, assessment challenges, propagating inaccurate information, inequities in access).
  • The authors propose three key areas for investigation: developing learners’ AI literacy/critical appraisal and navigating uncertainty, considering implications for assessment, and exploring human-AI interaction.

Methods

  • Scoping review following the Arksey and O’Malley framework; searched PubMed, Web of Science, and Google Scholar for English-language articles published from January 1, 2022, to June 21, 2023, discussing generative AI in medical education.
  • The first 100 articles were independently screened by both authors based on titles and abstracts, yielding substantial agreement (Cohen kappa=0.76); one author screened the remaining studies, and a random subset of full-text articles was independently reviewed by the second author. Conflicts were resolved through discussion and consensus.
  • Data abstraction used a structured form; descriptive statistics summarized study demographics, and qualitative data underwent thematic analysis guided by Braun and Clarke, with themes and subthemes reported in Table 2.

Limitations

  • Stated: the search was restricted to English-language articles and to publications from 2022 onward, excluding earlier related literature such as natural language processing in medical education; thematic analysis has inherent subjectivity; the literature is rapidly evolving; and the lack of empirical studies limits definitive conclusions, with most benefits and challenges remaining speculative.
  • Evident: only 1 study examined learner attitudes toward generative AI in medical education, and no curricula specifically focusing on generative AI were found; most included articles were opinion pieces or speculative, limiting empirical grounding.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/48785

Cites

75 of 75 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 PRISMA (Preferred Reporting Items in Systemic Reviews and Meta-Analyses) flow diagram of search and screening for generative artificial intelligence (AI) in medical education articles.
Figure 1 PRISMA (Preferred Reporting Items in Systemic Reviews and Meta-Analyses) flow diagram of search and screening for generative artificial intelligence (AI) in medical education articles.CC BY · PubMed Central
Figure 2 Proposed areas of investigation focused on learners, educators, and relevant to both. AI: artificial intelligence.
Figure 2 Proposed areas of investigation focused on learners, educators, and relevant to both. AI: artificial intelligence.CC BY · PubMed Central

Verification

Claims the paper makes

33 Valid · 2 Not valid · 10 Not checked · 48 Own results and interpretations

30 more claims · 9 with their cited sources checked

Create a free account to see all 93 claims and to verify the 11 references still open.

See all claims — free account
  • Probably not a substantial claim. 39
  • It may state two separate claims as one. 25

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 75 references

Research works printed but not linked: 3

  1. 10.6145/jme.202303_27(1).0005 · doi:10.6145/jme.202303_27(1).0005
  2. OpenAIGPT-4 Technical ReportarXiv202303272023-06-01https://arxiv.org/abs/2303.08774v3
  3. Bloom, BS, 1956, Taxonomy of Educational Objectives: The Classification of Educational Goals

Cited by

Items 101–200 of 460

Metadata

Authors
Preiksaitis, C., & Rose, C.
Affiliations
Stanford Medicine (US)
Corresponding author
Preiksaitis, Carl
Venue
JMIR Medical Education
Published
2023-10-20
Volume
9
Pages
e48785
ISSN
2369-3762 (ISSN-L)
OpenAlex
W4387144847
Cited by
552
References
68
Citations by year
2026: 238 · 2025: 204 · 2024: 104 · 2023: 5
FWCI
5.54
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Medical Education (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Education › Artificial Intelligence in Education
  • Social Sciences › Education › Innovations in Medical Education
Keywords
generative AI, medical education, ChatGPT, academic integrity, self-directed learning, simulation-based training, writing support, critical evaluation of AI, assessment methods, human-AI interaction, AI competencies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-15, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-15 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.