Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 303 of the 308 references it cites were found in a registry or an index; 12 of the 157 sources its claims cite were checked for support.

A scoping review of artificial intelligence in medical education: BEME Guide No. 84

Open access

Abstract

BACKGROUND: Artificial Intelligence (AI) is rapidly transforming healthcare, and there is a critical need for a nuanced understanding of how AI is reshaping teaching, learning, and educational practice in medical education. This review aimed to map the literature regarding AI applications in medical education, core areas of findings, potential candidates for formal systematic review and gaps for future research. METHODS: This rapid scoping review, conducted over 16 weeks, employed Arksey and O'Malley's framework and adhered to STORIES and BEME guidelines. A systematic and comprehensive search across PubMed/MEDLINE, EMBASE, and MedEdPublish was conducted without date or language restrictions. Publications included in the review spanned undergraduate, graduate, and continuing medical education, encompassing both original studies and perspective pieces. Data were charted by multiple author pairs and synthesized into various thematic maps and charts, ensuring a broad and detailed representation of the current landscape. RESULTS: The review synthesized 278 publications, with a majority (68%) from North American and European regions. The studies covered diverse AI applications in medical education, such as AI for admissions, teaching, assessment, and clinical reasoning. The review highlighted AI's varied roles, from augmenting traditional educational methods to introducing innovative practices, and underscores the urgent need for ethical guidelines in AI's application in medical education. CONCLUSION: The current literature has been charted. The findings underscore the need for ongoing research to explore uncharted areas and address potential risks associated with AI use in medical education. This work serves as a foundational resource for educators, policymakers, and researchers in navigating AI's evolving role in medical education. A framework to support future high utility reporting is proposed, the FACETS framework.

Overview

CoChat Summary

TL;DR

This BEME scoping review maps 278 publications on artificial intelligence in medical education, finding a publication surge since 2018 and diverse applications across admissions, teaching, assessment, clinical reasoning, and large language model exam performance. It proposes the FACETS framework and calls for ethical guidelines and further research.

Key findings

  • The review included 278 publications: 191 (68.7%) articles/innovations and 87 (31.3%) perspectives. Geographic distribution was predominantly Anglo-North American (n = 138, 49.6%) and European (n = 51, 18.4%); no studies were identified from Africa. The earliest publication was in 1992, with a surge from 2018 onward and 114 publications as of August 2023.
  • AI applications included assessment (n = 50, 26.2%), knowledge/attitudes about AI (n = 51, 26.7%), teaching about AI or AI-augmented instruction (n = 34, 17.8%), LLM performance on medical exams (n = 32, 16.8%), clinical reasoning (n = 13, 6.8%), admissions/selection (n = 7, 3.6%), and automation of case/procedure logs (n = 4, 2.1%).
  • Technical use varied: AI was treated as a general concept without computation in 65 studies (34%); traditional ML in 41 (21.5%), deep learning in 81 (42.4%), NLP in 78 (40.8%), and data mining in 4 (2.1%). Under SAMR, AI was substitution in 36 (18.8%), augmentation in 34 (17.8%), modification in 10 (5.2%), redefinition in 11 (5.8%), and not applicable in 100 (52.4%).
  • LLM performance was variable: models scored at or above passing thresholds on some local, national, and specialty licensure exams but performed modestly or poorly on others; newer models generally outperformed older ones, though not universally, and performance was often better on English or translated questions (e.g., 22% accuracy in French vs. 73% in Italian). The review proposes the FACETS framework for future reporting.

Methods

  • Rapid scoping review conducted over 16 weeks, guided by Arksey and O’Malley’s framework refined by Levac et al., and reported per STORIES, BEME guidance, and PRISMA-ScR.
  • Searched PubMed/MEDLINE, EMBASE, and MedEdPublish without date or language restrictions. The database search yielded 2,123 publications; after duplicate removal, 2,019 remained; title/abstract screening narrowed to 310; full-text review excluded 70; 241 were included; hand-searching added 37, yielding 278 total. Screening was by author pairs with discrepancies resolved by consensus or third author; inter-rater reliability was j = 0.86.
  • Data were charted by multiple author pairs using a piloted extraction form. Articles/innovations and perspectives were charted separately and synthesized into thematic maps, charts, and narrative accounts; perspectives were categorized into five groups.

Limitations

  • The paper states that the scoping tradition does not synthesize evidence; there was subjectivity in categorizing studies; terminology was inconsistent; the search was iterated and studies may have been missed; inclusion of perspective articles may be perceived as diluting empirical strength; and the sixth stage of the Arksey and O’Malley framework (external expert consultation) was not performed, though author-team experts fulfilled this role.
  • The text also makes evident that the rapid 16-week timeframe and evolving AI literature may have limited comprehensiveness, and no studies were identified from Africa, indicating a geographic evidence gap.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/0142159x.2024.2314198

Cites

303 of 308 references verified4 citation errors · 1 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

9 Valid · 7 Not valid · 81 Not checked · 98 Own results and interpretations

55 more claims

Create a free account to see all 195 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 86
  • It may state two separate claims as one. 84
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

13 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 306 references

Research works printed but not linked: 3

  1. 10.1016/s1532-0464.(02)00004-7 · doi:10.1016/s1532-0464.(02)00004-7
  2. 10.1016/s0933-3657.(97)00054-7 · doi:10.1016/s0933-3657.(97)00054-7
  3. 10.1016/s2589-7500.(20)30023-6 · doi:10.1016/s2589-7500.(20)30023-6

Cited by

See all 679

Metadata

Authors
Gordon, M., Daniel, M., Ajiboye, A., Uraiby, H., Xu, N. Y., Bartlett, R., Hanson, J., Haas, M., Spadafore, M., Grafton-Clarke, C., Gasiea, R. Y., Michie, C., Corral, J., Kwan, B., Dolmans, D., & Thammasitboon, S.
Affiliations
  • University of Lancashire (GB)
  • University of California San Diego (US)
  • University Hospitals of Leicester NHS Trust (GB)
  • Washington University in St. Louis (US)
  • University of Michigan (US)
  • University of East Anglia
  • Blackpool Teaching Hospitals NHS Foundation Trust (GB)
  • University of Nevada, Reno (US)
  • Maastricht University (NL)
  • Baylor College of Medicine (US)
Corresponding author
Gordon, Morris
Venue
Medical Teacher
Published
2024-02-29
Volume
46
Issue
4
Pages
446-470
ISSN
  • 0142-159X (ISSN-L)
  • 1466-187X
OpenAlex
W4392769984
Cited by
679
References
306
Citations by year
2026: 395 · 2025: 238 · 2024: 43
FWCI
12.88
Type
journal article
Language
en
Open access
Locations
  • Medical Teacher (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • CLOK (University of Central Lancashire) (submittedVersion)
  • Digital Commons-TMC (Texas Medical Center) (submittedVersion)
  • Digital Commons@Becker (Washington University School of Medicine) (submittedVersion, cc-by-nc-nd)
  • Research Publications (Maastricht University) (submittedVersion, cc-by-nc-nd)
  • eScholarship (California Digital Library) (submittedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Education › Innovations in Medical Education
  • Social Sciences › Education › Artificial Intelligence in Education
Keywords
artificial intelligence, medical education, AI-assisted assessment, clinical reasoning, AI ethics, reporting framework, continuing medical education, undergraduate medical education, graduate medical education
MeSH terms
Artificial Intelligence, Education, Medical, Humans, Learning, Teaching

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A scoping review of artificial intelligence in medical education: BEME Guide No. 84. https://app.cochat.ai/papers/10.1080/0142159x.2024.2314198
The paper
Gordon, M., Daniel, M., Ajiboye, A., Uraiby, H., Xu, N. Y., Bartlett, R., Hanson, J., Haas, M., Spadafore, M., Grafton-Clarke, C., Gasiea, R. Y., Michie, C., Corral, J., Kwan, B., Dolmans, D., & Thammasitboon, S. (2024). A scoping review of artificial intelligence in medical education: BEME Guide No. 84. Medical Teacher. https://doi.org/10.1080/0142159x.2024.2314198

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.