CoChat

The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index; 55 of the 72 sources its claims cite were checked for support.

What the AI era doctor should know: a scoping review of proposed artificial intelligence competencies for medical education

Open access

Published version of a preprint

Abstract

Artificial intelligence (AI) is rapidly reshaping healthcare and the competencies expected of graduating medical students, yet AI curricula and competency recommendations for undergraduate medical education (UME) remain fragmented. We conducted a PRISMA-ScR scoping review to map and synthesize proposed AI competencies for UME by performing a global search of PubMed, Embase, Web of Science, and ERIC without language restrictions and from database inception through July 28, 2025. Verbatim competency-relevant text was extracted and decomposed into discrete statements and classified using domains, competencies, or learning objectives. Statement frequencies were summarized to characterize recurring areas of emphasis, underrepresented topics, and cross-domain relationships. Of 4071 records identified, 54 studies from 22 countries met inclusion criteria. From 564 eligible statements, we synthesized a taxonomy comprising seven domains (AI ethics; AI law and regulation; AI professionalism in healthcare; clinical applications of AI; critical appraisal of AI output; research and innovation in AI; theory and foundations of AI) spanning 37 competencies and 170 learning objectives. Sources were predominantly editorial/opinion, with recurring emphasis on ethicolegal oversight, critical appraisal of AI outputs, and foundational understanding of AI methods and data. This synthesis provides a structured inventory to inform curriculum planning and future stakeholder-based refinement, prioritization, and evaluation.

Overview

CoChat Summary

TL;DR

This PRISMA-ScR scoping review mapped proposed AI competencies for undergraduate medical education from 54 studies across 22 countries, synthesizing 564 statements into 7 domains, 37 competencies, and 170 learning objectives. It provides a structured inventory emphasizing ethics/law, critical appraisal, and AI foundations, but the evidence base is mostly propositional and lacks implementation and outcome evaluation.

Key findings

  • From 4071 records identified, 54 studies from 22 countries met inclusion criteria; 564 eligible statements were synthesized into 7 domains, 37 competencies, and 170 learning objectives.
  • The seven domains were AI ethics; AI law and regulation; AI professionalism in healthcare; clinical applications of AI; critical appraisal of AI output; research and innovation in AI; and theory and foundations of AI.
  • Sources were predominantly editorial/opinion (24/54, 44.4%) and proposed or theoretical competencies (36/54, 66.7%); 29/54 (53.7%) were published in 2024–2025, with the largest contributions from the United States (16/54, 29.6%) and Germany (6/54, 11.1%).
  • Recurring emphasis was on ethicolegal oversight, critical appraisal of AI outputs, and foundational understanding of AI methods and data; linkage analysis showed clinical applications most strongly referenced critical appraisal (weight 5.08), and critical appraisal most strongly invoked theory and foundations (weight 3.65). Sensitivity analysis excluding editorial/opinion studies retained all 7 domains and all 37 competencies (domains ρ = 0.89; competencies ρ = 0.88).

Methods

  • Scoping review conducted using Arksey and O’Malley’s framework and reported per PRISMA-ScR; protocol registered on OSF (registration t62r5). Searches covered PubMed, Embase, Web of Science, and ERIC from database inception through July 28, 2025, without language restrictions.
  • Eligibility used the Population–Concept–Context framework: peer-reviewed literature proposing original AI-related competencies for undergraduate medical students; mixed-learner sources were included only when medical-student competencies were reported separately. Postgraduate-only, other health-professions, digital health without explicit AI, and non-original editorials/commentaries were excluded; reviews were excluded but their references were screened.
  • At least two reviewers independently screened titles/abstracts and full texts, with consensus and third-reviewer resolution. Verbatim competency-relevant text was decomposed into discrete statements, relevance-screened, classified as domain-, competency-, or learning-objective-level items, and synthesized via constant-comparison thematic synthesis; quantitative summaries used descriptive prevalence and study-normalized frequencies, with a sensitivity analysis excluding editorial/opinion studies.

Limitations

  • The paper states that no formal risk-of-bias assessment was performed; the taxonomy reflects published proposals rather than a validated or stakeholder-endorsed framework. Included studies varied widely in defining and structuring competencies and often provided limited implementation detail, precluding strong conclusions about optimal implementation or feasibility. Inter-rater reliability was modest at early screening (κ = 0.32 for title/abstract; κ = 0.53 for full-text eligibility) and moderate for level classification (κ = 0.55), with high reliability for domain assignment (κ = 0.82); machine translation may have lost nuance, and prevalence patterns reflect literature emphasis rather than intrinsic priority.
  • Evident from the text: most included sources were editorial/opinion (24/54, 44.4%) and proposed-only/theoretical (36/54, 66.7%), with few pilot-tested curricula (6/54, 11.1%) or outcome-evaluated studies (8/54, 14.8%), limiting conclusions about educational effectiveness and real-world implementation.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/s41746-026-02761-9

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

16 Valid · 1 Not valid · 5 Not checked · 153 Own results and interpretations

95 more claims · 6 with their cited sources checked

Create a free account to see all 175 claims and to verify the 2 references still open.

See all claims — free account
  • Probably not a substantial claim. 53
  • It may state two separate claims as one. 36
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 36 references

Cited by

See all 13

Metadata

Authors
Hunt, V. M., Sprehe, L. K., de Lomba, W. C., Gameiro, R. R., Woite, N. L., Wade, C. G., Chen, J. H., Rougas, S. C., Fraser, H. S. F., Sullivan, A. M., & Fregni, F.
Affiliations
  • Brown University (US)
  • Harvard University (US)
  • Yale University (US)
  • Stanford Medicine (US)
  • Beth Israel Deaconess Medical Center (US)
Venue
npj Digital Medicine
Published
2026-05-12
Volume
9
Issue
1
ISSN
2398-6352 (ISSN-L)
OpenAlex
W7160937423
Cited by
10
References
32
Citations by year
2026: 10
FWCI
19.00
Type
journal article
Language
en
Open access
Licence
Locations
  • npj Digital Medicine (publishedVersion, cc-by)
  • Research Square (acceptedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
  • National Institutes of Health (UM1TR004921)
  • Stanford Bio-X
  • National Institute of Allergy and Infectious Diseases (R01AI178121)
  • National Institute of Neurological Disorders and Stroke (U01NS134358)
  • National Center for Advancing Translational Sciences
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Education › Innovations in Medical Education
  • Health Sciences › Health Professions › General Health Professions › Health and Medical Education
Keywords
artificial intelligence in healthcare, AI competencies, undergraduate medical education, AI curriculum, competency taxonomy, AI ethics, clinical applications of AI, learning objectives

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-23, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-23 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: What the AI era doctor should know: a scoping review of proposed artificial intelligence competencies for medical education. https://app.cochat.ai/papers/10.1038/s41746-026-02761-9
The paper
Hunt, V. M., Sprehe, L. K., de Lomba, W. C., Gameiro, R. R., Woite, N. L., Wade, C. G., Chen, J. H., Rougas, S. C., Fraser, H. S. F., Sullivan, A. M., & Fregni, F. (2026). What the AI era doctor should know: a scoping review of proposed artificial intelligence competencies for medical education. npj Digital Medicine. https://doi.org/10.1038/s41746-026-02761-9

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.