Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.

A scoping review of reporting gaps in FDA-approved AI medical devices

Open access

Abstract

Machine learning and artificial intelligence (AI/ML) models in healthcare may exacerbate health biases. Regulatory oversight is critical in evaluating the safety and effectiveness of AI/ML devices in clinical settings. We conducted a scoping review on the 692 FDA-approved AI/ML-enabled medical devices approved from 1995-2023 to examine transparency, safety reporting, and sociodemographic representation. Only 3.6% of approvals reported race/ethnicity, 99.1% provided no socioeconomic data. 81.6% did not report the age of study subjects. Only 46.1% provided comprehensive detailed results of performance studies; only 1.9% included a link to a scientific publication with safety and efficacy data. Only 9.0% contained a prospective study for post-market surveillance. Despite the growing number of market-approved medical devices, our data shows that FDA reporting data remains inconsistent. Demographic and socioeconomic characteristics are underreported, exacerbating the risk of algorithmic bias and health disparity.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41746-024-01270-x

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Trends in FDA licensing of AI/ML-enabled medical devices. The blue bars show the number of Food and Drug Administration (FDA) approvals for medical devices from 1995 to 2023. The red line plot shows the number of FDA approvals for AI/ML-enabled medical devices that are licensed for children. Total number of FDA approvals for AI/ML-enabled medical devices have increased steeply since 2016. FDA approvals for children-licensed devices have increased steadily since 2018.
Fig. 1 Trends in FDA licensing of AI/ML-enabled medical devices. The blue bars show the number of Food and Drug Administration (FDA) approvals for medical devices from 1995 to 2023. The red line plot shows the number of FDA approvals for AI/ML-enabled medical devices that are licensed for children. Total number of FDA approvals for AI/ML-enabled medical devices have increased steeply since 2016. FDA approvals for children-licensed devices have increased steadily since 2018.CC BY-NC-ND · PubMed Central
Fig. 2 FDA-assigned medical specialty. Distribution of medical specialties represented in 692 FDA approvals between 1995 and 2023.
Fig. 2 FDA-assigned medical specialty. Distribution of medical specialties represented in 692 FDA approvals between 1995 and 2023.CC BY-NC-ND · PubMed Central
Fig. 3 Reported information on intended subjects. Number of FDA summary documents providing relevant sociodemographic information about intended subjects of medical device. a Only 14 (2.0%) summary documents lacked clearly stated indications for the use of the medical device. b The majority (667; 96.4%) of the documents did not provide any information about race/ethnicity of intended subjects and how this may impact the application of the device. c The majority (686; 99.1%) of the documents did not provide any information about socioeconomic context of intended subjects.
Fig. 3 Reported information on intended subjects. Number of FDA summary documents providing relevant sociodemographic information about intended subjects of medical device. a Only 14 (2.0%) summary documents lacked clearly stated indications for the use of the medical device. b The majority (667; 96.4%) of the documents did not provide any information about race/ethnicity of intended subjects and how this may impact the application of the device. c The majority (686; 99.1%) of the documents did not provide any information about socioeconomic context of intended subjects.CC BY-NC-ND · PubMed Central
Fig. 4 Accessibility to publications supporting safety, efficacy, and transparency. Only few summary documents provide a means of accessing published scientific publication that validates the use of the medical device.
Fig. 4 Accessibility to publications supporting safety, efficacy, and transparency. Only few summary documents provide a means of accessing published scientific publication that validates the use of the medical device.CC BY-NC-ND · PubMed Central
Fig. 5 FDA approvals for pediatrics-licensed medical devices. The proportion of total FDA approvals a licensed for children is 10.0% b tested and validated in both children and adults is 19.4%. c Radiology has the highest representation among FDA-approved devices for children.
Fig. 5 FDA approvals for pediatrics-licensed medical devices. The proportion of total FDA approvals a licensed for children is 10.0% b tested and validated in both children and adults is 19.4%. c Radiology has the highest representation among FDA-approved devices for children.CC BY-NC-ND · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 54 references

Research works printed but not linked: 1

  1. Jiang, H. & Nachum, O. Identifying and correcting label bias in machine learning. Proc. Mach. Learn. Res. 108, 4621–4630 (2020).

Cited by

See all 226

Metadata

Authors
Muralidharan, V., Adewale, B. A., Huang, C. J., Nta, M. T., Ademiju, P. O., Pathmarajah, P., Hang, M. K., Adesanya, O., Abdullateef, R. O., Babatunde, A. O., Ajibade, A., Onyeka, S., Cai, Z. R., Daneshjou, R., & Olatunji, T.
Affiliations
  • Stanford Medicine (US)
  • University of Ibadan (NG)
  • Afe Babalola University (NG)
  • University College London (GB)
  • University of Illinois Urbana-Champaign (US)
Corresponding author
Muralidharan, Vijaytha
Venue
npj Digital Medicine
Published
2024-10-03
Volume
7
Issue
1
Pages
273-273
ISSN
2398-6352 (ISSN-L)
OpenAlex
W4403107901
Cited by
201
References
54
Citations by year
2026: 108 · 2025: 87 · 2024: 6
FWCI
4.53
Type
journal article
Language
en
Open access
Licence
Locations
  • npj Digital Medicine (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
Keywords
AI medical devices, FDA device approval, reporting gaps, algorithmic bias, health disparities, race and ethnicity, socioeconomic status, post-marketing surveillance, performance studies, transparency, machine learning in healthcare, regulatory oversight

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A scoping review of reporting gaps in FDA-approved AI medical devices. https://app.cochat.ai/papers/10.1038/s41746-024-01270-x
The paper
Muralidharan, V., Adewale, B. A., Huang, C. J., Nta, M. T., Ademiju, P. O., Pathmarajah, P., Hang, M. K., Adesanya, O., Abdullateef, R. O., Babatunde, A. O., Ajibade, A., Onyeka, S., Cai, Z. R., Daneshjou, R., & Olatunji, T. (2024). A scoping review of reporting gaps in FDA-approved AI medical devices. npj Digital Medicine. https://doi.org/10.1038/s41746-024-01270-x

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.