Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.

Benefit-Risk Reporting for FDA-Cleared Artificial Intelligence−Enabled Medical Devices

Open access
Lin, John C., Jain, Bhav, Iyer, Jay M., Rola, Ishan, Srinivasan, Anusha R., Kang, Chaerim, Patel, Heta, Parikh, Ravi B. · 2025 · JAMA Health Forum

Abstract

Importance: Devices enabled by artificial intelligence (AI) and machine learning (ML) are increasingly used in clinical settings, but there are concerns regarding benefit-risk assessment and surveillance by the US Food and Drug Administration (FDA). Objective: To characterize pre- and postmarket efficacy, safety, and risk assessment reporting for FDA-cleared AI/ML devices. Design and Setting: This was a cross-sectional study using linked data from FDA decision summaries and approvals databases, the FDA Manufacturer and User Facility Device Experience Database, and the FDA Medical Device Recalls Database for all AI/ML devices cleared by the FDA from September 1995 to July 2023. Data were analyzed from October to November 2024. Main Outcomes and Measures: AI/ML reporting of study design, data availability, efficacy, safety, bias assessments, adverse events, device recalls, and risk classification. Results: The analysis included data for all 691 AI/ML devices that received FDA clearance through 2023, with 254 (36.8%) cleared in or after 2021. Device summaries often failed to report study designs (323 [46.7%]), training sample size (368 [53.3%]), and/or demographic information (660 [95.5%]). Only 6 devices (1.6%) reported data from randomized clinical trials and 53 (7.7%) from prospective studies. Few premarket summaries contained data published in peer-reviewed journals (272 [39.4%]) or provided statistical or clinical performance, including sensitivity (166 [24.0%]), specificity (152 [22.0%]), and/or patient outcomes (3 [<1%]). Some devices reported safety assessments (195 [28.2%]), adherence to international safety standards (344 [49.8%]), and/or risks to health (42 [6.1%]). In all, 489 adverse events were reported involving 36 (5.2%) devices, including 458 malfunctions, 30 injuries, and 1 death. A total of 40 devices (5.8%) were recalled 113 times, primarily due to software issues. Conclusions and Relevance: This cross-sectional study suggests that despite increasing clearance of AI/ML devices, standardized efficacy, safety, and risk assessment by the FDA are lacking. Dedicated regulatory pathways and postmarket surveillance of AI/ML safety events may address these challenges.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1001/jamahealthforum.2025.3351

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure. Safety Standards Reported by US Food and Drug Administration Approved Artificial Intelligence/Machine Learning−Enabled Medical Devices ANSI indicates American National Standards Institute; IEC, International Electrotechnical Commission; NEMA, National Electrical Manufacturers Association; ISO, International Organization for Standardization.
Figure. Safety Standards Reported by US Food and Drug Administration Approved Artificial Intelligence/Machine Learning−Enabled Medical Devices ANSI indicates American National Standards Institute; IEC, International Electrotechnical Commission; NEMA, National Electrical Manufacturers Association; ISO, International Organization for Standardization.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 21 references

Research works printed but not linked: 1

  1. US Institute of Medicine, 2011, Medical Devices and the Public’s Health: The FDA 510(k) Clearance Process at 35 Years

Cited by

See all 57

Metadata

Authors
Lin, J. C., Jain, B., Iyer, J. M., Rola, I., Srinivasan, A. R., Kang, C., Patel, H., & Parikh, R. B.
Affiliations
  • University of Pennsylvania (US)
  • Stanford Medicine (US)
  • Harvard University (US)
  • The Ohio State University (US)
  • Brown University (US)
  • Emory University (US)
Corresponding author
Parikh, Ravi B.
Venue
JAMA Health Forum
Published
2025-09-26
Volume
6
Issue
9
Pages
e253351
ISSN
2689-0186 (ISSN-L)
OpenAlex
W4414542836
Cited by
42
References
21
Citations by year
2026: 41 · 2025: 1
FWCI
10.11
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JAMA Health Forum (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
Funders
  • U.S. Department of Defense
  • Prostate Cancer Foundation
  • Conquer Cancer Foundation
  • National Comprehensive Cancer Network
  • National Palliative Care Research Center
  • Arnold Ventures
  • Emerson Collective
  • G1 Therapeutics
  • Flatiron Health
  • National Institutes of Health
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
Keywords
machine learning, risk-benefit assessment, postmarket surveillance, medical device recall, adverse events, risk classification, safety standards, training data transparency
MeSH terms
Machine Learning, Artificial Intelligence, Cross-Sectional Studies, Equipment and Supplies, Equipment Safety, Humans, Product Surveillance, Postmarketing, United States, United States Food and Drug Administration, Risk Assessment, Device Approval

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Benefit-Risk Reporting for FDA-Cleared Artificial Intelligence−Enabled Medical Devices. https://app.cochat.ai/papers/10.1001/jamahealthforum.2025.3351
The paper
Lin, J. C., Jain, B., Iyer, J. M., Rola, I., Srinivasan, A. R., Kang, C., Patel, H., & Parikh, R. B. (2025). Benefit-Risk Reporting for FDA-Cleared Artificial Intelligence−Enabled Medical Devices. JAMA Health Forum. https://doi.org/10.1001/jamahealthforum.2025.3351

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.