The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Benefit-Risk Reporting for FDA-Cleared Artificial Intelligence−Enabled Medical Devices
Open accessAbstract
Importance: Devices enabled by artificial intelligence (AI) and machine learning (ML) are increasingly used in clinical settings, but there are concerns regarding benefit-risk assessment and surveillance by the US Food and Drug Administration (FDA). Objective: To characterize pre- and postmarket efficacy, safety, and risk assessment reporting for FDA-cleared AI/ML devices. Design and Setting: This was a cross-sectional study using linked data from FDA decision summaries and approvals databases, the FDA Manufacturer and User Facility Device Experience Database, and the FDA Medical Device Recalls Database for all AI/ML devices cleared by the FDA from September 1995 to July 2023. Data were analyzed from October to November 2024. Main Outcomes and Measures: AI/ML reporting of study design, data availability, efficacy, safety, bias assessments, adverse events, device recalls, and risk classification. Results: The analysis included data for all 691 AI/ML devices that received FDA clearance through 2023, with 254 (36.8%) cleared in or after 2021. Device summaries often failed to report study designs (323 [46.7%]), training sample size (368 [53.3%]), and/or demographic information (660 [95.5%]). Only 6 devices (1.6%) reported data from randomized clinical trials and 53 (7.7%) from prospective studies. Few premarket summaries contained data published in peer-reviewed journals (272 [39.4%]) or provided statistical or clinical performance, including sensitivity (166 [24.0%]), specificity (152 [22.0%]), and/or patient outcomes (3 [<1%]). Some devices reported safety assessments (195 [28.2%]), adherence to international safety standards (344 [49.8%]), and/or risks to health (42 [6.1%]). In all, 489 adverse events were reported involving 36 (5.2%) devices, including 458 malfunctions, 30 injuries, and 1 death. A total of 40 devices (5.8%) were recalled 113 times, primarily due to software issues. Conclusions and Relevance: This cross-sectional study suggests that despite increasing clearance of AI/ML devices, standardized efficacy, safety, and risk assessment by the FDA are lacking. Dedicated regulatory pathways and postmarket surveillance of AI/ML safety events may address these challenges.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Even among regulated AI products, available evidence and disclosure are often insufficient to assess for bias and/or accuracy, underscoring the need for competency in the critical appraisal of resources19,20.”
From What the AI era doctor should know: a scoping review of proposed artificial intelligence competencies for medical education (2026) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Benjamens, S., Dhunnoo, P., & Meskó, B. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00324-0 · Cited by 1,215
Muehlematter, U. J., Daniore, P., & Vokinger, K. N. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30292-2 · Cited by 665
Goldsack, J. C., Coravos, A., Bakker, J. P., Bent, B., Dowling, A. V., Fitzer-Attas, C., Godfrey, A., Godino, J. G., Gujar, N., Izmailova, E., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0260-4 · Cited by 557
How Is ChatGPT’s Behavior Changing Over Time?
Chen, L., Zaharia, M., & Zou, J. (2024) · Harvard Data Science Review · doi:10.1162/99608f92.5317da47 · Cited by 507
How is ChatGPT's behavior changing over time?
Chen, L., Zaharia, M., & Zou, J. (2023) · arXiv · doi:10.48550/arxiv.2307.09009 · Cited by 507
Wu, E., Wu, K., Daneshjou, R., Ouyang, D., Ho, D. E., & Zou, J. (2021) · Nature Medicine · doi:10.1038/s41591-021-01312-x · Cited by 494
Joshi, G., Jain, A., Araveeti, S. R., Adhikari, S., Garg, H., & Bhandari, M. (2024) · Electronics · doi:10.3390/electronics13030498 · Cited by 294
Arya, S. S., Dias, S. B., Jelinek, H. F., Hadjileontiadis, L. J., & Pappa, A. (2023) · Biosensors and Bioelectronics · doi:10.1016/j.bios.2023.115387 · Cited by 187
Improving Medical Device Regulation: The United States and Europe in Perspective
SORENSON, C., & DRUMMOND, M. (2014) · The Milbank Quarterly · doi:10.1111/1468-0009.12043 · Cited by 170
Muehlematter, U. J., Blüthgen, C., & Vokinger, K. N. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00126-7 · Cited by 132
Research works printed but not linked: 1
- US Institute of Medicine, 2011, Medical Devices and the Public’s Health: The FDA 510(k) Clearance Process at 35 Years
Cited by
Muneer, A., Waqas, M. M., Saad, M. B., Showkatian, E., Bandyopadhyay, R., Xu, H. M., Li, W., Chang, J., Liao, Z., Haymaker, C., et al. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11522-9 · Cited by 28
Hunt, V. M., Sprehe, L. K., de Lomba, W. C., Gameiro, R. R., Woite, N. L., Wade, C. G., Chen, J. H., Rougas, S. C., Fraser, H. S. F., Sullivan, A. M., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02761-9 · Cited by 10
Lee, H., Handler, R., Mungle, T., & Hernandez‐Boussard, T. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag078 · Cited by 9
Maynard, S., Farrington, J., Raza, S., & Stanworth, S. J. (2026) · Transfusion Medicine Reviews · doi:10.1016/j.tmrv.2026.150961 · Cited by 8
Wi, C.-I., Overgaard, S. M., Malik, M., Watson, D., Sharma, D., Le‐Rademacher, J. G., Kelleher, D. P., Zheng, L., Ohde, J. W., Lynch, B., et al. (2026) · Journal of the National Medical Association · doi:10.1016/j.jnma.2026.04.001 · Cited by 6
Metadata
- Authors
- Lin, J. C., Jain, B., Iyer, J. M., Rola, I., Srinivasan, A. R., Kang, C., Patel, H., & Parikh, R. B.
- Affiliations
- University of Pennsylvania (US)
- Stanford Medicine (US)
- Harvard University (US)
- The Ohio State University (US)
- Brown University (US)
- Emory University (US)
- Corresponding author
- Parikh, Ravi B.
- Venue
- JAMA Health Forum
- Publisher
- American Medical Association (AMA)
- Published
- 2025-09-26
- Volume
- 6
- Issue
- 9
- Pages
- e253351
- ISSN
- 2689-0186 (ISSN-L)
- PMC
- PMC12475944
- OpenAlex
- W4414542836
- Cited by
- 42
- References
- 21
- Citations by year
- 2026: 41 · 2025: 1
- FWCI
- 10.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JAMA Health Forum (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- Funders
- U.S. Department of Defense
- Prostate Cancer Foundation
- Conquer Cancer Foundation
- National Comprehensive Cancer Network
- National Palliative Care Research Center
- Arnold Ventures
- Emerson Collective
- G1 Therapeutics
- Flatiron Health
- National Institutes of Health
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- machine learning, risk-benefit assessment, postmarket surveillance, medical device recall, adverse events, risk classification, safety standards, training data transparency
- MeSH terms
- Machine Learning, Artificial Intelligence, Cross-Sectional Studies, Equipment and Supplies, Equipment Safety, Humans, Product Surveillance, Postmarketing, United States, United States Food and Drug Administration, Risk Assessment, Device Approval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Benefit-Risk Reporting for FDA-Cleared Artificial Intelligence−Enabled Medical Devices. https://app.cochat.ai/papers/10.1001/jamahealthforum.2025.3351
- The paper
- Lin, J. C., Jain, B., Iyer, J. M., Rola, I., Srinivasan, A. R., Kang, C., Patel, H., & Parikh, R. B. (2025). Benefit-Risk Reporting for FDA-Cleared Artificial Intelligence−Enabled Medical Devices. JAMA Health Forum. https://doi.org/10.1001/jamahealthforum.2025.3351
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.