The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
The need for a system view to regulate artificial intelligence/machine learning-based software as medical device
Open accessAbstract
Artificial intelligence (AI) and Machine learning (ML) systems in medicine are poised to significantly improve health care, for example, by offering earlier diagnoses of diseases or recommending optimally individualized treatment plans. However, the emergence of AI/ML in medicine also creates challenges, which regulators must pay attention to. Which medical AI/ML-based products should be reviewed by regulators? What evidence should be required to permit marketing for AI/ML-based software as a medical device (SaMD)? How can we ensure the safety and effectiveness of AI/ML-based SaMD that may change over time as they are applied to new data? The U.S. Food and Drug Administration (FDA), for example, has recently proposed a discussion paper to address some of these issues. But it misses an important point: we argue that regulators like the FDA need to widen their scope from evaluating medical AI/ML-based products to assessing systems. This shift in perspective—from a product view to a system view—is central to maximizing the safety and efficacy of AI/ML in health care, but it also poses significant challenges for agencies like the FDA who are used to regulating products, not systems. We offer several suggestions for regulators to make this challenging but important transition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Regulatory agencies are working on strategies to address”
From Artificial intelligence and endo-histo-omics: new dimensions of precision endoscopy and histology in inflammatory bowel disease (2024) · cites this paper as [112]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Moreover, when there is substantial human involvement in decision-making, it becomes even more challenging for regulators to determine the effects of the update of such devices (Gerke, Babic, Evgeniou, and Cohen, 2020) [85].”
From Ethical and legal challenges of artificial intelligence-driven healthcare (2020) · cites this paper as [85]
In the citing paper
“Furthermore, the dynamic learning capability of ML, which allows continuous improvement, has yet to be regulated.”
From Artificial intelligence and endo-histo-omics: new dimensions of precision endoscopy and histology in inflammatory bowel disease (2024) · cites this paper as [112]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Beyond computation: Information technology, organizational transformation and business performance
Brynjolfsson, E., & Hitt, L. M. (2000) · Journal of Economic Perspectives · doi:10.1257/jep.14.4.23 · Cited by 3,335
Abràmoff, M. D., Lavin, P. T., Birch, M., Shah, N., & Folk, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0040-6 · Cited by 1,638
Extraneous factors in judicial decisions
Danziger, S., Levav, J., & Avnaim-Pesso, L. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1018033108 · Cited by 1,431
Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection
Lehman, C. D., Wellman, R. D., Buist, D. S. M., Kerlikowske, K., Tosteson, A. N. A., & Miglioretti, D. L. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.5231 · Cited by 678
Artificial intelligence and machine learning in clinical development: a translational perspective
Shah, P., Kendall, F., Khozin, S., Goosen, R., Hu, J., Laramie, J., Ringel, M., & Schork, N. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0148-3 · Cited by 498
Artificial Intelligence in Health Care: Will the Value Match the Hype?
Emanuel, E. J., & Wachter, R. M. (2019) · JAMA · doi:10.1001/jama.2019.4914 · Cited by 237
Deep Thinking: Where Machine Intelligence Ends and Human Creativity Begins
Kasparov, G. (2017) · Cited by 128
Algorithms on regulatory lockdown in medicine
Babic, B., Gerke, S., Evgeniou, T., & Cohen, I. G. (2019) · Science · doi:10.1126/science.aay9547 · Cited by 123
Self-citation
Cited by
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212
“Additionally, because the usefulness of AI systems can depend heavily on how humans provide input and interpret output, regulators may require testing of human factors and adequate training for the human users of medical AI systems 105 .”
BackgroundKuleto, V., Ilić, M., Dumangiu, M., Ranković, M., Martins, O. M. D., Păun, D., & Mihoreanu, L. (2021) · Sustainability · doi:10.3390/su131810424 · Cited by 561
“For example, digital algorithmic applications and impact were evidenced to improve medical care for patients [21,22].”
BackgroundArtificially intelligent chatbots in digital mental health interventions: a review
Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.2013200 · Cited by 440
“As the FDA and American Psychiatric Association [139,140] issue guidance on these critical topics, there exists an opportunity for those applying AI in mental health care to incorporate ethical, safety, and efficacy standards and values into DMHIs.”
BackgroundPrecision medicine in the era of artificial intelligence: implications in chronic disease management
Subramanian, M., Wojtusciszyn, A., Favre, L., Boughorbel, S., Shan, J., Letaief, K. B., Pitteloud, N., & Chouchane, L. (2020) · Journal of Translational Medicine · doi:10.1186/s12967-020-02658-5 · Cited by 362
Economics of artificial intelligence in healthcare: Diagnosis vs. treatment
Khanna, N. N., Maindarkar, M. A., Viswanathan, V., Fernandes, J. F. E., Paul, S., Bhagawati, M., Ahluwalia, P., Ruzsa, Z., Sharma, A., Kolluri, R., et al. (2022) · Healthcare · doi:10.3390/healthcare10122493 · Cited by 347
“In AI-based design, AI explainability is of vital importance since most AI-based systems are black boxes; therefore one must show the explanations and justification of the results, such as where the lesions are by color codes (say heatmaps) or show which AI-based features are crucial and why, such as usage of LIME or…”
Background
Metadata
- Authors
- Gerke, S., Babic, B., Evgeniou, T., & Cohen, I. G.
- Affiliations
- Harvard University (US)
- INSEAD (SG)
- INSEAD (FR)
- Corresponding author
- Cohen, I. Glenn
- Venue
- npj Digital Medicine
- Published
- 2020-04-07
- Volume
- 3
- Issue
- 1
- Pages
- 53-53
- ISSN
- 2398-6352 (ISSN-L)
- PMC
- PMC7138819
- OpenAlex
- W3016012157
- Cited by
- 359
- References
- 11
- Citations by year
- 2026: 45 · 2025: 65 · 2024: 77 · 2023: 95 · 2022: 34 · 2021: 35 · 2020: 8
- FWCI
- 12.65
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- npj Digital Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PhilSci-Archive (University of Pittsburgh) (acceptedVersion)
- PhilPapers (PhilPapers Foundation) (submittedVersion)
- eYLS (Yale Law School) (submittedVersion, cc-by)
- eYLS (Yale Law School) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Novo Nordisk Fonden (NNF17SA0027784, NNF17SA027784)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- artificial intelligence in healthcare, machine learning, software as a medical device, medical device regulation, systems view, FDA, regulatory framework, safety and effectiveness, evidence requirements
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The need for a system view to regulate artificial intelligence/machine learning-based software as medical device. https://app.cochat.ai/papers/10.1038/s41746-020-0262-2
- The paper
- Gerke, S., Babic, B., Evgeniou, T., & Cohen, I. G. (2020). The need for a system view to regulate artificial intelligence/machine learning-based software as medical device. npj Digital Medicine. https://doi.org/10.1038/s41746-020-0262-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.