Algorithms on regulatory lockdown in medicine
The DOI matches its Crossref record; 8 of the 9 references it cites were found in a registry or an index.
Abstract
Prioritize risk monitoring to address the “update problem”
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“First, the lack of comprehensive oversight and accountability mechanisms for low-risk health-related AI systems may result in the wide emergence of ineffective, unproven, and potentially harmful AI systems [11].”
From The EU Artificial Intelligence Act (2024): Implications for healthcare (2024) · cites this paper as [11]
In the citing paper
“This means that all current AI applications are static models that can no longer adapt, and therefore, the approved product does not change over time.”
From Introduction to artificial intelligence in ultrasound imaging in obstetrics and gynecology (2020) · cites this paper as [57]
In the citing paper
“Regulatory bodies, including the FDA, currently approve only AI applications with models that have ‘locked’ parameters 56 , 57 .”
From Introduction to artificial intelligence in ultrasound imaging in obstetrics and gynecology (2020) · cites this paper as [57]
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Adversarial attacks on medical machine learning
Finlayson, S. G., Bowers, J. D., Ito, J., Zittrain, J. L., Beam, A. L., & Kohane, I. S. (2019) · Science · doi:10.1126/science.aaw4399 · Cited by 1,088 · cited 1×
“Further, describing how the distribution of patients may change is not something a maker may be able to do ex-ante because they usually do not know the distribution of the data that the algorithm will be applied to.”
BackgroundA Deep Learning Mammography-based Model for Improved Breast Cancer Risk Prediction
Yala, A., Lehman, C., Schuster, T., Portnoi, T., & Barzilay, R. (2019) · Radiology · doi:10.1148/radiol.2019182716 · Cited by 758
Towards Deep Neural Network Architectures Robust to Adversarial Examples
Gu, S., & Rigazio, L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.5068 · Cited by 622
Discriminative learning for differing training and test distributions
Bickel, S., Brückner, M., & Scheffer, T. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273507 · Cited by 387
Immune Activation with HIV Vaccines
Fauci, A. S., Marovich, M. A., Dieffenbach, C. W., Hunter, E., & Buchbinder, S. P. (2014) · Science · doi:10.1126/science.1250672 · Cited by 79
Cited by
Ethical and legal challenges of artificial intelligence-driven healthcare
Gerke, S., Minssen, T., & Cohen, G. (2020) · Artificial Intelligence in Healthcare · doi:10.1016/b978-0-12-818438-7.00012-5 · Cited by 1,170
“, concept drift, instability, and covariate shift) [84].”
Self-citationSwarm Learning for decentralized and confidential clinical machine learning
Warnat-Herresthal, S., Schultze, H., Shastry, K. L., Manamohan, S., Mukherjee, S., Garg, V., Sarveswara, R., Händler, K., Pickkers, P., Aziz, N. A., et al. (2021) · Nature · doi:10.1038/s41586-021-03583-3 · Cited by 884
Feng, J., Phillips, R. V., Malenica, I., Bishara, A., Hubbard, A. E., Celi, L. A., & Pirracchio, R. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00611-y · Cited by 423
Gerke, S., Babic, B., Evgeniou, T., & Cohen, I. G. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0262-2 · Cited by 359
Self-citationLippi, G., Henry, B. M., Bovo, C., & Sanchis-Gomar, F. (2020) · Diagnosis · doi:10.1515/dx-2020-0041 · Cited by 353
The EU Artificial Intelligence Act (2024): Implications for healthcare
van Kolfschooten, H., & van Oirschot, J. (2024) · Health Policy · doi:10.1016/j.healthpol.2024.105152 · Cited by 314
Introduction to artificial intelligence in ultrasound imaging in obstetrics and gynecology
Drukker, L., Noble, J. A., & Papageorghiou, A. T. (2020) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.22122 · Cited by 240
“Regulatory bodies, including the FDA, currently approve only AI applications with models that have ‘locked’ parameters 56,57 .”
BackgroundArtificial Intelligence and Liability in Medicine: Balancing Safety and Innovation
MALIHA, G., GERKE, S., COHEN, I. G., & PARIKH, R. B. (2021) · The Milbank Quarterly · doi:10.1111/1468-0009.12504 · Cited by 211
Self-citationEthical and Legal Challenges of Artificial Intelligence-Driven Healthcare
Gerke, S., Minssen, T., & Cohen, I. G. (2020) · doi:10.2139/ssrn.3570129 · Cited by 177
Self-citationThe European artificial intelligence strategy: implications and challenges for digital health
Cohen, I. G., Evgeniou, T., Gerke, S., & Minssen, T. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30112-6 · Cited by 169
Self-citationCharacteristics and challenges of the clinical pipeline of digital therapeutics
Patel, N. A., & Butte, A. J. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00370-8 · Cited by 143
Regulatory, safety, and privacy concerns of home monitoring technologies during COVID-19
Gerke, S., Shachar, C., Chai, P. R., & Cohen, I. G. (2020) · Nature Medicine · doi:10.1038/s41591-020-0994-1 · Cited by 126
Self-citationThe need for health AI ethics in medical school education
Katznelson, G., & Gerke, S. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-021-10040-3 · Cited by 125
Self-citationCybersecurity in the Internet of Medical Things
Thomasian, N. M., & Adashi, E. Y. (2021) · Health Policy and Technology · doi:10.1016/j.hlpt.2021.100549 · Cited by 153
“This type of tech can be vulnerable to subtle physical manipulation of the device ’ s visual field — such as by shining lasers – that can lead to decision making or classification errors [44,45].”
Education Policy Overcome Coronavirus, A Study of Indonesians
Wajdi, M. B. N., Kuswandi, I., Faruq, U., Zulhijra, Z., Khairudin, K., & Khoiriyah, K. (2020) · EDUTEC Journal of Education And Technology · doi:10.29062/edu.v3i2.42 · Cited by 172
“Thus, the risk of a corona virus transmission in communities outside the lockdown region can be reduced(Babic et al., 2019; Weil, 2003).”
BackgroundAI in the hands of imperfect users
Kostick-Quenet, K. M., & Gerke, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00737-z · Cited by 101
“These mismatches may be more dif fi cult to predict and account for in the case of AI tools than for traditional medical devices or pharmaceuticals whose performance is less contingent on user interactions and interpretations 12 , or whose adaptive algorithms continuously change 16 .”
BackgroundSelf-citationAlgorithm Change Protocols in the Regulation of Adaptive Machine Learning–Based Medical Devices
Gilbert, S., Fenech, M., Hirsch, M., Upadhyay, S., Biasiucci, A., & Starlinger, J. (2021) · Journal of Medical Internet Research · doi:10.2196/30545 · Cited by 100
Brady, A. P., Allen, B., Chong, J., Kotter, E., Kottler, N. E., Mongan, J., Oakden‐Rayner, L., dos Santos, D. P., Tang, A., Wald, C., et al. (2024) · Insights into Imaging · doi:10.1186/s13244-023-01541-3 · Cited by 119
“Pilot projects for AI registries are underway; better understanding of the importance of aggregation and analysis of AI performance signal over time is likely to increase end-user interest in registry participation and may be a cost effective option to support this cause.”
BackgroundStenzinger, A., Alber, M., Allgäuer, M., Jurmeister, P. S., Bockmayr, M. L., Budczies, J., Lennerz, J. K., Eschrich, J., Kazdal, D. N., Schirmacher, P., et al. (2021) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2021.02.011 · Cited by 102
Introduction to Artificial Intelligence and Machine Learning for Pathology
Harrison, J. H., Gilbertson, J. R., Hanna, M. G., Olson, N. H., Seheult, J. N., Sorace, J. M., & Stram, M. N. (2021) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2020-0541-cp · Cited by 82
Brady, A. P., Allen, B., Chong, J., Kotter, E., Kottler, N. E., Mongan, J., Oakden‐Rayner, L., dos Santos, D. P., Tang, A., Wald, C., et al. (2024) · Radiology Artificial Intelligence · doi:10.1148/ryai.230513 · Cited by 101
“…diagnostic event frequencies, with alerts raised when normal bounds are exceeded, or a control sample approach where a constant reserved held-out set of test case examples is routinely evaluated with the algo-rithm, to ensure no major deviations on known difficult or borderline cases (50).”
BackgroundIacucci, M., Santacroce, G., Zammarchi, I., Maeda, Y., Del Amor, R., Meseguer, P., Kolawole, B. B., Chaudhari, U., Di Sabatino, A., Danese, S., et al. (2024) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(24)00053-0 · Cited by 73
What Makes Artificial Intelligence Exceptional in Health Technology Assessment?
Bélisle-Pipon, J.-C., Couture, V., Roy, M.-C., Ganache, I., Goetghebeur, M., & Cohen, I. G. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.736697 · Cited by 70
“Using data from the health care system, AI can learn and recalibrate both its performance and behaviors, and over time inform and re fi ne the practices of the health care system (Babic et al., 2019).”
BackgroundMethodInfluentialSelf-citationTrust criteria for artificial intelligence in health: normative and epistemic considerations
Kostick, K. M., Lang, B. H., Smith, J. N., Hurley, M. E., & Blumenthal‐Barby, J. (2023) · Journal of Medical Ethics · doi:10.1136/jme-2023-109338 · Cited by 75
“38 Other scholars such as Babic et al 39 40 have called for examining human factors and other outcomes of using AI/ML in real world settings through the use of well-designed clinical trials.”
BackgroundFlexible and Context-Specific AI Explainability: A Multidisciplinary Approach
Beaudouin, V., Bloch, I., Bounie, D., Clémençon, S., d'Alché-Buc, F., Eagan, J., Maxwell, W., Mozharovskyi, P., & Parekh, J. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3559477 · Cited by 61
Singh, V., Cheng, S. C., Kwan, A. C., & Ebinger, J. E. (2025) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2025.100231 · Cited by 105
“25 Consequently, many devices may require changes that are beyond the scope of approved PCCPs, and the FDA will have to review modi fi ed PCCPs. 22 Currently, it takes the FDA 90 days to review 510(k)s, but it is unclear if PCCP reviews led by technical experts will be conducted in a shorter…”
A general framework for governing marketed AI/ML medical devices
Babic, B., Cohen, I. G., Stern, A. D., Li, Y., & Ouellet, M. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01717-9 · Cited by 78
“…to the change in the relationship between the population characteristics and the targetvariableunderstudy)and “ covariateshift ” (whichreferstothechange in the distribution of the population characteristics alone) and we address themandtheirrelevanceforerrorreportinginmoredetailbelow 9 – 13 .”
InfluentialSelf-citationGrote, G., Parker, S. K., & Crowston, K. (2024) · Academy of Management Review · doi:10.5465/amr.2023.0117 · Cited by 116
Awad, E., Levine, S., Anderson, M., Anderson, S. L., Conitzer, V., Crockett, M. J., Everett, J. A. C., Evgeniou, T., Gopnik, A., Jamison, J. C., et al. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.02.009 · Cited by 50
Self-citationBrady, A. P., Allen, B., Chong, J., Kotter, E., Kottler, N. E., Mongan, J., Oakden‐Rayner, L., dos Santos, D. P., Tang, A., Wald, C., et al. (2024) · Canadian Association of Radiologists Journal · doi:10.1177/08465371231222229 · Cited by 70
“50 At a very minimum, a clear reporting procedure for unexpected errors to the vendor, with named responsible contact personnel, should be established and made easily accessible to clinical end users.”
BackgroundGranlund, T., Stirbu, V., & Mikkonen, T. (2021) · SN Computer Science · doi:10.1007/s42979-021-00726-1 · Cited by 53
Navigating regulatory and policy challenges for AI enabled combination devices
Santra, S., Kukreja, P., Saxena, K., Gandhi, S., & Singh, O. V. (2024) · Frontiers in Medical Technology · doi:10.3389/fmedt.2024.1473350 · Cited by 65
Recent evolutions of machine learning applications in clinical laboratory medicine
Bruyne, S. D., Speeckaert, M. M., Biesen, W. V., & Delanghe, J. (2020) · Critical Reviews in Clinical Laboratory Sciences · doi:10.1080/10408363.2020.1828811 · Cited by 60
“Disadvantages include the instability of the system and the inability to check its accuracy and performance, as the algorithm is continuously changing, which leads to problems for licensing [11].”
BackgroundKumar, R., Waisberg, E., Ong, J., Paladugu, P., Amiri, D., Saintyl, J., Yelamanchi, J., Nahouraii, R., Jagadeesan, R., & Tavakkoli, A. (2024) · Brain Sciences · doi:10.3390/brainsci14121266 · Cited by 65
Brady, A. P., Allen, B., Chong, J., Kotter, E., Kottler, N., Mongan, J., Oakden‐Rayner, L., Pinto dos Santos, D., Tang, A., Wald, C., et al. (2024) · Journal of Medical Imaging and Radiation Oncology · doi:10.1111/1754-9485.13612 · Cited by 44
Bias Mitigation via Synthetic Data Generation: A Review
Hameed, M. A. S., Qureshi, A. M., & Kaushik, A. (2024) · Electronics · doi:10.3390/electronics13193909 · Cited by 70
Balancing Personal Privacy and Public Safety During COVID-19: The Case of South Korea
Ahn, N. Y., Park, J. E., Lee, D. H., & Hong, P. C. (2020) · IEEE Access · doi:10.1109/access.2020.3025971 · Cited by 43
“COVID-19 is an extraordinary circumstance that poses enormous public health risks—potentially affecting millions of people worldwide [10]–[12].”
BackgroundEis, S., Solà-Morales, O., Duarte‐Díaz, A., Vidal‐Alaball, J., Perestelo‐Pérez, L., Robles, N., & Carrión, C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19042186 · Cited by 45
Twala, B. (2025) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2025.1638340 · Cited by 54
“The FDA’s Software as a Medical Device (SaMD) framework guides AI-based diagnostic tools, emphasizing the importance of clinical validation, performance monitoring, and post-market surveillance (Babic et al., 2019).”
AI in Context: Harnessing Domain Knowledge for Smarter Machine Learning
Miller, T. I., Durlik, I., Łobodzińska, A., Dorobczyński, L., & Jasionowski, R. (2024) · Applied Sciences · doi:10.3390/app142411612 · Cited by 56
Exploring the potential of digital therapeutics: An assessment of progress and promise
Armeni, P., Polat, I., Rossi, L. M. D., Diaferia, L., Meregalli, S., & Gatti, A. M. (2024) · Digital Health · doi:10.1177/20552076241277441 · Cited by 46
Artificial intelligence and spine imaging: limitations, regulatory issues and future direction
Hornung, A. L., Hornung, C. M., Mallow, G. M., Barajas, J. N., Orías, A. A. E., Galbusera, F., Wilke, H., Colman, M. W., Phillips, F. M., An, H. S., et al. (2022) · European Spine Journal · doi:10.1007/s00586-021-07108-4 · Cited by 39
“This is likely based on the difficulty surrounding reviewing adaptations in “real-time” and ensuring that they can be seamlessly implemented into practice without alterations in patient safety or efficacy of the model [43, 46].”
Emerging Ethical Considerations for the Use of Artificial Intelligence in Ophthalmology
Evans, N. G., Wenner, D. M., Cohen, I. G., Purves, D., Chiang, M. F., Ting, D. S. W., & Lee, A. (2022) · Ophthalmology Science · doi:10.1016/j.xops.2022.100141 · Cited by 45
“Others have argued that regulation of AI should focus on continuous monitoring 19 with a system view that sees new AI as part of a larger network of actors and institutions and evaluates its performance in the context of that network.”
BackgroundSelf-citationAlgorithmovigilance, lessons from pharmacovigilance
Balendran, A., Benchoufi, M., Evgeniou, T., & Ravaud, P. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01237-y · Cited by 34
“However, we notethatcurrentregulationmainlypermitsmarketingapprovalforso-called lockedAIsystems 2 , although the FDA is investigating new regulations for adaptiveAIsystemsinhealthcare 41 .”
BackgroundMethodSelf-citationShould the Use of Adaptive Machine Learning Systems in Medicine be Classified as Research?
Sparrow, R., Hatherley, J. J., Oakley, J. G., & Bain, C. (2024) · The American Journal of Bioethics · doi:10.1080/15265161.2024.2337429 · Cited by 33
“The FDA’s proposal has itself been subject to criticism on a number of grounds (Babic et al. 2019; Gerke et al. 2020).”
BackgroundAquino, Y. S. J., Rogers, W., Jacobson, S. S., Richards, B. J., Houssami, N., Woode, M. E., Frazer, H. M. L., & Carter, S. M. (2024) · Health Policy and Technology · doi:10.1016/j.hlpt.2024.100892 · Cited by 31
Ho, C. W.-L., & Caals, K. (2021) · Seminars in Nephrology · doi:10.1016/j.semnephrol.2021.05.009 · Cited by 43
Exclusion cycles: Reinforcing disparities in medicine
Bracic, A., Callier, S., & Price, W. N. (2022) · Science · doi:10.1126/science.abo2788 · Cited by 32
Brady, A. P., Allen, B., Chong, J., Kotter, E., Kottler, N. E., Mongan, J., Oakden‐Rayner, L., dos Santos, D. P., Tang, A., Wald, C., et al. (2024) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.12.005 · Cited by 39
Implementing Ai Principles: Frameworks, Processes, and ToolsPreprint
Boza, P., & Evgeniou, T. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3783124 · Cited by 36
Self-citationThe lucent yet opaque challenge of regulating artificial intelligence in radiology
Hillis, J. M., Visser, J. J., Cliff, E. R. S., van der Geest, K., Bizzo, B. C., Dreyer, K. J., Adams‐Prassl, J., & Andriole, K. P. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01071-2 · Cited by 26
Michelson, K. N., Klugman, C. M., Kho, A. N., & Gerke, S. (2022) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2021.12.069 · Cited by 23
Self-citationNew Guidance on Responsible Use of AI
Palmieri, S., Robertson, C. T., & Cohen, I. G. (2025) · JAMA · doi:10.1001/jama.2025.23059 · Cited by 25
Self-citationFederation Opacity and the Promise of Federated Learning in Healthcare
Hatherley, J. J., Søgaard, A., Ballantyne, A., & Pauwels, R. (2026) · The American Journal of Bioethics · doi:10.1080/15265161.2026.2637093 · Cited by 28
“Finally, FL models that engage in continual learning present regulatory design challenges given that, unlike many pharmaceuticals and other health produces, the performance of these systems changes over time (Babic et al. 2019).”
Grote, G. (2023) · Ergonomics · doi:10.1080/00140139.2023.2278408 · Cited by 27
“…specific debate where ethical and design principles need to be carefully balanced concerns whether learning algorithms should only be updated periodically, rather than being left to learn incessantly from new data, in order to facilitate explainability and regulatory oversight (Babic et al. 2019).”
BackgroundMulti-scale digital twins for personalized medicine
Vallée, A. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1753906 · Cited by 24
“In parallel, regulatory sandboxes operated by health authorities offer controlled environments for testing cross-border digital health and AI systems under real-world conditions while maintaining regulatory oversight (46).”
Hatherley, J. J., & Sparrow, R. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac218 · Cited by 22
“A number of serious criticisms have been raised against the FDA’s proposed framework (Babic et al. 2019; Gerke et al. 2020).”
InfluentialOECD (2023) · OECD digital economy papers · doi:10.1787/2448f04b-en · Cited by 95
Strategies for Testing Intervention Matching Schemes in Cancer
Schork, N. J., Goetz, L. H., Lowey, J., & Trent, J. M. (2020) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1947 · Cited by 16
“, ‘ifthen’ propositions) are used or they are determined by complicated machine learning strategies (See the section on ‘Learning Systems’ below).[14, 42, 43]”
BackgroundCorporate Responsibility Meets the Digital EconomyPreprint
Lankoski, L., & Smith, N. C. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3845940 · Cited by 17
Mayer, L. M., Strich, J. R., Kadri, S. S., Lionakis, M. S., Evans, N. G., Prevots, D. R., & Ricotta, E. (2022) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofac401 · Cited by 20
Regulating AI Adaptation: An Analysis of AI Medical Device UpdatesPreprint
Wu, K., Wu, E., Rodolfa, K. T., Ho, D. E., & Zou, J. (2024) · medRxiv · doi:10.1101/2024.06.26.24309506 · Cited by 27
Mangalam, M. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103272 · Cited by 14
AI models and the future of genomic research and medicine: True sons of knowledge?
König, H., Frank, D., Baumann, M., & Heil, R. (2021) · BioEssays · doi:10.1002/bies.202100025 · Cited by 11
Rosen, K. L., & Mandl, K. D. (2025) · medRxiv · doi:10.1101/2025.08.26.25334477 · Cited by 13
New Innovation Models in Medical AIPreprint
Price, W. N., II, Sachs, R. E., & Eisenberg, R. S. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3783879 · Cited by 12
Sorin, V., Korfiatis, P. D., Bratt, A. K., Leiner, T., Wald, C., Butler, C. S., Cook, C. J., Kline, T. L., & Collins, J. D. (2025) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2025.06.036 · Cited by 13
Empowering photodynamic therapy with artificial intelligence: current trends and future directions
Paul, A., Xavierselvan, M., Aebisher, D., Kubrak, T. P., Bartusik‐Aebisher, D., & Mallidi, S. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1771804 · Cited by 8
“Traditional regulatory frameworks designed for static medical devices are poorly suited to AI systems that must learn from variable real-world data while adapting over time (266).”
Digital Twins for Organ Preservation Devices
Buhagiar, A. J., Freitas, L., Scott, W. E., III, & Larsen, P. G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19762-8_3 · Cited by 8
Maturity Framework for Operationalizing Machine Learning Applications in Health Care: Scoping Review
Li, Y., Tian, J., Xu, A., Greiner, R., Hayward, J., Greenshaw, A. J., & Cao, B. (2025) · Journal of Medical Internet Research · doi:10.2196/66559 · Cited by 14
“Human oversight must be present for the risk management of the MLOps implementation to ensure that the ML model is still performing to an acceptable standard before the redeployment of the new model [22].”
Artificial intelligence in human genomics and biomedicine: Dynamics, potentials and challenges
Heil, R., Heyen, N. B., Baumann, M., Hüsing, B., Bachlechner, D., Schmoch, U., & König, H. (2021) · TATuP - Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis · doi:10.14512/tatup.30.3.30 · Cited by 7
Artificial Intelligence in Healthcare
Aggarwal, N., Matheny, M. E., Shachar, C., Wang, S. X. Y., & Israni, S. T. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197579329.013.50 · Cited by 7
Becker, J., Gerke, S., & Cohen, I. G. (2023) · Collaborative bioethics · doi:10.1007/978-3-031-29451-8_24 · Cited by 6
Self-citationHo, C. W.-L. (2020) · The American Journal of Bioethics · doi:10.1080/15265161.2020.1820106 · Cited by 7
Xing, Z., Zhao, S., Guo, W., & Guo, X. (2021) · ACS Omega · doi:10.1021/acsomega.1c02213 · Cited by 7
Flexible and Context-Specific AI Explainability: A Multidisciplinary ApproachPreprint
Beaudouin, V., Bloch, I., Bounie, D., Clémençon, S., d’Alché–Buc, F., Eagan, J., Maxwell, W., Mozharovskyi, P., & Parekh, J. (2020) · arXiv (Cornell University) · Cited by 21
Negi, R., Chopra, D., Maheshwari, K., Mahajan, A., Badyal, D. K., & Venkataramani, P. (2025) · Medical Journal Armed Forces India · doi:10.1016/j.mjafi.2025.08.010 · Cited by 6
New case law and liability risks for manufacturers of medical AI
Gerke, S., & Simon, D. A. (2025) · Science · doi:10.1126/science.adu4932 · Cited by 4
Self-citationDisciplining Deliberation: A Socio-technical Perspective on Machine Learning Trade-Offs
Fazelpour, S. (2025) · The British Journal for the Philosophy of Science · doi:10.1086/734552 · Cited by 6
Ho, C. W.-L. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108620024.035 · Cited by 8
Wataganara, T., Rekhawasin, T., Sompagdee, N., Viboonchart, S., Phithakwatchara, N., & Nawapun, K. (2021) · Diagnostics · doi:10.3390/diagnostics11081511 · Cited by 5
Ethical and Legal Challenges of Digital Medicine in Pandemics
Minssen, T., & Gerke, S. (2023) · Springer eBooks · doi:10.1007/978-3-662-66872-6_12 · Cited by 5
Self-citationCohen, I. G., Slottje, A., & Gerke, S. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95068-8.00007-8 · Cited by 5
Self-citationWalking Backward to Ensure Risk Management of Large Language Models in Medicine
Onitiu, D., Wachter, S., & Mittelstadt, B. (2025) · The Journal of Law Medicine & Ethics · doi:10.1017/jme.2025.10132 · Cited by 7
“Following this reasoning, medical LLMs require more dynamic specifications for the intended use.”
Continuous learning as a threat to care
Sparrow, R., Daus, Z., Howard, M., Hatherley, J. J., & Kwan, P. (2025) · Health and Technology · doi:10.1007/s12553-025-01030-1 · Cited by 5
Ulizio, C., Dua, D., Mukul, N. M., Areti, S., Kostick, K. M., & Rahimzadeh, V. N. (2026) · JMIR AI · doi:10.2196/85163 · Cited by 5
Coombs, L. P., Brink, L., Kim, W., Wald, C., Schmidt, K., Tilkin, M., Dreyer, K., Cook, T. S., & Bizzo, B. C. (2026) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2026.04.024 · Cited by 3
Research ethics for AI in healthcare: how, when and who
Pifarré-Esquerda, F., Esquerda, M., & Garcia-Cuyas, F. (2025) · AI & Society · doi:10.1007/s00146-025-02198-w · Cited by 6
“For the case of updating models, those would pose the ethical problems referred to as “update problem” which would also beg for technical and system oversight (Babic et al. 2019), as it implies that the behavior of an already validated model and process could change with time as it is updated.”
Artificial Intelligence in the Medical Context: Who is the Agent in Charge?
Palmerini, E. M., & Lucchiari, C. (2022) · Integrated science · doi:10.1007/978-3-030-96814-4_24 · Cited by 3
Meszaros, J. G., Compagnucci, M. C., & Minssen, T. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108975452.007 · Cited by 9
Ding, J., Freeman, M., & Hasija, S. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3806478 · Cited by 3
Thiers, F. A., & Harned, Z. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/5ks37 · Cited by 8
Machine Learning in Medical Systems: Toward a Sociological Agenda
Hu, W. (2024) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197653609.013.28 · Cited by 5
The Clinical Considerations for Trustworthy AI in Oncologic Imaging
Bobowicz, M., Koh, D., Penzkofer, T., Regge, D., Riklund, K., Martínez-Gironés, P. M., Fütterer, J. J., Lekadir, K., Tsakou, G., & Martí‐Bonmatí, L. (2025) · Springer eBooks · doi:10.1007/978-3-031-89963-8_2 · Cited by 4
Labeling of Direct-to-Consumer Medical Artificial Intelligence Applications for “Self-Diagnosis”
Gerke, S. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009373234.014 · Cited by 2
Self-citationFuture Trends in Artificial Intelligence for Medical Applications
Chaudhuri, T., & Ghosh, J. (2025) · Advances in medical diagnosis, treatment, and care (AMDTC) book series · doi:10.4018/979-8-3693-9816-6.ch020 · Cited by 1
Artificial Intelligence in Clinical Trials: From Protocol Design to Pharmacovigilance
Schulman, A., Fernández‐Torras, A., Gadiya, Y., Saeed, K., Mestres, J., & Tanoli, Z. (2026) · Springer eBooks · doi:10.1007/978-3-031-98022-0_24 · Cited by 2
Improving medical data quality via synthetic data generation: a review
Qureshi, A. M., Kaushik, A., Loughran, R., McDaid, K., & McCaffery, F. (2026) · Network Modeling Analysis in Health Informatics and Bioinformatics · doi:10.1007/s13721-025-00723-x · Cited by 2
“In that case, the algorithm will produce ill-suited recommendations for the underrepresented group (Babic et al. 2019).”
Model and Simulation to Reduce Covid-19 New Infectious Cases: A Survey
Maulanza, H., Abidin, T. F., Mubarak, Z., & Abdullah, A. (2020) · doi:10.1109/iceltics50595.2020.9315493 · Cited by 1
Chegni, S. R., Fathi, M., & Servak, R. M. H. (2021) · Armaghane Danesh · doi:10.52547/armaghanj.25.s1.852 · Cited by 1
Metadata
- Authors
- Babic, B., Gerke, S., Evgeniou, T., & Cohen, I. G.
- Affiliations
- INSEAD (FR)
- Harvard University (US)
- Venue
- Science
- Published
- 2019-12-06
- Volume
- 366
- Issue
- 6470
- Pages
- 1202-1204
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2991775327
- Cited by
- 123
- References
- 9
- Citations by year
- 2026: 13 · 2025: 18 · 2024: 27 · 2023: 6 · 2022: 19 · 2021: 23 · 2020: 17
- FWCI
- 16.08
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- PhilSci-Archive (University of Pittsburgh) (acceptedVersion)
- bepress Legal Repository (submittedVersion)
- eYLS (Yale Law School) (submittedVersion)
- Funders
- Novo Nordisk Fonden (NNF17SA0027784)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Toxicology › Pharmacovigilance and Adverse Drug Reactions
- Health Sciences › Nursing › Issues, ethics and legal aspects › Biomedical Ethics and Regulation
- Keywords
- medical regulation, risk monitoring, algorithmic decision-making, medical device regulation
- MeSH terms
- Algorithms, Artificial Intelligence, Risk Management, Biomedical Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.