Algorithms on regulatory lockdown in medicine
The DOI matches its Crossref record; 8 of the 9 references it cites were found in a registry or an index.
Abstract
Prioritize risk monitoring to address the “update problem”
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“First, the lack of comprehensive oversight and accountability mechanisms for low-risk health-related AI systems may result in the wide emergence of ineffective, unproven, and potentially harmful AI systems [11].”
From The EU Artificial Intelligence Act (2024): Implications for healthcare (2024) · cites this paper as [11]
In the citing paper
“This means that all current AI applications are static models that can no longer adapt, and therefore, the approved product does not change over time.”
From Introduction to artificial intelligence in ultrasound imaging in obstetrics and gynecology (2020) · cites this paper as [57]
In the citing paper
“Regulatory bodies, including the FDA, currently approve only AI applications with models that have ‘locked’ parameters 56 , 57 .”
From Introduction to artificial intelligence in ultrasound imaging in obstetrics and gynecology (2020) · cites this paper as [57]
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Adversarial attacks on medical machine learning
Finlayson, S. G., Bowers, J. D., Ito, J., Zittrain, J. L., Beam, A. L., & Kohane, I. S. (2019) · Science · doi:10.1126/science.aaw4399 · Cited by 1,088 · cited 1×
“Further, describing how the distribution of patients may change is not something a maker may be able to do ex-ante because they usually do not know the distribution of the data that the algorithm will be applied to.”
BackgroundA Deep Learning Mammography-based Model for Improved Breast Cancer Risk Prediction
Yala, A., Lehman, C., Schuster, T., Portnoi, T., & Barzilay, R. (2019) · Radiology · doi:10.1148/radiol.2019182716 · Cited by 758
Towards Deep Neural Network Architectures Robust to Adversarial Examples
Gu, S., & Rigazio, L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.5068 · Cited by 622
Discriminative learning for differing training and test distributions
Bickel, S., Brückner, M., & Scheffer, T. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273507 · Cited by 387
Immune Activation with HIV Vaccines
Fauci, A. S., Marovich, M. A., Dieffenbach, C. W., Hunter, E., & Buchbinder, S. P. (2014) · Science · doi:10.1126/science.1250672 · Cited by 79
Cited by
Ethical and legal challenges of artificial intelligence-driven healthcare
Gerke, S., Minssen, T., & Cohen, G. (2020) · Artificial Intelligence in Healthcare · doi:10.1016/b978-0-12-818438-7.00012-5 · Cited by 1,170
“, concept drift, instability, and covariate shift) [84].”
Self-citationSwarm Learning for decentralized and confidential clinical machine learning
Warnat-Herresthal, S., Schultze, H., Shastry, K. L., Manamohan, S., Mukherjee, S., Garg, V., Sarveswara, R., Händler, K., Pickkers, P., Aziz, N. A., et al. (2021) · Nature · doi:10.1038/s41586-021-03583-3 · Cited by 884
Feng, J., Phillips, R. V., Malenica, I., Bishara, A., Hubbard, A. E., Celi, L. A., & Pirracchio, R. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00611-y · Cited by 423
Gerke, S., Babic, B., Evgeniou, T., & Cohen, I. G. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0262-2 · Cited by 359
Self-citationLippi, G., Henry, B. M., Bovo, C., & Sanchis-Gomar, F. (2020) · Diagnosis · doi:10.1515/dx-2020-0041 · Cited by 353
Metadata
- Authors
- Babic, B., Gerke, S., Evgeniou, T., & Cohen, I. G.
- Affiliations
- INSEAD (FR)
- Harvard University (US)
- Venue
- Science
- Published
- 2019-12-06
- Volume
- 366
- Issue
- 6470
- Pages
- 1202-1204
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2991775327
- Cited by
- 123
- References
- 9
- Citations by year
- 2026: 13 · 2025: 18 · 2024: 27 · 2023: 6 · 2022: 19 · 2021: 23 · 2020: 17
- FWCI
- 16.08
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- PhilSci-Archive (University of Pittsburgh) (acceptedVersion)
- bepress Legal Repository (submittedVersion)
- eYLS (Yale Law School) (submittedVersion)
- Funders
- Novo Nordisk Fonden (NNF17SA0027784)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Toxicology › Pharmacovigilance and Adverse Drug Reactions
- Health Sciences › Nursing › Issues, ethics and legal aspects › Biomedical Ethics and Regulation
- Keywords
- medical regulation, risk monitoring, algorithmic decision-making, medical device regulation
- MeSH terms
- Algorithms, Artificial Intelligence, Risk Management, Biomedical Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Algorithms on regulatory lockdown in medicine. https://app.cochat.ai/papers/10.1126/science.aay9547
- The paper
- Babic, B., Gerke, S., Evgeniou, T., & Cohen, I. G. (2019). Algorithms on regulatory lockdown in medicine. Science. https://doi.org/10.1126/science.aay9547
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.