Continual learning in medical devices: FDA's action plan and beyond
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) and machine learning (ML) software have the potential to improve patient care. An underlying algorithm can either be locked so that its function does not change, or adaptive, in which the AI and ML system performs continual learning. Continual learning, also known as lifelong learning, is a technique in which the decision logic of mathematical models is updated through new data while retaining previously learned knowledge.1,2 By contrast, locked AI and ML systems prevent the ability to learn from post approval, real-world data, and thus cannot improve over time in the same way as adaptive systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Systematic errors might also be reduced through continual learning11, whereby an ML-based system is continuously updated through new data while retaining previously learned knowledge12.”
From Mitigating bias in machine learning for medicine (2021) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312
Continual lifelong learning with neural networks: A review
Parisi, G. I., Kemker, R., Part, J. L., Kanan, C., & Wermter, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.012 · Cited by 3,117
Cruz Rivera, S., Liu, X., Chan, A.-W., Denniston, A. K., Calvert, M. J., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Darzi, A., Holmes, C., Yau, C., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1037-7 · Cited by 933
Rivera, S. C., Liu, X., Chan, A.-W., Denniston, A. K., & Calvert, M. J. (2020) · BMJ · doi:10.1136/bmj.m3210 · Cited by 463
Oren, O., Gersh, B. J., & Bhatt, D. L. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30160-6 · Cited by 316
Clinical applications of continual learning machine learning
Lee, C. S., & Lee, A. Y. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30102-3 · Cited by 254
Geographic Distribution of US Cohorts Used to Train Deep Learning Algorithms
Kaushal, A., Altman, R., & Langlotz, C. (2020) · JAMA · doi:10.1001/jama.2020.12067 · Cited by 239
Cited by
Feng, J., Phillips, R. V., Malenica, I., Bishara, A., Hubbard, A. E., Celi, L. A., & Pirracchio, R. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00611-y · Cited by 423
“To ensure the long-term reliability and effectiveness of AI/ML-based clinical algorithms, it is crucial that we establish systems for regular monitoring and maintenance 12 – 14 .”
BackgroundMitigating bias in machine learning for medicine
Vokinger, K. N., Feuerriegel, S., & Kesselheim, A. S. (2021) · Communications Medicine · doi:10.1038/s43856-021-00028-w · Cited by 269
Self-citationFederated benchmarking of medical artificial intelligence with MedPerf
Karargyris, A., Umeton, R., Sheller, M. J., Aristizabal, A., George, J., Wuest, A., Pati, S., Kassem, H., Zenk, M., Baid, U., et al. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00652-2 · Cited by 188
Koçak, B., Ponsiglione, A., Stanzione, A., Bluethgen, C., Santinha, J., Ugga, L., Huisman, M., Klontzas, M. E., Cannella, R., & Cuocolo, R. (2024) · Diagnostic and Interventional Radiology · doi:10.4274/dir.2024.242854 · Cited by 168
Temporal quality degradation in AI models
Vela, D., Sharp, A., Zhang, R., Nguyen, T., Hoang, A., & Pianykh, O. S. (2022) · Scientific Reports · doi:10.1038/s41598-022-15245-z · Cited by 168
Metadata
- Authors
- Vokinger, K. N., Feuerriegel, S., & Kesselheim, A. S.
- Affiliations
- Brigham and Women's Hospital (US)
- ETH Zurich (CH)
- Corresponding author
- Vokinger, Kerstin N
- Venue
- The Lancet Digital Health
- Publisher
- Elsevier BV
- Published
- 2021-06
- Volume
- 3
- Issue
- 6
- Pages
- e337-e338
- ISSN
- 2589-7500 (ISSN-L)
- OpenAlex
- W3159068118
- Cited by
- 95
- References
- 8
- Citations by year
- 2026: 22 · 2025: 13 · 2024: 19 · 2023: 14 · 2022: 21 · 2021: 6
- FWCI
- 13.12
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-nd
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor)
- Locations
- The Lancet Digital Health (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, cc-by-nc-nd)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by-nc-nd)
- ETH Zürich Research Collection
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- Swiss National Science Foundation
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- continual learning, medical devices, FDA regulatory policy, adaptive algorithms, artificial intelligence in healthcare, real-world data, lifelong learning
- MeSH terms
- Machine Learning, Algorithms, Delivery of Health Care, Equipment and Supplies, Feedback, Humans, Medical Informatics, Software, United States, United States Food and Drug Administration, Government Regulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Continual learning in medical devices: FDA's action plan and beyond. https://app.cochat.ai/papers/10.1016/s2589-7500(21)00076-5
- The paper
- Vokinger, K. N., Feuerriegel, S., & Kesselheim, A. S. (2021). Continual learning in medical devices: FDA's action plan and beyond. The Lancet Digital Health. https://doi.org/10.1016/s2589-7500(21)00076-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.