The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index; 2 of the 7 sources its claims cite were checked for support.
The Clinician and Dataset Shift in Artificial Intelligence
Open accessAbstract
Dataset Shift in Clinical Trials This letter outlines how to identify, and potentially mitigate, common sources of “dataset shift” in machine-learning systems. This occurs when the model “training ...
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 of 7 cited sources checked · 1 supported · 0 flagged · accuracy not yet measured
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“A major driver of AI system malfunction is known as “dataset shift.”4,5”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
What the sources say
- Supportedcites [4] Subbaswamy A, Saria S. From development to deployment: dataset shift, causality, and shift-stable models in health AI. Biostatistics 2020; 21: 345– 52. 31742354 source
The paper’s opening discussion says shifts between training and deployment are common and can cause poor performance or dangerous decisions. It explicitly calls this problem of shifting conditions that prevent generalization “dataset shift,” supporting the citing sentence’s paraphrase. (LLM, conf=0.92)
- Not checked yetcites [5] Saria S, Subbaswamy A. Tutorial: safe and reliable machine learning. In: Proceedings of the conference on fairness, accountability, and transparency, January 29–31, 2019. New York: Association for Computing Machinery, 2019. DOI: 10.1056/NEJMc2104626
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: Most clinical AI systems today use machine learning.
- Supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This was a case in which dataset shift fundamentally altered the relationship between fevers and bacterial sepsis, leading the hospital’s clinical AI governing committee (which one of the authors of this letter chairs) to decommission its use.”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: In April 2020, the University of Michigan Hospital deactivated the Epic sepsis-alerting model because of spurious alerting owing to changes in patients’ demographic characteristics associated with the COVID-19 pandemic.
In the paper
“Artificial intelligence (AI) systems are now regularly being used in medical settings,1”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
What the sources say
- Not checked — no full text of the sourcecites [1] Rajkomar A, Dean J, Kohane I. Machine learning in medicine. N Engl J Med 2019; 380: 1347– 58. 30943338 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
- Probably not a substantial claim. 3
- It may state two separate claims as one. 2
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Successful recognition and mitigation of dataset shift require both vigilant clinicians and sound technical oversight through AI governance teams.4,5”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
What the sources say
- Partly supportedcites [4] Subbaswamy A, Saria S. From development to deployment: dataset shift, causality, and shift-stable models in health AI. Biostatistics 2020; 21: 345– 52. 31742354 sourceExperimental — accuracy not yet measured
Section 4, “Open Challenges and Looking Forward” (page not supplied), calls for monitoring to detect shifts, maintenance to address them, and collaboration with domain experts when constructing models. It does not say that vigilant clinicians and AI governance teams are both required for this work. (LLM, conf=0.86)
- Not checked yetcites [5] Saria S, Subbaswamy A. Tutorial: safe and reliable machine learning. In: Proceedings of the conference on fairness, accountability, and transparency, January 29–31, 2019. New York: Association for Computing Machinery, 2019. DOI: 10.1056/NEJMc2104626
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
- Partly supported
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“we group into changes in technology (e.g., software vendors), changes in population and setting (e.g., new demographics), and changes in behavior (e.g., new reimbursement incentives)”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“although regulatory oversight is inconsistent and undeveloped.2,3”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
What the sources say
- Not checked yetcites [2] Ross C Hospitals are using AI to predict the decline of Covid-19 patients — before knowing it works. Stat 4 24, 2020 (https://www.statnews.com/2020/04/24/coronavirus-hospitals-use-ai-to-predict-patient-decline-before-knowing-it-works/).
- Not checked yetcites [3] Artificial intelligence/machine learning (AI/ML)-based software as a medical device (SaMD) action plan Silver Spring, MD: Food and Drug Administration, January 2021 (https://www.fdagov/media/145022/download).
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Safe deployment of clinical AI requires informed clinician-users”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
- Rests on an assumption: Clinicians are generally responsible for identifying and reporting emerging problems with clinical AI.
The paper relies on this without support.
Clinicians are generally responsible for identifying and reporting emerging problems with clinical AI.
“who are generally responsible for identifying and reporting emerging problems.”
The paper relies on this without support.
Most clinical AI systems today use machine learning.
“Most clinical AI systems today use machine learning, algorithms that leverage statistical methods to learn key patterns from clinical data.”
The paper relies on this without support.
In April 2020, the University of Michigan Hospital deactivated the Epic sepsis-alerting model because of spurious alerting owing to changes in patients’ demographic characteristics associated with the COVID-19 pandemic.
“the University of Michigan Hospital implemented the widely used sepsis-alerting model developed by Epic Systems; in April 2020, the model had to be deactivated because of spurious alerting owing to changes in patients’ demographic characteristics associated with the coronavirus disease 2019 pandemic.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This quality becomes crucial when predictive models are deployed across different hospitals or healthcare systems, where variations in patient demographics, clinical practices, and data collection procedures can lead to inaccurate predictions [17, 18].”
From Toward generalizable and interpretable machine learning models in healthcare: Insights from ICU outcome predictions (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Small changes in the distribution of the underlying data between the algorithm training and clinical evaluation populations (i.e., dataset shift) can lead to substantial variation in clinical performance and expose patients to potential unexpected harm [21, 22].”
From Use of artificial intelligence in critical care: opportunities and obstacles (2024) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Finlayson et al. argue that dataset shift in medicine is “the rule rather than the exception,” driven by changes in care delivery, clinical incentives, and documentation rather than by random variation alone [8].”
From Validation is not enough: Longitudinal evidence of post-deployment fragility in clinical AI systems (2026) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Between 3 and 4 weeks after its first COVID-19 hospitalization, the University of Michigan paused ESM-generated alerts in April 2020 after nursing reports of overalerting.5”
From Quantification of Sepsis Model Alerts in 24 US Hospitals Before and During the COVID-19 Pandemic (2021) · cites this paper as [5]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Finlayson et al 55 have argued that clinicians who are well-prepared to recognize when AI tools are misbehaving are essential partners in safe deployment, and that institutions need governance structures, monitoring protocols, and clear pathways for frontline staff to escalate concerns.”
From Artificial Intelligence in Oncology: Practical Applications Across Clinical Care, Scholarship, and Translation. (2026) · cites this paper as [55]
The cited source says what the claim attributes to it.
In the citing paper
“Understanding persistence and degradation is perhaps particularly critical for ML models, where dataset shift should be expected to cause declines in performance when the data used to train a model begins to look different from the data in a new context [8].”
From Managing a 'responsibility vacuum' in AI monitoring and governance in healthcare: a qualitative study (2025) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“This supports a workflow-aware interpretation of post-deployment fragility: degradation may be linked to how data are produced within evolving workflows and information systems, not only to who the patients are [8,18,33,35].”
From Validation is not enough: Longitudinal evidence of post-deployment fragility in clinical AI systems (2026) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“As AI solutions have emerged, a wide variety of governance best practices in the form of frameworks, governance structures, checklists, and guidelines have been proposed7–23.”
From Advancing healthcare AI governance through a comprehensive maturity model based on systematic review (2026) · cites this paper as [15]
The cited source says what the claim attributes to it.
In the citing paper
“It is well-known that such models may not generalize across settings or over time due to changes in patient populations, practice patterns, and data processes — a phenomenon known as dataset shift.1”
From Challenges in the postmarket surveillance of clinical prediction models. (2025) · cites this paper as [1]
In the citing paper
“The healthcare landscape is constantly changing; therefore, there is no guarantee that an AI algorithm with high performance will maintain its high performance in the future [89].”
From Fairness of artificial intelligence in healthcare: review and recommendations (2024) · cites this paper as [89]
In the citing paper
“The models should be monitored regularly to address biases that may emerge over time [89].”
From Fairness of artificial intelligence in healthcare: review and recommendations (2024) · cites this paper as [89]
In the citing paper
“Consequently, these changes necessitate the periodic retraining and re-evaluation of AI systems to maintain their relevance and efficacy [69, 70].”
From Integrating machine learning and artificial intelligence in life-course epidemiology: pathways to innovative public health solutions (2024) · cites this paper as [70]
In the citing paper
“The dynamic nature of clinical practice, fluctuations in the prevalence of comorbidities, and various socio-environmental factors can precipitate shifts in the distribution of patient characteristics.”
From Integrating machine learning and artificial intelligence in life-course epidemiology: pathways to innovative public health solutions (2024) · cites this paper as [70]
In the citing paper
“Laboratory performance does not always translate directly to clinical practice [142,143,144,145,146].”
From Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery (2025) · cites this paper as [144]
Citations
Cites
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579
Self-citationFrom development to deployment: dataset shift, causality, and shift-stable models in health AI
Subbaswamy, A., & Saria, S. (2019) · Biostatistics · doi:10.1093/biostatistics/kxz041 · Cited by 276
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- Saria S Subbaswamy A. Tutorial: safe and reliable machine learning. In: Proceedings of the conference on fairness accountability and transparency January 29–31 2019. New York: Association for Computing Machinery 2019.
Cited by
Sorted by citations
Items 401–500 of 848
Transforming healthcare through in-body bioelectronic systems
Ceto, S., Elshove, S. A., Wu, M., Ramadi, K. B., Tondera, C., Minev, I. R., Srinivasan, S. S., Lee, K., Gora, M. J., Rogers, J. A., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-71188-3 · Cited by 3
Clinical trials for continuously monitored and updated AI systems
van Amsterdam, W. A. C., Oberst, M., Feng, J., Wiens, J., Tang, S., Joshi, S. D., Ranganath, R., Sendak, M., Shalit, U., Vogt, J. E., et al. (2026) · Nature Medicine · doi:10.1038/s41591-026-04368-9 · Cited by 3
Brusnic, O., Boicean, A., Ichim, C., Anderco, P., & Onișor, D. M. (2026) · Life · doi:10.3390/life16050845 · Cited by 4
Educational Frameworks for Diagnostic Decision-Making in AI-Enhanced Head and Neck Pathology
Tavares, T., Sangalli, L., Menon, R. S., Miller, C. S., & Hochman, G. (2026) · Head and Neck Pathology · doi:10.1007/s12105-026-01909-z · Cited by 3
Seuren, L. M., Williams, R., & Cresswell, K. M. (2026) · BMJ Digital Health & AI · doi:10.1136/bmjdh-2026-000091 · Cited by 3
Defining Replicability of Prediction Rules
Parmigiani, G. (2023) · Statistical Science · doi:10.1214/23-sts891 · Cited by 3
Patient and Physician Exposure to Artificial Intelligence Hype
Monteith, S., Glenn, T., Geddes, J. R., Whybrow, P. C., Achtyes, E. D., Bauer, R., & Bauer, M. (2025) · Pharmacopsychiatry · doi:10.1055/a-2577-7214 · Cited by 4
Promises and challenges of artificial intelligence in haematological diagnostics
Eckardt, J., & Middeke, J. M. (2025) · British Journal of Haematology · doi:10.1111/bjh.70055 · Cited by 4
Prognostic Modeling and Major Dataset Shifts During the COVID-19 Pandemic
Knaus, W. A. (2022) · JAMA Health Forum · doi:10.1001/jamahealthforum.2022.1103 · Cited by 3
Opportunities and Challenges for Deep Learning in Brain Lesions
Patel, J., Chang, K., Ahmed, S. R., Jang, I., & Kalpathy–Cramer, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-08999-2_2 · Cited by 3
Management Opportunities and Challenges After Achieving Widespread Health System Digitization
Cross, D. A., Adler‐Milstein, J., & Holmgren, A. J. (2022) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1474-823120220000021004 · Cited by 4
Ecosystem of Patient-Centered Research and Information System Design
Hsueh, P.-Y. S. (2022) · Cognitive informatics in biomedicine and healthcare · doi:10.1007/978-3-031-07696-1_16 · Cited by 3
National Needs Assessment of Utilization of Common Newborn Clinical Decision Support Tools
Beam, K., Wang, C., Beam, A., Clark, R. H., Tolia, V. N., & Ahmad, K. A. (2023) · American Journal of Perinatology · doi:10.1055/a-2096-2168 · Cited by 3
Joo, H., Mathis, M. R., Tam, M., James, C. A., Han, P., Mangrulkar, R. S., Friedman, C. P., & Vydiswaran, V. G. V. (2023) · JMIR Research Protocols · doi:10.2196/49842 · Cited by 2
Diagnostic suspicion bias and machine learning: Breaking the awareness deadlock for sepsis detection
Prasad, V., Aydemir, B., Kehoe, I. E., Kotturesh, C., O’Connell, A., Biebelberg, B., Wang, Y., Lynch, J. C., Pepino, J. A., Filbin, M. R., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000365 · Cited by 3
Ripperger, M. A., Kolli, J., Wilimitis, D., Robinson, K., Reale, C., Novak, L. L., Cunningham, C. A., Kasuske, L., Grover, S. G., Ribeiro, J. D., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.42750 · Cited by 4
Herasevich, S., Minteer, S. A., Boswell, C. L., Hanson, A. C., Dong, Y., Gajic, O., & Barwise, A. K. (2024) · Journal of the American Geriatrics Society · doi:10.1111/jgs.18861 · Cited by 3
Steinfeldt, J., Wild, B., Buergel, T., Pietzner, M., zu Belzen, J. U., Vauvelle, A., Hegselmann, S., Denaxas, S., Hemingway, H., Langenberg, C., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-48568-8 · Cited by 5
Retractedxiaotang, S., & xinran, H. (2024) · International Conference on Image, Signal Processing and Pattern Recognition (ISPP) · doi:10.1117/12.3034129 · Cited by 3
Novel and Proven Models of Public, Private, and Public–Private Partnerships in Healthcare: An Update
Wieland, H., & Maas, J. (2024) · Handbook of experimental pharmacology · doi:10.1007/164_2024_724 · Cited by 3
Ethical considerations of use of hold-out sets in clinical prediction model management
Chislett, L., Aslett, L. J. M., Davies, A. R., Vallejos, C. A., & Liley, J. (2024) · AI and Ethics · doi:10.1007/s43681-024-00561-z · Cited by 3
Sim, T. Y., Cho, E. Y., Kim, J., Lee, K. H., Kim, K. J., Ha, E. Y., Ha, E. Y., Yun, E., Kim, I., Park, S. H., et al. (2025) · Acute and Critical Care · doi:10.4266/acc.000525 · Cited by 3
Matheny, M. E., Lucila Ohno-machado, A., Davis, S. E., & Nemati, S. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-91200-6.00031-0 · Cited by 3
Remaki, A., Playe, B., Bernard, P., Vittoz, S., Doutreligne, M., Châtellier, G., Audureau, É., Kempf, E., Porcher, R., & Bey, R. (2023) · medRxiv · doi:10.1101/2023.08.17.23294220 · Cited by 4
Tuwani, R., & Beam, A. L. (2023) · medRxiv · doi:10.1101/2023.12.13.23299899 · Cited by 4
Risks and rewards of AI democratization
van der Sommen, F., & de Groof, J. (2024) · United European Gastroenterology Journal · doi:10.1002/ueg2.12560 · Cited by 3
AI Tools in Human Hands: Measuring Real-World Impact in the Emergency Department
Chen, I. Y., & Zink, A. (2025) · NEJM AI · doi:10.1056/aie2500083 · Cited by 3
Kohan, A., Xu, J., Xiao, L., Wu, X., Kukkar, A., Hussain, S., Roshanzamir, M., Alizadehsani, R., & Acharya, U. R. (2026) · Research Square · doi:10.21203/rs.3.rs-8976235/v1 · Cited by 4
Peeters, D., Venkadesh, K. V., Dinnessen, R., Saghir, Z., Scholten, E. T., Vliegenthart, R., Prokop, M., & Jacobs, C. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109633 · Cited by 2
A Reality Check of Vision-Language Pre-training in Radiology: Have We Progressed Using Text?
Silva-Rodríguez, J., Dolz, J., & Ayed, I. B. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-96625-5_20 · Cited by 2
Bielick, C. G., Awwad, A., Ellen, J., Jalilian, L., McCoy, L. G., Mishra, V., Osmanlliu, E., Pfohl, S. R., & Celi, L. A. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001115 · Cited by 2
Recent Advances in the Application of Artificial Intelligence in Alzheimer's Disease
Yao, L., Ni, J., Wei, M., Li, T., Li, F., Wang, T., Xiao, W., Shi, J., & Tian, J. (2025) · Current Alzheimer Research · doi:10.2174/0115672050410489250930175402 · Cited by 2
Jung, G., Lee, J., Gho, S., Han, Y., Choi, B., Cho, J. W., Kim, J., & Lee, G.-H. (2025) · Seizure · doi:10.1016/j.seizure.2025.10.004 · Cited by 2
Retinal Age Gap as a Biomarker for Patient Satisfaction and Visual Quality After Cataract Surgery
Komatsu, K., Masuda, Y., Sano, K., Ohira, R., Mitooka, S., IIDA, M., ICHIHARA, K., Nishijima, E., Oki, T., & Nakano, T. (2025) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2025.11.006 · Cited by 2
Clinical evaluation of GenAI adaptive cancer therapy
Derbal, Y. (2025) · EngMedicine · doi:10.1016/j.engmed.2025.100116 · Cited by 2
Subgroup Performance Analysis in Hidden Stratifications
Bissoto, A. E., Hoang, T.-D., Flühmann, T., Sun, S., Baumgartner, C. F., & Koch, L. M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05185-1_57 · Cited by 3
Goals of Care Transition after Postoperative Undertriage
Loftus, T. J., Ruppert, M. M., Hu, D., Nolan, V., Balch, J. A., Ozrazgat‐Baslanti, T., Madbak, F., Shickel, B., Bihorac, A., & Upchurch, G. R. (2026) · Journal of the American College of Surgeons · doi:10.1097/xcs.0000000000001763 · Cited by 2
Fading Memories: The Role of Machine Learning in Organizational Knowledge Depreciation
Gerlach, J. P., & Lange, D. A. (2026) · Academy of Management Review · doi:10.5465/amr.2024.0408 · Cited by 3
Liu, W., Wu, Y., Yu, W., Bittle, M. J., Zheng, Z., & Kharrazi, H. H. K. (2026) · Journal of Medical Internet Research · doi:10.2196/77967 · Cited by 2
A nursing perspective on human-AI collaboration in personalized breast cancer care pathways
Zhang, J., Zhao, X., Tao, J.-H., & Su, D.-C. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1784401 · Cited by 2
AI ‐Based Methods in Neuropathology for Diagnosis and Treatment of Brain Tumors
Roetzer-Pejrimovsky, T., Amberg, N., Widhalm, G., & Höftberger, R. (2026) · European Journal of Neurology · doi:10.1111/ene.70577 · Cited by 2
Duan, M., Liu, X., Yeung, W. L. K., Hao, S., Raffa, J. D., Hu, P., Liu, C., Chen, L., Li, Z., Gao, Z., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02472-1 · Cited by 3
From prediction to navigation for artificial intelligence in medicine
Nadkarni, G. N., McGreevy, J., Gavin, N. P., Freeman, R., Darrow, B. J., Stump, L. S., Reich, D. S., Kohane, I. S., & Sakhuja, A. (2026) · The Lancet · doi:10.1016/s0140-6736(26)00756-7 · Cited by 2
Self-citationChines, E., Tempesta, A. A., Boscarelli, L., Parisi, M. F., Marcoccia, L., Capillo, A., Mezzatesta, M. L., Ledda, C., Chessari, M., & Cafiso, V. (2026) · Antibiotics · doi:10.3390/antibiotics15050469 · Cited by 3
Xu, Z., Li, C., Guan, C., Xu, L. H., Wang, X., Jiang, S., Zhang, N., Gu, M., Xin, Y., & Xu, Y. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03561-7 · Cited by 2
Allyn, J., Oliver, M., Cerveau, R., Allou, N., Barennes, T., & Ferdynus, C. (2026) · Critical Care · doi:10.1186/s13054-026-06034-5 · Cited by 2
Research integrity and data ethics in AI-driven integrated healthcare: a critical appraisal
Zeng, W., Wei, H., Chen, Y., Tang, J., Ge, J., & Chen, H. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1838551 · Cited by 2
Zhao, Q., Jiang, W., Zhang, C., Ouyang, M., Wu, N., & Guo, Y. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1863050 · Cited by 3
The role of artificial intelligence in precision medicine for breast cancer
Hu, J.-J., Ding, Z.-L., & Yang, Z. (2026) · Discover Oncology · doi:10.1007/s12672-026-05550-8 · Cited by 3
Advances in the Interpretation of the Electrocardiogram by Artificial Intelligence
Lobodzinski, S. S., & Piotrowicz, R. (2026) · Diagnostics · doi:10.3390/diagnostics16142167 · Cited by 2
Palermi, S., Zeidaabadi, B., Vecchiato, M., Anselmino, M., Adorisio, R., Biffi, A., Borrelli, F., Brugin, E., Cantarutti, N., Cavarretta, E., et al. (2026) · International Journal of Cardiology · doi:10.1016/j.ijcard.2026.134677 · Cited by 2
Tzortzatou, O. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1832356 · Cited by 2
Applications of Artificial Intelligence in Cancer Diagnosis and Treatment
Xie, Y., Wang, Z., Zeng, Z., Xin, T., Yuan, S., Qin, F., & Chen, Z. (2026) · Cancer Medicine · doi:10.1002/cam4.72143 · Cited by 2
Lin, F. P. Y., Salih, O. S. M., Scott, N., Jameson, M. B., & Epstein, R. J. (2022) · JCO Clinical Cancer Informatics · doi:10.1200/cci.22.00064 · Cited by 2
Aktaş, M., & Çavuşoğlu, S. (2023) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub398.c1662 · Cited by 3
Peng, S. (2024) · Service Oriented Computing and Applications · doi:10.1007/s11761-024-00401-2 · Cited by 2
Development of a machine learning modelto estimate length of stay in coronaryartery bypass grafting
Couto, R. C., Pedrosa, T. M. G., Seara, L. M., Couto, V. S., & Couto, C. S. (2024) · Revista de Saúde Pública · doi:10.11606/s1518-8787.2024058006161 · Cited by 2
Efficient and robust sequential decision making algorithms
Xu, P. (2024) · AI Magazine · doi:10.1002/aaai.12186 · Cited by 2
A Normal Forced Vital Capacity Does Not Reliably or Equitably Exclude Restriction
Moffett, A. T., Balasubramanian, A., McCormack, M. C., Aysola, J., Halpern, S. D., & Weissman, G. E. (2025) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202501-009rl · Cited by 2
Medical AI can transform medicine — but only if we carefully track the data it touches
Vaid, A. (2025) · Nature · doi:10.1038/d41586-025-01946-8 · Cited by 2
Bi-branch bidirectional coupled interaction fusion network for multi-retinal diseases diagnosis
Chen, S., Tan, T., Zhao, X., Ke, W., Xu, X., Xu, Y., Zhang, G., Lam, C., & Sun, Y. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114069 · Cited by 2
Towards Reliable Prediction: A Bayesian Continual Learning Approach for Clinical Time-Series Data
Cao, Z., Jun, J. P. W., Guo, Y., Gautam, C., Nambiar, M., Chia, S. Y., Salim, N. N. M., Lee, S., Oh, H. C., Bee, Y. M., et al. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3598718 · Cited by 2
Qiu, L., Huang, D., Zhang, Y., Zhou, Y., Luo, M., Zhang, C., Huang, Y., Zou, M., Lu, W., Liu, H., et al. (2025) · MedComm – Future Medicine · doi:10.1002/mef2.70035 · Cited by 2
Artificial Intelligence in Infection Management in the ICU
Corte, T. D., Hoecke, S. V., & Waele, J. J. D. (2022) · Annual update in intensive care and emergency medicine · doi:10.1007/978-3-030-93433-0_28 · Cited by 2
From Classification to Governance: Ethical Challenges of Adaptive Learning in Medicine
Griffen, Z. W., Rosen, K. L., Horwitz, L. I., & Owens, K. (2024) · The American Journal of Bioethics · doi:10.1080/15265161.2024.2388721 · Cited by 2
Derby, M. D. D. L., Coulibaly, J. T., Dacal, E., Silué, K. D., Cuadrado, D., Bermejo-Peláez, D., García-Villena, J., Lin, L., Fisher, K. N., Andrews, J. R., et al. (2025) · medRxiv · doi:10.1101/2025.07.11.25331398 · Cited by 2
Hundal, J., Veettil, A. A. V., Chung, C., & Hosseini, M. (2026) · American Society of Clinical Oncology Educational Book · doi:10.1200/edbk-26-517280 · Cited by 1
Course Corrections for Clinical AI
DeGrave, A. J., Janizek, J. D., & Lee, S. (2021) · Kidney360 · doi:10.34067/kid.0004152021 · Cited by 1
Yurcu, M. E. (2023) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub398.c1667 · Cited by 1
Atlı, H. F. (2023) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub398.c1663 · Cited by 1
Deneyimsel Pazarlama Kavramının Bibliyometrik Analiz ile İncelenmesi
Erdem, A. (2023) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub398.c1665 · Cited by 1
Fractional Calculus Numerical Algorithm based on Artificial Intelligence
Zhang, Y., Ji, Q., Xin, W., & Hu, Y. (2024) · International Conference on Integrated Circuits and Communication Systems (ICICACS) · doi:10.1109/icicacs60521.2024.10498598 · Cited by 1
Artificial Intelligence for Serious Illness Communication: Proactive Approaches to Mitigating Harm
Tarbi, E. C., Durieux, B. N., Kwok, A., Rizzo, D. M., & Lindvall, C. J. (2025) · The Journal of Medicine and Philosophy A Forum for Bioethics and Philosophy of Medicine · doi:10.1093/jmp/jhaf024 · Cited by 3
Leveraging artificial intelligence for the management of preschool wheeze: A narrative review
Dent, A., Khan, M. U., & Subbarao, P. (2025) · Pediatric Allergy and Immunology · doi:10.1111/pai.70207 · Cited by 1
Dutta, S., Sengupta, S., & Arivazhagan, R. (2025) · Academic International Journal of Engineering Science · doi:10.59675/e322 · Cited by 1
Artificial Intelligence in Assessing Cardiovascular Disease
Tan, X. (2025) · MedScien · doi:10.61173/q84z9j91 · Cited by 1
Implementation of an automated contour quality assurance tool within the TROG 18.01 NINJA trial
Chlap, P., Min, H., Martin, J. M., Sidhom, M. A., Chan, L. X., Whitehead, A., Moore, A., Dowling, J., Field, M., Haworth, A., et al. (2025) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2025.111269 · Cited by 1
Research progress of universalvision foundation models in computational pathology
Fu, Z., Da, Q., Wang, W., Wang, C., Zhong, D., Wang, S., & Wang, L. (2025) · Chinese Science Bulletin (Chinese Version) · doi:10.1360/csb-2025-5045 · Cited by 1
Balancing Innovation and Responsibility: Ethical and Privacy Challenges in Stroke Digital Health
Muchada, M., Rizzo, F., Brunelli, N., & Molina, C. A. (2025) · Stroke · doi:10.1161/strokeaha.125.050450 · Cited by 1
Do we need prequalification of AI as a medical device to drive equitable adoption
Mateen, B. A., Aryeetey, B., & Darko, D. M. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02151-7 · Cited by 2
Conducting Systematic Reviews in a Day: Enter Artificial Intelligence
Cao, C., & Moher, D. (2026) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.25.01373 · Cited by 1
The 42% Accuracy Drop: When Vision Transformers Fail Across Medical Imaging Datasets
Jahangeer, J. S., & Shanmugavadivu, P. (2025) · IEEE International Conference on ICT in Business Industry & Government (ICTBIG) · doi:10.1109/ictbig68706.2025.11323789 · Cited by 1
Moffett, A. T., & Weissman, G. E. (2026) · Critical Care Medicine · doi:10.1097/ccm.0000000000007024 · Cited by 1
Interdisciplinary expertise to advance human-centered explainable AI
Bennett, C. R., Cole-Lewis, H. J., Farquhar, S. A., Hammel, N., Babenko, B., Lang, O., Fleck, M. S., Traynis, I., Lau, C. T., Liu, Y., et al. (2026) · Social Science & Medicine · doi:10.1016/j.socscimed.2026.119036 · Cited by 13
Securing Retail Payments: A PCI-DSS Compliant Network Design for Distributed Point-of-Sale Systems
Wang, C., & Rey, W. P. (2025) · International Conference on Communication and Information Processing (ICCIP) · doi:10.1145/3784833.3784909 · Cited by 1
Koch, A. H., Claessens, C. H. B., Nies, I., Schultz, E. W. R., Hellström, T. A. E., Boers, T. G. W., Dekker, E. M. L., Muntinga, C. L. P., Evert, J. S. H., Niers‐Stobbe, I., et al. (2026) · Radiology Imaging Cancer · doi:10.1148/rycan.250027 · Cited by 1
Rizal, P. (2025) · Annals of Innovation in Medicine · doi:10.59652/hrnhkr35 · Cited by 1
Immune Ageing Clocks: A Methods-Oriented Review of Tasks, Modalities, Models, and Recalibration
Yu, G., Shao, Z., Zhuo, J., & Chen, Z. (2026) · Cells · doi:10.3390/cells15050421 · Cited by 1
Ghnatios, C., Khene, Z., Attieh, R. M., Mardelli, C., Nedbal, C., Cacciamani, G. E., BACKER, P. D., Kronenberg, P., Tefik, T., Turney, B. W., et al. (2026) · World Journal of Urology · doi:10.1007/s00345-026-06322-3 · Cited by 1
Phenotyping cardiogenic shock: an insight from the gulf cardiogenic shock registry
Elmahrouk, A. F., Daoulah, A., Jamjoom, A. A., Yousif, N., Almahmeed, W. A., Panduranga, P., Arabi, A., Kanbr, O., Aloui, H. M., Alshehri, M., et al. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1744896 · Cited by 1
Song, F., Savulescu, J., & Dunn, M. (2026) · AI & Society · doi:10.1007/s00146-026-02909-x · Cited by 1
Bifurcated Networks for Breast Density & Cancer Risk: A Technical Framework
Grezia, G. D., Iannaccone, T., & Nazzaro, A. (2026) · Diagnostics · doi:10.3390/diagnostics16050770 · Cited by 1
Chang, L., Polansky, M., Yi, D., MacDowell, M., Sreedhar, R., Mosher, D., & Schwartz, A. (2026) · BMC Medical Education · doi:10.1186/s12909-026-08931-3 · Cited by 1
Wang, X., Xiong, D., Cui, S., Duan, B., Hung, Y., Jing, H. E., Ding, G., Tang, Y., & (15087726), Q. W. (2026) · Discover Oncology · doi:10.1007/s12672-026-04864-x · Cited by 3
Artificial intelligence in emergency medicine critical care
Heslin, S. M., Nocito, R., & Weingart, S. D. (2026) · Clinical and Experimental Emergency Medicine · doi:10.15441/ceem.26.057 · Cited by 1
Schuch, V., Mukherjee, I., de Carvalho, A. R. N., Olanrewaju, R. A., Davis, J., Thomas, S., Chakraborty, R., & Johnson, E. L. (2026) · Frontiers in Reproductive Health · doi:10.3389/frph.2026.1783837 · Cited by 1
Zitianellis, J. (2026) · IntechOpen eBooks · doi:10.5772/intechopen.1014718 · Cited by 1
Uveal Melanoma Ground Truth Labeling in Machine Learning
Kao, E., Ganesh, S., Chadwick, W. F., Alahmadi, R., Yao, X., & Heiferman, M. J. (2026) · Cancers · doi:10.3390/cancers18091357 · Cited by 1
Rotalinti, Y., Ordish, J., Liu, X., Glocker, B., Denniston, A. K., Wright, P., Yau, C., Kale, A. U., Grainger, D., Branson, R., et al. (2026) · BMJ Digital Health & AI · doi:10.1136/bmjdh-2026-000085 · Cited by 1
Yankam, B. M. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1739192 · Cited by 1
Metadata
- Authors
- Finlayson, S. G., Subbaswamy, A., Singh, K., Bowers, J., Kupke, A., Zittrain, J., Kohane, I. S., & Saria, S.
- Affiliations
- Harvard University (US)
- Johns Hopkins University (US)
- University of Michigan (US)
- Yale University (US)
- Boston University (US)
- Bayesian Health, New York, NY
- ORCID
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2021-07-15
- Volume
- 385
- Issue
- 3
- Pages
- 283-286
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- PMC
- PMC8665481
- OpenAlex
- W3177617320
- Cited by
- 855
- References
- 2
- Citations by year
- 2026: 336 · 2025: 141 · 2024: 141 · 2023: 135 · 2022: 83 · 2021: 18
- FWCI
- 27.15
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Science Foundation (1840088)
- Alfred P. Sloan Foundation (FG-2018-10877)
- National Institute of General Medical Sciences (T32GM007753)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- distribution shift, clinical trials, machine learning, clinician bias, model generalization, bias mitigation, clinical decision support
- MeSH terms
- Machine Learning, Information Technology, Artificial Intelligence, Humans, Medical Informatics, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-02, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-02 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
