The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index; 2 of the 7 sources its claims cite were checked for support.
The Clinician and Dataset Shift in Artificial Intelligence
Open accessAbstract
Dataset Shift in Clinical Trials This letter outlines how to identify, and potentially mitigate, common sources of “dataset shift” in machine-learning systems. This occurs when the model “training ...
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Own interpretation · 1 Supported so far · 1 Partly supported · 1 No full text of the sources · 1 Not checked yet · 1 No basis given · accuracy not yet measured
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“A major driver of AI system malfunction is known as “dataset shift.”4,5”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
What the sources say
- Supportedcites [4] Subbaswamy A, Saria S. From development to deployment: dataset shift, causality, and shift-stable models in health AI. Biostatistics 2020; 21: 345– 52. 31742354 source
The paper’s opening discussion says shifts between training and deployment are common and can cause poor performance or dangerous decisions. It explicitly calls this problem of shifting conditions that prevent generalization “dataset shift,” supporting the citing sentence’s paraphrase. (LLM, conf=0.92)
- Not checked yetcites [5] Saria S, Subbaswamy A. Tutorial: safe and reliable machine learning. In: Proceedings of the conference on fairness, accountability, and transparency, January 29–31, 2019. New York: Association for Computing Machinery, 2019. DOI: 10.1056/NEJMc2104626
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: Most clinical AI systems today use machine learning.
- Supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This was a case in which dataset shift fundamentally altered the relationship between fevers and bacterial sepsis, leading the hospital’s clinical AI governing committee (which one of the authors of this letter chairs) to decommission its use.”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: In April 2020, the University of Michigan Hospital deactivated the Epic sepsis-alerting model because of spurious alerting owing to changes in patients’ demographic characteristics associated with the COVID-19 pandemic.
In the paper
“Artificial intelligence (AI) systems are now regularly being used in medical settings,1”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
What the sources say
- Not checked — no full text of the sourcecites [1] Rajkomar A, Dean J, Kohane I. Machine learning in medicine. N Engl J Med 2019; 380: 1347– 58. 30943338 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 3
- It may state two separate claims as one. 2
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Successful recognition and mitigation of dataset shift require both vigilant clinicians and sound technical oversight through AI governance teams.4,5”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
What the sources say
- Partly supportedcites [4] Subbaswamy A, Saria S. From development to deployment: dataset shift, causality, and shift-stable models in health AI. Biostatistics 2020; 21: 345– 52. 31742354 sourceExperimental — accuracy not yet measured
Section 4, “Open Challenges and Looking Forward” (page not supplied), calls for monitoring to detect shifts, maintenance to address them, and collaboration with domain experts when constructing models. It does not say that vigilant clinicians and AI governance teams are both required for this work. (LLM, conf=0.86)
- Not checked yetcites [5] Saria S, Subbaswamy A. Tutorial: safe and reliable machine learning. In: Proceedings of the conference on fairness, accountability, and transparency, January 29–31, 2019. New York: Association for Computing Machinery, 2019. DOI: 10.1056/NEJMc2104626
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
- Partly supported
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“we group into changes in technology (e.g., software vendors), changes in population and setting (e.g., new demographics), and changes in behavior (e.g., new reimbursement incentives)”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“although regulatory oversight is inconsistent and undeveloped.2,3”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
What the sources say
- Not checked yetcites [2] Ross C Hospitals are using AI to predict the decline of Covid-19 patients — before knowing it works. Stat 4 24, 2020 (https://www.statnews.com/2020/04/24/coronavirus-hospitals-use-ai-to-predict-patient-decline-before-knowing-it-works/).
- Not checked yetcites [3] Artificial intelligence/machine learning (AI/ML)-based software as a medical device (SaMD) action plan Silver Spring, MD: Food and Drug Administration, January 2021 (https://www.fdagov/media/145022/download).
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Safe deployment of clinical AI requires informed clinician-users”
§ The Clinician and Dataset Shift in Artificial Intelligence > TO THE EDITOR:
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
- Rests on an assumption: Clinicians are generally responsible for identifying and reporting emerging problems with clinical AI.
The paper relies on this without support.
Clinicians are generally responsible for identifying and reporting emerging problems with clinical AI.
“who are generally responsible for identifying and reporting emerging problems.”
The paper relies on this without support.
Most clinical AI systems today use machine learning.
“Most clinical AI systems today use machine learning, algorithms that leverage statistical methods to learn key patterns from clinical data.”
The paper relies on this without support.
In April 2020, the University of Michigan Hospital deactivated the Epic sepsis-alerting model because of spurious alerting owing to changes in patients’ demographic characteristics associated with the COVID-19 pandemic.
“the University of Michigan Hospital implemented the widely used sepsis-alerting model developed by Epic Systems; in April 2020, the model had to be deactivated because of spurious alerting owing to changes in patients’ demographic characteristics associated with the coronavirus disease 2019 pandemic.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This quality becomes crucial when predictive models are deployed across different hospitals or healthcare systems, where variations in patient demographics, clinical practices, and data collection procedures can lead to inaccurate predictions [17, 18].”
From Toward generalizable and interpretable machine learning models in healthcare: Insights from ICU outcome predictions (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Small changes in the distribution of the underlying data between the algorithm training and clinical evaluation populations (i.e., dataset shift) can lead to substantial variation in clinical performance and expose patients to potential unexpected harm [21, 22].”
From Use of artificial intelligence in critical care: opportunities and obstacles (2024) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Finlayson et al. argue that dataset shift in medicine is “the rule rather than the exception,” driven by changes in care delivery, clinical incentives, and documentation rather than by random variation alone [8].”
From Validation is not enough: Longitudinal evidence of post-deployment fragility in clinical AI systems (2026) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Between 3 and 4 weeks after its first COVID-19 hospitalization, the University of Michigan paused ESM-generated alerts in April 2020 after nursing reports of overalerting.5”
From Quantification of Sepsis Model Alerts in 24 US Hospitals Before and During the COVID-19 Pandemic (2021) · cites this paper as [5]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Finlayson et al 55 have argued that clinicians who are well-prepared to recognize when AI tools are misbehaving are essential partners in safe deployment, and that institutions need governance structures, monitoring protocols, and clear pathways for frontline staff to escalate concerns.”
From Artificial Intelligence in Oncology: Practical Applications Across Clinical Care, Scholarship, and Translation. (2026) · cites this paper as [55]
The cited source says what the claim attributes to it.
In the citing paper
“Understanding persistence and degradation is perhaps particularly critical for ML models, where dataset shift should be expected to cause declines in performance when the data used to train a model begins to look different from the data in a new context [8].”
From Managing a 'responsibility vacuum' in AI monitoring and governance in healthcare: a qualitative study (2025) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“This supports a workflow-aware interpretation of post-deployment fragility: degradation may be linked to how data are produced within evolving workflows and information systems, not only to who the patients are [8,18,33,35].”
From Validation is not enough: Longitudinal evidence of post-deployment fragility in clinical AI systems (2026) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“As AI solutions have emerged, a wide variety of governance best practices in the form of frameworks, governance structures, checklists, and guidelines have been proposed7–23.”
From Advancing healthcare AI governance through a comprehensive maturity model based on systematic review (2026) · cites this paper as [15]
The cited source says what the claim attributes to it.
In the citing paper
“It is well-known that such models may not generalize across settings or over time due to changes in patient populations, practice patterns, and data processes — a phenomenon known as dataset shift.1”
From Challenges in the postmarket surveillance of clinical prediction models. (2025) · cites this paper as [1]
In the citing paper
“The healthcare landscape is constantly changing; therefore, there is no guarantee that an AI algorithm with high performance will maintain its high performance in the future [89].”
From Fairness of artificial intelligence in healthcare: review and recommendations (2024) · cites this paper as [89]
In the citing paper
“The models should be monitored regularly to address biases that may emerge over time [89].”
From Fairness of artificial intelligence in healthcare: review and recommendations (2024) · cites this paper as [89]
In the citing paper
“Consequently, these changes necessitate the periodic retraining and re-evaluation of AI systems to maintain their relevance and efficacy [69, 70].”
From Integrating machine learning and artificial intelligence in life-course epidemiology: pathways to innovative public health solutions (2024) · cites this paper as [70]
In the citing paper
“The dynamic nature of clinical practice, fluctuations in the prevalence of comorbidities, and various socio-environmental factors can precipitate shifts in the distribution of patient characteristics.”
From Integrating machine learning and artificial intelligence in life-course epidemiology: pathways to innovative public health solutions (2024) · cites this paper as [70]
In the citing paper
“Laboratory performance does not always translate directly to clinical practice [142,143,144,145,146].”
From Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery (2025) · cites this paper as [144]
Citations
Cites
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579
Self-citationFrom development to deployment: dataset shift, causality, and shift-stable models in health AI
Subbaswamy, A., & Saria, S. (2019) · Biostatistics · doi:10.1093/biostatistics/kxz041 · Cited by 276
Self-citation
Research works printed but not linked: 1
- Saria S Subbaswamy A. Tutorial: safe and reliable machine learning. In: Proceedings of the conference on fairness accountability and transparency January 29–31 2019. New York: Association for Computing Machinery 2019.
Cited by
Sorted by citations
Items 501–600 of 848
A Guide to Constructing Indigenous Statistical Spaces for Prevention Science Research
de la Sierra, V. Q. (2026) · Prevention Science · doi:10.1007/s11121-026-01911-5 · Cited by 1
Chen, Z., Shu, J., Wang, D., Erlian, S. U. N., Wang, B., Qi, L., Zhang, H., Han, S., Wu, Y., & Wang, G. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106476 · Cited by 3
Syailendra, E. A., Arshad, H., Lopez‐Ramirez, F., Tixier, F., Kawamoto, S., Fishman, E. K., & Chu, L. C. H. (2026) · Korean Journal of Radiology · doi:10.3348/kjr.2026.0003 · Cited by 1
Savitz, S. T., Broderick, B. T., Paul, M. M., Bonner, T. J., Ridgeway, J. L., Käll, M., & Njeru, J. W. (2026) · Learning Health Systems · doi:10.1002/lrh2.70089 · Cited by 1
What Utah’s clinical AI sandbox reveals about independent oversight
Gorijavolu, R., Jaiswal, N., Kesselheim, A. S., Sakran, J. V., Hernandez‐Boussard, T., & Celi, L. A. (2026) · Nature Medicine · doi:10.1038/s41591-026-04418-2 · Cited by 1
Sezer, E. (2026) · Nursing Inquiry · doi:10.1111/nin.70118 · Cited by 1
Safeguarding AI-driven digital health – An adaptation of the Swiss cheese model for safety
Denecke, K. (2026) · Digital Health · doi:10.1177/20552076261459551 · Cited by 1
Closing the Loop in Precision Oncology: A Digital Twin‐Driven Paradigm for Dynamic Decision‐Making
Zhu, J., Yang, M., Ouyang, C., & Zhang, L. (2026) · iMetaMed · doi:10.1002/imm3.70044 · Cited by 1
Navigating AI and machine learning in cancer research: an end-to-end translational framework
Saha, S., Ali, M. S., Tengli, A. K., Prasad, S. R., Mallikarjunaswamy, P., Pillappan, R., & Javarappa, K. K. (2026) · Journal of Translational Medicine · doi:10.1186/s12967-026-08503-5 · Cited by 3
Yang, Y., Liu, J., & Liu, S. (2026) · Journal of Medical Internet Research · doi:10.2196/96152 · Cited by 2
Carlini, A., Foca, F., Sirico, M., Farolfi, A., Casadei, C., Gianni, C., Palleschi, M., Gentili, N., Mariotti, M., Menna, G. D., et al. (2026) · The Breast · doi:10.1016/j.breast.2026.104861 · Cited by 1
Fujiwara, M., Pakpoor, J., Aslan, S., Taşdemir, M. N., Roest, C., Arita, Y., Purysko, A. S., & Giganti, F. (2026) · Abdominal Radiology · doi:10.1007/s00261-026-05634-7 · Cited by 1
Yeo, J., So, E. S., & Youm, S. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106597 · Cited by 1
Das, I. J., Debata, J., Bhatta, K., Panda, S., & Samal, H. B. (2026) · Wound Repair and Regeneration · doi:10.1111/wrr.70187 · Cited by 2
Palermi, S., Saglietto, A., D’Ascenzo, F., Ferrari, G. M. D., Bruno, F., Tse, G., Kizilkilic, S. E., Tjong, F. V. Y., Ruipérez-Campillo, S., Keser, N., et al. (2026) · Progress in Cardiovascular Diseases · doi:10.1016/j.pcad.2026.07.005 · Cited by 2
Interpretable Machine Learning for Population-Level Tooth Loss Prediction
Lam, Q. T., Fan, F.-Y., Wang, Y. L., Wu, C.-Y., Sun, Y.-S., Vo, T. T. T., Kuo, H., Kha, Q. H., Le, M. H. N., Vu, G. T., et al. (2026) · Journal of Dental Research · doi:10.1177/00220345261464887 · Cited by 1
Validating medical digital twins for clinical decision support: beyond predictive accuracy
Vallée, A. (2026) · JAMIA Open · doi:10.1093/jamiaopen/ooag160 · Cited by 1
Bilal, K. H., Gibson, J., Kim, D., LEVI, A. W., Nassar, A., Oen, H. O., Robila, V., Saieg, M. A., Shi, Q., Torous, V. F., et al. (2026) · Cancer Cytopathology · doi:10.1002/cncy.70134 · Cited by 1
Vasquez-Cevallos, L., Rodriguez, P. E. D. S., & Salazar, P. (2026) · Applied Sciences · doi:10.3390/app16178391 · Cited by 1
Machine Learning on the Pediatric Intensive Care (PIC) Database: PIC-Powered Prediction
Ganatra, H. A., Shamim, D., Sood, S., & Ali, A. M. (2026) · Bioengineering · doi:10.3390/bioengineering13090978 · Cited by 1
Echo Chambers: Bias and Representation in Cardiac Imaging Datasets for Artificial Intelligence
Gorijavolu, R., Jaiswal, N., Pratap, J. S., Madapati, K., López, M. D. P. A., Leite, M., Muwanguzi, D. P., Izath, N., Samsel, K., Shoyombo, I., et al. (2026) · Current Cardiology Reports · doi:10.1007/s11886-026-02406-z · Cited by 1
Opportunities, pitfalls, ethics, and clinical governance of AI in laboratory medicine
Lippi, G., Mattiuzzi, C., & Henry, B. M. (2026) · LabMed discovery. · doi:10.1016/j.lmd.2026.100145 · Cited by 1
Artificial intelligence in biomarker discovery for diseases: diagnostic and therapeutic prospects
Dinç, R., & Ardıç, N. (2026) · Signal Transduction and Targeted Therapy · doi:10.1038/s41392-026-02946-4 · Cited by 1
Clinical prediction tool pitfalls and considerations: Data and algorithms
Choi, J., & Marwaha, J. S. (2023) · Surgery · doi:10.1016/j.surg.2023.08.009 · Cited by 1
Tedarik Zinciri Bakış Açısıyla Şirketlerin Yeşil Aklama ile Başa Çıkma Stratejileri
Sofyalıoğlu, Ç., & Kartal, B. (2023) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub398.c1661 · Cited by 1
Brosula, R. J., Corbin, C. K., & Chen, J. H. (2024) · PubMed Central · Cited by 1
It is Not Time to Kick Out Radiologists
Nakamura, Y., Sonoda, Y., Yamagishi, Y., Kikuchi, T., Nakao, T., Miki, S., Hanaoka, S., Yoshikawa, T., & Abe, O. (2024) · Asian Bioethics Review · doi:10.1007/s41649-024-00325-1 · Cited by 2
Lestari, N. S., Renaldi, F., & Santikarama, I. (2022) · International Conference on Creative Communication and Innovative Technology (ICCIT) · doi:10.1109/iccit55355.2022.10119116 · Cited by 1
RetractedCross-Domain Evaluation of a Deep Learning-Based Type Inference System
Gruner, B., Sonnekalb, T., Heinze, T. S., & Brust, C.-A. (2023) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr59073.2023.00034 · Cited by 1
Evaluating BLOOMY and SOFA scores in hospitalised patients
Benzoni, N. S., Bewley, A. F., Guillamet, C. V., & Lyons, P. G. (2022) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(22)00231-6 · Cited by 1
Real-world usage diminishes validity of Artificial Intelligence toolsPreprint
Vaid, A., Sawant, A. S., Suárez‐Fariñas, M., Lee, J., Kaul, S. K., Kovatch, P., Freeman, R., Jiang, J. J., Jayaraman, P., Fayad, Z. A., et al. (2022) · medRxiv · doi:10.1101/2022.11.17.22282440 · Cited by 1
Self-citationSteinfeldt, J., Wild, B., Buergel, T., Pietzner, M., zu Belzen, J. U., Vauvelle, A., Hegselmann, S., Denaxas, S., Hemingway, H., Langenberg, C., et al. (2023) · medRxiv · doi:10.1101/2023.03.10.23286918 · Cited by 1
Participant Flow Diagrams for Health Equity in AI ResearchPreprint
Ellen, J., de Matos, J. C. R. G., Viola, M., Gallifant, J., Quion, J. M., Celi, L. A., & Hussein, N. S. A. (2023) · medRxiv · doi:10.1101/2023.10.05.23296611 · Cited by 1
Regulação da inteligência artificial na saúde
Dourado, D. D. A. (2024) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.5.2024.tde-23042024-111255 · Cited by 2
Salwei, M. E., Davis, S. E., Reale, C., Novak, L. L., Walsh, C. G., Beebe, R., Nelson, S., Sundrani, S. C., Rose, S. L., Wright, A. T., et al. (2025) · medRxiv · doi:10.1101/2025.06.05.25329034 · Cited by 1
Agweyu, A., Mwaniki, P., Musau, W., Korom, R., Isaaka, L., Wanyama, C. W., Kiptinness, S., Adan, N., Emmanuel-Fabula, M., & Mateen, B. A. (2025) · medRxiv · doi:10.1101/2025.09.05.25335163 · Cited by 1
Understanding Data Drift in Dental AI
Gudsoorkar, P. (2025) · International Dental Journal · doi:10.1016/j.identj.2025.103937 · Cited by 1
Shuaibu, I., Khan, M., Alkhamis, D., & Alkhamis, A. (2026) · medRxiv · doi:10.64898/2026.01.17.26344327 · Cited by 2
Bridging the Gap: Consensus-Based Considerations for AI Usefulness in Healthcare
Salwei, M. E., Morse, K., Saria, S., Shah, N. H., Bedoya, A., Beyer, M., del Río, A. M., Chornenky, D., Lin, A. L., Ruparel, S., et al. (2026) · The American Journal of Bioethics · doi:10.1080/15265161.2026.2617850 · Cited by 1
Self-citationRaposo, H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6512959 · Cited by 1
García-Hidalgo, C. (2026) · European Radiology · doi:10.1007/s00330-026-12729-8 · Cited by 1
Bohlen, L., Rosenberger, J., Hambauer, N., Zähringer, D., Franz, V., Zschech, P., & Kraus, M. (2026) · Health Care Management Science · doi:10.1007/s10729-026-09760-y
“This quality becomes crucial when predictive models are deployed across different hospitals or healthcare systems, where variations in patient demographics, clinical practices, and data collection procedures can lead to inaccurate predictions [17, 18].”
Clinical AI in Canadian Community Hospitals: A Framework for Implementation Readiness
Mohiyeddini, C. (2026) · Healthcare Management Forum · doi:10.1177/08404704261494446
Machine Learning in Risk Prediction for Cardiac Surgery – An Emerging Trend?
Raman, J., Venkatesh, S., & Bellomo, R. (2021) · Heart Lung and Circulation · doi:10.1016/j.hlc.2021.09.007
Too Hot to Handle, Too Cold to Care: The Future of Renal Mass Imaging
Prunty, M. C., Magee, D., & Bukavina, L. (2022) · European Urology · doi:10.1016/j.eururo.2022.02.012
DIAGNOSE: Avoiding Out-of-Distribution Data Using Submodular Information Measures
Kothawade, S. N., Shrivastava, A., Iyer, V., Ramakrishnan, G., & Iyer, R. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16760-7_14
Kabachenko, F., Samarina, A., & Mikhaylik, Y. (2022) · Studies in computational intelligence · doi:10.1007/978-3-031-19032-2_37
Normalizing Flow based Uncertainty Estimation for Deep Regression AnalysisPreprint
Zhang, B., Sui, W., Huang, Z., & Li, M. (2023) · doi:10.36227/techrxiv.22324951
Wang, R., Erus, G., Chaudhari, P., & Davatzikos, C. A. (2023) · PubMed · doi:10.48550/arxiv.2308.03175 · Cited by 1
TIPICAL - Type Inference for Python In Critical Accuracy Level
Elkobi, J., Gruner, B., Sonnekalb, T., & Brust, C.-A. (2023) · IEEE/ACIS International Conference on Software Engineering Research, Management and Applications (SERA) · doi:10.1109/sera57763.2023.10197800
(2023) · Elsevier eBooks · doi:10.1016/b978-0-323-90534-3.16001-9
Liu, L., Li, M., Lin, D., Yun, D., Lin, Z., Zhao, L., Pang, J., Li, L., Wu, Y., Shang, Y., et al. (2023) · STAR Protocols · doi:10.1016/j.xpro.2023.102565 · Cited by 1
Towards Generalizability and Robustness in Biological Object Detection in Electron Microscopy ImagesPreprint
Giannios, K., Chaurasia, A., Bueno, C., Riesterer, J. L., Pagano, L., Lo, T. P., Thibault, G., Gray, J. W., Song, X., & DeLaRosa, B. (2023) · SSRN Electronic Journal · doi:10.1101/2023.11.27.568889
New Artificial Intelligence System Based on Information Processing Technology
Tian, Z. (2023) · International Conference on Data Analytics, Computing and Artificial Intelligence (ICDACAI) · doi:10.1109/icdacai59742.2023.00111
Sustainable Brand Management: A Forward-Looking Perspective in The Business World
Pir, E. Ö. (2023) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub398.c1664 · Cited by 1
Dijital Dönüşümde Haberleşme İnovasyonu
Gültaş, P., & Gültaş, M. (2023) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub398.c1666
Uzkesici, D. (2023) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub398.c1660
Dijitalleşme ve Pazarlama Araştırmaları
Yılmaz, E. S., Uzkesici, D., Sofyalıoğlu, Ç., Kartal, B., Aktaş, M., Çavuşoğlu, S., Atlı, H. F., Pir, E. Ö., Erdem, A., Gültaş, M., et al. (2023) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub398
The Dominant Force of Science and Technology Financial Genes in the Great Power Technology Game
Li, B. (2023) · Accounting Auditing and Finance · doi:10.23977/accaf.2023.040310
Computational Medicine in Radiology: Medical Images as Big Data
Armato, S. G. (2023) · IEEE John Vincent Atanasoff International Symposium on Modern Computing (JVA) · doi:10.1109/jva60410.2023.00021
Normalizing Flow Based Uncertainty Estimation for Deep Regression AnalysisPreprint
Zhang, B., Sui, W., Huang, Z., Qi, M., & Li, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4698811
Wang, Y., & Sun, Y. (2023) · International Conference on Artificial Intelligence and Intelligent Information Processing (AIIIP) · doi:10.1109/aiiip61647.2023.00017
Khaliq, M., Shaikh, I. S., & Soman, S. (2024) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2024.122928
Huang, D., Zhu, C., Liu, X., Zhou, B., Luo, S., & Zheng, W. (2023) · International Conference on Mobile Networks and Wireless Communications (ICMNWC) · doi:10.1109/icmnwc60182.2023.10435980
Verma, N., De, A., & Duseja, A. K. (2024) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.17913
Sun, A., Yang, W., Sun, D., Lan, Y., Chen, Y., Han, Z., Liu, W., & Lin, Q. (2024) · doi:10.2196/preprints.59166
Aiskovich, M., Castro, E., Reinen, J., Fadnavis, S., Mehta, A., Li, H., Dhurandhar, A., Cecchi, G., & Polosecki, P. I. (2024) · Frontiers in Radiology · doi:10.3389/fradi.2024.1283392
Introduction to Artificial Intelligence (AI) and AI-Related Concepts
Brigham, C. R., Buttar, W. A., Bucksbaum, M., & Talmage, J. B. (2023) · AMA guides newsletter · doi:10.1001/amaguidesnewsletters.2023.sepoct03
Are Stronger Feature Representations All You Need for Histology Image Search?
Chen, R. J., & Mahmood, F. (2024) · NEJM AI · doi:10.1056/aie2400314
Rise of the machines: how machine learning will shape the field of rheumatology
Joshi, S. D., & Liebowitz, J. E. (2024) · Lara D. Veeken · doi:10.1093/rheumatology/keae252
Efficient data integration under prior probability shift
Huang, M., Qin, J., & Huang, C. (2024) · Biometrics · doi:10.1093/biomtc/ujae035
Guo, Y., Wang, Y., & Li, J. (2023) · International Conference on Information Education and Artificial Intelligence (ICIEAI) · doi:10.1145/3660043.3660159
Intelligent teacher management system based on computer vision
Guo, Y., Wang, Y., & Li, J. (2024) · Guangdong-Hong Kong-Macao Greater Bay Area International Conference on Digital Economy and Artificial Intelligence (DEAI) · doi:10.1145/3675417.3675546
Artificial Intelligence Terminologies
(2024) · Advances in higher education and professional development book series · doi:10.4018/979-8-3693-4074-5.ch001
Adaptive Statistical Iterative Reconstruction Algorithm Based on Artificial Intelligence
Li, C., & Zhang, Y. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.10.026
Tadpole: A Framework for Characterizing Temporal Model Data Drifts at the Point-of-Care
Pungitore, S. A., & Subbian, V. (2024) · IEEE Healthcare Innovations and Point of Care Technologies Conference (HI-POCT) · doi:10.1109/hi-poct64255.2024.10876202
Intelligent Information Teaching Method and Its Influence on Instrumental Music Teaching
Tian, J. (2025) · International Journal of Web-Based Learning and Teaching Technologies · doi:10.4018/ijwltt.372677
Ye, Y. (2025) · International Conference on Integrated Circuits and Communication Systems (ICICACS) · doi:10.1109/icicacs65178.2025.10968203
Navigating the Promises and Perils of Generative AI in Transforming Healthcare Services
Kohli, S., Kaushal, R., & Raina, A. (2025) · Advances in hospitality, tourism and the services industry (AHTSI) book series · doi:10.4018/979-8-3693-7447-4.ch020
Holdout sets for safe predictive model updating
Haidar-Wehbe, S., Emerson, S. R., Aslett, L. J. M., & Liley, J. (2025) · The Annals of Applied Statistics · doi:10.1214/24-aoas1982
Evolving Deep Learning Techniques for Disease Diagnosis Support Using Medical Imaging
Visuña, L., Garcia‐Blas, J., & Carretero, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-90203-1_37
Significance of Artificial Intelligence in Animal Disease Recognition
Kumar, R., Sharma, T., & Veer, K. (2025) · Current Signal Transduction Therapy · doi:10.2174/0115743624362164250630194443
Cross-Validation for Longitudinal Datasets with Unstable Correlations
Krishnamoorthy, M., Sjoding, M. W., & Wiens, J. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3736898
Tikhomirov, L., Semmler, C., Prizant, N. T., Bhasin, S., Kenyon, G., van der Vegt, A. H., Erdman, L., Palmer, L. J., Mohamud, A., Gichoya, J. W., et al. (2025) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/n9cx7_v1
Evaluating artificial intelligence-enabled medical tests in cardiology: Best practice
Isaksen, J. L., Nørregaard, M., Manninger, M., Dobrev, D., Jespersen, T., Hermans, B. J. M., Heijman, J., Plank, G., Scherr, D., Pock, T., et al. (2025) · IJC Heart & Vasculature · doi:10.1016/j.ijcha.2025.101783 · Cited by 3
Methodological Considerations for Machine Learning-Based Identification of IBD Cohorts
Khan, M. A., & Yousaf, M. (2025) · Digestive Diseases and Sciences · doi:10.1007/s10620-025-09378-0
Medical Artificial Intelligence
Grote, T. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197625835.013.0033
Evaluate the Impact of AI on Healthcare Workforce Dynamics and Operational Efficiency
Chakkaravarthy, A. P., & Jaganathan, D. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-2787-7.ch013
Ragab, H., Aydemir, D. G., Cicek, H., Kahl, H., Möhring, L., Striegler, M., de Jong, L. T., Karaagac, H., Adam, G., & Avanesov, M. (2025) · RöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren · doi:10.1055/a-2704-7577
Machine Learning in Skin Cancer Classification: A Review of CNN, SVM and KNN Models
Bhanu, H. S., & N, N. K. H. (2025) · International Conference on Inventive Systems and Control (ICISC) · doi:10.1109/icisc65841.2025.11188310
Gac, F. L., Calonge, Q., Estellat, C., & Navarro, V. (2025) · Epilepsia · doi:10.1111/epi.18683
Yan, A. P., Guo, L., Patel, P., Schechter, T., Arciniegas, S. E., Inoue, J., Vettese, E., Jessa, K., Cardiff, B., TOMLINSON, G. A., et al. (2025) · BMC Cancer · doi:10.1186/s12885-025-15137-1
Buatthaisong, N., Slijepcevic, I. V., Scaife, A. M. M., Bowles, M., Hopkins, A., Mohan, D., Shabala, S. S., & Wong, O. I. (2025) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staf1942 · Cited by 4
Equipping mathematical models for hospital dynamics using information theory
Balch, J. A., Brandberg, J. G., Andris, R. T., Mesner, I. G., Nametz, D. C., Megjhani, M., Ruppert, M. M., Hu, D., Clark, M., Shickel, B., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02013-2
Curriculum-based TRADES for Robust Skin Lesion Classification under Adversarial Attacks
R., N. M., Gladston Raj, S., & Pradeepan, P. (2025) · 2025 3rd International Conference on Intelligent Cyber Physical Systems and Internet of Things (ICoICI) · doi:10.1109/icoici65217.2025.11254705
A Two-Staged Optimized Stacking Ensemble Learning Classifier for the Prediction of Cervical Cancer
Bhavani, C., Radha, M., Lingaiah, G., Nitya, E., & Nagavelli, U. (2025) · BENTHAM SCIENCE PUBLISHERS eBooks · doi:10.2174/9798898812072125020012
Zhang, Q., Yu, S., Shi, Y., & Tan, X. (2025) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2025.102692
Dung-Hung, C., Cong, T., Zeyu, J., Yu-Shan, O.-Y., & Yung-Yan, L. (2022) · Figshare · doi:10.6084/m9.figshare.20317475
Geng, J., Sui, X., Du, R., Feng, J., Wang, R., Wang, M., Yao, K., Chen, Q., Bai, L., Wang, S., et al. (2024) · Research Square · doi:10.21203/rs.3.rs-3933902/v1
Metadata
- Authors
- Finlayson, S. G., Subbaswamy, A., Singh, K., Bowers, J., Kupke, A., Zittrain, J., Kohane, I. S., & Saria, S.
- Affiliations
- Harvard University (US)
- Johns Hopkins University (US)
- University of Michigan (US)
- Yale University (US)
- Boston University (US)
- Bayesian Health, New York, NY
- ORCID
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2021-07-15
- Volume
- 385
- Issue
- 3
- Pages
- 283-286
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- PMC
- PMC8665481
- OpenAlex
- W3177617320
- Cited by
- 855
- References
- 2
- Citations by year
- 2026: 336 · 2025: 141 · 2024: 141 · 2023: 135 · 2022: 83 · 2021: 18
- FWCI
- 27.15
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Science Foundation (1840088)
- Alfred P. Sloan Foundation (FG-2018-10877)
- National Institute of General Medical Sciences (T32GM007753)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- distribution shift, clinical trials, machine learning, clinician bias, model generalization, bias mitigation, clinical decision support
- MeSH terms
- Machine Learning, Information Technology, Artificial Intelligence, Humans, Medical Informatics, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-02, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-02 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
