Machine learning identifies ICU outcome predictors in a multicenter COVID-19 cohort
Open accessPublished version of a preprint
Abstract
Background: Intensive Care Resources are heavily utilized during the COVID-19 pandemic. However, risk stratification and prediction of SARS-CoV-2 patient clinical outcomes upon ICU admission remain inadequate. This study aimed to develop a machine learning model, based on retrospective & prospective clinical data, to stratify patient risk and predict ICU survival and outcomes. Methods: A Germany-wide electronic registry was established to pseudonymously collect admission, therapeutic and discharge information of SARS-CoV-2 ICU patients retrospectively and prospectively. Machine learning approaches were evaluated for the accuracy and interpretability of predictions. The Explainable Boosting Machine approach was selected as the most suitable method. Individual, non-linear shape functions for predictive parameters and parameter interactions are reported. Results: 1039 patients were included in the Explainable Boosting Machine model, 596 patients retrospectively collected, and 443 patients prospectively collected. The model for prediction of general ICU outcome was shown to be more reliable to predict “survival”. Age, inflammatory and thrombotic activity, and severity of ARDS at ICU admission were shown to be predictive of ICU survival. Patients’ age, pulmonary dysfunction and transfer from an external institution were predictors for ECMO therapy. The interaction of patient age with D-dimer levels on admission and creatinine levels with SOFA score without GCS were predictors for renal replacement therapy. Conclusions: Using Explainable Boosting Machine analysis, we confirmed and weighed previously reported and identified novel predictors for outcome in critically ill COVID-19 patients. Using this strategy, predictive modeling of COVID-19 ICU patient outcomes can be performed overcoming the limitations of linear regression models. Trial registration “ClinicalTrials” (clinicaltrials.gov) under NCT04455451.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 37 · Cited by 65
Research works printed but not linked: 28
- [2]Zheng Y Sun LJ Xu M Pan J Zhang YT Fang XL Fang Q Cai HL Clinical characteristics of 34 COVID-19 patients admitted to intensive care unit in Hangzhou, China J Zhejiang Univ Sci B 2020 21 5 378 387 10.1631/jzus.B2000174 32425003 PMC7238397 · DOI
- [3]Zhang J, Liu P, Wang M, Wang J, Chen J, Yuan W, Li M, Xie Z, Dong W, Li H, et al. The clinical data from 19 critically ill patients with coronavirus disease 2019: a single-centered, retrospective, observational study. Z Gesundh Wiss. 2020;1–4. PMC7171052 32318325
- [4]Zangrillo A, Beretta L, Scandroglio AM, Monti G, Fominskiy E, Colombo S, Morselli F, Belletti A, Silvani P, Crivellari M, et al. Characteristics, treatment, outcomes and cause of death of invasively ventilated patients with COVID-19 ARDS in Milan, Italy. Crit Care Resuscitation J Aust Acad Crit Care Med. 2020. PMC10692521 32900326
- [5]Yang X Yu Y Xu J Shu H Xia J Liu H Wu Y Zhang L Yu Z Fang M Clinical course and outcomes of critically ill patients with SARS-CoV-2 pneumonia in Wuhan, China: A single-centered, retrospective, observational study Lancet Respir Med 2020 8 5 475 481 10.1016/S2213-2600(20)30079-5 32105632 PMC7102538 · DOI · Paper page
- [6]Wang Y, Lu X, Chen H, Chen T, Su N, Huang F, Zhou J, Zhang B, Li Y, Yan F, et al. Clinical course and outcomes of 344 intensive care patients with COVID-19. Am J Respir Crit Care Med. 2020. PMC7258632 32267160
- [7]Petrilli CM Jones SA Yang J Rajagopalan H O'Donnell L Chernyak Y Tobin KA Cerfolio RJ Francois F Horwitz LI Factors associated with hospital admission and critical illness among 5279 people with coronavirus disease 2019 in New York City: Prospective cohort study BMJ 1966 2020 369 PMC7243801 32444366
- [8]Pedersen HP, Hildebrandt T, Poulsen A, Uslu B, Knudsen HH, Roed J, Poulsen TD, Nielsen HB: Initial experiences from patients with COVID-19 on ventilatory support in Denmark. Dan Med J. 2020;67(5). 32351196
- [9]Ling L, So C, Shum HP, Chan PKS, Lai CKC, Kandamby DH, Ho E, So D, Yan WW, Lui G, et al. Critically ill patients with COVID-19 in Hong Kong: A multicentre retrospective observational cohort study. Crit Care Resuscit J Aust Acad Crit Care Med. 2020. PMC10692444 32248675
- [12]Cummings MJ, Baldwin MR, Abrams D, Jacobson SD, Meyer BJ, Balough EM, Aaron JG, Claassen J, Rabbani LE, Hastie J, et al. Epidemiology, clinical course, and outcomes of critically ill adults with COVID-19 in New York City: a prospective cohort study. Lancet. 2020. PMC7237188 32442528
- [13]Bhatraju PK Ghassemieh BJ Nichols M Kim R Jerome KR Nalla AK Greninger AL Pipavath S Wurfel MM Evans L Covid-19 in critically Ill patients in the Seattle Region—case series N Engl J Med 2020 382 21 2012 2022 10.1056/NEJMoa2004500 32227758 PMC7143164 · DOI
- [14]Network C-IGobotR, the C-ICUI: Clinical characteristics and day-90 outcomes of 4244 critically ill adults with COVID-19: a prospective cohort study. Intensive Care Med. 2020. PMC7674575 33211135
- [15]Barrasa H, Rello J, Tejada S, Martin A, Balziskueta G, Vinuesa C, Fernandez-Miret B, Villagra A, Vallejo A, San Sebastian A, et al. SARS-CoV-2 in Spanish Intensive Care Units: early experience with 15-day survival in Vitoria. Anaesth Crit Care Pain Med. 2020. PMC7144603 32278670
- [16]Cummings MJ Baldwin MR Abrams D Jacobson SD Meyer BJ Balough EM Aaron JG Claassen J Rabbani LE Hastie J Epidemiology, clinical course, and outcomes of critically ill adults with COVID-19 in New York City: a prospective cohort study Lancet 2020 395 10239 1763 1770 10.1016/S0140-6736(20)31189-2 32442528 PMC7237188 · DOI
- [18]Schwalbe N Wahl B Artificial intelligence and the future of global health Lancet 2020 395 10236 1579 1586 10.1016/S0140-6736(20)30226-9 32416782 PMC7255280 · DOI
- [19]Motwani M Dey D Berman DS Germano G Achenbach S Al-Mallah MH Andreini D Budoff MJ Cademartiri F Callister TQ Machine learning for prediction of all-cause mortality in patients with suspected coronary artery disease: a 5-year multicentre prospective registry analysis Eur Heart J 2017 38 7 500 507 27252451 PMC5897836
- [21]Harris PA Taylor R Thielke R Payne J Gonzalez N Conde JG Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support J Biomed Inform 2009 42 2 377 381 10.1016/j.jbi.2008.08.010 18929686 PMC2700030 · DOI · Paper page
- [22]Vincent JL, Moreno R, Takala J, Willatts S, De Mendonca A, Bruining H, Reinhart CK, Suter PM, Thijs LG. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996; 22(7):707–710. 8844239
- [23]Murray JF Matthay MA Luce JM Flick MR An expanded definition of the adult respiratory distress syndrome Am Rev Respir Dis 1988 138 3 720 723 10.1164/ajrccm/138.3.720 3202424 · DOI
- [24]Guo L Wang W Zhao N Guo L Chi C Hou W Wu A Tong H Wang Y Wang C Mechanical ventilation strategies for intensive care unit patients without acute lung injury or acute respiratory distress syndrome: a systematic review and network meta-analysis Crit Care 2016 20 1 226 10.1186/s13054-016-1396-0 27448995 PMC4957383 · DOI
- [26]Hastie T Tibshirani R Generalized additive models Stat Sci 1986 1 3 297 318 8548102
- [29]Force ADT Ranieri VM Rubenfeld GD Thompson BT Ferguson ND Caldwell E Fan E Camporota L Slutsky AS Acute respiratory distress syndrome: the Berlin definition JAMA 2012 307 23 2526 2533 22797452
- [30]Holler JG Eriksson R Jensen TO van Wijhe M Fischer TK Sogaard OS Israelsen SB Mohey R Fabricius T Johnk F First wave of COVID-19 hospital admissions in Denmark: a Nationwide population-based cohort study BMC Infect Dis 2021 21 1 39 10.1186/s12879-020-05717-w 33421989 PMC7794638 · DOI
- [31]Becerra-Munoz VM, Nunez-Gil IJ, Eid CM, Aguado MG, Romero R, Huang J, Mulet A, Ugo F, Rametta F, Liebetrau C, et al. Clinical profile and predictors of in-hospital mortality among older patients admitted for COVID-19. Age Ageing. 2020. PMC7717146 33201181
- [33]Althaus K, Moller P, Uzun G, Singh A, Beck A, Bettag M, Bosmuller H, Guthoff M, Dorn F, Petzold GC, et al. Antibody-mediated procoagulant platelets in SARS-CoV-2- vaccination associated immune thrombotic thrombocytopenia. Haematologica. 2021. PMC8327736 34011137
- [34]Iba T Levy JH Inflammation and thrombosis: roles of neutrophils, platelets and endothelial cells and their interactions in thrombus formation during sepsis J Thromb Haemost 2018 16 2 231 241 10.1111/jth.13911 29193703 · DOI
- [35]Gould TJ Vu TT Swystun LL Dwivedi DJ Mai SH Weitz JI Liaw PC Neutrophil extracellular traps promote thrombin generation through platelet-dependent and platelet-independent mechanisms Arterioscler Thromb Vasc Biol 2014 34 9 1977 1984 10.1161/ATVBAHA.114.304114 25012129 · DOI
- [36]Barbaro RP Maclaren G Boonstra PS Iwashyna TJ Slutsky AS Fan E Bartlett RH Tonna JE Hyslop R Fanning JJ Extracorporeal membrane oxygenation support in COVID-19: an international cohort study of the Extracorporeal Life Support Organization registry Lancet 2020 396 10257 1071 1078 10.1016/S0140-6736(20)32008-0 32987008 PMC7518880 · DOI
- [37]Tokodi M Schwertner WR Kovacs A Toser Z Staub L Sarkany A Lakatos BK Behon A Boros AM Perge P Machine learning-based mortality prediction of patients undergoing cardiac resynchronization therapy: the SEMMELWEIS-CRT score Eur Heart J 2020 41 18 1747 1756 10.1093/eurheartj/ehz902 31923316 PMC7205468 · DOI
- Authors
- Magunia, H., Lederer, S., Verbuecheln, R., Gilot, B. J., Koeppen, M., Haeberle, H. A., Mirakaj, V., Hofmann, P., Marx, G., Bickenbach, J., Nohe, B., Lay, M., Spies, C., Edel, A., Schiefenhövel, F., Rahmel, T., Putensen, C., Sellmann, T., Koch, T., Brandenburger, T., Kindgen-Milles, D., Brenner, T., Berger, M., Zacharowski, K., Adam, E., Posch, M., Moerer, O., Scheer, C. S., Sedding, D., Weigand, M. A., Fichtner, F., Nau, C., Prätsch, F., Wiesmann, T., Koch, C., Schneider, G., Lahmer, T., Straub, A., Meiser, A., Weiss, M., Jungwirth, B., Wappler, F., Meybohm, P., Herrmann, J., Malek, N., Kohlbacher, O., Biergans, S., & Rosenberger, P.
- Affiliations
- Universitätsklinikum Tübingen (DE)
- University of Tübingen (DE)
- Universitätsklinikum Aachen (DE)
- Humboldt-Universität zu Berlin (DE)
- Universitätsklinikum Knappschaftskrankenhaus Bochum (DE)
- University Hospital Bonn (DE)
- Witten/Herdecke University (DE)
- University Hospital Carl Gustav Carus (DE)
- Düsseldorf University Hospital (DE)
- Essen University Hospital (DE)
- Goethe University Frankfurt (DE)
- University of Freiburg (DE)
- University of Göttingen (DE)
- Universitätsmedizin Greifswald (DE)
- University Hospital in Halle (DE)
- University Hospital Heidelberg (DE)
- University Hospital Leipzig (DE)
- University of Lübeck (DE)
- Otto-von-Guericke-Universität Magdeburg (DE)
- Philipps University of Marburg (DE)
- Justus-Liebig-Universität Gießen (DE)
- TUM Klinikum (DE)
- Universitätsklinikum des Saarlandes (DE)
- Universität Ulm (DE)
- University of Würzburg (DE)
- Corresponding author
- Magunia, Harry
- Rosenberger, Peter
- ORCID
- Magunia, Harry
- Lederer, Simone
- Verbuecheln, Raphael
- Koeppen, Michael
- Haeberle, Helene A.
- Mirakaj, Valbona
- Hofmann, Pascal
- Marx, Gernot
- Bickenbach, Johannes
- Spies, Claudia
- Edel, Andreas
- Schiefenhövel, Fridtjof
- Rahmel, Tim
- Putensen, Christian
- Sellmann, Timur
- Koch, Thea
- Brandenburger, Timo
- Brenner, Thorsten
- Berger, Marc
- Zacharowski, Kai
- Adam, Elisabeth
- Posch, Matthias
- Moerer, Onnen
- Scheer, Christian S.
- Sedding, Daniel
- Fichtner, Falk
- Prätsch, Florian
- Wiesmann, Thomas
- Koch, Christian
- Schneider, Gerhard
- Lahmer, Tobias
- Meiser, Andreas
- Weiss, Manfred
- Jungwirth, Bettina
- Wappler, Frank
- Meybohm, Patrick
- Herrmann, Johannes
- Malek, Nisar
- Kohlbacher, Oliver
- Biergans, Stephanie
- Rosenberger, Peter
- Venue
- Critical Care
- Published
- 2021-08-17
- Volume
- 25
- Issue
- 1
- Pages
- 295-295
- ISSN
- 1364-8535 (ISSN-L)
- PMC
- PMC8370055
- OpenAlex
- W3176943905
- Cited by
- 65
- References
- 37
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 16 · 2023: 19 · 2022: 17 · 2021: 2
- FWCI
- 4.28
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Critical Care (publishedVersion, cc-by)
- Research Square (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion, other-oa)
- Publication Server of Goethe University Frankfurt am Main (Goethe University Frankfurt) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Informationszentrum Lebenswissenschaften (ZB MED) (submittedVersion, cc-by)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion)
- Online Publication Service of Würzburg University (Würzburg University) (submittedVersion, cc-by)
- GoeScholar The Publication Server of the Georg-August-Universität Göttingen (Georg-August-Universität Göttingen) (submittedVersion, cc-by)
- RWTH Publications (RWTH Aachen)
- Funders
- deutsche forschungsgemeinschaft (DFG RO 3671/8-1)
- bundesministerium für bildung, wissenschaft, forschung und technologie (DIFUTURE, 01ZZ1804D)
- horizon 2020 framework programme
- Universitätsklinikum Tübingen
- Topics
- Health Sciences › Medicine › Infectious Diseases › COVID-19 Clinical Research Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Epidemiology › Sepsis Diagnosis and Treatment
- Keywords
- COVID-19 pandemic, intensive care unit outcomes, risk stratification, explainable boosting machine, SARS-CoV-2, ARDS severity, extracorporeal membrane oxygenation, renal replacement therapy, D-dimer, SOFA score, age, pulmonary dysfunction, critically ill patients
- MeSH terms
- Machine Learning, COVID-19, Adult, Aged, Emergency Service, Hospital, Female, Germany, Humans, Intensive Care Units, Male, Middle Aged, Cohort Studies, Critical Illness, Outcome Assessment, Health Care, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review