Using Machine Learning to Predict ICU Transfer in Hospitalized COVID-19 Patients
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Objectives: Approximately 20–30% of patients with COVID-19 require hospitalization, and 5–12% may require critical care in an intensive care unit (ICU). A rapid surge in cases of severe COVID-19 will lead to a corresponding surge in demand for ICU care. Because of constraints on resources, frontline healthcare workers may be unable to provide the frequent monitoring and assessment required for all patients at high risk of clinical deterioration. We developed a machine learning-based risk prioritization tool that predicts ICU transfer within 24 h, seeking to facilitate efficient use of care providers’ efforts and help hospitals plan their flow of operations. Methods: A retrospective cohort was comprised of non-ICU COVID-19 admissions at a large acute care health system between 26 February and 18 April 2020. Time series data, including vital signs, nursing assessments, laboratory data, and electrocardiograms, were used as input variables for training a random forest (RF) model. The cohort was randomly split (70:30) into training and test sets. The RF model was trained using 10-fold cross-validation on the training set, and its predictive performance on the test set was then evaluated. Results: The cohort consisted of 1987 unique patients diagnosed with COVID-19 and admitted to non-ICU units of the hospital. The median time to ICU transfer was 2.45 days from the time of admission. Compared to actual admissions, the tool had 72.8% (95% CI: 63.2–81.1%) sensitivity, 76.3% (95% CI: 74.7–77.9%) specificity, 76.2% (95% CI: 74.6–77.7%) accuracy, and 79.9% (95% CI: 75.2–84.6%) area under the receiver operating characteristics curve. Conclusions: A ML-based prediction model can be used as a screening tool to identify patients at risk of imminent ICU transfer within 24 h. This tool could improve the management of hospital resources and patient-throughput planning, thus delivering more effective care to patients hospitalized with COVID-19.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
pROC: an open-source package for R and S+ to analyze and compare ROC curves
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., & Müller, M. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-77 · Cited by 13,697
Richardson, S., Hirsch, J. S., Narasimhan, M., Crawford, J. M., McGinn, T., Davidson, K. W., and the Northwell COVID-19 Research Consortium, Barnaby, D. P., Becker, L. B., Chelico, J. D., et al. (2020) · JAMA · doi:10.1001/jama.2020.6775 · Cited by 9,254 · cited 2×
“Although age is clearly identified as a risk factor for needing ICU care among patients with COVID‐19 [3], patients above 65 years old have lower rates of ICU transfer, despite higher mortality [5], possibly reflecting a greater preference for palliative or less aggressive care in older patients.”
BackgroundResultDysregulation of Immune Response in Patients With Coronavirus 2019 (COVID-19) in Wuhan, China
Qin, C., Zhou, L., Hu, Z., Zhang, S., Yang, S., Tao, Y., Xie, C., Ma, K., Shang, K., Wang, W., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa248 · Cited by 4,775 · cited 1×
“Our finding that lymphocyte count is a significant predictor of ICU transfer correlates with previous reports that identified lymphopenia as a predictor of severe disease and poor prognosis [29,30].”
ResultClinical Characteristics of Covid-19 in New York City
Goyal, P., Choi, J. J., Pinheiro, L. C., Schenck, E. J., Chen, R., Jabri, A., Satlin, M. J., Campion, T. R., Nahid, M., Ringel, J. B., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmc2010419 · Cited by 2,234
COVID-19: ICU delirium management during SARS-CoV-2 pandemic
Kotfis, K., Williams Roberson, S., Wilson, J. E., Dabrowski, W., Pun, B. T., & Ely, E. W. (2020) · Critical Care · doi:10.1186/s13054-020-02882-x · Cited by 506
Myers, L. C., Parodi, S. M., Escobar, G. J., & Liu, V. X. (2020) · JAMA · doi:10.1001/jama.2020.7202 · Cited by 467
Iterative random forests to discover predictive and stable high-order interactions
Basu, S., Kumbier, K., Brown, J. B., & Yu, B. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711236115 · Cited by 317 · cited 2×
“This supports previous reports that found RF models to be highly suitable in situations with missing data [17], complex non‐linear relationships among input variables, and their potential higher‐level interactions [16]; thus, an ensemble‐based classification approach minimizes overfitting [15].”
MethodResultChurpek, M. M., Wendlandt, B., Zadravecz, F. J., Adhikari, R., Winslow, C., & Edelson, D. P. (2016) · Journal of Hospital Medicine · doi:10.1002/jhm.2630 · Cited by 143
An Examination of Early Transfers to the ICU Based on a Physiologic Risk Score
Hu, W., Chan, C. W., Zubizarreta, J. R., & Escobar, G. J. (2018) · Manufacturing & Service Operations Management · doi:10.1287/msom.2017.0658 · Cited by 44 · cited 1×
“Moreover, clinical implementation of the tool can increase the rates of early ICU transfers, which can potentially translate into reduced mortality and shorter lengths of ICU stay [40,41], with favorable consequences on other complications affecting patient outcomes, such as delirium and sleep disorders [42,43].”
Background
Cited by
Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070
The Importance of Respiratory Rate Monitoring: From Healthcare to Sport and Exercise
Nicolò, A., Massaroni, C., Schena, E., & Sacchetti, M. (2020) · Sensors · doi:10.3390/s20216396 · Cited by 440
Applications of artificial intelligence in battling against covid-19: A literature review
Tayarani N., M.-H. (2021) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.110338 · Cited by 210
“[94] Cheng F-Y , Joshi H , Tandon P , Freeman R , Reich DL , Mazumdar M , et al.”
Ruksakulpiwat, S., Thorngthip, S., Niyomyart, A., Benjasirisan, C., Phianhasin, L., Aldossary, H., Ahmed, B., & Samai, T. (2024) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s459946 · Cited by 98
Besculides, M., Mazumdar, M., Phlegar, S., Freeman, R., Wilson, S., Joshi, H., Kia, A., & Gorbenko, K. (2023) · JMIR Formative Research · doi:10.2196/42262 · Cited by 12
Self-citation
Metadata
- Authors
- Cheng, F.-Y., Joshi, H., Tandon, P., Freeman, R., Reich, D. L., Mazumdar, M., Kohli-Seth, R., Levin, M. A., Timsina, P., & Kia, A.
- Venue
- Journal of Clinical Medicine
- Publisher
- MDPI AG
- Published
- 2020-06-01
- Volume
- 9
- Issue
- 6
- Pages
- 1668
- ISSN
- 2077-0383 (ISSN-L)
- OpenAlex
- W3031876060
- Cited by
- 195
- References
- 10
- FWCI
- 14.49
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Machine Learning to Predict ICU Transfer in Hospitalized COVID-19 Patients. https://app.cochat.ai/papers/10.3390/jcm9061668
- The paper
- Cheng, F.-Y., Joshi, H., Tandon, P., Freeman, R., Reich, D. L., Mazumdar, M., Kohli-Seth, R., Levin, M. A., Timsina, P., & Kia, A. (2020). Using Machine Learning to Predict ICU Transfer in Hospitalized COVID-19 Patients. Journal of Clinical Medicine. https://doi.org/10.3390/jcm9061668
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.