Improving Prediction Performance Using Hierarchical Analysis of Real-Time Data: A Sepsis Case Study
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
This paper presents a novel method for hierarchical analysis of machine learning algorithms to improve predictions of at risk patients, thus further enabling prompt therapy. Specifically, we develop a multi-layer machine learning approach to analyze continuous, high-frequency data. We illustrate the capabilities of this approach for early identification of patients at risk of sepsis, a potentially life-threatening complication of an infection, using high-frequency (minute-by-minute) physiological data collected from bedside monitors. In our analysis of a cohort of 586 patients, the model obtained from analyzing the output of a previously developed sepsis prediction model resulted in improved outcomes. Specifically, the original model failed to predict 11.76 ± 4.26% of sepsis patients earlier than Systemic Inflammatory Response Syndrome (SIRS) criteria, commonly used to identify patients at risk for rapid physiological deterioration resulting from sepsis. In contrast, the multi-layer model only failed to predict 3.21 ± 3.11% of sepsis patients earlier than SIRS. In addition, sepsis patients were predicted on average 204.87 ± 7.90 minutes earlier than SIRS criteria using the multi-layer model, which can potentially help reduce mortality and morbidity if implemented in the ICU.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Seymour, C. W., Liu, V. X., Iwashyna, T. J., Brunkhorst, F. M., Rea, T. D., Scherag, A., Rubenfeld, G., Kahn, J. M., Shankar-Hari, M., Singer, M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0288 · Cited by 3,939 · cited 1×
“gan dysfunction caused by a dysregulated response to infection [5], and if untreated, it rapidly progresses to multi-organ dys-”
BackgroundBig data analytics in healthcare: promise and potential
Raghupathi, W., & Raghupathi, V. (2014) · Health Information Science and Systems · doi:10.1186/2047-2501-2-3 · Cited by 3,034 · cited 1×
“, through early warning systems to detect infection and allergic reactions [1]–[3].”
BackgroundRaith, E. P., Udy, A. A., Bailey, M., McGloughlin, S., MacIsaac, C., Bellomo, R., Pilcher, D. V., & for the Australian and New Zealand Intensive Care Society (ANZICS) Centre for Outcomes and Resource Evaluation (CORE) (2017) · JAMA · doi:10.1001/jama.2016.20328 · Cited by 1,279
An interpretable machine learning model for accurate prediction of sepsis in the ICU
Nemati, S., Holder, A., Razmi, F., Stanley, M. D., Clifford, G. D., & Buchman, T. G. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000002936 · Cited by 832
A targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598 · cited 1×
“Methods from artificial intelligence have been applied to predict sepsis onset [18]–[21], and present a great opportunity to improve healthcare around the world.”
MethodSendelbach, S., & Funk, M. (2013) · AACN Advanced Critical Care · doi:10.4037/nci.0b013e3182a903f9 · Cited by 497
Drew, B. J., Harris, P., Zègre-Hemsey, J. K., Mammone, T., Schindler, D., Salas-Boni, R., Bai, Y., Tinoco, A., Ding, Q., & Hu, X. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110274 · Cited by 438 · cited 1×
“Studies have reported false positive rates between 80% and 99% in hospitals [36], [37].”
BackgroundMao, Q., Jay, M., Hoffman, J. L., Calvert, J., Barton, C., Shimabukuro, D., Shieh, L., Chettipally, U., Fletcher, G., Kerem, Y., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-017833 · Cited by 336
Shashikumar, S. P., Stanley, M. D., Sadiq, I., Li, Q., Holder, A., Clifford, G. D., & Nemati, S. (2017) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2017.08.013 · Cited by 167 · cited 1×
“Recently, there have been many attempts in using high-frequency physiological data streams to extract rich and highly dynamic information from the time-series to predict sepsis earlier [21], [22], [42] and many efforts are still ongoing.”
Background
Cited by
Fleuren, L. M., Klausch, T. L. T., Zwager, C. L., Schoonmade, L. J., Guo, T., Roggeveen, L. F., Swart, E. L., Girbes, A. R. J., Thoral, P., Ercole, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-019-05872-y · Cited by 755
Early Prediction of Sepsis in the ICU Using Machine Learning: A Systematic Review
Moor, M., Rieck, B., Horn, M., Jutzeler, C. R., & Borgwardt, K. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.607952 · Cited by 231
Clinical applications of artificial intelligence in sepsis: A narrative review
Schinkel, M., Paranjape, K., Nannan Panday, R. S., Skyttberg, N., & Nanayakkara, P. W. B. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103488 · Cited by 130
Luz, C. F., Vollmer, M., Decruyenaere, J., Nijsten, M. W., Glasner, C., & Sinha, B. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2020.02.003 · Cited by 106
Cross-Hospital Sepsis Early Detection via Semi-Supervised Optimal Transport With Self-Paced Ensemble
Ding, R., Zhou, Y., Xu, J., Xie, Y., Liang, Q., Ren, H., Wang, Y., Chen, Y., Wang, L., & Huang, M. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3253208 · Cited by 20
“Systematic review and meta-analysis indicate that individual machine learning models can accurately predict the onset of Sepsis in advance on retrospective data [10], [31].”
Background
Metadata
- Authors
- van Wyk, F., Khojandi, A., & Kamaleswaran, R.
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2019-05
- Volume
- 23
- Issue
- 3
- Pages
- 978-986
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W2912708252
- Cited by
- 52
- References
- 11
- FWCI
- 5.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Improving Prediction Performance Using Hierarchical Analysis of Real-Time Data: A Sepsis Case Study. https://app.cochat.ai/papers/10.1109/jbhi.2019.2894570
- The paper
- van Wyk, F., Khojandi, A., & Kamaleswaran, R. (2019). Improving Prediction Performance Using Hierarchical Analysis of Real-Time Data: A Sepsis Case Study. IEEE Journal of Biomedical and Health Informatics. https://doi.org/10.1109/jbhi.2019.2894570
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.