Early Prediction of Sepsis from Clinical Data: The PhysioNet/Computing in Cardiology Challenge 2019
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
The PhysioNet/Computing in Cardiology Challenge focused on the early detection of sepsis from clinical data.A total of 40,336 patient records from two distinct hospital systems were shared with participants while 22,761 patient records from three distinct hospital systems were sequestered as hidden test sets.Each patient record contained up to 40 measurements of vital sign, laboratory, and demographics data for over 2.5 million hourly time windows and over 15 million data points.We used the Sepsis-3 clinical criteria to define the onset time of sepsis.We challenged participants to design automated, opensource algorithms for predicting sepsis 6 hours before clinical recognition of sepsis.We developed a novel, clinical utility-based evaluation metric to assess each algorithm that rewards early sepsis predictions and penalizes late or missed predictions and false alarms.A total of 104 teams from academia and industry submitted a total of 853 entries during the official phase of the Challenge.We accepted 90 abstracts based on Challenge entries for presentations at Computing in Cardiology.We also compared entries to ensure that approaches from different teams remained independent.This article presents our analysis and discusses the implications of the Challenge for early sepsis predictions and related sequential prediction tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The third international consensus definitions for sepsis and septic shock (Sepsis-3).
Singer, M., Deutschman, C. S., Seymour, C. W., Shankar-Hari, M., Annane, D., Bauer, M., Bellomo, R., Bernard, G. R., Chiche, J.-D., Coopersmith, C. M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0287 · Cited by 28,250
Kumar, A., Roberts, D., Wood, K. E., Light, B., Parrillo, J. E., Sharma, S., Suppes, R., Feinstein, D., Zanotti, S., Taiberg, L., et al. (2006) · Critical Care Medicine · doi:10.1097/01.ccm.0000217961.75225.e9 · Cited by 6,109
Seymour, C. W., Liu, V. X., Iwashyna, T. J., Brunkhorst, F. M., Rea, T. D., Scherag, A., Rubenfeld, G., Kahn, J. M., Shankar-Hari, M., Singer, M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0288 · Cited by 3,939
Time to treatment and mortality during mandated emergency care for sepsis.
Seymour, C. W., Gesten, F., Prescott, H. C., Friedrich, M. E., Iwashyna, T. J., Phillips, G. S., Lemeshow, S., Osborn, T., Terry, K. M., & Levy, M. M. (2017) · New England Journal of Medicine · doi:10.1056/nejmoa1703058 · Cited by 2,225
An interpretable machine learning model for accurate prediction of sepsis in the ICU
Nemati, S., Holder, A., Razmi, F., Stanley, M. D., Clifford, G. D., & Buchman, T. G. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000002936 · Cited by 832
Self-citationThe Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3)
Rather, A. R., & Kasana, B. (2015) · JMS SKIMS · doi:10.33883/jms.v18i2.269 · Cited by 780
A targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598
Improving sepsis treatment by embracing diagnostic uncertainty.
Prescott, H. C., & Iwashyna, T. J. (2019) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201809-646ps · Cited by 110
Cited by
Explainable AI for clinical and remote health applications: A survey on tabular and time series data
Di Martino, F., & Delmastro, F. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10304-3 · Cited by 216
Rajendran, S., Xu, Z., Pan, W., Ghosh, A., & Wang, F. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000117 · Cited by 61
Cross-Hospital Sepsis Early Detection via Semi-Supervised Optimal Transport With Self-Paced Ensemble
Ding, R., Zhou, Y., Xu, J., Xie, Y., Liang, Q., Ren, H., Wang, Y., Chen, Y., Wang, L., & Huang, M. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3253208 · Cited by 20
On Missingness Features in Machine Learning Models for Critical Care: Observational Study
Singh, J., Sato, M., & Ohkuma, T. (2021) · JMIR Medical Informatics · doi:10.2196/25022 · Cited by 17
Assessment of the timeliness and robustness for predicting adult sepsis
Guan, Y., Wang, X., Chen, X., Yi, D., Chen, L., & Jiang, X. (2021) · iScience · doi:10.1016/j.isci.2021.102106 · Cited by 7
Metadata
- Authors
- Reyna, M., Prajwal Shashikumar, S., Moody, B., Gu, P., Sharma, A., nemati, S., & Clifford, G.
- Venue
- Computing in Cardiology Conference (CinC)
- Publisher
- Computing in Cardiology
- Published
- 2019-12-30
- Volume
- 45
- ISSN
- 2325-887X (ISSN-L)
- OpenAlex
- W3046153892
- Cited by
- 153
- References
- 8
- FWCI
- 140.51
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Early Prediction of Sepsis from Clinical Data: The PhysioNet/Computing in Cardiology Challenge 2019. https://app.cochat.ai/papers/10.22489/cinc.2019.412
- The paper
- Reyna, M., Prajwal Shashikumar, S., Moody, B., Gu, P., Sharma, A., nemati, S., & Clifford, G. (2019). Early Prediction of Sepsis from Clinical Data: The PhysioNet/Computing in Cardiology Challenge 2019. Computing in Cardiology Conference (CinC). https://doi.org/10.22489/cinc.2019.412
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.