Heart rate variability based machine learning models for risk prediction of suspected sepsis patients in the emergency department
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Early identification of high-risk septic patients in the emergency department (ED) may guide appropriate management and disposition, thereby improving outcomes. We compared the performance of machine learning models against conventional risk stratification tools, namely the Quick Sequential Organ Failure Assessment (qSOFA), National Early Warning Score (NEWS), Modified Early Warning Score (MEWS), and our previously described Singapore ED Sepsis (SEDS) model, in the prediction of 30-day in-hospital mortality (IHM) among suspected sepsis patients in the ED. Adult patients who presented to Singapore General Hospital (SGH) ED between September 2014 and April 2016, and who met ≥2 of the 4 Systemic Inflammatory Response Syndrome (SIRS) criteria were included. Patient demographics, vital signs and heart rate variability (HRV) measures obtained at triage were used as predictors. Baseline models were created using qSOFA, NEWS, MEWS, and SEDS scores. Candidate models were trained using k-nearest neighbors, random forest, adaptive boosting, gradient boosting and support vector machine. Models were evaluated on F1 score and area under the precision-recall curve (AUPRC). A total of 214 patients were included, of whom 40 (18.7%) met the outcome. Gradient boosting was the best model with a F1 score of 0.50 and AUPRC of 0.35, and performed better than all the baseline comparators (SEDS, F1 0.40, AUPRC 0.22; qSOFA, F1 0.32, AUPRC 0.21; NEWS, F1 0.38, AUPRC 0.28; MEWS, F1 0.30, AUPRC 0.25). A machine learning model can be used to improve prediction of 30-day IHM among suspected sepsis patients in the ED compared to traditional risk stratification tools.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Surviving Sepsis Campaign: International guidelines for management of sepsis and septic shock: 2016.
Rhodes, A., Evans, L. E., Alhazzani, W., Levy, M. M., Antonelli, M., Ferrer, R., Kumar, A., Sevransky, J. E., Sprung, C. L., Nunnally, M. E., et al. (2017) · Intensive Care Medicine · doi:10.1007/s00134-017-4683-6 · Cited by 6,621
Saito, T., & Rehmsmeier, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118432 · Cited by 5,309
Kubios HRV–heart rate variability analysis software.
Tarvainen, M. P., Niskanen, J.-P., Lipponen, J. A., Ranta-aho, P. O., & Karjalainen, P. A. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.07.024 · Cited by 2,720 · cited 1×
“2 (Kuopio, Finland) for computation of HRV parameters.([24]) The program automatically detected QRS complexes, but each ECG was also manually screened to ensure QRS detection was correct, and their positions were adjusted if misplaced.”
Smith, G. B., Prytherch, D. R., Meredith, P., Schmidt, P. E., & Featherstone, P. I. (2013) · Resuscitation · doi:10.1016/j.resuscitation.2012.12.016 · Cited by 1,077
An interpretable machine learning model for accurate prediction of sepsis in the ICU
Nemati, S., Holder, A., Razmi, F., Stanley, M. D., Clifford, G. D., & Buchman, T. G. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000002936 · Cited by 832 · cited 1×
“Machine learning models have shown good performance in early detection of sepsis among ICU patients [18,19] and prediction progression to septic shock among patients with sepsis.”
Sassi, R., Cerutti, S., Lombardi, F., Malik, M., Huikuri, H. V., Peng, C.-K., Schmidt, G., Yamamoto, Y., Reviewers:, D., Gorenek, B., et al. (2015) · Europace · doi:10.1093/europace/euv015 · Cited by 727
Churpek, M. M., Snyder, A., Han, X., Sokol, S., Pettit, N., Howell, M. D., & Edelson, D. P. (2017) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201604-0854oc · Cited by 689
Hospitalizations, costs, and outcomes of severe sepsis in the United States 2003 to 2007
Lagu, T., Rothberg, M. B., Shieh, M.-S., Pekow, P. S., Steingrub, J. S., & Lindenauer, P. K. (2012) · Critical Care Medicine · doi:10.1097/ccm.0b013e318232db65 · Cited by 679
A targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598 · cited 1×
“[20] A randomised controlled trial also showed that the use of a machine learning-based severe sepsis surveillance and alert system improved patient outcomes such as length of stay and IHM.”
BackgroundShimabukuro, D. W., Barton, C. W., Feldman, M. D., Mataraso, S. J., & Das, R. (2017) · BMJ Open Respiratory Research · doi:10.1136/bmjresp-2017-000234 · Cited by 382
Cited by
Artificial intelligence in emergency medicine: A scoping review
Kirubarajan, A., Taher, A., Khan, S., & Masood, S. (2020) · JACEP Open · doi:10.1002/emp2.12277 · Cited by 127
Boonstra, A., & Laven, M. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08070-7 · Cited by 87
“Examples of this are identifying septic shock [15, 46] or predicting risk for a 30-day adverse event [39].”
BackgroundEnhancing sepsis management through machine learning techniques: A review
Ocampo-Quintero, N., Vidal-Cortés, P., del Río Carbajo, L., Fdez-Riverola, F., Reboiro-Jato, M., & Glez-Peña, D. (2022) · Medicina Intensiva · doi:10.1016/j.medin.2020.04.003 · Cited by 20
Artificial intelligence in emergency medicine: a primer for the nonexpert
Smith, M. E., Zalesky, C. C., Lee, S., Gottlieb, M., Adhikari, S., Goebel, M., Wegman, M., Garg, N., & Lam, S. H. F. (2025) · JACEP Open · doi:10.1016/j.acepjo.2025.100051 · Cited by 18
Metadata
- Authors
- Chiew, C. J., Liu, N., Tagami, T., Wong, T. H., Koh, Z. X., & Ong, M. E. H.
- Venue
- Medicine
- Published
- 2019-02
- Volume
- 98
- Issue
- 6
- Pages
- e14197
- ISSN
- 0025-7974 (ISSN-L)
- 1536-5964
- OpenAlex
- W2912754435
- Cited by
- 89
- References
- 12
- FWCI
- 9.11
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Heart rate variability based machine learning models for risk prediction of suspected sepsis patients in the emergency department. https://app.cochat.ai/papers/10.1097/md.0000000000014197
- The paper
- Chiew, C. J., Liu, N., Tagami, T., Wong, T. H., Koh, Z. X., & Ong, M. E. H. (2019). Heart rate variability based machine learning models for risk prediction of suspected sepsis patients in the emergency department. Medicine. https://doi.org/10.1097/md.0000000000014197
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.