Cited by 2Sepsis Diagnosis and TreatmentMachine Learning in HealthcareHealthcare Technology and Patient Monitoring

Alert Timing in Sepsis Prediction Models—An Opportunity to Tailor Interventions

Open access
Balczewski, Emily A., Lyons, Patrick G., Singh, Karandeep·2023·JAMA Network Open

Abstract

bundle compliance).If all alerting patients cannot actually be evaluated, the clinical benefits of these tools diminish greatly.4 Thus, clinicians overseeing the use of these tools must not only focus on selecting the optimal threshold or the best-performing tool.They must also determine whether any tools are sufficiently high performing to be useful at all.Recently, there are sepsis prediction models whose implementation has led to improvements in clinical outcomes, 5,6 including at least 1 study involving the SPM.However, performance of the SPM can vary substantially across hospitals (at least in version 1), 7 and we do not know the minimal performance required within a clinical setting before the use of a sepsis tool will translate to clinical benefits.Better clinical outcomes require both effective models and effective interventions, and both may benefit from tailoring to a local context.Through their analysis, Schertz et al 1 have identified a critical aspect of that tailoring: timing of alerts relative to sepsis onset.By estimating when alerts are expected to fire relative to sepsis onset, we can select interventions most likely to be useful at the time of the alert, hopefully aiding the translation of these tools into better clinical outcomes.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1001/jamanetworkopen.2023.29704

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Even when discrimination is high, the threshold chosen for alerts may result in suboptimal sensitivity or excessive false alarms.

    “Even when discrimination is high, the threshold chosen for alerts may result in suboptimal sensitivity or excessive false alarms [40].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 3

  1. Singh K, Shah NH, Vickers AJ. Assessing the net benefit of machine learning models in the presence of resource constraints. J Am Med Inform Assoc. 2023;30(4):668-673. doi:10.1093/jamia/ocad006 · DOI · Paper page
  2. Tarabichi Y, Cheng A, Bar-Shain D, et al. Improving timeliness of antibiotic administration using a provider and pharmacist facing sepsis early warning system in the emergency department setting: a randomized controlled quality improvement initiative. Crit Care Med. 2022;50(3):418-427. doi:10.1097/CCM.0000000000005267 · DOI · Paper page
  3. Lyons PG, Hofford MR, Yu SC, et al. Factors associated with variability in the performance of a proprietary sepsis prediction model across 9 networked hospitals in the US. JAMA Intern Med. 2023;183(6):611-612. doi:10.1001/ jamainternmed.2022.7182

Cited by

Sorted by citations

Authors
Balczewski, E. A., Lyons, P. G., & Singh, K.
Affiliations
  • University of Michigan (US)
  • Oregon Health & Science University (US)
Corresponding author
Singh, Karandeep
Venue
JAMA Network Open
Published
2023-08-25
Volume
6
Issue
8
Pages
e2329704
ISSN
2574-3805 (ISSN-L)
OpenAlex
W4386151482
Cited by
2
References
4
Citations by year
2026: 1 · 2024: 1
FWCI
0.40
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JAMA Network Open (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • Teva Pharmaceutical Industries
  • Flatiron Health
  • Agency for Healthcare Research and Quality
  • National Center for Advancing Translational Sciences
Topics
  • Health Sciences › Medicine › Epidemiology › Sepsis Diagnosis and Treatment
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Medicine › Surgery › Healthcare Technology and Patient Monitoring
Keywords
sepsis prediction model, clinical decision support alerts, personalized interventions, sepsis severity index, bundle compliance, sepsis mortality, hospital performance variation
MeSH terms
Humans, Sepsis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review