Alert Timing in Sepsis Prediction Models—An Opportunity to Tailor Interventions
Open accessAbstract
bundle compliance).If all alerting patients cannot actually be evaluated, the clinical benefits of these tools diminish greatly.4 Thus, clinicians overseeing the use of these tools must not only focus on selecting the optimal threshold or the best-performing tool.They must also determine whether any tools are sufficiently high performing to be useful at all.Recently, there are sepsis prediction models whose implementation has led to improvements in clinical outcomes, 5,6 including at least 1 study involving the SPM.However, performance of the SPM can vary substantially across hospitals (at least in version 1), 7 and we do not know the minimal performance required within a clinical setting before the use of a sepsis tool will translate to clinical benefits.Better clinical outcomes require both effective models and effective interventions, and both may benefit from tailoring to a local context.Through their analysis, Schertz et al 1 have identified a critical aspect of that tailoring: timing of alerts relative to sepsis onset.By estimating when alerts are expected to fire relative to sepsis onset, we can select interventions most likely to be useful at the time of the alert, hopefully aiding the translation of these tools into better clinical outcomes.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Even when discrimination is high, the threshold chosen for alerts may result in suboptimal sensitivity or excessive false alarms.
“Even when discrimination is high, the threshold chosen for alerts may result in suboptimal sensitivity or excessive false alarms [40].”
From Use of artificial intelligence in critical care: opportunities and obstacles (2024) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Wong, A., Otles, E., Donnelly, J. P., Krumm, A., McCullough, J., DeTroyer-Cooley, O., Pestrue, J., Phillips, M., Konye, J., Penoza, C., et al. (2021) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2021.2626 · Cited by 995 · see citing works
Self-citationAdams, R., Henry, K. E., Sridharan, A., Soleimani, H., Zhan, A., Rawat, N., Johnson, L., Hager, D. N., Cosgrove, S. E., Markowski, A., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01894-0 · Cited by 365 · see citing works
Sepsis prediction model for determining sepsis vs SIRS, qSOFA, and SOFA
Schertz, A. R., Lenoir, K. M., Bertoni, A. G., Levine, B. J., Mongraw-Chaffin, M., & Thomas, K. W. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.29729 · Cited by 78 · see citing works
Quantification of Sepsis Model Alerts in 24 US Hospitals Before and During the COVID-19 Pandemic
Wong, A., Cao, J., Lyons, P. G., Dutta, S., Major, V. J., Ötleş, E., & Singh, K. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.35286 · Cited by 57 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 3
- Singh K, Shah NH, Vickers AJ. Assessing the net benefit of machine learning models in the presence of resource constraints. J Am Med Inform Assoc. 2023;30(4):668-673. doi:10.1093/jamia/ocad006 · DOI · Paper page
- Tarabichi Y, Cheng A, Bar-Shain D, et al. Improving timeliness of antibiotic administration using a provider and pharmacist facing sepsis early warning system in the emergency department setting: a randomized controlled quality improvement initiative. Crit Care Med. 2022;50(3):418-427. doi:10.1097/CCM.0000000000005267 · DOI · Paper page
- Lyons PG, Hofford MR, Yu SC, et al. Factors associated with variability in the performance of a proprietary sepsis prediction model across 9 networked hospitals in the US. JAMA Intern Med. 2023;183(6):611-612. doi:10.1001/ jamainternmed.2022.7182
Cited by
Sorted by citations
Use of artificial intelligence in critical care: opportunities and obstacles
Pinsky, M. R., Bedoya, A., Bihorac, A., Celi, L., Churpek, M., Economou-Zavlanos, N. J., Elbers, P., Saria, S., Liu, V., Lyons, P. G., et al. (2024) · Critical Care · doi:10.1186/s13054-024-04860-z · Cited by 160 · see citing works
Self-citation
- Authors
- Balczewski, E. A., Lyons, P. G., & Singh, K.
- Affiliations
- University of Michigan (US)
- Oregon Health & Science University (US)
- Corresponding author
- Singh, Karandeep
- Venue
- JAMA Network Open
- Publisher
- American Medical Association (AMA)
- Published
- 2023-08-25
- Volume
- 6
- Issue
- 8
- Pages
- e2329704
- ISSN
- 2574-3805 (ISSN-L)
- OpenAlex
- W4386151482
- Cited by
- 2
- References
- 4
- Citations by year
- 2026: 1 · 2024: 1
- FWCI
- 0.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JAMA Network Open (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Teva Pharmaceutical Industries
- Flatiron Health
- Agency for Healthcare Research and Quality
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Medicine › Epidemiology › Sepsis Diagnosis and Treatment
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Surgery › Healthcare Technology and Patient Monitoring
- Keywords
- sepsis prediction model, clinical decision support alerts, personalized interventions, sepsis severity index, bundle compliance, sepsis mortality, hospital performance variation
- MeSH terms
- Humans, Sepsis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review