FDA-Authorized AI/ML Tool for Sepsis Prediction: Development and Validation
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
BACKGROUND Sepsis is a life-threatening condition that demands prompt treatment for improved patient outcomes. Its heterogenous presentation makes early detection challenging, highlighting the need for effective risk assessment tools. Artificial intelligence (AI) models could potentially identify patients with sepsis, but none have previously been authorized by the U.S. Food and Drug Administration (FDA) for commercial use. This study outlines the development and validation of the Sepsis ImmunoScore, the first FDA-authorized AI-based software designed to identify patients at risk of sepsis. METHODS In this prospective study, we enrolled adult patients (18+ years of age) suspected of infection, as indicated by a blood culture order, from five U.S. institutions between April 2017 and July 2022. The participants were divided into an algorithm development cohort (n=2366), an internal validation cohort (n=393), and an external validation cohort (n=698). The primary end point was sepsis presence (as defined by Sepsis-3) within 24 hours of test initiation. Secondary end points included length of hospital stay, intensive care unit (ICU) admission within 24 hours, mechanical ventilation use within 24 hours, vasopressor use within 24 hours, and in-hospital mortality. RESULTS The Sepsis ImmunoScore demonstrated high diagnostic accuracy, with an area under the curve of 0.85 (0.83 to 0.87) in the derivation cohort, 0.80 (0.74 to 0.86) in internal validation, and 0.81 (0.77 to 0.86) in external validation. The scores were categorized into four sepsis risk levels with corresponding likelihood ratios: low (0.1), medium (0.5), high (2.1), and very high (8.3). These risk categories also predicted in-hospital mortality: low (0.0%), medium (1.9%), high (8.7%), and very high (18.2%) in the external validation cohort. Similar trends were observed for other metrics, such as length of hospital stay, ICU utilization, mechanical ventilation, and vasopressor use. CONCLUSIONS The Sepsis ImmunoScore demonstrated high accuracy for the identification and prediction of sepsis and critical illness metrics that could enable prompt identification of patients at high risk of sepsis and adverse outcomes, potentially improving clinical decision-making and patient outcomes. (Funded by the Defense Threat Reduction Agency and others.).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kumar, A., Roberts, D., Wood, K. E., Light, B., Parrillo, J. E., Sharma, S., Suppes, R., Feinstein, D., Zanotti, S., Taiberg, L., et al. (2006) · Critical Care Medicine · doi:10.1097/01.ccm.0000217961.75225.e9 · Cited by 6,109
Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021
Evans, L., Rhodes, A., Alhazzani, W., Antonelli, M., Coopersmith, C. M., French, C., Machado, F. R., Mcintyre, L., Ostermann, M., Prescott, H. C., et al. (2021) · Intensive Care Medicine · doi:10.1007/s00134-021-06506-y · Cited by 5,082
Some Methods for Strengthening the Common χ 2 Tests
Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001616 · Cited by 3,718 · cited 1×
“18-20 We also estimated the area under the receiver operating characteristic curve (AUROC) of the sepsis risk score.”
Incidence and trends of sepsis in US hospitals using clinical vs claims data, 2009-2014.
Rhee, C., Dantes, R., Epstein, L., Murphy, D. J., Seymour, C. W., Iwashyna, T. J., Kadri, S. S., Angus, D. C., Danner, R. L., Fiore, A. E., et al. (2017) · JAMA · doi:10.1001/jama.2017.13836 · Cited by 1,884 · cited 1×
“9 The derivation cohort used a Sepsis-3 outcome derived from the medical record in an automated fashion, 9,10 while the internal and external validation cohorts used expert clinical adjudication to apply the definitions and determine the Sepsis-3 outcome.”
The timing of early antibiotics and hospital mortality in sepsis.
Liu, V. X., Fielding-Singh, V., Greene, J. D., Baker, J. M., Iwashyna, T. J., Bhattacharya, J., & Escobar, G. J. (2017) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201609-1848oc · Cited by 1,006
Wong, A., Otles, E., Donnelly, J. P., Krumm, A., McCullough, J., DeTroyer-Cooley, O., Pestrue, J., Phillips, M., Konye, J., Penoza, C., et al. (2021) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2021.2626 · Cited by 995 · cited 1×
“41-44 A large external validation study of the widely deployed Epic Sepsis Model in 2021 reported an AUC of only 0.63, 41 and recent reviews of validation studies of the Targeted Real-Time Early Warning System score have raised concerns regarding the control group and false positives.”
InfluentialGaieski, D. F., Mikkelsen, M. E., Band, R. A., Pines, J. M., Massone, R., Furia, F. F., Shofer, F. S., & Goyal, M. (2010) · Critical Care Medicine · doi:10.1097/ccm.0b013e3181cc4824 · Cited by 970
Fleuren, L. M., Klausch, T. L. T., Zwager, C. L., Schoonmade, L. J., Guo, T., Roggeveen, L. F., Swart, E. L., Girbes, A. R. J., Thoral, P., Ercole, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-019-05872-y · Cited by 755
Use of Procalcitonin to Shorten Antibiotic Treatment Duration in Septic Patients
Nobre, V., Harbarth, S., Graf, J.-D., Rohner, P., & Pugin, J. (2008) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200708-1238oc · Cited by 605
Puskarich, M. A., Trzeciak, S., Shapiro, N. I., Arnold, R. C., Horton, J. M., Studnek, J. R., Kline, J. A., & Jones, A. E. (2011) · Critical Care Medicine · doi:10.1097/ccm.0b013e31821e87ab · Cited by 376
Self-citation
Cited by
Surviving Sepsis campaign: international guidelines for Management of Sepsis and Septic Shock 2026
Prescott, H. C., Antonelli, M., Alhazzani, W., Møller, M. H., Alshamsi, F., Azevedo, L. C. P., Belley-Cote, E., De Waele, J., Derde, L., Dionne, J. C., et al. (2026) · Critical Care Medicine · doi:10.1097/ccm.0000000000007075 · Cited by 117
Transforming sepsis management: AI-driven innovations in early detection and tailored therapies
Papareddy, P., Lobo, T. J., Holub, M., Bouma, H., Maca, J., Strodthoff, N., & Herwald, H. (2025) · Critical Care · doi:10.1186/s13054-025-05588-0 · Cited by 49
Pavlik, E. J., Land Woodward, J., Lawton, F., Swiecki-Sikora, A. L., Ramaiah, D. D., & Rives, T. A. (2025) · doi:10.20944/preprints202502.0521.v1 · Cited by 8
Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis
Nguyen, H. B., Krishtopaytis, E., Lopez, E., Farnoudi, N., Van, T., Kharalampova, V., & Coz Yataco, A. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15093477
Metadata
- Authors
- Bhargava, A., López-Espina, C., Schmalz, L., Khan, S., Watson, G. L., Urdiales, D., Updike, L., Kurtzman, N., Dagan, A., Doodlesack, A., Stenson, B. A., Sarma, D., Reseland, E., Lee, J. H., Kravitz, M. S., Antkowiak, P. S., Shvilkina, T., Espinosa, A., Halalau, A., Demarco, C., Davila, F., Davila, H., Sims, M., Maddens, N., Berghea, R., Smith, S., Palagiri, A. V., Ezekiel, C., Sadaka, F., Iyer, K., Crisp, M., Azad, S., Oke, V., Friederich, A., Syed, A., Gosai, F., Chawla, L., Evans, N., Thomas, K., Malkani, R., Patel, R., Mayer, S., Ali, F., Raghavakurup, L., Tafa, M., Singh, S., Raouf, S., Zhao, S. D., Zhu, R., Bashir, R., Reddy, B., & Shapiro, N. I.
- Venue
- NEJM AI
- Publisher
- Massachusetts Medical Society
- Published
- 2024-11-27
- Volume
- 1
- Issue
- 12
- ISSN
- 2836-9386 (ISSN-L)
- OpenAlex
- W4404756513
- Cited by
- 72
- References
- 12
- FWCI
- 18.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: FDA-Authorized AI/ML Tool for Sepsis Prediction: Development and Validation. https://app.cochat.ai/papers/10.1056/aioa2400867
- The paper
- Bhargava, A., López-Espina, C., Schmalz, L., Khan, S., Watson, G. L., Urdiales, D., Updike, L., Kurtzman, N., Dagan, A., Doodlesack, A., Stenson, B. A., Sarma, D., Reseland, E., Lee, J. H., Kravitz, M. S., Antkowiak, P. S., Shvilkina, T., Espinosa, A., Halalau, A., . . . Shapiro, N. I. (2024). FDA-Authorized AI/ML Tool for Sepsis Prediction: Development and Validation. NEJM AI. https://doi.org/10.1056/aioa2400867
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.