Cited by 3,939Sepsis Diagnosis and TreatmentInflammation biomarkers and pathwaysAcute Kidney Injury Research

Assessment of Clinical Criteria for Sepsis: For the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3)

Open access
Seymour, Christopher W., Liu, Vincent X., Iwashyna, Theodore J., Brunkhorst, Frank M., Rea, Thomas D., Scherag, André, Rubenfeld, Gordon, Kahn, Jeremy M. +5 more·2016·JAMA

Abstract

IMPORTANCE: The Third International Consensus Definitions Task Force defined sepsis as "life-threatening organ dysfunction due to a dysregulated host response to infection." The performance of clinical criteria for this sepsis definition is unknown. OBJECTIVE: To evaluate the validity of clinical criteria to identify patients with suspected infection who are at risk of sepsis. DESIGN, SETTINGS, AND POPULATION: Among 1.3 million electronic health record encounters from January 1, 2010, to December 31, 2012, at 12 hospitals in southwestern Pennsylvania, we identified those with suspected infection in whom to compare criteria. Confirmatory analyses were performed in 4 data sets of 706,399 out-of-hospital and hospital encounters at 165 US and non-US hospitals ranging from January 1, 2008, until December 31, 2013. EXPOSURES: Sequential [Sepsis-related] Organ Failure Assessment (SOFA) score, systemic inflammatory response syndrome (SIRS) criteria, Logistic Organ Dysfunction System (LODS) score, and a new model derived using multivariable logistic regression in a split sample, the quick Sequential [Sepsis-related] Organ Failure Assessment (qSOFA) score (range, 0-3 points, with 1 point each for systolic hypotension [≤100 mm Hg], tachypnea [≥22/min], or altered mentation). MAIN OUTCOMES AND MEASURES: For construct validity, pairwise agreement was assessed. For predictive validity, the discrimination for outcomes (primary: in-hospital mortality; secondary: in-hospital mortality or intensive care unit [ICU] length of stay ≥3 days) more common in sepsis than uncomplicated infection was determined. Results were expressed as the fold change in outcome over deciles of baseline risk of death and area under the receiver operating characteristic curve (AUROC). RESULTS: In the primary cohort, 148,907 encounters had suspected infection (n = 74,453 derivation; n = 74,454 validation), of whom 6347 (4%) died. Among ICU encounters in the validation cohort (n = 7932 with suspected infection, of whom 1289 [16%] died), the predictive validity for in-hospital mortality was lower for SIRS (AUROC = 0.64; 95% CI, 0.62-0.66) and qSOFA (AUROC = 0.66; 95% CI, 0.64-0.68) vs SOFA (AUROC = 0.74; 95% CI, 0.73-0.76; P < .001 for both) or LODS (AUROC = 0.75; 95% CI, 0.73-0.76; P < .001 for both). Among non-ICU encounters in the validation cohort (n = 66 522 with suspected infection, of whom 1886 [3%] died), qSOFA had predictive validity (AUROC = 0.81; 95% CI, 0.80-0.82) that was greater than SOFA (AUROC = 0.79; 95% CI, 0.78-0.80; P < .001) and SIRS (AUROC = 0.76; 95% CI, 0.75-0.77; P < .001). Relative to qSOFA scores lower than 2, encounters with qSOFA scores of 2 or higher had a 3- to 14-fold increase in hospital mortality across baseline risk deciles. Findings were similar in external data sets and for the secondary outcome. CONCLUSIONS AND RELEVANCE: Among ICU encounters with suspected infection, the predictive validity for in-hospital mortality of SOFA was not significantly different than the more complex LODS but was statistically greater than SIRS and qSOFA, supporting its use in clinical criteria for sepsis. Among encounters with suspected infection outside of the ICU, the predictive validity for in-hospital mortality of qSOFA was statistically greater than SOFA and SIRS, supporting its use as a prompt to consider possible sepsis.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1001/jama.2016.0288

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • qSOFA was identified as a predictor of poor outcome in patients with known or suspected infection, but no analysis supported its use as a screening tool.

    “Data analysis used to support the recommendations of the Third International Consensus Conference on the Definitions of Sepsis identified qSOFA as a predictor of poor outcome in patients with known or suspected infection, but no analysis was performed to support its use as a screening tool (5).”

    From Surviving Sepsis Campaign: International Guidelines for Management of Sepsis and Septic Shock 2021. (2021) · cites this paper as [5]

    The Results (Performance of New, Simple Criteria) show that qSOFA predicted hospital mortality among patients with suspected infection. The Discussion (Criteria Outside of the ICU; Limitations) says the study did not test whether qSOFA could distinguish patients with infection from those without it, supporting the narrower point that it was not evaluated as a stand-alone infection screen. The broader claim that no analysis supported any screening use goes beyond those passages: the Discussion recommends using qSOFA outside the ICU to consider the possibility of sepsis. (LLM, conf=0.83)

    Experimental — accuracy not yet measured
  • Earlier detection of sepsis can be challenging due to its nonspecific symptoms and the lack of a definitive diagnostic test.

    “However, earlier detection of sepsis can be challenging due to its nonspecific symptoms and the lack of a definitive diagnostic test.3,4”

    From Development and validation of a screening tool for sepsis without laboratory results in the emergency department: a machine learning study (2025) · cites this paper as [3]

    The Abstract (Conclusions and Relevance; page unavailable) says there is no “gold standard” diagnostic test for sepsis. The Discussion (Criteria Outside of the ICU; page unavailable) addresses early recognition and the difficulty of obtaining some clinical and laboratory measures promptly, but our copy does not attribute that difficulty to nonspecific symptoms. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • A validated algorithm (sensitivity 91.2%, specificity 89.7%) was used to identify eligible patients.

    “A validated algorithm (sensitivity 91.2%, specificity 89.7%) was used to identify eligible patients from electronic health records30,31.”

    From Machine learning predicts sepsis deterioration trajectories. (2026) · cites this paper as [30]

    The Methods section, “Defining a Cohort With Suspected Infection” (page unavailable), describes identifying patients from EHR data using the timing of antibiotic orders and body-fluid cultures. It does not report that this identification algorithm was validated with 91.2% sensitivity and 89.7% specificity; those figures are unsupported by this paper. (LLM, conf=0.85)

    Experimental — accuracy not yet measured
  • In the original derivation study, only 24% of infected patients had a qSOFA score 2 or 3, but these patients accounted for 70% of poor outcomes.

    “In the original derivation study, authors found that only 24% of infected patients had a qSOFA score 2 or 3, but these patients accounted for 70% of poor outcomes (5).”
  • Data analysis used to support the Third International Consensus Conference on Definitions of Sepsis identified qSOFA as a predictor of poor outcome in patients with known or suspected infection, but no analysis was performed to support its use as a screening tool.

    “Data analysis used to support the recommendations of the Third International Consensus Conference on the Definitions of Sepsis identified qSOFA as a predictor of poor outcome in patients with known or suspected infection, but no analysis was performed to support its use as a screening tool (5).”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Seymour, C. W., Liu, V. X., Iwashyna, T. J., Brunkhorst, F. M., Rea, T. D., Scherag, A., Rubenfeld, G., Kahn, J. M., Shankar-Hari, M., Singer, M., Deutschman, C. S., Escobar, G. J., & Angus, D. C.
Affiliations
  • University of Pittsburgh (US)
  • Kaiser Permanente (US)
  • University of Michigan (US)
  • Jena University Hospital (DE)
  • University of Washington (US)
  • Sunnybrook Health Science Centre (CA)
  • Critical Care Medicine, Guy’s and St Thomas’ NHS Foundation Trust, London, England
  • University College London (GB)
  • Feinstein Institute for Medical Research (US)
Corresponding author
Seymour, Christopher W.
Venue
JAMA
Published
2016-02-23
Volume
315
Issue
8
Pages
762
ISSN
  • 0002-9955 (ISSN-L)
  • 0098-7484
OpenAlex
W2282181907
Cited by
3,939
References
43
Citations by year
2026: 336 · 2025: 309 · 2024: 386 · 2023: 417 · 2022: 375 · 2021: 517 · 2020: 451 · 2019: 399 · 2018: 338 · 2017: 270 · 2016: 132 · 2015: 3 · 2013: 2
FWCI
356.11
Type
journal article
Language
en
Open access
Locations
  • JAMA (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • Research Portal (King's College London) (submittedVersion, other-oa)
Funders
National Institute of General Medical Sciences (K23GM104022, K23GM112018)
Topics
  • Health Sciences › Medicine › Epidemiology › Sepsis Diagnosis and Treatment
  • Life Sciences › Immunology and Microbiology › Immunology › Inflammation biomarkers and pathways
  • Health Sciences › Medicine › Nephrology › Acute Kidney Injury Research
Keywords
sepsis, sepsis definitions, clinical criteria, qSOFA, SOFA score, systemic inflammatory response syndrome, in-hospital mortality, ICU length of stay, organ dysfunction, suspected infection, predictive validity, construct validity, electronic health records, sepsis mortality prediction model, early warning scores
MeSH terms
Adult, Female, Humans, Hypotension, Infections, Intensive Care Units, Length of Stay, Male, Pennsylvania, Regression Analysis, Retrospective Studies, Reproducibility of Results, Hospital Mortality, Systemic Inflammatory Response Syndrome, Sepsis, Lactic Acid, Consensus, Tachypnea, Organ Dysfunction Scores

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review