A Molecular Host Response Assay to Discriminate Between Sepsis and Infection-Negative Systemic Inflammation in Critically Ill Patients: Discovery and Validation in Independent Cohorts
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Systemic inflammation is a whole body reaction having an infection-positive (i.e., sepsis) or infection-negative origin. It is important to distinguish between these two etiologies early and accurately because this has significant therapeutic implications for critically ill patients. We hypothesized that a molecular classifier based on peripheral blood RNAs could be discovered that would (1) determine which patients with systemic inflammation had sepsis, (2) be robust across independent patient cohorts, (3) be insensitive to disease severity, and (4) provide diagnostic utility. The goal of this study was to identify and validate such a molecular classifier. METHODS AND FINDINGS: We conducted an observational, non-interventional study of adult patients recruited from tertiary intensive care units (ICUs). Biomarker discovery utilized an Australian cohort (n = 105) consisting of 74 cases (sepsis patients) and 31 controls (post-surgical patients with infection-negative systemic inflammation) recruited at five tertiary care settings in Brisbane, Australia, from June 3, 2008, to December 22, 2011. A four-gene classifier combining CEACAM4, LAMP1, PLA2G7, and PLAC8 RNA biomarkers was identified. This classifier, designated SeptiCyte Lab, was validated using reverse transcription quantitative PCR and receiver operating characteristic (ROC) curve analysis in five cohorts (n = 345) from the Netherlands. Patients for validation were selected from the Molecular Diagnosis and Risk Stratification of Sepsis study (ClinicalTrials.gov, NCT01905033), which recruited ICU patients from the Academic Medical Center in Amsterdam and the University Medical Center Utrecht. Patients recruited from November 30, 2012, to August 5, 2013, were eligible for inclusion in the present study. Validation cohort 1 (n = 59) consisted entirely of unambiguous cases and controls; SeptiCyte Lab gave an area under curve (AUC) of 0.95 (95% CI 0.91-1.00) in this cohort. ROC curve analysis of an independent, more heterogeneous group of patients (validation cohorts 2-5; 249 patients after excluding 37 patients with an infection likelihood of "possible") gave an AUC of 0.89 (95% CI 0.85-0.93). Disease severity, as measured by Sequential Organ Failure Assessment (SOFA) score or Acute Physiology and Chronic Health Evaluation (APACHE) IV score, was not a significant confounding variable. The diagnostic utility of SeptiCyte Lab was evaluated by comparison to various clinical and laboratory parameters available to a clinician within 24 h of ICU admission. SeptiCyte Lab was significantly better at differentiating cases from controls than all tested parameters, both singly and in various logistic combinations, and more than halved the diagnostic error rate compared to procalcitonin in all tested cohorts and cohort combinations. Limitations of this study relate to (1) cohort compositions that do not perfectly reflect the composition of the intended use population, (2) potential biases that could be introduced as a result of the current lack of a gold standard for diagnosing sepsis, and (3) lack of a complete, unbiased comparison to C-reactive protein. CONCLUSIONS: SeptiCyte Lab is a rapid molecular assay that may be clinically useful in managing ICU patients with systemic inflammation. Further study in population-based cohorts is needed to validate this assay for clinical use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649 · cited 4×
“DeLong’s test [36] was used to estimate the significance (p-value) of each pairwise comparison, and this test takes into account sample size.”
InfluentialpROC: an open-source package for R and S+ to analyze and compare ROC curves
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., & Müller, M. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-77 · Cited by 13,697 · cited 1×
“4 [35], and were reported to two significant figures.”
Gene selection for cancer classification using support vector machines
Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954
Surviving Sepsis Campaign: International Guidelines for Management of Severe Sepsis and Septic Shock
Dellinger, R. P., Levy, M. M., Rhodes, A., Annane, D., Gerlach, H., Opal, S. M., Sevransky, J. E., Sprung, C. L., Douglas, I. S., Jaeschke, R., et al. (2013) · Critical Care Medicine · doi:10.1097/ccm.0b013e31827e83af · Cited by 9,694
Pencina, M. J., D' Agostino, R. B., D' Agostino, R. B., & Vasan, R. S. (2008) · Statistics in Medicine · doi:10.1002/sim.2929 · Cited by 6,493
Points of control in inflammation
Nathan, C. (2002) · Nature · doi:10.1038/nature01320 · Cited by 2,738 · cited 1×
“We argue that, during the development of a new diagnostic assay for sepsis, the deliberate exclusion of patients with an infection likelihood of possible is necessitated by five factors: (1) the definition of sepsis was originally coined to “provide a conceptual and practical framework” rather than to provide “a clini…”
Dichotomizing continuous predictors in multiple regression: a bad idea
Royston, P., Altman, D. G., & Sauerbrei, W. (2006) · Statistics in Medicine · doi:10.1002/sim.2331 · Cited by 2,312
Nathan, C., & Ding, A. (2010) · Cell · doi:10.1016/j.cell.2010.02.029 · Cited by 2,183
Empirical evidence of design-related bias in studies of diagnostic tests.
Lijmer, J. G. (1999) · JAMA · doi:10.1001/jama.282.11.1061 · Cited by 1,861
The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Moher, D., Rennie, D., de Vet, H. C. W., & Lijmer, J. G. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00012-w1 · Cited by 1,124
Cited by
The Pathogenesis of Sepsis and Potential Therapeutic Targets
Huang, M., Cai, S., & Su, J. (2019) · International Journal of Molecular Sciences · doi:10.3390/ijms20215376 · Cited by 776
Scicluna, B. P., van Vught, L. A., Zwinderman, A. H., Wiewel, M. A., Davenport, E. E., Burnham, K. L., Nürnberg, P., Schultz, M. J., Horn, J., Cremer, O. L., et al. (2017) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(17)30294-1 · Cited by 672
Self-citationAn immune-cell signature of bacterial sepsis
Reyes, M., Filbin, M. R., Bhattacharyya, R. P., Billman, K., Eisenhaure, T., Hung, D. T., Levy, B. D., Baron, R. M., Blainey, P. C., Goldberg, M. B., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0752-4 · Cited by 489
Sweeney, T. E., Azad, T. D., Donato, M., Haynes, W. A., Perumal, T. M., Henao, R., Bermejo-Martin, J. F., Almansa, R., Tamayo, E., Howrylak, J. A., et al. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000003084 · Cited by 362
Sweeney, T. E., Wong, H. R., & Khatri, P. (2016) · Science Translational Medicine · doi:10.1126/scitranslmed.aaf7165 · Cited by 334
“Other groups have made gene expression classifiers for infection but did not include models for discriminating viral infections (7, 9, 10).”
BackgroundEmerging Technologies for Molecular Diagnosis of Sepsis
Sinha, M., Jupe, J., Mack, H., Coleman, T. P., Lawrence, S. M., & Fraley, S. I. (2018) · Clinical Microbiology Reviews · doi:10.1128/cmr.00089-17 · Cited by 331
The Clinical Challenge of Sepsis Identification and Monitoring
Vincent, J.-L. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002022 · Cited by 259
“[57], using microarray analysis in a development cohort, identified a molecular classifier of four RNA biomarkers, and showed in validation cohorts that it was able to distinguish patients with sepsis from those without with an AUC of 0.”
MethodAntibiotic failure: Beyond antimicrobial resistance
de la Fuente-Nunez, C., Cesaro, A., & Hancock, R. E. W. (2023) · Drug Resistance Updates · doi:10.1016/j.drup.2023.101012 · Cited by 254
Ljungström, L., Pernestig, A.-K., Jacobsson, G., Andersson, R., Usener, B., & Tilevik, D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0181704 · Cited by 219
Sepsis: frontiers in diagnosis, resuscitation and antibiotic therapy
Perner, A., Gordon, A. C., De Backer, D., Dimopoulos, G., Russell, J. A., Lipman, J., Jensen, J.-U., Myburgh, J., Singer, M., Bellomo, R., et al. (2016) · Intensive Care Medicine · doi:10.1007/s00134-016-4577-z · Cited by 227
“While PCT may be helpful in limiting the duration of antibiotic therapy, we need a better biomarker of infection in the presence of the ubiquitous inflammatory response [28].”
BackgroundSelf-citationvan Engelen, T. S. R., Wiersinga, W. J., Scicluna, B. P., & van der Poll, T. (2018) · Critical Care Clinics · doi:10.1016/j.ccc.2017.08.010 · Cited by 178
Self-citationKapasi, A. J., Dittrich, S., González, I. J., & Rodwell, T. C. (2016) · PLOS ONE · doi:10.1371/journal.pone.0160278 · Cited by 163
“92 in discrimination of infectious sepsis cases from non-infectious controls [77, 78].”
BackgroundRello, J., van Engelen, T. S. R., Alp, E., Calandra, T., Cattoir, V., Kern, W. V., Netea, M. G., Nseir, S., Opal, S. M., van de Veerdonk, F. L., et al. (2018) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2018.03.011 · Cited by 143
The Captain Study Group, Parlato, M., Philippart, F., Rouquette, A., Moucadel, V., Puchois, V., Blein, S., Bedos, J.-P., Diehl, J.-L., Hamzaoui, O., et al. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5228-3 · Cited by 85
Zheng, X., Meng, D., Chen, D., Wong, W.-K., To, K.-H., Zhu, L., Wu, J., Liang, Y., Leung, K.-S., Wong, M.-H., et al. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1012083 · Cited by 14
Jin, N., Nan, C., Li, W., Lin, P., Xin, Y., Wang, J., Chen, Y., Wang, Y., Yu, K., Wang, C., et al. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae661 · Cited by 9
“McHugh et al. developed a four-gene classifier combining expression of CEACAM4, LAMP1, PLA2G7, and PLAC8 genes in managing ICU patients with systemic inflammation [11].”
Metadata
- Authors
- McHugh, L., Seldon, T. A., Brandon, R. A., Kirk, J. T., Rapisarda, A., Sutherland, A. J., Presneill, J. J., Venter, D. J., Lipman, J., Thomas, M. R., Klein Klouwenberg, P. M. C., van Vught, L., Scicluna, B., Bonten, M., Cremer, O. L., Schultz, M. J., van der Poll, T., Yager, T. D., & Brandon, R. B.
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-12-08
- Volume
- 12
- Issue
- 12
- Pages
- e1001916
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- OpenAlex
- W2195240341
- Cited by
- 213
- References
- 11
- FWCI
- 12.38
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.