Severe sepsis cohorts derived from claims-based strategies appear to be biased toward a more severely ill patient population.
Open accessAbstract
OBJECTIVE: The epidemiology of severe sepsis is derived from administrative databases that rely on International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM) codes to select cases. We compared the sensitivity of two code abstraction methods in identifying severe sepsis cases using a severe sepsis registry. DESIGN: Single-center retrospective cohort study. SETTING: Tertiary care, Academic, University Hospital. PATIENTS: One thousand seven hundred thirty-five patients with severe sepsis or septic shock. INTERVENTIONS: None. MEASUREMENTS: Proportion identified as severe sepsis using two code abstraction methods: 1) the new specific ICD-9 codes for severe sepsis and septic shock, and 2) a validated method requiring two ICD-9 codes for infection and end-organ dysfunction. Multivariable logistic regression was performed to determine sociodemographics and clinical characteristics associated with documentation and coding accuracy. MAIN RESULTS: The strategy combining a code for infection and end-organ dysfunction was more sensitive in identifying cases than the method requiring specific ICD-9 codes for severe sepsis or septic shock (47% vs. 21%). Elevated serum lactate level (p<0.001), ICU admission (p<0.001), presence of shock (p<0.001), bacteremia as the source of sepsis (p=0.02), and increased Acute Physiology and Chronic Health Evaluation II score (p<0.001) were independently associated with being appropriately documented and coded. The 28-day mortality was significantly higher in those who were accurately documented/coded (41%, compared with 14% in those who were not, p<0.001), reflective of a more severe presentation on admission. CONCLUSIONS: Patients admitted with severe sepsis and septic shock were incompletely documented and under-coded, using either ICD-9 code abstracting method. Documentation of subsequent coding of severe sepsis was more common in more severely ill patients. These findings are important when evaluating current national estimates and when interpreting epidemiologic studies of severe sepsis as cohorts derived from claims-based strategies appear to be biased toward a more severely ill patient population.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Knaus, W. A., Draper, E. A., Wagner, D. P., & Zimmerman, J. E. (1985) · Critical Care Medicine · doi:10.1097/00003246-198510000-00009 · Cited by 15,333 · see citing works
APACHE II-A Severity of Disease Classification System
Knaus, W. A., Draper, E. A., Wagner, D. P., & Zimmerman, J. E. (1986) · Critical Care Medicine · doi:10.1097/00003246-198608000-00028 · Cited by 13,379 · see citing works
Bone, R. C., BALK, R. A., Cerra, F. B., Dellinger, R. P., Fein, A. M., Knaus, W. A., Schein, R. M. H., & Sibbald, W. J. (1992) · CHEST Journal · doi:10.1378/chest.101.6.1644 · Cited by 13,192 · see citing works
Early goal-directed therapy in the treatment of severe sepsis and septic shock
Rivers, E., Nguyen, B., Havstad, S., Ressler, J., Muzzin, A., Knoblich, B., Peterson, E., & Tomlanovich, M. (2001) · New England Journal of Medicine · doi:10.1056/nejmoa010307 · Cited by 10,743 · see citing works
Angus, D. C., Linde-Zwirble, W. T., Lidicker, J., Clermont, G., Carcillo, J., & Pinsky, M. R. (2001) · Critical Care Medicine · doi:10.1097/00003246-200107000-00002 · Cited by 8,503 · see citing works
APACHE II: a severity of disease classification system.
Knaus, W. A., Draper, E. S., Wagner, D. P., & Zimmerman, J. E. (1985) · PubMed · Cited by 6,034 · see citing works
2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference
Levy, M. M., Fink, M. P., Marshall, J. C., Abraham, E. H., Angus, D. C., Cook, D., Cohen, J., Opal, S. M., Vincent, J., & Ramsay, G. (2003) · Critical Care Medicine · doi:10.1097/01.ccm.0000050454.01978.3b · Cited by 5,976 · see citing works
The epidemiology of sepsis in the United States from 1979 through 2000
Martin, G. S., Mannino, D. M., Eaton, S., & Moss, M. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa022139 · Cited by 5,841 · see citing works
Long-term cognitive impairment and functional disability among survivors of severe sepsis.
Iwashyna, T. J., Ely, E. W., Smith, D. M., & Langa, K. M. (2010) · JAMA · doi:10.1001/jama.2010.1553 · Cited by 2,582 · see citing works
A wilcoxon‐type test for trend
Cuzick, J. M. (1985) · Statistics in Medicine · doi:10.1002/sim.4780040112 · Cited by 1,920 · see citing works
Dombrovskiy, V. Y., Martin, A. A., Sunderram, J., & Paz, H. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000261890.41311.e9 · Cited by 1,250 · see citing works
Serum lactate is associated with mortality in severe sepsis independent of organ failure and shock*
Mikkelsen, M. E., Miltiades, A., Gaieski, D. F., Goyal, M. K., Fuchs, B. D., Shah, C. V., Bellamy, S. L., & Christie, J. D. (2009) · Critical Care Medicine · doi:10.1097/ccm.0b013e31819fcf68 · Cited by 1,002 · see citing works
Self-citationHospitalizations, costs, and outcomes of severe sepsis in the United States 2003 to 2007
Lagu, T., Rothberg, M. B., Shieh, M.-S., Pekow, P. S., Steingrub, J. S., & Lindenauer, P. K. (2012) · Critical Care Medicine · doi:10.1097/ccm.0b013e318232db65 · Cited by 679 · see citing works
Xu, J., Kochanek, K. D., Murphy, S. L., & Tejada‐Vera, B. (2010) · PubMed · Cited by 650 · see citing works
Nationwide Trends of Severe Sepsis in the 21st Century (2000–2007)
Kumar, G., Kumar, N., Taneja, A., Kaleekal, T. S., Tarima, S. S., McGinley, E. L., Jimenez, E. J., Mohan, A., Khan, R. A., Whittle, J., et al. (2011) · CHEST Journal · doi:10.1378/chest.11-0352 · Cited by 615 · see citing works
Walkey, A. J., Wiener, R. S., Ghobrial, J. M., Curtis, L. H., & Benjamin, E. J. (2011) · JAMA · doi:10.1001/jama.2011.1615 · Cited by 490 · see citing works
The Epidemiology of Sepsis in Patients With Malignancy
Danai, P. A., Moss, M. M., Mannino, D. M., & Martin, G. S. (2006) · CHEST Journal · doi:10.1378/chest.129.6.1432 · Cited by 467 · see citing works
National estimates of severe sepsis in United States emergency departments
Wang, H. E., Shapiro, N. I., Angus, D. C., & Yealy, D. M. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000277043.85378.c1 · Cited by 421 · see citing works
Racial Variation in the Incidence, Care, and Outcomes of Severe Sepsis
Barnato, A. E., Alexander, S. L., Linde-Zwirble, W. T., & Angus, D. C. (2008) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200703-480oc · Cited by 284 · see citing works
Shapiro, N. I., Howell, M. D., Bates, D. W., Angus, D. C., Ngo, L. H., & Talmor, D. S. (2006) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2006.07.007 · Cited by 203 · see citing works
Kalhan, R., Mikkelsen, M. E., Dedhiya, P., Christie, J. D., Gaughan, C., Lanken, P. N., Finkel, B., Gallop, R., & Fuchs, B. D. (2006) · Critical Care Medicine · doi:10.1097/01.ccm.0000198328.83571.4a · Cited by 190 · see citing works
Self-citationWilhelms, S. B., Huss, F. R. M., Granath, G., & Sjöberg, F. (2010) · Critical Care Medicine · doi:10.1097/ccm.0b013e3181de4406 · Cited by 119 · see citing works
Epidemiology of sepsis in Norway in 1999
Flaatten, H. K. (2004) · Critical Care · doi:10.1186/cc2867 · Cited by 105 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [9]Poulose JT Cartin-Ceba R Shoja A Comparison of International Classification of Disease Ninth Revision (ICD-9) coding with retrospective case review for the diagnosis of septic shock Am J Respir Crit Care Med 2009 179 A4361
- [27]Dombrovskiy VY Martin AA Sunderram J Rapid increase in hospitalization and mortality rates for severe sepsis in the United States: a trend analysis from 1993 to 2003 Crit Care Med 2007 35 1244 1250 17414736
Cited by
Sorted by citations
Fleischmann, C., Scherag, A., Adhikari, N. K. J., Hartog, C. S., Tsaganos, T., Schlattmann, P., Angus, D. C., & Reinhart, K. (2016) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201504-0781oc · Cited by 3,548 · see citing works
Incidence and trends of sepsis in US hospitals using clinical vs claims data, 2009-2014.
Rhee, C., Dantes, R., Epstein, L., Murphy, D. J., Seymour, C. W., Iwashyna, T. J., Kadri, S. S., Angus, D. C., Danner, R. L., Fiore, A. E., et al. (2017) · JAMA · doi:10.1001/jama.2017.13836 · Cited by 1,884 · see citing works
A targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598 · see citing works
Rhee, C., Chiotos, K., Cosgrove, S. E., Heil, E. L., Kadri, S. S., Kalil, A. C., Gilbert, D. N., Masur, H., Septimus, E. J., Sweeney, D. A., et al. (2021) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa059 · Cited by 191 · see citing works
Diagnosing sepsis is subjective and highly variable: A survey of intensivists using case vignettes.
Rhee, C., Kadri, S. S., Danner, R. L., Suffredini, A. F., Massaro, A. F., Kitch, B. T., Lee, G., & Klompas, M. (2016) · Critical Care · doi:10.1186/s13054-016-1266-9 · Cited by 187 · see citing works
Post-acute care use and hospital readmission after sepsis.
Jones, T. K., Fuchs, B. D., Small, D. S., Halpern, S. D., Hanish, A., Umscheid, C. A., Baillie, C. A., Kerlin, M. P., Gaieski, D. F., & Mikkelsen, M. E. (2015) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201411-504oc · Cited by 140 · see citing works
Self-citationFleischmann-Struzek, C., Thomas-Rüddel, D. O., Schettler, A., Schwarzkopf, D., Stacke, A., Seymour, C. W., Haas, C., Dennler, U., & Reinhart, K. (2018) · PLOS ONE · doi:10.1371/journal.pone.0198847 · Cited by 95 · see citing works
Rhee, C., Jentzsch, M. S., Kadri, S. S., Seymour, C. W., Angus, D. C., Murphy, D. J., Martin, G. S., Dantes, R. B., Epstein, L., Fiore, A. E., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003554 · Cited by 85 · see citing works
Hospital-based acute care use in survivors of septic shock.
Ortego, A., Gaieski, D. F., Fuchs, B. D., Jones, T., Halpern, S. D., Small, D. S., Sante, S. C., Drumheller, B., Christie, J. D., & Mikkelsen, M. E. (2015) · Critical Care Medicine · doi:10.1097/ccm.0000000000000693 · Cited by 67 · see citing works
Self-citationTrends in empiric broad-Spectrum antibiotic use for suspected community-onset Sepsis in US hospitals
Rhee, C., Chen, T., Kadri, S. S., Lawandi, A., Yek, C., Walker, M., Warner, S., Fram, D., Chen, H.-C., Shappell, C. N., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.18923 · Cited by 58 · see citing works
Use of explicit ICD9-CM codes to identify adult severe sepsis: impacts on epidemiological estimates
Bouza, C., Lopez-Cuadrado, T., & Amate-Blanco, J. M. (2016) · Critical Care · doi:10.1186/s13054-016-1497-9 · Cited by 47 · see citing works
Diabetes mellitus and community-acquired bloodstream infections in the critically ill
McKane, C. K., Marmarelis, M., Mendu, M. L., Moromizato, T., Gibbons, F. K., & Christopher, K. B. (2014) · Journal of Critical Care · doi:10.1016/j.jcrc.2013.08.019 · Cited by 46 · see citing works
- Authors
- Whittaker, S.-A., Mikkelsen, M. E., Gaieski, D. F., Koshy, S., Kean, C., & Fuchs, B. D.
- Affiliations
- Hospital of the University of Pennsylvania (US)
- University of Pennsylvania Health System (US)
- University of Pennsylvania (US)
- Venue
- Critical Care Medicine
- Published
- 2013-04
- Volume
- 41
- Issue
- 4
- Pages
- 945-953
- ISSN
- 0090-3493 (ISSN-L)
- PMC
- PMC3810475
- OpenAlex
- W1986836608
- Cited by
- 156
- References
- 23
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 4 · 2023: 14 · 2022: 8 · 2021: 8 · 2020: 19 · 2019: 11 · 2018: 10 · 2017: 13 · 2016: 18 · 2015: 25 · 2014: 13 · 2013: 7
- FWCI
- 15.33
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Critical Care Medicine (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Heart, Lung, and Blood Institute (L30 HL115698)
- National Institute of General Medical Sciences (L30 GM086101)
- Topics
- Health Sciences › Medicine › Epidemiology › Sepsis Diagnosis and Treatment
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Nursing › Issues, ethics and legal aspects › Nursing Diagnosis and Documentation
- Keywords
- severe sepsis, septic shock, ICD-9-CM coding, end-organ dysfunction, documentation accuracy, 28-day mortality, sepsis epidemiology, APACHE II score, lactate
- MeSH terms
- Abstracting and Indexing, Adult, Aged, Critical Care, Female, Hospitals, University, Humans, Male, Medical Records, Middle Aged, Retrospective Studies, Sensitivity and Specificity, Severity of Illness Index, Shock, Septic, Cohort Studies, Critical Illness, Risk Assessment, Sepsis, International Classification of Diseases
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
