The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
The Elixhauser Comorbidity Method Outperforms the Charlson Index in Predicting Inpatient Death After Orthopaedic Surgery
Open accessAbstract
BACKGROUND: Scores derived from comorbidities can help with risk adjustment of quality and safety data. The Charlson and Elixhauser comorbidity measures are well-known risk adjustment models, yet the optimal score for orthopaedic patients remains unclear. QUESTIONS/PURPOSES: We determined whether there was a difference in the accuracy of the Charlson and Elixhauser comorbidity-based measures in predicting (1) in-hospital mortality after major orthopaedic surgery, (2) in-hospital adverse events, and (3) nonroutine discharge. METHODS: Among an estimated 14,007,813 patients undergoing orthopaedic surgery identified in the National Hospital Discharge Survey (1990-2007), 0.80% died in the hospital. The association of each Charlson comorbidity measure and Elixhauser comorbidity measure with mortality was assessed in bivariate analysis. Two main multivariable logistic regression models were constructed, with in-hospital mortality as the dependent variable and one of the two comorbidity-based measures (and age, sex, and year of surgery) as independent variables. A base model that included only age, sex, and year of surgery also was evaluated. The discriminative ability of the models was quantified using the area under the receiver operating characteristic curve (AUC). The AUC quantifies the ability of our models to assign a high probability of mortality to patients who die. Values range from 0.50 to 1.0, with 0.50 indicating no ability to discriminate and 1.0 indicating perfect discrimination. RESULTS: Elixhauser comorbidity adjustment provided a better prediction of in-hospital case mortality (AUC, 0.86; 95% CI, 0.86-0.86) compared with the Charlson model (AUC, 0.83; 95% CI, 0.83-0.84) and to the base model with no comorbidities (AUC, 0.81; 95% CI, 0.81-0.81). In terms of relative improvement in predictive performance, the Elixhauser measure performed 60% better than the Charlson score in predicting mortality. The Elixhauser model discriminated inpatient morbidity better than the Charlson measure, but the discriminative ability of the model was poor and the difference in the absolute improvement in predictive power between the two models (AUC, 0.01) is of dubious clinical importance. Both comorbidity models exhibited the same degree of discrimination for estimating nonroutine discharge (AUC, 0.81; 95% CI, 0.81-0.82 for both models). CONCLUSIONS: Provider-specific outcomes, particularly inpatient mortality, may be evaluated differently depending on the comorbidity risk adjustment model selected. Future research assessing and comparing the performance of the Charlson and Elixhauser measures in predicting long-term outcomes would be of value. LEVEL OF EVIDENCE: Level II, prognostic study. See the Instructions for Authors for a complete description of levels of evidence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742
Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data
Quan, H., Sundararajan, V., Halfon, P., Fong, A., Burnand, B., Luthi, J.-C., Saunders, L. D., Beck, C. A., Feasby, T. E., & Ghali, W. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000182534.19832.83 · Cited by 10,669
Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases
DEYO, R. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90133-8 · Cited by 10,452
Comorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921
Quan, H., Li, B., Couris, C. M., Fushimi, K., Graham, P., Hider, P., Januel, J.-M., & Sundararajan, V. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq433 · Cited by 5,843
van Walraven, C., Austin, P. C., Jennings, A., Quan, H., & Forster, A. J. (2009) · Medical Care · doi:10.1097/mlr.0b013e31819432e5 · Cited by 2,200
Regression modelling strategies for improved prognostic prediction
Harrell, F. E., Lee, K. L., Califf, R. M., Pryor, D. B., & Rosati, R. A. (1984) · Statistics in Medicine · doi:10.1002/sim.4780030207 · Cited by 1,798
Uno, H., Cai, T., Pencina, M. J., D'Agostino, R. B., & Wei, L. J. (2011) · Statistics in Medicine · doi:10.1002/sim.4154 · Cited by 1,535 · cited 1×
“To determine which model best predicted inpatient mortality, receiver operating characteristic (ROC) curves were plotted and the regression models were compared on the basis of the area under the ROC curve (AUC) and its 95% CI [20, 54].”
MethodNational Hospital Discharge Survey, 1988: Archival Version
United States Department of Health and Human Services. National Center for Health Statistics (1991) · ICPSR Data Holdings · doi:10.3886/icpsr09521 · Cited by 1,310
Assessing Quality Using Administrative Data
Iezzoni, L. I. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00048 · Cited by 974
Schneeweiss, S. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.9.854 · Cited by 711
National Hospital Discharge Survey: 2007 summary.
Hall, M. J., DeFrances, C. J., Williams, S. N., Golosinskiy, A., & Schwartzman, A. (2010) · PubMed · Cited by 626
Southern, D. A., Quan, H., & Ghali, W. A. (2004) · Medical Care · doi:10.1097/01.mlr.0000118861.56848.ee · Cited by 573
Surgical Mortality as an Indicator of Hospital Quality: The Problem With Small Sample Size
Dimick, J. B., Welch, H. G., & Birkmeyer, J. D. (2004) · JAMA · doi:10.1001/jama.292.7.847 · Cited by 468
Improved Comorbidity Adjustment for Predicting Mortality in Medicare Populations
Schneeweiss, S., Wang, P. S., Avorn, J., & Glynn, R. J. (2003) · Health Services Research · doi:10.1111/1475-6773.00165 · Cited by 330
Enhancement of Claims Data to Improve Risk Adjustment of Hospital Mortality
Pine, M., Jordan, H. S., Elixhauser, A., Fry, D. E., Hoaglin, D. C., Jones, B., Meimban, R., Warner, D., & Gonzales, J. (2007) · JAMA · doi:10.1001/jama.297.1.71 · Cited by 281
Factors That Predict Short-term Complication Rates After Total Hip Arthroplasty
SooHoo, N. F., Farng, E., Lieberman, J. R., Chambers, L., & Zingmond, D. S. (2010) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-010-1354-0 · Cited by 250
What Are the Rates and Causes of Hospital Readmission After Total Knee Arthroplasty?
Schairer, W. W., Vail, T. P., & Bozic, K. J. (2014) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-013-3030-7 · Cited by 231
Design and operation of the National Hospital Discharge Survey: 1988 redesign.
Dennison, C. F., & Pokras, R. (2000) · PubMed · Cited by 218
The Epidemiology of Admissions of Nontraumatic Subarachnoid Hemorrhage in the United States
Rincon, F., Rossenwasser, R. H., & Dumont, A. (2013) · Neurosurgery · doi:10.1227/01.neu.0000430290.93304.33 · Cited by 213
Risk of Fractures Following Cataract Surgery in Medicare Beneficiaries
Tseng, V. L., Yu, F., Lum, F., & Coleman, A. L. (2012) · JAMA · doi:10.1001/jama.2012.9014 · Cited by 205
RATE OF AND RISK FACTORS FOR ACUTE INPATIENT MORTALITY AFTER ORTHOPAEDIC SURGERY
BHATTACHARYYA, T., IORIO, R., & HEALY, W. L. (2002) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/00004623-200204000-00009 · Cited by 186
Impact of Comorbidities on Hospitalization Costs Following Hip Fracture
Nikkel, L. E., Fox, E. J., Black, K. P., Davis, C., Andersen, L., & Hollenbeak, C. S. (2012) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.j.01077 · Cited by 184
In Search of the Perfect Comorbidity Measure for Use With Administrative Claims Data: Does It Exist?
Baldwin, L.-M., Klabunde, C. N., Green, P., Barlow, W., & Wright, G. (2006) · Medical Care · doi:10.1097/01.mlr.0000223475.70440.07 · Cited by 175
Chu, Y.-T., Ng, Y.-Y., & Wu, S.-C. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-140 · Cited by 175
2006 National Hospital Discharge Survey.
DeFrances, C. J., Lucas, C. A., Buie, V., & Golosinskiy, A. (2008) · PubMed · Cited by 173
Everhart, J. S., Altneu, E., & Calhoun, J. H. (2013) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-013-2923-9 · Cited by 165
Lieffers, J. R., Baracos, V. E., Winget, M., & Fassbender, K. (2011) · Cancer · doi:10.1002/cncr.25653 · Cited by 164
Psychiatric Disorders and Major Spine Surgery
Menendez, M. E., Neuhaus, V., Bot, A. G. J., Ring, D., & Cha, T. D. (2013) · Spine · doi:10.1097/brs.0000000000000064 · Cited by 161
Self-citationObesity Increases Length of Stay and Direct Medical Costs in Total Hip Arthroplasty
Kremers, H. M., Visscher, S. L., Kremers, W. K., Naessens, J. M., & Lewallen, D. G. (2013) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-013-3316-9 · Cited by 160
Patel, K. V., Brennan, K. L., Brennan, M. L., Jupiter, D. C., Shar, A., & Davis, M. L. (2014) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-013-3334-7 · Cited by 157 · cited 1×
“Fifth, we performed risk-adjustment using administrative data only; inclusion of clinically relevant variables such as the American Society of Anesthesiologists (ASA) score or the Frailty Index developed by the Canadian Study of Health and Aging may have improved model performance [24, 40, 58].”
MethodCharlson Comorbidity Indices and In-hospital Deaths in Patients with Hip Fractures
Neuhaus, V., King, J. D., Hageman, M., & Ring, D. (2012) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-012-2705-9 · Cited by 141
Self-citationNational Hospital Discharge Survey, 2006
United States Department Of Health And Human Services. National Center For Health Statistics (2008) · ICPSR Data Holdings · doi:10.3886/icpsr22745 · Cited by 138
Memtsoudis, S. G., Stundner, O., Rasul, R., Sun, X., Chiu, Y., Fleischut, P. M., Danninger, T., & Mazumdar, M. (2013) · Regional Anesthesia & Pain Medicine · doi:10.1097/aap.0b013e31828d0173 · Cited by 127
Mortality in Elderly Patients After Cervical Spine Fractures
Harris, M. B., Reichmann, W. M., Bono, C. M., Bouchard, K., Corbett, K. L., Warholic, N. M., Simon, J. B., Schoenfeld, A. J., Maciolek, L., Corsello, P., et al. (2010) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.i.00003 · Cited by 120
Yoshihara, H., & Yoneoka, D. (2013) · The Spine Journal · doi:10.1016/j.spinee.2013.11.029 · Cited by 94
Myers, R. P., Quan, H., Hubbard, J. N., Shaheen, A. A., & Kaplan, G. G. (2008) · Hepatology · doi:10.1002/hep.22676 · Cited by 92
The Metabolic Syndrome in Patients Undergoing Knee and Hip Arthroplasty
Valle, A. G. D., Chiu, Y. L., Ma, Y., Mazumdar, M., & Memtsoudis, S. G. (2012) · The Journal of Arthroplasty · doi:10.1016/j.arth.2012.04.011 · Cited by 92
Wasielewski, R. C., Weed, H. R., Prezioso, C., Nicholson, C., & Puri, R. D. (1998) · Clinical Orthopaedics and Related Research · doi:10.1097/00003086-199811000-00014 · Cited by 91
Metabolic Syndrome and Lumbar Spine Fusion Surgery: Epidemiology and Perioperative Outcomes
Memtsoudis, S. G., Kirksey, M., Ma, Y., Chiu, Y. L., Mazumdar, M., Pumberger, M., & Girardi, F. P. (2011) · Spine · doi:10.1097/brs.0b013e31823a3a13 · Cited by 84
Limitations Associated with the Analysis of Data from Administrative Databases
Memtsoudis, S. G. (2009) · Anesthesiology · doi:10.1097/aln.0b013e3181adf739 · Cited by 81
Secular trends in small-bowel obstruction and adhesiolysis in the United States: 1988–2007
Scott, F. I., Osterman, M. T., Mahmoud, N. N., & Lewis, J. D. (2012) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2011.10.023 · Cited by 67
Health Care Burden of Anterior Cervical Spine Surgery
Alosh, H., Li, D., Riley, L. H., & Skolasky, R. L. (2013) · Journal of Spinal Disorders & Techniques · doi:10.1097/bsd.0000000000000001 · Cited by 51
Risk adjustment using administrative data
Ghali, W. A., Quan, H., & Brant, R. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016008519.x · Cited by 46
Menendez, M. E., Neuhaus, V., Bot, A. G. J., Vrahas, M. S., & Ring, D. (2013) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-013-3138-9 · Cited by 46
Self-citationObese Patients Undergoing Total Knee Arthroplasty Have Distinct Preoperative Characteristics
Vulcano, E., Lee, Y.-Y., Yamany, T., Lyman, S. L., & Valle, A. G. D. (2013) · The Journal of Arthroplasty · doi:10.1016/j.arth.2012.10.028 · Cited by 36
Predicting In-Hospital Mortality in Patients Undergoing Complex Gastrointestinal Surgery
Grendar, J. (2011) · Archives of Surgery · doi:10.1001/archsurg.2011.296 · Cited by 35
Gordon, M., Stark, A., Sköldenberg, O., Kärrholm, J., & Garellick, G. (2013) · The Bone & Joint Journal · doi:10.1302/0301-620x.95b9.31006 · Cited by 32
Acute Kidney Injury is an Independent Marker of Severity in Clostridium difficile Infection
Khanna, S., Keddis, M. T., Noheria, A., et al. (2012) · Journal of Clinical Gastroenterology · doi:10.1097/mcg.0b013e31826af6fd · Cited by 21
Cited by
Moore, B. J., White, S., Washington, R., Coenen, N., & Elixhauser, A. (2017) · Medical Care · doi:10.1097/mlr.0000000000000735 · Cited by 827
De Hert, S., Staender, S., Fritsch, G., Hinkelbein, J., Afshari, A., Bettelli, G., Bock, M., Chew, M. S., Coburn, M., De Robertis, E., et al. (2018) · European Journal of Anaesthesiology · doi:10.1097/eja.0000000000000817 · Cited by 389
comorbidity: An R package for computing comorbidity scores
Gasparini, A. (2018) · Journal of Open Source Software · doi:10.21105/joss.00648 · Cited by 361
The Charlson Comorbidity Index in Registry-based Research: Which Version to Use?
Lagergren, J., & Brusselaers, N. (2017) · Methods of Information in Medicine · doi:10.3414/me17-01-0051 · Cited by 337
Telehealth and Rural-Urban Differences in Receipt of Pain Care in the Veterans Health Administration
Chen, J. A., DeFaccio, R. J., Gelman, H., Thomas, E. R., Indresano, J. A., Dawson, T. C., Glynn, L. H., Sandbrink, F., & Zeliadt, S. B. (2022) · Pain Medicine · doi:10.1093/pm/pnab194 · Cited by 28
Metadata
- Authors
- Menendez, M. E., Neuhaus, V., van Dijk, N. C., & Ring, D.
- Venue
- Clinical Orthopaedics & Related Research
- Published
- 2014-09
- Volume
- 472
- Issue
- 9
- Pages
- 2878-2886
- ISSN
- 0009-921X (ISSN-L)
- OpenAlex
- W2080295278
- Cited by
- 531
- References
- 49
- FWCI
- 10.95
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.