The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Systematic Review of Comorbidity Indices for Administrative Data
Abstract
BACKGROUND: Adjustment for comorbidities is common in performance benchmarking and risk prediction. Despite the exponential upsurge in the number of articles citing or comparing Charlson, Elixhauser, and their variants, no systematic review has been conducted on studies comparing comorbidity measures in use with administrative data. We present a systematic review of these multiple comparison studies and introduce a new meta-analytical approach to identify the best performing comorbidity measures/indices for short-term (inpatient + ≤ 30 d) and long-term (outpatient+>30 d) mortality. METHODS: Articles up to March 18, 2011 were searched based on our predefined terms. The bibliography of the chosen articles and the relevant reviews were also searched and reviewed. Multiple comparisons between comorbidity measures/indices were split into all possible pairs. We used the hypergeometric test and confidence intervals for proportions to identify the comparators with significantly superior/inferior performance for short-term and long-term mortality. In addition, useful information such as the influence of lookback periods was extracted and reported. RESULTS: Out of 1312 retrieved articles, 54 articles were eligible. The Deyo variant of Charlson was the most commonly referred comparator followed by the Elixhauser measure. Compared with baseline variables such as age and sex, comorbidity adjustment methods seem to better predict long-term than short-term mortality and Elixhauser seems to be the best predictor for this outcome. For short-term mortality, however, recalibration giving empirical weights seems more important than the choice of comorbidity measure. CONCLUSIONS: The performance of a given comorbidity measure depends on the patient group and outcome. In general, the Elixhauser index seems the best so far, particularly for mortality beyond 30 days, although several newer, more inclusive measures are promising.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742
Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data
Quan, H., Sundararajan, V., Halfon, P., Fong, A., Burnand, B., Luthi, J.-C., Saunders, L. D., Beck, C. A., Feasby, T. E., & Ghali, W. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000182534.19832.83 · Cited by 10,669
Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases
DEYO, R. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90133-8 · Cited by 10,452
Comorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921
Quan, H., Li, B., Couris, C. M., Fushimi, K., Graham, P., Hider, P., Januel, J.-M., & Sundararajan, V. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq433 · Cited by 5,843
van Walraven, C., Austin, P. C., Jennings, A., Quan, H., & Forster, A. J. (2009) · Medical Care · doi:10.1097/mlr.0b013e31819432e5 · Cited by 2,200
Development of a comorbidity index using physician claims data
Klabunde, C. N., Potosky, A. L., Legler, J. M., & Warren, J. L. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00256-0 · Cited by 1,845
How to measure comorbiditya critical review of available methods
DEGROOT, V, BECKERMAN, H., LANKHORST, G., & BOUTER, L. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00585-1 · Cited by 1,757
Romano, P. S., Roos, L. L., & Jollis, J. G. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90103-8 · Cited by 1,717
A combined comorbidity score predicted mortality in elderly patients better than existing scores
Gagne, J. J., Glynn, R. J., Avorn, J., Levin, R., & Schneeweiss, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.10.004 · Cited by 995
Practical considerations on the use of the charlson comorbidity index with administrative data bases
D'Hoore, W., Bouckaert, A., & Tilquin, C. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00271-5 · Cited by 893
Schneeweiss, S. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.9.854 · Cited by 711
Southern, D. A., Quan, H., & Ghali, W. A. (2004) · Medical Care · doi:10.1097/01.mlr.0000118861.56848.ee · Cited by 573
Risk Adjustment in Outcome Assessment: the Charlson Comorbidity Index
Sicotte, C., Tilquin, C., & D’Hoore, W. (1993) · Methods of Information in Medicine · doi:10.1055/s-0038-1634956 · Cited by 545
Klabunde, C. N., Legler, J. M., Warren, J. L., Baldwin, L.-M., & Schrag, D. (2007) · Annals of Epidemiology · doi:10.1016/j.annepidem.2007.03.011 · Cited by 514
Measuring comorbidity in older cancer patients
Extermann, M. (2000) · European Journal of Cancer · doi:10.1016/s0959-8049(99)00319-6 · Cited by 476
Adaptation and validation of the Charlson Index for Read/OXMIS coded databases
Khan, N. F., Perera, R., Harper, S., & Rose, P. W. (2010) · BMC Family Practice · doi:10.1186/1471-2296-11-1 · Cited by 396
Armitage, J. N., & van der Meulen, J. H. (2010) · British Journal of Surgery · doi:10.1002/bjs.6930 · Cited by 370
Needham, D. M., Scales, D. C., Laupacis, A., & Pronovost, P. J. (2005) · Journal of Critical Care · doi:10.1016/j.jcrc.2004.09.007 · Cited by 369
Li, B., Evans, D., Faris, P., Dean, S., & Quan, H. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-12 · Cited by 342
Improved Comorbidity Adjustment for Predicting Mortality in Medicare Populations
Schneeweiss, S., Wang, P. S., Avorn, J., & Glynn, R. J. (2003) · Health Services Research · doi:10.1111/1475-6773.00165 · Cited by 330
An improved comorbidity index for outcome analyses among dialysis patients
Liu, J., Huang, Z., Gilbertson, D. T., Foley, R. N., & Collins, A. J. (2010) · Kidney International · doi:10.1038/ki.2009.413 · Cited by 326
Aylin, P., Bottle, A., & Majeed, A. (2007) · BMJ · doi:10.1136/bmj.39168.496366.55 · Cited by 303
Self-citationUsing diagnoses to describe populations and predict costs.
Ash, A. S., Ellis, R. P., Pope, G. C., Ayanian, J. Z., Bates, D. W., Burstin, H. R., Iezzoni, L. I., MacKay, E., & Yu, W. (2000) · PubMed Central · Cited by 299
Development and validation of the ontario acute myocardial infarction mortality prediction rules
Tu, J. V., Austin, P. C., Walld, R., Roos, L., Agras, J., & McDonald, K. M. (2001) · Journal of the American College of Cardiology · doi:10.1016/s0735-1097(01)01109-3 · Cited by 298
ROCHON, P. A., KATZ, J. N., MORROW, L. A., MCGLINCHEY-BERROTH, R., AHLQUIST, M. M., SARKARATI, M., & MINAKER, K. L. (1996) · Medical Care · doi:10.1097/00005650-199611000-00004 · Cited by 269
Cross-National Comparative Performance of Three Versions of the ICD-10 Charlson Index
Sundararajan, V., Quan, H., Halfon, P., Fushimi, K., Luthi, J.-C., Burnand, B., & Ghali, W. A. (2007) · Medical Care · doi:10.1097/mlr.0b013e3181484347 · Cited by 260
Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data
Ghali, W. A., Hall, R. E., Rosen, A. K., Ash, A. S., & Moskowitz, M. A. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00564-1 · Cited by 249
Stukenborg, G. J., Wagner, D. P., & Connors, A. F. (2001) · Medical Care · doi:10.1097/00005650-200107000-00009 · Cited by 239
Thombs, B. D., Singh, V. A., Halonen, J., Diallo, A., & Milner, S. M. (2007) · Annals of Surgery · doi:10.1097/01.sla.0000250422.36168.67 · Cited by 236
Preen, D. B., Holman, C. D. J., Spilsbury, K., Semmens, J. B., & Brameld, K. J. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.12.013 · Cited by 226
Nuttall, M., van der Meulen, J., & Emberton, M. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.07.015 · Cited by 219
In Search of the Perfect Comorbidity Measure for Use With Administrative Claims Data: Does It Exist?
Baldwin, L.-M., Klabunde, C. N., Green, P., Barlow, W., & Wright, G. (2006) · Medical Care · doi:10.1097/01.mlr.0000223475.70440.07 · Cited by 175
Zhang, J. X., Iwashyna, T. J., & Christakis, N. A. (1999) · Medical Care · doi:10.1097/00005650-199911000-00005 · Cited by 175
Chu, Y.-T., Ng, Y.-Y., & Wu, S.-C. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-140 · Cited by 175
Li, P., Kim, M. M., & Doshi, J. A. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-245 · Cited by 154
Baseline Comorbidity in Kidney Transplant Recipients: A Comparison of Comorbidity Indices
Jassal, S. V., Schaubel, D. E., & Fenton, S. S. A. (2005) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2005.03.006 · Cited by 153
Cleves, M. A., Sanchez, N., & Draheim, M. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00091-7 · Cited by 148
The impact of age and comorbidity on survival outcomes and treatment patterns in prostate cancer
Hall, W. H., Jani, A. B., Ryu, J. K., Narayan, S., & Vijayakumar, S. (2005) · Prostate Cancer and Prostatic Diseases · doi:10.1038/sj.pcan.4500772 · Cited by 144
ICD-10 coding algorithms for defining comorbidities of acute myocardial infarction
So, L., Evans, D., & Quan, H. (2006) · BMC Health Services Research · doi:10.1186/1472-6963-6-161 · Cited by 142
A multipurpose comorbidity scoring system performed better than the Charlson index
Holman, C. D. J., Preen, D. B., Baynham, N. J., Finn, J., & Semmens, J. B. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.020 · Cited by 142
Melfi, C. A., Holleman, E., Arthur, D., & Katz, B. P. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00202-2 · Cited by 137
Myers, R. P., Quan, H., Hubbard, J. N., Shaheen, A. A., & Kaplan, G. G. (2008) · Hepatology · doi:10.1002/hep.22676 · Cited by 92
Johnston, J. A., Wagner, D. P., Timmons, S., Welsh, D. E., Tsevat, J., & Render, M. L. (2002) · Medical Care · doi:10.1097/00005650-200210000-00010 · Cited by 90
van Walraven, C., Escobar, G. J., Greene, J., & Forster, A. J. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.08.020 · Cited by 89
Schneeweiß, S., Wang, P. S., Avorn, J., Maclure, M., Levin, R., & Glynn, R. J. (2004) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2004.30109.x · Cited by 81
Strategies for improving comorbidity measures based on Medicare and Medicaid claims data
Wang, P. S., Walker, A. M., Tsuang, M. T., Orav, E. J., Levin, R., & Avorn, J. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00222-5 · Cited by 80
Using Claims Data to Examine Mortality Trends Following Hospitalization for Heart Attack in Medicare
Ash, A. S., Posner, M. A., Speckman, J. L., Suglia, S. F., Yacht, A. C., & Bramwell, L. (2003) · Health Services Research · doi:10.1111/1475-6773.00175 · Cited by 79
Desai, M. M., Bogardus, S. T., Williams, C. S., Vitagliano, G., & Inouye, S. K. (2002) · Journal of the American Geriatrics Society · doi:10.1046/j.1532-5415.2002.50113.x · Cited by 75
Lim, L. L.-Y., & O'Connell, R. L. (2000) · Methods of Information in Medicine · doi:10.1055/s-0038-1634260 · Cited by 70
A New Casemix Adjustment Index for Hospital Mortality Among Patients With Congestive Heart Failure
Polanczyk, C. A., Rohde, L. E. P., Philbin, E. A., & Salvo, T. G. D. (1998) · Medical Care · doi:10.1097/00005650-199810000-00007 · Cited by 70
Comorbidity Indices to Predict Mortality From Medicare Data
Yan, Y., Deych, E., Radford, M. J., Nilasena, D. S., & Gage, B. F. (2005) · Medical Care · doi:10.1097/01.mlr.0000182477.29129.86 · Cited by 66
Using Information on Preexisting Conditions to Predict Mortality From Traumatic Injury
Moore, L., Lavoie, A., Sage, N. L., Bergeron, É., Émond, M., Liberman, M., & Abdous, B. (2008) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2007.09.007 · Cited by 62
Immunologic profile of excessive body weight
Sharabiani, M. T. A., Vermeulen, R. C. H., Scoccianti, C., Hosnijeh, F. S., Minelli, L., Sacerdote, C., Palli, D., Krogh, V., Tumino, R., Chiodini, P., et al. (2011) · Biomarkers · doi:10.3109/1354750x.2010.547948 · Cited by 60
Self-citationPredictive Ability of Pretransplant Comorbidities to Predict Long-Term Graft Loss and Death
Machnicki, G., Pinsky, B. W., Takemoto, S., Balshaw, R. F., Salvalaggio, P. R. D. O., Buchanan, P. M., Irish, W. D., Bunnapradist, S., Lentine, K. L., Burroughs, T. E., et al. (2008) · American Journal of Transplantation · doi:10.1111/j.1600-6143.2008.02486.x · Cited by 60
Comorbidity risk-adjustment strategies are comparable among persons with hip fracture
Radley, D., Gottlieb, D. J., Fisher, E. S., & Tosteson, A. N. A. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.08.001 · Cited by 54
Validity of ascertainment of co-morbid illness using administrative databases: a systematic review
Leal, J. R., & Laupland, K. B. (2009) · Clinical Microbiology and Infection · doi:10.1111/j.1469-0691.2009.02867.x · Cited by 51
Normand, S. T., Morris, C. N., Fung, K., McNeil, B. J., & Epstein, A. M. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00126-b · Cited by 51
Grunau, G. L., Sheps, S. B., Goldner, E. M., & Ratner, P. A. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.08.007 · Cited by 49
Evaluation of comorbidity indices for inpatient mortality prediction models
Martins, M. S., & Blais, R. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.11.017 · Cited by 49
Evaluating alternative risk-adjustment strategies for surgery
Atherly, A. J., Fink, A. S., Campbell, D. C., Mentzer, R. M., Henderson, W. G., Khuri, S. F., & Culler, S. D. (2004) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2004.07.032 · Cited by 47
Tang, J., Wan, J. Y., & Bailey, J. E. (2008) · Stroke · doi:10.1161/strokeaha.107.504688 · Cited by 47
Mm, W. (2000) · PubMed · Cited by 46
Performance of comorbidity measures for predicting outcomes in population-based osteoporosis cohorts
Lix, L. M., Quail, J. M., Teare, G. F., & Osman, B. A. (2011) · Osteoporosis International · doi:10.1007/s00198-010-1516-7 · Cited by 42
Ho, K. M., Finn, J., Knuiman, M. W., & Webb, S. (2007) · Anaesthesia · doi:10.1111/j.1365-2044.2007.05231.x · Cited by 37
The development and validation of a comorbidity index for prostate cancer among Black men
Fleming, S. T., Pearce, K. A., McDavid, K., & Pavlov, D. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00213-0 · Cited by 30
Cited by
Charlson Comorbidity Index: A Critical Review of Clinimetric Properties
Charlson, M. E., Carrozzino, D., Guidi, J., & Patierno, C. (2022) · Psychotherapy and Psychosomatics · doi:10.1159/000521288 · Cited by 1,686
Edwards, B. K., Noone, A., Mariotto, A. B., Simard, E. P., Boscoe, F. P., Henley, S. J., Jemal, A., Cho, H., Anderson, R. N., Kohler, B. A., et al. (2014) · Cancer · doi:10.1002/cncr.28509 · Cited by 1,210
Moore, B. J., White, S., Washington, R., Coenen, N., & Elixhauser, A. (2017) · Medical Care · doi:10.1097/mlr.0000000000000735 · Cited by 827
Comorbidities of epilepsy: current concepts and future perspectives
Keezer, M. R., Sisodiya, S. M., & Sander, J. W. (2016) · The Lancet Neurology · doi:10.1016/s1474-4422(15)00225-2 · Cited by 778
Why Summary Comorbidity Measures Such As the Charlson Comorbidity Index and Elixhauser Score Work
Austin, S. R., Wong, Y.-N., Uzzo, R. G., Beck, J. R., & Egleston, B. L. (2015) · Medical Care · doi:10.1097/mlr.0b013e318297429c · Cited by 716
Metadata
- Authors
- Sharabiani, M. T. A., Aylin, P., & Bottle, A.
- Venue
- Medical Care
- Published
- 2012-12
- Volume
- 50
- Issue
- 12
- Pages
- 1109-1118
- ISSN
- 0025-7079 (ISSN-L)
- OpenAlex
- W2006341561
- Cited by
- 493
- References
- 66
- FWCI
- 3.61
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.