Charlson scores based on ICD-10 administrative data were valid in assessing comorbidity in patients undergoing urological cancer surgery

Nuttall, Martin; van der Meulen, Jan; Emberton, Mark

doi:10.1016/j.jclinepi.2005.07.015

Cited by 219Chronic Disease Management StrategiesMedical Coding and Health InformationCardiac, Anesthesia and Surgical Outcomes

Charlson scores based on ICD-10 administrative data were valid in assessing comorbidity in patients undergoing urological cancer surgery

Nuttall, Martin, van der Meulen, Jan, Emberton, Mark·2006·Journal of Clinical Epidemiology

DOI 10.1016/j.jclinepi.2005.07.015

Open this paper in CoChat — free account

Abstract

Background and objectives Adjustment for comorbidity is an essential component of any observational study comparing outcomes. We evaluated the validity of the Charlson comorbidity score based on ICD-10 codes in patients undergoing urological cancer surgery within an English administrative database.Study design and setting Patients who underwent radical urological cancer surgery between 1998 and 2002 in the English National Health Service were identified from the Hospital Episode Statistics database (N = 20,138). ICD-9-CM codes defining comorbid diseases according to the Deyo and Dartmouth-Manitoba adaptations of the Charlson comorbidity score were translated into ICD-10 codes.Results Charlson scores derived by the ICD-10 translation of the Deyo and Dartmouth-Manitoba adaptations were identical in 16,623 patients (83%; kappa = .63). For both adaptations, ICD-10 scores increased with age, were higher in patients admitted on an emergency basis, and predicted short-term outcome. Addition of either the ICD-10 Charlson Deyo or Dartmouth-Manitoba score to risk models containing age and sex to predict in-hospital mortality resulted in a better model fit but only in small improvements of the predictive power.Conclusion The ICD-10 translations of the Deyo and Dartmouth-Manitoba adaptations performed similarly in risk models predicting hospital mortality following urological cancer surgery. Adjustment for comorbidity over and above age and sex alone does not seem to provide a large improvement.

Integrity signals

Registry

Crossref · 10.1016/j.jclinepi.2005.07.015

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742 · see citing works
Applied logistic regression
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305 · see citing works
Applied Logistic Regression
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302 · see citing works
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646 · see citing works
Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases
DEYO, R. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90133-8 · Cited by 10,452 · see citing works
Comorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921 · see citing works
Clinical Epidemiology: A Basic Science for Clinical Medicine.
(1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-114-9-825_9 · Cited by 3,497 · see citing works
Surgeon Volume and Operative Mortality in the United States
Birkmeyer, J. D., Stukel, T. A., Siewers, A. E., Goodney, P. P., Wennberg, D. E., & Lucas, F. L. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa035205 · Cited by 3,109 · see citing works
International Classification of Diseases
Jones, F. A. (1978) · Gut · doi:10.1136/gut.19.12.1175 · Cited by 2,919 · see citing works
New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality
Sundararajan, V., Henderson, T., Perry, C., Muggivan, A., Quan, H., & Ghali, W. A. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.03.012 · Cited by 2,439 · see citing works
Presentation adapting a clinical comorbidity index for use with ICD-9-CM administrative data: Differing perspectives
Romano, P. S., Roos, L. L., & Jollis, J. G. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90103-8 · Cited by 1,717 · see citing works
Surgeon volume and operative mortality in the United States
Birkmeyer, J. D., Stukel, T. A., Siewers, A. E., Goodney, P. P., Wennberg, D. E., & Lucas, F. L. (2004) · ACC Current Journal Review · doi:10.1016/j.accreview.2003.12.065 · Cited by 1,113 · see citing works
Assessing Quality Using Administrative Data
Iezzoni, L. I. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00048 · Cited by 981 · see citing works
Variations in Morbidity after Radical Prostatectomy
Begg, C. B., Riedel, E., Bach, P. B., Kattan, M. W., Schrag, D., Warren, J. L., & Scardino, P. T. (2002) · New England Journal of Medicine · doi:10.1056/nejmsa011788 · Cited by 839 · see citing works
The accuracy of Medicare's hospital claims data: progress has been made, but problems remain.
Fisher, E. S., Whaley, F. S., Krushat, W. M., Malenka, D. J., Fleming, C., Baron, J. A., & Hsia, D. C. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.2.243 · Cited by 710 · see citing works
Statistical Methods for Rates and Proportions
(2004) · Technometrics · doi:10.1198/tech.2004.s812 · Cited by 689 · see citing works
Validity of Information on Comorbidity Derived From ICD-9-CCM Administrative Data
Quan, H., Parsons, G. A., & Ghali, W. A. (2002) · Medical Care · doi:10.1097/00005650-200208000-00007 · Cited by 575 · see citing works
The Risks of Risk Adjustment
lezzoni, L. I. (1997) · JAMA · doi:10.1001/jama.1997.03550190064046 · Cited by 500 · see citing works
Accuracy of Diagnostic Coding for Medicare Patients under the Prospective-Payment System
Hsia, D. C., Krushat, W. M., Fagan, A. B., Tebbutt, J. A., & Kusserow, R. P. (1988) · New England Journal of Medicine · doi:10.1056/nejm198802113180604 · Cited by 488 · see citing works
Comorbidities, complications, and coding bias. Does the number of diagnosis codes matter in predicting in-hospital mortality?
Iezzoni, L. I. (1992) · JAMA · doi:10.1001/jama.267.16.2197 · Cited by 451 · see citing works
Influence of Cardiac-Surgery Performance Reports on Referral Practices and Access to Care — A Survey of Cardiovascular Specialists
Schneider, E. C., & Epstein, A. M. (1996) · New England Journal of Medicine · doi:10.1056/nejm199607253350406 · Cited by 398 · see citing works
The risks of risk adjustment
Iezzoni, L. I. (1997) · JAMA · doi:10.1001/jama.278.19.1600 · Cited by 391 · see citing works
Assessing hospital-associated deaths from discharge data. The role of length of stay and comorbidities
Jencks, S. F. (1988) · JAMA · doi:10.1001/jama.260.15.2240 · Cited by 388 · see citing works
Role of Surgeon Volume in Radical Prostatectomy Outcomes
Hu, J. C., Gold, K. F., Pashos, C. L., Mehta, S. S., & Litwin, M. S. (2003) · Journal of Clinical Oncology · doi:10.1200/jco.2003.05.169 · Cited by 334 · see citing works
International Classification of Diseases
Zeigler‐Hill, V., & Shackelford, T. K. (2020) · Springer eBooks · doi:10.1007/978-3-319-24612-3_301364 · Cited by 329 · see citing works
A systematic review of discharge coding accuracy
Campbell, S., Campbell, M., Grimshaw, J., & Walker, A. E. (2001) · Journal of Public Health · doi:10.1093/pubmed/23.3.205 · Cited by 300 · see citing works
Co-morbidity data in outcomes research Are clinical data derived from administrative databases a reliable alternative to chart review?
Humphries, K. H., Rankin, J. M., Carere, R. G., Buller, C. E. H., Kiely, F. M., & Spinelli, J. J. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00188-2 · Cited by 259 · see citing works
Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data
Ghali, W. A., Hall, R., Rosen, A. K., Ash, A. S., & Moskowitz, M. A. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00564-1 · Cited by 249 · see citing works
Measuring potentially avoidable hospital readmissions
Halfon, P., Eggli, Y., van Melle, G., Chevalier, J., Wasserfallen, J.-B., & Burnand, B. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00521-2 · Cited by 245 · see citing works
Explaining variations in hospital death rates. Randomness, severity of illness, quality of care
Park, R. E. (1990) · JAMA · doi:10.1001/jama.264.4.484 · Cited by 220 · see citing works
International Classification of Diseases
Sharma, A. (2010) · Springer eBooks · doi:10.1007/978-0-387-79948-3_40 · Cited by 192 · see citing works
Using administrative data to describe casemix: A comparison with the medical record
Malenka, D. J., McLerran, D., Roos, N. P., et al. (1994) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)90118-x · Cited by 166 · see citing works
Evaluation of two competing methods for calculating Charlson's comorbidity index when analyzing short-term mortality using administrative data
Cleves, M. A., Sanchez, N., & Draheim, M. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00091-7 · Cited by 147 · see citing works
Further evidence concerning the use of a clinical comorbidity index with ICD-9-CM administrative data
Romano, P. S., Roos, L. L., & Jollis, J. G. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90106-b · Cited by 143 · see citing works
A Study of the Morbidity, Mortality and Long-Term Survival Following Radical Cystectomy and Radical Radiotherapy in the Treatment of Invasive Bladder Cancer in Yorkshire
Chahal, R., Sundaram, S. K., Iddenden, R., et al. (2003) · European Urology · doi:10.1016/s0302-2838(02)00581-x · Cited by 142 · see citing works
Accuracy of administrative data to assess comorbidity in patients with heart disease
Powell, H. A., Lim, L. L.-Y., & Heller, R. F. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00364-4 · Cited by 136 · see citing works
Risk Adjusting Health Care Outcomes: A Methodologic Review
Blumberg, M. S. (1986) · Medical Care Review · doi:10.1177/107755878604300205 · Cited by 126 · see citing works
Cleveland Health Quality Choice: A Model for Collaborative Community-Based Outcomes Assessment
Rosenthal, G. E., & Harper, D. L. (1994) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30088-8 · Cited by 86 · see citing works
Adjusting surgical mortality rates for patient comorbidities: More harm than good?
Finlayson, E. V. A., Birkmeyer, J. D., Stukel, T. A., et al. (2002) · Surgery · doi:10.1067/msy.2002.126509 · Cited by 55 · see citing works
Explaining Variations in Hospital Death Rates
Redelmeier, D. A. (1991) · JAMA · doi:10.1001/jama.1991.03460040034014 · Cited by 49 · see citing works
Risk adjustment using administrative data
Ghali, W. A., Quan, H., & Brant, R. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016008519.x · Cited by 46 · see citing works
Adapting a clinical comorbidity index for use with ICD-9-CM administrative data: A response
Deyo, R. A. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90104-9 · Cited by 41 · see citing works
How severity measures rate hospitalized patients
Hughes, J. S., Iezzoni, L. I., Daley, J., & Greenberg, L. G. (1996) · Journal of General Internal Medicine · doi:10.1007/bf02598273 · Cited by 40 · see citing works
Comorbidity Assessment in Localized Prostate Cancer: A Review of Currently Available Techniques
Singh, R., & O’Brien, T. (2004) · European Urology · doi:10.1016/j.eururo.2004.01.010 · Cited by 39 · see citing works
'Failure to rescue' as a measure of quality of hospital care: the limitations of secondary diagnosis coding in English hospital data
McKee, M., Coles, J., & James, P. (1999) · Journal of Public Health · doi:10.1093/pubmed/21.4.453 · Cited by 37 · see citing works
The development and validation of a comorbidity index for prostate cancer among Black men
Fleming, S. T., Pearce, K. A., McDavid, K., & Pavlov, D. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00213-0 · Cited by 30 · see citing works
The completeness and accuracy of health authority and cancer registry records according to a study of ovarian neoplasms
Mukherjee, A. K., Leck, I. M., Langley, F. A., et al. (1991) · Public Health · doi:10.1016/s0033-3506(05)80319-1 · Cited by 22 · see citing works
Using Routine Data to Evaluate Quality of Care in British Hospitals
McKee, M., & James, P. (1997) · Medical Care · doi:10.1097/00005650-199710001-00013 · Cited by 21 · see citing works
Severity of Illness Measures
Iezzoni, L. I. (1990) · Medical Care · doi:10.1097/00005650-199009000-00001 · Cited by 20 · see citing works
Hospital activity analysis
(1973) · International Journal of Bio-Medical Computing · doi:10.1016/0020-7101(73)90008-1 · Cited by 16 · see citing works
Threshold volumes for urological cancer surgery: a survey of UK urologists
Nuttall, M. C., van der Meulen, J., McIntosh, G., et al. (2004) · British Journal of Urology · doi:10.1111/j.1464-410x.2004.05095.x · Cited by 15 · see citing works
Self-citation
Challenges of monitoring use of secondary care at local level: a study based in London, UK.
Chenet, L., & McKee, M. (1996) · Journal of Epidemiology & Community Health · doi:10.1136/jech.50.3.359 · Cited by 15 · see citing works
Book Review: Hospital Activity Analysis
Campbell, R. M. (1973) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591577306600848 · Cited by 15 · see citing works
Measuring the effects of casemix on outcomes
Orchard, C. (1996) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.1996.tb00035.x · Cited by 11 · see citing works

Flagged first, then by citations

Sorted by citations

Mortality and cardiovascular risk associated with different insulin secretagogues compared with metformin in type 2 diabetes, with or without a previous myocardial infarction: a nationwide study
Schramm, T. K., Gislason, G. H., Vaag, A., Rasmussen, J. N., Folke, F., Hansen, M. L., Fosbøl, E. L., Køber, L., Norgaard, M. L., Madsen, M., et al. (2011) · European Heart Journal · doi:10.1093/eurheartj/ehr077 · Cited by 418 · see citing works
The spectrum of thyroid disease and risk of new onset atrial fibrillation: a large population cohort study
Selmer, C., Olesen, J. B., Hansen, M. L., Lindhardsen, J., Olsen, A.-M. S., Madsen, J. C., Faber, J., Hansen, P. R., Pedersen, O. D., Torp-Pedersen, C., et al. (2012) · BMJ · doi:10.1136/bmj.e7895 · Cited by 323 · see citing works
Subclinical and Overt Thyroid Dysfunction and Risk of All-Cause Mortality and Cardiovascular Events: A Large Population Study
Selmer, C., Olesen, J. B., Hansen, M. L., von Kappelgaard, L. M., Madsen, J. C., Hansen, P. R., Pedersen, O. D., Faber, J., Torp-Pedersen, C., & Gislason, G. H. (2014) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2013-4184 · Cited by 288 · see citing works
Learning vector representation of medical objects via EMR-driven nonnegative restricted Boltzmann machines (eNRBM)
Tran, T., Nguyen, T. D., Phung, D., & Venkatesh, S. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.01.012 · Cited by 172 · see citing works
Longer Wait Times Increase Overall Mortality in Patients With Bladder Cancer
Kulkarni, G. S., Urbach, D. R., Austin, P. C., Fleshner, N. E., & Laupacis, A. (2009) · Journal of Urology · doi:10.1016/j.juro.2009.06.041 · Cited by 123 · see citing works
Stereotactic body radiotherapy for unresected pancreatic cancer: A nationwide review
de Geus, S. W. L., Eskander, M. F., Kasumova, G. G., Ng, S. C., Kent, T. S., Mancias, J. D., Callery, M. P., Mahadevan, A., & Tseng, J. F. (2017) · Cancer · doi:10.1002/cncr.30856 · Cited by 118 · see citing works
Medical comorbidity in patients with schizophrenia and alcohol dependence
Batki, S. L., Meszaros, Z. S., Strutynski, K., Dimmock, J. A., Leontieva, L., Ploutz-Snyder, R., Canfield, K., & Drayer, R. A. (2009) · Schizophrenia Research · doi:10.1016/j.schres.2008.10.016 · Cited by 72 · see citing works
Racial and ethnic disparities in interhospital transfer for complex emergency general surgical disease across the United States
Iantorno, S. E., Bucher, B. T., Horns, J. J., & McCrum, M. L. (2023) · Journal of Trauma and Acute Care Surgery · doi:10.1097/ta.0000000000003856 · Cited by 11 · see citing works

Elderly patients with head and neck cancer: the influence of comorbidity on choice of therapy, complication rate, and survival
Derks, W., de Leeuw, R. J., & Hordijk, G. J. (2005) · Current Opinion in Otolaryngology & Head & Neck Surgery · doi:10.1097/01.moo.0000156169.63204.39 · Cited by 66 · see citing works
Influence of comorbidity on the choice of treatment and survival of elderly patients with advanced non-small cell lung cancer
Ai-wu, Li, Caicun, et al. (2008) · Acta Scientiarum Naturalium Universitatis Sunyatseni
Comorbidity in head and neck cancer: A critical appraisal and recommendations for practice
Paleri, V., Wight, R. G., Silver, C. E., Haigentz, M., Takes, R. P., Bradley, P. J., Rinaldo, A., Sanabria, Á., Bień, S., & Ferlito, A. (2010) · Oral Oncology · doi:10.1016/j.oraloncology.2010.07.008 · Cited by 247 · see citing works
Comorbidity Index
Miedany, Y. M. E. (2017) · doi:10.1007/978-3-319-59963-2_16
Health Care Resource Utilization And Costs Associated With HIV-Positive Patients With Comorbidity Versus HIV-Negative Patients With Comorbidity
Lachaîne, J., Baribeau, V., Lorgeoux, R.-P., et al. (2017) · Value in Health · doi:10.1016/j.jval.2017.08.2323 · Cited by 4 · see citing works

Authors: Nuttall, M., van der Meulen, J., & Emberton, M.
Affiliations: Royal College of Surgeons of England (GB)
ORCID: Emberton, Mark
Venue: Journal of Clinical Epidemiology
Publisher: Elsevier BV
Published: 2006-03
Volume: 59
Issue: 3
Pages: 265-273
ISSN: 0895-4356 (ISSN-L)
DOI: 10.1016/j.jclinepi.2005.07.015
OpenAlex: W1965010847
Cited by: 219
References: 54
Citations by year: 2026: 7 · 2025: 12 · 2024: 7 · 2023: 8 · 2022: 15 · 2021: 11 · 2020: 15 · 2019: 16 · 2018: 15 · 2017: 8 · 2016: 7 · 2015: 12 · 2014: 13 · 2013: 15 · 2012: 12
FWCI: 4.64
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Journal of Clinical Epidemiology (publishedVersion)
PubMed (publishedVersion)
UCL Discovery (University College London) (submittedVersion)
Topics: Health Sciences › Medicine › Epidemiology › Chronic Disease Management Strategies
Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiac, Anesthesia and Surgical Outcomes
Keywords: Charlson Comorbidity Index, ICD-10, administrative data, comorbidity adjustment, in-hospital mortality prediction, risk adjustment, Hospital Episode Statistics
MeSH terms: Aged, Female, Forms and Records Control, Humans, Length of Stay, Male, Middle Aged, Research Design, Urologic Neoplasms, Cohort Studies, Comorbidity, Confounding Factors, Epidemiologic, Prevalence, Hospital Mortality, Risk Adjustment, International Classification of Diseases

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Charlson scores based on ICD-10 administrative data were valid in assessing comorbidity in patients undergoing urological cancer surgery

Abstract

Integrity signals

Claims the paper makes

Cites

Cited by

Related

Record

About these checks