The DOI matches its Crossref record; 69 of the 72 references it cites were found in a registry or an index.
Measures of Multimorbidity and Morbidity Burden for Use in Primary Care and Community Settings: A Systematic Review and Guide
Open accessAbstract
PURPOSE: Many patients consulting in primary care have multiple conditions (multimorbidity). Aims of this review were to identify measures of multimorbidity and morbidity burden suitable for use in research in primary care and community populations, and to investigate their validity in relation to anticipated associations with patient characteristics, process measures, and health outcomes. METHODS: Studies were identified using searches in MEDLINE and EMBASE from inception to December 2009 and bibliographies. RESULTS: Included were 194 articles describing 17 different measures. Commonly used measures included disease counts (n = 98), Chronic Disease Score (CDS)/RxRisk (n = 17), Adjusted Clinical Groups (ACG) System (n = 25), the Charlson index (n = 38), the Cumulative Index Illness Rating Scale (CIRS; n = 10) and the Duke Severity of Illness Checklist (DUSOI; n = 6). Studies that compared measures suggest their predictive validity for the same outcome differs only slightly. Evidence is strongest for the ACG System, Charlson index, or disease counts in relation to care utilization; for the ACG System in relation to costs; for Charlson index in relation to mortality; and for disease counts or Charlson index in relation to quality of life. Simple counts of diseases or medications perform almost as well as complex measures in predicting most outcomes. Combining measures can improve validity. CONCLUSIONS: The measures most commonly used in primary care and community settings are disease counts, Charlson index, ACG System, CIRS, CDS, and DUSOI. Different measures are most appropriate according to the outcome of interest. Choice of measure will also depend on the type of data available. More research is needed to directly compare performance of different measures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Additionally polymorbidity is associated with increased health service utilization and poorer health outcomes [6,7], demonstrating the relevance of proper treatment for polymorbid patients.”
From ESPEN guideline on nutritional support for polymorbid medical inpatients (2023) · cites this paper as [7]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742
Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases
DEYO, R. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90133-8 · Cited by 10,452
Comorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595
Measuring Health: A Guide to Rating Scales and Questionnaires
McDowell, I., & Newell, C. (1987) · Cited by 4,207
CUMULATIVE ILLNESS RATING SCALE
Linn, B. S., Linn, M. W., & Gurel, L. (1968) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1968.tb02103.x · Cited by 2,332
Prevalence, Expenditures, and Complications of Multiple Chronic Conditions in the Elderly
Wolff, J. L., Starfield, B. H., & Anderson, G. F. (2002) · Archives of Internal Medicine · doi:10.1001/archinte.162.20.2269 · Cited by 2,237
McDowell, I. (2006) · doi:10.1093/acprof:oso/9780195165678.001.0001 · Cited by 2,121
Miller, M. D., Paradis, C. F., Houck, P. R., Mazumdar, S., Stack, J. A., Rifai, A. H., Mulsant, B., & Reynolds, C. F. (1992) · Psychiatry Research · doi:10.1016/0165-1781(92)90005-n · Cited by 1,990
Health Measurement Scales--A Practical Guide to Their Development and Use
Waclawski, E. (2010) · Occupational Medicine · doi:10.1093/occmed/kqp179 · Cited by 1,870
Sangha, O., Stucki, G., Liang, M. H., Fossel, A. H., & Katz, J. N. (2003) · Arthritis Care & Research · doi:10.1002/art.10993 · Cited by 1,841
How to measure comorbiditya critical review of available methods
DEGROOT, V, BECKERMAN, H., LANKHORST, G., & BOUTER, L. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00585-1 · Cited by 1,757
Defining Comorbidity: Implications for Understanding Health and Health Services
Valderas, J. M., Starfield, B. H., Sibbald, B., Salisbury, C., & Roland, M. O. (2009) · The Annals of Family Medicine · doi:10.1370/afm.983 · Cited by 1,730
Self-citationRomano, P. S., Roos, L. L., & Jollis, J. G. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90103-8 · Cited by 1,717
The development of a comorbidity index with physical function as the outcome
GROLL, D., TO, T., BOMBARDIER, C., & WRIGHT, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.018 · Cited by 1,198
Prevalence of multimorbidity among adults seen in family practice
Fortin, M. (2005) · The Annals of Family Medicine · doi:10.1370/afm.272 · Cited by 987
Multimorbidity and quality of life in primary care: a systematic review
Fortin, M., Lapointe, L., Hudon, C., Vanasse, A., Ntetu, A. L., & Maltais, D. (2004) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-2-51 · Cited by 963
A chronic disease score from automated pharmacy data
Korff, M. V., Wagner, E. H., & Saunders, K. W. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90016-g · Cited by 962
Charlson, M. E., Charlson, R. E., Peterson, J. C., Marinopoulos, S. S., Briggs, W. M., & Hollenberg, J. P. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.01.006 · Cited by 894
Epidemiology and impact of multimorbidity in primary care: a retrospective cohort study
Salisbury, C., Johnson, L., Purdy, S., Valderas, J. M., & Montgomery, A. A. (2011) · British Journal of General Practice · doi:10.3399/bjgp11x548929 · Cited by 883
Self-citationDiederichs, C., Berger, K., & Bartels, D. B. (2011) · The Journals of Gerontology Series A: Biological Sciences and Medical Sciences · doi:10.1093/gerona/glq208 · Cited by 693
Predicting Mortality and Healthcare Utilization with a Single Question
DeSalvo, K. B., Fan, V. S., McDonell, M. B., & Fihn, S. D. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00404.x · Cited by 677
Measuring Health: A Guide to Rating Scales and Questionnaires
Hyett, K., & Mills, T. (2006) · Australian Health Review · Cited by 632
A Chronic Disease Score with Empirically Derived Weights
Clark, D. O., Korff, M. V., Saunders, K. W., Balugh, W. M., & Simon, G. E. (1995) · Medical Care · doi:10.1097/00005650-199508000-00004 · Cited by 551
Risk Adjustment in Outcome Assessment: the Charlson Comorbidity Index
Sicotte, C., Tilquin, C., & D’Hoore, W. (1993) · Methods of Information in Medicine · doi:10.1055/s-0038-1634956 · Cited by 545
Ambulatory care groups: a categorization of diagnoses for research and management.
Starfield, B. H., Weiner, J. P., Mumford, L. M., & Steinwachs, D. M. (1991) · Europe PMC (PubMed Central) · Cited by 520
Measuring comorbidity in older cancer patients
Extermann, M. (2000) · European Journal of Cancer · doi:10.1016/s0959-8049(99)00319-6 · Cited by 477
Common comorbidity scales were similar in their ability to predict health care costs and mortality
Perkins, A. J., Kroenke, K., Unützer, J., Katon, W. J., Williams, J. W., Hope, C. J., & Callahan, C. M. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.03.002 · Cited by 343
Risk Adjustment Using Automated Ambulatory Pharmacy Data
Fishman, P. A., Goodman, M. J., Hornbrook, M. C., Meenan, R. T., Bachman, D. J., & Rosetti, M. C. O. (2003) · Medical Care · doi:10.1097/00005650-200301000-00011 · Cited by 333
Psychological Distress and Multimorbidity in Primary Care
Fortin, M. (2006) · The Annals of Family Medicine · doi:10.1370/afm.528 · Cited by 308
Comorbidity Profile of Dementia Patients in Primary Care: Are They Sicker?
Schubert, C. C., Boustani, M. A., Callahan, C. M., Perkins, A. J., Carney, C. P., Fox, C., Unverzagt, F. W., Hui, S. L., & Hendrie, H. C. (2005) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2005.00543.x · Cited by 283
Bayliss, E. A., Ellis, J., & Steiner, J. F. (2005) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-3-51 · Cited by 277
Multimorbidity and quality of life: a closer look
Fortin, M., Dubois, M., Hudon, C., Soubhi, H., & Almirall, J. (2007) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-5-52 · Cited by 257
Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data
Ghali, W. A., Hall, R., Rosen, A. K., Ash, A. S., & Moskowitz, M. A. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00564-1 · Cited by 246
Geriatric Index of Comorbidity: validation and comparison with other measures of comorbidity
Rozzini, R. (2002) · Age and Ageing · doi:10.1093/ageing/31.4.277 · Cited by 220
Cumulative Illness Rating Scale was a reliable and valid index in a family practice context
Hudon, C., Fortin, M., & Vanasse, A. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.017 · Cited by 219
Comorbidity Assessments Based on Patient Report
Selim, A. J., Fincke, B. G., Ren, X. S., Lee, A. F., Rogers, W. H., Miller, D. R., Skinner, K. M., Linzer, M., & Kazis, L. E. (2004) · Journal of Ambulatory Care Management · doi:10.1097/00004479-200407000-00011 · Cited by 214
Multimorbidity is common to family practice: is it commonly researched?
Fortin, M., Lapointe, L., Hudon, C., & Vanasse, A. (2005) · PubMed Central · Cited by 211
Improving depression outcomes in older adults with comorbid medical illness
Harpole, L. H., Williams, J. W., Olsen, M. K., Stechuchak, K. M., Oddone, E. Ž., Callahan, C. M., Katon, W. J., Lin, E. H. B., Grypma, L., & Unützer, J. (2005) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2004.09.004 · Cited by 192
Fortin, M., Hudon, C., Dubois, M.-F., Almirall, J., Lapointe, L., & Soubhi, H. (2005) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-3-74 · Cited by 184
How to measure comorbidity: a critical review of available methods
de Groot, V., Beckerman, H., Lankhorst, G. J., & Bouter, L. M. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.09.002 · Cited by 181
The Duke severity of illness checklist (DUSOI) for measurement of severity and comorbidity
Parkerson, G. R., Broadhead, W. E., Chiu-Kit, J., & Tse, T. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90153-r · Cited by 172
Bayliss, E. A., Ellis, J., & Steiner, J. F. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.05.002 · Cited by 169
Impact of Age and Comorbidity on Colorectal Cancer Screening Among Older Veterans
Walter, L. C., Lindquist, K. J., Nugent, S. M., Schult, T., Lee, S. J., Casadei, M. A., & Partin, M. R. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-150-7-200904070-00006 · Cited by 166
From the Centers for Disease Control
Morris, J. G., West, G. R., Holck, S. E., Blake, P. A., Echeverria, P. D., & Karaulnik, M. (1982) · The Journal of Infectious Diseases · doi:10.1093/infdis/145.1.131 · Cited by 166
Validation of case-mix measures derived from self-reports of diagnoses and health
Fan, V. S., Au, D. H., Heagerty, P. J., Deyo, R. A., McDonell, M. B., & Fihn, S. D. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00493-0 · Cited by 164
251 PREDICTING MORTALITY AND HEALTH CARE UTILIZATION WITH A SINGLE QUESTION.
DeSalvo, K. B., Fan, V. S., McDonell, M. B., & Fihn, S. D. (2004) · Journal of Investigative Medicine · doi:10.1097/00042871-200401001-00804 · Cited by 154
Improving the Care for Depression in Patients With Comorbid Medical Illness
Koike, A. K., Unützer, J., & Wells, K. B. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.10.1738 · Cited by 135
Dorr, D. A., Jones, S. S., Burns, L., Donnelly, S. M., Brunker, C. P., Wilcox, A. B., & Clayton, P. D. (2006) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2006.00681.x · Cited by 133
Tooth, L. R., Hockey, R., Byles, J., & Dobson, A. J. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.05.015 · Cited by 123
Development and testing of a new measure of case mix for use in office practice.
Greenfield, S., SULLIVAN, L. M., Dukes, K. A., Silliman, R. A., D’Agostino, R. B., & Kaplan, S. H. (1995) · PubMed · Cited by 120
Single index of multimorbidity did not predict multiple outcomes
Byles, J., D’Este, C. A., Parkinson, L., O'Connell, R. L., & Treloar, C. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.025 · Cited by 119
Dominick, K. L., Dudley, T. K., Coffman, C. J., & Bosworth, H. B. (2005) · Arthritis Care & Research · doi:10.1002/art.21440 · Cited by 112
Bari, M. D., Virgillo, A., Matteuzzi, D., Inzitari, M., Mazzaglia, G., Pozzi, C., Geppetti, P., Masotti, G., Marchionni, N., & Pini, R. (2005) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2005.00572.x · Cited by 111
Associations among family support, family stress, and personal functional health status
Parkerson, G. R. (1989) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(89)90058-9 · Cited by 108
Validity of medication‐based co‐morbidity indices in the Australian elderly population
Vitry, A. I., Wong, S. A., Roughead, E. E., Ramsay, E. N., & Barratt, J. D. (2009) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2009.00357.x · Cited by 99
[Comorbidity indexes: review of the literature and application to studies of elderly population].
Harboun, M., & Ankri, J. (2001) · PubMed · Cited by 85
Schneeweiß, S., Wang, P. S., Avorn, J., Maclure, M., Levin, R., & Glynn, R. J. (2004) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2004.30109.x · Cited by 81
A Comparison of Two Comorbidity Instruments in Arthritis
Gabriel, S. E., Crowson, C. S., & O’Fallon, W. M. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00124-9 · Cited by 80
Effect of chronic diseases and associated psychological distress on health‐related quality of life
Keleş, H., Ekici, A. B., Ekici, M. S., Bulcun, E., & Altınkaya, V. (2006) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2006.01215.x · Cited by 78
Akner, G. (2009) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2008.12.009 · Cited by 69
Comorbidity Indices to Predict Mortality From Medicare Data
Yan, Y., Deych, E., Radford, M. J., Nilasena, D. S., & Gage, B. F. (2005) · Medical Care · doi:10.1097/01.mlr.0000182477.29129.86 · Cited by 66
Yeo, J., Karimova, G., & Bansal, S. (2005) · Age and Ageing · doi:10.1093/ageing/afj002 · Cited by 61
Development and Validation of the Medication-Based Disease Burden Index
George, J., Vuong, T., Bailey, M., Kong, D. C. M., Marriott, J., & Stewart, K. (2006) · Annals of Pharmacotherapy · doi:10.1345/aph.1g204 · Cited by 57
Characteristics of Adult Primary Care Patients as Predictors of Future Health Services Charges
Parkerson, G. R., Harrell, F. E., Hammond, W. E., & Wang, X.-Q. (2001) · Medical Care · doi:10.1097/00005650-200111000-00004 · Cited by 47
Tang, J., Wan, J. Y., & Bailey, J. E. (2008) · Stroke · doi:10.1161/strokeaha.107.504688 · Cited by 46
Mayo, N. E., Nadeau, L., Lévesque, L. E., Miller, S. B., Poissant, L., & Tamblyn, R. M. (2005) · Medical Care · doi:10.1097/01.mlr.0000185749.04875.cb · Cited by 43
Bayliss, E. A., Ellis, J., Steiner, J. F., & Main, D. S. (2005) · Chronic Illness · doi:10.1177/17423953050010040101 · Cited by 21
Comorbidity index was successfully validated among men but not in women
Rius, C., Pérez, G., Rodríguez‐Sanz, M., & Fernández, E. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.09.006 · Cited by 11
Flagged first, then by citations
3 of the 72 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Barnett, K., Mercer, S. W., Norbury, M., Watt, G., Wyke, S., & Guthrie, B. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60240-2 · Cited by 6,972
Evidence based medicine: a movement in crisis?
Greenhalgh, T., Howick, J., Maskrey, N., & for the Evidence Based Medicine Renaissance Group (2014) · BMJ · doi:10.1136/bmj.g3725 · Cited by 1,921
Charlson Comorbidity Index: A Critical Review of Clinimetric Properties
Charlson, M. E., Carrozzino, D., Guidi, J., & Patierno, C. (2022) · Psychotherapy and Psychosomatics · doi:10.1159/000521288 · Cited by 1,686
Skou, S. T., Mair, F. S., Fortin, M., Guthrie, B., Nunes, B. P., Miranda, J. J., Boyd, C. M., Pati, S., Mtenga, S., & Smith, S. M. (2022) · Nature Reviews Disease Primers · doi:10.1038/s41572-022-00376-4 · Cited by 1,499
Violan, C., Foguet-Boreu, Q., Flores-Mateo, G., Salisbury, C., Blom, J., Freitag, M., Glynn, L., Muth, C., & Valderas, J. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0102149 · Cited by 1,125
Self-citation
Metadata
- Authors
- Huntley, A. L., Johnson, R., Purdy, S., Valderas, J. M., & Salisbury, C.
- Affiliations
- University of Bristol (GB)
- University of Oxford (GB)
- Venue
- The Annals of Family Medicine
- Publisher
- Annals of Family Medicine
- Published
- 2012-03-01
- Volume
- 10
- Issue
- 2
- Pages
- 134-141
- ISSN
- 1544-1709 (ISSN-L)
- 1544-1717
- PMC
- PMC3315139
- OpenAlex
- W2131863095
- Cited by
- 619
- References
- 72
- Citations by year
- 2026: 17 · 2025: 32 · 2024: 40 · 2023: 42 · 2022: 43 · 2021: 74 · 2020: 41 · 2019: 51 · 2018: 49 · 2017: 40 · 2016: 43 · 2015: 55 · 2014: 48 · 2013: 35 · 2012: 8
- FWCI
- 5.82
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- The Annals of Family Medicine (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- BIBSYS Brage (BIBSYS (Norway)) (submittedVersion)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- Explore Bristol Research (submittedVersion)
- Bristol Research (University of Bristol) (submittedVersion)
- Funders
- National Institute for Health and Care Research (NIHR/CS/010/024, IAT/I-PF/009/011, CL-2010-25-005, SPCR-037)
- Topics
- Health Sciences › Medicine › Epidemiology › Chronic Disease Management Strategies
- Health Sciences › Medicine › Family Practice › Primary Care and Health Outcomes
- Health Sciences › Medicine › Geriatrics and Gerontology › Pharmaceutical Practices and Patient Outcomes
- Keywords
- multimorbidity, disease burden, Charlson Comorbidity Index, Chronic Disease Score, Cumulative Illness Rating Scale, predictive validity, primary care, community population, health outcomes, mortality, quality of life, health care utilization, health care costs
- MeSH terms
- Community Health Services, Humans, Outcome and Process Assessment, Health Care, Primary Health Care, Comorbidity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review