The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Mental comorbidity and multiple sclerosis: validating administrative data to support population-based surveillance
Open accessAbstract
BACKGROUND: While mental comorbidity is considered common in multiple sclerosis (MS), its impact is poorly defined; methods are needed to support studies of mental comorbidity. We validated and applied administrative case definitions for any mental comorbidities in MS. METHODS: Using administrative health data we identified persons with MS and a matched general population cohort. Administrative case definitions for any mental comorbidity, any mood disorder, depression, anxiety, bipolar disorder and schizophrenia were developed and validated against medical records using a a kappa statistic (k). Using these definitions we estimated the prevalence of these comorbidities in the study populations. RESULTS: Compared to medical records, administrative definitions showed moderate agreement for any mental comorbidity, mood disorders and depression (all k ≥ 0.49), fair agreement for anxiety (k = 0.23) and bipolar disorder (k = 0.30), and near perfect agreement for schizophrenia (k = 1.0). The age-standardized prevalence of all mental comorbidities was higher in the MS than in the general populations: depression (31.7% vs. 20.5%), anxiety (35.6% vs. 29.6%), and bipolar disorder (5.83% vs. 3.45%), except for schizophrenia (0.93% vs. 0.93%). CONCLUSIONS: Administrative data are a valid means of surveillance of mental comorbidity in MS. The prevalence of mental comorbidities, except schizophrenia, is increased in MS compared to the general population.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“numerous studies show that anxiety is almost as common as depression in persons with MS”
From Systematic review and meta-analysis of interventions for depression and anxiety in persons with multiple sclerosis (2016) · cites this paper as Marrie et al., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Comorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921
The kappa statistic in reliability studies: use, interpretation, and sample size requirements
Sim, J., & Wright, C. C. (2005) · Physical Therapy · doi:10.1093/ptj/85.3.257 · Cited by 4,093
Epidemiologic Research: Principles and Quantitative Methods.
Mayer, L. S., Kleinbaum, D. G., Kupper, L. L., & Morgenstern, H. (1984) · Journal of the American Statistical Association · doi:10.2307/2288427 · Cited by 2,905
Epidemiologic Research: Principles and Quantitative Methods.
Pocock, S., Kleinbaum, D. G., Kupper, L. L., & Morgenstern, H. (1983) · Biometrics · doi:10.2307/2531133 · Cited by 1,893
Haro, J. M., Arbabzadeh-Bouchez, S., Brugha, T. S., De Girolamo, G., Guyer, M. E., Jin, R., Lepine, J. P., Mazzi, F., Reneses, B., Vilagut, G., et al. (2006) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.196 · Cited by 1,082
Anxiety disorders and their clinical correlates in multiple sclerosis patients
Korostil, M., & Feinstein, A. (2007) · Multiple Sclerosis Journal · doi:10.1177/1352458506071161 · Cited by 424 · cited 4×
“Graphical analysis of misclassification bias suggested that the case definitions perform reasonably well in the expected range of prevalence for mental comorbidity in MS (Additional file 8: Figure S1) [1,2,22-28].”
BackgroundInfluentialMood Disorder and Multiple Sclerosis
Joffe, R. T., Lippert, G. P., Gray, T. A., Sawa, G. M., & Horvath, Z. (1987) · Archives of Neurology · doi:10.1001/archneur.1987.00520160018007 · Cited by 387
The Goldman Consensus statement on depression in multiple sclerosis
Goldman Consensus Group (2005) · Multiple Sclerosis Journal · doi:10.1191/1352458505ms1162oa · Cited by 329
The rising prevalence and changing age distribution of multiple sclerosis in Manitoba
Marrie, R. A., Yu, N., Blanchard, J., Leung, S., & Elliott, L. (2010) · Neurology · doi:10.1212/wnl.0b013e3181cf6ec0 · Cited by 307
Treatment of Depression Improves Adherence to Interferon Beta-1b Therapy for Multiple Sclerosis
Mohr, D. C., Goodkin, D., Likosky, W., Gatto, N. M., Baumann, K. A., & Rudick, R. A. (1997) · Archives of Neurology · doi:10.1001/archneur.1997.00550170015009 · Cited by 306
Prevalence and concurrence of anxiety, depression and fatigue over time in multiple sclerosis
Wood, B., van der Mei, I., Ponsonby, A.-L., Pittas, F., Quinn, S., Dwyer, T., Lucas, R., & Taylor, B. (2013) · Multiple Sclerosis Journal · doi:10.1177/1352458512450351 · Cited by 294 · cited 2×
“Graphical analysis of misclassification bias suggested that the case definitions perform reasonably well in the expected range of prevalence for mental comorbidity in MS (Additional file 8: Figure S1) [1,2,22-28].”
BackgroundAgreement Between Administrative Files and Written Medical Records
Kashner, T. M. (1998) · Medical Care · doi:10.1097/00005650-199809000-00005 · Cited by 268
Accuracy of Diagnoses of Schizophrenia in Medicaid Claims
Lurie, N., Popkin, M. K., Dysken, M. W., Moscovice, I., & Finch, M. D. (1992) · Psychiatric Services · doi:10.1176/ps.43.1.69 · Cited by 220
The burden of mental comorbidity in multiple sclerosis: frequent, underdiagnosed, and undertreated
Marrie, R., Horwitz, R., Cutter, G., Tyry, T., Campagnolo, D., & Vollmer, T. (2009) · Multiple Sclerosis Journal · doi:10.1177/1352458508099477 · Cited by 219
Epidemiologic research : principles and quantitative methods
Kleinbaum, D. G., Kupper, L. L., & Morgenstern, H. (1982) · Cited by 205
Edwards, L. J., & Constantinescu, C. S. (2004) · Multiple Sclerosis Journal · doi:10.1191/1352458504ms1087oa · Cited by 194
Validation of a Self-Report Comorbidity Questionnaire for Multiple Sclerosis
Horton, M., Rudick, R. A., Hara-Cleaver, C., & Marrie, R. A. (2010) · Neuroepidemiology · doi:10.1159/000311013 · Cited by 167
Comorbidities amongst patients with multiple sclerosis: a population‐based controlled study
Kang, J., Chen, Y. ‐., & Lin, H.-C. (2010) · European Journal of Neurology · doi:10.1111/j.1468-1331.2010.02971.x · Cited by 132
A profile of multiple sclerosis: The New York State Multiple Sclerosis Consortium
Jacobs, L., Wende, K. E., Brownscheidle, C. M., Apatoff, B., Coyle, P. K., Goodman, A. D., Gottesman, M. H., Granger, C. V., Greenberg, S. J., Herbert, J., et al. (1999) · Multiple Sclerosis Journal · doi:10.1177/135245859900500511 · Cited by 129
Marrie, R. A., Yu, B. N., Leung, S., Elliott, L. J., Caetano, P. A., Warren, S., Wolfson, C. M., Patten, S. B., Svenson, L. W., Tremlett, H. L., et al. (2012) · Multiple Sclerosis Journal · doi:10.1177/1352458512437814 · Cited by 127
Dahl, O. P., Stordal, E., Lydersen, S., & Midgard, R. (2009) · Multiple Sclerosis Journal · doi:10.1177/1352458509351542 · Cited by 123
Asche, C. V., Singer, M. E., Jhaveri, M., Chung, H., & Miller, A. (2010) · Journal of Managed Care Pharmacy · doi:10.18553/jmcp.2010.16.9.703 · Cited by 110
Psychotic disorders in MS: Population-based evidence of an association
Patten, S. B., Svenson, L. W., & Metz, L. M. (2005) · Neurology · doi:10.1212/01.wnl.0000178998.95293.29 · Cited by 107
Cumulative impact of comorbidity on quality of life in MS
Marrie, R. A., Horwitz, R. I., Cutter, G., & Tyry, T. M. (2011) · Acta Neurologica Scandinavica · doi:10.1111/j.1600-0404.2011.01526.x · Cited by 95
Mutch, S., Saip, S., Wildemann, B., Kitley, J., Karabudak, R., Aktaş, O., Kuşçu, D. Y., Altıntaş, A., Palace, J. A., Confavreux, C., et al. (2013) · Cited by 85
Symptomatic Management in Multiple Sclerosis
Samkoff, L., & Goodman, A. D. (2011) · Neurologic Clinics · doi:10.1016/j.ncl.2011.01.008 · Cited by 80
Unützer, J., Simon, G., Pabiniak, C. J., Bond, K., & Katon, W. J. (2000) · General Hospital Psychiatry · doi:10.1016/s0163-8343(99)00057-2 · Cited by 76
Rawson, N. S. B., Malcolm, E., & D’Arcy, C. (1997) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/bf00788238 · Cited by 67
Assessing the Saskatchewan database for outcomes research studies of depression and its treatment
West, S. L., Richter, A., Melfi, C. A., McNutt, M., Nennstiel, M., & Mauskopf, J. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00237-1 · Cited by 52
Tricco, A. C., Pham, B., & Rawson, N. S. B. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.009 · Cited by 50
Hospital-based Psychiatric Service Utilization and Morbidity in Multiple Sclerosis
Fisk, J. D., Morehouse, S. A., Brown, M. G., Skedgel, C. D., & Murray, T. J. (1998) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/s0317167100034065 · Cited by 48
Use of Administrative Data for the Surveillance of Mood and Anxiety Disorders
Kisely, S. R., Lin, E. H. B., Gilbert, C., Smith, M. J., Campbell, L. A., & Vasiliadis, H. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048670903279838 · Cited by 46
Psychiatric Manifestations of Multiple Sclerosis: A Review
Rodgers, J., & Bland, R. C. (1996) · The Canadian Journal of Psychiatry · doi:10.1177/070674379604100709 · Cited by 41
Research works printed but not linked: 3
- Patten S: Integrating data from clinical and administrative databases in pharmacoepidemiological research. Can J Clin Pharmacol. 1998, 5 (2): 92-97.
- Martens P, Fransoo R, McKeen N, Burland E, Jebamani L, Burchill C, Coster CD, Ekuma O, Prior H, Chateau D: Patterns of regional mental illness disorder diagnoses and service use in Manitoba: a population-based study. 2004, Winnipeg: Manitoba Centre for Health Policy, University of Manitoba
- Branch HIM: Population report. 2008, Winnipeg, Manitoba: Manitoba Health and Healthy Living
Cited by
Sorted by citations
Prevalence of depression and anxiety in Multiple Sclerosis: A systematic review and meta-analysis
Boeschoten, R. E., Braamse, A. M. J., Beekman, A. T. F., Cuijpers, P., van Oppen, P., Dekker, J., & Uitdehaag, B. M. J. (2017) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2016.11.067 · Cited by 713
The link between multiple sclerosis and depression
Feinstein, A., Magalhaes, S., Richard, J., Audet, B., & Moore, C. S. (2014) · Nature Reviews Neurology · doi:10.1038/nrneurol.2014.139 · Cited by 550
The incidence and prevalence of psychiatric disorders in multiple sclerosis: A systematic review
Marrie, R. A., Reingold, S., Cohen, J., Stuve, O., Trojano, M., Sorensen, P. S., Cutter, G., & Reider, N. (2015) · Multiple Sclerosis Journal · doi:10.1177/1352458514564487 · Cited by 519
A systematic review of the incidence and prevalence of comorbidity in multiple sclerosis: Overview
Marrie, R., Cohen, J., Stüve, O., Trojano, M., Sørensen, P., Reingold, S., Cutter, G., & Reider, N. (2015) · Multiple Sclerosis · doi:10.1177/1352458514564491 · Cited by 762
Increased burden of psychiatric disorders in inflammatory bowel disease
Bernstein, C. N., Hitchon, C. A., Walld, R., Bolton, J. M., Sareen, J., Walker, J. R., Graff, L. A., Patten, S. B., Singer, A., Lix, L. M., et al. (2019) · Inflammatory Bowel Diseases · doi:10.1093/ibd/izy235 · Cited by 274
Metadata
- Authors
- for the CIHR Team in the Epidemiology and Impact of Comorbidity on Multiple Sclerosis, Marrie, R. A., Fisk, J. D., Yu, B. N., Leung, S., Elliott, L., Caetano, P., Warren, S., Evans, C., Wolfson, C., Svenson, L. W., Tremlett, H., Blanchard, J. F., & Patten, S. B.
- Affiliations
- University of Manitoba (CA)
- Health Sciences Centre (CA)
- Dalhousie University (CA)
- University of Alberta (CA)
- University of Saskatchewan (CA)
- Alberta Health (CA)
- Research Institute of the McGill University Health Centre (CA)
- Corresponding author
- Marrie, Ruth Ann
- ORCID
- Venue
- BMC Neurology
- Published
- 2013-02-06
- Volume
- 13
- Issue
- 1
- Pages
- 16-16
- ISSN
- 1471-2377 (ISSN-L)
- PMC
- PMC3599013
- OpenAlex
- W2011332759
- Cited by
- 163
- References
- 34
- Citations by year
- 2026: 8 · 2025: 11 · 2024: 13 · 2023: 11 · 2022: 10 · 2021: 14 · 2020: 10 · 2019: 11 · 2018: 15 · 2017: 12 · 2016: 16 · 2015: 19 · 2014: 11 · 2013: 2
- FWCI
- 11.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Neurology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- cIRcle (University of British Columbia) (submittedVersion, cc-by)
- Mspace (University of Manitoba) (submittedVersion)
- Open Collections
- Funders
- United States Agency for International Development
- Bill and Melinda Gates Foundation
- Amgen
- Pfizer
- AstraZeneca
- Sanofi
- Biogen
- Teva Pharmaceutical Industries
- Alberta Health Services
- Health Sciences Centre Foundation
- McGill University
- European Committee for Treatment and Research in Multiple Sclerosis
- Manitoba Health Research Council
- Canadian Health Services Research Foundation
- Public Health Agency of Canada
- University of Alberta
- Michael Smith Health Research BC (MOP-93646, RG 4202-A-2)
- Multiple Sclerosis Society of Canada (MOP-93646, RG 4202-A-2)
- Multiple Sclerosis Society
- Public Health Agency
- Dalhousie University
- University of British Columbia
- Schweizerische Multiple Sklerose Gesellschaft
- Alberta Innovates
- Servier
- H. Lundbeck A/S
- Bayer Canada
- Canadian Institutes of Health Research (RG 4202-A-2, (MOP: #93646, 190898)
- Social Sciences and Humanities Research Council of Canada (93646)
- Topics
- Health Sciences › Medicine › Clinical Neurology › Multiple Sclerosis Research Studies
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Medicine › Epidemiology › Chronic Disease Management Strategies
- Keywords
- multiple sclerosis, psychiatric comorbidity, administrative data validation, case definition, depression, anxiety, bipolar disorder, schizophrenia, mood disorders, prevalence, population-based surveillance
- MeSH terms
- Adult, Mental Disorders, Canada, Female, Humans, Male, Medical Records, Middle Aged, Multiple Sclerosis, Population Surveillance, Reproducibility of Results, Cohort Studies, Comorbidity, Prevalence, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review