The DOI matches its Crossref record; 39 of the 40 references it cites were found in a registry or an index.
The validity and reliability of screening measures for depression and anxiety disorders in multiple sclerosis
Open accessAbstract
OBJECTIVE: We aimed to evaluate the validity and reliability of multiple screening measures for depression and anxiety for use in the clinical care of people with multiple sclerosis (MS). METHODS: Participants with MS completed the Patient Health Questionnaire (PHQ-9), Hospital Anxiety and Depression Scale (HADS), Kessler-6 Distress Scale, PROMIS Emotional Distress Depression Short-Form 8a (PROMIS Depression) and Anxiety Short-Form 8a (PROMIS Anxiety), Generalized Anxiety Disorder 7-item Scale (GAD-7), and the Overall Anxiety and Severity Impairment Scale (OASIS). A subgroup repeated the screening measures two weeks later. All participants also completed a Structured Clinical Interview for DSM-IV-TR Axis I Disorders (SCID). For the screening measures we computed sensitivity, specificity, positive predictive and negative predictive value with SCID diagnoses as the reference standard and conducted receiver operating curve (ROC) analyses; we also assessed internal consistency and test-retest reliability. RESULTS: Of 253 participants, the SCID classified 10.3% with major depression and 14.6% with generalized anxiety disorder. Among the depression measures, the PHQ-9 had the highest sensitivity (84%). Specificity was generally higher than sensitivity, and was highest for the HADS-D with a cut-point of 11 (95%). In ROC analyses the area under the curve (AUC) did not differ between depression measures. Among the anxiety measures, sensitivity was highest for the HADS-A with a cut-point of 8 (82%). Specificity ranged from 83% to 86% for all measures except the HADS-A with a cut-point of 8 (68%). The AUC did not differ between anxiety measures. CONCLUSION: Overall, performance of the depression and anxiety screening measures was very similar, with reasonable psychometric properties for the MS population, suggesting that other factors such as accessibility and ease of use could guide the choice of measure in clinical practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Validity and reliability of this measure have been demonstrated in patients with knee osteoarthritis (Driban, Morgan, Price, Cook, & Wang, 2015), multiple sclerosis (Marrie et al., 2018), and lumbar degenerative disease (Purvis, Neuman, Riley, & Skolasky, 2018).”
From Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments: Reliability and Validity in Veterans Following Orthopedic Surgery. (2020) · cites this paper as Marrie et al., 2018
In the citing paper
“Validity and reliability of this measure have been demonstrated in patients with knee osteoarthritis (Driban et al., 2015), multiple sclerosis (Marrie et al., 2018), and lumbar degenerative disease (Purvis et al., 2018)”
From Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments: Reliability and Validity in Veterans Following Orthopedic Surgery. (2020) · cites this paper as Marrie et al., 2018
In the citing paper
“It is widely used in outpatient, hospital, and community settings, and has been validated for use in pwMS (Marrie et al., 2018).”
From Neuropsychology intervention for managing invisible symptoms of MS (NIMIS-MS) group: A pilot effectiveness and acceptability study (2024) · cites this paper as Marrie et al., 2018
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
The Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709
Rating neurologic impairment in multiple sclerosis: An expanded disability status scale (EDSS)
Kurtzke, J. F. (1983) · Neurology · doi:10.1212/wnl.33.11.1444 · Cited by 15,011
An inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407
Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria
Polman, C. H., Reingold, S. C., Banwell, B., Clanet, M., Cohen, J. A., Filippi, M., Fujihara, K., Havrdova, E., Hutchinson, M., Kappos, L., et al. (2011) · Annals of Neurology · doi:10.1002/ana.22366 · Cited by 9,802
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802
New diagnostic criteria for multiple sclerosis: Guidelines for research protocols
Poser, C. M., Paty, D. W., Scheinberg, L., McDonald, W. I., Davis, F. A., Ebers, G. C., Johnson, K. P., Sibley, W. A., Silberberg, D. H., & Tourtellotte, W. W. (1983) · Annals of Neurology · doi:10.1002/ana.410130302 · Cited by 7,384
McDonald, W. I., Compston, A., Edan, G., Goodkin, D., Hartung, H., Lublin, F. D., McFarland, H. F., Paty, D. W., Polman, C. H., Reingold, S. C., et al. (2001) · Annals of Neurology · doi:10.1002/ana.1032 · Cited by 6,969
Research works printed but not linked: 1
- Marrie, 2017, A prospective study of the effects of psychiatric comorbidity in immune-mediated inflammatory disease: rationale, protocol and participation, JMIR Research Protocols
Cited by
Sorted by citations
Levis, B., Benedetti, A., Ioannidis, J. P. A., Sun, Y., Negeri, Z., He, C., Wu, Y., Krishnan, A., Bhandari, P. M., Neupane, D., et al. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.02.002 · Cited by 231
Peres, D. S., Rodrigues, P., Viero, F. T., Frare, J. M., Kudsi, S. Q., Meira, G. M., & Trevisan, G. (2022) · Brain Behavior & Immunity - Health · doi:10.1016/j.bbih.2022.100484 · Cited by 134
Etiology, effects and management of comorbidities in multiple sclerosis: recent advances
Marrie, R. A., Fisk, J. D., Fitzgerald, K. C., Kowalec, K., Maxwell, C. J., Rotstein, D., Salter, A. R., & Tremlett, H. L. (2023) · Frontiers in Immunology · doi:10.3389/fimmu.2023.1197195 · Cited by 121
Comorbid anxiety, depression, and cognition in MS and other immune-mediated disorders
Whitehouse, C. E., Fisk, J. D., Bernstein, C. N., Berrigan, L. I., Bolton, J. M., Graff, L. A., Hitchon, C. A., Marriott, J. J., Peschken, C. A., Sareen, J., et al. (2019) · Neurology · doi:10.1212/wnl.0000000000006854 · Cited by 112
Hitchon, C. A., Zhang, L., PESCHKEN, C. A., Lix, L. M., Graff, L. A., Fisk, J. D., Patten, S. B., Bolton, J. M., Sareen, J., El-Gabalawy, R. M., et al. (2019) · Arthritis Care & Research · doi:10.1002/acr.24011 · Cited by 114
Metadata
- Authors
- Marrie, R. A., Zhang, L., Lix, L. M., Graff, L. A., Walker, J. R., Fisk, J. D., Patten, S. B., Hitchon, C. A., Bolton, J. M., Sareen, J., El-Gabalawy, R., Marriott, J. J., & Bernstein, C. N.
- Affiliations
- University of Manitoba (CA)
- Dalhousie University (CA)
- University of Calgary (CA)
- Corresponding author
- Marrie, Ruth Ann
- ORCID
- Venue
- Multiple Sclerosis and Related Disorders
- Publisher
- Elsevier BV
- Published
- 2018-02
- Volume
- 20
- Pages
- 9-15
- ISSN
- 2211-0348 (ISSN-L)
- OpenAlex
- W2771966364
- Cited by
- 169
- References
- 40
- Citations by year
- 2026: 17 · 2025: 17 · 2024: 16 · 2023: 25 · 2022: 22 · 2021: 26 · 2020: 18 · 2019: 24 · 2018: 4
- FWCI
- 16.26
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Multiple Sclerosis and Related Disorders (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- Crohn's and Colitis Canada
- Heart and Stroke Foundation of Canada
- Canadian Institutes of Health Research (THC-135234, 333252)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Clinical Neurology › Multiple Sclerosis Research Studies
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- multiple sclerosis, depression screening, anxiety screening, PHQ-9, Hospital Anxiety and Depression Scale, PROMIS, GAD-7, OASIS, Kessler-6, sensitivity and specificity, test-retest reliability, internal consistency, psychometric properties, generalized anxiety disorder
- MeSH terms
- Anxiety, Depression, Female, Humans, Interview, Psychological, Male, Middle Aged, Multiple Sclerosis, Psychiatric Status Rating Scales, Psychometrics, Sensitivity and Specificity, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
