The validity and reliability of screening measures for depression and anxiety disorders in multiple sclerosis
Open accessAbstract
OBJECTIVE: We aimed to evaluate the validity and reliability of multiple screening measures for depression and anxiety for use in the clinical care of people with multiple sclerosis (MS). METHODS: Participants with MS completed the Patient Health Questionnaire (PHQ-9), Hospital Anxiety and Depression Scale (HADS), Kessler-6 Distress Scale, PROMIS Emotional Distress Depression Short-Form 8a (PROMIS Depression) and Anxiety Short-Form 8a (PROMIS Anxiety), Generalized Anxiety Disorder 7-item Scale (GAD-7), and the Overall Anxiety and Severity Impairment Scale (OASIS). A subgroup repeated the screening measures two weeks later. All participants also completed a Structured Clinical Interview for DSM-IV-TR Axis I Disorders (SCID). For the screening measures we computed sensitivity, specificity, positive predictive and negative predictive value with SCID diagnoses as the reference standard and conducted receiver operating curve (ROC) analyses; we also assessed internal consistency and test-retest reliability. RESULTS: Of 253 participants, the SCID classified 10.3% with major depression and 14.6% with generalized anxiety disorder. Among the depression measures, the PHQ-9 had the highest sensitivity (84%). Specificity was generally higher than sensitivity, and was highest for the HADS-D with a cut-point of 11 (95%). In ROC analyses the area under the curve (AUC) did not differ between depression measures. Among the anxiety measures, sensitivity was highest for the HADS-A with a cut-point of 8 (82%). Specificity ranged from 83% to 86% for all measures except the HADS-A with a cut-point of 8 (68%). The AUC did not differ between anxiety measures. CONCLUSION: Overall, performance of the depression and anxiety screening measures was very similar, with reasonable psychometric properties for the MS population, suggesting that other factors such as accessibility and ease of use could guide the choice of measure in clinical practice.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The PROMIS depression measure has demonstrated validity and reliability in patients with knee osteoarthritis, multiple sclerosis, and lumbar degenerative disease.
“Validity and reliability of this measure have been demonstrated in patients with knee osteoarthritis (Driban et al., 2015), multiple sclerosis (Marrie et al., 2018), and lumbar degenerative disease (Purvis et al., 2018)”
From Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments: Reliability and Validity in Veterans Following Orthopedic Surgery. (2020) · cites this paper as Marrie et al., 2018
The HADS is validated for use in pwMS.
“It is widely used in outpatient, hospital, and community settings, and has been validated for use in pwMS (Marrie et al., 2018).”
From Neuropsychology intervention for managing invisible symptoms of MS (NIMIS-MS) group: A pilot effectiveness and acceptability study (2024) · cites this paper as Marrie et al., 2018
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369 · see citing works
The Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139 · see citing works
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · see citing works
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 29,639 · see citing works
Rating neurologic impairment in multiple sclerosis: An expanded disability status scale (EDSS)
Kurtzke, J. F. (1983) · Neurology · doi:10.1212/wnl.33.11.1444 · Cited by 15,011 · see citing works
An inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407 · see citing works
Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria
Polman, C. H., Reingold, S. C., Banwell, B., Clanet, M., Cohen, J. A., Filippi, M., Fujihara, K., Havrdova, E., Hutchinson, M., Kappos, L., et al. (2011) · Annals of Neurology · doi:10.1002/ana.22366 · Cited by 9,802 · see citing works
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802 · see citing works
New diagnostic criteria for multiple sclerosis: Guidelines for research protocols
Poser, C. M., Paty, D. W., Scheinberg, L., McDonald, W. I., Davis, F. A., Ebers, G. C., Johnson, K. P., Sibley, W. A., Silberberg, D. H., & Tourtellotte, W. W. (1983) · Annals of Neurology · doi:10.1002/ana.410130302 · Cited by 7,384 · see citing works
McDonald, W. I., Compston, A., Edan, G., Goodkin, D., Hartung, H., Lublin, F. D., McFarland, H. F., Paty, D. W., Polman, C. H., Reingold, S. C., et al. (2001) · Annals of Neurology · doi:10.1002/ana.1032 · Cited by 6,969 · see citing works
The Patient Health Questionnaire-2: Validity of a Two-Item Depression Screener
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000093487.78664.3c · Cited by 6,359 · see citing works
Statistics notes: Cronbach's alpha: Table 1
Bland, J. M., & Altman, D. G. (1997) · BMJ · doi:10.1136/bmj.314.7080.572 · Cited by 5,300 · see citing works
Diagnostic criteria for multiple sclerosis: 2005 revisions to the “McDonald Criteria”
Polman, C. H., Reingold, S. C., Edan, G., Filippi, M., Hartung, H., Kappos, L., Lublin, F. D., Metz, L. M., McFarland, H. F., O'Connor, P. W., et al. (2005) · Annals of Neurology · doi:10.1002/ana.20703 · Cited by 5,017 · see citing works
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.006 · Cited by 4,465 · see citing works
Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., Cella, D., & PROMIS Cooperative Group (2011) · Assessment · doi:10.1177/1073191111411667 · Cited by 2,132 · see citing works
Development and validation of an Overall Anxiety Severity and Impairment Scale (OASIS)
Norman, S. B., Hami Cissell, S., Means-Christensen, A. J., & Stein, M. B. (2006) · Depression and Anxiety · doi:10.1002/da.20182 · Cited by 770 · see citing works
Comparability of telephone and face-to-face interviews in assessing axis I and II disorders
Rohde, P., Lewinsohn, P. M., & Seeley, J. R. (1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.11.1593 · Cited by 522 · see citing works
The incidence and prevalence of psychiatric disorders in multiple sclerosis: A systematic review
Marrie, R. A., Reingold, S., Cohen, J., Stuve, O., Trojano, M., Sorensen, P. S., Cutter, G., & Reider, N. (2015) · Multiple Sclerosis Journal · doi:10.1177/1352458514564487 · Cited by 519 · see citing works
Validation of the Hospital anxiety and depression scale for use with multiple sclerosis patients
Honarmand, K., & Feinstein, A. (2009) · Multiple Sclerosis Journal · doi:10.1177/1352458509347150 · Cited by 436 · see citing works
Identifying depression in primary care: a literature synthesis of case-finding instruments
Williams, J. W., Pignone, M. P., Ramı́rez, G., & Stellato, C. P. (2002) · General Hospital Psychiatry · doi:10.1016/s0163-8343(02)00195-0 · Cited by 288 · see citing works
Stafford, L., Berk, M., & Jackson, H. J. (2007) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2007.06.005 · Cited by 265 · see citing works
Long-term disability in anxiety disorders
Hendriks, S. M., Spijker, J., Licht, C. M. M., Hardeveld, F., de Graaf, R., Batelaan, N. M., Penninx, B. W. J. H., & Beekman, A. T. F. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0946-y · Cited by 234 · see citing works
Cairney, J., Veldhuizen, S., Wade, T. J., Kurdyak, P. A., & Streiner, D. L. (2007) · The Canadian Journal of Psychiatry · doi:10.1177/070674370705200209 · Cited by 226 · see citing works
Janssens, A. C. J. W., van Doorn, P. A., de Boer, J. B., Kalkers, N. F., van der Meché, F. G. A., Passchier, J., & Hintzen, R. Q. (2003) · Multiple Sclerosis Journal · doi:10.1191/1352458503ms930oa · Cited by 209 · see citing works
Construction and validation of a fatigue impact scale for daily administration (D-FIS)
Fisk, J. D., & Doble, S. E. (2002) · Quality of Life Research · doi:10.1023/a:1015295106602 · Cited by 170 · see citing works
Validation of Depression Screening Scales in Patients With CKD
Hedayati, S. S., Minhajuddin, A., Toto, R. D., Morris, D. W., & Rush, A. J. (2009) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2009.03.016 · Cited by 136 · see citing works
Identification of Beck Depression Inventory Items Related to Multiple Sclerosis
Mohr, D. C., Goodkin, D. E., Likosky, W., Beutler, L. E., Gatto, N. M., & Langan, M. K. (1997) · Journal of Behavioral Medicine · doi:10.1023/a:1025573315492 · Cited by 129 · see citing works
Pietrzak, R. H., Kinley, J., Afifi, T. O., Enns, M. W., FAWCETT, J. A., & Sareen, J. (2012) · Psychological Medicine · doi:10.1017/s0033291712002309 · Cited by 127 · see citing works
Sex differences in comorbidity at diagnosis of multiple sclerosis
Marrie, R. A., Patten, S. B., Tremlett, H. L., Wolfson, C. M., Warren, S., Svenson, L. W., Jetté, N., Fisk, J. D., For the CIHR Team in the Epidemiology and Impact of Comorbidity on Multiple Sclerosis, CIHR Team in the Epidemiology and Impact of Comorbidity on Multiple Sclerosis, et al. (2016) · Neurology · doi:10.1212/wnl.0000000000002481 · Cited by 126 · see citing works
Validation of Mood Measures for People with Multiple Sclerosis
Watson, T. M., Ford, E., Worthington, E. J., & Lincoln, N. B. (2014) · International Journal of MS Care · doi:10.7224/1537-2073.2013-013 · Cited by 112 · see citing works
Comorbidity increases the risk of hospitalizations in multiple sclerosis
Marrie, R. A., Elliott, L. J., Marriott, J. J., Cossoy, M. B., Tennakoon, A., & Yu, N. (2014) · Neurology · doi:10.1212/wnl.0000000000001187 · Cited by 108 · see citing works
Validity of four screening scales for major depression in MS
Patten, S. B., Burton, J., Fiest, K. M., Wiebe, S., Bulloch, A. G., Koch, M. W., Dobson, K. S., Metz, L. M., Maxwell, C. J., & Jetté, N. (2015) · Multiple Sclerosis Journal · doi:10.1177/1352458514559297 · Cited by 88 · see citing works
Cacciola, J. S., Alterman, A. I., Rutherford, M. J., McKay, J. R., & May, D. J. (1999) · Assessment · doi:10.1177/107319119900600304 · Cited by 86 · see citing works
Terrill, A. L., Hartoonian, N., Beier, M. L., Salem, R., & Alschuler, K. N. (2014) · International Journal of MS Care · doi:10.7224/1537-2073.2014-008 · Cited by 84 · see citing works
Comorbidity is associated with pain-related activity limitations in multiple sclerosis
Fiest, K. M., Fisk, J. D., Patten, S. B., Tremlett, H. L., Wolfson, C. M., Warren, S., McKay, K. A., Berrigan, L. I., & Marrie, R. A. (2015) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2015.07.014 · Cited by 69 · see citing works
Screening Tools for Anxiety in People with Multiple Sclerosis
Litster, B., Fiest, K. M., Patten, S. B., Fisk, J. D., Walker, J. R., Graff, L. A., Bolton, J. M., Sareen, J., Marriott, J. J., Berrigan, L. I., et al. (2016) · International Journal of MS Care · doi:10.7224/1537-2073.2016-004 · Cited by 40 · see citing works
Hind, D., Kaklamanou, D., Beever, D., Webster, R., Lee, E. C., Barkham, M., & Cooper, C. L. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0931-5 · Cited by 38 · see citing works
Amtmann, D., Bamer, A. M., Johnson, K. L., Ehde, D. M., Beier, M. L., Elzea, J. L., & Bombardier, C. H. (2015) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2015.08.007 · Cited by 32 · see citing works
Flagged first, then by citations
1 of the 40 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Levis, B., Benedetti, A., Ioannidis, J. P. A., Sun, Y., Negeri, Z., He, C., Wu, Y., Krishnan, A., Bhandari, P. M., Neupane, D., et al. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.02.002 · Cited by 217 · see citing works
Peres, D. S., Rodrigues, P., Viero, F. T., Frare, J. M., Kudsi, S. Q., Meira, G. M., & Trevisan, G. (2022) · Brain Behavior & Immunity - Health · doi:10.1016/j.bbih.2022.100484 · Cited by 127 · see citing works
Etiology, effects and management of comorbidities in multiple sclerosis: recent advances
Marrie, R. A., Fisk, J. D., Fitzgerald, K. C., Kowalec, K., Maxwell, C. J., Rotstein, D., Salter, A. R., & Tremlett, H. L. (2023) · Frontiers in Immunology · doi:10.3389/fimmu.2023.1197195 · Cited by 115 · see citing works
Comorbid anxiety, depression, and cognition in MS and other immune-mediated disorders
Whitehouse, C. E., Fisk, J. D., Bernstein, C. N., Berrigan, L. I., Bolton, J. M., Graff, L. A., Hitchon, C. A., Marriott, J. J., Peschken, C. A., Sareen, J., et al. (2019) · Neurology · doi:10.1212/wnl.0000000000006854 · Cited by 112 · see citing works
Hitchon, C. A., Zhang, L., PESCHKEN, C. A., Lix, L. M., Graff, L. A., Fisk, J. D., Patten, S. B., Bolton, J. M., Sareen, J., El-Gabalawy, R. M., et al. (2019) · Arthritis Care & Research · doi:10.1002/acr.24011 · Cited by 111 · see citing works
Snijkers, J. T. W., van den Oever, W., Weerts, Z. Z. R. M., Vork, L., Mujagic, Z., Leue, C., Hesselink, M., Kruimel, J. W., Muris, J. W. M., Bogie, R. M. M., et al. (2021) · Neurogastroenterology & Motility · doi:10.1111/nmo.14161 · Cited by 94 · see citing works
Karimi, S., Andayeshgar, B., & Khatony, A. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02579-z · Cited by 85 · see citing works
Psychiatric disorders in multiple sclerosis
Sparaco, M., Lavorgna, L., & Bonavita, S. (2019) · Journal of Neurology · doi:10.1007/s00415-019-09426-6 · Cited by 79 · see citing works
Garjani, A., Middleton, R., Hunter, R., Tuite-Dalton, K. A., Coles, A. J., Dobson, R., Duddy, M., Hughes, S., Pearson, O. R., Rog, D. J., et al. (2021) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2021.102939 · Cited by 57 · see citing works
Diabetes and anxiety adversely affect cognition in multiple sclerosis
Marrie, R. A., Patel, R., Figley, C. R., Kornelsen, J., Bolton, J. M., Graff, L. A., Mazerolle, E. L., Marriott, J. J., Bernstein, C. N., & Fisk, J. D. (2018) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2018.10.018 · Cited by 50 · see citing works
Aktürk, Z., Hapfelmeier, A., Fomenko, A., Dümmler, D., Eck, S., Olm, M., Gehrmann, J., von Schrottenberg, V., Rehder, R., Dawson, S., et al. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015455 · Cited by 50 · see citing works
Anxiety disorders and medical illness comorbidity and treatment implications
Latas, M. B., Latas, D. V., & Stojaković, M. S. (2019) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000527 · Cited by 40 · see citing works
Tennenhouse, L. G., Marrie, R. A., Bernstein, C. N., & Lix, L. M. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2020.110126 · Cited by 42 · see citing works
Recovery From COVID-19 in Multiple Sclerosis
Garjani, A., Middleton, R. M., Nicholas, R. S., & Evangelou, N. (2021) · Neurology Neuroimmunology & Neuroinflammation · doi:10.1212/nxi.0000000000001118 · Cited by 38 · see citing works
Depression and anxiety in multiple sclerosis. Review of a fatal combination
Jellinger, K. A. (2024) · Journal of Neural Transmission · doi:10.1007/s00702-024-02792-0 · Cited by 41 · see citing works
Xie, Z., Wenger, N. S., Stanton, A. L., Sepucha, K., Kaplan, C. P., Madlensky, L., Elashoff, D. A., Trent, J., Petruse, A., Johansen, L., et al. (2019) · Psycho-Oncology · doi:10.1002/pon.5211 · Cited by 34 · see citing works
Childhood Maltreatment and Psychiatric Comorbidity in Immune-Mediated Inflammatory Disorders
Wan, A., Bernstein, C. N., Graff, L. A., Patten, S. B., Sareen, J., Fisk, J. D., Bolton, J. M., Hitchon, C., Marriott, J. J., Marrie, R. A., et al. (2021) · Psychosomatic Medicine · doi:10.1097/psy.0000000000001025 · Cited by 34 · see citing works
Thiemann, P., Brimicombe, J. D., BENSON, J. A., & Quince, T. A. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02029-0 · Cited by 35 · see citing works
Modifiable factors associated with depression and anxiety in multiple sclerosis
Gascoyne, C., Simpson, S., Chen, J., van der Mei, I. A. F., & Marck, C. H. (2019) · Acta Neurologica Scandinavica · doi:10.1111/ane.13132 · Cited by 32 · see citing works
Network alterations underlying anxiety symptoms in early multiple sclerosis
Ellwardt, E., Muthuraman, M., González-Escamilla, G., Chirumamilla, V., Luessi, F., Bittner, S., Zipp, F., Groppa, S., & Fleischer, V. (2022) · Journal of Neuroinflammation · doi:10.1186/s12974-022-02476-0 · Cited by 29 · see citing works
Beswick, E., Quigley, S. M., Macdonald, P., Patrick, S. L., Colville, S., Chandran, S., & Connick, P. (2022) · BMC Psychology · doi:10.1186/s40359-022-00949-8 · Cited by 33 · see citing works
Watson, C. B., Sharpley, C. F., Bitsika, V., Evans, I. D., & Vessey, K. A. (2025) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13794 · Cited by 33 · see citing works
Restless legs syndrome and health‐related quality of life in adults with multiple sclerosis
Cederberg, K. L. J., Jeng, B., Sasaki, J. E., Braley, T. J., Walters, A. S., & Motl, R. W. (2019) · Journal of Sleep Research · doi:10.1111/jsr.12880 · Cited by 31 · see citing works
Fleming, K. M., Coote, S. B., & Herring, M. P. (2019) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2019.101573 · Cited by 31 · see citing works
Vong, V., Simpson, S., Phaiju, S., Davenport, R. A., Neate, S. L., Pisano, M. I., & Reece, J. C. (2023) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2023.104501 · Cited by 31 · see citing works
Validation of the SymptoMScreen with performance-based or clinician-assessed outcomes
Fitzgerald, K. C., Salter, A. R., Tyry, T. M., Fox, R. J., Cutter, G., Mowry, E. M., & Marrie, R. A. (2019) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2019.01.031 · Cited by 30 · see citing works
Berg, S. K., Herning, M., Thygesen, L. C., Cromhout, P. F., Wagner, M. K., Nielsen, K. M., Christensen, A. V., & Rasmussen, T. B. (2019) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2019.03.183 · Cited by 30 · see citing works
Taylor, P., Dorstyn, D., & Prior, E. (2019) · Journal of Health Psychology · doi:10.1177/1359105319860185 · Cited by 30 · see citing works
Clover, K., Lambert, S., Oldmeadow, C., Britton, B., Mitchell, A., Carter, G., & King, M. (2022) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-022-00477-4 · Cited by 25 · see citing works
Freedman, D., Oh, J., Kiss, A., Puopolo, J., Wishart, M., Meza, C., & Feinstein, A. (2024) · Journal of Neurology · doi:10.1007/s00415-024-12409-x · Cited by 29 · see citing works
Jerković, A., Proroković, A., Matijaca, M., Vuko, J., Poljičanin, A., Mastelić, A., Katić, A. Ć., Košta, V., Kustura, L., Dolić, K., et al. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.794353 · Cited by 28 · see citing works
Predisposing Factors for Sexual Dysfunction in Multiple Sclerosis
Altmann, P., Leutmezer, F., Leithner, K., Monschein, T., Ponleitner, M., Stattmann, M., Rommer, P. S., Zrzavy, T., Zulehner, G., Berek, K., et al. (2021) · Frontiers in Neurology · doi:10.3389/fneur.2021.618370 · Cited by 27 · see citing works
Buchholz, S. W., Wilbur, J., Halloway, S., Schoeny, M. E., Johnson, T. J., Vispute, S., & Kitsiou, S. (2019) · Contemporary Clinical Trials · doi:10.1016/j.cct.2019.105921 · Cited by 26 · see citing works
Podda, J., Ponzio, M., Uccelli, M. M., Pedullà, L., Bozzoli, F., Molinari, F., Bragadin, M. M., Battaglia, M. A., Zaratin, P., Brichetto, G., et al. (2020) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2020.102417 · Cited by 26 · see citing works
Marrie, R. A., Patel, R., Bernstein, C. N., Bolton, J. M., Graff, L. A., Marriott, J. J., Hitchon, C. A., Figley, C. R., Kornelsen, J., & Fisk, J. D. (2020) · Multiple Sclerosis Journal · doi:10.1177/1352458520961534 · Cited by 26 · see citing works
Symptom clusters and quality of life in persons with multiple sclerosis across the lifespan
Silveira, S. L., Cederberg, K. L. J., Jeng, B., Sikes, E. M., Sandroff, B. M., Jones, C. D., & Motl, R. W. (2020) · Quality of Life Research · doi:10.1007/s11136-020-02689-x · Cited by 26 · see citing works
Garjani, A., Hunter, R., Law, G. R., Middleton, R., Tuite-Dalton, K. A., Dobson, R., Ford, D. V., Hughes, S., Pearson, O. R., Rog, D. J., et al. (2021) · Multiple Sclerosis Journal · doi:10.1177/13524585211020435 · Cited by 25 · see citing works
Clinical Practice Guidelines for the Detection and Treatment of Depression in Multiple Sclerosis
McIntosh, G. E., Liu, E. S., Allan, M., & Grech, L. (2023) · Neurology Clinical Practice · doi:10.1212/cpj.0000000000200154 · Cited by 28 · see citing works
Tauil, C. B., Lima, A. D. D. R., Ferrari, B. B., da Silva, F. M., Machado, L., Ramari, C., Brandão, C. O., dos Santos, L. M. B., & dos Santos‐Neto, L. L. (2021) · Brazilian Journal of Medical and Biological Research · doi:10.1590/1414-431x202010428 · Cited by 24 · see citing works
Recklitis, C. J., Blackmon, J. E., & Chang, G. (2020) · Cancer · doi:10.1002/cncr.32689 · Cited by 24 · see citing works
Dunne, J., Chih, H. J., Begley, A., Daly, A., Gerlach, R., Schütze, R., Castell, E., Byrne, J., & Black, L. J. (2021) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2020.102728 · Cited by 23 · see citing works
Rahimi, F., Rejeh, N., Bahrami, T., Heravi‐Karimooi, M., Tadrisi, S. D., Griffiths, P., & Vaismoradi, M. (2019) · Perspectives in Psychiatric Care · doi:10.1111/ppc.12389 · Cited by 23 · see citing works
Manifestations and impact of the COVID‐19 pandemic in neuroinflammatory diseases
Levin, S. N., Venkatesh, S., Nelson, K. E., Li, Y., Aguerre, I. M., Zhu, W., Masown, K., Rimmer, K., Diaconu, C. I., Onomichi, K. B., et al. (2021) · Annals of Clinical and Translational Neurology · doi:10.1002/acn3.51314 · Cited by 23 · see citing works
Marrie, R. A., Walker, J. R., Graff, L. A., Patten, S. B., Bolton, J. M., Marriott, J. J., Fisk, J. D., Hitchon, C. A., PESCHKEN, C. A., & Bernstein, C. N. (2019) · Patient Education and Counseling · doi:10.1016/j.pec.2019.04.007 · Cited by 22 · see citing works
MacDonald, T., Fisk, J. D., Bernstein, C. N., El-Gabalawy, R. M., Hitchon, C. A., Kornelsen, J., Patten, S. B., Tisseverasinghe, A., & Marrie, R. A. (2021) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2021.110479 · Cited by 22 · see citing works
Fomenko, A., Dümmler, D., Aktürk, Z., Eck, S., Teusen, C., Karapetyan, S., Dawson, S., Löwe, B., Hapfelmeier, A., Linde, K., et al. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015456 · Cited by 28 · see citing works
Grunberg, V. A., Greenberg, J., Mace, R. A., Bakhshaie, J., Choi, K. W., & Vranceanu, A. (2022) · Journal of Pain · doi:10.1016/j.jpain.2022.07.003 · Cited by 20 · see citing works
Daniels, K., Frequin, S. T. F. M., van de Garde, E. M. W., Biesma, D. H., van der Wees, P. J., van der Nat, P. B., Hüseyinsinoğlu, B. E., Ben‐Zacharia, A. B., Cohen, E. T., Gonçalves, P. J. C., et al. (2022) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2022.104461 · Cited by 19 · see citing works
Filser, M., Buchner, A., Fink, G. R., Gold, S. M., & Penner, I. (2022) · Journal of Neurology · doi:10.1007/s00415-022-11359-6 · Cited by 18 · see citing works
Foong, Y. C., Merlo, D., Gresle, M. M., Zhu, C., Buzzard, K. A., Lechner‐Scott, J., Barnett, M. H., Taylor, B. V., Kalinčík, T., Kilpatrick, T. J., et al. (2023) · European Journal of Neurology · doi:10.1111/ene.16046 · Cited by 18 · see citing works
Simpson, S., Taylor, K. L., Jelinek, G. A., Livera, A. M. D., Brown, C. R., O’Kearney, E., Neate, S. L., Bevens, W., & Weiland, T. J. (2019) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2019.02.014 · Cited by 18 · see citing works
Dorstyn, D., Mathias, J. L., Bombardier, C. H., & Osborn, A. J. (2019) · Clinical Rehabilitation · doi:10.1177/0269215519895790 · Cited by 20 · see citing works
Hadlandsmyth, K., Dindo, L. N., St. Marie, B. J., Wajid, R., Embree, J. L., Noiseux, N. O., Tripp-Reimer, T., Zimmerman, M. B., & Rakel, B. A. (2020) · Evaluation & the Health Professions · doi:10.1177/0163278719856406 · Cited by 17 · see citing works
“Validity and reliability of this measure have been demonstrated in patients with knee osteoarthritis (OA; Driban, Morgan, Price, Cook, & Wang, 2015), multiple sclerosis (Marrie et al., 2018), and lumbar degenerative disease (Purvis, Neuman, Riley, & Skolasky, 2018).”
InfluentialSullivan, A. B., Davis, B. E., Kidd, J., & Chiong-Rivero, H. (2025) · Neurology and Therapy · doi:10.1007/s40120-025-00728-8 · Cited by 17 · see citing works
Burrows, B. T., Morgan, A. M., King, A. C., Hernández, R., & Wilund, K. R. (2023) · Kidney and Dialysis · doi:10.3390/kidneydial3030026 · Cited by 17 · see citing works
Aminian, S., Motl, R. W., Rowley, J., & Manns, P. J. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026622 · Cited by 17 · see citing works
Park, S., & Park, S. K. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.119913 · Cited by 19 · see citing works
Social phobia in immune-mediated inflammatory diseases
Reinhorn, I. M., Bernstein, C. N., Graff, L. A., Patten, S. B., Sareen, J., Fisk, J. D., Bolton, J. M., Hitchon, C. A., & Marrie, R. A. (2019) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2019.109890 · Cited by 16 · see citing works
Witges, K., Targownik, L. E., Haviva, C., Walker, J. R., Graff, L. A., Sexton, K. A., Lix, L. M., Sargent, M. J., Vagianos, K., & Bernstein, C. N. (2018) · JMIR Research Protocols · doi:10.2196/11317 · Cited by 16 · see citing works
Wu, Y., Levis, B., Daray, F. M., Ioannidis, J. P. A., Patten, S. B., Cuijpers, P. J., Ziegelstein, R. C., Gilbody, S. M., Fischer, F. H., Fan, S., et al. (2023) · Psychological Assessment · doi:10.1037/pas0001181 · Cited by 15 · see citing works
Factors associated with perceived need for mental health care in multiple sclerosis
Orr, J., Bernstein, C. N., Graff, L. A., Patten, S. B., Bolton, J. M., Sareen, J., Marriott, J. J., Fisk, J. D., & Marrie, R. A. (2018) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2018.07.043 · Cited by 15 · see citing works
Relationship of perceived stress and employment status in individuals with multiple sclerosis
Beier, M. L., Hartoonian, N., D’Orio, V. L., Terrill, A. L., Bhattarai, J., Paisner, N. D., & Alschuler, K. N. (2019) · Work · doi:10.3233/wor-192859 · Cited by 15 · see citing works
Hansen, J. S., Hansen, R. M., Petersen, T., Gustavsen, S., Oturai, A. B., Sellebjerg, F. T., Sædder, E. A., Kasch, H., Rasmussen, P. V., Finnerup, N. B., et al. (2021) · Brain Sciences · doi:10.3390/brainsci11091212 · Cited by 15 · see citing works
Cederberg, K. L. J., Jeng, B., Sasaki, J. E., Sikes, E. M., Silveira, S. L., Cutter, G., & Motl, R. W. (2021) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2021.103204 · Cited by 14 · see citing works
Sommer, J. L., Reynolds, K., Hebbard, P. C., Mota, N. P., Roos, L. E., Sareen, J., Devereaux, P. J., Srinathan, S., & El-Gabalawy, R. M. (2022) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2022.111036 · Cited by 14 · see citing works
Yi, F.-C., Zhou, H.-X., Chen, B.-J., Ren, H.-Q., Ma, Z., Zhang, X.-Y., & Duan, J. (2024) · Thoracic Cancer · doi:10.1111/1759-7714.15287 · Cited by 12 · see citing works
Item Response Theory Analysis: PROMIS® Anxiety Form and Generalized Anxiety Disorder Scale
Liu, W., Dindo, L. N., Hadlandsmyth, K., Unick, G. J., Zimmerman, M. B., Marie, B. S., Embree, J. L., Tripp‐Reimer, T., & Rakel, B. A. (2021) · Western Journal of Nursing Research · doi:10.1177/01939459211015985 · Cited by 14 · see citing works
Liu, C., McCabe, M., Kellett-Renzella, S., Shankar, S., Gerges, N., & Cornish, K. M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182312752 · Cited by 16 · see citing works
Grunberg, V. A., Mace, R. A., Bannon, S. M., Greenberg, J., Bakhshaie, J., & Vranceanu, A.-M. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.05.069 · Cited by 13 · see citing works
Peres, D. S., Viero, F. T., Rodrigues, P., Bernardes, L. D. B., Ruviaro, N. A., Lima, I. R., Martins, G., Silveira, P. C. L., Ferreira, M. D. A., da Silva, A. M., et al. (2023) · Journal of Neuroimmune Pharmacology · doi:10.1007/s11481-023-10080-z · Cited by 13 · see citing works
Gervasoni, E., Cattaneo, D., Bertoni, R., Grosso, C., Bisio, A., Rovaris, M., & Bove, M. (2019) · International Journal of Rehabilitation Research · doi:10.1097/mrr.0000000000000362 · Cited by 13 · see citing works
Clinical Management in Multiple Sclerosis
Arredondo-Robles, A. V., Rodriguez-Lopez, K., & Ávila‐Avilés, R. D. (2025) · Neuroglia · doi:10.3390/neuroglia6010006 · Cited by 14 · see citing works
Meek, C., das Nair, R., Evangelou, N., Middleton, R., Tuite-Dalton, K., & Moghaddam, N. (2022) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2022.104154 · Cited by 12 · see citing works
Craner, J. R., Flegge, L. G., Lake, E. S., & Perra, A. E. A. (2021) · Pain Medicine · doi:10.1093/pm/pnab242 · Cited by 11 · see citing works
Kowalec, K., Salter, A. R., Fitzgerald, K. C., Patel, M., Han, J., Lu, Y., Bolton, J. M., Hitchon, C. A., Bernstein, C. N., Patten, S. B., et al. (2022) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2022.04.005 · Cited by 11 · see citing works
Claflin, S. B., Campbell, J. A., Norman, R., Mason, D. F., Kalinčík, T., Simpson, S., Butzkueven, H., Carroll, W. M., Palmer, A. J., Blizzard, C. L., et al. (2022) · The European Journal of Health Economics · doi:10.1007/s10198-022-01518-x · Cited by 10 · see citing works
Freitag, G. F., Salem, H., Conroy, K., Busto, C., Adrian, M. C., Borba, C. P. C., Brandt, A. J., Chu, P. V., Dantowitz, A., Farley, A. M., et al. (2023) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2023.102677 · Cited by 10 · see citing works
Cohen, J. N., Seng, E. K., & Foley, F. W. (2021) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2021.102808 · Cited by 10 · see citing works
Uddin, M. N., Figley, T. D., Kornelsen, J., Mazerolle, E. L., Helmick, C. A., O'Grady, C. B., Pirzada, S., Patel, R., Carter, S., Wong, K., et al. (2022) · Frontiers in Neuroimaging · doi:10.3389/fnimg.2022.970385 · Cited by 10 · see citing works
Coll, C., Salavedra‐Pont, J., Buxó, M., Quintana, E., Quiroga‐Varela, A., Robles‐Cedeño, R., Puig, M., Álvarez-Bravo, G., Ramió‐Torrentà, L., & Gich, J. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1163112 · Cited by 9 · see citing works
The Barancik lecture: Comorbidity in multiple sclerosis—Looking backward, looking forward
Marrie, R. A. (2023) · Multiple Sclerosis Journal · doi:10.1177/13524585231167740 · Cited by 9 · see citing works
Recklitis, C. J., Blackmon, J. E., Chevalier, L., & Chang, G. (2021) · Cancer · doi:10.1002/cncr.33683 · Cited by 9 · see citing works
Claflin, S. B., Campbell, J. A., Mason, D. F., Kalinčík, T., Simpson, S., Norman, R., Butzkueven, H., Carroll, W. M., Palmer, A. J., Blizzard, C. L., et al. (2021) · Multiple Sclerosis Journal · doi:10.1177/13524585211035948 · Cited by 9 · see citing works
Shadyab, A. H., Larson, J. C., Rapp, S. R., Shumaker, S. A., Kroenke, C. H., Meliker, J. R., Saquib, N., Ikramuddin, F. S., Michael, Y. L., Goveas, J. S., et al. (2022) · The Journals of Gerontology Series A · doi:10.1093/gerona/glac053 · Cited by 8 · see citing works
Joyees, J., Marrie, R. A., Bernstein, C. N., Bolton, J. M., Fisk, J. D., Graff, L. A., Hitchon, C. A., Patten, S. B., Kowalec, K., & for the CIHR team in defining the burden and managing the effects of psychiatric comorbidity in chronic immunoinflammatory disease (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1260420 · Cited by 8 · see citing works
Depression and Anxiety in Association with Polypharmacy in Patients with Multiple Sclerosis
Baldt, J., Frahm, N., Hecker, M., Streckenbach, B., Langhorst, S. E., Mashhadiakbar, P., Burian, K., Meißner, J., Heidler, F., Richter, J., et al. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12165379 · Cited by 8 · see citing works
Burian, K., Heidler, F., Frahm, N., Hecker, M., Langhorst, S. E., Mashhadiakbar, P., Streckenbach, B., Baldt, J., Meißner, J., Richter, J., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-62541-x · Cited by 9 · see citing works
Miller, J., Altaras, C., Vissicchio, N. A., Zemon, V. M., Portnoy, J. G., Gromisch, E. S., Sloan, J., Tyry, T. M., & Foley, F. W. (2020) · Quality of Life Research · doi:10.1007/s11136-020-02567-6 · Cited by 8 · see citing works
Cesa, K. T., Cunningham, C. A., Noll, R. B., & Kim, S. C. (2022) · Crohn s & Colitis 360 · doi:10.1093/crocol/otac019 · Cited by 8 · see citing works
Greene, N., Quéré, S., Bury, D. P., Mazerolle, F., M’Hari, M., Loubert, A., Regnault, A., & Higuchi, K. (2023) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-023-00594-8 · Cited by 8 · see citing works
Dysmenorrhea and psychological wellbeing among females with attention deficit hyperactivity disorder
Lockinger, K., & Gagnon, M. M. (2023) · Journal of Health Psychology · doi:10.1177/13591053231177254 · Cited by 7 · see citing works
Depression, Anxiety, and Physical Activity in Older Adults With Multiple Sclerosis
Bollaert, R. E., Jones, C. D., Šilić, P., & Motl, R. W. (2022) · Journal of Aging and Physical Activity · doi:10.1123/japa.2021-0447 · Cited by 7 · see citing works
Stein, C., O’Keeffe, F. M., McManus, C., Tubridy, N. J., Gaughan, M., McGuigan, C., & Bramham, J. (2023) · Journal of Neuropsychology · doi:10.1111/jnp.12327 · Cited by 7 · see citing works
Almweisheer, S., Bernstein, C. N., Graff, L. A., Patten, S. B., Bolton, J. M., Fisk, J. D., Hitchon, C. A., Marriott, J. J., & Marrie, R. A. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-073782 · Cited by 7 · see citing works
Sex differences in predictors of illness intrusiveness in persons with multiple sclerosis
Neto, L. O., Gromisch, E. S., Sloan, J., Tyry, T. M., & Foley, F. W. (2018) · Quality of Life Research · doi:10.1007/s11136-018-2023-0 · Cited by 7 · see citing works
Gromisch, E. S., Neto, L. O., Sloan, J., Tyry, T. M., & Foley, F. W. (2021) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2021.103079 · Cited by 7 · see citing works
Multipl Skleroz Hastalarında Ruhsal Durumun Değerlendirilmesi ve Hemşirenin Rolü: Sistematik Derleme
Altun, Ö. Ş., & Özer, D. (2020) · Arşiv Kaynak Tarama Dergisi · doi:10.17827/aktd.514723 · Cited by 6 · see citing works
Fleming, K. M., Coote, S. B., & Herring, M. P. (2020) · Mental health and physical activity · doi:10.1016/j.mhpa.2020.100341 · Cited by 6 · see citing works
Meek, C., Moghaddam, N. G., Evangelou, N., Oates, L. L., Topcu, G., Allen, C. M., & das Nair, R. (2021) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2021.07.001 · Cited by 6 · see citing works
- Authors
- Marrie, R. A., Zhang, L., Lix, L. M., Graff, L. A., Walker, J. R., Fisk, J. D., Patten, S. B., Hitchon, C. A., Bolton, J. M., Sareen, J., El-Gabalawy, R., Marriott, J. J., & Bernstein, C. N.
- Affiliations
- University of Manitoba (CA)
- Dalhousie University (CA)
- University of Calgary (CA)
- Corresponding author
- Marrie, Ruth Ann
- ORCID
- Venue
- Multiple Sclerosis and Related Disorders
- Publisher
- Elsevier BV
- Published
- 2018-02
- Volume
- 20
- Pages
- 9-15
- ISSN
- 2211-0348 (ISSN-L)
- OpenAlex
- W2771966364
- Cited by
- 169
- References
- 40
- Citations by year
- 2026: 17 · 2025: 17 · 2024: 16 · 2023: 25 · 2022: 22 · 2021: 26 · 2020: 18 · 2019: 24 · 2018: 4
- FWCI
- 16.26
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Multiple Sclerosis and Related Disorders (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- Crohn's and Colitis Canada
- Heart and Stroke Foundation of Canada
- Canadian Institutes of Health Research (THC-135234, 333252)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Pathology and Forensic Medicine › Multiple Sclerosis Research Studies
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- multiple sclerosis, depression screening, anxiety screening, PHQ-9, Hospital Anxiety and Depression Scale, PROMIS, GAD-7, OASIS, Kessler-6, sensitivity and specificity, test-retest reliability, internal consistency, psychometric properties, generalized anxiety disorder
- MeSH terms
- Anxiety, Depression, Female, Humans, Interview, Psychological, Male, Middle Aged, Multiple Sclerosis, Psychiatric Status Rating Scales, Psychometrics, Sensitivity and Specificity, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review