The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Validation of the Hospital Anxiety and Depression Scale for use with multiple sclerosis patients
Abstract
Detecting clinically significant symptoms of depression and anxiety in medically ill patients using self-report rating scales presents a challenge because of somatic confounders. The Hospital Anxiety and Depression Scale (HADS) was developed with this in mind, but has never been validated for a multiple sclerosis population. Our objective was to validate the HADS for multiple sclerosis patients. Multiple sclerosis patients were interviewed for the presence of major depression (n = 180) and anxiety disorders (n = 140) with the Structured Clinical Interview for DSM-IV disorders. A receiver operating characteristic (ROC) analysis was undertaken to assess which HADS cut-off scores give the best yield with respect to diagnoses of major depression and all anxiety disorders defined by the Structured Clinical Interview for DSM-IV. A threshold score of 8 or greater on the HADS depression subscale provides a sensitivity of 90% and specificity of 87.3% (ROC area under the curve 0.938). The same cut-off score gives a sensitivity of 88.5% and a specificity of 80.7% on the anxiety subscale (ROC area under the curve 0.913), but for generalized anxiety disorder only. The study confirms the usefulness of the HADS as a marker of major depression and generalized anxiety disorder, but not other anxiety disorders, in multiple sclerosis patients.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A cut-off of >7 gives a high sensitivity and specificity for detecting clinically elevated depression and anxiety in pwMS (Honarmand & Feinstein, 2009).”
From Neuropsychology intervention for managing invisible symptoms of MS (NIMIS-MS) group: A pilot effectiveness and acceptability study (2024) · cites this paper as Honarmand & Feinstein, 2009
Citations
Cites
The Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139
Rating neurologic impairment in multiple sclerosis: An expanded disability status scale (EDSS)
Kurtzke, J. F. (1983) · Neurology · doi:10.1212/wnl.33.11.1444 · Cited by 15,011
Practical Statistics for Medical Research
Altman, D. G. (1990) · doi:10.1201/9780429258589 · Cited by 10,668
New diagnostic criteria for multiple sclerosis: Guidelines for research protocols
Poser, C. M., Paty, D. W., Scheinberg, L., McDonald, W. I., Davis, F. A., Ebers, G. C., Johnson, K. P., Sibley, W. A., Silberberg, D. H., & Tourtellotte, W. W. (1983) · Annals of Neurology · doi:10.1002/ana.410130302 · Cited by 7,384
McDonald, W. I., Compston, A., Edan, G., Goodkin, D., Hartung, H., Lublin, F. D., McFarland, H. F., Paty, D. W., Polman, C. H., Reingold, S. C., et al. (2001) · Annals of Neurology · doi:10.1002/ana.1032 · Cited by 6,969
Ellsworth, P. D. (1980) · American Journal of Occupational Therapy · doi:10.5014/ajot.34.12.819a · Cited by 1,702
Measuring the Functional Impact of Fatigue: Initial Validation of the Fatigue Impact Scale
Fisk, J. D., Ritvo, P. G., Ross, L., Haase, D. A., Marrie, T. J., & Schlech, W. F. (1994) · Clinical Infectious Diseases · doi:10.1093/clinids/18.supplement_1.s79 · Cited by 1,546
Olssøn, I., Mykletun, A., & Dahl, A. A. (2005) · BMC Psychiatry · doi:10.1186/1471-244x-5-46 · Cited by 580
Depression and multiple sclerosis
Sadovnick, A. D., Remick, R. A., Allen, J. B., Swartz, E. S., Yee, I. M. L., Eisen, K., Farquhar, R., Hashimoto, S. A., Hooge, J. P., Kastrukoff, L. F., et al. (1996) · Neurology · doi:10.1212/wnl.46.3.628 · Cited by 536
Major depression in multiple sclerosis
Patten, S. B., Beck, C. A., Williams, J. V. A., Barbui, C., & Metz, L. M. (2003) · Neurology · doi:10.1212/01.wnl.0000095964.34294.b4 · Cited by 534
Screening for Adjustment Disorders and Major Depressive Disorders in Cancer In-Patients
Razavi, D., Delvaux, N., Farvacques, C., & Robaye, E. (1990) · British Journal of Psychiatry · doi:10.1192/bjp.156.1.79 · Cited by 514
Anxiety disorders and their clinical correlates in multiple sclerosis patients
Korostil, M., & Feinstein, A. (2007) · Multiple Sclerosis Journal · doi:10.1177/1352458506071161 · Cited by 424 · cited 1×
“Data show that two-thirds of patients with an anxiety disorder also have major depression.(4) Our findings therefore indicate that the use of the HADS should come with a cautionary recommendation, namely that the anxiety subscale is most valid when identifying the presence of a generalized anxiety disorder.”
BackgroundSelf-citationScreening for anxiety and depression in cancer patients: the effects of disease and treatment
Ibbotson, T., Maguire, P., Selby, P., Priestman, T., & Wallace, L. (1994) · European Journal of Cancer · doi:10.1016/s0959-8049(05)80015-2 · Cited by 421
Affective Disorders in Multiple Sclerosis Review and Recommendations for Clinical Research
Minden, S. L., & Schiffer, R. B. (1990) · Archives of Neurology · doi:10.1001/archneur.1990.00530010124031 · Cited by 415
Screening for Psychological Distress in Japanese Cancer Patients
Kugaya, A., Akechi, T., Okuyama, T., Okamura, H., & Uchitomi, Y. (1998) · Japanese Journal of Clinical Oncology · doi:10.1093/jjco/28.5.333 · Cited by 365
Validity of the Beck Depression Inventory-Fast Screen in multiple sclerosis
Benedict, R. H. B., Fishman, I., McClellan, M., Bakshi, R., & Weinstock‐Guttman, B. (2003) · Multiple Sclerosis Journal · doi:10.1191/1352458503ms902oa · Cited by 336
An examination of suicidal intent in patients with multiple sclerosis
Feinstein, A. (2002) · Neurology · doi:10.1212/wnl.59.5.674 · Cited by 326
Self-citationStructural brain abnormalities in multiple sclerosis patients with major depression
Feinstein, A., Roy, P., Lobaugh, N., Feinstein, K., O’Connor, P., & Black, S. (2004) · Neurology · doi:10.1212/01.wnl.0000110316.12086.0c · Cited by 294 · cited 4×
“Statistical analysis The sample was divided into those subjects with and without current diagnoses of major depression and anxiety disorders based on the results of the SCID-I.”
MethodResultInfluentialSelf-citationHopwood, P., Howell, A., & Maguire, P. (1991) · British Journal of Cancer · doi:10.1038/bjc.1991.305 · Cited by 280
Abiodun, O. A. (1994) · The British Journal of Psychiatry · doi:10.1192/bjp.165.5.669 · Cited by 258
Hadjimichael, O., Vollmer, T., & Oleen-Burkey, M. (2008) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-6-100 · Cited by 240
Prevalence of sleep problems in individuals with multiple sclerosis
Bamer, A. M., Johnson, K., Amtmann, D., & Kraft, G. (2008) · Multiple Sclerosis Journal · doi:10.1177/1352458508092807 · Cited by 239
A prospective study of patterns of fatigue in multiple sclerosis
Lerdal, A., Celius, E. G., Krupp, L., & Dahl, A. A. (2007) · European Journal of Neurology · doi:10.1111/j.1468-1331.2007.01974.x · Cited by 235
Severity of chronic pain and its relationship to quality of life in multiple sclerosis
Kalia, L. V., & O'Connor, P. W. (2005) · Multiple Sclerosis Journal · doi:10.1191/1352458505ms1168oa · Cited by 193
Suicide among Danes with multiple sclerosis
Brønnum‐Hansen, H. (2005) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.2004.056747 · Cited by 154
Johnson, G., Burvill, P. W., Anderson, C. S., Jamrozik, K. D., Stewart‐Wynne, E. G., & Chakera, T. M. H. (1995) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1995.tb09778.x · Cited by 151
The effects of anxiety on psychiatric morbidity in patients with multiple sclerosis
Feinstein, A., O'Connor, P., Gray, T., & Feinstein, K. (1999) · Multiple Sclerosis Journal · doi:10.1177/135245859900500504 · Cited by 147
Self-citationSchnoll, R. A., Harlow, L. L., Stolbach, L. L., & Brandt, U. (1998) · Psycho-Oncology · doi:10.1002/(sici)1099-1611(199803/04)7:2 · Cited by 133
Gold, S. M., Schulz, H., Mönch, A., Schulz, K., & Heesen, C. (2003) · Multiple Sclerosis Journal · doi:10.1191/1352458503ms927oa · Cited by 130
Identification of Beck Depression Inventory Items Related to Multiple Sclerosis
Mohr, D. C., Goodkin, D. E., Likosky, W., Beutler, L. E., Gatto, N. M., & Langan, M. K. (1997) · Journal of Behavioral Medicine · doi:10.1023/a:1025573315492 · Cited by 129
Galeazzi, G., Ferrari, S., Giaroli, G., Mackinnon, A., Merelli, E., Motti, L., & Rigatelli, M. (2005) · Neurological Sciences · doi:10.1007/s10072-005-0468-8 · Cited by 126
El-Rufaie, O. E. F., & Absood, G. H. (1995) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/bf00784431 · Cited by 119
Janssens, A. C., Buljevac, D., van Doorn, P. A., van der Meché, F. G., Polman, C. H., Passchier, J., & Hintzen, R. Q. (2006) · Multiple Sclerosis Journal · doi:10.1177/1352458506070935 · Cited by 107
Screening for psychiatric disorders in a lymphoma out-patient population
Razavi, D., Delvaux, N., Brédart, A., Paesmans, M., Debusscher, L., Bron, D., & Stryckmans, P. A. (1992) · European Journal of Cancer · doi:10.1016/0959-8049(92)90025-w · Cited by 70
Can mood disorder in women with breast cancer be identified preoperatively?
Ramirez, A., Richards, M., Jarrett, Sr., & Fentiman, I. (1995) · British Journal of Cancer · doi:10.1038/bjc.1995.538 · Cited by 67
Davies, K. N., Burn, W. K., McKenzie, F. R., Brothwell, J. A., & Wattis, J. P. (1993) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.930080209 · Cited by 66
Social anxiety in a multiple sclerosis clinic population
Poder, K., Ghatavi, K., Fisk, J. D., Tl, C., Kisely, S. R., Sarty, I., Stadnyk, K., & Bhan, V. (2008) · Multiple Sclerosis Journal · doi:10.1177/1352458508099143 · Cited by 57
Prevalence and Severity of Multiple-Sclerosis-Associated Fatigue in Treated and Untreated Patients
Putzki, N., Katsarava, Z., Vago, S., Diener, H., & Limmroth, V. (2007) · European Neurology · doi:10.1159/000111876 · Cited by 56
Hosaka, T., Awazu, H., Aoki, T., Okuyama, T., & Yamawaki, S. (1999) · International Journal of Psychiatry in Clinical Practice · doi:10.3109/13651509909024758 · Cited by 39
Neuropsychiatric syndromes associated with multiple sclerosis
Feinstein, A. (2007) · Journal of Neurology · doi:10.1007/s00415-007-2017-2 · Cited by 31
Self-citationRandolph, J. J., Arnett, P. A., Higginson, C. I., & Voss, W. D. (2000) · Archives of Clinical Neuropsychology · doi:10.1016/s0887-6177(99)00030-x · Cited by 28
Gramigna, S., Schluep, M., Staub, F., Bruggimann, L., Simioni, S., Bogousslavsky, J., & Annoni, J. (2007) · Revue Neurologique · doi:10.1016/s0035-3787(07)90406-3 · Cited by 15
Research works printed but not linked: 6
- Beck AT, 1996, Beck Depression Inventory (BDI)-II Manual
- Beck AT, 2000, BDI-Fast Screen for medical patients manual
- Randolph JJ, 2000, Arch Clin Neuropsychol, 15, 387
- First MB, 1994, Structured clinical interview for Axis 1 DSM-IV disorders - patient edition, SCID-I/P, Version 2.0
- American Psychiatric Association ., 1994, Diagnostic and statistical manual of mental disorder
- Lepine JP, 1986, Acta Psychiatr Belg, 86, 608
Cited by
Sorted by citations
The link between multiple sclerosis and depression
Feinstein, A., Magalhaes, S., Richard, J., Audet, B., & Moore, C. S. (2014) · Nature Reviews Neurology · doi:10.1038/nrneurol.2014.139 · Cited by 550
Self-citationRecommendations for cognitive screening and management in multiple sclerosis care
Kalb, R. C., Beier, M. L., Benedict, R. H. B., Charvet, L. E., Costello, K., Feinstein, A., Gingold, J. N., Goverover, Y., Halper, J., Harris, C. J., et al. (2018) · Multiple Sclerosis Journal · doi:10.1177/1352458518803785 · Cited by 413
“therapy) or for relapse recovery; (3) evaluate progression of cognitive impairment; and/or (4)”
BackgroundSelf-citationMultiple sclerosis and depression
Feinstein, A. (2011) · Multiple Sclerosis Journal · doi:10.1177/1352458511417835 · Cited by 337
“Examples of these are the Hospital Anxiety andDepression Scale and the BeckFast Screen for depression in medically ill patients, both of which have been validated for patients with multiple sclerosis.(12,13) Useful as they are for screening purposes and clinical trials, self-report questionnaires cannot generate a dia…”
MethodSelf-citationPrevalence and concurrence of anxiety, depression and fatigue over time in multiple sclerosis
Wood, B., van der Mei, I., Ponsonby, A.-L., Pittas, F., Quinn, S., Dwyer, T., Lucas, R., & Taylor, B. (2013) · Multiple Sclerosis Journal · doi:10.1177/1352458512450351 · Cited by 294
Health-related quality of life in multiple sclerosis
Berrigan, L. I., Fisk, J. D., Patten, S. B., Tremlett, H. L., Wolfson, C. M., Warren, S., Fiest, K. M., McKay, K. A., Marrie, R. A., For the CIHR Team in the Epidemiology and Impact of Comorbidity on Multiple Sclerosis (ECoMS), et al. (2016) · Neurology · doi:10.1212/wnl.0000000000002564 · Cited by 236
“7% for generalized anxiety disorder.(16) Fatigue was operationalized as the continuous total score on the Fatigue Impact Scale for Daily Use, a validated 8-item instrument.”
BackgroundMethodInfluential
Metadata
- Authors
- Honarmand, K., & Feinstein, A.
- Affiliations
- Sunnybrook Health Science Centre (CA)
- Venue
- Multiple Sclerosis Journal
- Publisher
- SAGE Publications
- Published
- 2009-11-13
- Volume
- 15
- Issue
- 12
- Pages
- 1518-1524
- ISSN
- 1352-4585 (ISSN-L)
- 1477-0970
- OpenAlex
- W2114728329
- Cited by
- 436
- References
- 43
- Citations by year
- 2026: 23 · 2025: 32 · 2024: 36 · 2023: 31 · 2022: 34 · 2021: 43 · 2020: 23 · 2019: 27 · 2018: 34 · 2017: 26 · 2016: 32 · 2015: 26 · 2014: 23 · 2013: 12 · 2012: 15
- FWCI
- 14.36
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Multiple Sclerosis Journal (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Multiple Sclerosis Society
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Clinical Neurology › Multiple Sclerosis Research Studies
- Health Sciences › Medicine › Oncology › Cancer survivorship and care
- Keywords
- Hospital Anxiety and Depression Scale, multiple sclerosis, depression, anxiety disorders, generalized anxiety disorder, psychometric validation, cut-off values, sensitivity and specificity, self-report scale
- MeSH terms
- Adolescent, Adult, Aged, Anxiety Disorders, Major Depressive Disorder, Female, Humans, Male, Middle Aged, Multiple Sclerosis, Predictive Value of Tests, Psychiatric Status Rating Scales, Surveys and Questionnaires, ROC Curve, Sensitivity and Specificity, Severity of Illness Index, Reproducibility of Results, Logistic Models, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
