The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Comparative validity of three screening questionnaires for DSM-IV depressive disorders and physicians? diagnoses
Abstract
Background The aim of this study was to compare the validity of the Hospital Anxiety and Depression Scale (HADS), the WHO (five) Well Being Index (WBI-5), the Patient Health Questionnaire (PHQ), and physicians' recognition of depressive disorders, and to recommend specific cut-off points for clinical decision making.Methods A total of 501 outpatients completed each of the three depression screening questionnaires and received the Structured Clinical Interview for DSM-IV (SCID) as the criterion standard. In addition, treating physicians were asked to give their psychiatric diagnoses. Criterion validity and Receiver Operating Characteristics (ROC) were determined. Areas under the curves (AUCs) were compared statistically.Results All depression scales showed excellent internal consistencies (Cronbach's alpha: 0.85-0.90). For 'major depressive disorder', the operating characteristics of the PHQ were significantly superior to both the HADS and the WBI-5. For 'any depressive disorder', the PHQ showed again the best operating characteristics but the overall difference did not reach statistical significance at the 5% level. Cut-off points that can be recommended for the screening of 'major depressive disorder' had sensitivities of 98% (PHQ), 94% (WBI-5), and 85% (HADS). Corresponding specificities were 80% (PHQ), 78% (WBI-5), and 76% (HADS). In contrast, physicians' recognition of 'major depressive disorder' was poor (sensitivity, 40%; specificity, 87%).Limitations Our sample may not be representative of medical outpatients, but sensitivity and specificity are independent of disorder prevalence.Conclusions All three questionnaires performed well in depression screening, but significant differences in criterion validity existed. These results may be helpful in the selection of questionnaires and cut-off points.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The PHQ-9 [81–83] is a 9-item questionnaire measuring the frequency of depression symptoms on a 4-point Likert scale (0 = not at all, 3 = almost every day) for the past week.”
In the citing paper
“Several studies support its validity in outpatient adult mental health settings, both as an initial screening tool and as a follow-up measure to monitor treatment progress. 22-25”
From Dialectical behaviour therapy skills training: A feasibility study with active duty military. (2022) · cites this paper as [23]
In the citing paper
“Previous studies of the PHQ-9 that examined psychometric properties have shown that all items load in one single factor and that it has an internal consistency with Cronbach's α of 0.79 to 0.89. 16,19,26”
From Comparison of two self-rating scales to detect depression: HADS and PHQ-9 (2009) · cites this paper as [16]
In the citing paper
“alternatively, the PHQ-9 scale may be over-inclusive, as indicated by, for example, Löwe et al . 16”
From Comparison of two self-rating scales to detect depression: HADS and PHQ-9 (2009) · cites this paper as [16]
In the citing paper
“However, some studies recommend a higher cut-off such as ≥ 11 or ≥ 12 to improve the balance between sensitivity and specificity. 16,24”
From Comparison of two self-rating scales to detect depression: HADS and PHQ-9 (2009) · cites this paper as [16]
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
The Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802
The validity of the Hospital Anxiety and Depression Scale
Bjelland, I., Dahl, A. A., Haug, T. T., & Neckelmann, D. (2002) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(01)00296-3 · Cited by 9,779
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Structured clinical interview for DSM-IV axis I disorders : SCID-I : clinical version : scoresheet
First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (1997) · American Psychiatric Press eBooks · Cited by 3,101
Herrmann, C. (1997) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)00216-4 · Cited by 2,885
The functioning and well-being of depressed patients. Results from the Medical Outcomes Study
Wells, K. B. (1989) · JAMA · doi:10.1001/jama.262.7.914 · Cited by 2,826
Utility of a new procedure for diagnosing mental disorders in primary care. The PRIME-MD 1000 study
Spitzer, R. L. (1994) · JAMA · doi:10.1001/jama.272.22.1749 · Cited by 2,648
SPINHOVEN, P., ORMEL, J., SLOEKERS, P. P. A., KEMPEN, G. I. J. M., SPECKENS, A. E. M., & HEMERT, A. M. V. (1997) · Psychological Medicine · doi:10.1017/s0033291796004382 · Cited by 2,158
The Functioning and Well-being of Depressed Patients: Results From the Medical Outcomes Study
Wells, K. B. (1989) · JAMA · doi:10.1001/jama.1989.03430070062031 · Cited by 2,130 · cited 2×
“…are associated with high levels of personal suffering, increased disability days, and elevated risk of cardiovascular mortality and suicide (Wells et al., 1989; Broadhead et al., 1990; Ormel et al., 1994; Simon et al., 1995; Frasure-Smith et al., 2000; Penninx et al., 2001; Posternak and…”
BackgroundCase-finding instruments for depression: Two questions are as good as many
Whooley, M. A., Avins, A. L., Miranda, J., & Browner, W. S. (1997) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1997.00076.x · Cited by 1,826
Depression, Disability Days, and Days Lost From Work in a Prospective Epidemiologic Survey
Broadhead, W. E. (1990) · JAMA · doi:10.1001/jama.1990.03450190056028 · Cited by 1,232
Depression and cardiac mortality: results from a community-based longitudinal study.
Penninx, B., Beekman, A., Honig, A., Deeg, D., Schoevers, R., van Eijk, J., & van Tilburg, W. V. (2001) · Archives of General Psychiatry · doi:10.1001/archpsyc.58.3.221 · Cited by 983
Bech, P., Rasmussen, N.-A., Olsen, L. R., Noerholm, V., & Abildgaard, W. (2001) · Journal of Affective Disorders · doi:10.1016/s0165-0327(00)00309-8 · Cited by 975
Mykletun, A., Stordal, E., & Dahl, A. A. (2001) · British Journal of Psychiatry · doi:10.1192/bjp.179.6.540 · Cited by 908 · cited 1×
“There is evidence for the two-factor structure of the instrument, although the two subscales are strongly intercorrelated (Spinhoven et al., 1997; Mykletun et al., 2001).”
BackgroundSpitzer, R. L., Williams, J. B. W., Kroenke, K., Hornyak, R., & McMurray, J. (2000) · American Journal of Obstetrics and Gynecology · doi:10.1067/mob.2000.106580 · Cited by 847 · cited 2×
“Since then, the PHQ has been used for the diagnosis and follow-up of psychiatric disorders in multiple studies (O’Malley et al., 2000; Spitzer et al., 2000; Johnson et al., 2001; Kroenke et al., 2001a).”
MethodOrmel, E. A. J. (1995) · PsycEXTRA Dataset · doi:10.1037/e536912011-072 · Cited by 706
Diez-Quevedo, C., Rangil, T., Sanchez-Planell, L., Kroenke, K., & Spitzer, R. L. (2001) · Psychosomatic Medicine · doi:10.1097/00006842-200107000-00021 · Cited by 649
Social Support, Depression, and Mortality During the First Year After Myocardial Infarction
Frasure-Smith, N., Lespérance, F., Gravel, G., Masson, A., Juneau, M., Talajic, M., & Bourassa, M. G. (2000) · Circulation · doi:10.1161/01.cir.101.16.1919 · Cited by 632
Health care costs associated with depressive and anxiety disorders in primary care
(1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.3.352 · Cited by 555 · cited 2×
“…associated with high levels of personal suffering, increased disability days, and elevated risk of cardiovascular mortality and suicide (Wells et al., 1989; Broadhead et al., 1990; Ormel et al., 1994; Simon et al., 1995; Frasure-Smith et al., 2000; Penninx et al., 2001; Posternak and Miller, 2001).”
BackgroundThe WHO (Ten) Well-Being Index: Validation in Diabetes
Bech, P., Gudex, C. M., & Johansen, S. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000289073 · Cited by 531
Screening for Depression: Recommendations and Rationale
U.S. Preventive Services Task Force* (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-10-200205210-00012 · Cited by 524
Svanborg, P., & Åsberg, M. (2001) · Journal of Affective Disorders · doi:10.1016/s0165-0327(00)00242-1 · Cited by 481
Bracken, B. A., & Barona, A. (1991) · School Psychology International · doi:10.1177/0143034391121010 · Cited by 469
Williams, Jr., Barrett, J., Oxman, T., Frank, E., Katon, W., Sullivan, M., Cornell, J., & Sengupta, A. (2000) · JAMA · doi:10.1001/jama.284.12.1519 · Cited by 460
Case-Finding Instruments for Depression in Primary Care Settings
Mulrow, C. D., Williams, J. W., Gerety, M. B., Ramirez, G., Montiel, O. M., & Kerber, C. (1995) · Annals of Internal Medicine · doi:10.7326/0003-4819-122-12-199506150-00004 · Cited by 456
Treating Major Depression in Primary Care Practice
Schulberg, H. C., Katon, W. J., Simon, G. E., & Rush, A. J. (1998) · Archives of General Psychiatry · doi:10.1001/archpsyc.55.12.1121 · Cited by 455
Depression in Ambulatory Medical Patients
Nielsen, A. C. (1980) · Archives of General Psychiatry · doi:10.1001/archpsyc.1980.01780220037003 · Cited by 421
Recognition, Management, and Course of Anxiety and Depression in General Practice
Ormel, J. (1991) · Archives of General Psychiatry · doi:10.1001/archpsyc.1991.01810320024004 · Cited by 375
Managing Depression in Medical Outpatients
Whooley, M. A., & Simon, G. E. (2000) · New England Journal of Medicine · doi:10.1056/nejm200012283432607 · Cited by 374
Depression in Medical Outpatients
Pérez‐Stable, E. J. (1990) · Archives of Internal Medicine · doi:10.1001/archinte.1990.00390170113024 · Cited by 351
Similar Effectiveness of Paroxetine, Fluoxetine, and Sertraline in Primary Care
Kroenke, K., West, S. L., Swindle, R. W., Gilsenan, A., Eckert, G. J., Dolor, R. J., Stang, P., Zhou, X., Hays, R. D., & Weinberger, M. (2001) · JAMA · doi:10.1001/jama.286.23.2947 · Cited by 310
Jarrett, R., Kraft, D., Doyle, J., Foster, B. M., Eaves, G., & Silver, P. (2001) · Archives of General Psychiatry · doi:10.1001/archpsyc.58.4.381 · Cited by 278
The Cost–Utility of Screening for Depression in Primary Care
Valenstein, M., Vijan, S., Zeber, J. E., Boehm, K., & Buttar, A. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-5-200103060-00007 · Cited by 268
Johnson, J. G., Spitzer, R. L., & Williams, J. B. W. (2001) · Psychological Medicine · doi:10.1017/s0033291701004640 · Cited by 253
Two Questions Are as Good as Many
Whooley, M. A., Avins, A. L., Miranda, J. M., & Browner, W. S. (1997) · Cited by 248
Strik, J. J. M. H., Honig, A., Lousberg, R. L., & Denollet, J. (2001) · Psychosomatics · doi:10.1176/appi.psy.42.5.423 · Cited by 244
Treating Depressed Primary Care Patients Improves Their Physical, Mental, and Social Functioning
Coulehan, J. L. (1997) · Archives of Internal Medicine · doi:10.1001/archinte.1997.00440310079008 · Cited by 224
Case-finding for depression in primary care: a randomized trial∗
Williams, J. W., Mulrow, C. D., Kroenke, K., Dhanda, R., Badgett, R. G., Omori, D., & Lee, S. (1999) · The American Journal of Medicine · doi:10.1016/s0002-9343(98)00371-4 · Cited by 221
Posternak, M. A., & Miller, I. (2001) · Journal of Affective Disorders · doi:10.1016/s0165-0327(00)00304-9 · Cited by 215 · cited 2×
“…associated with high levels of personal suffering, increased disability days, and elevated risk of cardiovascular mortality and suicide (Wells et al., 1989; Broadhead et al., 1990; Ormel et al., 1994; Simon et al., 1995; Frasure-Smith et al., 2000; Penninx et al., 2001; Posternak and Miller, 2001).”
Background(1997) · PubMed · Cited by 211
Mental disorders among internal medical inpatients
Hansen, M. S., Fink, P., Frydenberg, M., Oxhøj, M.-L., Søndergaard, L., & Munk‐Jørgensen, P. (2001) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(00)00230-0 · Cited by 173
Internal and external validity of the WHO Well‐Being Scale in the elderly general population
Heun, R., Burkart, M., Maier, W., & Bech, P. (1999) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1999.tb00973.x · Cited by 160
Intervention for minor depression in primary care patients.
de Miranda, J. V. M., & Muñoz, R. F. (1994) · Psychosomatic Medicine · doi:10.1097/00006842-199403000-00009 · Cited by 121
Lack of Correlation between Psychological Factors and Subclinical Coronary Artery Disease
O’Malley, P. G., Jones, D. L., Feuerstein, I. M., & Taylor, A. J. (2000) · New England Journal of Medicine · doi:10.1056/nejm200011023431803 · Cited by 119
Measuring the potency of risk factors for clinical or policy significance.
KRAEMER, H. C., Kazdin, A. E., Offord, D. R., Kessler, R. C., Jensen, P. S., & Kupfer, D. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.257 · Cited by 112
Screening for Depression in the Medically Ill
Meakin, C. (1992) · The British Journal of Psychiatry · doi:10.1192/bjp.160.2.212 · Cited by 71
Depression Screening Is Not Enough
Kroenke, K. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-5-200103060-00014 · Cited by 51
Depression Is Still Underrecognized and Undertreated
Gelenberg, A. J. (1999) · Archives of Internal Medicine · doi:10.1001/archinte.159.15.1657 · Cited by 21
Cited by
Sorted by citations
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Self-citationThe WHO-5 well-being index: A systematic review of the literature
Topp, C. W., Østergaard, S. D., Søndergaard, S., & Bech, P. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000376585 · Cited by 4,708
Combat Duty in Iraq and Afghanistan, Mental Health Problems, and Barriers to Care
Hoge, C. W., Castro, C. A., Messer, S. C., McGurk, D., Cotting, D. I., & Koffman, R. L. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa040603 · Cited by 4,778
Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008) · Medical Care · doi:10.1097/mlr.0b013e318160d093 · Cited by 4,527
Self-citationKroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057
Metadata
- Authors
- LOWE, B.
- Venue
- Journal of Affective Disorders
- Publisher
- Elsevier BV
- Published
- 2004-02
- Volume
- 78
- Issue
- 2
- Pages
- 131-140
- ISSN
- 0165-0327 (ISSN-L)
- OpenAlex
- W2087381130
- Cited by
- 1,060
- References
- 52
- Citations by year
- 2026: 24 · 2025: 32 · 2024: 50 · 2023: 52 · 2022: 48 · 2021: 44 · 2020: 44 · 2019: 47 · 2018: 45 · 2017: 52 · 2016: 49 · 2015: 60 · 2014: 47 · 2013: 63 · 2012: 65
- FWCI
- 19.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Affective Disorders (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Pfizer
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Keywords
- depression screening, major depressive disorder, Patient Health Questionnaire, Hospital Anxiety and Depression Scale, physician diagnosis, criterion validity, cut-off values, sensitivity and specificity, outpatients
- MeSH terms
- Adolescent, Adult, Depressive Disorder, Humans, Mass Screening, Primary Health Care, Surveys and Questionnaires, ROC Curve, Sensitivity and Specificity, Reproducibility of Results, Diagnostic Techniques and Procedures, Diagnostic and Statistical Manual of Mental Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
