Diagnosing ICD-10 Depressive Episodes: Superior Criterion Validity of the Patient Health Questionnaire
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Background: Diagnosing and monitoring depression in primary care remains an issue of significant public health concern. Clinicians and researchers need to know if any one screening instrument is superior to the others in diagnosing ICD-10 depressive episodes. This study aimed to examine the criterion validity for diagnosing ICD-10 depressive episodes of the Patient Health Questionnaire (PHQ) in comparison with 2 well-established instruments, the Hospital Anxiety and Depression Scale (HADS), and the WHO Well-Being Index 5 (WBI-5). Methods: Five hundred and one medical outpatients completed the questionnaires and had a clinical interview. The presence of a depressive episode was determined with the International Diagnostic Checklists (IDCL) for ICD-10 as the criterion standard. Coefficient kappa (ĸ), sensitivities and specificities were calculated and a statistical comparison of the areas under the receiver operating characteristic curves was performed. Results: Diagnostic agreement between the questionnaires and the IDCL was moderate (ĸ = 0.34–0.56), with the highest values for the PHQ. While all 3 questionnaires had reasonable sensitivity and specificity, the operating characteristics for the PHQ were significantly superior to both the HADS and the WBI-5 (p = 0.02). Conclusions: Any of the 3 screening instruments can be recommended for clinical use. However, this is the first comparative study to demonstrate the diagnostic advantage of a particular depression-screening instrument using the ICD-10 diagnostic criteria. The superior criterion validity of the PHQ is likely attributable to its closer representation of the current concept of depressive disorders.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The PHQ-9 has demonstrated good sensitivity, specificity, and convergent validity [49,50].”
In the citing paper
“Earlier studies in primary care show that PHQ-9 detects depression with a sensitivity around 90% and a specificity ranging from 77% to 88% when using the cut-off ≥ 10. 15,17,23,24”
From Comparison of two self-rating scales to detect depression: HADS and PHQ-9 (2009) · cites this paper as [17]
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
The Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802
LOWE, B. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00237-9 · Cited by 1,060
Self-citationMünster, R. D. (1999) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026//0084-5345.28.1.68 · Cited by 1,010
Ormel, E. A. (1995) · PsycEXTRA Dataset · doi:10.1037/e536912011-072 · Cited by 706
Screening for Depression: Recommendations and Rationale
U.S. Preventive Services Task Force* (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-10-200205210-00012 · Cited by 526
Depression in Medical Outpatients: Underrecognition and Misdiagnosis
Pérez-Stable, E. J. (1990) · Archives of Internal Medicine · doi:10.1001/archinte.1990.00390170113024 · Cited by 350
Getting What You Ask For: On the Selectivity of Depression Rating Scales
Demyttenaere, K., & De Fruyt, J. (2003) · Psychotherapy and Psychosomatics · doi:10.1159/000068690 · Cited by 206 · cited 1×
“to assess depression severity, and to monitor patients already identified as depressed and receiving treatment.While theories and diagnostic criteria of depressive disorders have changed, diagnostic instruments for depression have remained relatively unaltered for the past 20 years [”
BackgroundJanča, A., & Hiller, W. F. A. (1996) · Comprehensive Psychiatry · doi:10.1016/s0010-440x(96)90034-6 · Cited by 81
Predictors of Psychiatric Comorbidity in Medical Outpatients
Löwe, B., Gräfe, K., Kroenke, K., Zipfel, S., Quenter, A., Wild, B., Fiehn, C., & Herzog, W. (2003) · Psychosomatic Medicine · doi:10.1097/01.psy.0000079379.39918.17 · Cited by 59
Self-citation
Research works printed but not linked: 1
- 10.1001/jama.272.22.1741 · DOI · Paper page
Cited by
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Self-citationLöwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008) · Medical Care · doi:10.1097/mlr.0b013e318160d093 · Cited by 4,527
Self-citationLöwe, B., Wahl, I., Rose, M., Spitzer, C., Glaesmer, H., Wingenfeld, K., Schneider, A., & Brähler, E. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.06.019 · Cited by 2,473
Self-citationPrevalence and correlates of depression, anxiety, and suicidality among university students
Eisenberg, D., Gollust, S. E., Golberstein, E., & Hefner, J. L. (2007) · American Journal of Orthopsychiatry · doi:10.1037/0002-9432.77.4.534 · Cited by 1,592
Detecting and monitoring depression with a two-item questionnaire (PHQ-2)
Löwe, B., Kroenke, K., & Gräfe, K. (2005) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2004.09.006 · Cited by 1,473
“Recent studies have shown the validity of the German PHQ [8–11,13,20]; furthermore, results from the German and American PHQ validation studies are similar with respect to criterion validity, construct validity, internal consistency, sensitivity to change, and recommended cut-off scores [6–8,10–12].”
ResultSelf-citation
Metadata
- Authors
- Löwe, B., Gräfe, K., Zipfel, S., Witte, S., Loerch, B., & Herzog, W.
- Affiliations
- Regenstrief Institute (US)
- Heidelberg University (DE)
- Venue
- Psychotherapy and Psychosomatics
- Publisher
- S. Karger AG
- Published
- 2004
- Volume
- 73
- Issue
- 6
- Pages
- 386-390
- ISSN
- 0033-3190 (ISSN-L)
- 1423-0348
- OpenAlex
- W2024751320
- Cited by
- 301
- References
- 14
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 8 · 2023: 11 · 2022: 11 · 2021: 19 · 2020: 10 · 2019: 19 · 2018: 19 · 2017: 17 · 2016: 12 · 2015: 18 · 2014: 15 · 2013: 18 · 2012: 10
- FWCI
- 18.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.karger.com/Services/SiteLicenses (vor)
- www.karger.com/Services/SiteLicenses (tdm)
- Locations
- Psychotherapy and Psychosomatics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Pfizer
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- depressive episodes, depression screening, Patient Health Questionnaire, ICD-10 diagnostic criteria, criterion validity, Hospital Anxiety and Depression Scale, primary care, diagnostic agreement, sensitivity and specificity
- MeSH terms
- Adult, Depressive Disorder, Diagnosis, Differential, Female, Humans, Male, Middle Aged, Primary Health Care, Psychiatric Status Rating Scales, Surveys and Questionnaires
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.