The DOI matches its Crossref record; 20 of the 21 references it cites were found in a registry or an index.
The accuracy of Patient Health Questionnaire-9 in detecting depression and measuring depression severity in high-risk groups in primary care
Abstract
Objective Only half of patients with depressive disorder are diagnosed by their family physicians. Screening in high-risk groups might reduce this hidden morbidity. This study aims to determine the accuracy of the Patient Health Questionnaire-9 (PHQ-9) in (a) screening for depressive disorder, (b) diagnosing depressive disorder and (c) measuring the severity of depressive disorder in groups that are at high risk for depressive disorder.Method We compared the performance of the PHQ-9 as a screening instrument and as a diagnostic instrument to that of the Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I) interview, which we used as reference standard. Three high-risk groups of patients were selected: (a) frequent attenders, (b) patients with mental health problems and (c) patients with unexplained complaints. Patients completed the PHQ-9. Next, patients who were at risk for depression (based on PHQ scores) and a random sample of 20% of patients who were not at risk were selected for a second PHQ-9 and the reference standard (SCID-I). We assessed the adequacy of the PHQ-9 as a tool for severity measurement by comparing PHQ-9 scores with scores on the 17-item Hamilton Depression Rating Scale (HDRS-17) in patients diagnosed with a depressive disorder.Results Among 440 patients, both PHQ-9 and SCID-I were analyzed. The test characteristics for screening were sensitivity=0.93 and specificity=0.85; those for diagnosing were sensitivity=0.68 and specificity=0.95. The positive likelihood ratio for diagnosing was 14.2. The HDRS-17 was administered in 49 patients with depressive disorder. The Pearson correlation coefficient of the PHQ-9 to the HDRS-17 was r=.52 (P<.01).Conclusion The PHQ-9 performs well as a screening instrument, but in diagnosing depressive disorder, a formal diagnostic process following the PHQ-9 remains imperative. The PHQ-9 does not seem adequate for measuring severity.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The PHQ-9 and GAD-7 have strong internal and test-retest reliability as well as construct and factor-structure validity.20”
From Patient Health Questionnaire Anxiety and Depression Scale: Initial Validation in Three Clinical Trials (2016) · cites this paper as [20]
In the citing paper
“Moreover, both measures have proven sensitive to change when monitoring treatment response.20;33-36”
From Patient Health Questionnaire Anxiety and Depression Scale: Initial Validation in Three Clinical Trials (2016) · cites this paper as [20]
In the citing paper
“The Patient Health Questionnaire 9-item depression scale (PHQ-9) and 7-item Generalized Anxiety Disorder scale (GAD-7) are among the best validated and most commonly used depression and anxiety measures, respectively.20-25”
From Patient Health Questionnaire Anxiety and Depression Scale: Initial Validation in Three Clinical Trials (2016) · cites this paper as [20]
Citations
Cites
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802
Development of a Rating Scale for Primary Depressive Illness
Hamilton, M. (1967) · British Journal of Social and Clinical Psychology · doi:10.1111/j.2044-8260.1967.tb00530.x · Cited by 8,410
The Structured Clinical Interview for DSM-III-R (SCID): I: History, Rationale, and Description
Spitzer, R. L. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820080032005 · Cited by 4,336
The Statistical Evaluation of Medical Tests for Classification and Prediction
PEPE, M. S. (2003) · doi:10.1093/oso/9780198509844.001.0001 · Cited by 2,206
The Statistical Evaluation of Medical Tests for Classification and Prediction
PEPE, M. S. (2005) · Technometrics · doi:10.1198/tech.2005.s278 · Cited by 1,907
Gilbody, S., Richards, D., Brealey, S., & Hewitt, C. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0333-y · Cited by 1,290
LOWE, B. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00237-9 · Cited by 1,060
Psychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care
Cameron, I. M., Crawford, J. R., Lawton, K., & Reid, I. C. (2008) · British Journal of General Practice · doi:10.3399/bjgp08x263794 · Cited by 590
Diagnostic accuracy of the mood module of the patient health questionnaire: a systematic review
Wittkampf, K. A., Naeije, L., Schene, A. H., Huyser, J., & van Weert, H. C. (2007) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2007.06.004 · Cited by 493
Identifying depression in primary care: a literature synthesis of case-finding instruments
Williams, J. W., Pignone, M. P., Ramı́rez, G., & Stellato, C. P. (2002) · General Hospital Psychiatry · doi:10.1016/s0163-8343(02)00195-0 · Cited by 288
Two-phase epidemiological surveys in psychiatric research
Dunn, G., Pickles, A. R., Tansella, M., & Vázquez‐Barquero, J. L. (1999) · The British Journal of Psychiatry · doi:10.1192/bjp.174.2.95 · Cited by 266
Telephone assessment of depression severity
Simon, G. E., Revicki, D. A., & VonKorff, M. (1993) · Journal of Psychiatric Research · doi:10.1016/0022-3956(93)90035-z · Cited by 219
Screening and case finding instruments for depression
Gilbody, S., House, A., & Sheldon, T. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002792.pub2 · Cited by 205
Should we screen for depression?
Gilbody, S. M., Sheldon, T., & Wessely, S. C. (2006) · BMJ · doi:10.1136/bmj.332.7548.1027 · Cited by 195
Screening for depression in high-risk groups: prospective cohort study in general practice
Baas, K. D., Wittkampf, K. A., van Weert, H. C. P. M., Lucassen, P. L., Huyser, J., van den Hoogen, H., van de Lisdonk, E., Bindels, P., Bockting, C., Ruhé, H. G., et al. (2009) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.107.046052 · Cited by 42
Self-citationShould general practitioners be testing for depression?
Wright, A. F. (1994) · Europe PMC (PubMed Central) · Cited by 33
Inducing Sustainable Improvement in Depression Care in Primary Care Practices
Nease, D. E., Nutting, P. A., Dickinson, W. P., Bonham, A. J., Graham, D. G., Gallagher, K. M., & Main, D. S. (2008) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(08)34031-8 · Cited by 24
Howe, A. C., Parry, G. D., Pickvance, D., & Hockley, B. (2002) · Europe PMC (PubMed Central) · Cited by 23
Detecting and describing heterogeneity in meta-analysis
Hardy, R. J., & Thompson, S. G. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980430)17:8
Research works printed but not linked: 1
- NICE, 2004, 23, 1
Cited by
Sorted by citations
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057
Manea, L., Gilbody, S., & McMillan, D. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.110829 · Cited by 1,966
Kroenke, K., Wu, J., Yu, Z., Bair, M. J., Kean, J., Stump, T., & Monahan, P. O. (2016) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000322 · Cited by 504
Moriarty, A. S., Gilbody, S., McMillan, D., & Manea, L. (2015) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.06.012 · Cited by 372
Fisher, L., Glasgow, R. E., & Strycker, L. A. (2010) · Diabetes Care · doi:10.2337/dc09-2175 · Cited by 351
Metadata
- Authors
- Wittkampf, K., van Ravesteijn, H., Baas, K., van de Hoogen, H., Schene, A., Bindels, P., Lucassen, P., van de Lisdonk, E., & van Weert, H.
- Affiliations
- Amsterdam UMC Location University of Amsterdam (NL)
- Radboud University Nijmegen (NL)
- Corresponding author
- Wittkampf, Karin
- Venue
- General Hospital Psychiatry
- Publisher
- Elsevier BV
- Published
- 2009-09
- Volume
- 31
- Issue
- 5
- Pages
- 451-459
- ISSN
- 0163-8343 (ISSN-L)
- OpenAlex
- W2149482727
- Cited by
- 126
- References
- 21
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 7 · 2023: 2 · 2022: 7 · 2021: 10 · 2020: 6 · 2019: 11 · 2018: 4 · 2017: 5 · 2016: 8 · 2015: 11 · 2014: 7 · 2013: 14 · 2012: 6
- FWCI
- 10.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- General Hospital Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Pure Amsterdam UMC (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Funders
- Radboud Universitair Medisch Centrum
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Keywords
- PHQ-9, depression screening, depression severity measurement, high-risk groups, primary care, frequent attenders, SCID-I, Hamilton Depression Rating Scale, diagnostic accuracy, sensitivity and specificity
- MeSH terms
- Depression, Female, Humans, Male, Mass Screening, Middle Aged, Netherlands, Primary Health Care, Surveys and Questionnaires, Sensitivity and Specificity, Severity of Illness Index
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review