The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Diagnostic accuracy of the mood module of the Patient Health Questionnaire: a systematic review
Abstract
Objective The nine-item mood module of the Patient Health Questionnaire (PHQ-9) was developed to screen and to diagnose patients in primary care with depressive disorders. We systematically reviewed the psychometric literature on the PHQ-9 and performed a meta-analysis to ascertain its summary sensitivity and specificity.Methods EMBASE, PubMed and PsycINFO were used to search literature up to July 2006. Studies were included if (1) they investigated the diagnostic accuracy of the PHQ-9 and (2) the PHQ-9 had been compared with a reference test. The quality of the studies was appraised using the Quality Assessment of Diagnostic Accuracy Studies. We calculated sensitivity, specificity and confidence intervals for each included study. We used the random effects model to calculate the summary sensitivity and specificity.Results We found a sensitivity of 0.77 (0.71-0.84) and a specificity of 0.94 (0.90-0.97) for the PHQ-9. The positive predictive value in an unselected primary care population was 59%, which increased to 85-90% when the prior probability increased to 30-40%.Conclusion In primary care, the PHQ-9 is a valid diagnostic tool if used in selected subgroups of patients with a high prevalence of depressive disorder.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although the PHQ-9 is generally well validated and commonly used in primary care (Wittkampf et al. , 2007)”
From Do depressed and anxious men do groups? What works and what are the barriers to help seeking? (2014) · cites this paper as Wittkampf et al. , 2007
In the citing paper
“Earlier studies in primary care show that PHQ-9 detects depression with a sensitivity around 90% and a specificity ranging from 77% to 88% when using the cut-off ≥ 10. 15,17,23,24”
From Comparison of two self-rating scales to detect depression: HADS and PHQ-9 (2009) · cites this paper as [23]
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802
Whiting, P., Rutjes, A. W., Reitsma, J. B., Bossuyt, P. M., & Kleijnen, J. (2003) · BMC Medical Research Methodology · doi:10.1186/1471-2288-3-25 · Cited by 3,592
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369 · cited 2×
“[28] developed the bivariate meta-regression model to incorporate this relationship in calculating the summary sensitivity and specificity.”
MethodUtility of a new procedure for diagnosing mental disorders in primary care. The PRIME-MD 1000 study
Spitzer, R. L. (1994) · JAMA · doi:10.1001/jama.272.22.1749 · Cited by 2,648
LOWE, B. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00237-9 · Cited by 1,060
Screening psychischer Störungen mit dem “Gesundheitsfragebogen für Patienten (PHQ-D)“
Gräfe, K., Zipfel, S., Herzog, W., & Löwe, B. (2004) · Diagnostica · doi:10.1026/0012-1924.50.4.171 · Cited by 805
Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Weswood, M. E., Rutjes, A. W., Reitsma, J. B., Bossuyt, P. M., & Kleijnen, J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-9 · Cited by 767
Diez-Quevedo, C., Rangil, T., Sanchez-Planell, L., Kroenke, K., & Spitzer, R. L. (2001) · Psychosomatic Medicine · doi:10.1097/00006842-200107000-00021 · Cited by 649
Thompson, C., Kinmonth, A., Stevens, L., Pevele, R., Stevens, A., Ostler, K., Pickering, R., Baker, N., Henson, A., Preece, J., et al. (2000) · The Lancet · doi:10.1016/s0140-6736(99)03171-2 · Cited by 489
Meta-analytic methods for diagnostic test accuracy
Irwig, L., Macaskill, P., Glasziou, P., & Fahey, M. T. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00099-c · Cited by 467
Performance of the PHQ-9 as a screening tool for depression after stroke
Williams, L. S., Brizendine, E. J., Plue, L., Bakas, T., Tu, W., Hendrie, H., & Kroenke, K. (2005) · Stroke · doi:10.1161/01.str.0000155688.18207.33 · Cited by 397
Validation of 2 Depression Screening Tools in Dialysis Patients
Watnick, S. G., Wang, P.-L., Demadura, T. L., & Ganzini, L. K. (2005) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2005.08.006 · Cited by 324
Identifying depression in primary care: a literature synthesis of case-finding instruments
Williams, J. W., Pignone, M. P., Ramı́rez, G., & Stellato, C. P. (2002) · General Hospital Psychiatry · doi:10.1016/s0163-8343(02)00195-0 · Cited by 288
McManus, D. D., Pipkin, S. S., & Whooley, M. A. (2005) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2005.06.037 · Cited by 226
(1997) · PubMed · Cited by 211
Becker, S., Al Zaid, K., & Al Faris, E. (2002) · The International Journal of Psychiatry in Medicine · doi:10.2190/xtdd-8l18-p9e0-jyrv · Cited by 190 · cited 1×
“Nowadays, the PHQ is used all over the world and has been translated into more than 25 languages, including German [8], French [9], Spanish [10], Italian [11], Arabic [12], Bengali [13], Turkish [14], Flemish [15] and Dutch [16].”
BackgroundChallenges in Systematic Reviews of Diagnostic Technologies
Tatsioni, A., Zarin, D. A., Aronson, N., Samson, D. J., Flamm, C. R., Schmid, C. H., & Lau, J. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-12_part_2-200506211-00004 · Cited by 170
Systematic review and evaluation of methods of assessing urinary incontinence
Martin, J., Williams, K., Abrams, K. R., Turner, D., Sutton, A. J., Chapple, C. R., Assassa, R. P., Shaw, C., & Cheater, F. (2006) · Health Technology Assessment · doi:10.3310/hta10060 · Cited by 164
The Defeat Depression Campaign: psychiatry in the public arena
(1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.6.59 · Cited by 154
Frequent consulters in general practice
Gill, D. M., & Sharpe, M. (1999) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(98)00118-4 · Cited by 141
The overdiagnosis of depression in non-depressed patients in primary care
Aragonès, E. (2006) · Family Practice · doi:10.1093/fampra/cmi120 · Cited by 90
How does study quality affect the results of a diagnostic meta-analysis?
Westwood, M. E., Whiting, P. F., & Kleijnen, J. (2005) · BMC Medical Research Methodology · doi:10.1186/1471-2288-5-20 · Cited by 87
Systematic reviews of diagnostic test evaluations: what's behind the scenes?
Pai, M. (2004) · BMJ Evidence-Based Medicine · doi:10.1136/ebm.9.4.101 · Cited by 85
Persoons, P., Luyckx, K., Desloovere, C., Vandenberghe, J. U., & Fischler, B. (2003) · General Hospital Psychiatry · doi:10.1016/s0163-8343(03)00072-0 · Cited by 83
Bengali adaptation of brief patient health questionnaire for screening depression at primary care.
Chowdhury, A. N., Ghosh, S., & Sanyal, D. (2004) · PubMed · Cited by 71
Screening for depressive disorders in patients with skin diseases: a comparison of three screeners
Picardi, A., Adler, D., Abeni, D., Chang, H., Pasquini, P., Rogers, W., & Bungay, K. (2005) · Acta Dermato Venereologica · doi:10.1080/00015550510034966 · Cited by 62
Does This Patient Have an Instability of the Shoulder or a Labrum Lesion?
Luime, J. J. (2004) · JAMA · doi:10.1001/jama.292.16.1989 · Cited by 59
Systematic reviews of diagnostic test evaluations: What's behind the scenes?
Pai, M., Michael McCulloch, L., Wayne Enanoria, M., & John M. Colford Jr., M. (2004) · ACP Journal Club · doi:10.7326/acpjc-2004-141-1-a11 · Cited by 43
Hollerwöger, D. (2006) · Manual Therapy · doi:10.1016/j.math.2005.12.001 · Cited by 37
Bronzite, M. (2000) · Springer eBooks · doi:10.1007/978-1-4471-0469-8_2 · Cited by 36
Somatisation in primary care: clinical judgement and standardised measurement compared
Schilte, A. F., Portegijs, P. J. M., Blankenstein, A. H., & Knottnerus, J. A. (2000) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s001270050239 · Cited by 34
Çorapçıoğlu, A., & Özer, G. U. (2004) · International Journal of Psychiatry in Clinical Practice · doi:10.1080/13651500310004452 · Cited by 30
Schreuders, B., van Oppen, P., van Marwijk, H., Smit, J. H., & Stalman, W. A. B. (2005) · BMC Family Practice · doi:10.1186/1471-2296-6-42 · Cited by 26
Procalcitonin as a marker of postoperative complications
Boysen, A., Madsen, J. S., & Jørgensen, P. E. (2005) · Scandinavian Journal of Clinical and Laboratory Investigation · doi:10.1080/00365510510025755 · Cited by 11
Questionnaires for depression and anxiety
Pignone, M. P., Gaynes, B. N., Lohr, K. N., Orleans, C. T., & Mulrow, C. D. (2001) · BMJ · doi:10.1136/bmj.323.7305.167/b · Cited by 5
Questionnaires for depression and anxiety. Routine screening entails additional pitfalls.
Coyne, J. C., Palmer, S., & Thompson, R. (2001) · PubMed · Cited by 4
[Quick detection of depression: a significant clinical issue].
Dumont, P., Andreoli, A. L., Borgacci, S., Carballeira, Y., Rentsch, D., Tonnac, N. D., & Archinard, M. (2005) · PubMed · Cited by 3
Détection rapide de la dépression : un problème important
Dumont, P., Andreoli, A., Borgacci, S., Carballeira, Y., et, D. R., Tonnac, N. D., & Archinard, M. (2005) · JMIG · doi:10.53738/revmed.2005.1.5.0344 · Cited by 1
Flagged first, then by citations
Research works printed but not linked: 1
- Mazzotti, 2003, The Patient Health Questionnaire (PHQ) for the screening of psychiatric disorders: a validation study versus the Structured Clinical Interview for DSM-IV Axis I (SCID-I), Ital J Psychopathol, 9, 235
Cited by
Sorted by citations
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057
Manea, L., Gilbody, S., & McMillan, D. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.110829 · Cited by 1,966
Levis, B., Benedetti, A., & Thombs, B. D. (2019) · BMJ · doi:10.1136/bmj.l1476 · Cited by 1,718
Zhou, S.-J., Zhang, L.-G., Wang, L.-L., Guo, Z.-C., Wang, J.-Q., Chen, J.-C., Liu, M., Chen, X., & Chen, J.-X. (2020) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-020-01541-4 · Cited by 1,464
Wang, W., Bian, Q., Zhao, Y., Li, X., Wang, W., Du, J., Zhang, G., Zhou, Q., & Zhao, M. (2014) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2014.05.021 · Cited by 1,480
Metadata
- Authors
- Wittkampf, K. A., Naeije, L., Schene, A. H., Huyser, J., & van Weert, H. C.
- Affiliations
- Amsterdam UMC Location University of Amsterdam (NL)
- Corresponding author
- Wittkampf, Karin A.
- Venue
- General Hospital Psychiatry
- Publisher
- Elsevier BV
- Published
- 2007-09
- Volume
- 29
- Issue
- 5
- Pages
- 388-395
- ISSN
- 0163-8343 (ISSN-L)
- OpenAlex
- W2055505621
- Cited by
- 493
- References
- 40
- Citations by year
- 2026: 17 · 2025: 21 · 2024: 14 · 2023: 13 · 2022: 32 · 2021: 41 · 2020: 40 · 2019: 22 · 2018: 29 · 2017: 21 · 2016: 43 · 2015: 31 · 2014: 41 · 2013: 23 · 2012: 29
- FWCI
- 2.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- General Hospital Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Keywords
- PHQ-9, Patient Health Questionnaire, depressive disorders, diagnostic accuracy, sensitivity and specificity, primary care, depression screening, positive predictive value, prior probability
- MeSH terms
- Depression, Diagnostic Errors, Humans, Netherlands, Primary Health Care, Psychometrics, Surveys and Questionnaires
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
