The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Accuracy of the Patient Health Questionnaire-9 for screening to detect major depression: updated systematic review and individual participant data meta-analysis
Open accessAbstract
Objective: To update a previous individual participant data meta-analysis and determine the accuracy of the Patient Health Questionnaire-9 (PHQ-9), the most commonly used depression screening tool in general practice, for detecting major depression overall and by study or participant subgroups. Design: Systematic review and individual participant data meta-analysis. Data sources: Medline, Medline In-Process, and Other Non-Indexed Citations via Ovid, PsycINFO, Web of Science searched through 9 May 2018. Review methods: Eligible studies administered the PHQ-9 and classified current major depression status using a validated semistructured diagnostic interview (designed for clinician administration), fully structured interview (designed for lay administration), or the Mini International Neuropsychiatric Interview (MINI; a brief interview designed for lay administration). A bivariate random effects meta-analytic model was used to obtain point and interval estimates of pooled PHQ-9 sensitivity and specificity at cut-off values 5-15, separately, among studies that used semistructured diagnostic interviews (eg, Structured Clinical Interview for Diagnostic and Statistical Manual), fully structured interviews (eg, Composite International Diagnostic Interview), and the MINI. Meta-regression was used to investigate whether PHQ-9 accuracy correlated with reference standard categories and participant characteristics. Results: Data from 44 503 total participants (27 146 additional from the update) were obtained from 100 of 127 eligible studies (42 additional studies; 79% eligible studies; 86% eligible participants). Among studies with a semistructured interview reference standard, pooled PHQ-9 sensitivity and specificity (95% confidence interval) at the standard cut-off value of ≥10, which maximised combined sensitivity and specificity, were 0.85 (0.79 to 0.89) and 0.85 (0.82 to 0.87), respectively. Specificity was similar across reference standards, but sensitivity in studies with semistructured interviews was 7-24% (median 21%) higher than with fully structured reference standards and 2-14% (median 11%) higher than with the MINI across cut-off values. Across reference standards and cut-off values, specificity was 0-10% (median 3%) higher for men and 0-12 (median 5%) higher for people aged 60 or older. Conclusions: Researchers and clinicians could use results to determine outcomes, such as total number of positive screens and false positive screens, at different PHQ-9 cut-off values for different clinical settings using the knowledge translation tool at www.depressionscreening100.com/phq. Study registration: PROSPERO CRD42014010673.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006
The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898
Lopez, A. D., Mathers, C. D., Ezzati, M., Jamison, D. T., & Murray, C. J. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68770-9 · Cited by 5,630
Robins, L. N. (1981) · Archives of General Psychiatry · doi:10.1001/archpsyc.1981.01780290015001 · Cited by 5,219
Depression, chronic diseases, and decrements in health: results from the World Health Surveys
Moussavi, S., Chatterji, S., Verdes, E., Tandon, A., Patel, V., & Ustun, B. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61415-9 · Cited by 4,070
Lecrubier, Y., Sheehan, D., Weiller, E., Amorim, P., Bonora, I., Sheehan, K. H., Janavs, J., & Dunbar, G. (1997) · European Psychiatry · doi:10.1016/s0924-9338(97)83296-8 · Cited by 3,513
Robins, L. N. (1988) · Archives of General Psychiatry · doi:10.1001/archpsyc.1988.01800360017003 · Cited by 2,909
Global Burden of Disease and Risk Factors
(2006) · World Bank, Washington, DC eBooks · doi:10.1596/978-0-8213-6262-4 · Cited by 2,605
Sheehan, D., Lecrubier, Y., Harnett Sheehan, K., Janavs, J., Weiller, E., Keskiner, A., Schinka, J., Knapp, E., Sheehan, M., & Dunbar, G. (1997) · European Psychiatry · doi:10.1016/s0924-9338(97)83297-x · Cited by 2,149
Stewart, L. A., Clarke, M., Rovers, M., Riley, R. D., Simmonds, M., Stewart, G., & Tierney, J. F. (2015) · JAMA · doi:10.1001/jama.2015.3656 · Cited by 2,134
American Academy of Family Physicians
(1966) · New England Journal of Medicine · doi:10.1056/nejm196611172752014 · Cited by 1,948
Levis, B., Benedetti, A., & Thombs, B. D. (2019) · BMJ · doi:10.1136/bmj.l1476 · Cited by 1,718
Self-citationLewis, G., Pelosi, A. J., Araya, R., & Dunn, G. (1992) · Psychological Medicine · doi:10.1017/s0033291700030415 · Cited by 1,487
Screening for Depression in Adults: US Preventive Services Task Force Recommendation Statement
Siu, A. L., and the US Preventive Services Task Force (USPSTF), Bibbins-Domingo, K., Grossman, D. C., Baumann, L. C., Davidson, K. W., Ebell, M., García, F. A. R., Gillman, M., Herzstein, J., et al. (2016) · JAMA · doi:10.1001/jama.2015.18392 · Cited by 1,407
Structured Clinical Interview for DSM-III-R Personality Disorders
First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (2012) · PsycTESTS Dataset · doi:10.1037/t07827-000 · Cited by 1,403
Gilbody, S., Richards, D., Brealey, S., & Hewitt, C. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0333-y · Cited by 1,290
Salameh, J.-P., Bossuyt, P. M., McGrath, T. A., Thombs, B. D., Hyde, C. J., Macaskill, P., Deeks, J. J., Leeflang, M., Korevaar, D. A., Whiting, P., et al. (2020) · BMJ · doi:10.1136/bmj.m2632 · Cited by 719
Self-citationQUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W., Westwood, M. E., Mallett, S. V., Deeks, J. J., Reitsma, J. B., Leeflang, M., Sterne, J. A. C., & Bossuyt, P. M. (2011) · Data Archiving and Networked Services (DANS) · doi:10.1059/0003-4819-155-8-201110180-00009 · Cited by 601
Levis, B., Sun, Y., He, C., Wu, Y., Krishnan, A., Bhandari, P. M., Neupane, D., Imran, M., Brehaut, E., Negeri, Z., et al. (2020) · JAMA · doi:10.1001/jama.2020.6504 · Cited by 577
Self-citationStructured Clinical Interview for the DSM ( SCID )
First, M. B. (2015) · The Encyclopedia of Clinical Psychology · doi:10.1002/9781118625392.wbecp351 · Cited by 532
Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal
Kent, D. M., Rothwell, P. M., Ioannidis, J. P., Altman, D. G., & Hayward, R. A. (2010) · Trials · doi:10.1186/1745-6215-11-85 · Cited by 504
Diagnostic accuracy of the mood module of the patient health questionnaire: a systematic review
Wittkampf, K. A., Naeije, L., Schene, A. H., Huyser, J., & van Weert, H. C. (2007) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2007.06.004 · Cited by 493
Wu, Y., Levis, B., Riehm, K. E., Saadat, N., Levis, A. W., Azar, M., Rice, D. B., Boruff, J., Cuijpers, P., Gilbody, S., et al. (2020) · Psychological Medicine · doi:10.1017/s0033291719001314 · Cited by 423
Self-citationLópez, A. D., Cd, M., Ezzati, M., Jamison, D. T. T., & Cjl, M. (2006) · Cited by 343
Recommendations on screening for depression in adults
Canadian Task Force on Preventive Health Care, Joffres, M., Jaramillo, A., Dickinson, J., Lewin, G., Pottie, K., Shaw, E., Gorber, S. C., & Tonelli, M. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.130403 · Cited by 247
Rethinking recommendations for screening for depression in primary care
Thombs, B. D., Coyne, J. C., Cuijpers, P., de Jonge, P., Gilbody, S., Ioannidis, J. P. A., Johnson, B. T., Patten, S. B., Turner, E. H., & Ziegelstein, R. C. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.111035 · Cited by 220
Self-citationDepression: Screening and Diagnosis.
Maurer, D., Raymond, T. J., & Davis, B. N. (2018) · PubMed · Cited by 204
Should we screen for depression?
Gilbody, S., Sheldon, T., & Wessely, S. (2006) · BMJ · doi:10.1136/bmj.332.7548.1027 · Cited by 195
BRUGHA, T. S., BEBBINGTON, P. E., & JENKINS, R. (1999) · Psychological Medicine · doi:10.1017/s0033291799008880 · Cited by 191
van der Leeden, R., Meijer, E., & Busing, F. M. T. A. (2007) · Springer eBooks · doi:10.1007/978-0-387-73186-5_11 · Cited by 181
BRUGHA, T. S., JENKINS, R., TAUB, N., MELTZER, H., & BEBBINGTON, P. E. (2001) · Psychological Medicine · doi:10.1017/s0033291701004184 · Cited by 171
Freedland, K. E., Skala, J. A., Carney, R. M., Raczynski, J. M., Taylor, C. B., de Leon, C. F. M., Ironson, G. H., Youngblood, M., Krishnan, K., & Veith, R. C. (2002) · Psychosomatic Medicine · doi:10.1097/01.psy.0000028826.64279.29 · Cited by 157
Thombs, B. D., Benedetti, A., Kloda, L. A., Levis, B., Nicolau, I. A., Cuijpers, P. J., Gilbody, S. M., Ioannidis, J. P. A., McMillan, D., Patten, S. B., et al. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-124 · Cited by 143
Self-citationScreening for depression in medical care
Palmer, S. C., & Coyne, J. C. (2003) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(02)00640-2 · Cited by 116
Thombs, B. D., Arthurs, E., El‐Baalbaki, G., Meijer, A., Ziegelstein, R. C., & Steele, R. J. (2011) · BMJ · doi:10.1136/bmj.d4825 · Cited by 116
Self-citationDoes depression screening improve depression outcomes in primary care?
Thombs, B. D., & Ziegelstein, R. C. (2014) · BMJ · doi:10.1136/bmj.g1253 · Cited by 104
Self-citationThombs, B. D., Ziegelstein, R. C., Roseman, M., Kloda, L. A., & Ioannidis, J. P. (2014) · BMC Medicine · doi:10.1186/1741-7015-12-13 · Cited by 100
Self-citationMeta‐analysis of diagnostic test studies using individual patient data and aggregate data
Riley, R. D., Dodd, S. R., Craig, J. V., Thompson, J. R., & Williamson, P. R. (2008) · Statistics in Medicine · doi:10.1002/sim.3441 · Cited by 97
Levis, B., Benedetti, A., Levis, A. W., Ioannidis, J. P. A., Shrier, I., Cuijpers, P. J., Gilbody, S. M., Kloda, L. A., McMillan, D., Patten, S. B., et al. (2016) · American Journal of Epidemiology · doi:10.1093/aje/kww191 · Cited by 70
Self-citationLevis, B., Benedetti, A., Riehm, K. E., Saadat, N., Levis, A. W., Azar, M., Rice, D. B., Chiovitti, M. J., Sanchez, T. A., Cuijpers, P., et al. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.54 · Cited by 69
Self-citationHandbook of research methods in abnormal and clinical psychology
McKay, D. (2008) · Cited by 69
Smits, N., Smit, F., Cuijpers, P. J., & de Graaf, R. (2007) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.230 · Cited by 63
Kronish, I. M., Moise, N., Cheung, Y. K., Clarke, G. N., Dolor, R. J., Duer-Hefele, J., Margolis, K. L., St Onge, T., Parsons, F., Retuerto, J., et al. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2019.4518 · Cited by 62
Does depression screening in primary care improve mental health outcomes?
Thombs, B. D., Markham, S., Rice, D. B., & Ziegelstein, R. C. (2021) · BMJ · doi:10.1136/bmj.n1661 · Cited by 54
Self-citationLevis, B., McMillan, D., Sun, Y., He, C., Rice, D. B., Krishnan, A., Wu, Y., Azar, M., Sanchez, T. A., Chiovitti, M. J., et al. (2019) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1803 · Cited by 49
Self-citationWu, Y., Levis, B., Sun, Y., Krishnan, A., He, C., Riehm, K. E., Rice, D. B., Azar, M., Yan, X. W., Neupane, D., et al. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2019.109892 · Cited by 48
Self-citationWu, Y., Levis, B., Ioannidis, J. P. A., Benedetti, A., & Thombs, B. D. (2020) · Psychotherapy and Psychosomatics · doi:10.1159/000509283 · Cited by 45
Self-citationSmall Signal, Big Noise: Performance of the CIDI Depression Module
Kurdyak, P. A., & Gnam, W. (2005) · The Canadian Journal of Psychiatry · doi:10.1177/070674370505001308 · Cited by 44
Rice, D., & Thombs, B. (2016) · PLoS ONE · doi:10.1371/journal.pone.0150067 · Cited by 21
Self-citationNeupane, D., Levis, B., Bhandari, P. M., Thombs, B. D., & Benedetti, A. (2021) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1873 · Cited by 19
Self-citation
Cited by
Management of Depression in Adults: A Review
Simon, G. E., Moise, N., & Mohr, D. C. (2024) · JAMA · doi:10.1001/jama.2024.5756 · Cited by 234
Lu, Y., Li, Y., Huang, Y., Zhang, X., Wang, J., Wu, L., & Cao, F. (2023) · Journal of Medical Internet Research · doi:10.2196/51549 · Cited by 24
“Consistent with previous literature [42], this study used a cutoff score of 5 to indicate positive depression symptoms and intervene with nurses exhibiting mild or greater depression symptoms.”
Mace, R. A., Greenberg, J., Lemaster, N., Duarte, B., Penn, T., Kanaya, M., Doorley, J. D., Burris, J. L., Jacobs, C. A., & Vranceanu, A.-M. (2022) · JMIR Formative Research · doi:10.2196/34654 · Cited by 15
Associations of weight-adjusted-waist index and depression with secondary infertility
Sun, F., Liu, M., Hu, S., Xie, R., Chen, H., Sun, Z., & Bi, H. (2024) · Frontiers in Endocrinology · doi:10.3389/fendo.2024.1330206 · Cited by 13
Metadata
- Authors
- Negeri, Z. F., Levis, B., Sun, Y., He, C., Krishnan, A., Wu, Y., Bhandari, P. M., Neupane, D., Brehaut, E., Benedetti, A., & Thombs, B. D.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2021-10-05
- Volume
- 375
- Pages
- n2183
- ISSN
- 1756-1833 (ISSN-L)
- OpenAlex
- W3202660027
- Cited by
- 364
- References
- 58
- FWCI
- 8.17
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.