Diagnostic accuracy of the mood module of the patient health questionnaire: a systematic review
Abstract
Objective The nine-item mood module of the Patient Health Questionnaire (PHQ-9) was developed to screen and to diagnose patients in primary care with depressive disorders. We systematically reviewed the psychometric literature on the PHQ-9 and performed a meta-analysis to ascertain its summary sensitivity and specificity.Methods EMBASE, PubMed and PsycINFO were used to search literature up to July 2006. Studies were included if (1) they investigated the diagnostic accuracy of the PHQ-9 and (2) the PHQ-9 had been compared with a reference test. The quality of the studies was appraised using the Quality Assessment of Diagnostic Accuracy Studies. We calculated sensitivity, specificity and confidence intervals for each included study. We used the random effects model to calculate the summary sensitivity and specificity.Results We found a sensitivity of 0.77 (0.71-0.84) and a specificity of 0.94 (0.90-0.97) for the PHQ-9. The positive predictive value in an unselected primary care population was 59%, which increased to 85-90% when the prior probability increased to 30-40%.Conclusion In primary care, the PHQ-9 is a valid diagnostic tool if used in selected subgroups of patients with a high prevalence of depressive disorder.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The PHQ-9 is generally well validated and commonly used in primary care.
“Although the PHQ-9 is generally well validated and commonly used in primary care (Wittkampf et al. , 2007)”
From Do depressed and anxious men do groups? What works and what are the barriers to help seeking? (2014) · cites this paper as Wittkampf et al. , 2007
Earlier studies in primary care show that the PHQ-9 detects depression with a sensitivity around 90% and a specificity ranging from 77% to 88% when using the cut-off ≥10.
“Earlier studies in primary care show that PHQ-9 detects depression with a sensitivity around 90% and a specificity ranging from 77% to 88% when using the cut-off ≥ 10. 15,17,23,24”
From Comparison of two self-rating scales to detect depression: HADS and PHQ-9 (2009) · cites this paper as [23]
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · see citing works
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · see citing works
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802 · see citing works
Whiting, P., Rutjes, A. W., Reitsma, J. B., Bossuyt, P. M., & Kleijnen, J. (2003) · BMC Medical Research Methodology · doi:10.1186/1471-2288-3-25 · Cited by 3,592 · see citing works
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369 · cited 2× · see citing works
“[28] developed the bivariate meta-regression model to incorporate this relationship in calculating the summary sensitivity and specificity.”
MethodUtility of a new procedure for diagnosing mental disorders in primary care. The PRIME-MD 1000 study
Spitzer, R. L. (1994) · JAMA · doi:10.1001/jama.272.22.1749 · Cited by 2,648 · see citing works
LOWE, B. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00237-9 · Cited by 1,060 · see citing works
Screening psychischer Störungen mit dem “Gesundheitsfragebogen für Patienten (PHQ-D)“
Gräfe, K., Zipfel, S., Herzog, W., & Löwe, B. (2004) · Diagnostica · doi:10.1026/0012-1924.50.4.171 · Cited by 805 · see citing works
Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Weswood, M. E., Rutjes, A. W., Reitsma, J. B., Bossuyt, P. M., & Kleijnen, J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-9 · Cited by 767 · see citing works
Diez-Quevedo, C., Rangil, T., Sanchez-Planell, L., Kroenke, K., & Spitzer, R. L. (2001) · Psychosomatic Medicine · doi:10.1097/00006842-200107000-00021 · Cited by 649 · see citing works
Thompson, C., Kinmonth, A., Stevens, L., Pevele, R., Stevens, A., Ostler, K., Pickering, R., Baker, N., Henson, A., Preece, J., et al. (2000) · The Lancet · doi:10.1016/s0140-6736(99)03171-2 · Cited by 489 · see citing works
Meta-analytic methods for diagnostic test accuracy
Irwig, L., Macaskill, P., Glasziou, P., & Fahey, M. T. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00099-c · Cited by 467 · see citing works
Performance of the PHQ-9 as a screening tool for depression after stroke
Williams, L. S., Brizendine, E. J., Plue, L., Bakas, T., Tu, W., Hendrie, H., & Kroenke, K. (2005) · Stroke · doi:10.1161/01.str.0000155688.18207.33 · Cited by 397 · see citing works
Validation of 2 Depression Screening Tools in Dialysis Patients
Watnick, S. G., Wang, P.-L., Demadura, T. L., & Ganzini, L. K. (2005) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2005.08.006 · Cited by 324 · see citing works
Identifying depression in primary care: a literature synthesis of case-finding instruments
Williams, J. W., Pignone, M. P., Ramı́rez, G., & Stellato, C. P. (2002) · General Hospital Psychiatry · doi:10.1016/s0163-8343(02)00195-0 · Cited by 288 · see citing works
McManus, D. D., Pipkin, S. S., & Whooley, M. A. (2005) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2005.06.037 · Cited by 222 · see citing works
(1997) · PubMed · Cited by 211 · see citing works
Becker, S., Al Zaid, K., & Al Faris, E. (2002) · The International Journal of Psychiatry in Medicine · doi:10.2190/xtdd-8l18-p9e0-jyrv · Cited by 190 · see citing works
Challenges in Systematic Reviews of Diagnostic Technologies
Tatsioni, A., Zarin, D. A., Aronson, N., Samson, D. J., Flamm, C. R., Schmid, C. H., & Lau, J. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-12_part_2-200506211-00004 · Cited by 176 · see citing works
Systematic review and evaluation of methods of assessing urinary incontinence
Martin, J., Williams, K., Abrams, K. R., Turner, D., Sutton, A. J., Chapple, C. R., Assassa, R. P., Shaw, C., & Cheater, F. (2006) · Health Technology Assessment · doi:10.3310/hta10060 · Cited by 164 · see citing works
The Defeat Depression Campaign: psychiatry in the public arena
(1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.6.59 · Cited by 154 · see citing works
Frequent consulters in general practice
Gill, D. M., & Sharpe, M. (1999) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(98)00118-4 · Cited by 141 · see citing works
The overdiagnosis of depression in non-depressed patients in primary care
Aragonès, E. (2006) · Family Practice · doi:10.1093/fampra/cmi120 · Cited by 90 · see citing works
How does study quality affect the results of a diagnostic meta-analysis?
Westwood, M. E., Whiting, P. F., & Kleijnen, J. (2005) · BMC Medical Research Methodology · doi:10.1186/1471-2288-5-20 · Cited by 87 · see citing works
Systematic reviews of diagnostic test evaluations: what's behind the scenes?
Pai, M. (2004) · BMJ Evidence-Based Medicine · doi:10.1136/ebm.9.4.101 · Cited by 85 · see citing works
Persoons, P., Luyckx, K., Desloovere, C., Vandenberghe, J. U., & Fischler, B. (2003) · General Hospital Psychiatry · doi:10.1016/s0163-8343(03)00072-0 · Cited by 83 · see citing works
Bengali adaptation of brief patient health questionnaire for screening depression at primary care.
Chowdhury, A. N., Ghosh, S., & Sanyal, D. (2004) · PubMed · Cited by 71 · see citing works
Screening for depressive disorders in patients with skin diseases: a comparison of three screeners
Picardi, A., Adler, D., Abeni, D., Chang, H., Pasquini, P., Rogers, W., & Bungay, K. (2005) · Acta Dermato Venereologica · doi:10.1080/00015550510034966 · Cited by 62 · see citing works
Does This Patient Have an Instability of the Shoulder or a Labrum Lesion?
Luime, J. J. (2004) · JAMA · doi:10.1001/jama.292.16.1989 · Cited by 59 · see citing works
Systematic reviews of diagnostic test evaluations: What's behind the scenes?
Pai, M., Michael McCulloch, L., Wayne Enanoria, M., & John M. Colford Jr., M. (2004) · ACP Journal Club · doi:10.7326/acpjc-2004-141-1-a11 · Cited by 43 · see citing works
Hollerwöger, D. (2006) · Manual Therapy · doi:10.1016/j.math.2005.12.001 · Cited by 37 · see citing works
Bronzite, M. (2000) · Springer eBooks · doi:10.1007/978-1-4471-0469-8_2 · Cited by 37 · see citing works
Somatisation in primary care: clinical judgement and standardised measurement compared
Schilte, A. F., Portegijs, P. J. M., Blankenstein, A. H., & Knottnerus, J. A. (2000) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s001270050239 · Cited by 34 · see citing works
Çorapçıoğlu, A., & Özer, G. U. (2004) · International Journal of Psychiatry in Clinical Practice · doi:10.1080/13651500310004452 · Cited by 30 · see citing works
Schreuders, B., van Oppen, P., van Marwijk, H., Smit, J. H., & Stalman, W. A. B. (2005) · BMC Family Practice · doi:10.1186/1471-2296-6-42 · Cited by 23 · see citing works
Procalcitonin as a marker of postoperative complications
Boysen, A., Madsen, J. S., & Jørgensen, P. E. (2005) · Scandinavian Journal of Clinical and Laboratory Investigation · doi:10.1080/00365510510025755 · Cited by 11 · see citing works
Questionnaires for depression and anxiety
Pignone, M. P., Gaynes, B. N., Lohr, K. N., Orleans, C. T., & Mulrow, C. D. (2001) · BMJ · doi:10.1136/bmj.323.7305.167/b · Cited by 5 · see citing works
Questionnaires for depression and anxiety. Routine screening entails additional pitfalls.
Coyne, J. C., Palmer, S., & Thompson, R. (2001) · PubMed · Cited by 4 · see citing works
[Quick detection of depression: a significant clinical issue].
Dumont, P., Andreoli, A. L., Borgacci, S., Carballeira, Y., Rentsch, D., Tonnac, N. D., & Archinard, M. (2005) · PubMed · Cited by 3 · see citing works
Détection rapide de la dépression : un problème important
Dumont, P., Andreoli, A., Borgacci, S., Carballeira, Y., et, D. R., Tonnac, N. D., & Archinard, M. (2005) · JMIG · doi:10.53738/revmed.2005.1.5.0344 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057 · see citing works
Manea, L., Gilbody, S., & McMillan, D. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.110829 · Cited by 1,966 · see citing works
Zhou, S.-J., Zhang, L.-G., Wang, L.-L., Guo, Z.-C., Wang, J.-Q., Chen, J.-C., Liu, M., Chen, X., & Chen, J.-X. (2020) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-020-01541-4 · Cited by 1,464 · see citing works
Wang, W., Bian, Q., Zhao, Y., Li, X., Wang, W., Du, J., Zhang, G., Zhou, Q., & Zhao, M. (2014) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2014.05.021 · Cited by 1,480 · see citing works
Levis, B., Benedetti, A., & Thombs, B. D. (2019) · BMJ · doi:10.1136/bmj.l1476 · Cited by 1,718 · see citing works
Manea, L., Gilbody, S., & McMillan, D. (2015) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2014.09.009 · Cited by 795 · see citing works
Richardson, L. P., McCauley, E., Grossman, D. C., McCarty, C. A., Richards, J., Russo, J. E., Rockhill, C., & Katon, W. (2010) · Pediatrics · doi:10.1542/peds.2010-0852 · Cited by 806 · see citing works
Eisenberg, D., Hunt, J., & Speer, N. (2013) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e31827ab077 · Cited by 728 · see citing works
Su, R., Tay, L., & Diener, E. (2014) · Applied Psychology: Health and Well-Being · doi:10.1111/aphw.12027 · Cited by 511 · see citing works
Keyes, C. L. M., Eisenberg, D., Perry, G. S., Dube, S. R., Kroenke, K., & Dhingra, S. S. (2012) · Journal of American College Health · doi:10.1080/07448481.2011.608393 · Cited by 483 · see citing works
Sawaya, H., Atoui, M., Hamadeh, A., Zeinoun, P., & Nahas, Z. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.03.030 · Cited by 450 · see citing works
Muramatsu, K., Miyaoka, H., Kamijima, K., Muramatsu, Y., Tanaka, Y., Hosaka, M., Miwa, Y., Fuse, K., Yoshimine, F., Mashima, I., et al. (2018) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2018.03.007 · Cited by 345 · see citing works
Moriarty, A. S., Gilbody, S., McMillan, D., & Manea, L. (2015) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.06.012 · Cited by 372 · see citing works
Negeri, Z., Levis, B., Sun, Y., He, C., Krishnan, A., Wu, Y., Bhandari, P. M., Neupane, D., Brehaut, E., Benedetti, A., et al. (2021) · BMJ · doi:10.1136/bmj.n2183 · Cited by 388 · see citing works
Development and validation of the overall depression severity and impairment scale
Bentley, K. H., Gallagher, M. W., Carl, J. R., & Barlow, D. H. (2014) · Psychological Assessment · doi:10.1037/a0036216 · Cited by 365 · see citing works
CBT for depression: a pilot RCT comparing mobile phone vs. computer
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L., Williams, A., & Andrews, G. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-49 · Cited by 329 · see citing works
Sun, Y., Fu, Z., Bo, Q., Mao, Z., Ma, X., & Wang, C. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02885-6 · Cited by 343 · see citing works
Mitchell, A., Yadegarfar, M., Gill, J., & Stubbs, B. (2016) · BJPsych Open · doi:10.1192/bjpo.bp.115.001685 · Cited by 322 · see citing works
Sleep problems among Chinese adolescents and young adults during the coronavirus-2019 pandemic
Zhou, S.-J., Wang, L.-L., Yang, R., Yang, X.-J., Zhang, L.-G., Guo, Z.-C., Chen, J.-C., Wang, J.-Q., & Chen, J.-X. (2020) · Sleep Medicine · doi:10.1016/j.sleep.2020.06.001 · Cited by 316 · see citing works
Blunted neural response to rewards prospectively predicts depression in adolescent girls
Bress, J. N., Foti, D., Kotov, R., Klein, D. N., & Hajcak, G. (2013) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01485.x · Cited by 317 · see citing works
Osório, F. D. L., Mendes, A. V., Crippa, J. A. S., & Loureiro, S. R. (2009) · Perspectives In Psychiatric Care · doi:10.1111/j.1744-6163.2009.00224.x · Cited by 321 · see citing works
Kaiser, T., Herzog, P., Voderholzer, U., & Brakemeier, E. (2021) · Depression and Anxiety · doi:10.1002/da.23136 · Cited by 296 · see citing works
Prevalence of Depression Among U.S. Adults With Diabetes
Li, C., Ford, E. S., Strine, T. W., & Mokdad, A. H. (2007) · Diabetes Care · doi:10.2337/dc07-1154 · Cited by 286 · see citing works
Assessment of depression severity with the PHQ-9 in cancer patients and in the general population
Hinz, A., Mehnert, A., Kocalevent, R.-D., Brähler, E., Forkmann, T., Singer, S., & Schulte, T. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0728-6 · Cited by 272 · see citing works
Ell, K., Xie, B., Quon, B., Quinn, D. I., Dwight‐Johnson, M., & Lee, P.-J. (2008) · Journal of Clinical Oncology · doi:10.1200/jco.2008.16.6371 · Cited by 270 · see citing works
Incorporating Recognition and Management of Perinatal Depression Into Pediatric Practice
Rafferty, J. R., Mattson, G. L., Earls, M. F., Yogman, M. W., Gambon, T. B., Lavin, A., & Wissow, L. S. (2018) · PEDIATRICS · doi:10.1542/peds.2018-3260 · Cited by 269 · see citing works
Identifying depression with the PHQ-2: A diagnostic meta-analysis
Manea, L., Gilbody, S. M., Hewitt, C. E., North, A., Plummer, F., Richardson, R., Thombs, B. D., Williams, B., & McMillan, D. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.06.003 · Cited by 265 · see citing works
Comparison of two self-rating scales to detect depression: HADS and PHQ-9
Hansson, M., Chotai, J., Nordstöm, A., & Bodlund, O. (2009) · British Journal of General Practice · doi:10.3399/bjgp09x454070 · Cited by 246 · see citing works
Na, P. J., Yaramala, S. R., Kim, J. A., Kim, H., Goes, F. S., Zandi, P. P., Voort, J. L. V., Sutor, B., Croarkin, P. E., & Bobo, W. V. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.02.045 · Cited by 247 · see citing works
Reliability and validity of the PHQ‐9 for screening late‐life depression in Chinese primary care
Chen, S., Chiu, H. F. K., Xu, B., Ma, Y., Jin, T., Wu, M., & Conwell, Y. (2009) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.2442 · Cited by 242 · see citing works
Kohrt, B. A., Luitel, N. P., Acharya, P., & Jordans, M. J. D. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0768-y · Cited by 236 · see citing works
Free, Brief, and Validated: Standardized Instruments for Low-Resource Mental Health Settings
Beidas, R. S., Stewart, R. E., Walsh, L., Lucas, S., Downey, M. M., Jackson, K., Fernandez, T., & Mandell, D. S. (2014) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2014.02.002 · Cited by 225 · see citing works
Ell, K., Katon, W. J., Xie, B., Lee, P.-J., Kapetanovic, S., Guterman, J. J., & Chou, C.-P. (2010) · Diabetes Care · doi:10.2337/dc09-1711 · Cited by 224 · see citing works
Hajos, T. R. S., Pouwer, F., Skovlund, S. E., Oudsten, B. L. D., Geelhoed-Duijvestijn, P. H. L. M., Tack, C. J., & Snoek, F. J. (2012) · Diabetic Medicine · doi:10.1111/dme.12040 · Cited by 222 · see citing works
Zuithoff, N. P., Vergouwe, Y., King, M., Nazareth, I., van Wezep, M. J., Moons, K. G., & Geerlings, M. I. (2010) · BMC Family Practice · doi:10.1186/1471-2296-11-98 · Cited by 218 · see citing works
Composite International Diagnostic Interview screening scales for DSM-IV anxiety and mood disorders
Kessler, R. C., Calabrese, J. R., Farley, P. A., Gruber, M. J., Jewell, M. A., Katon, W. J., Keck, P. E., Nierenberg, A. A., Sampson, N. A., Shear, M. K., et al. (2012) · Psychological Medicine · doi:10.1017/s0033291712002334 · Cited by 218 · see citing works
Fann, J. R., Bombardier, C. H., Richards, J. S., Tate, D. G., Wilson, C. S., & Temkin, N. (2011) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2010.05.016 · Cited by 205 · see citing works
Packages of care for depression in low- and middle-income countries
Patel, V., Simon, G., Chowdhary, N., Kaaya, S., & Araya, R. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000159 · Cited by 202 · see citing works
A study of the diagnostic accuracy of the PHQ-9 in primary care elderly
Phelan, E. A., WILLIAMS, B. J., Meeker, K., Bonn, K., Frederick, J. T., LoGerfo, J. P., & Snowden, M. B. (2010) · BMC Family Practice · doi:10.1186/1471-2296-11-63 · Cited by 198 · see citing works
Razykov, I., Ziegelstein, R. C., Whooley, M. A., & Thombs, B. D. (2012) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2012.06.001 · Cited by 188 · see citing works
Newby, J. M., Mackenzie, A., Williams, A. D., McIntyre, K., Watts, S., Wong, N., & Andrews, G. (2013) · Psychological Medicine · doi:10.1017/s0033291713000111 · Cited by 181 · see citing works
Validation of the Patient Health Questionnaire (PHQ)-9 for prenatal depression screening
Sidebottom, A. C., Harrison, P. A., Godecker, A. L., & Kim, H. (2012) · Archives of Women s Mental Health · doi:10.1007/s00737-012-0295-x · Cited by 188 · see citing works
Assessment of mood: Guides for clinicians
Furukawa, T. A. (2009) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2009.05.003 · Cited by 183 · see citing works
Screening for major depression in cancer outpatients
Thekkumpurath, P., Walker, J., Butcher, I., Hodges, L. J., Kleiboer, A. M., O’Connor, M. J., Wall, L. R., Murray, G. D., Kroenke, K., & Sharpe, M. (2010) · Cancer · doi:10.1002/cncr.25514 · Cited by 182 · see citing works
Psychometrics of the PHQ-9 as a measure of depressive symptoms in patients with heart failure
Hammash, M., Hall, L. A., Lennie, T. A., Heo, S., Chung, M. L., Lee, K. S., & Moser, D. K. (2012) · European Journal of Cardiovascular Nursing · doi:10.1177/1474515112468068 · Cited by 162 · see citing works
Affect Recall Bias: Being Resilient by Distorting Reality
Colombo, D., Suso‐Ribera, C., Fernández‐Álvarez, J., Cipresso, P., García‐Palacios, A., Riva, G., & Botella, C. (2020) · Cognitive Therapy and Research · doi:10.1007/s10608-020-10122-3 · Cited by 176 · see citing works
Inagaki, M., Ohtsuki, T., Yonemoto, N., Kawashima, Y., Saitoh, A., Oikawa, Y., Kurosawa, M., Muramatsu, K., Furukawa, T. A., & Yamada, M. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.08.001 · Cited by 159 · see citing works
Prevalence and determinants of depression in type 2 diabetes patients in a tertiary care centre.
Raval, A. D., Dhanaraj, E., Bhansali, A. K., Grover, S., & Tiwari, P. (2010) · PubMed · Cited by 153 · see citing works
Kleiboer, A., Smit, J., Bosmans, J., Ruwaard, J., Andersson, G., Topooco, N., Berger, T., Krieger, T., Botella, C., Baños, R., et al. (2016) · Trials · doi:10.1186/s13063-016-1511-1 · Cited by 133 · see citing works
Perceived discrimination and depression among low-income Latina male-to-female transgender women
Bazargan, M., & Galván, F. H. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-663 · Cited by 149 · see citing works
Sakuma, A., Takahashi, Y. K., Ueda, I., Sato, H., Katsura, M., Abe, M., Nagao, A., Suzuki, Y., Kakizaki, M., Tsuji, I., et al. (2015) · BMC Psychiatry · doi:10.1186/s12888-015-0440-y · Cited by 149 · see citing works
Milette, K., Hudson, M., Baron, M., & Thombs, B. D. (2010) · Lara D. Veeken · doi:10.1093/rheumatology/kep443 · Cited by 147 · see citing works
Depression, Chronic Pain, and Suicide by Overdose: On the Edge
Cheatle, M. D. (2011) · Pain Medicine · doi:10.1111/j.1526-4637.2011.01131.x · Cited by 142 · see citing works
Katon, W. J., Lin, E. H. B., Williams, L. H., Ciechanowski, P., Heckbert, S. R., Ludman, E., Rutter, C., Crane, P. K., Oliver, M., & Von Korff, M. (2010) · Journal of General Internal Medicine · doi:10.1007/s11606-009-1248-6 · Cited by 141 · see citing works
Reinertsen, E., & Clifford, G. D. (2018) · Physiological Measurement · doi:10.1088/1361-6579/aabf64 · Cited by 136 · see citing works
Ell, K., Vourlekis, B., Xie, B., Nedjat‐Haiem, F. R., Lee, P., Muderspach, L., Russell, C., & Palinkas, L. A. (2009) · Cancer · doi:10.1002/cncr.24500 · Cited by 132 · see citing works
Lehavot, K., Stappenbeck, C. A., Luterek, J. A., Kaysen, D. L., & Simpson, T. L. (2013) · Psychology of Addictive Behaviors · doi:10.1037/a0032266 · Cited by 130 · see citing works
Prevalence of DSM-IV Major Depression Among U.S. Military Personnel: Meta-Analysis and Simulation
Gadermann, A., Engel, C. C., Naifeh, J. A., Nock, M. K., Petukhova, M. V., Santiago, P. N., Wu, B., Zaslavsky, A. M., & Kessler, R. C. (2012) · Military Medicine · doi:10.7205/milmed-d-12-00103 · Cited by 131 · see citing works
Kiely, K. M., & Butterworth, P. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2014.12.023 · Cited by 128 · see citing works
“Additional validation studies of the PHQ-9 have focused on its clinical utility (Kroenke, 2012; Kroenke et al., 2010), reporting optimal cut-points in patient populations (Gelaye et al., 2013; Gilbody et al., 2007; Löwe et al., 2004a, 2004b; Manea et al., 2012; Wittkampf et al., 2007).”
BackgroundWittkampf, K., van Ravesteijn, H., Baas, K., van de Hoogen, H., Schene, A., Bindels, P., Lucassen, P., van de Lisdonk, E., & van Weert, H. (2009) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2009.06.001 · Cited by 126 · see citing works
Utility and limitations of PHQ-9 in a clinic specializing in psychiatric care
Inoue, T., Tanaka, T., Nakagawa, S., Nakato, Y., Kameyama, R., Boku, S., Toda, H., Kurita, T., & Koyama, T. (2012) · BMC Psychiatry · doi:10.1186/1471-244x-12-73 · Cited by 128 · see citing works
Lifetime Traumatic Experiences and Posttraumatic Stress Disorder in the German Population
Hauffa, R., Rief, W., Brähler, E., Martin, A., Mewes, R., & Glaesmer, H. (2011) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0b013e3182392c0d · Cited by 122 · see citing works
Newby, J., Robins, L., Wilhelm, K., Smith, J., Fletcher, T., Gillis, I., Ma, T., Finch, A., Campbell, L., & Andrews, G. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7274 · Cited by 102 · see citing works
Kotsis, K. T., Voulgari, P. V., Tsifetaki, N., Machado, M. O., Carvalho, A. F., Creed, F. H., Drosos, A. A., & Hyphantis, T. N. (2012) · Arthritis Care & Research · doi:10.1002/acr.21725 · Cited by 122 · see citing works
Practical Suicide-Risk Management for the Busy Primary Care Physician
McDowell, A. K., Lineberry, T. W., & Bostwick, J. M. (2011) · Mayo Clinic Proceedings · doi:10.4065/mcp.2011.0076 · Cited by 121 · see citing works
A randomized trial of cognitive rehabilitation in cancer survivors
Cherrier, M. M., Anderson, K., David, D., Higano, C. S., Gray, H. J., Church, A. E., & Willis, S. L. (2013) · Life Sciences · doi:10.1016/j.lfs.2013.08.011 · Cited by 118 · see citing works
Arthurs, E., Steele, R., Hudson, M., Baron, M., & Thombs, B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0052028 · Cited by 107 · see citing works
Thombs, B. D., Ziegelstein, R. C., & Whooley, M. A. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0802-y · Cited by 113 · see citing works
Kleiboer, A. M., Donker, T., Seekles, W., van Straten, A., Riper, H. M., & Cuijpers, P. J. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.06.013 · Cited by 110 · see citing works
Cameron, I. M., Cardy, A., Crawford, J. R., du Toit, S. W., Hay, S., Lawton, K., Mitchell, K., Sharma, S., Shivaprasad, S., Winning, S., et al. (2011) · British Journal of General Practice · doi:10.3399/bjgp11x583209 · Cited by 109 · see citing works
Thombs, B. D., Arthurs, E., El‐Baalbaki, G., Meijer, A., Ziegelstein, R. C., & Steele, R. J. (2011) · BMJ · doi:10.1136/bmj.d4825 · Cited by 103 · see citing works
Which PHQ-9 Items Can Effectively Screen for Suicide? Machine Learning Approaches
Kim, S., Lee, H.-K., & Lee, K. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18073339 · Cited by 99 · see citing works
Herrero, R., Mira, A., Cormo, G., Etchemendy, E., Baños, R., García‐Palacios, A., Ebert, D. D., Franke, M., Berger, T., Schaub, M. P., et al. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.03.005 · Cited by 105 · see citing works
Measurement invariance testing of the PHQ-9 in a multi-ethnic population in Europe: the HELIUS study
Galenkamp, H., Stronks, K., Snijder, M., & Derks, E. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1506-9 · Cited by 85 · see citing works
Hyphantis, T. N., Kotsis, K. T., Voulgari, P. V., Tsifetaki, N., Creed, F. H., & Drosos, A. A. (2011) · Arthritis Care & Research · doi:10.1002/acr.20505 · Cited by 99 · see citing works
Ell, K., Katon, W. J., Cabassa, L. J., Xie, B., Lee, P.-J., Kapetanovic, S., & Guterman, J. (2009) · The International Journal of Psychiatry in Medicine · doi:10.2190/pm.39.2.a · Cited by 97 · see citing works
Abnormal neural sensitivity to monetary gains versus losses among adolescents at risk for depression
Foti, D., Kotov, R., Klein, D. N., & Hajcak, G. (2011) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-011-9503-9 · Cited by 96 · see citing works
What is “normal” disability? An investigation of disability in the general population
Mewes, R., Rief, W., Stenzel, N., Glaesmer, H., Martin, A., & Brähler, E. (2009) · Pain · doi:10.1016/j.pain.2008.11.007 · Cited by 96 · see citing works
Measurement invariance with respect to ethnicity of the Patient Health Questionnaire-9 (PHQ-9)
Baas, K. D., Cramer, A. O. J., Koeter, M. W. J., van de Lisdonk, E. H., van Weert, H. C. P. M., & Schene, A. H. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2010.08.026 · Cited by 95 · see citing works
Miltz, A. R., Lampe, F. C., Bacchus, L., McCormack, S., Dunn, D. T., White, E., Rodger, A. J., Phillips, A. N., Sherr, L., Clarke, A. E., et al. (2019) · BMC Public Health · doi:10.1186/s12889-019-6757-6 · Cited by 92 · see citing works
Petersen, J. J., Paulitsch, M., Hartig, J., Mergenthal, K., Gerlach, F. M., & Gensichen, J. S. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.08.053 · Cited by 91 · see citing works
Newby, J. M., Mewton, L. R., Williams, A. D., & Andrews, G. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.04.037 · Cited by 91 · see citing works
Cassiani-Miranda, C. A., Cuadros-Cruz, A. K., Torres-Pinzón, H., Scoppetta, O., Pinzón-Tarrazona, J. H., López-Fuentes, W. Y., Paez, A., Cabanzo-Arenas, D. F., Ribero-Marulanda, S., & Llanes-Amaya, E. R. (2021) · Revista Colombiana de Psiquiatría · doi:10.1016/j.rcp.2019.09.001 · Cited by 89 · see citing works
Nakku, J. E. M., Rathod, S. D., Kizza, D., Breuer, E., Mutyaba, K., Baron, E. C., Ssebunnya, J., & Kigozi, F. N. (2016) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2016.14 · Cited by 89 · see citing works
Factor structure of the Spanish version of the Patient Health Questionnaire‐9 in Mexican women
Familiar, I., Ortiz-Panozo, E., Hall, B. J., Vieitez, I., Romieu, I., López-Ridaura, R., & Lajous, M. (2015) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1461 · Cited by 88 · see citing works
Comparison of the CES-D and PHQ-9 depression scales in people with type 2 diabetes in Tehran, Iran
Khamseh, M. E., Baradaran, H. R., Javanbakht, A., Mirghorbani, M., Yadollahi, Z., & Malek, M. (2011) · BMC Psychiatry · doi:10.1186/1471-244x-11-61 · Cited by 89 · see citing works
Tamizaje de episodio depresivo en adolescentes. Validación del instrumento PHQ-9
Borghero, F., Martínez, V., Pedro Zitko, M., Vöhringer, P. A., Cavada, G., & Rojas, G. (2018) · Revista médica de Chile · doi:10.4067/s0034-98872018000400479 · Cited by 86 · see citing works
Improved Perinatal Depression Screening, Treatment, and Outcomes With a Universal Obstetric Program
Avalos, L. A., Raine‐Bennett, T. R., Chen, H., Adams, A. S., & FLANAGAN, T. A. (2016) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000001403 · Cited by 86 · see citing works
Flynn, H. A., Sexton, M. B., Ratliff, S. M., Porter, K. E., & Zivin, K. (2010) · Psychiatry Research · doi:10.1016/j.psychres.2010.10.022 · Cited by 85 · see citing works
Mahoney, A. E. J., Hobbs, M. J., Newby, J. M., Williams, A. D., Sunderland, M., & Andrews, G. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.06.020 · Cited by 84 · see citing works
Katon, W. J., Young, B. A., Russo, J. E., Lin, E., Ciechanowski, P. S., Ludman, E. J., & Korff, M. R. V. (2013) · The Annals of Family Medicine · doi:10.1370/afm.1501 · Cited by 84 · see citing works
Herrero, R., Vara, M. D., Miragall, M., Botella, C., García-Palacios, A., Riper, H., Kleiboer, A., & Baños, R. M. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17176169 · Cited by 81 · see citing works
Simoen, L., Van den Berghe, L., Jacquet, W., & Marks, L. (2020) · Clinical Oral Investigations · doi:10.1007/s00784-020-03260-1 · Cited by 97 · see citing works
Ell, K., Xie, B., Kapetanovic, S., Quinn, D. I., Lee, P.-J., Wells, A., & Chou, C. (2011) · Psychiatric Services · doi:10.1176/ps.62.2.pss6202_0162 · Cited by 79 · see citing works
Kathol, R. G., Kunkel, E. J. S., Weiner, J. S., McCarron, R. M., Worley, L. L. M., Yates, W. R., D, P. S. M., & Huyse, F. J. (2009) · Psychosomatics · doi:10.1176/appi.psy.50.2.93 · Cited by 78 · see citing works
Associations Between Police Stress and Alcohol Use: Implications for Practice
Chopko, B. A., Palmieri, P. A., & Adams, R. E. (2012) · Journal of Loss and Trauma · doi:10.1080/15325024.2012.719340 · Cited by 77 · see citing works
Screening instruments for depression in primary care: a concise review for clinicians
Lakkis, N. A., & Mahmassani, D. M. (2014) · Postgraduate Medicine · doi:10.1080/00325481.2015.992721 · Cited by 77 · see citing works
Sidebottom, A. C., Hellerstedt, W. L., Harrison, P. A., & Hennrikus, D. J. (2013) · Archives of Women s Mental Health · doi:10.1007/s00737-013-0378-3 · Cited by 76 · see citing works
Navinés, R., Castellví, P., Moreno-España, J., Giménez, D., Udina, M., Cañizares, S., Díez, C., Valdés, M., Sola, R. L., & Martín‐Santos, R. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.01.018 · Cited by 75 · see citing works
Cohort Profile: The Mexican Teachers’ Cohort (MTC)
Lajous, M., Ortiz‐Panozo, E., Monge, A., Santoyo-Vistrain, R., García-Anaya, A., Yunes-Díaz, E., Rice, M. S., Blanco, M., Hernández‐Ávila, M., Willett, W. C., et al. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv123 · Cited by 73 · see citing works
- Authors
- Wittkampf, K. A., Naeije, L., Schene, A. H., Huyser, J., & van Weert, H. C.
- Affiliations
- Amsterdam UMC Location University of Amsterdam (NL)
- Corresponding author
- Wittkampf, Karin A.
- Venue
- General Hospital Psychiatry
- Publisher
- Elsevier BV
- Published
- 2007-09
- Volume
- 29
- Issue
- 5
- Pages
- 388-395
- ISSN
- 0163-8343 (ISSN-L)
- OpenAlex
- W2055505621
- Cited by
- 493
- References
- 40
- Citations by year
- 2026: 17 · 2025: 21 · 2024: 14 · 2023: 13 · 2022: 32 · 2021: 41 · 2020: 40 · 2019: 22 · 2018: 29 · 2017: 21 · 2016: 43 · 2015: 31 · 2014: 41 · 2013: 23 · 2012: 29
- FWCI
- 2.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- General Hospital Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Social Psychology › Mental Health Treatment and Access
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Keywords
- PHQ-9, Patient Health Questionnaire, depressive disorders, diagnostic accuracy, sensitivity and specificity, primary care, depression screening, positive predictive value, prior probability
- MeSH terms
- Depression, Diagnostic Errors, Humans, Netherlands, Primary Health Care, Psychometrics, Surveys and Questionnaires
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review