The Patient Health Questionnaire-9 for detection of major depressive disorder in primary care: consequences of current thresholds in a crosssectional study
Open accessAbstract
Background: There is a need for brief instruments to ascertain the diagnosis of major depressive disorder. In this study, we present the reliability, construct validity and accuracy of the PHQ-9 and PHQ-2 to detect major depressive disorder in primary care. Methods: Cross-sectional analyses within a large prospective cohort study (PREDICT-NL). Data was collected in seven large general practices in the centre of the Netherlands. 1338 subjects were recruited in the general practice waiting room, irrespective of their presenting complaint. The diagnostic accuracy (the area under the ROC curve and sensitivities and specificities for various thresholds) was calculated against a diagnosis of major depressive disorder determined with the Composite International Diagnostic Interview (CIDI). Results: The PHQ-9 showed a high degree of internal consistency (ICC = 0.88) and test-retest reliability (correlation = 0.94). With respect to construct validity, it showed a clear association with functional status measurements, sick days and number of consultations. The discriminative ability was good for the PHQ-9 (area under the ROC curve = 0.87, 95% CI: 0.84-0.90) and the PHQ-2 (ROC area = 0.83, 95% CI 0.80-0.87). Sensitivities at the recommended thresholds were 0.49 for the PHQ-9 at a score of 10 and 0.28 for a categorical algorithm. Adjustment of the threshold and the algorithm improved sensitivities to 0.82 and 0.84 respectively but the specificity decreased from 0.95 to 0.82 (threshold) and from 0.98 to 0.81 (algorithm). Similar results were found for the PHQ-2: the recommended threshold of 3 had a sensitivity of 0.42 and lowering the threshold resulted in an improved sensitivity of 0.81. Conclusion: The PHQ-9 and the PHQ-2 are useful instruments to detect major depressive disorder in primary care, provided a high score is followed by an additional diagnostic work-up. However, often recommended thresholds for the PHQ-9 and the PHQ-2 resulted in many undetected major depressive disorders.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The Patient Health Questionnaire-9 item has been demonstrated to have excellent psychometric properties in previous samples.
“The PHQ-9 has been demonstrated to have excellent psychometric properties in previous samples [28, 58].”
From Internet videoconferencing delivered cognitive behavior therapy for generalized anxiety disorder: protocol for a randomized controlled trial (2022) · cites this paper as [58]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · see citing works
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,384 · see citing works
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802 · see citing works
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Koretz, D., Merikangas, K. R., Rush, A. J., Walters, E. E., & Wang, P. S. (2003) · JAMA · doi:10.1001/jama.289.23.3095 · Cited by 7,988 · see citing works
The Patient Health Questionnaire-2: Validity of a Two-Item Depression Screener
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000093487.78664.3c · Cited by 6,359 · see citing works
Statistical Analysis With Missing Data
Ghosh, S., Little, R. J. A., & Rubin, D. B. (1988) · Technometrics · doi:10.2307/1269814 · Cited by 4,730 · see citing works
The Structured Clinical Interview for DSM-III-R (SCID): I: History, Rationale, and Description
Spitzer, R. L. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820080032005 · Cited by 4,336 · see citing works
Utility of a new procedure for diagnosing mental disorders in primary care. The PRIME-MD 1000 study
Spitzer, R. L. (1994) · JAMA · doi:10.1001/jama.272.22.1749 · Cited by 2,648 · see citing works
Review: a gentle introduction to imputation of missing values.
Donders, A. R. T., van der Heijden, G. J. M. G., Stijnen, T., & Moons, K. G. M. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.014 · Cited by 2,582 · see citing works
Self-citationUtility of a New Procedure for Diagnosing Mental Disorders in Primary Care: The PRIME-MD 1000 Study
Spitzer, R. L. (1994) · JAMA · doi:10.1001/jama.1994.03520220043029 · Cited by 1,873 · see citing works
The Structured Clinical Interview for DSM-III-R (SCID)
Williams, J. B. W. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820080038006 · Cited by 1,627 · see citing works
Gilbody, S., Richards, D., Brealey, S., & Hewitt, C. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0333-y · Cited by 1,290 · see citing works
Validation of PHQ-2 and PHQ-9 to Screen for Major Depression in the Primary Care Population
Arroll, B., Goodyear-Smith, F., Crengle, S., Gunn, J., Kerse, N., Fishman, T., Falloon, K., & Hatcher, S. (2010) · The Annals of Family Medicine · doi:10.1370/afm.1139 · Cited by 1,279 · see citing works
Prevalence and incidence studies of anxiety disorders: A systematic review of the literature
Somers, J. M., Goldner, E. M., Waraich, P., & Hsu, L. (2006) · The Canadian Journal of Psychiatry · doi:10.1177/070674370605100206 · Cited by 1,114 · see citing works
LOWE, B. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00237-9 · Cited by 1,060 · see citing works
A critical look at methods for handling missing covariates in epidemiologic regression analyses.
Greenland, S., & Finkle, W. D. (1995) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117592 · Cited by 891 · cited 1× · see citing works
“complete case analysis) leads to biased results[23-26].”
Diez-Quevedo, C., Rangil, T., Sanchez-Planell, L., Kroenke, K., & Spitzer, R. L. (2001) · Psychosomatic Medicine · doi:10.1097/00006842-200107000-00021 · Cited by 649 · see citing works
Spitzer, R. L., Williams, J. B. W., & Kroenke, K. (1999) · PsycTESTS Dataset · doi:10.1037/t02598-000 · Cited by 590 · see citing works
Prevalence and Incidence Studies of Mood Disorders: A Systematic Review of the Literature
Waraich, P., Goldner, E. M., Somers, J. M., & Hsu, L. (2004) · The Canadian Journal of Psychiatry · doi:10.1177/070674370404900208 · Cited by 522 · cited 1× · see citing works
“Second, the prevalence of major depressive disorder in this study was relatively high [30-32].”
BackgroundDiagnostic accuracy of the mood module of the patient health questionnaire: a systematic review
Wittkampf, K. A., Naeije, L., Schene, A. H., Huyser, J., & van Weert, H. C. (2007) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2007.06.004 · Cited by 493 · see citing works
Adewuya, A. O., Ola, B. A., & Afolabi, O. O. (2006) · Journal of Affective Disorders · doi:10.1016/j.jad.2006.05.021 · Cited by 474 · see citing works
Spitzer, R. L. (1999) · Medical Entomology and Zoology · Cited by 429 · see citing works
Li, C., Friedman, B., Conwell, Y., & Fiscella, K. A. (2007) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2007.01103.x · Cited by 334 · see citing works
The Feasibility of Using the Spanish PHQ-9 to Screen for Depression in Primary Care in Honduras
Wulsin, L. R., Somoza, E. C., & Heck, J. E. (2002) · The Primary Care Companion For CNS Disorders · doi:10.4088/pcc.v04n0504 · Cited by 240 · see citing works
McManus, D. D., Pipkin, S. S., & Whooley, M. A. (2005) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2005.06.037 · Cited by 222 · see citing works
King, M., Walker, C., Levy, G., Bottomley, C., Royston, P., Weich, S., Bellón-Saameño, J. Á., Moreno, B., Švab, I., Rotar, D., et al. (2008) · Archives of General Psychiatry · doi:10.1001/archpsyc.65.12.1368 · Cited by 221 · see citing works
Self-citationGilbody, S. M., Richards, D. A., & Barkham, M. (2007) · Europe PMC (PubMed Central) · Cited by 206 · see citing works
Gender and age-specific first incidence of DSM-III-R psychiatric disorders in the general population
Bijl, R. V., de Graaf, R., Ravelli, A., Smit, F., & Vollebergh, W. (2002) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-002-0566-3 · Cited by 199 · see citing works
Lamers, F., Jonkers, C. C. M., Bosma, H., Penninx, B. W. J. H., Knottnerus, J. A., & van Eijk, J. T. M. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.07.018 · Cited by 188 · see citing works
Diagnostic interviewing for family studies
Sobin, C. A., Weissman, M. M., Goldstein, R. B., Adams, P. J., WICKRAMARATNE, P. J., Warner, V., & Lish, J. D. (1993) · Psychiatric Genetics · doi:10.1097/00041444-199324000-00005 · Cited by 132 · see citing works
Prediction of depression in European general practice attendees: the PREDICT study
King, M., Weich, S., Torres‐González, F., Švab, I., Maaroos, H., Neeleman, J., Xavier, M., Morris, R. W., Walker, C., Bellón, J. Á., et al. (2006) · BMC Public Health · doi:10.1186/1471-2458-6-6 · Cited by 96 · see citing works
Self-citationPersoons, P., Luyckx, K., Desloovere, C., Vandenberghe, J. U., & Fischler, B. (2003) · General Hospital Psychiatry · doi:10.1016/s0163-8343(03)00072-0 · Cited by 83 · see citing works
Logistic Regression with Missing Values in the Covariates
Vach, W. (1994) · Lecture notes in statistics · doi:10.1007/978-1-4612-2650-5 · Cited by 82 · see citing works
Screening for depressive disorders in patients with skin diseases: a comparison of three screeners
Picardi, A., Adler, D., Abeni, D., Chang, H., Pasquini, P., Rogers, W., & Bungay, K. (2005) · Acta Dermato Venereologica · doi:10.1080/00015550510034966 · Cited by 62 · see citing works
Small Signal, Big Noise: Performance of the CIDI Depression Module
Kurdyak, P. A., & Gnam, W. (2005) · The Canadian Journal of Psychiatry · doi:10.1177/070674370505001308 · Cited by 41 · see citing works
Screening for maternal depression in a low education population using a two item questionnaire
Cutler, C., Legano, L. A., Dreyer, B., Fierman, A., Berkule, S. B., Lusskin, S., Tomopoulos, S., Roth, M., & Mendelsohn, A. (2007) · Archives of Women's Mental Health · doi:10.1007/s00737-007-0202-z · Cited by 37 · see citing works
Hosmer (1997) · doi:10.1002/(sici)1097-0258(19970515)16:9
Flagged first, then by citations
Research works printed but not linked: 1
- Kosinsky M Scoring the SF-12 Physical and Mental Health Summary Measures Medical Outcomes Trust Bulletin 1997 5 3 4
Cited by
Sorted by citations
Manea, L., Gilbody, S., & McMillan, D. (2015) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2014.09.009 · Cited by 795 · see citing works
Costantini, L., Pasquarella, C. I. M., Odone, A., Colucci, M. E., Costanza, A., Serafini, G., Aguglia, A., Murri, M. B., Brakoulias, V., Amore, M., et al. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.09.131 · Cited by 740 · see citing works
Zhang, Y., Liang, W., Zuo-ming, C., Zhang, H., Zhang, J.-H., Weng, X., Yang, S.-C., Zhang, L., Shen, L.-J., & Zhang, Y. (2013) · Asia-Pacific Psychiatry · doi:10.1111/appy.12103 · Cited by 444 · see citing works
Santos, I. S., Tavares, B. F., Munhoz, T. N., Almeida, L. S. P. D., Silva, N. T. B. D., Tams, B. D., Patella, A. M., & Matijasevich, A. (2013) · Cadernos de Saúde Pública · doi:10.1590/s0102-311x2013001200006 · Cited by 415 · see citing works
Moriarty, A. S., Gilbody, S., McMillan, D., & Manea, L. (2015) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.06.012 · Cited by 372 · see citing works
Santos, I. S., Tavares, B. F., Munhoz, T. N., de Almeida, L. S. P., da Silva, N. T. B., Tams, B. D., Patella, A. M., & Matijasevich, A. (2013) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 367 · see citing works
CBT for depression: a pilot RCT comparing mobile phone vs. computer
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L., Williams, A., & Andrews, G. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-49 · Cited by 329 · see citing works
Mitchell, A., Yadegarfar, M., Gill, J., & Stubbs, B. (2016) · BJPsych Open · doi:10.1192/bjpo.bp.115.001685 · Cited by 322 · see citing works
Patel, J. S., Oh, Y., Rand, K. L., Wu, W., Cyders, M. A., Kroenke, K., & Stewart, J. C. (2019) · Depression and Anxiety · doi:10.1002/da.22940 · Cited by 306 · see citing works
Arrieta, J., Aguerrebere, M., Raviola, G. J., Flores, H., Elliott, P. F., Espinosa, A., Reyes, A., Ortiz‐Panozo, E., Rodriguez-Gutierrez, E. G., Mukherjee, J. S., et al. (2017) · Journal of Clinical Psychology · doi:10.1002/jclp.22390 · Cited by 261 · see citing works
Identifying depression with the PHQ-2: A diagnostic meta-analysis
Manea, L., Gilbody, S. M., Hewitt, C. E., North, A., Plummer, F., Richardson, R., Thombs, B. D., Williams, B., & McMillan, D. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.06.003 · Cited by 265 · see citing works
El‐Den, S., Chen, T. F., Gan, Y.-L., Wong, E., & O’Reilly, C. L. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.08.060 · Cited by 190 · see citing works
Williams, A. D., & Andrews, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057447 · Cited by 149 · see citing works
Rozental, A., Magnusson, K., Boettcher, J., Andersson, G., & Carlbring, P. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000158 · Cited by 137 · see citing works
Dadfar, M., Kalibatseva, Z., & Lester, D. (2018) · Trends in Psychiatry and Psychotherapy · doi:10.1590/2237-6089-2017-0116 · Cited by 136 · see citing works
Bosanquet, K., Bailey, D., Gilbody, S. M., Harden, M., Manea, L., Nutbrown, S., & McMillan, D. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008913 · Cited by 106 · see citing works
Pence, B. W., Gaynes, B. N., Atashili, J., O’Donnell, J. K., Tayong, G., Kats, D., Whetten, R., Whetten, K., NJAMNSHI, A. K., & Ndumbe, P. M. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.05.056 · Cited by 105 · see citing works
Punnen, S., Cowan, J. E., Dunn, L. B., Shumay, D. M., Carroll, P. R., & Cooperberg, M. R. (2013) · British Journal of Urology · doi:10.1111/bju.12209 · Cited by 103 · see citing works
Hyphantis, T. N., Kotsis, K. T., Voulgari, P. V., Tsifetaki, N., Creed, F. H., & Drosos, A. A. (2011) · Arthritis Care & Research · doi:10.1002/acr.20505 · Cited by 99 · see citing works
Villarreal-Zegarra, D., Barrera-Begazo, J., Otazú-Alfaro, S., Mayo-Puchoc, N., Bazo-Alvarez, J. C., & Huarcaya-Victoria, J. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-076193 · Cited by 93 · see citing works
Miltz, A. R., Lampe, F. C., Bacchus, L., McCormack, S., Dunn, D. T., White, E., Rodger, A. J., Phillips, A. N., Sherr, L., Clarke, A. E., et al. (2019) · BMC Public Health · doi:10.1186/s12889-019-6757-6 · Cited by 92 · see citing works
Newby, J. M., Mewton, L. R., Williams, A. D., & Andrews, G. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.04.037 · Cited by 91 · see citing works
Chang, B., Gitlin, D., & Patel, R. B. (2011) · PubMed · Cited by 82 · see citing works
Long-term consequences of recurrent sports concussion
Decq, P., Gault, N., Blandeau, M., Kerdraon, T., Berkal, M., Helou, A. E., Dusfour, B., & Peyrin, J.-C. (2015) · Acta Neurochirurgica · doi:10.1007/s00701-015-2681-4 · Cited by 82 · see citing works
Ghazisaeedi, M., Mahmoodi, H., Arpacı, İ., Mehrdar, S., & Barzegari, S. (2021) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-021-00483-5 · Cited by 80 · see citing works
Garabiles, M. R., Lao, C. K., Yip, P. S. Y., Chan, E. W. W., Mordeno, I. G., & Hall, B. J. (2019) · Journal of Personality Assessment · doi:10.1080/00223891.2019.1644343 · Cited by 79 · see citing works
Vesel, C., Rashidisabet, H., Zulueta, J., Stange, J. P., Duffecy, J. L., Hussain, F., Piscitello, A., Bark, J. S., Langenecker, S. A., Young, S., et al. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa057 · Cited by 74 · see citing works
Screening instruments for depression in primary care: a concise review for clinicians
Lakkis, N. A., & Mahmassani, D. M. (2014) · Postgraduate Medicine · doi:10.1080/00325481.2015.992721 · Cited by 77 · see citing works
Rozental, A., Andersson, G., & Carlbring, P. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00589 · Cited by 74 · see citing works
Navinés, R., Castellví, P., Moreno-España, J., Giménez, D., Udina, M., Cañizares, S., Díez, C., Valdés, M., Sola, R. L., & Martín‐Santos, R. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.01.018 · Cited by 75 · see citing works
Andersson, G., Carlbring, P., & Rozental, A. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00749 · Cited by 71 · see citing works
Newby, J. M., Mewton, L., & Andrews, G. (2017) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.06.002 · Cited by 75 · see citing works
Rosso, I. M., Killgore, W. D. S., Olson, E. A., Webb, C. A., Fukunaga, R., Auerbach, R. P., Gogel, H., Buchholz, J. L., & Rauch, S. L. (2016) · Depression and Anxiety · doi:10.1002/da.22590 · Cited by 65 · see citing works
Williams, A. D., O'Moore, K., Mason, E., & Andrews, G. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.11.001 · Cited by 53 · see citing works
Carey, M. L., Boyes, A., Noble, N., Waller, A. E., & Inder, K. (2015) · Australian Journal of Primary Health · doi:10.1071/py14149 · Cited by 57 · see citing works
Health of patients on the waiting list: Opportunity to improve health in Canada?
Sutherland, J. M., Crump, T., Chan, A., Liu, G., Yue, E., & Bair, M. J. (2016) · Health Policy · doi:10.1016/j.healthpol.2016.04.017 · Cited by 57 · see citing works
Lee, S., Oh, S. T., Ryu, S. Y., Jun, J. Y., Lee, K., Lee, E. M., Park, J. Y., Yi, S., & Choi, W. J. (2016) · Cited by 54 · see citing works
Zhai, Y., Zhang, Y., Chu, Z., Geng, B., Almaawali, M. S., Fulmer, R., Lin, Y.-W. D., Xu, Z., Daniels, A. D., Liu, Y., et al. (2024) · Journal of Counseling & Development · doi:10.1002/jcad.12543 · Cited by 53 · see citing works
Ginkel, J. M. D. M., Hafsteinsdøttir, T. B., Lindeman, E., Geerlings, M. I., Grobbee, D. E., & Schuurmans, M. J. (2015) · PLoS ONE · doi:10.1371/journal.pone.0144450 · Cited by 44 · see citing works
Self-citationSienko, S. E. (2017) · Disability and Rehabilitation · doi:10.1080/09638288.2016.1274340 · Cited by 45 · see citing works
The patient health questionnaire (PHQ)
Iglesias-González, M., & Díez, C. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-817933-8.00029-3 · Cited by 44 · see citing works
Allen, A. R., Newby, J. M., Mackenzie, A., Smith, J., Boulton, M., Loughnan, S. A., & Andrews, G. (2016) · BJPsych Open · doi:10.1192/bjpo.bp.115.001826 · Cited by 43 · see citing works
van Dijk, S. E. M., Pols, A. D., Adriaanse, M. C., Bosmans, J. E., Elders, P. J. M., van Marwijk, H., & van Tulder, M. W. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-128 · Cited by 43 · see citing works
Volker, D., Zijlstra-Vlasveld, M. C., Brouwers, E. P. M., Homans, W. A., Emons, W. H. M., & Feltz-Cornelis, C. M. V. D. (2015) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-015-9607-0 · Cited by 42 · see citing works
Lasser, K. E., Shanahan, C. W., Parker, V. A., Beers, D., Xuan, Z., Heymann, O. D., Lange, A. V., & Liebschutz, J. M. (2015) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2015.06.018 · Cited by 42 · see citing works
Schumann, M. E., Coombes, B. J., Gascho, K., Geske, J. R., McDermott, M. C., Morrison, E. J. P., Reynolds, A. L., Bernau, J. L., & Gilliam, W. P. (2021) · Pain Medicine · doi:10.1093/pm/pnab271 · Cited by 36 · see citing works
Grool, A. M., van der Graaf, Y., Mali, W. P. T. M., Geerlings, M. I., & on behalf of the SMART Study Group (2011) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.2010.232413 · Cited by 35 · see citing works
Self-citationWard, R. E., Beauchamp, M. K., Latham, N. K., Leveille, S. G., Percac‐Lima, S., Kurlinski, L. A., Ni, P., Goldstein, R., Jette, A. M., & Bean, J. F. (2016) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2016.03.003 · Cited by 35 · see citing works
Grool, A. M., van der Graaf, Y., Mali, W. P. T. M., Witkamp, T. D., Vincken, K. L., & Geerlings, M. I. (2011) · Psychological Medicine · doi:10.1017/s0033291711001383 · Cited by 35 · see citing works
Self-citationClinical utility of screening for clinical depression and bipolar disorder
Mitchell, A. J. (2011) · Current Opinion in Psychiatry · doi:10.1097/yco.0b013e32834de45b · Cited by 34 · see citing works
Which Neuromuscular Attributes Are Most Associated With Mobility Among Older Primary Care Patients?
Bean, J. F., Latham, N. K., Holt, N. E., Kurlinksi, L., Ni, P., Leveille, S. G., Percac‐Lima, S., & Jette, A. M. (2013) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2013.07.026 · Cited by 34 · see citing works
Exploring the patient perspective of fatigue in adults with visual impairment: a qualitative study
Schakel, W., Bode, C., van der Aa, H. P. A., Hulshof, C. T. J., Bosmans, J. E., van Rens, G. H. M. B., & van Nispen, R. M. A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-015023 · Cited by 34 · see citing works
Brown, L. A., Craske, M. G., Glenn, D. E., Stein, M. B., Sullivan, G., Sherbourne, C., Bystritsky, A., Welch, S. S., Campbell-Sills, L., Lang, A., et al. (2013) · Depression and Anxiety · doi:10.1002/da.22027 · Cited by 31 · see citing works
van der Zwaan, G. L., van Dijk, S. E. M., Adriaanse, M. C., van Marwijk, H., van Tulder, M. W., Pols, A. D., & Bosmans, J. E. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.09.045 · Cited by 32 · see citing works
Deschênes, S. S., Burns, R. J., Graham, E. A., & Schmitz, N. (2019) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796019000441 · Cited by 32 · see citing works
Sebera, F. M., Vissoci, J. R. N., Umwiringirwa, J., Teuwen, D. E., Boon, P., & Dedeken, P. (2020) · PLoS ONE · doi:10.1371/journal.pone.0234095 · Cited by 32 · see citing works
Scoppetta, O., Cassiani-Miranda, C. A., Arocha-Díaz, K. N., Cabanzo-Arenas, D. F., & Campo‐Arias, A. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.09.096 · Cited by 35 · see citing works
Kladnitski, N., Smith, J., Allen, A., Andrews, G., & Newby, J. M. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.06.003 · Cited by 31 · see citing works
“%) met criteria for two or more anxiety disorders without MDD, and four (18.2”
MethodInfluentialManea, L., Boehnke, J. R., Gilbody, S. M., Moriarty, A. S., & McMillan, D. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-015247 · Cited by 31 · see citing works
AlShebali, M., AlHadi, A. N., & Waller, G. (2020) · Eating and Weight Disorders - Studies on Anorexia Bulimia and Obesity · doi:10.1007/s40519-020-01028-w · Cited by 29 · see citing works
Vöhringer, P. A., Jimenez, M. I., Igor, M. A., Fores, G. A., Correa, M. O. S., Sullivan, M. C., Holtzman, N. S., Whitham, E. A., Barroilhet, S. A., Alvear, K., et al. (2013) · Journal of Medical Screening · doi:10.1177/0969141313503954 · Cited by 26 · see citing works
AlShebali, M., Becker, C. B., Kellett, S., AlHadi, A. N., & Waller, G. (2021) · Eating and Weight Disorders - Studies on Anorexia Bulimia and Obesity · doi:10.1007/s40519-021-01104-9 · Cited by 23 · see citing works
Newby, J. M., Haskelberg, H., Hobbs, M. J., Mahoney, A. E. J., Mason, E., & Andrews, G. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.087 · Cited by 23 · see citing works
Telehealth videoconferencing psychotherapy in rural primary care.
Gonzalez, G. E., & Brossart, D. F. (2015) · Rural Mental Health · doi:10.1037/rmh0000037 · Cited by 23 · see citing works
Blackburn, J., van der Oest, M. J. W., Selles, R. W., Chen, N. C., Feitz, R., Vranceanu, A., & Porsius, J. T. (2019) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000000992 · Cited by 23 · see citing works
The use of automated assessments in internet-based CBT: The computer will be with you shortly
Mason, E. C., & Andrews, G. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.10.003 · Cited by 23 · see citing works
Do individuals with and without depression value depression differently? And if so, why?
Papageorgiou, K., Vermeulen, K. M., Schroevers, M. J., Stiggelbout, A. M., Buskens, E., Krabbe, P. F. M., van den Heuvel, E. R., & Ranchor, A. V. (2015) · Quality of Life Research · doi:10.1007/s11136-015-1018-3 · Cited by 22 · see citing works
The Relationship Between Neuromuscular Impairments, Chronic Back Pain and Mobility in Older Adults
Makris, U., Paul, T. M., Holt, N. E., Latham, N., Ni, P., Jette, A., Leveille, S. G., & Bean, J. (2016) · PM & R : the journal of injury, function, and rehabilitation · doi:10.1016/j.pmrj.2016.01.007 · Cited by 21 · see citing works
Williams, R. T., Heinemann, A. W., Neumann, H. D., Fann, J. R., Forchheimer, M. B., Richardson, E. J., & Bombardier, C. H. (2016) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2016.01.017 · Cited by 21 · see citing works
Rentmeesters, N., & Hermans, D. (2023) · European Journal of Psychotraumatology · doi:10.1080/20008066.2022.2156558 · Cited by 19 · see citing works
A Review of Psychometrically Tested Instruments Assessing Suicide Risk in Adults
Kreuze, E. J., & Lamis, D. A. (2017) · OMEGA - Journal of Death and Dying · doi:10.1177/0030222816688151 · Cited by 18 · see citing works
Spangenberg, L., Brähler, E., & Glaesmer, H. (2012) · Zeitschrift für Psychosomatische Medizin und Psychotherapie · doi:10.13109/zptm.2012.58.1.3 · Cited by 29 · see citing works
Zhai, Y., Xiong, Y., Almaawali, M. S., Tian, X., & Du, X. Y. (2025) · General Psychiatry · doi:10.1136/gpsych-2025-102124 · Cited by 22 · see citing works
Bruns, E. J., Lee, K. A., Davis, C. J., Pullmann, M. D., Ludwig, K. A., Sander, M., Holm-Hansen, C., Hoover, S. A., & McCauley, E. M. (2023) · Prevention Science · doi:10.1007/s11121-022-01463-4 · Cited by 16 · see citing works
Zhai, Y., Carney, J. V., & Hazler, R. J. (2023) · Journal of Counseling & Development · doi:10.1002/jcad.12468 · Cited by 18 · see citing works
Nghia, N. T., An, P. L., & Tien, N. D. P. (2021) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-030-75506-5_72 · Cited by 17 · see citing works
The Relationship Between Social Anxiety and Internalized Racism in Black Young Adults
Kline, E. A., Warner, C. M., Grapin, S. L., Reyes-Portillo, J. A., Bixter, M. T., Cunningham, D. J., Mahmud, F., Singh, T., & Weeks, C. (2021) · Journal of Cognitive Psychotherapy · doi:10.1891/jcpsy-d-20-00030 · Cited by 16 · see citing works
Jain, N., Stech, E., Grierson, A. B., Sharrock, M. J., Li, I., Mahoney, A. E. J., & Newby, J. M. (2021) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2021.102473 · Cited by 21 · see citing works
Psychosocial factors and hippocampal subfields: The Medea‐7T study
Twait, E. L., Blom, K., Koek, H. L., Zwartbol, M. H. T., Ghaznawi, R., Hendrikse, J., Gerritsen, L., Geerlings, M. I., & UCC SMART Study Group (2022) · Human Brain Mapping · doi:10.1002/hbm.26185 · Cited by 15 · see citing works
Self-citationJacob, M. E., Travison, T. G., Ward, R. E., Latham, N. K., Leveille, S. G., Jette, A. M., & Bean, J. F. (2018) · The Journals of Gerontology Series A · doi:10.1093/gerona/gly102 · Cited by 16 · see citing works
Olmert, T., Cooper, J. D., Han, S. Y. S., Barton‐Owen, G., Farrag, L. P., Bell, E., Friend, L. V., Özcan, S., Rustogi, N., Preece, R. L., et al. (2020) · JMIR Research Protocols · doi:10.2196/18453 · Cited by 16 · see citing works
Accuracy of Community Informant Led Detection of Maternal Depression in Rural Pakistan
Mohsin, S., Waqas, A., Atif, N., Rabbani, M. W., Khan, S. A., Bilal, S., Sharif, M., Bibi, A., & Sikander, S. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18031075 · Cited by 15 · see citing works
Ivanova, E. L., Burns, R. J., Deschênes, S. S., Knaüper, B., & Schmitz, N. (2016) · Canadian Journal of Diabetes · doi:10.1016/j.jcjd.2016.07.006 · Cited by 15 · see citing works
The predictive power of depression screening procedures for veterans with coronary artery disease
Shankman, S. A., Nadelson, McGowan, Sovari, A. A., & Vidovich (2012) · Vascular Health and Risk Management · doi:10.2147/vhrm.s29424 · Cited by 15 · see citing works
Hippocampal volume and the course of depressive symptoms over eight years of follow‐up
Buddeke, J., Kooistra, M., Zuithoff, N. P. A., Gerritsen, L., Biessels, G. J., van der Graaf, Y., Geerlings, M. I., & the SMART Study Group (2017) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12662 · Cited by 14 · see citing works
Self-citationWang, J., Caprio, T. V., Temkin‐Greener, H., Cai, X., Simning, A., & Li, Y. (2020) · Journal of Aging and Health · doi:10.1177/0898264319899211 · Cited by 14 · see citing works
Smith, S., Paparo, J., & Wootton, B. M. (2021) · Clinical Psychologist · doi:10.1080/13284207.2021.1892453 · Cited by 13 · see citing works
Preconception depression reduces fertility: a couple-based prospective preconception cohort
Liao, T., Gao, Y., Yang, X., Tang, Y., Wang, B., Yang, Q., Gao, X. Y., Tang, Y., He, K., Shen, J., et al. (2024) · Human Reproduction Open · doi:10.1093/hropen/hoae032 · Cited by 13 · see citing works
Reduced Inhibition of Return to Food Images in Obese Individuals
Carters, M. A., Rieger, E., & Bell, J. (2015) · PLoS ONE · doi:10.1371/journal.pone.0137821 · Cited by 13 · see citing works
Depressive symptoms among surrogate decision makers in Lebanese ICUs.
Abou-Mrad, F., Mourad, C. J., & Najem, C. E. (2012) · Europe PMC (PubMed Central) · Cited by 13 · see citing works
Determinants of depressive mood states in everyday life: An experience sampling study
Fuller‐Tyszkiewicz, M., Karvounis, T., Pemberton, R., Hartley-Clark, L., & Richardson, B. (2017) · Motivation and Emotion · doi:10.1007/s11031-017-9620-z · Cited by 13 · see citing works
Interrelated Neuromuscular and Clinical Risk Factors That Contribute to Falls
Ward, R. E., Quach, L., Welch, S. A., Leveille, S. G., Leritz, E. C., & Bean, J. F. (2019) · The Journals of Gerontology Series A · doi:10.1093/gerona/glz030 · Cited by 13 · see citing works
Spirituality and Quality of Life among Parents of Adolescents with Spina Bifida
Taha, A. A., Eisen, A. M., Rahman, H. Q. A., Abdul-Rahman, T. Q., La, S., Hanes, D. A., & Zouros, A. (2020) · Western Journal of Nursing Research · doi:10.1177/0193945920976407 · Cited by 14 · see citing works
Wilfley, D. E., Fitzsimmons‐Craft, E. E., Eichen, D. M., Buren, D. J. V., Welch, R. R., Robinson, A. H., Jo, B., Raghavan, R., Proctor, E. K., Wilson, G. T., et al. (2018) · Contemporary Clinical Trials · doi:10.1016/j.cct.2018.07.002 · Cited by 12 · see citing works
The Patient Health Questionnaire depression screener in spinal cord injury
Poritz, J. M. P., Mignogna, J., Christie, A. J., Holmes, S. A., & Ames, H. (2017) · Journal of Spinal Cord Medicine · doi:10.1080/10790268.2017.1294301 · Cited by 13 · see citing works
Tsantila, F., Coppens, E., Witte, H. D., Arensman, E., Amann, B. L., Pashoja, A. C., Corcoran, P. E., Cresswell‐Smith, J., Cully, G., Tóth, M. D., et al. (2023) · International Archives of Occupational and Environmental Health · doi:10.1007/s00420-023-01996-3 · Cited by 12 · see citing works
Twait, E. L., Kamarioti, M., Verberk, I. M. W., Teunissen, C. E., Nooyens, A. C. J., Verschuren, W. M. M., Visser, P. J., Huisman, M. A., Kok, A. A. L., Slagboom, P. E., et al. (2024) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2024.03.004 · Cited by 12 · see citing works
Self-citationLoeb, D. F., Sieja, A., Corral, J., Zehnder, N. G., Guiton, G., & Nease, D. E. (2014) · American Journal of Medical Quality · doi:10.1177/1062860614532681 · Cited by 12 · see citing works
Martin-Key, N. A., Olmert, T., Barton‐Owen, G., Han, S. Y. S., Cooper, J. D., Eljasz, P., Farrag, L. P., Friend, L. V., Bell, E., Cowell, D., et al. (2021) · Brain and Behavior · doi:10.1002/brb3.2167 · Cited by 12 · see citing works
de Hartog-Keyzer, J. M. L., Pedersen, S. S., Messaoudi, S. E., Nijveldt, R., & Pop, V. J. M. (2022) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2022.110980 · Cited by 16 · see citing works
- Authors
- Zuithoff, N. P., Vergouwe, Y., King, M., Nazareth, I., van Wezep, M. J., Moons, K. G., & Geerlings, M. I.
- Affiliations
- University Medical Center Utrecht (NL)
- The Royal Free Hospital (GB)
- Corresponding author
- Geerlings, Mirjam I
- Venue
- BMC Family Practice
- Published
- 2010-12
- Volume
- 11
- Issue
- 1
- Pages
- 98-98
- ISSN
- 1471-2296 (ISSN-L)
- PMC
- PMC3009622
- OpenAlex
- W2083648129
- Cited by
- 218
- References
- 37
- Citations by year
- 2026: 6 · 2025: 23 · 2024: 21 · 2023: 18 · 2022: 9 · 2021: 15 · 2020: 15 · 2019: 12 · 2018: 9 · 2017: 10 · 2016: 21 · 2015: 15 · 2014: 9 · 2013: 16 · 2012: 11
- FWCI
- 13.32
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Family Practice (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- European Commission (PREDICT-QL4-CT2002-00683)
- ZonMw
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (016.046.360)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Social Psychology › Mental Health Treatment and Access
- Health Sciences › Medicine › Pharmacology › Treatment of Major Depression
- Keywords
- PHQ-9, PHQ-2, major depressive disorder, depression screening, primary care, diagnostic accuracy, screening thresholds, sensitivity and specificity, construct validity, test-retest reliability, Composite International Diagnostic Interview
- MeSH terms
- Adult, Aged, Algorithms, Cross-Sectional Studies, Major Depressive Disorder, Female, Humans, Interviews as Topic, Male, Middle Aged, Netherlands, Primary Health Care, Prospective Studies, Psychiatric Status Rating Scales, Psychometrics, Surveys and Questionnaires, ROC Curve, Sensitivity and Specificity, Reproducibility of Results, General Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
