Diagnosing ICD-10 Depressive Episodes: Superior Criterion Validity of the Patient Health Questionnaire
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Background: Diagnosing and monitoring depression in primary care remains an issue of significant public health concern. Clinicians and researchers need to know if any one screening instrument is superior to the others in diagnosing ICD-10 depressive episodes. This study aimed to examine the criterion validity for diagnosing ICD-10 depressive episodes of the Patient Health Questionnaire (PHQ) in comparison with 2 well-established instruments, the Hospital Anxiety and Depression Scale (HADS), and the WHO Well-Being Index 5 (WBI-5). Methods: Five hundred and one medical outpatients completed the questionnaires and had a clinical interview. The presence of a depressive episode was determined with the International Diagnostic Checklists (IDCL) for ICD-10 as the criterion standard. Coefficient kappa (ĸ), sensitivities and specificities were calculated and a statistical comparison of the areas under the receiver operating characteristic curves was performed. Results: Diagnostic agreement between the questionnaires and the IDCL was moderate (ĸ = 0.34–0.56), with the highest values for the PHQ. While all 3 questionnaires had reasonable sensitivity and specificity, the operating characteristics for the PHQ were significantly superior to both the HADS and the WBI-5 (p = 0.02). Conclusions: Any of the 3 screening instruments can be recommended for clinical use. However, this is the first comparative study to demonstrate the diagnostic advantage of a particular depression-screening instrument using the ICD-10 diagnostic criteria. The superior criterion validity of the PHQ is likely attributable to its closer representation of the current concept of depressive disorders.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The PHQ-9 has demonstrated good sensitivity, specificity, and convergent validity [49,50].”
In the citing paper
“Earlier studies in primary care show that PHQ-9 detects depression with a sensitivity around 90% and a specificity ranging from 77% to 88% when using the cut-off ≥ 10. 15,17,23,24”
From Comparison of two self-rating scales to detect depression: HADS and PHQ-9 (2009) · cites this paper as [17]
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
The Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802
LOWE, B. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00237-9 · Cited by 1,060
Self-citationMünster, R. D. (1999) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026//0084-5345.28.1.68 · Cited by 1,010
Ormel, E. A. (1995) · PsycEXTRA Dataset · doi:10.1037/e536912011-072 · Cited by 706
Screening for Depression: Recommendations and Rationale
U.S. Preventive Services Task Force* (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-10-200205210-00012 · Cited by 526
Research works printed but not linked: 1
- 10.1001/jama.272.22.1741 · DOI · Paper page
Cited by
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Self-citationLöwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008) · Medical Care · doi:10.1097/mlr.0b013e318160d093 · Cited by 4,527
Self-citationLöwe, B., Wahl, I., Rose, M., Spitzer, C., Glaesmer, H., Wingenfeld, K., Schneider, A., & Brähler, E. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.06.019 · Cited by 2,473
Self-citationPrevalence and correlates of depression, anxiety, and suicidality among university students
Eisenberg, D., Gollust, S. E., Golberstein, E., & Hefner, J. L. (2007) · American Journal of Orthopsychiatry · doi:10.1037/0002-9432.77.4.534 · Cited by 1,592
Detecting and monitoring depression with a two-item questionnaire (PHQ-2)
Löwe, B., Kroenke, K., & Gräfe, K. (2005) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2004.09.006 · Cited by 1,473
“Recent studies have shown the validity of the German PHQ [8–11,13,20]; furthermore, results from the German and American PHQ validation studies are similar with respect to criterion validity, construct validity, internal consistency, sensitivity to change, and recommended cut-off scores [6–8,10–12].”
ResultSelf-citationMonitoring Depression Treatment Outcomes With the Patient Health Questionnaire-9
L??we, B., Un??tzer, J., Callahan, C. M., Perkins, A. J., & Kroenke, K. (2004) · Medical Care · doi:10.1097/00005650-200412000-00006 · Cited by 1,354
Self-citationGilbody, S., Richards, D., Brealey, S., & Hewitt, C. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0333-y · Cited by 1,290
“Six studies reported a range of cut points for the PHQ9 (Table 4).(11,35,36,48,49,52) The recommended cut point of ≥10 represented the optimum cut point in only one of these studies.”
BackgroundMethodHelp-Seeking and Access to Mental Health Care in a University Student Population
Eisenberg, D., Golberstein, E., & Gollust, S. E. (2007) · Medical Care · doi:10.1097/mlr.0b013e31803bb4c1 · Cited by 1,131
“The PHQ-9 has not been validated specifically in college populations, but has been validated in a wide variety of other populations.(31,32,34,35,38) Symptoms of generalized anxiety and panic disorder over the past 4 weeks were measured using the PHQ anxiety module.”
MethodSocial support and mental health among college students.
Hefner, J., & Eisenberg, D. (2009) · American Journal of Orthopsychiatry · doi:10.1037/a0016918 · Cited by 810
“…Kroenke, & Spitzer, 2001; Henkel et al., 2004; Kroenke, Spitzer, & Williams, 2001; Lowe et al., 2004) and other depression assessment tools (Henkel et al., 2004; Lowe et al., 2004; Martin, Rief, Klaiberg, Braehler, 2006; Kroenke, Spitzer, & Williams, 2001) in a variety of populations.”
BackgroundMethodInfluentialEisenberg, D., Hunt, J., & Speer, N. (2013) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e31827ab077 · Cited by 728
“This screen has been validated as highly correlated with diagnoses by clinicians and other depression assessment tools in a variety of populations, including young adults (Lowe et al., 2004; Martin et al., 2006).”
Depression, anxiety and somatization in primary care: Syndrome overlap and functional impairment
Löwe, B., Spitzer, R. L., Williams, J. B. W., Mussell, M., Schellberg, D., & Kroenke, K. (2008) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2008.01.001 · Cited by 706
“Superior criterion validity of the PHQ compared to other established self-report questionnaires was confirmed with respect to the diagnoses of “major depressive disorder” and “other depressive disorders” made by a standard interview in assessing psychiatric disorders [28,35].”
ResultSelf-citationMental Health Service Utilization Among College Students in the United States
Eisenberg, D., Hunt, J., Speer, N., & Zivin, K. (2011) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e3182175123 · Cited by 633
“A number of studies have confirmed the validity of both the depression (Diez-Quevedo et al., 2001; Lowe et al., 2004; Martin et al., 2006) and anxiety instruments in the PHQ (Löwe et al.”
BackgroundMental Disorder Symptoms among Public Safety Personnel in Canada
Carleton, R. N., Afifi, T. O., Turner, S., Taillieu, T., Duranceau, S., LeBouthillier, D. M., Sareen, J., Ricciardelli, R., MacPhee, R. S., Groll, D., et al. (2018) · The Canadian Journal of Psychiatry · doi:10.1177/0706743717723825 · Cited by 558
An arabic translation, reliability, and validation of Patient Health Questionnaire in a Saudi sample
AlHadi, A. N., AlAteeq, D. A., Al-Sharif, E., Bawazeer, H. M., Alanazi, H., AlShomrani, A. T., Shuqdar, R. M., & AlOwaybil, R. (2017) · Annals of General Psychiatry · doi:10.1186/s12991-017-0155-1 · Cited by 523
“The PHQ had better diagnostic accuracy compared to the two well-established instruments [5].”
MethodKeyes, C. L. M., Eisenberg, D., Perry, G. S., Dube, S. R., Kroenke, K., & Dhingra, S. S. (2012) · Journal of American College Health · doi:10.1080/07448481.2011.608393 · Cited by 480
Adewuya, A. O., Ola, B. A., & Afolabi, O. O. (2006) · Journal of Affective Disorders · doi:10.1016/j.jad.2006.05.021 · Cited by 474
Exposures to potentially traumatic events among public safety personnel in Canada
Carleton, R. N., Afifi, T. O., Taillieu, T., Turner, S., Krakauer, R., Anderson, G. S., MacPhee, R. S., Ricciardelli, R., Cramm, H. A., Groll, D., et al. (2019) · Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement · doi:10.1037/cbs0000115 · Cited by 324
Cranford, J. A., Eisenberg, D., & Serras, A. M. (2009) · Addictive Behaviors · doi:10.1016/j.addbeh.2008.09.004 · Cited by 312
“…of mental health symptoms have been validated in a variety of populations (e.g., Diez-Quevedo, Rangil, Sanchez-Planell, Kroenke, & Spitzer, 2001; Henkel, Mergl, Kohnen, Allgaier, Moller, & Hegerl, 2004; Kroenke, Spitzer, & Williams, 2001; Lowe, Grafe, Zipfel, Witte, Loerch, & Herzog, 2004).”
Beutel, M. E., Jünger, C., Klein, E. M., Wild, P., Lackner, K., Blettner, M., Binder, H., Michal, M., Wiltink, J., Brähler, E., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0155357 · Cited by 277
“A PHQ-9 sum score of 10 was used for the definition of caseness for depression yielding a sensitivity of 81% and a specificity of 82% for any depressive disorder[19].”
MethodEll, K., Xie, B., Quon, B., Quinn, D. I., Dwight-Johnson, M., & Lee, P.-J. (2008) · Journal of Clinical Oncology · doi:10.1200/jco.2008.16.6371 · Cited by 270
“In recent years, the PHQ-9 has emerged as a reliable depression screening tool in primary care, with a demonstrated ability to identify clinically important depression, to make accurate diagnoses of major depression, to track severity of depression over time, and to monitor significant improvement in response to thera…”
MethodLipson, S. K., Zhou, S., Wagner, B., Beck, K., & Eisenberg, D. (2016) · Journal of College Student Psychotherapy · doi:10.1080/87568225.2016.1105657 · Cited by 264
“Across settings and populations, the PHQ-9 has been validated as internally consistent and highly correlated with clinical diagnosis (Diez-Quevedo, Rangil, SanchezPlanell, Kroenke, & Spitzer, 2001; Löwe et al., 2004).”
MethodComparison of two self-rating scales to detect depression: HADS and PHQ-9
Hansson, M., Chotai, J., Nordstöm, A., & Bodlund, O. (2009) · British Journal of General Practice · doi:10.3399/bjgp09x454070 · Cited by 246
“Earlier studies in primary care show that PHQ-9 detects depression with a sensitivity around 90% and a specificity ranging from 77% to 88% when using the cut-off ≥10.(15,17,23,24) However, some studies recommend a higher cut-off such as ≥11 or ≥12 to improve the balance between sensitivity and How this fits in”
BackgroundAnxiety and depression in patients with pulmonary hypertension.
Löwe, B., Gräfe, K., Ufer, C., Kroenke, K., Grünig, E., Herzog, W., & Borst, M. M. (2004) · Psychosomatic Medicine · doi:10.1097/01.psy.0000145593.37594.39 · Cited by 230
Satisfaction with information and unmet information needs in men and women with cancer
Faller, H., Koch, U., Brähler, E., Härter, M., Keller, M., Schulz, H., Wegscheider, K., Weis, J., Boehncke, A., Hund, B., et al. (2016) · Journal of Cancer Survivorship · doi:10.1007/s11764-015-0451-1 · Cited by 226
“However, excellent psychometric properties of the PHQ-9 and the GAD-7 have been established [31–35].”
BackgroundMethodVariations in Student Mental Health and Treatment Utilization Across US Colleges and Universities
Ketchen Lipson, S., Gaddis, S. M., Heinze, J., Beck, K., & Eisenberg, D. (2015) · Journal of American College Health · doi:10.1080/07448481.2015.1040411 · Cited by 215
“Across multiple settings and populations, scholars have found the PHQ-9 internally consistent and highly correlated with clinical diagnosis.(23,24)”
BackgroundAlAteeq, D. A., Aljhani, S., Althiyabi, I., & Majzoub, S. (2020) · Journal of Infection and Public Health · doi:10.1016/j.jiph.2020.08.013 · Cited by 216
Corson, K., Gerrity, M., & Dobscha, S. K. (2004) · PubMed · Cited by 214
Sun, P., Wang, M., Song, T., Wu, Y., Luo, J., Chen, L., & Yan, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.626547 · Cited by 204
“, 2006); the Patient Health Questionnaire (PHQ-9):mild (score of 5–9), moderate (score 10–14), moderately severe (score 15–19), or severe (score 20–27) (Löwe et al., 2004); Selfrating Anxiety Scale (SAS): a score of 50–59 indicated mild anxiety, 60–69 indicated moderate anxiety, and ≥70 indicated severe anxiety; Self-…”
BackgroundNew Roles for Pharmacists in Community Mental Health Care: A Narrative Review
Rubio-Valera, M., Chen, T., & O'Reilly, C. (2014) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph111010967 · Cited by 199
“validity, feasibility and practicality, and a number of depression screening tools have shown to be reliable and valid in primary care settings such as the Patient Health Questionnaire (PHQ) or the WHO-5 Wellbeing Index [31–33].”
MethodWahl, I., Löwe, B., Bjorner, J. B., Fischer, F., Langs, G., Voderholzer, U., Aita, S. A., Bergemann, N., Brähler, E., & Rose, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.04.019 · Cited by 193
“The clinical samples were consecutively drawn within clinical routines or crosssectional studies [37,43,44], including in- and outpatients with mental and/or medical conditions being treated in 7 hospitals and 12 family practices across Germany.”
BackgroundSelf-citationGastrointestinal symptoms in primary care: Prevalence and association with depression and anxiety
Mussell, M., Kroenke, K., Spitzer, R. L., Williams, J. B. W., Herzog, W., & Löwe, B. (2008) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2008.02.019 · Cited by 192
“Superior criterion validity of the PHQ compared to other established self-report questionnaires was confirmed with respect to the diagnoses of “major depressive disorder” and “other depressive disorders” made by way of a standard interview in assessing psychiatric disorders [22,29].”
ResultSelf-citationSerras, A., Saules, K. K., Cranford, J. A., & Eisenberg, D. (2010) · Psychology of Addictive Behaviors · doi:10.1037/a0017210 · Cited by 171
Brain systems for baroreflex suppression during stress in humans
Gianaros, P. J., Onyewuenyi, I. C., Sheu, L. K., Christie, I. C., & Critchley, H. D. (2012) · Human Brain Mapping · doi:10.1002/hbm.21315 · Cited by 166
Predictors of depression in a sample of 1,021 primary care patients with osteoarthritis
Rosemann, T., Backenstrass, M., Joest, K., Rosemann, A., Szecsenyi, J., & Laux, G. (2007) · Arthritis Care & Research · doi:10.1002/art.22624 · Cited by 162
Hartung, T. J., Friedrich, M., Johansen, C., Wittchen, H., Faller, H., Koch, U., Brähler, E., Härter, M., Keller, M., Schulz, H., et al. (2017) · Cancer · doi:10.1002/cncr.30846 · Cited by 155
“11 47 (39-55) 84 (83-86) 31 (27-35) 14 (11-17) 97 (96-97) 82 (81-84) 0.”
Rationale and Design of the Hamburg City Health Study
Jagodzinski, A., Johansen, C., Koch, U., Aarabi, G., Adam, G., Anders, S., Augustin, M., der Kellen, R. B., Beikler, T., Behrendt, C., et al. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00577-4 · Cited by 162
Self-citationBrockmeyer, T., Zimmermann, J., Kulessa, D., Hautzinger, M., Bents, H., Friederich, H., Herzog, W., & Backenstraß, M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01564 · Cited by 203
Self-citationMikolajczyk, R., Brzoska, P., Maier, C., Ottova, V., Meier, S., Dudziak, U., Ilieva, S., & Ansari, W. E. (2008) · BMC Public Health · doi:10.1186/1471-2458-8-215 · Cited by 146
“In addition, the WHO-5 scale applied in our analysis draws its name from the general well-being item but can also be used for the assessment of depression [42].”
MethodDepression, Chronic Pain, and Suicide by Overdose: On the Edge
Cheatle, M. D. (2011) · Pain Medicine · doi:10.1111/j.1526-4637.2011.01131.x · Cited by 142
Hall, G. B., Dollard, M. F., Winefield, A. H., Dormann, C., & Bakker, A. B. (2012) · Anxiety Stress & Coping · doi:10.1080/10615806.2012.700477 · Cited by 172
Mental health training, attitudes toward support, and screening positive for mental disorders
Carleton, R. N., Afifi, T. O., Turner, S., Taillieu, T., Vaughan, A. D., Anderson, G. S., Ricciardelli, R., MacPhee, R. S., Cramm, H. A., Czarnuch, S., et al. (2020) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2019.1575900 · Cited by 135
“…Questionnaire (PHQ-9; Beard, Hsu, Rifkin, Busch, & Bjorgvinsson, 2016; Kroenke, Spitzer, & Williams, 2001; Kroenke, Spitzer, Williams, & Lowe, 2010; Lowe et al., 2004); past 2-week GAD was assessed using the seven-item GAD-7 (Beard & Bjorgvinsson, 2014; Kroenke et al., 2010; Spitzer, Kroenke,…”
Responsiveness of the PHQ-9 to Psychopharmacological Depression Treatment
Löwe, B., Karapanagiotou‐Schenkel, I., Carney, C. P., & Göbel, C. (2005) · Psychosomatics · doi:10.1176/appi.psy.47.1.62 · Cited by 146
Self-citationRose, D. M., Seidler, A., Nübling, M., Latza, U., Brähler, E., Klein, E. M., Wiltink, J., Michal, M., Nickels, S., Wild, P. S., et al. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1237-y · Cited by 154
“Depression was measured by the Patient Health Questionnaire (PHQ-9); caseness of depression was defined by a score ≥ 10 with a sensitivity of 81% and a specificity of 82% for depressive disorder [25].”
MethodInflammatory Pathways Link Socioeconomic Inequalities to White Matter Architecture
Gianaros, P. J., Marsland, A. L., Sheu, L. K., Erickson, K. I., & Verstynen, T. D. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs191 · Cited by 125
Körber, S., Frieser, D., Steinbrecher, N., & Hiller, W. (2011) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2011.01.006 · Cited by 124
“92 [35,36].”
Associations between depression and different measures of obesity (BMI, WC, WHtR, WHR)
Wiltink, J., Michal, M., Wild, P. S., Zwiener, I., Blettner, M., Münzel, T. F., Schulz, A., Kirschner, Y., & Beutel, M. E. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-223 · Cited by 131
“Depression was measured by the Patient Health Questionnaire (PHQ-9); caseness was defined by a score ≥ 10 with a sensitivity of 81% and a specificity of 82% for depressive disorder [27].”
MethodInterian, A., Allen, L. A., Gara, M. A., Escobar, J. I., & Díaz-Martínez, A. M. (2006) · Psychosomatics · doi:10.1176/appi.psy.47.5.392 · Cited by 134
Mental health among currently enrolled medical students in Germany
Wege, N., Muth, T., Li, J., & Angerer, P. (2016) · Public Health · doi:10.1016/j.puhe.2015.12.014 · Cited by 126
Ell, K., Unützer, J., Aranda, M., Sanchez, K., & Lee, P.-J. (2006) · Home Health Care Services Quarterly · doi:10.1300/j027v24n04_01 · Cited by 109
Schwille-Kiuntke, J., Enck, P., Zendler, C., Krieg, M., Polster, A. V., Klosterhalfen, S., Autenrieth, I. B., Zipfel, S., & Frick, J.-S. (2011) · Neurogastroenterology & Motility · doi:10.1111/j.1365-2982.2011.01779.x · Cited by 110
Self-citationDepression and anxiety in patients with different rare chronic diseases: A cross-sectional study.
Uhlenbusch, N., Löwe, B., Härter, M., Schramm, C., Weiler-Normann, C., & Depping, M. K. (2019) · PLoS ONE · doi:10.1371/journal.pone.0211343 · Cited by 111
Self-citationPsychiatric Comorbidity and Work Disability in Patients With Inflammatory Rheumatic Diseases
Löwe, B., Willand, L., Eich, W., Zipfel, S., Ho, A. D., Herzog, W., & Fiehn, C. (2004) · Psychosomatic Medicine · doi:10.1097/00006842-200405000-00019 · Cited by 107
Self-citationMaatouk, I., Herzog, W., Boehlen, F. H., Quinzler, R., Löwe, B., Saum, K.-U., Brenner, H., & Wild, B. (2016) · Journal of Hypertension · doi:10.1097/hjh.0000000000001006 · Cited by 123
“9 in detecting depression in a validation study, when a cutpoint of 10 or greater was applied [73].”
Self-citationDepression, Anxiety, and Cognitive Impairment: Comorbid Mental Health Disorders in Heart Failure
Angermann, C. E., & Ertl, G. (2018) · Current Heart Failure Reports · doi:10.1007/s11897-018-0414-8 · Cited by 124
Prevalence of distress, comorbid conditions and well being in the general population
Wiltink, J., Beutel, M. E., Till, Y., Ojeda, F., Wild, P. S., Münzel, T. F., Blankenberg, S., & Michal, M. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2010.10.041 · Cited by 120
“Caseness of depression was defined with a score of PHQ9≥10, indicating moderate to severe depressive symptoms for the last 2 weeks (Löwe et al., 2004).”
Faller, H., Störk, S., Schüler, M., Schowalter, M., Steinbüchel, T., Ertl, G., & Angermann, C. E. (2008) · Journal of Cardiac Failure · doi:10.1016/j.cardfail.2008.10.022 · Cited by 111
Ell, K., Katon, W. J., Cabassa, L. J., Xie, B., Lee, P.-J., Kapetanovic, S., & Guterman, J. (2009) · The International Journal of Psychiatry in Medicine · doi:10.2190/pm.39.2.a · Cited by 104
“The PHQ-9 is a reliable depression screening tool in primary care with a demonstrated ability to identify clinical depression, make accurate diagnoses of major depressive disorder, track severity of depression over time [36-41], and monitor patient response to therapy in-person or via telephone [42].”
MethodKerahrodi, J. G., Brähler, E., Wiltink, J., Michal, M., Schulz, A., Wild, P. S., Münzel, T. F., Toenges, G., Lackner, K. J., Pfeiffer, N., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-56440-9 · Cited by 100
Beutel, M. E., Jünger, C., Klein, E. M., Wild, P. S., Lackner, K. J., Blettner, M., Banerjee, M., Michal, M., Wiltink, J., & Brähler, E. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0995-2 · Cited by 106
“[22] suicidal ideation was assessed by the item “In the last 2 weeks, have you had thoughts that you would be better off dead or of hurting yourself in some way?” of the depression module of the Patient Health Questionnaire (PHQ-9; [18, 23]).”
MethodSnijkers, J. T. W., van den Oever, W., Weerts, Z. Z. R. M., Vork, L., Mujagic, Z., Leue, C., Hesselink, M., Kruimel, J. W., Muris, J. W. M., Bogie, R. M. M., et al. (2021) · Neurogastroenterology & Motility · doi:10.1111/nmo.14161 · Cited by 104
Beutel, M. E., Fischbeck, S., Binder, H., Blettner, M., Brähler, E., Emrich, K., Friedrich-Mai, P., Imruck, B. H., Weyer, V., & Zeißig, S. R. (2015) · PLoS ONE · doi:10.1371/journal.pone.0116440 · Cited by 85
“The EORTC QLQ30 and the PHQ-9 were completed by 2515 participants with comparable response rates (57.7”
MethodInfluentialRosenkranz, T., Takano, K., Watkins, E. R., & Ehring, T. W. (2020) · PLoS ONE · doi:10.1371/journal.pone.0231783 · Cited by 99
Depression and Survival in Chronic Heart Failure: Does Gender Play a Role?
Faller, H., Störk, S., Schowalter, M., Steinbüchel, T., Wollner, V., Ertl, G., & Angermann, C. E. (2007) · European Journal of Heart Failure · doi:10.1016/j.ejheart.2007.06.011 · Cited by 82
“The PHQ-9 diagnosis of depression compares favourably to other screening instruments in validation studies using the Structured Clinical Interviews for ICD-10 [16] or DSM-IVas reference standards [17].”
MethodHigh prevalence of somatic symptoms and depression in women with disabling chronic headache
Tietjen, G. E., Brandes, J. L., Digre, K. B., Baggaley, S. K., Martin, V., Recober, A., Geweke, L. O., Hafeez, F., Aurora, S. K., Herial, N. A., et al. (2007) · Neurology · doi:10.1212/01.wnl.0000251195.55563.02 · Cited by 83
Depression care for the elderly: reducing barriers to evidence based practice
Ell, K. (2006) · Home Health Care Services Quarterly · doi:10.1300/j027v25n01_07 · Cited by 78
Provincial Correctional Service Workers: The Prevalence of Mental Disorders
Carleton, R. N., Ricciardelli, R., Taillieu, T., Mitchell, M. M., Andres, E., & Afifi, T. O. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17072203 · Cited by 102
Ell, K., Xie, B., Kapetanovic, S., Quinn, D. I., Lee, P.-J., Wells, A., & Chou, C.-P. (2011) · Psychiatric Services · doi:10.1176/appi.ps.62.2.162 · Cited by 79
Hahad, O., Beutel, M. E., Gori, T., Schulz, A., Blettner, M., Pfeiffer, N., Rostock, T., Lackner, K. J., Sørensen, M., Prochaska, J. H., et al. (2018) · International Journal of Cardiology · doi:10.1016/j.ijcard.2018.03.126 · Cited by 90
Rezapour, J., Nickels, S., Schuster, A. K.-G., Michal, M., Münzel, T. F., Wild, P. S., Schmidtmann, I. M., Lackner, K. J., Schulz, A., Pfeiffer, N., et al. (2018) · BMC Ophthalmology · doi:10.1186/s12886-018-0831-1 · Cited by 85
Rogiers, A., Boekhout, A. H., Schwarze, J. K., Awada, G., Blank, C. U., & Neyns, B. (2019) · Journal of Oncology · doi:10.1155/2019/5269062 · Cited by 79
Medication adherence among patients with chronic diseases: a survey-based study in pharmacies
Jüngst, C., Gräber, S., Simons, S., Wedemeyer, H., & Lammert, F. (2019) · QJM: An International Journal of Medicine · doi:10.1093/qjmed/hcz058 · Cited by 69
A Neural Circuitry Linking Insulin Resistance to Depressed Mood
Ryan, J. P., Sheu, L. K., Critchley, H. D., & Gianaros, P. J. (2012) · Psychosomatic Medicine · doi:10.1097/psy.0b013e31824d0865 · Cited by 68
“Respondents were screened to exclude those with a) a self-reported history of cardiovascular disease (including treatment or diagnoses of hypertension, stroke, myocardial infarction, congestive heart failure, and atrial or ventricular arrhythmias); b) prior cardiovascular surgery (including coronary bypass, carotid ar…”
MethodInfluentialEsler, D., Johnston, F. H., & Thomas, D. (2007) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1467-842x.2007.00058.x · Cited by 68
A feasibility study of community pharmacists performing depression screening services
O’Reilly, C. L., Wong, E., & Chen, T. F. (2014) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2014.08.013 · Cited by 74
Clinical management of depression and anxiety in HIV-infected adults
Basu, S., Chwastiak, L., & Bruce, R. D. (2005) · AIDS · doi:10.1097/01.aids.0000182518.84407.32 · Cited by 68
“Although the Hospital Anxiety and Depression Scale (HADS) is one such validated scale that has been specifically designed to exclude somatic items [26], the Patient Health Questionnaire (PHQ) version of the PRIME-MD diagnostic instrument may be the most clinically useful depression screen.”
MethodMichal, M., Wiltink, J., Lackner, K. J., Wild, P. S., Zwiener, I., Blettner, M., Münzel, T. F., Schulz, A., Kirschner, Y., & Beutel, M. E. (2013) · Journal of Hypertension · doi:10.1097/hjh.0b013e32835f5768 · Cited by 76
“com caseness for depression yielding a sensitivity of 81% and a specificity of 82% for any depressive disorder [21].”
BackgroundEllis, T. E., Rufino, K. A., Allen, J. G., Fowler, J. C., & Jobes, D. A. (2015) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12151 · Cited by 66
Depression in Atrial Fibrillation in the General Population
Schnabel, R. B., Michal, M., Wilde, S., Wiltink, J., Wild, P. S., Sinning, C., Lubos, E., Ojeda, F., Zeller, T., Münzel, T. F., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0079109 · Cited by 74
“A PHQ-9 sum score of $10 was used for the definition of caseness for depression [11].”
MethodThe prevalence of unrecognized depression in patients with acute coronary syndrome
Amin, A. A., Jones, A. M. H., Nugent, K., Rumsfeld, J. S., & Spertus, J. A. (2006) · American Heart Journal · doi:10.1016/j.ahj.2006.05.006 · Cited by 68
Depression among caregivers of patients with dementia
Alfakhri, A. S., Alshudukhi, A. W., Alqahtani, A. A., Alhumaid, A. M., Alhathlol, O. A., Almojali, A. I., Alotaibi, M. A., & Alaqeel, M. K. (2018) · INQUIRY The Journal of Health Care Organization Provision and Financing · doi:10.1177/0046958017750432 · Cited by 63
“We chose the PHQ-9 because it is considered the best and most widely used instrument for screening depression in the primary care settings.(13,14) Comparing our results with those derived from the general population, we found moderately increased depression scores in our study population.”
ResultMontalbán, S. R., Vives, Á. C., & García-García, M. (2010) · PubMed · Cited by 63
Wiltink, J., Kliem, S., Michal, M., Subič-Wrana, C., Reiner, I., Beutel, M. E., Brähler, E., & Zwerenz, R. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1545-2 · Cited by 70
“Depression was measured by the Patient Health Questionnaire (PHQ-9 [24, 25]).”
MethodFaller, H., Störk, S., Schowalter, M., Steinbüchel, T., Wollner, V., Ertl, G., & Angermann, C. E. (2007) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2007.06.026 · Cited by 72
“Depression was measured using the German version of the Patient Health Questionnaire depression module PHQ-9 [17–19].”
MethodBabb, S. J., Rufino, K. A., & Johnson, R. (2021) · Adult Education Quarterly · doi:10.1177/07417136211027508 · Cited by 83
Hahad, O., Beutel, M. E., Gilan, D., Michal, M., Schulz, A., Pfeiffer, N., König, J., Lackner, K. J., Wild, P. S., Daiber, A., et al. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.06.083 · Cited by 70
Ellis, T. E., & Rufino, K. A. (2016) · Archives of Suicide Research · doi:10.1080/13811118.2015.1093983 · Cited by 61
“The PHQ-9 is considered a valid measure of depressive symptoms (Löwe et al., 2004; Löwe, Kroenke, Herzog, & Gräfe, 2004; Löwe, Unützer, Callahan, Perkins, & Kroenke, 2004).”
Medical patients’ attitudes toward emotional problems and their treatment: What do they really want?
Löwe, B., Schulz, U., Gräfe, K., & Wilke, S. (2005) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2005.0266.x · Cited by 60
“Psychotherapyz 25 (29) 13 (14) No treatmentz‰ 21 (25) 45 (50) Improvement of medical care (e.”
Self-citationEllis, T. E., Rufino, K. A., & Allen, J. G. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.01.032 · Cited by 59
“” Prior research has found support for the psychometric properties of the WHO-5 (Bech et al., 2003; Lowe et al., 2004b).”
BackgroundResultBeutel, M. E., Brähler, E., Wiltink, J., Kerahrodi, J. G., Burghardt, J., Michal, M., Schulz, A., Wild, P. S., Münzel, T. F., Schmidtmann, I. M., et al. (2018) · Psychological Medicine · doi:10.1017/s0033291718001848 · Cited by 70
Somatic correlates of comorbid major depression in patients with systolic heart failure
Angermann, C. E., Gelbrich, G., Störk, S., Schowalter, M., Deckert, J., Ertl, G., & Faller, H. (2009) · International Journal of Cardiology · doi:10.1016/j.ijcard.2009.07.044 · Cited by 62
A psychometric study of the Suicide Cognitions Scale with psychiatric inpatients.
Ellis, T. E., & Rufino, K. A. (2014) · Psychological Assessment · doi:10.1037/pas0000028 · Cited by 62
Test–retest reliability of an fMRI paradigm for studies of cardiovascular reactivity
Sheu, L. K., Jennings, J. R., & Gianaros, P. J. (2012) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01382.x · Cited by 67
“In brief, individuals responding to mass mailings were screened to exclude those with (i) a history of cardiovascular disease (including treatment for or diagnoses of hypertension, stroke, myocardial infarction, congestive heart failure, and atrial or ventricular arrhythmias); (ii) prior cardiovascular surgery (includ…”
BackgroundSleep Quality and Mental Disorder Symptoms among Canadian Public Safety Personnel
Angehrn, A., Sapach, M. J. N. T., Ricciardelli, R., MacPhee, R. S., Andérson, G. S., & Carleton, R. N. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17082708 · Cited by 81
Managing Depression in Home Health Care: A Randomized Clinical Trial
Ell, K., Unützer, J., Aranda, M., Gibbs, N. E., Lee, P.-J., & Xie, B. (2007) · Home Health Care Services Quarterly · doi:10.1300/j027v26n03_05 · Cited by 58
“…diagnoses of major depression (Kroenke & Spitzer, 2002), to track severity of depression over time (Löwe, Unützer, Callahan, Perkins, & Kroenke, 2004c) and to monitor patient response to therapy (Kroenke & Spitzer, 2002; Löwe, Gräfe, Zipfel, Witte, Loerch, & Herzog, 2004a; Löwe et al., 2004c).”
Norton, J. L., de Roquefeuil, G., David, M., Boulenger, J.-P., Ritchie, K. A., & MANN, A. H. (2009) · L Encéphale · doi:10.1016/j.encep.2008.06.018 · Cited by 70
Childhood physical abuse predicts stressor-evoked activity within central visceral control regions
Banihashemi, L., Sheu, L. K., Midei, A. J., & Gianaros, P. J. (2015) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu073 · Cited by 54
“…the Patient Health Questionnaire (PHQ; Spitzer et al., 1999), an inventory validated in outpatient (Spitzer et al., 1999; Kroenke et al., 2001; Lowe et al., 2004a) and community samples (Martin et al., 2006) for sensitivity and specificity against the Diagnostic and Statistical Manual of…”
BackgroundSchowalter, M., Gelbrich, G., Störk, S., Langguth, J.-P., Morbach, C., Ertl, G., Faller, H., & Angermann, C. E. (2012) · Clinical Research in Cardiology · doi:10.1007/s00392-012-0531-4 · Cited by 60
Depression and Anxiety are Common in Acute HIV Infection and Associate with Plasma Immune Activation
on behalf of the RV254/SEARCH 010 Study Group, Hellmuth, J. M., Colby, D. J., Valcour, V., Suttichom, D., Spudich, S., Ananworanich, J., Prueksakaew, P., Sailasuta, N., Allen, I. E., et al. (2017) · AIDS and Behavior · doi:10.1007/s10461-017-1788-4 · Cited by 66
“detecting depression compared to the HADS and the WHO Well-Being Index 5 based on ICD-10 diagnostic criteria [42, 45].”
Duration of untreated illness in patients with somatoform disorders
Herzog, A., Mora, M. C. S., Jordan, P., & Löwe, B. (2018) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2018.01.011 · Cited by 57
“PHQ-15 = Patient Health Questionnaire-15 (score range 0–30); PHQ-9 = Patient Health Questionnaire-9 (score range 0–27); GAD-7 = Generalized Anxiety Disorder Scale (score range 0–21); CIDI = Composite International Diagnostic Interview; differences in sample size were caused by missing data.”
MethodSelf-citationThe efficacy of focused acceptance and commitment therapy in VA primary care
Glover, N. G., Sylvers, P. D., Shearer, E. M., Kane, M.-C., Clasen, P. C., Epler, A. J., Plumb-Vilardaga, J. C., Bonow, J. T., & Jakupcak, M. (2016) · Psychological Services · doi:10.1037/ser0000062 · Cited by 46
Metadata
- Authors
- Löwe, B., Gräfe, K., Zipfel, S., Witte, S., Loerch, B., & Herzog, W.
- Affiliations
- Regenstrief Institute (US)
- Heidelberg University (DE)
- Venue
- Psychotherapy and Psychosomatics
- Publisher
- S. Karger AG
- Published
- 2004
- Volume
- 73
- Issue
- 6
- Pages
- 386-390
- ISSN
- 0033-3190 (ISSN-L)
- 1423-0348
- OpenAlex
- W2024751320
- Cited by
- 301
- References
- 14
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 8 · 2023: 11 · 2022: 11 · 2021: 19 · 2020: 10 · 2019: 19 · 2018: 19 · 2017: 17 · 2016: 12 · 2015: 18 · 2014: 15 · 2013: 18 · 2012: 10
- FWCI
- 18.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.karger.com/Services/SiteLicenses (vor)
- www.karger.com/Services/SiteLicenses (tdm)
- Locations
- Psychotherapy and Psychosomatics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Pfizer
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- depressive episodes, depression screening, Patient Health Questionnaire, ICD-10 diagnostic criteria, criterion validity, Hospital Anxiety and Depression Scale, primary care, diagnostic agreement, sensitivity and specificity
- MeSH terms
- Adult, Depressive Disorder, Diagnosis, Differential, Female, Humans, Male, Middle Aged, Primary Health Care, Psychiatric Status Rating Scales, Surveys and Questionnaires
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.