The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Psychometric Comparison of the PHQ-9 and BDI-II for Measuring Response during Treatment of Depression
Abstract
The Patient Health Questionnaire-9 Item (PHQ-9) and Beck Depression Inventory-II (BDI-II) are frequently used measures of depression severity, but little is known about their relative psychometric properties. The authors assessed psychometric properties of both measures during treatment for depression. The PHQ-9 and BDI-II scores from 172 depressed participants in two randomized controlled trials of treatment for depression were assessed and combined. Tests of internal consistency (Cronbach's α), factor analyses, correlational analyses, estimates of clinically significant change, and effect sizes (Cohen's d) were calculated after treatment and follow-up. Both scales demonstrated adequate internal consistency at pre- and posttreatment (PHQ-9 α = .74 and .81; BDI-II α = .87 and .90, respectively). Factor analysis failed to confirm the one-factor model previously reported for the PHQ-9, but two factors evidenced good fit for the BDI-II. Both scales converged more with each other than with the Sheehan Disability Scale at pre- but not at posttreatment. Responsiveness to change of PHQ-9 and BDI-II was similar at both posttreatment and follow-up. The consistency of agreement on indices of clinical significance was fair to moderate, but the BDI-II categorised a greater proportion of participants with severe depression than the PHQ-9. The BDI-II and PHQ-9 demonstrated adequate reliability, convergent/discriminant validity, and similar responsiveness to change. Differences were found in how they categorised severity. Pending the results of further studies, the attributes of the PHQ-9, of being shorter and based on the diagnostic criteria for depression, may indicate an advantage over the BDI-II.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The PHQ-9 has strong internal consistency (0.74-0.81), validity, and demonstrated responsiveness to change [32].”
From A randomized controlled trial of yoga vs nonaerobic exercise for veterans with PTSD: Understanding efficacy, mechanisms of change, and mode of delivery (2021) · cites this paper as [32]
In the citing paper
“Both PHQ-9 and GAD-7 are well-established measures with demonstrated good validity and reliability even when administered via the internet.49–51”
In the citing paper
“The PHQ-9 is brief, with strong sensitivity and specificity [59].”
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
Confirmatory factor analysis for applied research
Brown, T. A. (2007) · Choice Reviews Online · doi:10.5860/choice.44-2769 · Cited by 15,621
Journal of Clinical Psychiatry
(2018) · Journal of Clinical Psychiatry · doi:10.5505/kpd · Cited by 13,703
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Practical Statistics for Medical Research.
Walter, S., & Altman, D. G. (1992) · Biometrics · doi:10.2307/2532320 · Cited by 11,666
Practical Statistics for Medical Research.
Bartko, J. J., & Altman, D. G. (1992) · Journal of the American Statistical Association · doi:10.2307/2290246 · Cited by 4,834
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057
Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size.
Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.3.391 · Cited by 3,953
Dimidjian, S., Hollon, S. D., Dobson, K. S., Schmaling, K. B., Kohlenberg, R. J., Addis, M. E., Gallop, R., McGlinchey, J. B., Markley, D. K., Gollan, J. K., et al. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.4.658 · Cited by 1,607 · cited 2×
“cutoffs indicating clinical caseness using evidence from the literature (Dimidjian et al., 2006; Gilbody, Richards, Brealey, & Hewitt, 2007; Kroenke et al., 2001, 2010; Löwe et al., 2004).”
MethodMonitoring Depression Treatment Outcomes With the Patient Health Questionnaire-9
L??we, B., Un??tzer, J., Callahan, C. M., Perkins, A. J., & Kroenke, K. (2004) · Medical Care · doi:10.1097/00005650-200412000-00006 · Cited by 1,354
Gilbody, S., Richards, D., Brealey, S., & Hewitt, C. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0333-y · Cited by 1,290
Assessing Psychiatric Impairment in Primary Care with the Sheehan Disability Scale
Leon, A. C., Olfson, M., Portera, L., Farber, L., & Sheehan, D. V. (1997) · The International Journal of Psychiatry in Medicine · doi:10.2190/t8em-c8yh-373n-1uwd · Cited by 987
Andrews, G., Henderson, S., & Hall, W. (2001) · British Journal of Psychiatry · doi:10.1192/bjp.178.2.145 · Cited by 933
Sheehan, D. V. (1984) · Medical Entomology and Zoology · Cited by 883
2007 National Survey of Mental Health and Wellbeing: Methods and Key Findings
Slade, T., Johnston, A., Oakley Browne, M. A., Andrews, G., & Whiteford, H. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670902970882 · Cited by 832
Psychometric evaluation of the Beck Depression Inventory-II with primary care medical patients.
Arnau, R. C., Meagher, M. W., Norris, M. P., & Bramson, R. (2001) · Health Psychology · doi:10.1037/0278-6133.20.2.112 · Cited by 694
Huang, F. Y., Chung, H., Kroenke, K., Delucchi, K., & Spitzer, R. L. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00409.x · Cited by 688
Adewuya, A. O., Ola, B. A., & Afolabi, O. O. (2006) · Journal of Affective Disorders · doi:10.1016/j.jad.2006.05.021 · Cited by 474
Byrne, B. M., & Stewart, S. M. (2006) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1302_7 · Cited by 459
Titov, N., Andrews, G., Davies, M., McIntyre, K., Robinson, E., & Solley, K. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010939 · Cited by 406
Self-citationCarlbring, P., Brunt, S., Bohman, S., Austin, D., Richards, J., Öst, L.-G., & Andersson, G. (2007) · Computers in Human Behavior · doi:10.1016/j.chb.2005.05.002 · Cited by 319 · cited 2×
“Recent research indicates that online administration of questionnaires results in acceptable reliability of responses (Carlbring et al., 2007; Donker, van Straten,Marks, &Cuijpers, 2010; Garb, 2007; Hedman et al., 2010), with no reported differences between administration that involves presenting…”
BackgroundClinician-Assisted Internet-Based Treatment is Effective for Panic: A Randomized Controlled Trial
Wims, E., Titov, N., Andrews, G., & Choi, I. (2010) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048671003614171 · Cited by 290
Self-citationDefining successful treatment outcome in depression using the PHQ-9: A comparison of methods
McMillan, D., Gilbody, S., & Richards, D. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2010.04.030 · Cited by 247
Clinician-Assisted Internet-Based Treatment is Effective for Depression: Randomized Controlled Trial
Perini, S., Titov, N., & Andrews, G. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670902873722 · Cited by 231 · cited 2×
“These RCTs employed the same recruitment process, inclusion criteria, and treatment materials and are described in detail elsewhere (Perini et al., 2009; Titov et al., 2010).”
MethodSelf-citationHedman, E., Ljótsson, B., Rück, C., Furmark, T., Carlbring, P., Lindefors, N., & Andersson, G. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.01.010 · Cited by 220 · cited 2×
“…of questionnaires results in acceptable reliability of responses (Carlbring et al., 2007; Donker, van Straten,Marks, &Cuijpers, 2010; Garb, 2007; Hedman et al., 2010), with no reported differences between administration that involves presenting all items of a questionnaire on one webpage…”
BackgroundLamers, F., Jonkers, C. C. M., Bosma, H., Penninx, B. W. J. H., Knottnerus, J. A., & van Eijk, J. T. M. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.07.018 · Cited by 188
Westbrook, D., & Kirk, J. (2005) · Behaviour Research and Therapy · doi:10.1016/j.brat.2004.09.006 · Cited by 183
Comparing the BDI-II and the PHQ-9 with outpatient substance abusers
Dum, M., Pickren, J., Sobell, L. C., & Sobell, M. B. (2007) · Addictive Behaviors · doi:10.1016/j.addbeh.2007.09.017 · Cited by 141
Brief self-rated screening for depression on the Internet
Donker, T., van Straten, A., Marks, I., & Cuijpers, P. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.07.013 · Cited by 88
Web-based measurement: Effect of completing single or multiple items per webpage
Thorndike, F. P., Carlbring, P., Smyth, F. L., Magee, J. C., Gonder-Frederick, L., Ost, L.-G., & Ritterband, L. M. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.05.006 · Cited by 83
Computer-administered interviews and rating scales.
Garb, H. N. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.1.4 · Cited by 77
The role of computer‐aided psychotherapy within an NHS CBT specialist service
Learmonth, D., Trosh, J., Rai, S., Sewell, J., & Cavanagh, K. (2008) · Counselling and Psychotherapy Research · doi:10.1080/14733140801976290 · Cited by 65
Depression as Measured by the Beck Depression Inventory-II Among Injecting Drug Users
Johnson, M. E., Neal, D. B., Brems, C., & Fisher, D. G. (2006) · Assessment · doi:10.1177/1073191106286951 · Cited by 52
Andrews, G., & Titov, N. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61393-2 · Cited by 51
Hepner, K. A., Hunter, S. B., Edelen, M. O., Zhou, A. J., & Watkins, K. E. (2009) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2009.03.005 · Cited by 44
Initial validation of the Voris cocaine craving scale: A preliminary report
Smelson, D. A., McGee-Caulfield, E., Bergstein, P., & Engelhart, C. (1999) · Journal of Clinical Psychology · doi:10.1002/(sici)1097-4679(199901)55:1 · Cited by 25
Research works printed but not linked: 4
- American Psychiatric Association . 1994 . Diagnostic and statistical manual of mental disorders , 4th ed. , Washington, DC : Author .
- Beck , A. T. , Steer , R. A. and Brown , B. K. 1996 . Beck Depression Inventory manual , 2nd ed. , San Antonio, TX : Psychological Corporation .
- 10.1080/00036810600603377 · DOI
- 10.1016/s0924-9338(97)83296-8 · DOI · Paper page
Cited by
Sorted by citations
Groarke, J. M., Berry, E., Graham-Wisener, L., McKenna-Plumley, P. E., McGlinchey, E., & Armour, C. (2020) · PLOS ONE · doi:10.1371/journal.pone.0239698 · Cited by 727
McCarron, R. M., Shapiro, B. B., Rawles, J., & Luo, J. S. (2021) · Annals of Internal Medicine · doi:10.7326/aitc202105180 · Cited by 511
Choi, S. W., Schalet, B., Cook, K. F., & Cella, D. (2014) · Psychological Assessment · doi:10.1037/a0035768 · Cited by 480
“Correlations between PHQ-9 and BDIII scores were .72 to .84 in clinical samples (Dum, Pickren, Sobell, & Sobell, 2008; Hepner, Hunter, Edelen, Zhou, & Watkins, 2009; Kung et al., 2013; Titov et al., 2011).”
BackgroundValidation of the PHQ-9 in a psychiatric sample
Beard, C., Hsu, K. J., Rifkin, L. S., Busch, A. B., & Björgvinsson, T. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.12.075 · Cited by 467
Neacsiu, A. D., Eberle, J. W., Kramer, R., Wiesmann, T., & Linehan, M. M. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.05.005 · Cited by 394
Metadata
- Authors
- Titov, N., Dear, B. F., McMillan, D., Anderson, T., Zou, J., & Sunderland, M.
- Affiliations
- UNSW Sydney (AU)
- University of York (GB)
- Corresponding author
- Titov, Nickolai
- Venue
- Cognitive Behaviour Therapy
- Publisher
- Informa UK Limited
- Published
- 2011-06
- Volume
- 40
- Issue
- 2
- Pages
- 126-136
- ISSN
- 1650-6073 (ISSN-L)
- 1651-2316
- OpenAlex
- W2062363236
- Cited by
- 342
- References
- 39
- Citations by year
- 2026: 27 · 2025: 35 · 2024: 24 · 2023: 27 · 2022: 17 · 2021: 30 · 2020: 36 · 2019: 21 · 2018: 35 · 2017: 14 · 2016: 20 · 2015: 24 · 2014: 14 · 2013: 11 · 2012: 7
- FWCI
- 13.18
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Cognitive Behaviour Therapy (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- PHQ-9, Beck Depression Inventory-II, depression severity measurement, psychometric properties, responsiveness to change, internal consistency, factor structure, convergent validity, clinical significance, Sheehan Disability Scale, depression treatment outcomes
- MeSH terms
- Adult, Aged, Aged, 80 and over, Depressive Disorder, Female, Humans, Male, Middle Aged, Psychiatric Status Rating Scales, Psychometrics, Surveys and Questionnaires, Severity of Illness Index, Reproducibility of Results, Treatment Outcome, Outcome Assessment, Health Care, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review