Cited by 188Suicide and Self-Harm StudiesAnxiety, Depression, Psychometrics, Treatment, Cognitive ProcessesPsychological Testing and Assessment

The DOI matches its Crossref record; 49 of the 52 references it cites were found in a registry or an index.

The PHQ-9 versus the PHQ-8 — Is item 9 useful for assessing suicide risk in coronary artery disease patients? Data from the Heart and Soul Study

Open access

Razykov, Ilya, Ziegelstein, Roy C., Whooley, Mary A., Thombs, Brett D.·2012·Journal of Psychosomatic Research

DOI 10.1016/j.jpsychores.2012.06.001

Open this paper in CoChat — free account Open PDF

Abstract

Objective Item 9 of the Patient Health Questionnaire-9 (PHQ-9), which inquires about both passive thoughts of death and active ideas of self-harm, has been used to assess suicide risk. The objectives of this study were (1) to determine the proportion of patients who responded "yes" to Item 9 who endorsed active suicidal ideation in response to more direct questions from a structured clinical interview and (2) to compare the sensitivity and specificity for detecting cases of depression of the PHQ-9 and the PHQ-8, which does not include Item 9, as well as the correlation between the PHQ-8 and PHQ-9.Methods Coronary artery disease (CAD) outpatients were administered the PHQ-9 and the Computerized Diagnostic Interview Schedule (C-DIS). Item 9 responses were compared to suicidal ideation and intent in the last year based on the C-DIS. Scores on the PHQ-8 were obtained by eliminating Item 9 from the PHQ-9. Test characteristics of the PHQ-9 and PHQ-8 were compared.Results Of 1022 patients, 110 (10.8%) endorsed Item 9. Of those, only 22 (19.8%) reported thoughts about committing suicide, and only 9 of those (8.1%) reported a suicide plan any time in the last year based on the C-DIS. Correlation between PHQ-9 and PHQ-8 scores was r=0.997. Sensitivity and specificity for the PHQ-9 (54%, 90%) and PHQ-8 (50%, 91%) to detect major depression were similar.Conclusion Item 9 does not appear to be an accurate suicide screen. The PHQ-8 may be a better option than the PHQ-9 in CAD patients.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1016/j.jpsychores.2012.06.001

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. B. (2013) · Oxford University Press eBooks · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,845
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898 · cited 1×
“The PHQ-9 [22] is a 9-item measure for assessment of depressive symptoms that is commonly used in medical populations [2–4], including patients with CAD [5–9].”
Method
National Institute of Mental Health Diagnostic Interview Schedule: Its History, Characteristics, and Validity
Robins, L. N. (1981) · Archives of General Psychiatry · doi:10.1001/archpsyc.1981.01780290015001 · Cited by 5,219
The PHQ-8 as a measure of current depression in the general population
Kroenke, K., Strine, T. W., Spitzer, R. L., Williams, J. B. W., Berry, J. T., & Mokdad, A. H. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2008.06.026 · Cited by 5,121
The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: a systematic review
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057
The Cardiovascular Health Study: design and rationale.
Fried, L. P., Borhani, N. O., Enright, P., Furberg, C. D., Gardin, J. M., Kronmal, R. A., Kuller, L. H., Manolio, T. A., Mittelmark, M. B., Newman, A., et al. (1991) · Annals of Epidemiology · doi:10.1016/1047-2797(91)90005-w · Cited by 3,652
Approximate is Better than “Exact” for Interval Estimation of Binomial Proportions
Agresti, A., & Coull, B. A. (1998) · The American Statistician · doi:10.1080/00031305.1998.10480550 · Cited by 3,223
Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): a meta-analysis
Manea, L., Gilbody, S., & McMillan, D. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.110829 · Cited by 1,966
Cardia: study design, recruitment, and some characteristics of the examined subjects
FRIEDMAN, G. D., Cutter, G., Donahue, R. P., Hughes, G. H., Hulley, S. B., Jacobs, D. R., Liu, K., & Savage, P. J. (1988) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(88)90080-7 · Cited by 1,689
Depression and Coronary Heart Disease: Recommendations for Screening, Referral, and Treatment: A Science Advisory From the American Heart Association Prevention Committee of the Council on Cardiovascular Nursing, Council on Clinical Cardiology, Council on Epidemiology and Prevention, and Interdisciplinary Council on Quality of Care and Outcomes Research: Endorsed by the American Psychiatric Association
Lichtman, J. H., Bigger, J. T., Blumenthal, J. A., Frasure-Smith, N., Kaufmann, P. G., Lespérance, F., Mark, D. B., Sheps, D. S., Taylor, C. B., & Froelicher, E. S. (2008) · Circulation · doi:10.1161/circulationaha.108.190769 · Cited by 1,482
Screening for depression in medical settings with the Patient Health Questionnaire (PHQ): A diagnostic meta-analysis
Gilbody, S., Richards, D., Brealey, S., & Hewitt, C. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0333-y · Cited by 1,290
Screening for Depression in Adults: A Summary of the Evidence for the U.S. Preventive Services Task Force
Pignone, M. P., Gaynes, B. N., Rushton, J. L., Burchell, C. M., Orleans, C. T., Mulrow, C. D., & Lohr, K. N. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-10-200205210-00013 · Cited by 1,086
Diagnostic accuracy of the mood module of the patient health questionnaire: a systematic review
Wittkampf, K. A., Naeije, L., Schene, A. H., Huyser, J., & van Weert, H. C. (2007) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2007.06.004 · Cited by 493
Validity of the Hospital Anxiety and Depression Scale and Patient Health Questionnaire-9 to screen for depression in patients with coronary artery disease
Stafford, L., Berk, M., & Jackson, H. J. (2007) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2007.06.005 · Cited by 265
Screening for Depression in Patients With Coronary Heart Disease (Data from the Heart and Soul Study)
McManus, D. D., Pipkin, S. S., & Whooley, M. A. (2005) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2005.06.037 · Cited by 226
Self-citation
Rethinking recommendations for screening for depression in primary care
Thombs, B. D., Coyne, J. C., Cuijpers, P. J., de Jonge, P., Gilbody, S. M., Ioannidis, J. P. A., Johnson, B. T., Patten, S. B., Turner, E. H., & Ziegelstein, R. C. (2011) · Canadian Medical Association Journal · doi:10.1503/cmaj.111035 · Cited by 225
Self-citation
Screening for depression and suicidality in a VA primary care setting: 2 items are better than 1 item.
Corson, K., Gerrity, M., & Dobscha, S. K. (2004) · PubMed · Cited by 214
Better Off Dead: Suicidal Thoughts in Cancer Patients
Walker, J., Waters, R. A., Murray, G., Swanson, H., Hibberd, C. J., Rush, R. W., Storey, D. J., Strong, V. A., Fallon, M. T., Wall, L. R., et al. (2008) · Journal of Clinical Oncology · doi:10.1200/jco.2007.11.8844 · Cited by 195
Computerized administration of the diagnostic interview schedule
Blouin, A. G., Pérez, E. L., & Blouin, J. (1988) · Psychiatry Research · doi:10.1016/0165-1781(88)90024-8 · Cited by 183
Incidental Findings in Imaging Research
Orme, N. M., Fletcher, J. G., Siddiki, H. A., Harmsen, W. S., O’Byrne, M. M., Port, J. D., Tremaine, W. J., Pitot, H. C., McFarland, E. G., Robinson, M., et al. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.317 · Cited by 170
Depressive symptoms and health-related quality of life in breast cancer survivors
Reyes-Gibby, C. C., Anderson, K. O., Morrow, P. K., Shete, S., & Hassan, S. (2012) · Journal of Women's Health · doi:10.1089/jwh.2011.2852 · Cited by 166
Assessment and Treatment of Depression in Patients With Cardiovascular Disease: National Heart, Lung, and Blood Institute Working Group Report
Davidson, K. W., Kupfer, D. J., Bigger, J. T., Califf, R. M., Carney, R. M., Coyne, J. C., Czajkowski, S. M., Frank, E., Frasure‐Smith, N., Freedland, K. E., et al. (2006) · Psychosomatic Medicine · doi:10.1097/01.psy.0000233233.48738.22 · Cited by 157
The P4 Screener: Evaluation of a Brief Measure for Assessing Potential Suicide Risk in 2 Randomized Effectiveness Trials of Primary Care and Oncology Patients
Dube, P., Kroenke, K., Bair, M. J., Theobald, D., & Williams, L. S. (2010) · The Primary Care Companion to The Journal of Clinical Psychiatry · doi:10.4088/pcc.10m00978blu · Cited by 131
Myocardial Infarction and Risk of Suicide
Larsen, K. K., Agerbo, E., Christensen, B., Søndergaard, J., & Vestergaard, M. (2010) · Circulation · doi:10.1161/circulationaha.110.956136 · Cited by 121
Optimizing Detection of Major Depression Among Patients with Coronary Artery Disease Using the Patient Health Questionnaire: Data from the Heart and Soul Study
Thombs, B. D., Ziegelstein, R. C., & Whooley, M. A. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0802-y · Cited by 113
Self-citation
Depression among adults with diabetes in Jordan: risk factors and relationship to blood sugar control
Al-Amer, R. M., Sobeh, M. M., Zayed, A. A., & Al-Domi, H. A. (2011) · Journal of Diabetes and its Complications · doi:10.1016/j.jdiacomp.2011.03.001 · Cited by 112
Suicidal ideation in multiple sclerosis.
Turner, A., Williams, R. M., Bowen, J., Kivlahan, D., & Haselkorn, J. (2006) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2006.04.021 · Cited by 106
Cost-Effectiveness of Mammography for Older Women
Mandelblatt, J. S., Saha, S., & Helfand, M. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-140-10-200405180-00023 · Cited by 105
Routine, Self‐Administered, Touch‐Screen, Computer‐Based Suicidal Ideation Assessment Linked to Automated Response Team Notification in an HIV Primary Care Setting
Lawrence, S. T., Willig, J. H., Crane, H. M., Ye, J., Aban, I., Lober, W. B., Nevin, C. R., Batey, D. S., Mugavero, M. J., McCullumsmith, C. B., et al. (2010) · Clinical Infectious Diseases · doi:10.1086/651420 · Cited by 100
Thoughts of Death and Suicide Reported by Cancer Patients Who Endorsed the “Suicidal Thoughts” Item of the PHQ-9 During Routine Screening for Depression
Walker, J., Hansen, C. H., Butcher, I., Sharma, N., Wall, L. R., Murray, G. D., & Sharpe, M. (2011) · Psychosomatics · doi:10.1016/j.psym.2011.02.003 · Cited by 99
Depressive Symptoms in Pulmonary Arterial Hypertension: Prevalence and Association With Functional Status
McCollister, D. H., Beutz, M. A., McLaughlin, V. V., Rumsfeld, J. S., Masoudi, F. A., Tripputi, M., Yaeger, T. E., Weintraub, P., & Badesch, D. B. (2010) · Psychosomatics · doi:10.1176/appi.psy.51.4.339 · Cited by 94
Do the PHQ-8 and the PHQ-2 accurately screen for depressive disorders in a sample of pregnant women?
Smith, M. V., Gotman, N., Lin, H., & Yonkers, K. A. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.04.011 · Cited by 84
Does Gender Moderate the Relationship Between Childhood Maltreatment and Adult Depression?
Arnow, B. A., Blasey, C. M., Hunkeler, E. M., Lee, J., & Hayward, C. (2011) · Child Maltreatment · doi:10.1177/1077559511412067 · Cited by 84
Screening for suicidality in cancer patients using Item 9 of the nine-item patient health questionnaire; does the item score predict who requires further assessment?
Walker, J., Hansen, C. H., Hodges, L. J., Thekkumpurath, P., O’Connor, M. J., Sharma, N., Kleiboer, A. M., Murray, G. D., Kroenke, K., & Sharpe, M. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2009.11.011 · Cited by 59
Predicting and Preventing Suicide: Do We Know Enough to Do Either?
Paris, J. (2006) · Harvard Review of Psychiatry · doi:10.1080/10673220600968662 · Cited by 58
Suicidal ideation among adults with arthritis: Prevalence and subgroups at highest risk. Data from the 2007–2008 National Health and Nutrition Examination Survey
Tektonidou, M. G., Dasgupta, A., & Ward, M. M. (2011) · Arthritis Care & Research · doi:10.1002/acr.20516 · Cited by 56
Real-World Lessons From the Implementation of a Depression Screening Protocol in Acute Myocardial Infarction Patients
Smolderen, K. G. E., Buchanan, D. M., Amin, A. A., GOSCH, K. L., Nugent, K., Riggs, L. A., Seavey, G., & Spertus, J. A. (2011) · Circulation Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.110.960013 · Cited by 50
The impact of blood glucose monitoring on depression and distress in insulin-naïve patients with type 2 diabetes
Fisher, L., Polonsky, W., Parkin, C. G., Jelsovsky, Z., Amstutz, L., & Wagner, R. S. (2011) · Current Medical Research and Opinion · doi:10.1185/03007995.2011.619176 · Cited by 47
Exploring potential associations of suicidal ideation and ideas of self-harm in patients with congestive heart failure
Loßnitzer, N., Müller‐Tasch, T., Löwe, B., Zugck, C., Nelles, M., Remppis, A. B., Haass, M., Rauch, B. H., Jünger, J., Herzog, W., et al. (2009) · Depression and Anxiety · doi:10.1002/da.20587 · Cited by 41
Screening for Depression and Suicidality in Patients With Cardiovascular Illnesses
Shemesh, E., Annunziato, R. A., Rubinstein, D., Sultan, S., Malhotra, J. C., Santra, M., Davison, B. A., Feaganes, J. R., Cotter, G., & Yehuda, R. (2009) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2009.06.033 · Cited by 39
Cost-Effectiveness of Mammography for Older Women
Finucane, T. E. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-140-10-200405180-00022 · Cited by 36
Correlates of depression among people with diabetes: The Translating Research Into Action for Diabetes (TRIAD) study
Waitzfelder, B. E., Gerzoff, R. B., Karter, A. J., Crystal, S., Bair, M. J., Ettner, S. L., Brown, A. F., Subramanian, U., Lu, S., Marrero, D. G., et al. (2010) · Primary care diabetes · doi:10.1016/j.pcd.2010.07.002 · Cited by 33
The Crisis in Mental Health Care: A Preliminary Study of Access to Psychiatric Care in Boston
Boyd, J. W., Linsenmeyer, A., Woolhandler, S. J., Himmelstein, D. U., & Nardin, R. A. (2011) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2011.03.053 · Cited by 22
Cost-effectiveness of mammography for older women.
Finucane, T. E. (2004) · PubMed · Cited by 21
Better Off Not Knowing
Volk, M. L., & Ubel, P. A. (2011) · Archives of Internal Medicine · doi:10.1001/archinternmed.2011.63 · Cited by 19
A comparison of depression and mental distress indicators, Rhode Island Behavioral Risk Factor Surveillance System, 2006.
Jiang, Y., & Hesser, J. E. (2011) · Europe PMC (PubMed Central) · Cited by 8
Responding to Incidental Findings on Research Imaging Studies
Lo, B. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.306 · Cited by 6

Sorted by citations

Equivalency of the diagnostic accuracy of the PHQ-8 and PHQ-9: a systematic review and individual participant data meta-analysis
Wu, Y., Levis, B., Riehm, K. E., Saadat, N., Levis, A. W., Azar, M., Rice, D. B., Boruff, J., Cuijpers, P., Gilbody, S., et al. (2020) · Psychological Medicine · doi:10.1017/s0033291719001314 · Cited by 423
Self-citation
Excess Burden of Depression among HIV-Infected Persons Receiving Medical Care in the United States: Data from the Medical Monitoring Project and the Behavioral Risk Factor Surveillance System
Do, A. N., Rosenberg, E. S., Sullivan, P. S., Beer, L., Strine, T. W., Schulden, J. D., Fagan, J. L., Freedman, M. S., & Skarbinski, J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0092842 · Cited by 274
Comparison of the Usefulness of the PHQ-8 and PHQ-9 for Screening for Major Depressive Disorder: Analysis of Psychiatric Outpatient Data
Shin, C., Lee, S., Han, K., Yoon, H.-K., & Han, C. (2019) · Psychiatry Investigation · doi:10.30773/pi.2019.02.01 · Cited by 265
The PHQ-9 Item 9 based screening for suicide risk: a validation study of the Patient Health Questionnaire (PHQ)−9 Item 9 with the Columbia Suicide Severity Rating Scale (C-SSRS)
Na, P. J., Yaramala, S. R., Kim, J. A., Kim, H., Goes, F. S., Zandi, P. P., Voort, J. L. V., Sutor, B., Croarkin, P. E., & Bobo, W. V. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.02.045 · Cited by 247
Depression is associated with more aggressive inflammatory bowel disease
Kochar, B., Barnes, E. L., Long, M. D., Cushing, K. C., Galanko, J., Martin, C. F., Raffals, L. E., & Sandler, R. S. (2018) · American Journal of Gastroenterology · doi:10.1038/ajg.2017.423 · Cited by 178

See all 188

Authors: Razykov, I., Ziegelstein, R. C., Whooley, M. A., & Thombs, B. D.
Affiliations: Jewish General Hospital (CA)
Johns Hopkins University (US)
San Francisco VA Medical Center (US)
Corresponding author: Thombs, Brett D.
ORCID: Ziegelstein, Roy C.
Whooley, Mary A.
Thombs, Brett D.
Venue: Journal of Psychosomatic Research
Publisher: Elsevier BV
Published: 2012-09
Volume: 73
Issue: 3
Pages: 163-168
ISSN: 0022-3999 (ISSN-L)
DOI: 10.1016/j.jpsychores.2012.06.001
OpenAlex: W2015188398
Cited by: 188
References: 52
Citations by year: 2026: 9 · 2025: 12 · 2024: 11 · 2023: 26 · 2022: 21 · 2021: 16 · 2020: 12 · 2019: 23 · 2018: 12 · 2017: 10 · 2016: 8 · 2015: 7 · 2014: 12 · 2013: 7 · 2012: 2
FWCI: 10.18
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Journal of Psychosomatic Research (publishedVersion)
PubMed (publishedVersion)
eScholarship@McGill (McGill) (submittedVersion, cc-by-nc-nd)
Funders: National Center for Complementary and Alternative Medicine (R24AT004641)
Miller Family Scholar Program of the Johns Hopkins Center for Innovative Medicine
New Investigator Award from the Canadian Institutes of Health Research
Établissement de Jeunes Chercheurs award from the Fonds de la Recherche en Santé Québec
Department of Veterans Affairs, Washington, DC
National Heart Lung and Blood Institute (R01 HL079235)
American Federation for Aging Research (Paul Beeson Scholars Program), New York, NY
Robert Wood Johnson Foundation (Faculty Scholars Program), Princeton, NJ
Ischemia Research and Education Foundation, South San Francisco, CA
Topics: Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
Keywords: PHQ-9, PHQ-8, suicide risk screening, suicidal ideation, coronary artery disease, depression screening, suicide planning, self-harm, sensitivity and specificity, Heart and Soul Study
MeSH terms: Suicide Prevention, Aged, Aged, 80 and over, Coronary Disease, Major Depressive Disorder, Depressive Disorder, Major, Female, Humans, Male, Middle Aged, Psychiatric Status Rating Scales, Surveys and Questionnaires, Sensitivity and Specificity, Suicide, Risk Assessment, Suicidal Ideation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The PHQ-9 versus the PHQ-8 — Is item 9 useful for assessing suicide risk in coronary artery disease patients? Data from the Heart and Soul Study

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks