Which PHQ-9 Items Can Effectively Screen for Suicide? Machine Learning Approaches
Open accessThe DOI matches its Crossref record; 54 of the 56 references it cites were found in a registry or an index.
Abstract
(1) Background: The Patient Health Questionnaire-9 (PHQ-9) is a tool that screens patients for depression in primary care settings. In this study, we evaluated the efficacy of PHQ-9 in evaluating suicidal ideation (2) Methods: A total of 8760 completed questionnaires collected from college students were analyzed. The PHQ-9 was scored in combination with and evaluated against four categories (PHQ-2, PHQ-8, PHQ-9, and PHQ-10). Suicidal ideations were evaluated using the Mini-International Neuropsychiatric Interview suicidality module. Analyses used suicide ideation as the dependent variable, and machine learning (ML) algorithms, k-nearest neighbors, linear discriminant analysis (LDA), and random forest. (3) Results: Random forest application using the nine items of the PHQ-9 revealed an excellent area under the curve with a value of 0.841, with 94.3% accuracy. The positive and negative predictive values were 84.95% (95% CI = 76.03–91.52) and 95.54% (95% CI = 94.42–96.48), respectively. (4) Conclusion: This study confirmed that ML algorithms using PHQ-9 in the primary care field are reliably accurate in screening individuals with suicidal ideation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Also, the role and efficacy of pharmacological antidepressant treatment among patients with cancer with depressive symptoms have not been well studied, particularly in elderly patients 56,57 .”
From Suicide risk and mortality among patients with cancer (2022) · cites this paper as [57]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
(1998) · PubMed · Cited by 10,216
Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research
Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., Huang, X., Musacchio, K. M., Jaroszewski, A. C., Chang, B. P., & Nock, M. K. (2017) · Psychological Bulletin · doi:10.1037/bul0000084 · Cited by 3,784 · cited 2×
“These techniques will accurately predict suicidal behavior and actual suicide through longitudinal records of patients [31,33,34], socio-demographic information, psychopathological factors, and control for risk factors [49].”
MethodSuicide Prevention Strategies: A Systematic Review
Mann, J. J., Apter, A., Bertolote, J., Beautrais, A., Currier, D., Haas, A., Hegerl, U., Lonnqvist, J., Malone, K., Marusic, A., et al. (2005) · JAMA · doi:10.1001/jama.294.16.2064 · Cited by 2,852 · cited 1×
“Justification for population-based screening and prevention would require both evidence that the screening predicts suicidal risk in the general population and evidence that some feasible intervention can reduce that risk [53,54].”
BackgroundHand, D. J., Mannila, H., & Smyth, P. (2001) · Cited by 2,581
The diagnostic odds ratio: a single indicator of test performance
Glas, A. S., Lijmer, J. G., Prins, M. H., Bonsel, G. J., & Bossuyt, P. M. M. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00177-x · Cited by 2,261 · cited 1×
“We used the subtotal score of PHQ-9 items, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and area under the receiver operating characteristic curve (AUC) for comparison with the clinical diagnosis of suicide ideation using 95% confidence intervals for each measure [43].”
MethodContact With Mental Health and Primary Care Providers Before Suicide: A Review of the Evidence
Luoma, J. B., Martin, C. E., & Pearson, J. L. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.6.909 · Cited by 1,576 · cited 1×
“Most individuals who die by suicide have visited mental health services providers within one year before death (rates of contact average 32%, range = 16–46%) [1,2].”
BackgroundLichtman, J. H., Bigger, J. T., Blumenthal, J. A., Frasure-Smith, N., Kaufmann, P. G., Lespérance, F., Mark, D. B., Sheps, D. S., Taylor, C. B., & Froelicher, E. S. (2008) · Circulation · doi:10.1161/circulationaha.108.190769 · Cited by 1,482 · cited 1×
“The American Heart Association Science Advisory recommends that all patients who answer “yes” to item 9 of PHQ-9 be immediately assessed for suicide [25].”
Background
Research works printed but not linked: 3
- 37. Yoo S. Kim Y. Noh J. Oh K. Kim C. Namkoong K. Chae J. Lee G. Jeon S. Min K. Validity of Korean version of the mini-international neuropsychiatric interview Anxiety Mood 2006 2 50 55
- 39. Stork D.G. Duda R.O. Hart P.E. Stork D. Pattern Classification Wiley Hoboken, NJ, USA 2001
- 42. Zhu W. Zeng N. Wang N. Sensitivity, specificity, accuracy, associated confidence interval and ROC analysis with practical SAS implementations Proceedings of the NESUG proceedings: Health care and life sciences Baltimore, MD, USA 14–17 November 2010 Volume 19 67
Cited by
Suicide risk and mortality among patients with cancer
Heinrich, M., Hofmann, L., Baurecht, H., Kreuzer, P. M., Knüttel, H., Leitzmann, M. F., & Seliger, C. (2022) · Nature Medicine · doi:10.1038/s41591-022-01745-y · Cited by 136
“57 ).”
Dananjaya, V., Chevali, V. S., Dear, J. P., Potluri, P., & Abeykoon, C. (2024) · Progress in Materials Science · doi:10.1016/j.pmatsci.2024.101336 · Cited by 162
Spottswood, M., Lim, C. T., Davydow, D., & Huang, H. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.892205 · Cited by 40
“Evidence exists for machine learning algorithms in the EMR paired with the PHQ-9 question 9 resulting in effective screening for suicide in a college student population (38).”
MethodAssociation between long-term sedentary behavior and depressive symptoms in U.S. adults
Guo, Y., Li, K., Zhao, Y., Wang, C., Mo, H., & Li, Y. (2024) · Scientific Reports · doi:10.1038/s41598-024-55898-6 · Cited by 50
“, was used to evaluate participants’ self-injury tendencies 31 .”
MethodPotential paths to suicidal ideation and suicide attempts among high-risk women
Weiss, S. J., Simeonova, D. I., Koleva, H. K., Muzik, M., Clark, K. D., Özerdem, A., Cooper, B. A., & Ammerman, R. T. (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.09.033 · Cited by 45
Analysis and evaluation of explainable artificial intelligence on suicide risk assessment
Tang, H., Rekavandi, A. M., Rooprai, D., Dwivedi, G., Sanfilippo, F. M., Boussaïd, F., & Bennamoun, M. (2024) · Scientific Reports · doi:10.1038/s41598-024-53426-0 · Cited by 55
Liem, A., Prawira, B., Magdalena, S., Siandita, M. J., & Hudiyana, J. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-03944-w · Cited by 51
“Previous study found that higher score means higher risk for suicide in mental health screening for the community sample [33].”
BackgroundLevi‐Belz, Y., Shoval‐Zuckerman, Y., Blank, C., Groweiss, Y., & Neria, Y. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.04.055 · Cited by 31
Kirakosian, N., Stanton, A. M., McKetchnie, S. M., King, D. S., Dolotina, B., O’Cleirigh, C. M., Grasso, C., Potter, J. E., Mayer, K. H., & Batchelder, A. (2023) · Journal of General Internal Medicine · doi:10.1007/s11606-022-07996-2 · Cited by 38
Predictors of suicide ideation among South Korean adolescents: A machine learning approach
Donnelly, H. K., Han, Y., Kim, S.-A., & Lee, D. H. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.02.079 · Cited by 28
Self-citationJáuregui, J. C., Mwochi, C. R., Crawford, J., Jadwin-Cakmak, L. A., Okoth, C., Onyango, D. P., & Harper, G. W. (2021) · LGBT Health · doi:10.1089/lgbt.2020.0495 · Cited by 25
“35,36 The brief four-item Primary Care Post-Traumatic Stress Disorder (PC-PTSD) screen was used to assess PTSSs in the past month.”
Kim, S., & Lee, K. (2021) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s339412 · Cited by 27
“These have strengths in the identification of depression by using machine learning techniques.(53,54,58,59,70,71) In this study, studies were analyzed using machine learning techniques on PHQ-9 depression screening data collected through mobile devices according to the latest depression screening trends.”
MethodSelf-citationMilatz, F., Klotsche, J., Niewerth, M., Sengler, C., Windschall, D., Kallinich, T., Dressler, F., Trauzeddel, R., Holl, R. W., Foeldvari, I., et al. (2024) · Arthritis Research & Therapy · doi:10.1186/s13075-024-03312-x · Cited by 33
Can the MMPI Predict Adult ADHD? An Approach Using Machine Learning Methods
Kim, S., Lee, H.-K., & Lee, K. (2021) · Diagnostics · doi:10.3390/diagnostics11060976 · Cited by 27
Self-citationKim, S., Perry, L. M., Mossman, B., Dunn, A., & Hoerger, M. P. (2024) · PLoS ONE · doi:10.1371/journal.pone.0306620 · Cited by 25
Self-citationKim, S., & Lee, K. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12040516 · Cited by 25
“In our previous study, there were some differences according to the ML technique [71], but the inclusion of item 9 did not indicate a difference in accuracy.”
ResultSelf-citationBao, X., Guo, T., Xu, L., Chen, W., Luan, L., Yang, H., & Zhang, X. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1427560 · Cited by 29
Landa–Blanco, M., Romero, K., Caballero, I., Gálvez-Pineda, E., Fúnes-Henríquez, M. J., & Romero, R. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1352889 · Cited by 21
“This item of the PHQ-9 has been commonly used as a stand-alone measurement of suicidal ideation; there is evidence of its convergent validity with the widely used Mini-International Neuropsychiatric Interview suicidality module (42).”
MethodRisk for Suicide Attempts Assessed Using the Patient Health Questionnaire–9 Modified for Teens
Tsui, F. R., Ruiz, V. M., Ryan, N. D., Shi, L., Melhem, N., Young, J. F., Davis, M., Gibbons, R. D., & Brent, D. A. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.38144 · Cited by 17
Howard, K. J., Leong, C., Chambless, S., Grigsby, T. J., Cordaro, M., Perrotte, J. K., & Howard, J. T. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192315748 · Cited by 15
“Item 9 from the PHQ has been shown to be effective in predicting suicidal ideation [35].”
BackgroundMallhi, T. H., Ahmad, N., Salman, M., Tanveer, N., Shah, S., Butt, M. H., Alatawi, A. D., Alotaibi, N. H., Rahman, H. U., Alzarea, A. I., et al. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192114282 · Cited by 23
Crisol-Deza, D. A., Poma-Ramírez, D., Pacherres-López, A., Noriega-Baella, C., Villanueva-Zúñiga, L., Carrillo, J. F. S., & Huarcaya-Victoria, J. (2022) · Death Studies · doi:10.1080/07481187.2022.2042752 · Cited by 14
Stressed, Lonely, and Overcommitted: Predictors of Lawyer Suicide Risk
Krill, P. R., Thomas, H. M., Kramer, M. R., Degeneffe, N., & Anker, J. J. (2023) · Healthcare · doi:10.3390/healthcare11040536 · Cited by 24
Pérez, S., Layrón, J. E., Barrigón, M. L., Baca‐García, E., & Marco, J. H. (2023) · Death Studies · doi:10.1080/07481187.2023.2235569 · Cited by 17
“Moreover, Kim et al. (2021) found that the PHQ-9, including Item 9, predicted suicidal ideation, and they concluded that the PHQ-9 provides reliable accuracy in classifying and predicting suicidal ideations.”
BackgroundKarampotsis, E., Kioskli, K., Tsirimpa, A., Dounias, G. D., & Polydoropoulou, A. (2024) · Natural Hazards · doi:10.1007/s11069-024-06759-y · Cited by 14
“The work of Kim et al. (2021) assessed the effectiveness of the Patient Health Questionnaire-9 (PHQ-9) in identifying suicidal ideation.”
Storey, Q. K., Kealy, D., Seidler, Z. E., Oliffe, J. L., Rice, S., & Ogrodniczuk, J. S. (2022) · American Journal of Men s Health · doi:10.1177/15579883221136980 · Cited by 14
“Although a single item was also used to assess suicidality in the present study, there is ample research supporting the validity of using Item 9 from the PHQ-9 as a suicidality assessment (Kim et al., 2021).”
MethodGlavin, D., Grua, E. M., Nakamura, C. A., Scazufca, M., dos Santos, E. R., Wong, G. H. Y., Hollingworth, W., Peters, T. J., Araya, R., & van de Ven, P. W. J. (2023) · JMIR Mental Health · doi:10.2196/48444 · Cited by 16
“ML algorithms have previously been combined with PHQ-9 items, but it was used to accurately predict suicidal ideation [13].”
MethodLevi‐Belz, Y., Blank, C., Groweiss, Y., & Neria, Y. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.115996 · Cited by 12
Recognising and Responding to Suicide-Risk Factors in Primary Care: A Scoping Review
Saini, P., Hunt, A. M., Blaney, P. S., & Murray, A. (2024) · Journal of Prevention · doi:10.1007/s10935-024-00783-1 · Cited by 19
“Asking evidenced-based questions such as ‘Thoughts that you would be better off dead or of hurting yourself in some way’ from the Patient Health Questionnaire-9 (PHQ-9; Kroenke et al., 2001) have been shown to be reliably accurate in screening individuals with suicidal ideation (Kim et al., 2021).”
BackgroundSalman, M., Shehzadi, N., Mustafa, Z. U., Mallhi, T. H., Khan, Y. H., Khan, T. M., & Hussain, K. (2022) · Psychology Health & Medicine · doi:10.1080/13548506.2022.2119483 · Cited by 11
“It inquires, ‘Over the past two weeks, how often have you been bothered by thoughts that you would be better off dead or of hurting yourself in some way?’ Previous studies have demonstrated that suicidal ideation, indicated by the 9thitem of PHQ, is a robust predictor of suicide attempts and deaths (Kim et al., 2021;…”
BackgroundMason, M. J., Coatsworth, J. D., Zaharakis, N. M., Russell, M. A., Wallis, D., Brown, A., & Hale, C. (2022) · Behavior Therapy · doi:10.1016/j.beth.2022.09.005 · Cited by 12
Screening of Mood Symptoms Using MMPI-2-RF Scales: An Application of Machine Learning Techniques
Kim, S., Lee, H.-K., & Lee, K. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11080812 · Cited by 13
“This study used a dataset from a survey conducted by Kongju National University across South Korea [54].”
MethodSelf-citationPark, H., & Lee, K. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.03.076 · Cited by 11
Self-citationCawiding, O. R., Lee, S., Jo, H., Kim, S., Suh, S. A., Joo, E. Y., Chung, S., & Kim, J. K. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109589 · Cited by 15
Self-citationPark, H., & Lee, K. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12091357 · Cited by 10
“However, in previous studies, when the same sample was analyzed, the prediction rate was increased depending on the analysis method [21,22].”
MethodSelf-citationCortisol Regulation among Women Who Experience Suicidal Ideation during Pregnancy
El-Refaay, S. M. M., & Weiss, S. J. (2023) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2023.100642 · Cited by 10
“This finding has been reported for general samples of male and female depressed adults as well (Adam et al., 2017; Kim et al., 2021).”
BackgroundMethodIs personality linked to season of birth?
Lee, H., Lee, H.-K., & Lee, K. (2021) · PLoS ONE · doi:10.1371/journal.pone.0253815 · Cited by 8
“The Institutional Review Board of Kongju National University approved this study.”
MethodSelf-citationCasas, A. V., Gómez‐Revuelta, M., Garay, U. M., Ruiz-Guerrero, F., Núñez, M. R., Solla, P. F., López, R. G., López, J. C., Rumayor, E. G., Antón, L. B., et al. (2023) · Revista de Psiquiatría y Salud Mental · doi:10.1016/j.rpsm.2022.12.002 · Cited by 13
Xiao, Y., & Brown, T. T. (2023) · Scientific Reports · doi:10.1038/s41598-023-28568-2 · Cited by 8
Salman, M., Mallhi, T. H., Khan, Y. H., Mustafa, Z. U., Shehzadi, N., Khan, T. M., & Hussain, K. (2022) · Disaster Medicine and Public Health Preparedness · doi:10.1017/dmp.2022.124 · Cited by 7
Mulholland, H., Whittington, R., Lane, S., Haines‐Delmont, A., Nathan, R., Saini, P., Kullu, C., Comerford, T., Yameen, F., & Corcoran, R. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-063699 · Cited by 7
Hernández‐Vásquez, A., Vargas‐Fernández, R., & Bendezú-Quispe, G. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.08.008 · Cited by 9
Seedat, S., Sengwayo, M., Gani, S., Mashego, L., Ochayon, J., Shepard, A., Vergie, C., Masango, M. G., Makuapane, L. P., Wagner, F., et al. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1492620 · Cited by 12
Schmiedehaus, E., Snyder, E., Perrotte, J. K., Deason, R. G., Howard, K. J., & Cordaro, M. (2023) · Issues in Mental Health Nursing · doi:10.1080/01612840.2023.2215866 · Cited by 7
“Item 9 from the PHQ has been shown to be effective in predicting suicidal ideation (Kim et al., 2021).”
BackgroundHuang, A. A., & Huang, S. Y. (2022) · Research Square · doi:10.21203/rs.3.rs-2110891/v1 · Cited by 5
Suicidal ideation among mental health patients at hospital discharge: prevalence and risk factors
Mao, W., Shalaby, R., Owusu, E., Elgendy, H. E., Agyapong, B., Eboreime, E., Silverstone, P. H., Chue, P. S., Li, X., Vuong, W., et al. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-06547-3 · Cited by 8
“Therefore, item 9 is sometimes called the PHQ-9 suicide question because it determines the frequency of passive accidents caused by death or self-harm over the past two weeks [27–29].”
Humer, E. C., Gächter, A., Pieh, C., Zeldovich, M., & Neubauer, V. (2025) · Archives of Suicide Research · doi:10.1080/13811118.2025.2552954 · Cited by 6
“This dichotomization aligns with established practices in population-based research, where even infrequent suicidal thoughts are considered clinically relevant (Kim et al., 2021; Louzon et al., 2016; Simon et al., 2013).”
Tu, J.-H., Lu, Y., Yue, Z.-C., Ling, K.-N., Xing, Y.-R., Chen, D.-D., Zhu, Z.-R., & Chen, T. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1427486 · Cited by 4
Hedley, D., Uljarević, M., Bury, S. M., Haschek, A., Richdale, A. L., Trollor, J. N., & Stokes, M. A. (2024) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-024-06489-x · Cited by 6
“In non-autistic samples, depression mediated the relationship between social support and suicidal ideation, supporting the hypothesis that better social support may be particularly salient to depressed individuals who are susceptible to thoughts of self-harm or suicidality (Kim et al., 2021).”
Zheng, B., Zhu, N., Yu, M. Y., Guan, Y., Zheng, Z., Deng, Y., & Jiang, Y. (2024) · Journal of Advanced Nursing · doi:10.1111/jan.16591 · Cited by 6
Khaled, S. M., Amro, I., Bader, L., Woodruff, P. W. R., Alabdulla, M., Bellaj, T., Marzouk, Y., Hasan, Y., Alkaabi, I., & Haddad, P. M. (2021) · Discover Psychology · doi:10.1007/s44202-021-00009-z · Cited by 6
“However, its predictive value has been reported to be low [41].”
BackgroundOh, T. K., Park, H. Y., & Song, I. (2023) · Psychiatry Investigation · doi:10.30773/pi.2023.0072 · Cited by 4
Morejón, A. J. V., Vázquez-Reyes, A., Salas‐Azcona, R., & Vázquez-Morejón, R. (2024) · International Journal of Social Psychiatry · doi:10.1177/00207640241299325 · Cited by 3
“…(PHQ-9; Kroenke et al., 2001) ‘thoughts that you would be better off dead or harming yourself in some way’ (Bauer et al., 2013; Glazer et al., 2020; Kim et al., 2021; Litster et al., 2018; Na et al., 2018; Rossom et al., 2017; Simon et al., 2013; Walker et al., 2011) , being considered as a…”
Ayilara, O. F., White, A., Dunleavy, G., Ferro, M. A., Araya, R., Schmider, J., Seward, N., & Sajobi, T. T. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.120226 · Cited by 5
A Machine Learning Approach for Predicting Wage Workers’ Suicidal Ideation
Park, H., & Lee, K. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12060945 · Cited by 5
Self-citationA Comparative Study of Machine Learning Algorithms in Predicting Mental Disorders
Sneha, Bhatia, S., & Batra, M. (2024) · International Conference on Advances in Computation, Communication and Information Technology (ICAICCIT) · doi:10.1109/icaiccit64383.2024.10912431 · Cited by 4
Gonçalves, W. S., de Moraes, C. E. F., Moulin, C. D. C., Bulik, C. M., Sichieri, R., Hay, P., & Appolinário, J. C. (2025) · Australasian Psychiatry · doi:10.1177/10398562251383783 · Cited by 2
“34 Furthermore, although our sample may show an increased rate of SI due to the instrument, the impact of this factor was the same across the four groups, so the relative differences between them remain convincing.”
Christensen, H. B., Michalsen, A., Brattmyr, M., Havnen, A., & Solem, S. (2024) · Nordic Psychology · doi:10.1080/19012276.2024.2313526 · Cited by 2
“This item has previously demonstrated a good ability to detect SI in individuals and have high convergent validity with other measures of the SI construct (Kim et al., 2021), and could be a predictor of subsequent suicide attempts (Simon et al., 2013).”
Puig-Lagunes, Á. A., Varela-Castillo, G. Y., Rodríguez‐Landa, J. F., Ortiz-Cruz, F., & Germán-Ponciano, L. J. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1410873 · Cited by 2
Zhang, J., Liu, Y., Zhang, C., Chen, Y., Hu, Y., Yang, X., Liu, W., Zhang, W., Liu, D., & Song, H. (2024) · Digital Health · doi:10.1177/20552076241287450 · Cited by 2
Xiong, S., Si, D., Ding, M., Tang, C., Zhu, J., Li, D., Lei, Y., Huang, L., Chen, X., & Chen, J. (2025) · BMC Geriatrics · doi:10.1186/s12877-025-05980-z · Cited by 1
“Numerous studies have demonstrated that using the PHQ-9 to screen individuals for SI is effective, accurate, and reliable [46–49].”
Food Addiction und Alkoholkonsum vor Adipositaschirurgie
Thomas, T. A., Pommnitz, M., Tilk, K., Meyer, G., Hüttl, T. P., de Zwaan, M., & Müller, A. (2022) · SUCHT - Zeitschrift für Wissenschaft und Praxis / Journal of Addiction Research and Practice · doi:10.1024/0939-5911/a000773 · Cited by 2
Crisol-Deza, D. A. (2022) · Universidad Privada San Juan Bautista · doi:10.59590/upsjb/fcs.med.hum/tesis/4449 · Cited by 2
Gil, T., & Bonetti, T. C. (2024) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2024.100809 · Cited by 3
Fields, A. M., Lewis, O. J., Hill, R. B. S., Reynolds, M., Gilreath, R., & Castle, M. (2025) · Current Psychology · doi:10.1007/s12144-025-07900-1 · Cited by 1
“Patient health questionnaire-9 Another reliable assessment tool for measuring and predicting suicide risk is the Patient Health Qustsionnaire-9 (PHQ-9; Kroenke et al., 2001; Kim et al., 2021).”
Adebayo, A. A., Obianyo, C. M., Johnson, K., Mbonu, J. C., Erukusin, T., Mokwenye, V. C., Adetifa, O., Akinade, O. N., Okobi, O. E., & Adeyemi, A. R. (2025) · Cureus · doi:10.7759/cureus.86356 · Cited by 3
“[64] Quantitative study using machine learning The study applied machine learning algorithms to PHQ-9 questionnaire data with the objective of determining the most effective items in screening for suicidal ideation.”
Mahmoud, Y. A., Al-Khatib, A., Almahmoud, Y., Darwish, M., Ranjous, Y., Etma, L., Haidar, M. Y., Mohamad, R., & Gad, A. M. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.120614 · Cited by 2
Navarro-Loli, J. S., Domínguez-Lara, S., Lourenço, A. A., Paiva, T. T., & la Cruz, G. C.-D. (2026) · Revista Colombiana de Psicología · doi:10.15446/rcp.v35n2.119924 · Cited by 1
Comparison of screening for suicidal ideation in the year prior to death by suicide
Miller, N. E., North, F., Duval, M., Tieben, J., & Pecina, J. L. (2022) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2022.100446 · Cited by 1
Salerno, J. P., Getrich, C. M., Fish, J. N., Castillo, Y., Edmiston, S., Sandoval, P., Aparicio, E. M., Fryer, C. S., & Boekeloo, B. O. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115583 · Cited by 1
Mijatović-Jovanović, V., Milijašević, D., Čanković, S., Tomašević, T., Šušnjević, S., & Ukropina, S. (2024) · Vojnosanitetski pregled · doi:10.2298/vsp231023005m · Cited by 1
Machine-Learning-Based Diagnosis of Mental Health Issues
Chopra, S., Agarwal, P., Ahmed, J., & Obaid, A. J. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-99-9489-2_37 · Cited by 2
曹, 辉. (2024) · Advances in Psychology · doi:10.12677/ap.2024.145301 · Cited by 1
“目前已有国内外研究将决策树模型引入学生自杀预测的研究当中 (Kim et al., 2021; Kirtley et al., 1999; 薛”
Huarcaya-Victoria, J., Carrillo, J. F. S., Cabrejos-Espinoza, M., Ponce-Pantigoso, M., Broncano-Rivera, K., & Loarte-Cabrera, A. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-06480-5 · Cited by 1
Martínez-Rives, N. L., Martín, P., Asano, K., & Kotera, Y. (2025) · Social Sciences · doi:10.3390/socsci14100616 · Cited by 2
“…Screen Version, and with the Patient Health Questionnaire-9 (PHQ-9), we evaluated suicide risk in a more indirect way since depression has been strongly associated with suicide risk (Bachmann 2018; Brådvik 2018), and the PHQ-9 has proven efficacy in evaluating suicidal ideation (Kim et al. 2021).”
Mahmud, S. A. S., Mohsin, M., Muyeed, A., Nazneen, S., Sayed, M. A., Murshed, N., & Islam, A. (2022) · Research Square · doi:10.21203/rs.3.rs-2069873/v1 · Cited by 1
Yang, H., Chen, W., Xu, L., Yang, M., Luan, L., & Zhang, X. (2023) · Research Square · doi:10.21203/rs.3.rs-3239115/v1 · Cited by 1
It is time to dethrone suicidal ideations as a risk predictor
Alameddine, A. (2025) · Australasian Psychiatry · doi:10.1177/10398562251325720 · Cited by 1
Little, V., Gatanaga, O. S., Hutchins, S., & Gloria, C. T. (2023) · Health Affairs Scholar · doi:10.1093/haschl/qxad029
“23,24 Insofar as there is no definitive consensus against the inclusion of item 9 in the PHQ-9, we believe that PCPs would benefit from utilizing the unabridged version of the PHQ-9 as an exploratory item around suicidal thoughts for individuals who may already carry depressive symptomology that…”
MethodEvaluating Factors Associated with Suicidal Ideation Among Healthcare Workers: A Secondary Analysis
Agarwal, A. K., Schroeder, D., Gonzales, R. E., Southwick, L., Bellini, L. M., Asch, D. A., & Merchant, R. M. (2025) · Journal of General Internal Medicine · doi:10.1007/s11606-025-09544-0
Suicidal Ideation in Spinocerebellar Ataxia
Peppel, L., Lai, R., Rummey, C., Opal, P., Schmahmann, J. D., Gomez, C. M., Paulson, H. L., Zesiewicz, T. A., Perlman, S., Wilmot, G. R., et al. (2025) · Journal of Neuropsychiatry · doi:10.1176/appi.neuropsych.20250006
Zamani, I., Khan, M., Manzardo, A. M., & Khanzada, N. (2025) · Cureus · doi:10.7759/cureus.87919
Mao, W., Shalaby, R., Owusu, E., Elgendy, H. E., Agyapong, B., Eboreime, E., Silverstone, P. H., Chue, P. S., Li, X., Vuong, W., et al. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1595303 · Cited by 6
Hajek, A., Stickley, A., Zwar, L., Peltzer, K., Pengpid, S., Gyasi, R. M., Yon, D. K., & König, H. (2025) · Journal of Public Health · doi:10.1007/s10389-025-02627-6 · Cited by 2
Waddell, R. L., Spray, B. J., Crawley, L., Williams, J. H., Campos, S., Howard, L. E., & Spiro, D. M. (2025) · Pediatric Emergency Care · doi:10.1097/pec.0000000000003515
Bogner, S., Seliger, C., Leitzmann, M. F., & Bohmann, P. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2025.103670
“Tools such as the Patient Health Questionnaire-9, 110 the Distress Ther-mometer, 111 or the Columbia Suicide Severity Rating Scale 112 are widely used and can be integrated into waiting-room questionnaires.”
Kim, C. S., Kim, Y., Lee, A., Lee, W., Choi, Y., Kim, H., Lee, M., & Yang, J. H. (2025) · Journal of Korean Medical Science · doi:10.3346/jkms.2025.40.e340
Milatz, F., Klotsche, J., Niewerth, M., Sengler, C., Windschall, D., Kallinich, T., Dressler, F., Trauzeddel, R., Holl, R. W., Foeldvari, I., et al. (2024) · Figshare · doi:10.6084/m9.figshare.25583962
Bruce, S. L., Cooper, M., Farmer, C., Folsom, A. M., Fulton, M., Haskins, J., Knight, C., Moore, C. M., Mullins, J. A., Shollenbarger, A. J., et al. (2026) · Brain Sciences · doi:10.3390/brainsci16020185
“Suicide ideation was identified by PHQ-9 question 9 [42].”
SENSE: A Stacked Ensemble Learning Framework for Early Suicidal Risk Prediction in Adolescents
Metri, P., & Kukreja, S. (2025) · International Conference on Advances in Computation, Communication and Information Technology (ICAICCIT) · doi:10.1109/icaiccit68829.2025.11434211
Zatti, C., & da Rocha, N. S. (2026) · Psicologia Reflexão e Crítica · doi:10.1186/s41155-026-00384-3
“Nevertheless, more recent studies employing this same item in combination with machine-learning algorithms in large samples ( n = 8,760) have demonstrated its reliability and usefulness as a screening tool for suicidal ideation in primary health care settings (Kim et al., 2021).”
Understanding suicidal ideation in Cambodia: the roles of PTSD, shame, and guilt
Fleddermann, K., Ean, N., Mannarino, J. A., Carrico, A. C., Paul, R. H., White, H., & Bruce, S. E. (2026) · International Journal of Mental Health · doi:10.1080/00207411.2026.2630428
Fernandes, O., Portugal, L. C. L., da Fonseca, P. M. D. O., Muchaluat-Saade, D. C., David, I. A., Machado, A. V., Volchan, E., Erthal, F. S., Pereira, M. G., & Oliveira, L. M. (2026) · The Lancet Regional Health - Americas · doi:10.1016/j.lana.2026.101487
“69,70 Additionally, a history of prior suicide attempts was not included because the survey instrument did not assess this information.”
Prelog, P. R., Zupan, M., & Frol, S. (2026) · Frontiers in Neurology · doi:10.3389/fneur.2026.1867538
“…(PHQ-9) item 9 or analogous items in Hospital Anxiety and Depression Scale (HADS) and Center for Epidemiologic Studies Depression Scale (CES-D)] to dedicated suicidality questionnaires and non-standardized clinical ratings, with differing time frames and thresholds for “caseness” (2, 4, 6, 8).”
InfluentialLayrón, J. E., Marco, J. H., Salom, R., & Pérez, S. (2026) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.70084
“Previous research suggests that brief or single‐ item indicators of suicidal ideation, including those derived from depression measures (e.g., PHQ‐9 item 9), may provide a valid approximation for screening purposes (Desseilles et al. 2012; Kim et al. 2021).”
Jung, H. W., Lee, J. J., & Kim, O. (2026) · European Psychiatry · doi:10.1192/j.eurpsy.2026.11847
Zhou, H., Sun, Y., Guo, Y.-Z.-Y., Guo, F., Li, S., Wang, Y., Zhou, X., Mu, F.-Q., Qiao, Y., Liu, M., et al. (2026) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2026.07.017
A machine learning framework for the multi-class prediction of suicide attempt risk
Nordin, N., Noor, M. H. M., Zainol, Z. B., Chan, L. F., & Buji, R. I. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.107815
Rousan, M. J., McGonigle, T., Muscatello, R. A., Vandekar, S., & Corbett, B. A. (2026) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-026-07588-7
Metadata
- Authors
- Kim, S., Lee, H.-K., & Lee, K.
- Affiliations
- Hanyang University Seoul Hospital (KR)
- Kongju National University (KR)
- Corresponding author
- Lee, Kounseok
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2021-03-24
- Volume
- 18
- Issue
- 7
- Pages
- 3339
- ISSN
- 1660-4601 (ISSN-L)
- PMC
- PMC8036742
- OpenAlex
- W3145871323
- Cited by
- 99
- References
- 56
- Citations by year
- 2026: 11 · 2025: 21 · 2024: 26 · 2023: 15 · 2022: 20 · 2021: 6
- FWCI
- 11.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- International Journal of Environmental Research and Public Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Research Foundation of Korea (2018R1D1A1B07050245)
- Ministry of Trade, Industry and Energy (20012931)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- PHQ-9, suicidal ideation, suicide risk screening, depression screening, PHQ-2, PHQ-8, university students, random forest, linear discriminant analysis, k-nearest neighbors, primary care
- MeSH terms
- Machine Learning, Patient Health Questionnaire, Depression, Humans, Mass Screening, Psychiatric Status Rating Scales, Surveys and Questionnaires, Suicidal Ideation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
