Suicide prediction models: a critical review of recent research with recommendations for the way forward
Open accessAbstract
Suicide is a leading cause of death. A substantial proportion of the people who die by suicide come into contact with the health care system in the year before their death. This observation has resulted in the development of numerous suicide prediction tools to help target patients for preventive interventions. However, low sensitivity and low positive predictive value have led critics to argue that these tools have no clinical value. We review these tools and critiques here. We conclude that existing tools are suboptimal and that improvements, if they can be made, will require developers to work with more comprehensive predictor sets, staged screening designs, and advanced statistical analysis methods. We also conclude that although existing suicide prediction tools currently have little clinical value, and in some cases might do more harm than good, an even-handed assessment of the potential value of refined tools of this sort cannot currently be made because such an assessment would depend on evidence that currently does not exist about the effectiveness of preventive interventions. We argue that the only way to resolve this uncertainty is to link future efforts to develop or evaluate suicide prediction tools with concrete questions about specific clinical decisions aimed at reducing suicides and to evaluate the clinical value of these tools in terms of net benefit rather than sensitivity or positive predictive value. We also argue for a focus on the development of individualized treatment rules to help select the right suicide-focused treatments for the right patients at the right times. Challenges will exist in doing this because of the rarity of suicide even among patients considered high-risk, but we offer practical suggestions for how these challenges can be addressed.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Digital phenotyping takes advantage of unprecedented types and amounts of data including movement, pulse rate, blood pressure, and sleep, meals and other lifestyle patterns, in addition to repeated self-report and neurocognitive tests.
“Digital phenotyping, the 'moment-by-moment quantification of the individuallevel human phenotype in situ using data from personal digital devices' 636 takes advantage of unprecedented types and amounts of data including movement, pulse rate, blood pressure, and sleep, meals and other lifestyle patterns, in addition to repeated self-report and neurocognitive tests. 637”
From Time for united action on depression: a Lancet–World Psychiatric Association Commission (2022) · cites this paper as [637]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Regression Modeling Strategies
Harrell, F. E. (2001) · Springer series in statistics · doi:10.1007/978-1-4757-3462-1 · Cited by 9,270 · see citing works
Beck, A. T., Steer, R. A., & Brown, G. (2011) · PsycTESTS Dataset · doi:10.1037/t00742-000 · Cited by 7,535 · see citing works
Stone, N. J., Robinson, J. G., Lichtenstein, A. H., Bairey Merz, C. N., Blum, C. B., Eckel, R. H., Goldberg, A. C., Gordon, D., Levy, D., Lloyd-Jones, D. M., et al. (2014) · Circulation · doi:10.1161/01.cir.0000437738.63853.7a · Cited by 7,081 · see citing works
Harrell (2015) · Springer Series in Statistics · doi:10.1007/978-3-319-19425-7 · Cited by 6,878 · see citing works
Decision curve analysis: a novel method for evaluating prediction models
Vickers, A. J., & Elkin, E. B. (2006) · Medical Decision Making · doi:10.1177/0272989x06295361 · Cited by 6,341 · see citing works
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298 · see citing works
Christodoulou, E., Ma, J., Collins, G. S., Steyerberg, E. W., Verbakel, J. Y., & Van Calster, B. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.02.004 · Cited by 2,119 · see citing works
Suicide prevention strategies revisited: 10-year systematic review
Zalsman, G., Hawton, K., Wasserman, D., van Heeringen, K., Arensman, E., Sarchiapone, M., Carli, V., Höschl, C., Barzilay, R., Balazs, J., et al. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30030-x · Cited by 1,765 · see citing works
Contact With Mental Health and Primary Care Providers Before Suicide: A Review of the Evidence
Luoma, J. B., Martin, C. E., & Pearson, J. L. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.6.909 · Cited by 1,576 · see citing works
Relief-based feature selection: Introduction and review
Urbanowicz, R. J., Meeker, M., La Cava, W., Olson, R. S., & Moore, J. H. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.07.014 · Cited by 1,311 · see citing works
Reporting and Interpreting Decision Curve Analysis: A Guide for Investigators
CALSTER, B. V., Wynants, L., Verbeek, J. F. M., Verbakel, J. Y. J., Christodoulou, E., Vickers, A. J., Roobol, M. J., & Steyerberg, E. W. (2018) · European Urology · doi:10.1016/j.eururo.2018.08.038 · Cited by 1,306 · see citing works
(2015) · neural information processing systems · Cited by 1,305 · see citing works
Proceedings of the 24th International Conference on Neural Information Processing Systems
Shawe-Taylor, J. S., Zemel, R. S., Bartlett, P. L., Pereira, F. B., & Weinberger, K. Q. (2011) · Cited by 1,184 · see citing works
Vickers, A. J., Van Calster, B., & Steyerberg, E. W. (2016) · BMJ · doi:10.1136/bmj.i6 · Cited by 1,163 · see citing works
Empirical characterization of random forest variable importance measures
Archer, K. J., & Kimes, R. (2007) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2007.08.015 · Cited by 1,118 · see citing works
Data Mining for Imbalanced Datasets: An Overview
Chawla, N. V. (2009) · Springer eBooks · doi:10.1007/978-0-387-09823-4_45 · Cited by 1,092 · see citing works
Naghavi, M. (2019) · BMJ · doi:10.1136/bmj.l94 · Cited by 1,043 · see citing works
Semiparametric Efficiency in Multivariate Regression Models with Missing Data
Robins, J. M., & Rotnitzky, A. G. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476494 · Cited by 888 · see citing works
Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., Nichols, C. N., Lampropoulos, G. K., Walker, B. S., Cohen, G., et al. (2006) · The Counseling Psychologist · doi:10.1177/0011000005285875 · Cited by 737 · see citing works
Health care contacts in the year before suicide death.
Ahmedani, B. K., Simon, G. E., Stewart, C., Beck, A., Waitzfelder, B. E., Rossom, R., Lynch, F., Owen-Smith, A., Hunkeler, E. M., Whiteside, U., et al. (2014) · Journal of General Internal Medicine · doi:10.1007/s11606-014-2767-3 · Cited by 671 · see citing works
Development of suicidal intent scales.
Beck, A. T., Schuyler, D., & Herman, I. (1974) · Cited by 663 · see citing works
Suicide Rates After Discharge From Psychiatric Facilities: A Systematic Review and Meta-analysis
Chung, D. T., Ryan, C. J., Hadzi-Pavlovic, D., Singh, S. P., Stanton, C., & Large, M. M. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.1044 · Cited by 651 · see citing works
Stone, D. M., Simon, T. R., Fowler, K. A., Kegler, S. R., Yuan, K., Holland, K. M., Ivey-Stephenson, A. Z., & Crosby, A. E. (2018) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm6722a1 · Cited by 634 · see citing works
Measuring the Suicidal Mind: Implicit Cognition Predicts Suicidal Behavior
Nock, M. K., Park, J. M., Finn, C. T., Deliberto, T. L., Dour, H. J., & Banaji, M. R. (2010) · Psychological Science · doi:10.1177/0956797610364762 · Cited by 624 · see citing works
Carroll, R., Metcalfe, C., & Gunnell, D. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089944 · Cited by 586 · see citing works
Predicting Risk of Suicide Attempts Over Time Through Machine Learning
Walsh, C. G., Ribeiro, J. D., & Franklin, J. C. (2017) · Clinical Psychological Science · doi:10.1177/2167702617691560 · Cited by 571 · see citing works
Prediction Models for Suicide Attempts and Deaths: A Systematic Review and Simulation
Belsher, B. E., Smolenski, D. J., Pruitt, L. D., Bush, N. E., Beech, E. H., Workman, D. E., Morgan, R. L., Evatt, D. P., Tucker, J., & Skopp, N. A. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0174 · Cited by 540 · see citing works
Kessler, R. C., Warner, C. H., Ivany, C., Petukhova, M. V., Rose, S., Bromet, E. J., Brown, M., Cai, T., Colpe, L. J., Cox, K. L., et al. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1754 · Cited by 447 · see citing works
Self-citationTreatment selection in depression.
Cohen, Z. D., & DeRubeis, R. J. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050817-084746 · Cited by 435 · see citing works
Disclosure of sensitive behaviors across self-administered survey modes: a meta-analysis
Gnambs, T., & Kaspar, K. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0533-4 · Cited by 422 · see citing works
Simon, G. E., Johnson, E., Lawrence, J. M., Rossom, R. C., Ahmedani, B., Lynch, F. L., Beck, A., Waitzfelder, B., Ziebell, R., Penfold, R. B., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17101167 · Cited by 400 · see citing works
Stable weights that balance covariates for estimation with incomplete outcome data
Zubizarreta, J. R. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1023805 · Cited by 369 · see citing works
Carter, G., Milner, A., McGill, K., Pirkis, J., Kapur, N., & Spittal, M. J. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.182717 · Cited by 361 · see citing works
Predicting suicidal behavior from longitudinal electronic health records.
Barak-Corren, Y., Castro, V. M., Javitt, S., Hoffnagle, A. G., Dai, Y., Perlis, R. H., Nock, M. K., Smoller, J. W., & Reis, B. Y. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16010077 · Cited by 339 · see citing works
Deaths: Leading Causes for 2016.
Heron, M. (2018) · PubMed · Cited by 303 · see citing works
Suicide risk assessment and intervention in people with mental illness
Bolton, J. M., Gunnell, D., & Turecki, G. (2015) · BMJ · doi:10.1136/bmj.h4978 · Cited by 294 · see citing works
The Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS)
Ursano, R. J., Colpe, L. J., Heeringa, S. G., Kessler, R. C., Schoenbaum, M., Stein, M. B., & collaborators, O. B. O. T. A. S. (2014) · Psychiatry · doi:10.1521/psyc.2014.77.2.107 · Cited by 283 · see citing works
Self-citationJobes, D. A. (2012) · Suicide and Life-Threatening Behavior · doi:10.1111/j.1943-278x.2012.00119.x · Cited by 264 · see citing works
Attitudes towards clinical services among people who self-harm: systematic review
Taylor, T. L., Hawton, K., Fortune, S., & Kapur, N. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.107.046425 · Cited by 256 · see citing works
McCarthy, J. F., Bossarte, R. M., Katz, I. R., Thompson, C., Kemp, J., Hannemann, C. M., Nielson, C., & Schoenbaum, M. (2015) · American Journal of Public Health · doi:10.2105/ajph.2015.302737 · Cited by 251 · see citing works
Self-citationRuneson, B., Odeberg, J., Pettersson, A., Edbom, T., Jildevik Adamsson, I., & Waern, M. (2017) · PLOS ONE · doi:10.1371/journal.pone.0180292 · Cited by 250 · see citing works
Large, M., Kaneson, M., Myles, N., Myles, H., Gunaratne, P., & Ryan, C. (2016) · PLOS ONE · doi:10.1371/journal.pone.0156322 · Cited by 248 · see citing works
Lithium and suicide in mood disorders: Updated meta‐review of the scientific literature
Smith, K. A., & Cipriani, A. (2017) · Bipolar Disorders · doi:10.1111/bdi.12543 · Cited by 247 · see citing works
Vermeulen, J. M., van Rooijen, G., van de Kerkhof, M. P. J., Sutterland, A. L., Correll, C. U., & de Haan, L. (2019) · Schizophrenia Bulletin · doi:10.1093/schbul/sby052 · Cited by 246 · see citing works
Large, M., Sharma, S., Cannon, E., Ryan, C., & Nielssen, O. (2011) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048674.2011.590465 · Cited by 234 · see citing works
A Computer Interview for Suicide-Risk Prediction
GREIST, J. H., LAUGHREN, T. P., GUSTAFSON, D. H., STAUSS, F. F., ROWSE, G. L., & CHILES, J. A. (1973) · American Journal of Psychiatry · doi:10.1176/ajp.130.12.1327 · Cited by 221 · see citing works
The Zero Suicide Model: Applying Evidence-Based Suicide Prevention Practices to Clinical Care
Brodsky, B. S., Spruch-Feiner, A., & Stanley, B. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00033 · Cited by 221 · see citing works
Kessler, R. C., Hwang, I., Hoffmire, C. A., McCarthy, J. F., Petukhova, M. V., Rosellini, A. J., Sampson, N. A., Schneider, A. L., Bradley, P. A., Katz, I. R., et al. (2017) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1575 · Cited by 209 · see citing works
Self-citationO'Connor, E., Gaynes, B. N., Burda, B. U., Soh, C., & Whitlock, E. P. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-10-201305210-00642 · Cited by 193 · see citing works
Chung, D., Hadzi-Pavlovic, D., Wang, M., Swaraj, S., Olfson, M., & Large, M. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-023883 · Cited by 191 · see citing works
The American Psychiatric Association Practice Guidelines for the Psychiatric Evaluation of Adults
Silverman, J. J., Galanter, M. S., Jackson‐Triche, M., Jacobs, D. G., Lomax, J. W., Riba, M., Tong, L., Watkins, K. E., Fochtmann, L. J., Rhoads, R. S., et al. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.1720501 · Cited by 183 · see citing works
Chan, K. C. G., Yam, S. C. P., & Zhang, Z. (2015) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12129 · Cited by 175 · see citing works
Statistical inference for the mean outcome under a possibly non-unique optimal treatment strategy
Luedtke, A. R., & van der Laan, M. J. (2016) · The Annals of Statistics · doi:10.1214/15-aos1384 · Cited by 174 · see citing works
Self-citationDhingra, K., Boduszek, D., & O’Connor, R. C. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.07.007 · Cited by 169 · see citing works
Fernandes, A. C., Dutta, R., Velupillai, S. U., Sanyal, J., Stewart, R. J., & Chandran, D. (2018) · Scientific Reports · doi:10.1038/s41598-018-25773-2 · Cited by 168 · see citing works
Comtois, K. A., Kerbrat, A. H., DeCou, C. R., Atkins, D. C., Majeres, J. J., Baker, J. C., & Ries, R. K. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.4530 · Cited by 144 · see citing works
Pestian, J. P., Sorter, M. T., Connolly, B., Cohen, K. B., McCullumsmith, C. B., Gee, J. T., Morency, L., Scherer, S. J., & Rohlfs, L. (2016) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12312 · Cited by 142 · see citing works
Risk Factors for Repetition of Self-Harm: A Systematic Review of Prospective Hospital-Based Studies
Larkin, C., Blasi, Z. D., & Arensman, E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084282 · Cited by 141 · see citing works
ROSEN, A. P. (1954) · Journal of Consulting Psychology · doi:10.1037/h0058579 · Cited by 135 · see citing works
Bryan, C. J., Rudd, M. D., Wertenberger, E. G., Etienne, N., Ray-Sannerud, B. N., Morrow, C. E., Peterson, A. L., & Young‐McCaughan, S. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.02.021 · Cited by 134 · see citing works
Bernert, R. A., Hom, M. A., & Roberts, L. W. (2014) · Academic Psychiatry · doi:10.1007/s40596-014-0180-1 · Cited by 129 · see citing works
Machine learning versus statistical modeling
Boulesteix, A., & Schmid, M. C. (2014) · Biometrical Journal · doi:10.1002/bimj.201300226 · Cited by 122 · see citing works
Primary care contact prior to suicide in individuals with mental illness
Pearson, A., Saini, P., Cruz, D. D., Miles, C., While, D., Swinson, N., Williams, A., Shaw, J. J., Appleby, L., & Kapur, N. (2009) · British Journal of General Practice · doi:10.3399/bjgp09x472881 · Cited by 120 · see citing works
Owens, C. V., Hansford, L., Sharkey, S. S., & Ford, T. J. (2015) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.113.141242 · Cited by 119 · see citing works
Schaffer, A., Sinyor, M., Kurdyak, P., Vigod, S., Sareen, J., Reis, C., Green, D., Bolton, J., Rhodes, A., Grigoriadis, S., et al. (2016) · World Psychiatry · doi:10.1002/wps.20321 · Cited by 118 · see citing works
Cooper, J., Steeg, S., Bennewith, O., Lowe, M., Gunnell, D., House, A. O., Hawton, K. E., & Kapur, N. (2013) · BMJ Open · doi:10.1136/bmjopen-2013-003444 · Cited by 117 · see citing works
The futility of risk prediction in psychiatry
Mulder, R., Newton‐Howes, G., & Coid, J. W. (2016) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.116.184960 · Cited by 117 · see citing works
Assessment of suicide risk by computer‐delivered self‐rating questionnaire: preliminary findings
Levine, S., Ancill, R. J., & Roberts, A. P. (1989) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1989.tb01330.x · Cited by 112 · see citing works
Meta-analysis of suicide rates among psychiatric in-patients
Walsh, G., Sara, G., Ryan, C. J., & Large, M. (2015) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12383 · Cited by 110 · see citing works
Carson, N. J., Mullin, B. O., Román, M. J. S., Lu, F. Q., Yang, K. G., Menezes, M., & Cook, B. L. (2019) · PLoS ONE · doi:10.1371/journal.pone.0211116 · Cited by 109 · see citing works
Assessment of self-harm risk using implicit thoughts
Randall, J. R., Rowe, B. H., Dong, K. A., Nock, M. K., & Colman, I. (2013) · Psychological Assessment · doi:10.1037/a0032391 · Cited by 92 · see citing works
Woodford, R., Spittal, M. J., Milner, A., McGill, K., Kapur, N., Pirkis, J., Mitchell, A., & Carter, G. (2019) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12395 · Cited by 92 · see citing works
Selecting Optimal Subgroups for Treatment Using Many Covariates
VanderWeele, T. J., Luedtke, A. R., van der Laan, M. J., & Kessler, R. C. (2019) · Epidemiology · doi:10.1097/ede.0000000000000991 · Cited by 91 · see citing works
Self-citationQuinlivan, L. M., Cooper, J., Davies, L. M., Hawton, K. E., Gunnell, D., & Kapur, N. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-009297 · Cited by 89 · see citing works
Hoffmire, C., Stephens, B., Morley, S., Thompson, C., Kemp, J., & Bossarte, R. M. (2016) · Public Health Reports® · doi:10.1177/0033354916670133 · Cited by 87 · see citing works
Self-citationChoi, S. B., Lee, W., Yoon, J., Won, J., & Kim, D. W. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.01.019 · Cited by 85 · see citing works
Hunter, C., Chantler, K., Kapur, N., & Cooper, J. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.08.009 · Cited by 82 · see citing works
The Construction and Selection of Predictive Scales, with Special Reference to Parasuicide
Kreitman, N., & Foster, J. (1991) · The British Journal of Psychiatry · doi:10.1192/bjp.159.2.185 · Cited by 80 · see citing works
Scales for predicting risk following self-harm: an observational study in 32 hospitals in England
Quinlivan, L., Cooper, J., Steeg, S., Davies, L., Hawton, K., Gunnell, D., & Kapur, N. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-004732 · Cited by 79 · see citing works
Large, M., Myles, N., Myles, H., Corderoy, A., Weiser, M., Davidson, M., & Ryan, C. J. (2018) · Psychological Medicine · doi:10.1017/s0033291717002537 · Cited by 76 · see citing works
Psychological approaches to suicide treatment and prevention
Jobes, D. A., Au, J. S., & Siegelman, A. (2015) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-015-0064-3 · Cited by 73 · see citing works
Beck, A. T., Resnik, A. T., & Lettieri, D. J. (2014) · PsycTESTS Dataset · doi:10.1037/t15303-000 · Cited by 69 · see citing works
Mining social networks to improve suicide prevention: A scoping review
López‐Castromán, J., Moulahi, B., Azé, J., Bringay, S., Deninotti, J., Guillaume, S., & Baca‐García, E. (2019) · Journal of Neuroscience Research · doi:10.1002/jnr.24404 · Cited by 69 · see citing works
Clinical Identification of Suicidal Risk
Murphy, G. E. (1972) · Archives of General Psychiatry · doi:10.1001/archpsyc.1972.01750270062009 · Cited by 67 · see citing works
Psychiatric hospitalisation and the risk of suicide
Large, M. M. B., & Kapur, N. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.22 · Cited by 67 · see citing works
Optimal Individualized Treatments in Resource-Limited Settings
Luedtke, A. R., & van der Laan, M. J. (2016) · The International Journal of Biostatistics · doi:10.1515/ijb-2015-0007 · Cited by 64 · see citing works
Self-citationBrown, J. L., Swartzendruber, A. L., & DiClemente, R. J. (2013) · Caries Research · doi:10.1159/000351827 · Cited by 58 · see citing works
McKernan, L. C., Clayton, E. W., & Walsh, C. G. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00650 · Cited by 52 · see citing works
Bernecker, S. L., Zuromski, K. L., Gutierrez, P. M., Joiner, T. E., King, A. J., Liu, H., Nock, M. K., Sampson, N. A., Zaslavsky, A. M., Stein, M. B., et al. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.11.018 · Cited by 45 · see citing works
Self-citationThe prevalence rates of suicide are likely underestimated worldwide: why it matters
Katz, C., Bolton, J. M., & Sareen, J. (2015) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-015-1158-3 · Cited by 44 · see citing works
The coping long term with active suicide program: Description and pilot data
Miller, I. W., Gaudiano, B. A., & Weinstock, L. M. (2016) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12247 · Cited by 44 · see citing works
The Role of Big Data Analytics in Predicting Suicide
Kessler, R. C., Bernecker, S. L., Bossarte, R. M., Luedtke, A. R., McCarthy, J. F., Nock, M. K., Pigeon, W. R., Petukhova, M. V., Sadikova, E., VanderWeele, T. J., et al. (2019) · Personalized Psychiatry · doi:10.1007/978-3-030-03553-2_5 · Cited by 44 · see citing works
Self-citationClinical epidemiological research on suicide-related behaviors—where we are and where we need to go
Kessler, R. C. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.1238 · Cited by 41 · see citing works
Self-citationPredicting suicide with the SAD PERSONS scale
Katz, C., Randall, J. R., Sareen, J., Chateau, D. G., Walld, R., Leslie, W. D., Wang, J., & Bolton, J. M. (2017) · Depression and Anxiety · doi:10.1002/da.22632 · Cited by 37 · see citing works
Overcoming Challenges to Evidence‐Based Policy Development in a Large, Integrated Delivery System
Frakt, A. B., Prentice, J. C., Pizer, S. D., Elwy, A. R., Garrido, M. M., Kilbourne, A. M., & Atkins, D. (2018) · Health Services Research · doi:10.1111/1475-6773.12986 · Cited by 33 · see citing works
McCoy, T. H., Pellegrini, A. M., & Perlis, R. H. (2019) · Depression and Anxiety · doi:10.1002/da.22882 · Cited by 31 · see citing works
Ben-Ari, A., & Hammond, K. (2015) · 2015 48th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2015.382 · Cited by 30 · see citing works
Suicide Reduction and Research Efforts in Service Members and Veterans—Sobering Realities
Hoge, C. W. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.4564 · Cited by 30 · see citing works
Newborn Screening for Genetic Disorders
Fernhoff, P. M. (2009) · Pediatric Clinics of North America · doi:10.1016/j.pcl.2009.03.002 · Cited by 29 · see citing works
Hammond, K. W., Ben‐Ari, A. Y., Laundry, R. J., Boyko, E. J., & Samore, M. H. (2015) · Journal of Traumatic Stress · doi:10.1002/jts.22058 · Cited by 29 · see citing works
Methodological advances in statistical prediction.
Garb, H. N., & Wood, J. M. (2019) · Psychological Assessment · doi:10.1037/pas0000673 · Cited by 28 · see citing works
Stefánsson, J. G., Nordström, P., Runeson, B., Åsberg, M., & Jokinen, J. (2015) · BMC Psychiatry · doi:10.1186/s12888-015-0607-6 · Cited by 24 · see citing works
Use of Text Search to Effectively Identify Lifetime Prevalence of Suicide Attempts among Veterans
Hammond, K. W., Laundry, R. J., OLeary, T. M., & Jones, W. (2013) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2013.586 · Cited by 21 · see citing works
Why Suicide Risk Assessment Still Matters
Wortzel, H. S., Nazem, S., Bahraini, N. H., & Matarazzo, B. B. (2017) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000263 · Cited by 21 · see citing works
SUICIDE RISK ASSESSMENT IN THE EMERGENCY DEPARTMENT: OUT OF THE DARKNESS
Bolton, J. M. (2014) · Depression and Anxiety · doi:10.1002/da.22320 · Cited by 20 · see citing works
Steeg, S., Carr, M., Emsley, R., Hawton, K. E., Waters, K., Bickley, H., Ness, J., Geulayov, G., & Kapur, N. (2018) · PLoS ONE · doi:10.1371/journal.pone.0204670 · Cited by 17 · see citing works
Rosen, D. C., Nakash, O., & Alegria, M. M. (2015) · Psychotherapy · doi:10.1037/pst0000022 · Cited by 13 · see citing works
Core Competencies, Warning Signs, and a Framework for Suicide Risk Assessment in Clinical Practice
Nock, M. K., & Rudd, M. D. (2014) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195388565.013.0018 · Cited by 12 · see citing works
The suicide assessment scale: Psychometric properties of a Norwegian language version
Koldsland, B. O., Mehlum, L. I., Mellesdal, L., et al. (2012) · BMC Research Notes · doi:10.1186/1756-0500-5-417 · Cited by 9 · see citing works
Application of a Hybrid Text Mining Approach to the Study of Suicidal Behavior in a Large Population
Hammond, K. W., & Laundry, R. J. (2014) · Proceedings of the ... Annual Hawaii International Conference on System Sciences/Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.321 · Cited by 9 · see citing works
Predictive properties of risk assessment instruments following self-harm
Owens, D., & Kelley, R. (2017) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.116.196253 · Cited by 8 · see citing works
Ichimura, A., Kato, K., Taira, T., Otsuka, H., Seki, T., Nakagawa, Y., & Inokuchi, S. (2018) · Archives of Suicide Research · doi:10.1080/13811118.2018.1438323 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- [34]Simon R Improving suicide risk assessment with evidence-based psychiatry In: Pompili M, Taterelli R editors. Evidence-based practice in suicidology: a sourcebook. Cambridge MA: Hogrefe Publishing; 2011, p. 45– 54.
- [52]Self-harm in over 8s: long-term management. National Institute for Health and Care Excellence (NICE) 2011 Accessed 30 April 2019 31891461
- [66]United States. Public Health Service. Office of the Surgeon General. 2012 National strategy for suicide prevention: goals and objectives for action. National Action Alliance for Suicide Prevention. Washington, DC: National Action Alliance for Suicide Prevention; 2012 https://www.surgeongeneral.gov/library/reports/national-strategy-suicide-prevention/full-report.pdf. 23136686
- [97]Olson RS, Sipper M, La Cava W, Tartarone S, Vitale S, Fu W A system for accessible artificial intelligence. arXiv:1705.00594v2. 2017 Available from: https://arxiv.org/abs/1705.00594. · arXiv
Cited by
Sorted by citations
Time for united action on depression: a Lancet–World Psychiatric Association Commission
Herrman, H., Patel, V., Kieling, C., Berk, M., Buchweitz, C., Cuijpers, P., Furukawa, T. A., Kessler, R. C., Kohrt, B. A., Maj, M., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)02141-3 · Cited by 1,104 · see citing works
Self-citationHawton, K., Lascelles, K., Pitman, A., Gilbert, S., & Silverman, M. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(22)00232-2 · Cited by 196 · see citing works
Nock, M. K., Millner, A. J., Ross, E. L., Kennedy, C. J., Al-Suwaidi, M., Barak-Corren, Y., Castro, V. M., Castro-Ramirez, F., Lauricella, T., Murman, N., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.44373 · Cited by 157 · see citing works
Self-citationIncidence of suicide death in patients with cancer: A systematic review and meta-analysis
Du, L., Shi, H.-Y., Yu, H.-R., Liu, X.-M., Jin, X.-H., Yan-Qian, Fu, X.-L., Song, Y.-P., Cai, J.-Y., & Chen, H.-L. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.07.082 · Cited by 100 · see citing works
John, A., DelPozo-Banos, M., Gunnell, D., Dennis, M., Scourfield, J., Ford, D. V., Kapur, N., & Lloyd, K. (2020) · The British Journal of Psychiatry · doi:10.1192/bjp.2020.137 · Cited by 71 · see citing works
Gatekeeper training for friends and family of individuals at risk of suicide: a systematic review
Morton, M., Wang, S., Tse, K., Chung, C., Bergmans, Y., Ceniti, A., Flam, S., Johannes, R., Schade, K., Terah, F., et al. (2021) · Journal of Community Psychology · doi:10.1002/jcop.22624 · Cited by 43 · see citing works
Lee, P. H., Doyle, A. E., Li, X., Silberstein, M., Jung, J.-Y., Gollub, R. L., Nierenberg, A. A., Liu, R. T., Kessler, R. C., Perlis, R. H., et al. (2022) · Biological Psychiatry · doi:10.1016/j.biopsych.2021.11.026 · Cited by 30 · see citing works
Self-citationFortune, S., & Hetrick, S. (2022) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/00048674221107316 · Cited by 16 · see citing works
Lamontagne, S. J., Zabala, P. K., Zarate, C. A., & Ballard, E. D. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105361 · Cited by 12 · see citing works
Let’s Move Towards Precision Suicidology
Courtet, P., & Saiz, P. A. (2025) · Current Psychiatry Reports · doi:10.1007/s11920-025-01605-9 · Cited by 7 · see citing works
Morales, S., & Barros, J. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.750651 · Cited by 7 · see citing works
- Authors
- Kessler, R. C., Bossarte, R. M., Luedtke, A., Zaslavsky, A. M., & Zubizarreta, J. R.
- Affiliations
- Harvard University (US)
- West Virginia University (US)
- University of Washington (US)
- Corresponding author
- Kessler, Ronald C.
- Venue
- Molecular Psychiatry
- Published
- 2019-09-30
- Volume
- 25
- Issue
- 1
- Pages
- 168-179
- ISSN
- 1359-4184 (ISSN-L)
- 1476-5578
- PMC
- PMC7489362
- OpenAlex
- W2975086838
- Cited by
- 234
- References
- 112
- Citations by year
- 2026: 37 · 2025: 42 · 2024: 33 · 2023: 36 · 2022: 43 · 2021: 26 · 2020: 16 · 2019: 1
- FWCI
- 3.40
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Molecular Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Department of Veterans Affairs Center of Excellence for Suicide Prevention; The Precision Treatment of Mental Disorders Initiative
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Health Sciences › Medicine › Psychiatry and Mental health › Bipolar Disorder and Treatment
- Keywords
- suicide risk prediction, suicide prevention, clinical utility, net benefit, positive predictive value, sensitivity, screening, individualized treatment rules, rare outcomes, preventive interventions
- MeSH terms
- Suicide Prevention, Forecasting, Humans, Suicide, Risk Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review