The DOI matches its Crossref record, with a small difference in title or year; 43 of the 46 references it cites were found in a registry or an index.
Prediction Models for Suicide Attempts and Deaths: A Systematic Review and Simulation
Abstract
Importance: Suicide prediction models have the potential to improve the identification of patients at heightened suicide risk by using predictive algorithms on large-scale data sources. Suicide prediction models are being developed for use across enterprise-level health care systems including the US Department of Defense, US Department of Veterans Affairs, and Kaiser Permanente. Objectives: To evaluate the diagnostic accuracy of suicide prediction models in predicting suicide and suicide attempts and to simulate the effects of implementing suicide prediction models using population-level estimates of suicide rates. Evidence Review: A systematic literature search was conducted in MEDLINE, PsycINFO, Embase, and the Cochrane Library to identify research evaluating the predictive accuracy of suicide prediction models in identifying patients at high risk for a suicide attempt or death by suicide. Each database was searched from inception to August 21, 2018. The search strategy included search terms for suicidal behavior, risk prediction, and predictive modeling. Reference lists of included studies were also screened. Two reviewers independently screened and evaluated eligible studies. Findings: From a total of 7306 abstracts reviewed, 17 cohort studies met the inclusion criteria, representing 64 unique prediction models across 5 countries with more than 14 million participants. The research quality of the included studies was generally high. Global classification accuracy was good (≥0.80 in most models), while the predictive validity associated with a positive result for suicide mortality was extremely low (≤0.01 in most models). Simulations of the results suggest very low positive predictive values across a variety of population assessment characteristics. Conclusions and Relevance: To date, suicide prediction models produce accurate overall classification models, but their accuracy of predicting a future event is near 0. Several critical concerns remain unaddressed, precluding their readiness for clinical applications across health systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Even complex risk assessment models do not allow for precise prediction of suicidal behavior (26, 27)”
From Suicide risk assessment: clinical implications of the unpredictability of suicidal behavior (2026) · cites this paper as [27]
In the citing paper
“and, in particular, they do not allow for prediction of the time at which suicidal behavior will occur.”
From Suicide risk assessment: clinical implications of the unpredictability of suicidal behavior (2026) · cites this paper as [27]
In the citing paper
“In principle, it is important to acknowledge that events with a low base rate, such as suicide attempts and suicides, can never be precisely predicted-no matter which assessments and methods are used (Belsher et al., 2019;Bryan, 2021).”
From Suicide Crisis Syndrome: A systematic review (2024) · cites this paper as Belsher et al., 2019
In the citing paper
“most models had a PPV <1% for predicting suicide mortality”
From Accuracy requirements for cost-effective suicide risk prediction among primary care patients in the US (2021) · cites this paper as [10]
In the citing paper
“multiple research groups have developed suicide risk prediction models using electronic health record data.10,11,12,13”
From Accuracy requirements for cost-effective suicide risk prediction among primary care patients in the US (2021) · cites this paper as [10]
In the citing paper
“A recent systematic review10 identified 17 such predictive models that have been described in the literature.”
From Accuracy requirements for cost-effective suicide risk prediction among primary care patients in the US (2021) · cites this paper as [10]
In the citing paper
“A 2019 review of 64 longitudinal suicide prediction models36 found most models reported extremely low (ie, <.01) PPVs, such that 99 out of every 100 individuals predicted by these models to attempt suicide will not.”
From A pilot study using frequent inpatient assessments of suicidal thinking to predict short-term postdischarge suicidal behavior (2021) · cites this paper as [36]
In the citing paper
“The dynamic feature model predicted posthospital suicide attempts with good accuracy (AUC, 0.89), which is at the high end of the range of reported AUC values for longitudinal prediction models of suicidal behaviors.36”
From A pilot study using frequent inpatient assessments of suicidal thinking to predict short-term postdischarge suicidal behavior (2021) · cites this paper as [36]
In the citing paper
“In comparison, the average cross-validated PPV for our dynamic feature model was 0.39. This represents a substantial improvement beyond both previous work and our baseline and mean models”
From A pilot study using frequent inpatient assessments of suicidal thinking to predict short-term postdischarge suicidal behavior (2021) · cites this paper as [36]
In the citing paper
“Although machine learning methods have yielded high AUCs, the PPV of most models has been low.”
From A pilot study using frequent inpatient assessments of suicidal thinking to predict short-term postdischarge suicidal behavior (2021) · cites this paper as [36]
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research
Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., Huang, X., Musacchio, K. M., Jaroszewski, A. C., Chang, B. P., & Nock, M. K. (2017) · Psychological Bulletin · doi:10.1037/bul0000084 · Cited by 3,784
Wang, Y., Kung, L., & Byrd, T. A. (2018) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2015.12.019 · Cited by 1,571
Prediction of Suicide in Psychiatric Patients
Pokorny, A. D. (1983) · Archives of General Psychiatry · doi:10.1001/archpsyc.1983.01790030019002 · Cited by 749
Predicting Risk of Suicide Attempts Over Time Through Machine Learning
Walsh, C. G., Ribeiro, J. D., & Franklin, J. C. (2017) · Clinical Psychological Science · doi:10.1177/2167702617691560 · Cited by 571
Uses and abuses of screening tests
Grimes, D. A., & Schulz, K. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07948-5 · Cited by 545
Kessler, R. C., Warner, C. H., Ivany, C., Petukhova, M. V., Rose, S., Bromet, E. J., Brown, M., Cai, T., Colpe, L. J., Cox, K. L., et al. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1754 · Cited by 447
Simon, G. E., Johnson, E., Lawrence, J. M., Rossom, R. C., Ahmedani, B., Lynch, F. L., Beck, A., Waitzfelder, B., Ziebell, R., Penfold, R. B., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17101167 · Cited by 400
Flagged first, then by citations
3 of the 46 references couldn’t be matched to a known paper.
Research works printed but not linked: 5
- 2018, Supporting our veterans during their transition from uniformed service to civilian life., Federal Register, 83, 1513
- Pruitt, 2017, Department of Defense Suicide Event Report: Calendar Year 2016 Annual Report
- 2018, VA National Suicide Data Report: 2005-2015
- 2018, Joint Action Plan for Supporting Veterans During Their Transition From Uniformed Service to Civilian Life
- VA REACH VET initiative helps save veterans lives: program signals when more help is needed for at-risk veterans [press release]. Washington DC: US Department of Veterans Affairs; April 3, 2017.
Cited by
Sorted by citations
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
Time for united action on depression: a Lancet–World Psychiatric Association Commission
Herrman, H., Patel, V., Kieling, C., Berk, M., Buchweitz, C., Cuijpers, P., Furukawa, T. A., Kessler, R. C., Kohrt, B. A., Maj, M., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)02141-3 · Cited by 1,104
Turecki, G., Brent, D. A., Gunnell, D., O’Connor, R. C., Oquendo, M. A., Pirkis, J., & Stanley, B. H. (2019) · Nature Reviews Disease Primers · doi:10.1038/s41572-019-0121-0 · Cited by 1,074
Supervised Machine Learning: A Brief Primer
Jiang, T., Gradus, J. L., & Rosellini, A. J. (2020) · Behavior Therapy · doi:10.1016/j.beth.2020.05.002 · Cited by 953
Machine learning and natural language processing in mental health: systematic review
Le Glaz, A., Haralambous, Y., Kim-Dufor, D.-H., Lenca, P., Billot, R., Ryan, T. C., Marsh, J., DeVylder, J., Walter, M., Berrouiguet, S., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/15708 · Cited by 576
Hossain, E., Rana, R., Higgins, N., Soar, J., Barua, P. D., Pisani, A. R., & Turner, K. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106649 · Cited by 407
Candidate biomarkers in psychiatric disorders: state of the field
Abi‐Dargham, A., Moeller, S. J., Ali, F., DeLorenzo, C., Domschke, K., Horga, G., Jutla, A., Kotov, R., Paulus, M. P., Rubio, J. M., et al. (2023) · World Psychiatry · doi:10.1002/wps.21078 · Cited by 421
Artificial intelligence and the future of psychiatry: Insights from a global physician survey
Doraiswamy, P. M., Blease, C., & Bodner, K. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.101753 · Cited by 253
Nebeker, C., Torous, J., & Bartlett Ellis, R. J. (2019) · BMC Medicine · doi:10.1186/s12916-019-1377-7 · Cited by 241
Kessler, R. C., Bossarte, R. M., Luedtke, A., Zaslavsky, A. M., & Zubizarreta, J. R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0531-0 · Cited by 234
Su, C., Aseltine, R. H., Doshi, R., Chen, K., Rogers, S. C., & Wang, F. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-01100-0 · Cited by 163
Nock, M. K., Millner, A. J., Ross, E. L., Kennedy, C. J., Al-Suwaidi, M., Barak-Corren, Y., Castro, V. M., Castro-Ramirez, F., Lauricella, T., Murman, N., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.44373 · Cited by 157
The Changing Characteristics of African-American Adolescent Suicides, 2001–2017
Price, J. H., & Khubchandani, J. (2019) · Journal of Community Health · doi:10.1007/s10900-019-00678-x · Cited by 141
Identification of Suicide Attempt Risk Factors in a National US Survey Using Machine Learning
de la Garza, Á. G., Blanco, C., Olfson, M., & Wall, M. M. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.4165 · Cited by 146
Genome-Wide Association Study of Suicide Death and Polygenic Prediction of Clinical Antecedents
Docherty, A. R., Shabalin, A. A., DiBlasi, E., Monson, E., Mullins, N., Adkins, D. E., Bacanu, S.-A., Bakian, A. V., Crowell, S., Chen, D., et al. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.19101025 · Cited by 124
Gee, B. L., Han, J., Benassi, H. P., & Batterham, P. J. (2020) · Digital Health · doi:10.1177/2055207620963958 · Cited by 137
Walsh, C. G., Chaudhry, B., Dua, P., Goodman, K. W., Kaplan, B., Kavuluru, R., Solomonides, A., & Subbian, V. (2020) · JAMIA Open · doi:10.1093/jamiaopen/ooz054 · Cited by 118
Leaune, E., Samuel, M., Oh, H., Poulet, E., & Brunelin, J. (2020) · Preventive Medicine · doi:10.1016/j.ypmed.2020.106264 · Cited by 116
Physician Suicide: A Call to Action.
Kalmoe, M. C., Chapman, M. B., Gold, J. A., & Giedinghagen, A. M. (2019) · PubMed Central · Cited by 110
Singh, B., Swartz, H. A., Barboza, A. B. C., Schaffer, A., Kato, T., Dols, A., Sperry, S. H., Vassilev, A. B., Burdick, K. E., & Frye, M. A. (2025) · The Lancet · doi:10.1016/s0140-6736(25)01140-7 · Cited by 106
Tsui, F. R., Shi, L., Ruiz, V., Ryan, N. D., Biernesser, C. L., Iyengar, S., Walsh, C. G., & Brent, D. A. (2021) · JAMIA Open · doi:10.1093/jamiaopen/ooab011 · Cited by 105
Bjureberg, J., Dahlin, M., Carlborg, A., Edberg, H., Haglund, A., & Runeson, B. (2021) · Psychological Medicine · doi:10.1017/s0033291721000751 · Cited by 111
Barak‐Corren, Y., Castro, V. M., Nock, M. K., Mandl, K. D., Madsen, E. M., Seiger, A. N., Adams, W. G., Applegate, R. J., Bernstam, E. V., Klann, J. G., et al. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.1262 · Cited by 102
King, C. A., Grupp‐Phelan, J., Brent, D., Dean, J. M., Webb, M., Bridge, J. A., Spirito, A., Chernick, L. S., Mahabee‐Gittens, E. M., Mistry, R. D., et al. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13087 · Cited by 101
Wang, S. B., Coppersmith, D. D. L., Kleiman, E. M., Bentley, K. H., Millner, A. J., Fortgang, R., Mair, P., Dempsey, W., Huffman, J. C., & Nock, M. K. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.0591 · Cited by 98
Passos, I. C., Ballester, P. L., Barros, R. C., Librenza‐Garcia, D., Mwangi, B., Birmaher, B. B., Brietzke, E. M., Hájek, T., López‐Jaramillo, C., Mansur, R. B., et al. (2019) · Bipolar Disorders · doi:10.1111/bdi.12828 · Cited by 103
Translating promise into practice: a review of machine learning in suicide research and prevention
Kirtley, O. J., van Mens, K., Hoogendoorn, M., Kapur, N., & de Beurs, D. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00254-6 · Cited by 100
Kusuma, K., Larsen, M. E., Quiroz, J. C., Gillies, M. B., Burnett, A., Qian, J., & Torok, M. H. (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.09.050 · Cited by 94
Levis, M., Leonard Westgate, C., Gui, J., Watts, B. V., & Shiner, B. (2021) · Psychological Medicine · doi:10.1017/s0033291720000173 · Cited by 87
How accurate are suicide risk prediction models? asking the right questions for clinical practice.
Whiting, D., & Fazel, S. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300102 · Cited by 83
Genetic contributions to suicidal thoughts and behaviors
DiBlasi, E., Kang, J., & Docherty, A. R. (2021) · Psychological Medicine · doi:10.1017/s0033291721001720 · Cited by 83
Chen, Q., Zhang‐James, Y., Barnett, E. J., Lichtenstein, P., Jokinen, J., D'Onofrio, B. M., Faraone, S. V., Larsson, H., & Fazel, S. (2020) · PLoS Medicine · doi:10.1371/journal.pmed.1003416 · Cited by 86
Schafer, K. M., Duffy, M. E., Kennedy, G. A., Stentz, L. A., Leon, J., Herrerias, G., Fulcher, S., & Joiner, T. E. (2021) · Military Psychology · doi:10.1080/08995605.2021.1976544 · Cited by 83
National Trends of Mental Health Care Among US Adults Who Attempted Suicide in the Past 12 Months
Bommersbach, T. J., Rosenheck, R. A., & Rhee, T. G. (2022) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.3958 · Cited by 80
Prospective Validation of an Electronic Health Record–Based, Real-Time Suicide Risk Model
Walsh, C. G., Johnson, K. B., Ripperger, M., Sperry, S., Harris, J., Clark, N., Fielstein, E., Novak, L., Robinson, K., & Stead, W. W. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.1428 · Cited by 78
A direct comparison of theory-driven and machine learning prediction of suicide: A meta-analysis
Schafer, K. M., Kennedy, G. A., Gallyer, A. J., & Resnik, P. (2021) · PLoS ONE · doi:10.1371/journal.pone.0249833 · Cited by 84
Conceptualising fairness: three pillars for medical algorithms and health equity
Sikstrom, L., Maslej, M. M., Hui, K., Findlay, Z., Buchman, D. Z., & Hill, S. L. (2022) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100459 · Cited by 76
Cusick, M. M., Adekkanattu, P. M., Campion, T. R., Sholle, E., Myers, A., Banerjee, S., Alexopoulos, G. S., Wang, Y., & Pathak, J. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.01.052 · Cited by 80
Machine learning-based prediction for self-harm and suicide attempts in adolescents
Su, R., John, J. R., & Lin, P. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115446 · Cited by 72
Psychiatry in the Digital Age: A Blessing or a Curse?
Roth, C. B., Papassotiropoulos, A., Brühl, A. B., Lang, U. E., & Huber, C. G. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18168302 · Cited by 76
Ehtemam, H., Esfahlani, S. S., Sanaei, A., Ghaemi, M. M., Hajesmaeel‐Gohari, S., Rahimisadegh, R., Bahaadinbeigy, K., Ghasemian, F., & Shirvani, H. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02524-0 · Cited by 69
Kleiman, E. M., Glenn, C. R., & Liu, R. T. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2019.1666400 · Cited by 68
Miché, M., Studerus, E., Meyer, A. H., Gloster, A. T., Beesdo‐Baum, K., Wïttchen, H., & Lieb, R. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.093 · Cited by 69
Acoustic and language analysis of speech for suicidal ideation among US veterans
Belouali, A., Gupta, S., Sourirajan, V., Yu, J., Allen, N. J., Alaoui, A., Dutton, M. A., & Reinhard, M. J. (2021) · BioData Mining · doi:10.1186/s13040-021-00245-y · Cited by 70
Ross, E. L., Zuromski, K. L., Reis, B. Y., Nock, M. K., Kessler, R. C., & Smoller, J. W. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.0089 · Cited by 65
Annual Research Review: Translational machine learning for child and adolescent psychiatry
Dwyer, D., & Koutsouleris, N. (2022) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13545 · Cited by 71
Can machine-learning methods really help predict suicide?
McHugh, C. M., & Large, M. M. B. (2020) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000609 · Cited by 67
The use of advanced technology and statistical methods to predict and prevent suicide
Kleiman, E. M., Glenn, C. R., & Liu, R. T. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00175-y · Cited by 65
Chiauzzi, E. J., Clayton, A. R., & Huh, J. (2020) · JMIR Mental Health · doi:10.2196/24021 · Cited by 62
Meta-analysis of the strength of exploratory suicide prediction models; from clinicians to computers
Corke, M., Mullin, K., Angel-Scott, H. N., Xia, S., & Large, M. M. B. (2021) · BJPsych Open · doi:10.1192/bjo.2020.162 · Cited by 61
Expectations for Artificial Intelligence (AI) in Psychiatry
Monteith, S., Glenn, T., Geddes, J. R., Whybrow, P. C., Achtyes, E. D., & Bauer, M. (2022) · Current Psychiatry Reports · doi:10.1007/s11920-022-01378-5 · Cited by 61
Evidence of Inflated Prediction Performance: A Commentary on Machine Learning and Suicide Research
Jacobucci, R., Littlefield, A. K., Millner, A. J., Kleiman, E. M., & Steinley, D. (2021) · Clinical Psychological Science · doi:10.1177/2167702620954216 · Cited by 61
Martínez‐Alés, G., Hernández‐Calle, D., Khauli, N., & Keyes, K. M. (2020) · Current topics in behavioral neurosciences · doi:10.1007/7854_2020_158 · Cited by 59
Suicide in the pediatric population: screening, risk assessment and treatment
Cwik, M. F., O’Keefe, V. M., & Haroz, E. E. (2020) · International Review of Psychiatry · doi:10.1080/09540261.2019.1693351 · Cited by 54
Integrating a functional view on suicide risk into idiographic statistical models
Kaurin, A., Dombrovski, A. Y., Hallquist, M. N., & Wright, A. G. C. (2021) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.104012 · Cited by 55
van Eeden, W. A., Luo, C. W., van Hemert, A. M., Carlier, I. V. E., Penninx, B. W. J. H., Wardenaar, K. J., Hoos, H. H., & Giltay, E. J. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.113823 · Cited by 59
Interpersonal theory of suicide: prospective examination
Forkmann, T., Glaesmer, H., Paashaus, L., Rath, D., Schönfelder, A., Stengler, K., Juckel, G., Assion, H., & Teismann, T. (2020) · BJPsych Open · doi:10.1192/bjo.2020.93 · Cited by 52
Wilimitis, D., Turer, R. W., Ripperger, M. A., McCoy, A. B., Sperry, S. H., Fielstein, E. M., Kurz, T. L., & Walsh, C. G. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.12095 · Cited by 51
Baldaçara, L., Rocha, G. A., Leite, V. D. S., Porto, D. M., Grüdtner, R. R., Díaz, A. P., Meleiro, A. M. A. D. S., Corrêa, H., Tung, T. C., Quevedo, J., et al. (2020) · Brazilian Journal of Psychiatry · doi:10.1590/1516-4446-2020-0994 · Cited by 55
Eskin, M., Baydar, N., Harlak, H., Hamdan, M., Mechri, A., Isayeva, U., Abdel‐Khalek, A. M., Rezaeian, M., Asad, N., El-Nayal, M., et al. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.07.050 · Cited by 49
Haroz, E. E., Kitchen, C., Nestadt, P. S., Wilcox, H. C., DeVylder, J., & Kharrazi, H. H. K. (2021) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12800 · Cited by 48
Vidal-Ribas, P., Janiri, D., Doucet, G. E., Pornpattananangkul, N., Nielson, D. M., Frangou, S., & Stringaris, A. (2021) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20020120 · Cited by 45
Reconciling Statistical and Clinicians’ Predictions of Suicide Risk
Simon, G. E., Matarazzo, B. B., Walsh, C. G., Smoller, J. W., Boudreaux, E. D., Yarborough, B. J. H., Shortreed, S. M., Coley, R. Y., Ahmedani, B. K., Doshi, R., et al. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202000214 · Cited by 44
Agne, N. A., Tisott, C. G., Ballester, P. L., Passos, I. C., & Ferrão, Y. A. (2020) · Psychological Medicine · doi:10.1017/s0033291720002329 · Cited by 46
van Vuuren, C. L., van Mens, K., Beurs, D. P. D., Lokkerbol, J., van der Wal, M. F., Cuijpers, P. J., & Chinapaw, M. J. M. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.09.018 · Cited by 44
Analysis and evaluation of explainable artificial intelligence on suicide risk assessment
Hao Tang, A., Rekavandi, A. M., Rooprai, D., Dwivedi, G., Sanfilippo, F. M., Boussaïd, F., & Bennamoun, M. (2024) · Scientific Reports · doi:10.1038/s41598-024-53426-0 · Cited by 42
Konttinen, H. M., Sjöholm, K., Jacobson, P., Svensson, P., Carlsson, L. M. S., & Peltonen, M. (2019) · Annals of Surgery · doi:10.1097/sla.0000000000003742 · Cited by 42
Iorfino, F., Ho, N., Carpenter, J. S., Cross, S. P. M., Davenport, T. A., Hermens, D. F., Yee, H. F., Nichles, A., Zmicerevska, N., Guastella, A. J., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0243467 · Cited by 44
Clinical epidemiological research on suicide-related behaviors—where we are and where we need to go
Kessler, R. C. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.1238 · Cited by 41
Firearm Suicides in the Elderly: A Narrative Review and Call for Action
Price, J. H., & Khubchandani, J. (2021) · Journal of Community Health · doi:10.1007/s10900-021-00964-7 · Cited by 41
Morgiève, M., Genty, C., Azé, J., Dubois, J., Leboyer, M., Vaïva, G., Berrouiguet, S., & Courtet, P. (2020) · JMIR mhealth and uhealth · doi:10.2196/15741 · Cited by 45
Clary, K. L., Pena, S., & Smith, D. C. (2021) · Current Psychology · doi:10.1007/s12144-021-01768-7 · Cited by 39
Spittal, M. J., Guo, X. A., Kang, L., Kirtley, O. J., Clapperton, A., Hawton, K. E., Kapur, N., Pirkis, J., & Carter, G. L. (2025) · PLoS Medicine · doi:10.1371/journal.pmed.1004581 · Cited by 41
Machine learning for suicidology: A practical review of exploratory and hypothesis-driven approaches
Cox, C. R., Moscardini, E. H., Cohen, A. S., & Tucker, R. P. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101940 · Cited by 45
Torous, J. B., & Walker, R. L. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.1231 · Cited by 38
A comparative study of machine learning techniques for suicide attempts predictive model
Nordin, N., Zainol, Z. B., Noor, M. H. M., & Fong, C. L. (2021) · Health Informatics Journal · doi:10.1177/1460458221989395 · Cited by 38
Martínez‐Alés, G., & Keyes, K. M. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-1080-6 · Cited by 38
Gardner, W. P., PAJER, K. A., Cloutier, P., Currie, L. M., Colman, I., Zemek, R. L., Hatcher, S., Lima, I. S. F., & Cappelli, M. (2019) · Canadian Medical Association Journal · doi:10.1503/cmaj.190188 · Cited by 38
Torous, J. B., Choudhury, T., Barnett, I., Keshavan, M. S., & Kane, J. M. (2020) · World Psychiatry · doi:10.1002/wps.20805 · Cited by 35
Steine, I. M., Nielsen, B., Porter, P. A., Krystal, J. H., Winje, D., Grønli, J., Milde, A. M., Bjorvatn, B., Nordhus, I. H., & Pallesen, S. (2020) · European Journal of Psychotraumatology · doi:10.1080/20008198.2020.1815282 · Cited by 35
Development of a Suicide Prediction Model for the Elderly Using Health Screening Data
Cho, S., Geem, Z. W., & Na, K. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph181910150 · Cited by 37
A review and meta-analysis of gene expression profiles in suicide
Piras, I. S., Huentelman, M. J., Pinna, F., Paribello, P., Solmi, M., Murru, A., Carpiniello, B., Manchia, M., & Zai, C. C. H. (2021) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2021.12.003 · Cited by 38
Joo, Y. Y., Moon, S., Wang, H., Kim, H., Lee, E., Kim, J. H., Posner, J. E., Ahn, W., Choi, I., Kim, J.-W., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.48585 · Cited by 36
The Veterans Health Administration REACH VET Program: Suicide Predictive Modeling in Practice
Matarazzo, B. B., Eagan, A. E., Landes, S. J., Mina, L. K., Clark, K., Gerard, G. R., McCarthy, J. F., Trafton, J. A., Bahraini, N. H., Brenner, L. A., et al. (2022) · Psychiatric Services · doi:10.1176/appi.ps.202100629 · Cited by 34
Averill, L. A., Averill, C. L., Gueorguieva, R., Fouda, S., Sherif, M., Ahn, K.-H., Ranganathan, M., D'Souza, D. C., Southwick, S. M., Sanacora, G., et al. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.01.104 · Cited by 33
Gifuni, A. J., Chakravarty, M. M., Lepage, M., Ho, T. C., Geoffroy, M.-C., Lacourse, E., Gotlib, I. H., Turecki, G., Renaud, J., & Jollant, F. (2021) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.200198 · Cited by 33
Bentley, K. H., Zuromski, K. L., Fortgang, R. G., Madsen, E., Kessler, D. T., Lee, H., Nock, M. K., Reis, B. Y., Castro, V. M., & Smoller, J. W. (2022) · JMIR Formative Research · doi:10.2196/30946 · Cited by 33
What is bipolar disorder? A disease model of dysregulated energy expenditure
Mansur, R. B., Lee, Y. L., McIntyre, R. S., & Brietzke, E. M. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.04.006 · Cited by 33
Parghi, N., Chennapragada, L., Barzilay, S., Newkirk, S., Ahmedani, B. K., Lok, B. C. L., & GALYNKER, I. I. (2020) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1863 · Cited by 32
Machado, C. D. S., Ballester, P. L., Cao, B., Mwangi, B., Caldieraro, M. A., Kapczinski, F. P., & Passos, I. C. (2021) · Psychological Medicine · doi:10.1017/s0033291720004997 · Cited by 32
van Velzen, L. S., Toenders, Y. J., Àvila-Parcet, A., Dinga, R., Rabinowitz, J. A., Campos, A. I., Jahanshad, N., Rentería, M. E., & Schmaal, L. (2022) · The British Journal of Psychiatry · doi:10.1192/bjp.2022.7 · Cited by 34
A Review of Suicide Risk Assessment Tools and Their Measured Psychometric Properties in Korea
Baek, I., Jo, S., Kim, E. J., Lee, G. R., Lee, D. H., & Jeon, H. J. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.679779 · Cited by 31
Suicide Crisis Syndrome: A systematic review
Melzer, L., Forkmann, T., & Teismann, T. (2024) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.13065 · Cited by 30
Ćosić, K., Popović, S., & Wiederhold, B. K. (2024) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2023.0737 · Cited by 32
Liu, L., Li, Z., Hu, Y., Li, C., He, S., Zhang, S., Gao, J., Zhu, H., & Huang, G. (2025) · Journal of Medical Internet Research · doi:10.2196/73052 · Cited by 33
Levis, M., Levy, J., Dufort, V., Gobbel, G. T., Watts, B. V., & Shiner, B. R. (2022) · Psychiatry Research · doi:10.1016/j.psychres.2022.114703 · Cited by 30
Wu, C., Lee, M., Liao, S., Chan, C., Liu, L.-Y. D., & Chen, C.-Y. (2020) · Journal of the Formosan Medical Association · doi:10.1016/j.jfma.2020.04.033 · Cited by 29
Gioia, A. N., Forrest, L. N., & Smith, A. R. (2022) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12915 · Cited by 33
Machine learning to advance the prediction, prevention and treatment of eating disorders
Wang, S. B. (2021) · European Eating Disorders Review · doi:10.1002/erv.2850 · Cited by 35
Bryan, C. J., Rozek, D. C., & Khazem, L. R. (2019) · Crisis · doi:10.1027/0227-5910/a000639 · Cited by 28
Metadata
- Authors
- Belsher, B. E., Smolenski, D. J., Pruitt, L. D., Bush, N. E., Beech, E. H., Workman, D. E., Morgan, R. L., Evatt, D. P., Tucker, J., & Skopp, N. A.
- Affiliations
- Uniformed Services University of the Health Sciences (US)
- Defense Health Agency (US)
- McMaster University (CA)
- ORCID
- Venue
- JAMA Psychiatry
- Publisher
- American Medical Association (AMA)
- Published
- 2019-06-01
- Volume
- 76
- Issue
- 6
- Pages
- 642
- ISSN
- 2168-622X (ISSN-L)
- OpenAlex
- W2921616123
- Cited by
- 540
- References
- 46
- Citations by year
- 2026: 81 · 2025: 73 · 2024: 63 · 2023: 63 · 2022: 82 · 2021: 83 · 2020: 64 · 2019: 31
- FWCI
- 10.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- JAMA Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- suicide attempts, suicide mortality, diagnostic accuracy, predictive validity, positive predictive value, risk prediction, clinical implementation, health care system
- MeSH terms
- Algorithms, Humans, Models, Theoretical, Suicide, Suicide, Attempted, Suicidal Ideation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
