Artificial Intelligence and Suicide Prevention: A Systematic Review of Machine Learning Investigations
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Suicide is a leading cause of death that defies prediction and challenges prevention efforts worldwide. Artificial intelligence (AI) and machine learning (ML) have emerged as a means of investigating large datasets to enhance risk detection. A systematic review of ML investigations evaluating suicidal behaviors was conducted using PubMed/MEDLINE, PsychInfo, Web-of-Science, and EMBASE, employing search strings and MeSH terms relevant to suicide and AI. Databases were supplemented by hand-search techniques and Google Scholar. Inclusion criteria: (1) journal article, available in English, (2) original investigation, (3) employment of AI/ML, (4) evaluation of a suicide risk outcome. N = 594 records were identified based on abstract search, and 25 hand-searched reports. N = 461 reports remained after duplicates were removed, n = 316 were excluded after abstract screening. Of n = 149 full-text articles assessed for eligibility, n = 87 were included for quantitative synthesis, grouped according to suicide behavior outcome. Reports varied widely in methodology and outcomes. Results suggest high levels of risk classification accuracy (>90%) and Area Under the Curve (AUC) in the prediction of suicidal behaviors. We report key findings and central limitations in the use of AI/ML frameworks to guide additional research, which hold the potential to impact suicide on broad scale.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Just, M. A., Pan, L., Cherkassky, V. L., McMakin, D. L., Cha, C., Nock, M. K., & Brent, D. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0234-y · Cited by 210
RetractedRisk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research
Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., Huang, X., Musacchio, K. M., Jaroszewski, A. C., Chang, B. P., & Nock, M. K. (2017) · Psychological Bulletin · doi:10.1037/bul0000084 · Cited by 3,784
Suicide Prevention Strategies: A Systematic Review
Mann, J. J., Apter, A., Bertolote, J., Beautrais, A., Currier, D., Haas, A., Hegerl, U., Lonnqvist, J., Malone, K., Marusic, A., et al. (2005) · JAMA · doi:10.1001/jama.294.16.2064 · Cited by 2,852
Delgado-Rodríguez, M., & Llorca, J. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.008466 · Cited by 1,064
Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw042 · Cited by 936
Suicide Rates After Discharge From Psychiatric Facilities: A Systematic Review and Meta-analysis
Chung, D. T., Ryan, C. J., Hadzi-Pavlovic, D., Singh, S. P., Stanton, C., & Large, M. M. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.1044 · Cited by 651
A targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598 · cited 1×
“Risk models learned, using such data, have been developed to predict preterm infant morbidity [20], early warning signs of sepsis [21], and risk for rare outcomes (e.g., first-onset cancers, congestive heart failure, and schizophrenia) with a high degree (i.e., > 90”
BackgroundUsing electronic health records for population health research: a review of methods and applications
Casey, J. A., Schwartz, B. S., Stewart, W. F., & Adler, N. E. (2016) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032315-021353 · Cited by 590
Hersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R. O., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., Cimino, J. J., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1dbd · Cited by 567 · cited 1×
“Hersh et al. [139] raised concerns regarding biases due to EMR data being collected only at hospital visits, incomplete records or missing data, and other considerations relevant to accurate coding that emphasize advanced statistical methods be used for correction.”
Methodvan Heeringen, K., & Mann, J. J. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70220-2 · Cited by 550 · cited 1×
“Moreover, known risk factors currently show relatively poor sensitivity and clinical utility in predicting suicide occurrence [10,11].”
BackgroundNatural language processing of social media as screening for suicide risk
Coppersmith, G., Leary, R., Crutchley, P., & Fine, A. (2018) · Biomedical Informatics Insights · doi:10.1177/1178222618792860 · Cited by 506
Kessler, R. C., Warner, C. H., Ivany, C., Petukhova, M. V., Rose, S., Bromet, E. J., Brown, M., Cai, T., Colpe, L. J., Cox, K. L., et al. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1754 · Cited by 447
Suicide Prevention in an Emergency Department Population: The ED-SAFE Study
Miller, I. W., Camargo, C. A., Arias, S. A., Sullivan, A. F., Allen, M. H., Goldstein, A. B., Manton, A. P., Espinola, J. A., Jones, R., Hasegawa, K., et al. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0678 · Cited by 418
Single-item measurement of suicidal behaviors: Validity and consequences of misclassification
Millner, A. J., Lee, M. D., & Nock, M. K. (2015) · PLOS ONE · doi:10.1371/journal.pone.0141606 · Cited by 361
Ivey-Stephenson, A. Z., Crosby, A. E., Jack, S. P. D., Haileyesus, T., & Kresnow-Sedacca, M.-J. (2017) · MMWR. Surveillance Summaries · doi:10.15585/mmwr.ss6618a1 · Cited by 319 · cited 1×
“This includes di ff erences in suicide risk according to age, gender, and ethnicity, which may furthermore vary according to region, suicide method, and access to health care [13,14].”
BackgroundMiller, M., Azrael, D., & Barber, C. (2012) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031811-124636 · Cited by 265 · cited 1×
“This includes di ff erences in suicide risk according to age, gender, and ethnicity, which may furthermore vary according to region, suicide method, and access to health care [13,14].”
BackgroundKessler, R. C., Hwang, I., Hoffmire, C. A., McCarthy, J. F., Petukhova, M. V., Rosellini, A. J., Sampson, N. A., Schneider, A. L., Bradley, P. A., Katz, I. R., et al. (2017) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1575 · Cited by 209 · cited 1×
“A smaller number of reports examined high-risk, pediatric or geriatric samples, as well as military veterans [15,26,33,34,53,72,97,112].”
BackgroundHom, M. A., Joiner, T. E., & Bernert, R. A. (2016) · Psychological Assessment · doi:10.1037/pas0000241 · Cited by 203 · cited 1×
“Such surveys, however, frequently used a single item assessment of suicidal behaviors, which may misclassify risk [132,133].”
BackgroundSelf-citationTran, T., Nguyen, T. D., Phung, D., & Venkatesh, S. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.01.012 · Cited by 172
Kessler, R. C., Stein, M. B., Petukhova, M. V., Bliese, P., Bossarte, R. M., Bromet, E. J., Fullerton, C. S., Gilman, S. E., Ivany, C., Lewandowski-Romps, L., et al. (2017) · Molecular Psychiatry · doi:10.1038/mp.2016.110 · Cited by 163 · cited 5×
“A smaller number of reports examined high-risk, pediatric or geriatric samples, as well as military veterans [15,26,33,34,53,72,97,112].”
BackgroundInfluentialTran, T., Luo, W., Phung, D., Harvey, R., Berk, M., Kennedy, R. L., & Venkatesh, S. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-76 · Cited by 150
Predicting emergency department inpatient admissions to improve same-day patient flow
Peck, J. S., Benneyan, J. C., Nightingale, D. J., & Gaehde, S. A. (2012) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2012.01435.x · Cited by 138
Ruderfer, D. M., Walsh, C. G., Aguirre, M. W., Tanigawa, Y., Ribeiro, J. D., Franklin, J. C., & Rivas, M. A. (2020) · Molecular Psychiatry · doi:10.1038/s41380-018-0326-8 · Cited by 134 · cited 1×
“Baca-Garcia and colleagues [56] showed that an algorithm based on three CNS (Central Nervous System) single nucleotide polymorphisms (SNPs) correctly classified those with and without a suicide attempt history, whereas other investigations evaluated candidate biomarkers to predict future risk for suicide [64,69,103].”
BackgroundCarter, G. L., Clover, K., Whyte, I. M., Dawson, A. H., & D'Este, C. (2013) · British Journal of Psychiatry · doi:10.1192/bjp.bp.112.112664 · Cited by 115
Fuzzy logic detection of medically serious suicide attempt records in major psychiatric disorders
Modai, I., Kuperman, J., Goldberg, I., Goldish, M., & Mendel, S. (2004) · The Journal of Nervous and Mental Disease · doi:10.1097/01.nmd.0000142020.20038.dd · Cited by 15
Cited by
AI Chatbots in Digital Mental Health
Balcombe, L. (2023) · Informatics · doi:10.3390/informatics10040082 · Cited by 174
Beyond human expertise: the promise and limitations of ChatGPT in suicide risk assessment
Elyoseph, Z., & Levkovich, I. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1213141 · Cited by 116
Sharma, G., Yaffe, M. J., Ghadiri, P., Gandhi, R., Pinkham, L., Gore, G., & Abbasgholizadeh-Rahimi, S. (2025) · JMIR Mental Health · doi:10.2196/70438 · Cited by 38
Metadata
- Authors
- Bernert, R. A., Hilberg, A. M., Melia, R., Kim, J. P., Shah, N. H., & Abnousi, F.
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2020-08-15
- Volume
- 17
- Issue
- 16
- Pages
- 5929
- ISSN
- 1660-4601 (ISSN-L)
- OpenAlex
- W3049024012
- Cited by
- 222
- References
- 25
- FWCI
- 2.40
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.