Classification of Suicide Attempts through a Machine Learning Algorithm Based on Multiple Systemic Psychiatric Scales
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Classification and prediction of suicide attempts in high-risk groups is important for preventing suicide. The purpose of this study was to investigate whether the information from multiple clinical scales has classification power for identifying actual suicide attempts. Patients with depression and anxiety disorders (N = 573) were included, and each participant completed 31 self-report psychiatric scales and questionnaires about their history of suicide attempts. We then trained an artificial neural network classifier with 41 variables (31 psychiatric scales and 10 sociodemographic elements) and ranked the contribution of each variable for classification of suicide attempts. To evaluate the clinical applicability of our model, we measured classification performance with top-ranked predictors. Our model had an overall accuracy of 93.7% in 1-month, 90.8% in 1-year, and 87.4% in lifetime suicide attempts detection. The area under the receiver operating characteristic curve (AUROC) was the highest for 1-month suicide attempts detection (0.93), followed by lifetime (0.89), and 1-year detection (0.87). Among all variables, the Emotion Regulation Questionnaire had the highest contribution, and the positive and negative characteristics of the scales similarly contributed to classification performance. Performance on suicide attempts classification was largely maintained when we only used the top five ranked variables for training (AUROC; 1-month, 0.75, 1-year, 0.85, lifetime suicide attempts detection, 0.87). Our findings indicate that information from self-report clinical scales can be useful for classification of suicide attempts. Based on the reliable performance of the top five predictors alone, this machine learning approach could help clinicians identify high-risk patients in clinical settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gross, J. J., & John, O. P. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.348 · Cited by 11,929 · cited 4×
“Rather than the direct assessment of suicide ideation, indirect measures such as the ERQ, ARS, and SWLS were better predictors of actual suicide attempts.”
BackgroundInfluentialPosner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., Currier, G. W., Melvin, G. A., Greenhill, L., Shen, S., et al. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10111704 · Cited by 5,157 · cited 1×
“Clinical scales that directly assess suicidal ideation and behavior are widely used (3, 4), but they generally have a low specificity for suicide attempts as they tend to incorrectly classify low-risk suicide attempters as high-risk attempters (5).”
BackgroundAssessment of suicidal intention: The Scale for Suicide Ideation.
Beck, A. T., Kovacs, M., & Weissman, A. (1979) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.47.2.343 · Cited by 3,419
Dysfunction in the neural circuitry of emotion regulation–a possible prelude to violence
Davidson, R. J., Putnam, K. M., & Larson, C. L. (2000) · Science · doi:10.1126/science.289.5479.591 · Cited by 1,894
Dalgleish, T. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1432 · Cited by 1,849
Toward a clinical model of suicidal behavior in psychiatric patients
Mann, J. J., Waternaux, C., Haas, G. L., & Malone, K. M. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.2.181 · Cited by 1,791 · cited 1×
“History of previous suicide attempts has long been considered to be a crucial factor in predicting future suicide attempts (1), but attempts history lacks predictive value as only one-third of suicide attempters have a previous history of suicide attempts (2).”
Background(1985) · American Journal of Psychiatry · doi:10.1176/ajp.142.5.559 · Cited by 1,723
Risk factors for suicide in psychiatric outpatients: A 20-year prospective study.
Brown, G. K., Beck, A. T., Steer, R. A., & Grisham, J. R. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.3.371 · Cited by 1,317
Sareen, J., Cox, B. J., Afifi, T. O., de Graaf, R., Asmundson, G. J. G., ten Have, M., & Stein, M. B. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.11.1249 · Cited by 824
Oquendo, M. A., Galfalvy, H., Russo, S., Ellis, S. P., Grunebaum, M. F., Burke, A., & Mann, J. J. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.8.1433 · Cited by 605
Dumais, A., Lesage, A. D., Alda, M., Rouleau, G., Dumont, M., Chawky, N., Roy, M., Mann, J. J., Benkelfat, C., & Turecki, G. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.11.2116 · Cited by 583 · cited 1×
“Information on the participants’ diagnoses or substance use were also not used in training, though the lifetime risk for suicide has been shown to significantly vary between psychiatric illnesses (12, 23), and alcohol abuse was shown to be an independent predictor of suicide (9).”
BackgroundKessler, R. C., Warner, C. H., Ivany, C., Petukhova, M. V., Rose, S., Bromet, E. J., Brown, M., Cai, T., Colpe, L. J., Cox, K. L., et al. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1754 · Cited by 447 · cited 4×
“Participant-reported subjective symptoms and psychological states were the main variables in our analysis, and the total number of variables was much less than in previous studies; previously, one study used 73–122 predictors (8), and another used over 100 (9).”
BackgroundMethodInfluentialSociodemographic, psychiatric and somatic risk factors for suicide: a Swedish national cohort study
Crump, C., Sundquist, K., Sundquist, J., & Winkleby, M. A. (2014) · Psychological Medicine · doi:10.1017/s0033291713000810 · Cited by 384
Predicting suicidal behavior from longitudinal electronic health records.
Barak-Corren, Y., Castro, V. M., Javitt, S., Hoffnagle, A. G., Dai, Y., Perlis, R. H., Nock, M. K., Smoller, J. W., & Reis, B. Y. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16010077 · Cited by 339 · cited 4×
“Central problems seem to be self-reporting bias of suicide attempts and a low accuracy rate of each variable that has been used to predict suicide attempts (8).”
BackgroundMethodInfluentialPurpose in Life, Satisfaction with Life, and Suicide Ideation in a Clinical Sample
Heisel, M. J., & Flett, G. L. (2004) · Journal of Psychopathology and Behavioral Assessment · doi:10.1023/b:joba.0000013660.22413.e0 · Cited by 324 · cited 1×
“As the absence of positive emotions and satisfaction can contribute to suicidality (13), consideration of the degree of patients’ positivity may be needed in estimating suicide attempts.”
BackgroundMin, J.-A., Yu, J. J., Lee, C.-U., & Chae, J.-H. (2013) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2013.05.008 · Cited by 253
Self-citationLarge, M., Smith, G., Sharma, S., Nielssen, O., & Singh, S. P. (2011) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2010.01672.x · Cited by 223
Cited by
Machine learning and natural language processing in mental health: systematic review
Le Glaz, A., Haralambous, Y., Kim-Dufor, D.-H., Lenca, P., Billot, R., Ryan, T. C., Marsh, J., DeVylder, J., Walter, M., Berrouiguet, S., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/15708 · Cited by 576
Which PHQ-9 Items Can Effectively Screen for Suicide? Machine Learning Approaches
Kim, S., Lee, H.-K., & Lee, K. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18073339 · Cited by 99
The Role of Big Data Analytics in Predicting Suicide
Kessler, R. C., Bernecker, S. L., Bossarte, R. M., Luedtke, A. R., McCarthy, J. F., Nock, M. K., Pigeon, W. R., Petukhova, M. V., Sadikova, E., VanderWeele, T. J., et al. (2019) · Personalized Psychiatry · doi:10.1007/978-3-030-03553-2_5 · Cited by 44
Metadata
- Authors
- Oh, J., Yun, K., Hwang, J.-H., & Chae, J.-H.
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2017-09-29
- Volume
- 8
- Pages
- 192-192
- ISSN
- 1664-0640 (ISSN-L)
- OpenAlex
- W2759260070
- Cited by
- 65
- References
- 17
- FWCI
- 7.27
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.