Assessing the predictive ability of the Suicide Crisis Inventory for near‐term suicidal behavior using machine learning approaches
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Objective: This study explores the prediction of near‐term suicidal behavior using machine learning (ML) analyses of the Suicide Crisis Inventory (SCI), which measures the Suicide Crisis Syndrome, a presuicidal mental state. Methods: SCI data were collected from high‐risk psychiatric inpatients (N = 591) grouped based on their short‐term suicidal behavior, that is, those who attempted suicide between intake and 1‐month follow‐up dates (N = 20) and those who did not (N = 571). Data were analyzed using three predictive algorithms (logistic regression, random forest, and gradient boosting) and three sampling approaches (split sample, Synthetic minority oversampling technique, and enhanced bootstrap). Results: The enhanced bootstrap approach considerably outperformed the other sampling approaches, with random forest (98.0% precision; 33.9% recall; 71.0% Area under the precision‐recall curve [AUPRC]; and 87.8% Area under the receiver operating characteristic [AUROC]) and gradient boosting (94.0% precision; 48.9% recall; 70.5% AUPRC; and 89.4% AUROC) algorithms performing best in predicting positive cases of near‐term suicidal behavior using this dataset. Conclusions: ML can be useful in analyzing data from psychometric scales, such as the SCI, and for predicting near‐term suicidal behavior. However, in cases such as the current analysis where the data are highly imbalanced, the optimal method of measuring performance must be carefully considered and selected.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Decision curve analysis: a novel method for evaluating prediction models
Vickers, A. J., & Elkin, E. B. (2006) · Medical Decision Making · doi:10.1177/0272989x06295361 · Cited by 6,341 · cited 1×
“Net benefit is calculated as (Peirce, 1884; Vickers & Elkin, 2006): where p t is the threshold probability, or the minimum probability of SB where treatment is warranted (Vickers, van Calster, & Steyerberg, 2019).”
MethodSaito, T., & Rehmsmeier, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118432 · Cited by 5,309
Posner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., Currier, G. W., Melvin, G. A., Greenhill, L., Shen, S., et al. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10111704 · Cited by 5,157 · cited 1×
“The Columbia Suicide ‐ Severity Rating Scale (CSSRS; Posner et al., 2011) is a semi ‐ structured interview that assesses the severity of current and lifetime suicidal thoughts and behaviors.”
MethodMoons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147 · cited 1×
“However, it is important to note that because the approaches described here were trained and tested using one study sample, they are considered internal validation techniques and thus contribute to model development rather than model validation (Moons et al., 2015).”
MethodRisk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research
Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., Huang, X., Musacchio, K. M., Jaroszewski, A. C., Chang, B. P., & Nock, M. K. (2017) · Psychological Bulletin · doi:10.1037/bul0000084 · Cited by 3,784
The Balanced Accuracy and Its Posterior Distribution
Brodersen, K. H., Ong, C. S., Stephan, K. E., & Buhmann, J. M. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.764 · Cited by 1,816
Coming to terms with the terms of risk
Kraemer, H. C. (1997) · Archives of General Psychiatry · doi:10.1001/archpsyc.1997.01830160065009 · Cited by 1,432
A simple, step-by-step guide to interpreting decision curve analysis
Vickers, A. J., van Calster, B., & Steyerberg, E. W. (2019) · Diagnostic and Prognostic Research · doi:10.1186/s41512-019-0064-7 · Cited by 1,174
Prediction Models for Suicide Attempts and Deaths: A Systematic Review and Simulation
Belsher, B. E., Smolenski, D. J., Pruitt, L. D., Bush, N. E., Beech, E. H., Workman, D. E., Morgan, R. L., Evatt, D. P., Tucker, J., & Skopp, N. A. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0174 · Cited by 540 · cited 1×
“However, despite the density and variability of risk assessment literature, recent systematic reviews indicate that many suicide prediction models have poor predictive abilities and practical utility (Belsher et al., 2019; Franklin et al., 2017).”
BackgroundSimon, G. E., Johnson, E., Lawrence, J. M., Rossom, R. C., Ahmedani, B., Lynch, F. L., Beck, A., Waitzfelder, B., Ziebell, R., Penfold, R. B., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17101167 · Cited by 400 · cited 1×
“…in the analysis of electronic medical records of approximately 3 million patients; here, short ‐ term SB following mental health specialty visits and primary care visits were retrospectively predicted with seemingly greater ability than extant suicide risk assessment tools (Simon et al., 2018).”
BackgroundInfluentialSelf-citation
Cited by
Bloch-Elkouby, S., Barzilay, S., Gorman, B. S., Lawrence, O. C., Rogers, M. L., Richards, J., Cohen, L. J., Johnson, B. N., & Galynker, I. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.08.048 · Cited by 72
Self-citationThe role of suicide ideation in assessing near-term suicide risk: A machine learning approach
McMullen, L., Parghi, N., Rogers, M. L., Yao, H., Bloch-Elkouby, S., & Galynker, I. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114118 · Cited by 30
Self-citationFactor structure and validity of the Revised Suicide Crisis Inventory (SCI-2) among Indian adults
Menon, V., Bafna, A. R., Rogers, M. L., Richards, J., & Galynker, I. (2022) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2022.103119 · Cited by 29
Self-citationSuicide Crisis Syndrome: A systematic review
Melzer, L., Forkmann, T., & Teismann, T. (2024) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.13065 · Cited by 30
Cross-national presence and sociodemographic correlates of the suicide crisis syndrome
Rogers, M. L., McMullen, L., Liang, Y., Perez, N., Richards, J. A., Akülker, G., Barzilay, S., Bilici, R., Blum, Y., Chistopolskaya, K., et al. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.02.076 · Cited by 16
Self-citation
Metadata
- Authors
- Parghi, N., Chennapragada, L., Barzilay, S., Newkirk, S., Ahmedani, B., Lok, B., & Galynker, I.
- Venue
- International Journal of Methods in Psychiatric Research
- Publisher
- Wiley
- Published
- 2020-11-09
- Volume
- 30
- Issue
- 1
- Pages
- e1863-e1863
- ISSN
- 1049-8931 (ISSN-L)
- 1557-0657
- OpenAlex
- W3103837797
- Cited by
- 30
- References
- 17
- FWCI
- 1.30
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing the predictive ability of the Suicide Crisis Inventory for near‐term suicidal behavior using machine learning approaches. https://app.cochat.ai/papers/10.1002/mpr.1863
- The paper
- Parghi, N., Chennapragada, L., Barzilay, S., Newkirk, S., Ahmedani, B., Lok, B., & Galynker, I. (2021). Assessing the predictive ability of the Suicide Crisis Inventory for near‐term suicidal behavior using machine learning approaches. International Journal of Methods in Psychiatric Research. https://doi.org/10.1002/mpr.1863
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.