Predicting Imminent Suicidal Thoughts and Nonfatal Attempts: The Role of Complexity
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
For decades, our ability to predict suicidal thoughts and behaviors (STBs) has been at near-chance levels. The objective of this study was to advance prediction by addressing two major methodological constraints pervasive in past research: (a) the reliance on long follow-ups and (b) the application of simple conceptualizations of risk. Participants were 1,021 high-risk suicidal and/or self-injuring individuals recruited worldwide. Assessments occurred at baseline and 3, 14, and 28 days after baseline using a range of implicit and self-report measures. Retention was high across all time points (> 90%). Risk algorithms were derived and compared with univariate analyses at each follow-up. Results indicated that short-term prediction alone did not improve prediction for attempts, even using commonly cited “warning signs”; however, a small set of factors did provide fair-to-good short-term prediction of ideation. Machine learning produced considerable improvements for both outcomes across follow-ups. Results underscore the importance of complexity in the conceptualization of STBs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Of note, the study with the briefest follow-up period for suicide attempts (i.e., three days; Ribeiro, Huang, Fox, Walsh, & Linthicum, 2019) yielded the largest effect (d = .85) among studies”
From Sleep and suicide: A systematic review and meta-analysis of longitudinal studies (2020) · cites this paper as Ribeiro, Huang, Fox, Walsh, & Linthicum, 2019
In the citing paper
“recent meta-analyses show that the prediction accuracy of suicide is alarmingly poor (Franklin et al., 2017;Ribeiro et al., 2019;Woodford et al., 2019).”
From Suicide Crisis Syndrome: A systematic review (2024) · cites this paper as Ribeiro et al., 2019
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
An Introduction to Statistical Learning
James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013) · Springer Texts in Statistics · doi:10.1007/978-1-4614-7138-7 · Cited by 12,106
Validation of the Insomnia Severity Index as an outcome measure for insomnia research
Bastien, C. (2001) · Sleep Medicine · doi:10.1016/s1389-9457(00)00065-4 · Cited by 8,067
Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research
Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., Huang, X., Musacchio, K. M., Jaroszewski, A. C., Chang, B. P., & Nock, M. K. (2017) · Psychological Bulletin · doi:10.1037/bul0000084 · Cited by 3,784
Self-citationJournal of Consulting and Clinical Psychology
Nezu, A. M., & Greenberg, L. M. (2015) · The Encyclopedia of Clinical Psychology · doi:10.1002/9781118625392.wbecp389 · Cited by 2,469
Interoceptive predictions in the brain
Barrett, L. F., & Simmons, W. K. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn3950 · Cited by 1,766 · cited 1×
“Although not yet at the forefront of clinical psychology, the principle of complexity is ubiquitous among many other disciplines, including modern theories in biology, neuroscience, and affective science (Edelman & Gally, 2001; Barrett & Simmons, 2015).”
BackgroundHauser, D. J., & Schwarz, N. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0578-z · Cited by 1,739
Casler, K., Bickel, L., & Hackett, E. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2013.05.009 · Cited by 1,662
Degeneracy and complexity in biological systems
Edelman, G. M., & Gally, J. A. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.231499798 · Cited by 1,493
Coming to terms with the terms of risk
Kraemer, H. C. (1997) · Archives of General Psychiatry · doi:10.1001/archpsyc.1997.01830160065009 · Cited by 1,432 · cited 1×
“Identifying causal risk factors requires controlled experiments (Kraemer et al., 1997).”
BackgroundAn inkblot for attitudes: Affect misattribution as implicit measurement.
Payne, B. K., Cheng, C. M., Govorun, O., & Stewart, B. D. (2005) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.89.3.277 · Cited by 1,371
Nock, M. K., Holmberg, E. B., Photos, V. I., & Michel, B. D. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.3.309 · Cited by 1,352
Ribeiro, J. D., Franklin, J. C., Fox, K. R., Bentley, K. H., Kleiman, E. M., Chang, B. P., & Nock, M. K. (2016) · Psychological Medicine · doi:10.1017/s0033291715001804 · Cited by 1,346 · cited 3×
“As it stands, metaanalytic evidence suggests that the effects of risk factors on eventual STBs are modest at best (Franklin et al., 2017; Ribeiro et al., 2016a; Ribeiro et al., 2018).”
BackgroundSelf-citationBirchwood, M., Smith, J., Cochrane, R., Wetton, S., & Copestake, S. (1990) · British Journal of Psychiatry · doi:10.1192/bjp.157.6.853 · Cited by 1,157
Ribeiro, J. D., Huang, X., Fox, K. R., & Franklin, J. C. (2018) · British Journal of Psychiatry · doi:10.1192/bjp.2018.27 · Cited by 894
Self-citationClinical correlates of inpatient suicide
Busch, K. A., Fawcett, J., & Jacobs, D. G. (2003) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v64n0105 · Cited by 750
Derogatis, L. R. (2011) · PsycTESTS Dataset · doi:10.1037/t07502-000 · Cited by 656
Predicting Risk of Suicide Attempts Over Time Through Machine Learning
Walsh, C. G., Ribeiro, J. D., & Franklin, J. C. (2017) · Clinical Psychological Science · doi:10.1177/2167702617691560 · Cited by 567
Self-citationWarning signs for suicide: theory, research, and clinical applications
Rudd, M. D., Berman, A. L., Joiner, T. E., Nock, M. K., Silverman, M. M., Mandrusiak, M., Van Orden, K., & Witte, T. (2006) · Suicide and Life-Threatening Behavior · doi:10.1521/suli.2006.36.3.255 · Cited by 548
Suicidal Thoughts and Behaviors Among Adults Aged ≥18 Years — United States, 2015–2019
Ivey-Stephenson, A. Z., Crosby, A. E., Hoenig, J. M., Gyawali, S., Park-Lee, E., & Hedden, S. L. (2022) · MMWR. Surveillance Summaries · doi:10.15585/mmwr.ss7101a1 · Cited by 512
Kessler, R. C., Warner, C. H., Ivany, C., Petukhova, M. V., Rose, S., Bromet, E. J., Brown, M., Cai, T., Colpe, L. J., Cox, K. L., et al. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1754 · Cited by 447 · cited 1×
“Recent efforts support the viability of using machine learning to predict suicidal behaviors, considerably improving prediction accuracy (Barack-Corren et al., 2017; Kessler et al., 2015; Walsh, Ribeiro, & Franklin, 2017).”
BackgroundBentley, K. H., Franklin, J. C., Ribeiro, J. D., Kleiman, E. M., Fox, K. R., & Nock, M. K. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.11.008 · Cited by 422
Self-citationRibeiro, J. D., Witte, T. K., Van Orden, K. A., Selby, E. A., Gordon, K. H., Bender, T. W., & Joiner, T. E. (2014) · Psychological Assessment · doi:10.1037/a0034858 · Cited by 407
Self-citationCarter, G., Milner, A., McGill, K., Pirkis, J., Kapur, N., & Spittal, M. J. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.182717 · Cited by 361
Correcting for Optimistic Prediction in Small Data Sets
Smith, G. C. S., Seaman, S. R., Wood, A. M., Royston, P., & White, I. R. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwu140 · Cited by 352
Predicting suicidal behavior from longitudinal electronic health records.
Barak-Corren, Y., Castro, V. M., Javitt, S., Hoffnagle, A. G., Dai, Y., Perlis, R. H., Nock, M. K., Smoller, J. W., & Reis, B. Y. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16010077 · Cited by 339
Predicting suicide attempts in adolescents with longitudinal clinical data and machine learning
Walsh, C. G., Ribeiro, J. D., & Franklin, J. C. (2018) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12916 · Cited by 264
Self-citationKessler, R. C., van Loo, H. M., Wardenaar, K. J., Bossarte, R. M., Brenner, L. A., Cai, T., Ebert, D. D., Hwang, I., Li, J., de Jonge, P., et al. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.198 · Cited by 254
Franklin, J. C., Fox, K. R., Franklin, C. R., Kleiman, E. M., Ribeiro, J. D., Jaroszewski, A. C., Hooley, J. M., & Nock, M. K. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000093 · Cited by 217 · cited 1×
“In this study, we implemented a multilayer authentication approach to data collection consistent with best-practice recommendations (e.g., Bull, Vallejos, Levine, & Ortiz, 2008; Ip, Barnett, Tenerowicz, & Perry, 2010) and which we have used successfully in prior studies (see Franklin et al., 2016).”
MethodSelf-citationJoiner, T. E., Jr., Rudd, M. D., & Rajab, M. H. (1997) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.106.2.260 · Cited by 133
The role of intense affective states in signaling a suicide crisis.
Hendin, H., Maltsberger, J. T., & Szanto, K. (2007) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e318052264d · Cited by 121
Biological risk factors for suicidal behaviors: a meta-analysis
Chang, B. P., Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., & Nock, M. K. (2016) · Translational Psychiatry · doi:10.1038/tp.2016.165 · Cited by 113
Self-citationHuang, X., Fox, K. R., Ribeiro, J. D., & Franklin, J. C. (2017) · Psychological Medicine · doi:10.1017/s0033291717002136 · Cited by 100
Self-citationDemographics as predictors of suicidal thoughts and behaviors: A meta-analysis
Huang, X., Ribeiro, J. D., Musacchio, K. M., & Franklin, J. C. (2017) · PLOS ONE · doi:10.1371/journal.pone.0180793 · Cited by 94
Self-citationDevelopment and Validation of a Brief Self-Report Measure of Agitation: The Brief Agitation Measure
Ribeiro, J. D., Bender, T. W., Selby, E. A., Hames, J. L., & Joiner, T. E. (2011) · Journal of Personality Assessment · doi:10.1080/00223891.2011.608758 · Cited by 87
Self-citationSmith, A. R., Velkoff, E. A., Ribeiro, J. D., & Franklin, J. (2019) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12427 · Cited by 82
Self-citationBull, S. S., Vallejos, D., Levine, D., & Ortiz, C. (2008) · AIDS Care · doi:10.1080/09540120701771697 · Cited by 74
The Nature of Pain Offset Relief in Nonsuicidal Self-Injury: A Laboratory Study
Franklin, J. C., Puzia, M. E., Lee, K. M., Lee, G. E., Hanna, E. K., Spring, V. L., & Prinstein, M. J. (2013) · Clinical Psychological Science · doi:10.1177/2167702612474440 · Cited by 71
Ribeiro, J. D., Franklin, J. C., Fox, K. R., Bentley, K. H., Kleiman, E. M., Chang, B., & Nock, M. K. (2016) · Psychological Medicine · doi:10.1017/s0033291716000611 · Cited by 63
Self-citationSuicide Attempts within 12 Months of Treatment for Substance Use Disorders
Britton, P. C., & Conner, K. R. (2010) · Suicide and Life-Threatening Behavior · doi:10.1521/suli.2010.40.1.14 · Cited by 56
Eating Disorder Symptoms and Suicidal Ideation: The Moderating Role of Disgust
Chu, C., Bodell, L. P., Ribeiro, J. D., & Joiner, T. E. (2015) · European Eating Disorders Review · doi:10.1002/erv.2373 · Cited by 51
Self-citationWitte, T. K., Gauthier, J. M., Huang, X., Ribeiro, J. D., & Franklin, J. C. (2018) · Journal of Clinical Psychology · doi:10.1002/jclp.22625 · Cited by 29
Self-citationThe Touro 12-Step: A Systematic Guide to Optimizing Survey Research with Online Discussion Boards
Ip, E. J., Barnett, M. J., Tenerowicz, M. J., & Perry, P. J. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1314 · Cited by 24
Research works printed but not linked: 2
- Beck A. T., 1988, BHS, Beck Hopelessness Scale: Manual
- Beck A. T., 1991, BSI, Beck scale for suicide ideation: Manual
Cited by
Sleep and suicide: A systematic review and meta-analysis of longitudinal studies
Liu, R. T., Steele, S. J., Hamilton, J. L., Do, Q. B. P., Furbish, K., Burke, T. A., Martinez, A. P., & Gerlus, N. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101895 · Cited by 239
Harris, L. M., Huang, X., Linthicum, K. P., Bryen, C. P., & Ribeiro, J. D. (2020) · Scientific Reports · doi:10.1038/s41598-020-70866-6 · Cited by 201
Self-citationThe Lancet Commission on self-harm
Moran, P., Chandler, A., Dudgeon, P., Kirtley, O. J., Knipe, D. W., Pirkis, J., Sinyor, M., Allister, R., Ansloos, J. P., Ball, M. A., et al. (2024) · The Lancet · doi:10.1016/s0140-6736(24)01121-8 · Cited by 160
Deep neural networks detect suicide risk from textual facebook posts
Ophir, Y., Tikochinski, R., Asterhan, C. S. C., Sisso, I., & Reichart, R. (2020) · Scientific Reports · doi:10.1038/s41598-020-73917-0 · Cited by 154
Translating promise into practice: a review of machine learning in suicide research and prevention
Kirtley, O. J., van Mens, K., Hoogendoorn, M., Kapur, N., & de Beurs, D. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00254-6 · Cited by 100
Metadata
- Authors
- Ribeiro, J. D., Huang, X., Fox, K. R., Walsh, C. G., & Linthicum, K. P.
- Affiliations
- Florida State University (US)
- Harvard University (US)
- Vanderbilt University Medical Center (US)
- Corresponding author
- Ribeiro, Jessica D.
- Venue
- Clinical Psychological Science
- Publisher
- SAGE Publications
- Published
- 2019-05-06
- Volume
- 7
- Issue
- 5
- Pages
- 941-957
- ISSN
- 2167-7026 (ISSN-L)
- 2167-7034
- OpenAlex
- W2944798565
- Cited by
- 75
- References
- 44
- Citations by year
- 2026: 7 · 2025: 6 · 2024: 10 · 2023: 7 · 2022: 11 · 2021: 12 · 2020: 18 · 2019: 4
- FWCI
- 13.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Clinical Psychological Science (publishedVersion)
- Funders
- u.s. department of defense (W81XWH-10-2-0181)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- suicidal ideation, suicide attempts, suicide risk prediction, self-harm, risk algorithm, machine learning, short-term forecasting, warning signs, complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.