Meta-Analysis of Longitudinal Cohort Studies of Suicide Risk Assessment among Psychiatric Patients: Heterogeneity in Results and Lack of Improvement over Time
Open accessThe DOI matches its Crossref record, with a small difference in title or year; 69 of the 71 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: It is widely assumed that the clinical care of psychiatric patients can be guided by estimates of suicide risk and by using patient characteristics to define a group of high-risk patients. However, the statistical strength and reliability of suicide risk categorization is unknown. Our objective was to investigate the odds of suicide in high-risk compared to lower-risk categories and the suicide rates in high-risk and lower-risk groups. METHOD: We located longitudinal cohort studies where psychiatric patients or people who had made suicide attempts were stratified into high-risk and lower-risk groups for suicide with suicide mortality as the outcome by searching for peer reviewed publications indexed in PubMed or PsychINFO. Electronic searches were supplemented by hand searching of included studies and relevant review articles. Two authors independently extracted data regarding effect size, study population and study design from 53 samples of risk-assessed patients reported in 37 studies. RESULTS: The pooled odds of suicide among high-risk patients compared to lower-risk patients calculated by random effects meta-analysis was of 4.84 (95% Confidence Interval (CI) 3.79-6.20). Between-study heterogeneity was very high (I2 = 93.3). There was no evidence that more recent studies had greater statistical strength than older studies. Over an average follow up period of 63 months the proportion of suicides among the high-risk patients was 5.5% and was 0.9% among lower-risk patients. The meta-analytically derived sensitivity and specificity of a high-risk categorization were 56% and 79% respectively. There was evidence of publication bias in favour of studies that inflated the pooled odds of suicide in high-risk patients. CONCLUSIONS: The strength of suicide risk categorizations based on the presence of multiple risk factors does not greatly exceed the association between individual suicide risk factors and suicide. A statistically strong and reliable method to usefully distinguish patients with a high-risk of suicide remains elusive.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“currently established longitudinal risk factors being no better than chance at differentiating between those at high vs. low risk (33).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [33]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, a meta-analysis by Large and colleagues (17) showed that even when a large number of different sources of information are combined to categorize patients as high-risk vs. low-risk, the predictive power for suicidal behavior is still insufficient.”
From Suicide risk assessment: clinical implications of the unpredictability of suicidal behavior (2026) · cites this paper as [17]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Recent meta-analyses demonstrate that neither individual risk factors, composite risk scores, clinical judgment, nor adherence to theoretical models or artificial intelligence enables sufficiently accurate prediction of suicidal behavior.”
From Suicide risk assessment: clinical implications of the unpredictability of suicidal behavior (2026) · cites this paper as [17]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, these factors have quite limited clinical use: they are poor predictors of short-term behavior, or are non-modifiable (e.g., gender, past STBs).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [33]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“and sensitivity analyses indicated that 44% of the patients who died by suicide were not assigned to the high-risk group.”
From Suicide risk assessment: clinical implications of the unpredictability of suicidal behavior (2026) · cites this paper as [17]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“Our methods conformed to the items in the quality checklist from the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and Meta-analysis Of Observational Studies in Epidemiology (MOOSE) guidelines [20,21].”
MethodDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
(2014) · Medical Entomology and Zoology · Cited by 17,633
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Suicide Prevention Strategies: A Systematic Review
Mann, J. J., Apter, A., Bertolote, J., Beautrais, A., Currier, D., Haas, A., Hegerl, U., Lonnqvist, J., Malone, K., Marusic, A., et al. (2005) · JAMA · doi:10.1001/jama.294.16.2064 · Cited by 2,852
(1985) · American Journal of Psychiatry · doi:10.1176/ajp.142.5.559 · Cited by 1,723 · cited 1×
“Beck (1985) [46] Patients considered suicidal admitted to Hospital or the University of Pennsylvania General Hospital 165 patients, 11 suicides 72 BHS, BDI, SSI Validation.”
BackgroundRisk factors for suicide in individuals with depression: a systematic review
Hawton, K., Casañas i Comabella, C., Haw, C., & Saunders, K. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.01.004 · Cited by 1,469
Ribeiro, J. D., Franklin, J. C., Fox, K. R., Bentley, K. H., Kleiman, E. M., Chang, B. P., & Nock, M. K. (2016) · Psychological Medicine · doi:10.1017/s0033291715001804 · Cited by 1,346 · cited 1×
“However, some authors doubt that clinically meaningful suicide risk categories can be defined by either suicidal thoughts or behaviors [5,6] or a combination of multiple risk factors [7–10].”
Background
Cited by
Items 201–248 of 248
Suicidal behaviors in bipolar disorder
Serafini, G., Cipriani, N., & Amore, M. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-819182-8.00029-6
The Treatment of Suicide Risk: Neuroscience Aspects
van Heeringen, K. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205.011
Costello, S., & Li, J. (2021) · Research Square · doi:10.21203/rs.3.rs-567997/v1
Images of the Suicidal Brain: Systems Neuroscience and Suicide
van Heeringen, K. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205.007
I Think, Therefore I Do Not Want to Be: The Cognitive Neuroscience of Suicidal Behavior
van Heeringen, K. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205.006
Application of Multimodal EEG in Predicting the Risk of Suicide
Jiang, X., & Kuang, L. (2021) · Springer eBooks · doi:10.1007/978-981-16-4493-1_14
Suicide Prevention: Turning Inward for Direction
Reidenberg, D. J. (2021) · Springer eBooks · doi:10.1007/978-3-030-41319-4_40-1
(2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205.013
van Heeringen, K. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205.015
van Heeringen, K. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205.001
Lethal Signals: The Molecular Neuroscience of Suicidal Behavior
van Heeringen, K. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205.005
van Heeringen, K. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205.012
van Heeringen, K. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205.014
Suicide Prevention: Turning Inward for Direction
Reidenberg, D. J. (2022) · Springer eBooks · doi:10.1007/978-3-030-42003-1_40
Knowles, J. R. P. (2023) · Cronfa (Swansea University) · doi:10.23889/suthesis.63616
Etične vsebine na področju samomorilnega vedenja
Poštuvan, V., & Gomboc, V. (2023) · doi:10.26493/978-961-293-275-6.481-502
Tanaka, K., & Ikeuchi, S. (2023) · Journal of Advanced Nursing · doi:10.1111/jan.16024
Eggenberger, L., Spangenberg, L., Genuchi, M. C., & Walther, A. (2024) · doi:10.31234/osf.io/8dc56
The Effect of Climate And Environment on Human Mental State and Health
Yar, F. G. M., & Shaheedzooy, M. I. (2024) · Randwick International of Social Science Journal · doi:10.47175/rissj.v5i1.888
Mirowatisiwin : vers le mieux-être à Manawan
Bernheim, E., & Ottawa, E. (2022) · Revue d’études autochtones · doi:10.7202/1110705ar · Cited by 1
Muckley, L. (2024) · Counselling and Psychotherapy Research · doi:10.1002/capr.12760
Baldaçara, L., Calfat, E. L. D. B., Périco, C. D. A.-M., da Rocha, G. A., Leite, V. D. S., Porto, D. M., Grüdtner, R. R., Díaz, A. P., Meleiro, A. M. A. D. S., Corrêa, H., et al. (2024) · Debates em Psiquiatria · doi:10.25118/2763-9037.2024.v14.1256 · Cited by 2
Addressing suicide risk: A study of dose response in collaborative care
Littl, V., Green, B., Hardy, C., & Fuller, S. (2024) · doi:10.36855/cc2024.1
“However, there is ample evidence demonstrating that patients with a history of suicide risk are at an elevated risk for subsequent suicidal ideation (Busch et al., 2003; Doshi et al., 2020; Large et al., 2016; Large et al., 2011).”
Bernheim, E. (2024) · Criminologie · doi:10.7202/1112601ar · Cited by 1
Emotional information processing in depressed elderly with suicidal behavior
Barsznica, Y., Vandel, P., Lambert, B., Monnin, J., Nicolier, M., Pinho, C. D., Hickel, J., Richard‐Devantoy, S., Morgny, C., Szymanska, M., et al. (2024) · L Encéphale · doi:10.1016/j.encep.2024.09.004 · Cited by 2
Suicide-risk implications in legalising medical assistance in dying for mental disorders
Gay, M. (2025) · Mortality · doi:10.1080/13576275.2025.2481265 · Cited by 2
“While these factors may indicate chronic risk and guide suicide prevention measures, their predictability for completed suicide remains poor (Mulder, Newton-Howes, & Coid, 2016; Large et al., 2016).”
InfluentialKang, G., Yoon, J. Y., & Shin, J. H. (2025) · Archives of Public Health · doi:10.1186/s13690-025-01574-8
“According to a study by the WHO, only 7% of individuals with suicidal thoughts actually attempted suicide within two years [12].”
Biscoe, N., Leightley, D., & Murphy, D. (2025) · JMIR AI · doi:10.2196/64898
“Military research has also made use of these techniques to identify veterans from a clinical research database [10], as well as to categorize patients with probable posttraumatic stress disorder [11].”
HLA Class II Alleles and Suicidal Behavior: Evidence from a Case–Control Study
Cîmpianu, M. E., Vică, M. L., Bâlici, Ș., Nicula, G. Z., Domșa, E. M., Cîmpianu, T., Rusu, S. I., Coman, H. G., & Siserman, C. V. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms262010181
“Highlighting the complex interplay observed in suicidal behavioral processes, a meta-analysis on suicide risks found that 50% of patients considered to be at low risk actually do commit suicide, while 95% of the high-risk patients do not [28].”
Cogan, M. B., Nestadt, P. S., Lewis, C. M., Weckstein, J., & Berman, A. L. (2025) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.70062
Psychiatry at the turn of the century and a vision for future developments
Oquendo, M. A., Barrigón, M. L., & Baca‐García, E. (2025) · International Review of Psychiatry · doi:10.1080/09540261.2025.2591200 · Cited by 2
“(Large et al., 2016) Clear standards requiring high accuracy, transparency, and regular validation will be essential (Torous et al., 2018).”
Bond, K. S., Cottrill, F. A., Mackinnon, A., Morgan, A. J., Kelly, C. M., Armstrong, G., Kitchener, B. A., Reavley, N. J., & Jorm, A. F. (2021) · Figshare · doi:10.6084/m9.figshare.14457011
Scapegoating in Healthcare: A Primitive Response to Tragedy
Gibbons, R. (2025) · International Journal of Social Psychiatry · doi:10.1177/00207640251398277
“Despite decades of research, for example, it remains impossible to predict who will go on to die by suicide or commit homicide (Gibbons, 2023, 2025a; Hawton & Pirkis, 2024; Large et al., 2016).”
Cengisiz, C., & Nehir, S. (2025) · Cyprus Turkish Journal of Psychiatry and Psychology · doi:10.35365/ctjpp.25.4.09
García-Ramos, A., Doval, S., Essau, C., Lara-Cabrera, R., Ayad-ahmed, W., & de la Torre-Luque, A. (2026) · International Journal of Child Abuse & Neglect · doi:10.1016/j.chiabu.2026.107920
When is Suicide Unexpected? A Normative-Explanatory Account of Suicidal Action
Baston, R. (2026) · Review of Philosophy and Psychology · doi:10.1007/s13164-026-00807-1
“From this perspective, strictly speaking, every suicide is unexpected, as all known risk assessments are not predictive (Large et al. 2016).”
Bliokas, V. V., Whiting, L., Liddle, S. K., Sng, R., & Janackovski, A. (2026) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.70090 · Cited by 1
“Despite decades of suicide prevention research, there has been little progress in our ability to accurately predict who will take their own life (Franklin et al. 2017; Large et al. 2016).”
Oztermeli, A. D., Budak, B. Y., & Görmez, V. (2026) · Clinical Child Psychology and Psychiatry · doi:10.1177/13591045261447933 · Cited by 1
Shen, C., Xu, L., Jiang, Q., & Li, Y. (2026) · Journal of Nursing Management · doi:10.1155/jonm/3736316
“…into their condition, and under the infuence of psychiatric symptoms and medications, behaviors such as suicide, self-harm, violence toward others or property destruction, elopement, choking, and falls pose unpredictable threats to themselves and others, potentially leading to medical disputes [3].”
Diagnostic accuracy of machine learning approaches for suicide‑related outcomes: a meta‑analysis
Kohnepoushi, P., Afraie, M., Rahmani, H., Seyedoshohadaei, S. A., Ghadirzadeh, B., & Moradi, Y. (2026) · Annals of General Psychiatry · doi:10.1186/s12991-026-00671-4
“Large et al. (2016) discovered that 95% of patients deemed high risk did not die by suicide, while many of those who did were initially classified as low risk [8].”
Longitudinal Risk for Suicidal Self-Directed Violence Among Veterans With Cancer
Sullivan, D. R., Disher, N. G., Rosa, W. E., Vlajic, S. A., Handley, R., Scott, J., Denneson, L. M., Niederhausen, M., Lyons, P. G., Vranas, K. C., et al. (2026) · JAMA Oncology · doi:10.1001/jamaoncol.2026.1459 · Cited by 1
Alberdi‐Páramo, Í., Rodrigo-Holgado, I., & Díaz‐Marsá, M. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1843176
“As a result, overreliance on checklist-based approaches may create a false sense of precision and obscure the nuanced, dynamic nature of suicidal crises (47, 48).”
Between Protocol and Presence: Clinicians' Work in Suicide Risk Assessment
Ward, K., Ansloos, J. P., & Sanchez-Morales, D. (2026) · Counselling and Psychotherapy Research · doi:10.1002/capr.70189
Samamé, C. (2026) · The British Journal of Psychiatry · doi:10.1192/bjp.2026.10751
Suicidology’s Faulty Paradigm: Suicide Overrides Superordinate Impetus for Survival (“SOSIS”)
Soper, C. A. (2026) · Evolutionary Psychological Science · doi:10.1007/s40806-026-00469-3
A machine learning framework for the multi-class prediction of suicide attempt risk
Nordin, N., Noor, M. H. M., Zainol, Z. B., Chan, L. F., & Buji, R. I. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.107815
Determining a model of care for a youth suicide service: The Luminos Project
Panton, K. R., Highfield, Z., Flanagan, S., Marshall, K., Hansen, A., Speirs, S., Freeman, J., & Lin, A. P. (2026) · Advances in Mental Health · doi:10.1080/18387357.2026.2740101
Metadata
- Authors
- Large, M., Kaneson, M., Myles, N., Myles, H., Gunaratne, P., & Ryan, C.
- Affiliations
- UNSW Sydney (AU)
- Queen Elizabeth Hospital (AU)
- The University of Adelaide (AU)
- Prince of Wales Hospital (AU)
- The University of Sydney (AU)
- Corresponding author
- Large, Matthew
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-06-10
- Volume
- 11
- Issue
- 6
- Pages
- e0156322
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4902221
- OpenAlex
- W2410895653
- Cited by
- 248
- References
- 71
- Citations by year
- 2026: 19 · 2025: 19 · 2024: 20 · 2023: 24 · 2022: 24 · 2021: 19 · 2020: 28 · 2019: 24 · 2018: 46 · 2017: 23 · 2016: 2
- FWCI
- 4.69
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Social Sciences › Psychology › Clinical Psychology › Psychopathy, Forensic Psychiatry, Sexual Offending
- Keywords
- suicide risk assessment, psychiatric patients, suicide mortality, high-risk patients, sensitivity and specificity, publication bias, study heterogeneity, longitudinal cohort
- MeSH terms
- Suicide Prevention, Mental Disorders, Humans, Longitudinal Studies, Risk Factors, Suicide, Suicide, Attempted, Time Factors, Reproducibility of Results, Cohort Studies, Risk Assessment, Suicidal Ideation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.