Meta-Analysis of Longitudinal Cohort Studies of Suicide Risk Assessment among Psychiatric Patients: Heterogeneity in Results and Lack of Improvement over Time
Open accessThe DOI matches its Crossref record, with a small difference in title or year; 69 of the 71 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: It is widely assumed that the clinical care of psychiatric patients can be guided by estimates of suicide risk and by using patient characteristics to define a group of high-risk patients. However, the statistical strength and reliability of suicide risk categorization is unknown. Our objective was to investigate the odds of suicide in high-risk compared to lower-risk categories and the suicide rates in high-risk and lower-risk groups. METHOD: We located longitudinal cohort studies where psychiatric patients or people who had made suicide attempts were stratified into high-risk and lower-risk groups for suicide with suicide mortality as the outcome by searching for peer reviewed publications indexed in PubMed or PsychINFO. Electronic searches were supplemented by hand searching of included studies and relevant review articles. Two authors independently extracted data regarding effect size, study population and study design from 53 samples of risk-assessed patients reported in 37 studies. RESULTS: The pooled odds of suicide among high-risk patients compared to lower-risk patients calculated by random effects meta-analysis was of 4.84 (95% Confidence Interval (CI) 3.79-6.20). Between-study heterogeneity was very high (I2 = 93.3). There was no evidence that more recent studies had greater statistical strength than older studies. Over an average follow up period of 63 months the proportion of suicides among the high-risk patients was 5.5% and was 0.9% among lower-risk patients. The meta-analytically derived sensitivity and specificity of a high-risk categorization were 56% and 79% respectively. There was evidence of publication bias in favour of studies that inflated the pooled odds of suicide in high-risk patients. CONCLUSIONS: The strength of suicide risk categorizations based on the presence of multiple risk factors does not greatly exceed the association between individual suicide risk factors and suicide. A statistically strong and reliable method to usefully distinguish patients with a high-risk of suicide remains elusive.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“currently established longitudinal risk factors being no better than chance at differentiating between those at high vs. low risk (33).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [33]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, a meta-analysis by Large and colleagues (17) showed that even when a large number of different sources of information are combined to categorize patients as high-risk vs. low-risk, the predictive power for suicidal behavior is still insufficient.”
From Suicide risk assessment: clinical implications of the unpredictability of suicidal behavior (2026) · cites this paper as [17]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Recent meta-analyses demonstrate that neither individual risk factors, composite risk scores, clinical judgment, nor adherence to theoretical models or artificial intelligence enables sufficiently accurate prediction of suicidal behavior.”
From Suicide risk assessment: clinical implications of the unpredictability of suicidal behavior (2026) · cites this paper as [17]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, these factors have quite limited clinical use: they are poor predictors of short-term behavior, or are non-modifiable (e.g., gender, past STBs).”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [33]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“and sensitivity analyses indicated that 44% of the patients who died by suicide were not assigned to the high-risk group.”
From Suicide risk assessment: clinical implications of the unpredictability of suicidal behavior (2026) · cites this paper as [17]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“Our methods conformed to the items in the quality checklist from the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and Meta-analysis Of Observational Studies in Epidemiology (MOOSE) guidelines [20,21].”
MethodDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
(2014) · Medical Entomology and Zoology · Cited by 17,633
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Suicide Prevention Strategies: A Systematic Review
Mann, J. J., Apter, A., Bertolote, J., Beautrais, A., Currier, D., Haas, A., Hegerl, U., Lonnqvist, J., Malone, K., Marusic, A., et al. (2005) · JAMA · doi:10.1001/jama.294.16.2064 · Cited by 2,852
(1985) · American Journal of Psychiatry · doi:10.1176/ajp.142.5.559 · Cited by 1,723 · cited 1×
“Beck (1985) [46] Patients considered suicidal admitted to Hospital or the University of Pennsylvania General Hospital 165 patients, 11 suicides 72 BHS, BDI, SSI Validation.”
BackgroundRisk factors for suicide in individuals with depression: a systematic review
Hawton, K., Casañas i Comabella, C., Haw, C., & Saunders, K. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.01.004 · Cited by 1,469
Ribeiro, J. D., Franklin, J. C., Fox, K. R., Bentley, K. H., Kleiman, E. M., Chang, B. P., & Nock, M. K. (2016) · Psychological Medicine · doi:10.1017/s0033291715001804 · Cited by 1,346 · cited 1×
“However, some authors doubt that clinically meaningful suicide risk categories can be defined by either suicidal thoughts or behaviors [5,6] or a combination of multiple risk factors [7–10].”
Background
Research works printed but not linked: 1
- M Krupinski, 2000, Schizophrenic psychoses and suicide in the clinic. Risk factors, psychopharmacologic treatment, Nervenarzt, 71, 906
Cited by
Suicide Rates After Discharge From Psychiatric Facilities: A Systematic Review and Meta-analysis
Chung, D. T., Ryan, C. J., Hadzi-Pavlovic, D., Singh, S. P., Stanton, C., & Large, M. M. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.1044 · Cited by 651
Self-citationChronic pain and suicide risk: A comprehensive review
Racine, M. (2018) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2017.08.020 · Cited by 360
“, 2016) and a meta-analysis (Large et al., 2016) examining suicidality risk factors in psychiatric patients having harmed themselves, irrespective of the motive, (i.”
BackgroundChildhood trauma and suicide attempt: a meta-analysis of longitudinal studies from the last decade
Zatti, C., Rosa, V., Barros, A., Valdivia, L., Calegaro, V. C., Freitas, L. H., Ceresér, K. M. M., Rocha, N. S. D., Bastos, A. G., & Schuch, F. B. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.06.082 · Cited by 297
A Social-Ecological Framework of Theory, Assessment, and Prevention of Suicide
Cramer, R. J., & Kapusta, N. D. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01756 · Cited by 264
“Enhancing Suicide Risk Assessment Methods Despite a proliferation of suicide risk assessment tools (Lotito and Cook, 2015), recent evidence suggests limited ability to predict future suicidal behavior (Chan et al., 2016; Large et al., 2016).”
BackgroundKessler, R. C., Bossarte, R. M., Luedtke, A., Zaslavsky, A. M., & Zubizarreta, J. R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0531-0 · Cited by 234
McHugh, C. M., Corderoy, A., Ryan, C. J., Hickie, I. B., & Large, M. M. (2019) · BJPsych Open · doi:10.1192/bjo.2018.88 · Cited by 212
“…be compared with those of recent meta-analyses of the psychometric properties of suicide risk scales 91,92 and multivariate models of suicide risk, 93 which found similar odds of suicide, sensitivity, specificity and PPV among studies conducted in psychiatric settings as well as similar…”
Self-citationBerman, A. L. (2018) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12351 · Cited by 203
Chung, D., Hadzi-Pavlovic, D., Wang, M., Swaraj, S., Olfson, M., & Large, M. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-023883 · Cited by 191
Self-citationDe Berardis, D., Fornaro, M., Valchera, A., Cavuto, M., Perna, G., Di Nicola, M., Serafini, G., Carano, A., Pompili, M., Vellante, F., et al. (2018) · International Journal of Molecular Sciences · doi:10.3390/ijms19102888 · Cited by 174
“, displaying multiple suicide-related characteristics defining a high propensity to suicidal mortality) usually do not attempt suicide, whereas 50% of low-risk patients do, thus confirming the complexity of suicidal behavior processes [14].”
BackgroundDon't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research
Kivelä, L., van der Does, W. A. J., Riese, H., & Antypa, N. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.876595 · Cited by 163
Detecting Suicidal Ideation on Forums: Proof-of-Concept Study
Aladağ, A. E., Muderrisoglu, S., Akbas, N. B., Zahmacioglu, O., & Bingol, H. O. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9840 · Cited by 147
“It has been shown that half of all suicides are likely to occur in lower-risk groups [7].”
BackgroundHowarth, E. J., O'Connor, D. B., Panagioti, M., Hodkinson, A., Wilding, S., & Johnson, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.01.171 · Cited by 134
Can we usefully stratify patients according to suicide risk?
Large, M. M., Ryan, C. J., Carter, G., & Kapur, N. (2017) · BMJ · doi:10.1136/bmj.j4627 · Cited by 112
Self-citationAssessment of selective and universal screening for suicide risk in a pediatric emergency department
DeVylder, J. E., Ryan, T. C., Cwik, M., Wilson, M. E., Jay, S., Nestadt, P. S., Goldstein, M., & Wilcox, H. C. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.14070 · Cited by 109
The role of prediction in suicide prevention
Large, M. M. (2018) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2018.20.3/mlarge · Cited by 99
Self-citationModeling suicide in bipolar disorders
Malhi, G. S., Outhred, T., Das, P., Morris, G., Hamilton, A., & Mannie, Z. (2018) · Bipolar Disorders · doi:10.1111/bdi.12622 · Cited by 97
Woodford, R., Spittal, M. J., Milner, A., McGill, K., Kapur, N., Pirkis, J., Mitchell, A., & Carter, G. (2019) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12395 · Cited by 92
McHugh, C. M., Corderoy, A., Ryan, C. J., Hickie, I. B., & Large, M. M. (2019) · BJPsych Open · doi:10.1192/bjo.2019.15 · Cited by 89
Self-citationKusuma, K., Larsen, M. E., Quiroz, J. C., Gillies, M. B., Burnett, A., Qian, J., & Torok, M. H. (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.09.050 · Cited by 101
Risk assessment tools and data-driven approaches for predicting and preventing suicidal behavior
Velupillai, S., Hadlaczky, G., Baca-Garcia, E., Gorrell, G. M., Werbeloff, N., Nguyen, D., Patel, R., Leightley, D., Downs, J., Hotopf, M., et al. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00036 · Cited by 76
“No relationship between the precision of risk assessment tools and date of their publication has been found, suggesting no radical improvement over the past 50 years (10, 12).”
BackgroundLarge, M., Myles, N., Myles, H., Corderoy, A., Weiser, M., Davidson, M., & Ryan, C. J. (2018) · Psychological Medicine · doi:10.1017/s0033291717002537 · Cited by 76
“(Large et al. 2016).”
MethodSelf-citationMoore, F. R., Doughty, H., Neumann, T., McClelland, H., Allott, C., & O’Connor, R. C. (2022) · EClinicalMedicine · doi:10.1016/j.eclinm.2022.101307 · Cited by 77
Carter, G. L., & Spittal, M. J. (2018) · Crisis · doi:10.1027/0227-5910/a000558 · Cited by 83
Can machine-learning methods really help predict suicide?
McHugh, C. M., & Large, M. M. (2020) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000609 · Cited by 61
“However, a practical method for anticipating individual suicides or even usefully stratifying patients according to suicide risk has remained elusive [1,2].”
MethodSelf-citationLindh, Å. U., Wærn, M., Beckman, K., Renberg, E. S., Dahlin, M., & Runeson, B. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1883-8 · Cited by 72
Sanderson, M., Bulloch, A. G., Wang, J., Williams, K. G., Williamson, T. S., & Patten, S. B. (2020) · EClinicalMedicine · doi:10.1016/j.eclinm.2020.100281 · Cited by 68
Meta-analysis of the strength of exploratory suicide prediction models; from clinicians to computers
Corke, M., Mullin, K., Angel-Scott, H. N., Xia, S., & Large, M. M. B. (2021) · BJPsych Open · doi:10.1192/bjo.2020.162 · Cited by 66
Self-citationThe androgen model of suicide completion
Lenz, B., Röther, M., Bouna-Pyrrou, P., Mühle, C., Tektas, O. Y., & Kornhuber, J. (2018) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2018.06.003 · Cited by 62
“The authors conclude that suicide risk categorization based on multiple risk factors does not greatly exceed the association between single suicide risk factors and suicide (Large et al., 2016).”
BackgroundThe clinical application of suicide risk assessment: A theory‐driven approach
Mitchell, S. M., Brown, S. L., Roush, J. F., Bolaños, A. D., Littlefield, A. K., Marshall, A. J., Jahn, D. R., Morgan, R. D., & Cukrowicz, K. C. (2017) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2086 · Cited by 54
Suicide Prediction – A Shift in Paradigm Is Needed
Hawgood, J., & De Leo, D. (2016) · Crisis · doi:10.1027/0227-5910/a000440 · Cited by 48
Senior, M., Burghart, M., Yu, R., Kormilitzin, A., Liu, Q., Vaci, N., Nevado‐Holgado, A. J., Pandit, S. A., Zlodre, J., & Fazel, S. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00268 · Cited by 57
Large, M. M. B., Galletly, C. A., Myles, N., Ryan, C. J., & Myles, H. (2017) · BJPsych Bulletin · doi:10.1192/pb.bp.116.054940 · Cited by 60
Self-citationBellairs-Walsh, I., Perry, Y., Krysinska, K., Byrne, S. J., Boland, A., Michail, M., Lamblin, M., Gibson, K. L., Lin, A., Li, T. Y., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038855 · Cited by 46
Iorfino, F., Ho, N., Carpenter, J. S., Cross, S. P. M., Davenport, T. A., Hermens, D. F., Yee, H. F., Nichles, A., Zmicerevska, N., Guastella, A. J., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0243467 · Cited by 48
van Vuuren, C. L., van Mens, K., Beurs, D. P. D., Lokkerbol, J., van der Wal, M. F., Cuijpers, P. J., & Chinapaw, M. J. M. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.09.018 · Cited by 50
Baldaçara, L., Rocha, G. A., Leite, V. D. S., Porto, D. M., Grüdtner, R. R., Díaz, A. P., Meleiro, A. M. A. D. S., Corrêa, H., Tung, T. C., Quevedo, J., et al. (2021) · Brazilian Journal of Psychiatry · doi:10.1590/1516-4446-2020-0994 · Cited by 72
Murphy, A. L., Ataya, R., Himmelman, D., O’Reilly, C. L., Rosen, A., Salvador‐Carulla, L., Martin‐Misener, R., Burge, F., Kutcher, S., & Gardner, D. M. (2018) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-018-1553-7 · Cited by 44
“[38], approximately half of suicide deaths are likely to occur in lower risk groups with a positive predictive value suggesting that 95% of high-risk patients will not die by suicide.”
BackgroundImproving patient care after a suicide attempt
Shand, F., Vogl, L., & Robinson, J. (2018) · Australasian Psychiatry · doi:10.1177/1039856218758560 · Cited by 40
Brüdern, J., Glaesmer, H., Berger, T., & Spangenberg, L. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.899500 · Cited by 41
“Despite a considerable number of novel theories and models describing risk factors and underlying mechanisms leading to suicidal thoughts and behavior (STB), our ability to predict future suicidal behavior has not improved over the last five decades (2, 3).”
BackgroundLee, H., Cho, J. K., Park, J., Lee, H., Fond, G. B., Boyer, L., Kim, H. J., Park, S., Cho, W., Lee, H., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/51473 · Cited by 57
“No practical methods for anticipating individual suicides or stratifying individuals according to risk have been well established [16,17]; however, ML-based models is a potential method for more accurately identifying adolescents at risk of suicide.”
Development of a Suicide Prediction Model for the Elderly Using Health Screening Data
Cho, S., Geem, Z. W., & Na, K. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph181910150 · Cited by 40
“In another meta-analysis, the positive predictive values of the tool, which predicts suicide risk, were analyzed for psychiatric patients only [48].”
MethodSpittal, M. J., Guo, X. A., Kang, L., Kirtley, O. J., Clapperton, A., Hawton, K. E., Kapur, N., Pirkis, J., & Carter, G. L. (2025) · PLoS Medicine · doi:10.1371/journal.pmed.1004581 · Cited by 49
Mullinax, S., Chalmers, C. E., Brennan, J. J., Vilke, G. M., Nordstrom, K., & Wilson, M. P. (2018) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2018.01.087 · Cited by 39
Suicide risk assessment: trust an implicit probe or listen to the patient?
Harrison, D. P., Stritzke, W. G. K., Fay, N., & Hudaib, A.-R. (2018) · Psychological Assessment · doi:10.1037/pas0000577 · Cited by 31
“One relates to the common practice in clinical settings to use time-efficient assessment protocols, which may not always have optimal psychometric properties or have poor predictive validity (Chan et al., 2016; Franklin et al., 2017; Large et al., 2016).”
BackgroundShould compulsory admission to hospital be part of suicide prevention strategies?
Wang, D. W. L., & Colucci, E. (2017) · BJPsych Bulletin · doi:10.1192/pb.bp.116.055699 · Cited by 32
Toward Automatic Risk Assessment to Support Suicide Prevention
Adamou, M., Antoniou, G., Greasidou, E., Lagani, V., Charonyktakis, P., Tsamardinos, I., & Doyle, M. (2018) · Crisis · doi:10.1027/0227-5910/a000561 · Cited by 34
Wang, M., Swaraj, S., Chung, D., Stanton, C., Kapur, N., & Large, M. M. B. (2019) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13023 · Cited by 35
Self-citationAssociation between high sensitivity CRP and suicidal ideation in the Korean general population
Park, R. J., & Kim, Y. (2017) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2017.06.010 · Cited by 31
“In the light of the apparent weakness of clinical risk factors in suicide risk assessment (Chan et al., 2016; Large et al., 2016), biological risk factors have the potential importance.”
BackgroundSanderson, M., Bulloch, A. G., Wang, J., Williamson, T. S., & Patten, S. B. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.12.024 · Cited by 39
Icick, R., Melle, I. S., Étain, B., Ringen, P. A., Aminoff, S. R., Leboyer, M., Aas, M., Henry, C., Bjella, T. D., Andreassen, O. A., et al. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.05.075 · Cited by 33
Luo, M., Jiang, X., Wang, Y., Wang, Z., Shen, Q., Li, R., & Cai, Y. (2018) · BMC Public Health · doi:10.1186/s12889-018-5527-1 · Cited by 31
Hunt, T., Wilson, C. J., Caputi, P., Wilson, I. G., & Woodward, A. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15020235 · Cited by 29
“risk, and appears to reflect the current movement in training away from risk categorisation and towards individualized approaches of suicide intervention [66,67].”
BackgroundMillner, A. J., Coppersmith, D. D. L., Teachman, B. A., & Nock, M. K. (2018) · Psychological Assessment · doi:10.1037/pas0000580 · Cited by 33
“One of the most important issues in enhancing suicide prevention efforts is improving suicide risk assessment in clinical settings (Large et al., 2016).”
PROTECT: Relational safety based suicide prevention training frameworks
Ray, M. K., Wyder, M., Crompton, D., Kousoulis, A. A., Arensman, E., Hafizi, S., Bortel, T. V. V., & Lombardo, C. (2019) · International Journal of Mental Health Nursing · doi:10.1111/inm.12685 · Cited by 30
The differential associations of positive and negative symptoms with suicidality
Grover, L. E., Jones, R., Bass, N. J., & McQuillin, A. (2022) · Schizophrenia Research · doi:10.1016/j.schres.2022.07.016 · Cited by 37
Ethical Concerns in Suicide Research: Results of an International Researcher Survey
Andriessen, K., Reifels, L., Krysinska, K. E., Robinson, J., Dempster, G., & Pirkis, J. (2019) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/1556264619859734 · Cited by 32
“For example, while it is commendable that Principles 17 and 18 stipulate the need for adequate risk management, the low base rate of suicidal behavior and the difficulty of predicting its occurrence in individuals (Large et al., 2016), may fuel discussions between researchers and research ethics committees about appro…”
BackgroundBelzeaux-R, R., Fiori, L. M., López, J. P., Boucékine, M., Boyer, L., Blier, P., Farzan, F., Frey, B. N., Giacobbe, P., Lam, R. W. M., et al. (2019) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.18m12556 · Cited by 29
Tian, S., Zhu, R., Chen, Z., Wang, H., Chattun, M. R., Zhang, S., Shao, J., Wang, X., Yao, Z., & Lü, Q. (2023) · Human Brain Mapping · doi:10.1002/hbm.26243 · Cited by 30
The Neuroscience of Suicidal Behavior
van Heeringen, K. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205 · Cited by 45
Dealing with Ethical Concerns in Suicide Research: A Survey of Australian Researchers
Andriessen, K., Reifels, L., Krysinska, K. E., Robinson, J., Dempster, G., & Pirkis, J. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16071094 · Cited by 30
“However, the low base rate of suicide and the impossibility of predicting the occurrence of suicide in individuals are major challenges in conducting suicide prevention research [6].”
BackgroundSanderson, M., Bulloch, A. G. M., Wang, J., Williamson, T. S., & Patten, S. B. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.07.063 · Cited by 27
Tools to Detect Risk of Death by Suicide: A Systematic Review and Meta-Analysis
Riblet, N. B. V., Matsunaga, S., Lee, Y., Young‐Xu, Y., Shiner, B. R., Schnurr, P. P., Levis, M., & Watts, B. V. (2022) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.21r14385 · Cited by 26
Barros, J., Morales, S., García, A., Echávarri, O., Fischman, R., Szmulewicz, M., Moya, C., Núñez, C., & Tomicic, A. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02535-x · Cited by 27
Why Suicide Risk Assessment Still Matters
Wortzel, H. S., Nazem, S., Bahraini, N. H., & Matarazzo, B. B. (2017) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000263 · Cited by 22
Bond, K. S., Cottrill, F. A., Mackinnon, A. J., Morgan, A. J., Kelly, C., Armstrong, G., Kitchener, B. A., Reavley, N. J., & Jorm, A. F. (2021) · International Journal of Mental Health Systems · doi:10.1186/s13033-021-00459-x · Cited by 23
Michel, K. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18105301 · Cited by 26
“Suicide risk scales with multiple risk factors do not add to the statistical strength [30].”
BackgroundBerman, A. L., & Carter, G. (2020) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12610 · Cited by 19
Bellairs-Walsh, I., Byrne, S. J., Bendall, S., Perry, Y., Krysinska, K. E., Lin, A. P., Michail, M., Lamblin, M., Li, T. Y., Hetrick, S. E., et al. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182412926 · Cited by 21
Using the stress–vulnerability model to better understand suicide in prison populations
Scott, R. J., Aboud, A., & Smith, T. (2022) · Psychiatry Psychology and Law · doi:10.1080/13218719.2021.2013340 · Cited by 23
“A later meta-analysis of longitudinal studies found that over an average follow-up period of 5 years, the proportion of suicides among the high-risk patients was 5.5%, and among the low risk patients the proportion was 0.9% (Large et al., 2016).”
InfluentialTeismann (2019) · doi:10.1159/000493887 · Cited by 18
Cohen, A. S. (2019) · Psychological Assessment · doi:10.1037/pas0000694 · Cited by 18
O’Shea, B. A., Glenn, J. J., Millner, A. J., Teachman, B. A., & Nock, M. K. (2020) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12652 · Cited by 23
“Despite the high prevalence of suicide, suitable tools to accurately measure and predict this behavior are still in their infancy (Large et al., 2016).”
BackgroundMethodOn the Randomness of Suicide: An Evolutionary, Clinical Call to Transcend Suicide Risk Assessment
Soper, C. A., Ocejo, P. M., & Large, M. M. (2022) · Evolutionary Psychiatry · doi:10.1017/9781009030564.011 · Cited by 16
Self-citationFortune, S., & Hetrick, S. (2022) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/00048674221107316 · Cited by 16
“…there has been no appreciable advance in our ability to predict who will go on to engage in self-harm or suicide (Carter et al., 2017; Chan et al., 2016; Franklin et al., 2017; Large et al., 2016; Quinlivan et al., 2016; Ribeiro et al., 2016; Runeson et al., 2017; Woodford et al., 2019).”
BackgroundA Computational Model of Hopelessness and Active-Escape Bias in Suicidality
Karvelis, P., & Diaconescu, A. O. (2022) · Computational Psychiatry · doi:10.5334/cpsy.80 · Cited by 19
Park, C. H. K., Lee, J. W., Lee, S.-Y., Moon, J., Jeon, D.-W., Shim, S.-H., Cho, S., Kim, S. G., Lee, J., Paik, J., et al. (2018) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2018.11.003 · Cited by 19
Suicide Evaluation in the Pediatric Emergency Setting
Ambrose, A. J. H., & Prager, L. M. (2018) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2018.03.003 · Cited by 15
Adaptation to the Suicidal Niche
Soper, C. A. (2019) · Evolutionary Psychological Science · doi:10.1007/s40806-019-00202-3 · Cited by 20
Suicide Risk Assessments: A Scientific and Ethical Critique
Smith, M. (2022) · Journal of Bioethical Inquiry · doi:10.1007/s11673-022-10189-5 · Cited by 21
“Two of the meta-analyses found that suicide risk assessments had a positive predictive value (PPV) 3 of five per cent in the long term (Carter et al. 2017; Large et al. 2016).”
BackgroundJi, Y., Liu, X., Zheng, S., Zhong, Q., Zheng, R., Huang, J., & Yin, H. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.09.014 · Cited by 16
Hasking, P. A., Robinson, K., McEvoy, P. M., Melvin, G. A., Bruffaerts, R., Boyes, M. E., Auerbach, R. P., Hendrie, D. V., Nock, M. K., Preece, D. A., et al. (2023) · Psychological Medicine · doi:10.1017/s0033291723002714 · Cited by 17
“…and psychiatric history (e.g. Manchester Self-Harm Rule, Cooper, Kapur, Dunning, Guthrie, and Appleby, 2006; ReAct Self-Harm Rule, Steeg et al., 2012) are generally poor (< 5% accurate) at meaningfully predicting future risk (Carter et al., 2017; Large et al., 2016; Quinlivan et al., 2016).”
López-Moríñigo, J.-D., Fernandes, A. C., Shetty, H., Ayesa‐Arriola, R., Bari, A., Stewart, R. J., & Dutta, R. (2018) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-018-1536-8 · Cited by 14
“Consistent with this, recent metaanalyses have concluded that risk scales have a limited role in predicting suicidal behaviour [13–15], although there are important issues of between-study heterogeneity [13].”
ResultThe Paradox of Suicide Prevention
Turner, K. A., Pisani, A. R., Svetičič, J., O’Connor, N., Woerwag‐Mehta, S., Burke, K., & Stapelberg, N. J. C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192214983 · Cited by 18
“Despite longstanding recognition of the inherent limitations, public mental health services are engineered and resourced around the assumption that ‘high risk’ consumers are those who will make up most of those who subsequently die by suicide, and that the primary responsibility lies in successfully identifying people…”
BackgroundForecast models for suicide: Time-series analysis with data from Italy
Preti, A., & Lentini, G. (2016) · Chronobiology International · doi:10.1080/07420528.2016.1211669 · Cited by 15
“People who are classified at high risk of suicide are effectively more likely to die by suicide (Large et al. 2016).”
Therapists’ perspectives on suicide: A conceptual model of connectedness
Aherne, C., Coughlan, B., & Surgenor, P. W. G. (2017) · Psychotherapy Research · doi:10.1080/10503307.2017.1359428 · Cited by 18
“Recent research indicates that risk assessments are not necessarily effective in predicting suicide outcomes (Chan et al., 2016; Large et al., 2016).”
BackgroundAbarca, C., Gheza, C., Coda, C., & Elicer, B. (2018) · Medwave · doi:10.5867/medwave.2018.05.7246 · Cited by 18
Living with suicidal thoughts: A scoping review
Søndergaard, R., Buus, N., Berring, L. L., Andersen, C. B., Grundahl, M., Stjernegaard, K., & Hybholt, L. (2022) · Scandinavian Journal of Caring Sciences · doi:10.1111/scs.13137 · Cited by 19
Musgrave, G., & Lamis, D. A. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1507772 · Cited by 15
Psychiatric Risk Assessment from the Clinician’s Perspective: Lessons for the Future
Cohen, A. S., Fedechko, T. L., Schwartz, E. K., Le, T. P., Foltz, P. W., Bernstein, J., Cheng, J., Rosenfeld, E. P., & Elvevåg, B. (2019) · Community Mental Health Journal · doi:10.1007/s10597-019-00411-x · Cited by 12
Lamontagne, S. J., Zabala, P. K., Zarate, C. A., & Ballard, E. D. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105361 · Cited by 12
Suicide Prediction With Machine Learning
Rakesh, G. (2017) · American Journal of Psychiatry Residents Journal · doi:10.1176/appi.ajp-rj.2017.120105 · Cited by 12
Leveraging data science to enhance suicide prevention research: a literature review
Wulz, A. R., Law, R., Wang, J., & Wolkin, A. F. (2021) · Injury Prevention · doi:10.1136/injuryprev-2021-044322 · Cited by 13
“52 Clinical applications of classification based on predictive risk assessments can impact resource allocation or unequal access to treatment.”
BackgroundOpioid use as a proximal risk factor for suicidal behavior in young adults
Marengo, L., Douaihy, A. B., Zhong, Y., Krancevich, K., Brummit, B., Sakolsky, D. J., Deal, M., Zelazny, J. M., Goodfriend, E., Saul, M. I., et al. (2021) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12806 · Cited by 13
Clinical Characteristics of Pesticide Self-Harm as Associated with Suicide Attempt Repetition Status
Huang, W.-C., Yen, T., Lin, L., Lin, C., Juang, Y., Wang, B., & Lee, S. (2020) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s258475 · Cited by 11
Browne, C. C., Chemjong, P., Korobanova, D., Jang, S., Yee, N., Marr, C., Rae, N., Ma, T., Spencer, S., & Dean, K. (2022) · International Journal of Prisoner Health · doi:10.1108/ijph-12-2021-0115 · Cited by 10
Sjöstrand, M., & Eyal, N. (2023) · The British Journal of Psychiatry · doi:10.1192/bjp.2023.3 · Cited by 17
“10,11 Thus, even if directed at comparatively high-risk patients, preventive efforts need to target many, most of whom would not die by suicide.”
Carson, N. J., Yang, X., Mullin, B. O., Stettenbauer, E. G., Waddington, M., Zhang, A., Williams, P., Perez, G. E. R., & Cook, B. L. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.12.059 · Cited by 12
Brüdern, J., Spangenberg, L., Stein, M., Forkmann, T., Schreiber, D., Stengler, K., Gold, H., & Glaesmer, H. (2024) · Behaviour Research and Therapy · doi:10.1016/j.brat.2024.104601 · Cited by 14
The Potential Perils of a Suicide-specific Diagnosis
Wortzel, H. S., Nazem, S., Bahraini, N. H., Matarazzo, B. B., & Silverman, M. M. (2018) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000333 · Cited by 11
Fan, P., Guo, X., Qi, X., Matharu, M., Patel, R. J., Sakolsky, D. J., Kirisci, L., Silverstein, J. C., & Wang, L. (2020) · Brain Sciences · doi:10.3390/brainsci10110784 · Cited by 14
Metadata
- Authors
- Large, M., Kaneson, M., Myles, N., Myles, H., Gunaratne, P., & Ryan, C.
- Affiliations
- UNSW Sydney (AU)
- Queen Elizabeth Hospital (AU)
- The University of Adelaide (AU)
- Prince of Wales Hospital (AU)
- The University of Sydney (AU)
- Corresponding author
- Large, Matthew
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-06-10
- Volume
- 11
- Issue
- 6
- Pages
- e0156322
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4902221
- OpenAlex
- W2410895653
- Cited by
- 248
- References
- 71
- Citations by year
- 2026: 19 · 2025: 19 · 2024: 20 · 2023: 24 · 2022: 24 · 2021: 19 · 2020: 28 · 2019: 24 · 2018: 46 · 2017: 23 · 2016: 2
- FWCI
- 4.69
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Social Sciences › Psychology › Clinical Psychology › Psychopathy, Forensic Psychiatry, Sexual Offending
- Keywords
- suicide risk assessment, psychiatric patients, suicide mortality, high-risk patients, sensitivity and specificity, publication bias, study heterogeneity, longitudinal cohort
- MeSH terms
- Suicide Prevention, Mental Disorders, Humans, Longitudinal Studies, Risk Factors, Suicide, Suicide, Attempted, Time Factors, Reproducibility of Results, Cohort Studies, Risk Assessment, Suicidal Ideation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.