Which are the most useful scales for predicting repeat self-harm? A systematic review evaluating risk scales using measures of diagnostic accuracy
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Objectives: The aims of this review were to calculate the diagnostic accuracy statistics of risk scales following self-harm and consider which might be the most useful scales in clinical practice. Design: Systematic review. Methods: We based our search terms on those used in the systematic reviews carried out for the National Institute for Health and Care Excellence self-harm guidelines (2012) and evidence update (2013), and updated the searches through to February 2015 (CINAHL, EMBASE, MEDLINE, and PsychINFO). Methodological quality was assessed and three reviewers extracted data independently. We limited our analysis to cohort studies in adults using the outcome of repeat self-harm or attempted suicide. We calculated diagnostic accuracy statistics including measures of global accuracy. Statistical pooling was not possible due to heterogeneity. Results: The eight papers included in the final analysis varied widely according to methodological quality and the content of scales employed. Overall, sensitivity of scales ranged from 6% (95% CI 5% to 6%) to 97% (CI 95% 94% to 98%). The positive predictive value (PPV) ranged from 5% (95% CI 3% to 9%) to 84% (95% CI 80% to 87%). The diagnostic OR ranged from 1.01 (95% CI 0.434 to 2.5) to 16.3 (95%CI 12.5 to 21.4). Scales with high sensitivity tended to have low PPVs. Conclusions: It is difficult to be certain which, if any, are the most useful scales for self-harm risk assessment. No scales perform sufficiently well so as to be recommended for routine clinical use. Further robust prospective studies are warranted to evaluate risk scales following an episode of self-harm. Diagnostic accuracy statistics should be considered in relation to the specific service needs, and scales should only be used as an adjunct to assessment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Whiting, P., Rutjes, A. W., Reitsma, J. B., Bossuyt, P. M., & Kleijnen, J. (2003) · BMC Medical Research Methodology · doi:10.1186/1471-2288-3-25 · Cited by 3,592
Skinner, H. A. (1982) · Addictive Behaviors · doi:10.1016/0306-4603(82)90005-3 · Cited by 3,134
The diagnostic odds ratio: a single indicator of test performance
Glas, A. S., Lijmer, J. G., Prins, M. H., Bonsel, G. J., & Bossuyt, P. M. M. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00177-x · Cited by 2,261
Empirical evidence of design-related bias in studies of diagnostic tests.
Lijmer, J. G. (1999) · JAMA · doi:10.1001/jama.282.11.1061 · Cited by 1,861 · cited 1×
“Inclusion and exclusion criteria Consistent with the NICE self-harm evidence update,(11) studies were included if they used a cohort design—the optimal design for evaluating the diagnostic accuracy of scales as case–control studies can overestimate diagnostic accuracy.(12) Although suicide is an extremely important ou…”
MethodFatal and non-fatal repetition of self-harm: Systematic review
Owens, D., Horrocks, J., & House, A. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.181.3.193 · Cited by 1,241
Likelihood ratios with confidence: Sample size estimation for diagnostic test studies
Simel, D. L., Samsa, G. P., & Matchar, D. B. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90128-v · Cited by 932 · cited 2×
“Higher values indicate greater test discriminatory power.18 20 CIs for sensitivity and specificity were calculated using the Wilson score method without correction.22 CIs for positive and negative likelihood ratios were produced using the method of Simel et al.23 The CI for the diagnostic OR was produced using the met…”
MethodSuicide After Deliberate Self-Harm: A 4-Year Cohort Study
Cooper, J., Kapur, N., Webb, R., Lawlor, M., Guthrie, E., Mackway-Jones, K., & Appleby, L. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.2.297 · Cited by 690
Self-citationCarroll, R., Metcalfe, C., & Gunnell, D. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089944 · Cited by 586
Self-citationThe validity and utility of risk assessment for inpatient suicide
Large, M., Ryan, C., & Nielssen, O. (2011) · Australasian Psychiatry · doi:10.3109/10398562.2011.610505 · Cited by 73
Cited by
Gillies, D., Christou, M. A., Dixon, A. C., Featherston, O. J., Rapti, I., Garcia-Anguita, A., Villasis-Keever, M., Reebye, P., Christou, E., Al Kabir, N., et al. (2018) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2018.06.018 · Cited by 557
Carter, G., Milner, A., McGill, K., Pirkis, J., Kapur, N., & Spittal, M. J. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.182717 · Cited by 361
Self-citationKnipe, D., Padmanathan, P., Newton-Howes, G., Chan, L. F., & Kapur, N. (2022) · The Lancet · doi:10.1016/s0140-6736(22)00173-8 · Cited by 331
Self-citationKessler, R. C., Bossarte, R. M., Luedtke, A., Zaslavsky, A. M., & Zubizarreta, J. R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0531-0 · Cited by 234
Predictive accuracy of risk scales following self-harm: multicentre, prospective cohort study
Quinlivan, L., Cooper, J., Meehan, D., Longson, D., Potokar, J., Hulme, T., Marsden, J., Brand, F., Lange, K., Riseborough, E., et al. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.189993 · Cited by 130
Self-citation
Metadata
- Authors
- Quinlivan, L., Cooper, J., Davies, L., Hawton, K., Gunnell, D., & Kapur, N.
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2016-02
- Volume
- 6
- Issue
- 2
- Pages
- e009297
- ISSN
- 2044-6055 (ISSN-L)
- OpenAlex
- W2269496654
- Cited by
- 89
- References
- 9
- FWCI
- 1.89
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Which are the most useful scales for predicting repeat self-harm? A systematic review evaluating risk scales using measures of diagnostic accuracy. https://app.cochat.ai/papers/10.1136/bmjopen-2015-009297
- The paper
- Quinlivan, L., Cooper, J., Davies, L., Hawton, K., Gunnell, D., & Kapur, N. (2016). Which are the most useful scales for predicting repeat self-harm? A systematic review evaluating risk scales using measures of diagnostic accuracy. BMJ Open. https://doi.org/10.1136/bmjopen-2015-009297
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.