Machine Learning for Suicide Research–Can It Improve Risk Factor Identification?
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Machine learning is on the rise. According to Scopus (www2.scopus.com), the number of publications in medicine with machine learning in the title, abstract, or as a keyword during 2016 to 2018 increased from 1658 to 3904. In psychiatry, applications of machine learning are proposed to improve the accuracy of diagnosis and prognosis and determine treatment choice. At the same time, much of this research has given insufficient attention to high-quality methods, clinical applications, and ethical aspects. This is compounded by poor reporting of performative measures and misleading claims about the high accuracy of such approaches. In this issue of JAMA Psychiatry, the article by Gradus and colleagues 1 raises important questions about the place of machine learning in research and practice. Machine learning is useful when analyzing several predictors, particularly if there are nonlinear observations and interaction terms that are difficult to theoretically conceptualize and practically model. A strength of the study by Gradus et al1 is that it uses a robust data set of patient-level predictors from Danish national health care registers without imposing or relying on theoretical models. The authors tested 1365 parameters based on 334 individual predictors, which were mostly associated with somatic and psychiatric diagnoses and by temporal proximity with the suicide event by being categorized into 4 points of 6, 12, 24, and 48 months. Another strength is the outcome of death by suicide. As the study illuminates risk factors rather than prediction, this is important, as risk factors for suicide are different from self-harm and suicidal ideation. For example, male sex is more highly associated with
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Suicide and suicidal behaviour
Turecki, G., & Brent, D. A. (2016) · The Lancet · doi:10.1016/s0140-6736(15)00234-2 · Cited by 2,338
Christodoulou, E., Ma, J., Collins, G. S., Steyerberg, E. W., Verbakel, J. Y., & Van Calster, B. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.02.004 · Cited by 2,119 · cited 1×
“…of 71 studies that compared machine learning prediction models with simpler regression ones found no improvement in the machine learning ones, 5 suggesting that simpler models would be preferred by clinical services that would struggle to implement complex algorithms into computer systems…”
BackgroundA calibration hierarchy for risk models was defined: from utopia to empirical data
Van Calster, B., Nieboer, D., Vergouwe, Y., De Cock, B., Pencina, M. J., & Steyerberg, E. W. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.12.005 · Cited by 910
Reporting of artificial intelligence prediction models
Collins, G. S., & Moons, K. G. M. (2019) · The Lancet · doi:10.1016/s0140-6736(19)30037-6 · Cited by 701
Kessler, R. C., Warner, C. H., Ivany, C., Petukhova, M. V., Rose, S., Bromet, E. J., Brown, M., Cai, T., Colpe, L. J., Cox, K. L., et al. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1754 · Cited by 447 · cited 1×
“Going forward, the development of prediction models in specific, high-risk groups (eg, US Army soldiers after psychiatric treatment 10 ) or those with certain psychiatric diagnoses (eg, schizophrenia spectrum disorders 11 ) will likely have benefits of higher accuracy, more acceptability to…”
BackgroundChan, S. K. W., Chan, S. W. Y., Pang, H. H., Yan, K. K., Hui, C. L. M., Chang, W. C., Lee, E. H. M., & Chen, E. Y. H. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.0185 · Cited by 95
How accurate are suicide risk prediction models? asking the right questions for clinical practice.
Whiting, D., & Fazel, S. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300102 · Cited by 83
Self-citation
Cited by
Which PHQ-9 Items Can Effectively Screen for Suicide? Machine Learning Approaches
Kim, S., Lee, H.-K., & Lee, K. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18073339 · Cited by 99
“Machine learning algorithms have been proposed to improve diagnostic and prognostic accuracy and determine treatment options [27].”
BackgroundSuicide risk assessment in UK mental health services: a national mixed-methods study
Graney, J., Hunt, I. M., Quinlivan, L., Rodway, C., Turnbull, P., Gianatsi, M., Appleby, L., & Kapur, N. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30381-3 · Cited by 71
Vidal-Ribas, P., Janiri, D., Doucet, G. E., Pornpattananangkul, N., Nielson, D. M., Frangou, S., & Stringaris, A. (2021) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20020120 · Cited by 45
Metadata
- Authors
- Fazel, S., & O’Reilly, L.
- Venue
- JAMA Psychiatry
- Publisher
- American Medical Association (AMA)
- Published
- 2020-01-01
- Volume
- 77
- Issue
- 1
- Pages
- 13
- ISSN
- 2168-622X (ISSN-L)
- OpenAlex
- W2981722189
- Cited by
- 35
- References
- 7
- FWCI
- 6.27
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.