The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Risk stratification using data from electronic medical records better predicts suicide risks than clinician assessments
Open accessAbstract
BACKGROUND: To date, our ability to accurately identify patients at high risk from suicidal behaviour, and thus to target interventions, has been fairly limited. This study examined a large pool of factors that are potentially associated with suicide risk from the comprehensive electronic medical record (EMR) and to derive a predictive model for 1-6 month risk. METHODS: 7,399 patients undergoing suicide risk assessment were followed up for 180 days. The dataset was divided into a derivation and validation cohorts of 4,911 and 2,488 respectively. Clinicians used an 18-point checklist of known risk factors to divide patients into low, medium, or high risk. Their predictive ability was compared with a risk stratification model derived from the EMR data. The model was based on the continuation-ratio ordinal regression method coupled with lasso (which stands for least absolute shrinkage and selection operator). RESULTS: In the year prior to suicide assessment, 66.8% of patients attended the emergency department (ED) and 41.8% had at least one hospital admission. Administrative and demographic data, along with information on prior self-harm episodes, as well as mental and physical health diagnoses were predictive of high-risk suicidal behaviour. Clinicians using the 18-point checklist were relatively poor in predicting patients at high-risk in 3 months (AUC 0.58, 95% CIs: 0.50 - 0.66). The model derived EMR was superior (AUC 0.79, 95% CIs: 0.72 - 0.84). At specificity of 0.72 (95% CIs: 0.70-0.73) the EMR model had sensitivity of 0.70 (95% CIs: 0.56-0.83). CONCLUSION: Predictive models applied to data from the EMR could improve risk stratification of patients presenting with potential suicidal behaviour. The predictive factors include known risks for suicide, but also other information relating to general health and health service utilisation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Numerous recent studies predicted suicide death or attempted suicide in high-risk patient populations from electronic health record data using machine learning (ML) methods.”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [69]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Comorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921
Regression Shrinkage and Selection via The Lasso: A Retrospective
Tibshirani, R. J. (2011) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2011.00771.x · Cited by 3,601
Nock, M. K., Green, J. G., Hwang, I., McLaughlin, K. A., Sampson, N. A., Zaslavsky, A. M., & Kessler, R. C. (2013) · JAMA Psychiatry · doi:10.1001/2013.jamapsychiatry.55 · Cited by 1,666
Contact With Mental Health and Primary Care Providers Before Suicide: A Review of the Evidence
Luoma, J. B., Martin, C. E., & Pearson, J. L. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.6.909 · Cited by 1,576
Risk factors for suicide in individuals with depression: a systematic review
Hawton, K., Casañas i Comabella, C., Haw, C., & Saunders, K. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.01.004 · Cited by 1,469
Borges, G., Nock, M. K., Haro Abad, J. M., Hwang, I., Sampson, N. A., Alonso, J., Andrade, L. H., Angermeyer, M. C., Beautrais, A., Bromet, E., et al. (2010) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.08m04967blu · Cited by 796
Regression models for ordinal responses: a review of methods and applications
Ananth, C. V. (1997) · International Journal of Epidemiology · doi:10.1093/ije/26.6.1323 · Cited by 594
Trends in US emergency department visits for attempted suicide and self-inflicted injury, 1993-2008.
Ting, S. A., Sullivan, A. F., Boudreaux, E. D., Miller, I., & Camargo, C. A. (2012) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2012.03.020 · Cited by 252
Suicidal behavior in bipolar disorder: Epidemiology, characteristics and major risk factors
Gonda, X., Pompili, M., Serafini, G., Montebovi, F., Campi, S., Döme, P., Duleba, T., Girardi, P., & Rihmer, Z. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.04.041 · Cited by 219
Cited by
Sorted by citations
Luo, W., Phung, D., Tran, T., Gupta, S., Rana, S., Karmakar, C., Shilton, A., Yearwood, J., Dimitrova, N., Ho, T. B., et al. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5870 · Cited by 988
Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw042 · Cited by 936
Machine Learning Approaches for Clinical Psychology and Psychiatry
Dwyer, D. B., Falkai, P., & Koutsouleris, N. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-045037 · Cited by 966
Prediction Models for Suicide Attempts and Deaths: A Systematic Review and Simulation
Belsher, B. E., Smolenski, D. J., Pruitt, L. D., Bush, N. E., Beech, E. H., Workman, D. E., Morgan, R. L., Evatt, D. P., Tucker, J., & Skopp, N. A. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0174 · Cited by 540
Lee, E., Torous, J. B., Choudhury, M. D., Depp, C. A., Graham, S. A., Kim, H., Paulus, M. P., Krystal, J. H., & Jeste, D. V. (2021) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2021.02.001 · Cited by 523
Metadata
- Authors
- Tran, T., Luo, W., Phung, D., Harvey, R., Berk, M., Kennedy, R. L., & Venkatesh, S.
- Affiliations
- Deakin University (AU)
- Barwon Health (AU)
- Corresponding author
- Venkatesh, Svetha
- Venue
- BMC Psychiatry
- Published
- 2014-03-14
- Volume
- 14
- Issue
- 1
- Pages
- 76-76
- ISSN
- 1471-244X (ISSN-L)
- PMC
- PMC3984680
- OpenAlex
- W2123409929
- Cited by
- 150
- References
- 41
- Citations by year
- 2026: 5 · 2025: 9 · 2024: 12 · 2023: 9 · 2022: 8 · 2021: 32 · 2020: 17 · 2019: 12 · 2018: 14 · 2017: 14 · 2016: 10 · 2015: 7 · 2014: 1
- FWCI
- 12.62
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Psychiatry (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- eSpace (Curtin University) (submittedVersion)
- eSpace (Curtin University) (submittedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Keywords
- suicide risk, risk stratification, electronic health records, clinical risk assessment, prediction model, emergency department visits, hospitalization, health care utilization, LASSO
- MeSH terms
- Suicide Prevention, Adolescent, Adult, Aged, Australia, Emergency Service, Hospital, Female, Humans, Male, Medical History Taking, Middle Aged, Prognosis, Retrospective Studies, Risk Factors, Suicide, Models, Statistical, Risk Assessment, Young Adult, Electronic Health Records, Suicidal Ideation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
