The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Predictive Modeling and Concentration of the Risk of Suicide: Implications for Preventive Interventions in the US Department of Veterans Affairs
Open accessAbstract
Objectives. The Veterans Health Administration (VHA) evaluated the use of predictive modeling to identify patients at risk for suicide and to supplement ongoing care with risk-stratified interventions. Methods. Suicide data came from the National Death Index. Predictors were measures from VHA clinical records incorporating patient-months from October 1, 2008, to September 30, 2011, for all suicide decedents and 1% of living patients, divided randomly into development and validation samples. We used data on all patients alive on September 30, 2010, to evaluate predictions of suicide risk over 1 year. Results. Modeling demonstrated that suicide rates were 82 and 60 times greater than the rate in the overall sample in the highest 0.01% stratum for calculated risk for the development and validation samples, respectively; 39 and 30 times greater in the highest 0.10%; 14 and 12 times greater in the highest 1.00%; and 6.3 and 5.7 times greater in the highest 5.00%. Conclusions. Predictive modeling can identify high-risk patients who were not identified on clinical grounds. VHA is developing modeling to enhance clinical care and to guide the delivery of preventive interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Suicide prediction models based on computational analyses of electronic health records may help identify individuals with the highest risk for suicide at time of discharge, the subgroup that would potentially benefit most from intensive treatment and follow-up (237, 238).”
From A brain-centric model of suicidal behavior (2020) · cites this paper as [238]
In the citing paper
“patients with high suicide risk also have significantly elevated risk of other negative outcomes, such as other types of death by external cause, suicide attempts, severe and permanently disabling injuries, and repeat psychiatric hospitalizations (20, 88).”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
In the citing paper
“These veterans were found to account for approximately 2% of all suicide deaths in VHA.”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
In the citing paper
“The Reach Vet model attempted to isolate the 0.1% of all VHA users with highest suicide risk.”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
In the citing paper
“the VHA Reach Vet model (88), which is used to target preventive interventions to the roughly 35,000 VHA patients each year considered to be at highest suicide risk, is based on a 30-day time horizon, which we showed clearly to be suboptimal in the current application to inpatients.”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861
Suicide Prevention Strategies: A Systematic Review
Mann, J. J., Apter, A., Bertolote, J., Beautrais, A., Currier, D., Haas, A., Hegerl, U., Lonnqvist, J., Malone, K., Marusic, A., et al. (2005) · JAMA · doi:10.1001/jama.294.16.2064 · Cited by 2,852
National Strategy for Suicide Prevention: Goals and Objectives for Action
Service., U. S. P. H. (2001) · PsycEXTRA Dataset · doi:10.1037/e415652005-001 · Cited by 458
Kessler, R. C., Warner, C. H., Ivany, C., Petukhova, M. V., Rose, S., Bromet, E. J., Brown, M., Cai, T., Colpe, L. J., Cox, K. L., et al. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1754 · Cited by 447
Self-citationImproving the Short-Term Prediction of Suicidal Behavior
Glenn, C. R., & Nock, M. K. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.004 · Cited by 328
Psychiatric Diagnoses and Risk of Suicide in Veterans
Ilgen, M. A., Bohnert, A. S. B., Ignacio, R. V., McCarthy, J. F., Valenstein, M. M., Kim, H. M., & Blow, F. C. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.129 · Cited by 311
Self-citationMortality in the United States, 2023
Murphy, S. L., Kochanek, K. D., Xu, J., & Arias, E. (2024) · doi:10.15620/cdc/170564 · Cited by 282
Noncancer pain conditions and risk of suicide
Ilgen, M. A., Kleinberg, F., Ignacio, R. V., Bohnert, A. S. B., Valenstein, M., McCarthy, J. F., Blow, F. C., & Katz, I. R. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.908 · Cited by 238
Self-citationSuicide Mortality Among Patients Receiving Care in the Veterans Health Administration Health System
McCarthy, J. F., Valenstein, M. M., Kim, H., Ilgen, M. A., Zivin, K., & Blow, F. C. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwp010 · Cited by 220
Self-citationSuicide and Traumatic Brain Injury Among Individuals Seeking Veterans Health Administration Services
Brenner, L. A., Ignacio, R. V., & Blow, F. C. (2011) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0b013e31821fdb6e · Cited by 189
Standardized Evaluation in Clinical Practice
PRIDMORE, S. A. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.7.1319-a · Cited by 166
Suicide among adults aged 35-64 years--United States, 1999-2010.
Sullivan, E., Annest, J. L., Luo, F., Simon, T. R., & Dahlberg, L. L. (2013) · PubMed Central · Cited by 155
Comorbid anxiety as a suicide risk factor among depressed veterans
Pfeiffer, P. N., Ganoczy, D., Ilgen, M., Zivin, K., & Valenstein, M. (2009) · Depression and Anxiety · doi:10.1002/da.20583 · Cited by 153
Tran, T., Luo, W., Phung, D., Harvey, R., Berk, M., Kennedy, R. L., & Venkatesh, S. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-76 · Cited by 150
Trust is the basis for effective suicide risk screening and assessment in veterans
Ganzini, L., Denneson, L. M., Press, N., Bair, M. J., Helmer, D. A., Poat, J., & Dobscha, S. K. (2013) · Journal of General Internal Medicine · doi:10.1007/s11606-013-2412-6 · Cited by 149
Valenstein, M. M., Kim, H. M., Ganoczy, D. A., McCarthy, J. F., Zivin, K., Austin, K., Hoggatt, K. J., Eisenberg, D., Piette, J. D., Blow, F. C., et al. (2008) · Journal of Affective Disorders · doi:10.1016/j.jad.2008.08.020 · Cited by 142
Self-citationMccarthy, J., Blow, F., Ignacio, R., Ilgen, M., Austin, K. L., & Valenstein, M. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300463 · Cited by 136
Self-citationA Clinical Tool for Assessing Risk After Self-Harm
Cooper, J., Kapur, N., Dunning, J., Guthrie, E., Appleby, L., & Mackway-Jones, K. C. (2006) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2006.07.944 · Cited by 114
Suicide among adults aged 35-64 years--United States, 1999-2010.
(2013) · PubMed · Cited by 94
Ilgen, M., Mccarthy, J., Ignacio, R., Bohnert, A., Valenstein, M., Blow, F., & Katz, I. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028266 · Cited by 76
Self-citationSuicide Risk Screening and Assessment
Boudreaux, E. D., & Horowitz, L. M. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.005 · Cited by 68
Tiet, Q., Ilgen, M., Byrnes, H. F., & Moos, R. (2006) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2006.00114.x · Cited by 65
Kim, H. M., Smith, E. G., Ganoczy, D. A., Walters, H., Stano, C. M., Ilgen, M. A., Bohnert, A. M., & Valenstein, M. M. (2012) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.12m07658 · Cited by 54
Datapoints: Are VA Patients With Serious Mental Illness Dying Younger?
Kilbourne, A. M., Ignacio, R. V., Kim, H. M., & Blow, F. C. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.5.589 · Cited by 48
Katz, I., Mccarthy, J., Ignacio, R., & Kemp, J. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300503 · Cited by 45
Self-citationKatz, I. R. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300582 · Cited by 43
Self-citationEvaluation of clinical prognostic models for suicide attempts after a major depressive episode
Galfalvy, H., Oquendo, M. A., & Mann, J. J. (2008) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2008.01162.x · Cited by 37
Violent and Nonviolent Suicide in Veterans With Substance-Use Disorders
Ilgen, M. A., Conner, K. R., Valenstein, M. M., Austin, K., & Blow, F. C. (2010) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2010.71.473 · Cited by 32
A Strategic Approach for Prioritizing Research and Action to Prevent Suicide
Pringle, B., Colpe, L. J., HEINSSEN, R. K., Schoenbaum, M., Sherrill, J. T., Claassen, C. A., & Pearson, J. L. (2013) · Psychiatric Services · doi:10.1176/appi.ps.201100512 · Cited by 31
Self-citationAssessing risk of suicide or self harm in adults
Morriss, R. K., Kapur, N., & Byng, R. (2013) · BMJ · doi:10.1136/bmj.f4572 · Cited by 30
Basham, C., Denneson, L. M., Millet, L. M., Shen, X., Duckart, J. P., & Dobscha, S. K. (2011) · Suicide and Life-Threatening Behavior · doi:10.1111/j.1943-278x.2011.00028.x · Cited by 29
Prognostic models to detect and monitor the near-term risk of suicide: state of the science.
Claassen, C., Harvilchuck-Laurenson, J. D., & Fawcett, J. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.003 · Cited by 28
Research works printed but not linked: 4
- Centers for Disease Control and Prevention, 2013, MMWR Morb Mortal Wkly Rep, 62, 321
- Research Prioritization Task Force, 2014, A Prioritized Research Agenda for Suicide Prevention: An Action Plan to Save Lives
- Institute of Medicine, 1994, Committee on Prevention of Mental Disorders, Division of Biobehavorial Sciences and Mental Disorders
- The Assessment and Management of Risk for Suicide Working Group, 2013, VA/DoD Clinical Practice Guideline for Assessment and Management of Patients at Risk for Suicide. Version 1.0
Cited by
Sorted by citations
Prediction Models for Suicide Attempts and Deaths: A Systematic Review and Simulation
Belsher, B. E., Smolenski, D. J., Pruitt, L. D., Bush, N. E., Beech, E. H., Workman, D. E., Morgan, R. L., Evatt, D. P., Tucker, J., & Skopp, N. A. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0174 · Cited by 540
Simon, G. E., Johnson, E., Lawrence, J. M., Rossom, R. C., Ahmedani, B., Lynch, F. L., Beck, A., Waitzfelder, B., Ziebell, R., Penfold, R. B., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17101167 · Cited by 400
Major Physical Health Conditions and Risk of Suicide
Ahmedani, B. K., Peterson, E. L., Hu, Y., Rossom, R. C., Lynch, F., Lu, C. Y., Waitzfelder, B. E., Owen-Smith, A. A., Hubley, S., Prabhakar, D., et al. (2017) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2017.04.001 · Cited by 265
Large, M., Kaneson, M., Myles, N., Myles, H., Gunaratne, P., & Ryan, C. (2016) · PLOS ONE · doi:10.1371/journal.pone.0156322 · Cited by 248
Kessler, R. C., Bossarte, R. M., Luedtke, A., Zaslavsky, A. M., & Zubizarreta, J. R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0531-0 · Cited by 234
Self-citation
Metadata
- Authors
- McCarthy, J. F., Bossarte, R. M., Katz, I. R., Thompson, C., Kemp, J., Hannemann, C. M., Nielson, C., & Schoenbaum, M.
- Affiliations
- United States Department of Veterans Affairs (US)
- Venue
- American Journal of Public Health
- Publisher
- American Public Health Association
- Published
- 2015-09
- Volume
- 105
- Issue
- 9
- Pages
- 1935-1942
- ISSN
- 0090-0036 (ISSN-L)
- 1541-0048
- PMC
- PMC4539821
- OpenAlex
- W1727999343
- Cited by
- 251
- References
- 34
- Citations by year
- 2026: 21 · 2025: 22 · 2024: 18 · 2023: 23 · 2022: 37 · 2021: 29 · 2020: 24 · 2019: 23 · 2018: 23 · 2017: 18 · 2016: 11 · 2015: 1
- FWCI
- 21.94
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- American Journal of Public Health (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- U.S. Department of Veterans Affairs
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- suicide risk prediction, suicide prevention, veterans, risk stratification, predictive modeling, Veterans Health Administration, medical records, National Death Index, high-risk patients
- MeSH terms
- Suicide Prevention, Female, Humans, Male, Predictive Value of Tests, Suicide, United States, United States Department of Veterans Affairs, Veterans, Risk Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
