Predictive Modeling and Concentration of the Risk of Suicide: Implications for Preventive Interventions in the US Department of Veterans Affairs
Open accessAbstract
Objectives. The Veterans Health Administration (VHA) evaluated the use of predictive modeling to identify patients at risk for suicide and to supplement ongoing care with risk-stratified interventions. Methods. Suicide data came from the National Death Index. Predictors were measures from VHA clinical records incorporating patient-months from October 1, 2008, to September 30, 2011, for all suicide decedents and 1% of living patients, divided randomly into development and validation samples. We used data on all patients alive on September 30, 2010, to evaluate predictions of suicide risk over 1 year. Results. Modeling demonstrated that suicide rates were 82 and 60 times greater than the rate in the overall sample in the highest 0.01% stratum for calculated risk for the development and validation samples, respectively; 39 and 30 times greater in the highest 0.10%; 14 and 12 times greater in the highest 1.00%; and 6.3 and 5.7 times greater in the highest 5.00%. Conclusions. Predictive modeling can identify high-risk patients who were not identified on clinical grounds. VHA is developing modeling to enhance clinical care and to guide the delivery of preventive interventions.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Suicide prediction models based on computational analyses of electronic health records may help identify individuals with the highest risk for suicide at time of discharge.
“Suicide prediction models based on computational analyses of electronic health records may help identify individuals with the highest risk for suicide at time of discharge, the subgroup that would potentially benefit most from intensive treatment and follow-up (237, 238).”
From A brain-centric model of suicidal behavior (2020) · cites this paper as [238]
Patients with high suicide risk also have significantly elevated risk of other negative outcomes, such as other types of death by external cause, suicide attempts, severe and permanently disabling injuries, and repeat psychiatric hospitalizations.
“patients with high suicide risk also have significantly elevated risk of other negative outcomes, such as other types of death by external cause, suicide attempts, severe and permanently disabling injuries, and repeat psychiatric hospitalizations (20, 88).”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
The veterans isolated by the Reach Vet model were found to account for approximately 2% of all suicide deaths in VHA.
“These veterans were found to account for approximately 2% of all suicide deaths in VHA.”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
The VHA Reach Vet model attempted to isolate the 0.1% of all VHA users with highest suicide risk.
“The Reach Vet model attempted to isolate the 0.1% of all VHA users with highest suicide risk.”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
The VHA Reach Vet model is based on a 30-day time horizon, which we showed clearly to be suboptimal in the current application to inpatients.
“the VHA Reach Vet model (88), which is used to target preventive interventions to the roughly 35,000 VHA patients each year considered to be at highest suicide risk, is based on a 30-day time horizon, which we showed clearly to be suboptimal in the current application to inpatients.”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305 · see citing works
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · see citing works
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861 · see citing works
Suicide Prevention Strategies: A Systematic Review
Mann, J. J., Apter, A., Bertolote, J., Beautrais, A., Currier, D., Haas, A., Hegerl, U., Lonnqvist, J., Malone, K., Marusic, A., et al. (2005) · JAMA · doi:10.1001/jama.294.16.2064 · Cited by 2,852 · see citing works
National Strategy for Suicide Prevention: Goals and Objectives for Action
Service., U. S. P. H. (2001) · PsycEXTRA Dataset · doi:10.1037/e415652005-001 · Cited by 463 · see citing works
Kessler, R. C., Warner, C. H., Ivany, C., Petukhova, M. V., Rose, S., Bromet, E. J., Brown, M., Cai, T., Colpe, L. J., Cox, K. L., et al. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1754 · Cited by 447 · see citing works
Self-citationImproving the Short-Term Prediction of Suicidal Behavior
Glenn, C. R., & Nock, M. K. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.004 · Cited by 328 · see citing works
Psychiatric Diagnoses and Risk of Suicide in Veterans
Ilgen, M. A., Bohnert, A. S. B., Ignacio, R. V., McCarthy, J. F., Valenstein, M. M., Kim, H. M., & Blow, F. C. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.129 · Cited by 311 · see citing works
Self-citationMortality in the United States, 2023
Murphy, S. L., Kochanek, K. D., Xu, J., & Arias, E. (2024) · doi:10.15620/cdc/170564 · Cited by 282 · see citing works
Noncancer pain conditions and risk of suicide
Ilgen, M. A., Kleinberg, F., Ignacio, R. V., Bohnert, A. S. B., Valenstein, M., McCarthy, J. F., Blow, F. C., & Katz, I. R. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.908 · Cited by 238 · see citing works
Self-citationSuicide Mortality Among Patients Receiving Care in the Veterans Health Administration Health System
McCarthy, J. F., Valenstein, M. M., Kim, H., Ilgen, M. A., Zivin, K., & Blow, F. C. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwp010 · Cited by 220 · see citing works
Self-citationSuicide and Traumatic Brain Injury Among Individuals Seeking Veterans Health Administration Services
Brenner, L. A., Ignacio, R. V., & Blow, F. C. (2011) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0b013e31821fdb6e · Cited by 187 · see citing works
Standardized Evaluation in Clinical Practice
PRIDMORE, S. A. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.7.1319-a · Cited by 165 · see citing works
Suicide among adults aged 35-64 years--United States, 1999-2010.
Sullivan, E., Annest, J. L., Luo, F., Simon, T. R., & Dahlberg, L. L. (2013) · PubMed Central · Cited by 155 · see citing works
Comorbid anxiety as a suicide risk factor among depressed veterans
Pfeiffer, P. N., Ganoczy, D., Ilgen, M., Zivin, K., & Valenstein, M. (2009) · Depression and Anxiety · doi:10.1002/da.20583 · Cited by 153 · see citing works
Tran, T., Luo, W., Phung, D., Harvey, R., Berk, M., Kennedy, R. L., & Venkatesh, S. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-76 · Cited by 150 · see citing works
Trust is the basis for effective suicide risk screening and assessment in veterans
Ganzini, L., Denneson, L. M., Press, N., Bair, M. J., Helmer, D. A., Poat, J., & Dobscha, S. K. (2013) · Journal of General Internal Medicine · doi:10.1007/s11606-013-2412-6 · Cited by 149 · see citing works
McCarthy, J. F., Blow, F. C., Ignacio, R. V., Ilgen, M. A., Austin, K., & Valenstein, M. M. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300463 · Cited by 144 · see citing works
Self-citationValenstein, M. M., Kim, H. M., Ganoczy, D. A., McCarthy, J. F., Zivin, K., Austin, K., Hoggatt, K. J., Eisenberg, D., Piette, J. D., Blow, F. C., et al. (2008) · Journal of Affective Disorders · doi:10.1016/j.jad.2008.08.020 · Cited by 142 · see citing works
Self-citationA Clinical Tool for Assessing Risk After Self-Harm
Cooper, J., Kapur, N., Dunning, J., Guthrie, E., Appleby, L., & Mackway-Jones, K. C. (2006) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2006.07.944 · Cited by 114 · see citing works
Suicide among adults aged 35-64 years--United States, 1999-2010.
(2013) · PubMed · Cited by 94 · see citing works
Ilgen, M. A., McCarthy, J. F., Ignacio, R. V., Bohnert, A. M., Valenstein, M. M., Blow, F. C., & Katz, I. R. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028266 · Cited by 84 · see citing works
Self-citationSuicide Risk Screening and Assessment
Boudreaux, E. D., & Horowitz, L. M. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.005 · Cited by 67 · see citing works
Tiet, Q., Ilgen, M., Byrnes, H. F., & Moos, R. (2006) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2006.00114.x · Cited by 65 · see citing works
Kim, H. M., Smith, E. G., Ganoczy, D. A., Walters, H., Stano, C. M., Ilgen, M. A., Bohnert, A. M., & Valenstein, M. M. (2012) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.12m07658 · Cited by 54 · see citing works
Datapoints: Are VA Patients With Serious Mental Illness Dying Younger?
Kilbourne, A. M., Ignacio, R. V., Kim, H. M., & Blow, F. C. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.5.589 · Cited by 48 · see citing works
Katz, I. R. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300582 · Cited by 43 · see citing works
Self-citationKatz, I. R., McCarthy, J. F., Ignacio, R. V., & Kemp, J. E. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300503 · Cited by 41 · see citing works
Self-citationEvaluation of clinical prognostic models for suicide attempts after a major depressive episode
Galfalvy, H., Oquendo, M. A., & Mann, J. J. (2008) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2008.01162.x · Cited by 37 · see citing works
Violent and Nonviolent Suicide in Veterans With Substance-Use Disorders
Ilgen, M. A., Conner, K. R., Valenstein, M. M., Austin, K., & Blow, F. C. (2010) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2010.71.473 · Cited by 32 · see citing works
A Strategic Approach for Prioritizing Research and Action to Prevent Suicide
Pringle, B., Colpe, L. J., HEINSSEN, R. K., Schoenbaum, M., Sherrill, J. T., Claassen, C. A., & Pearson, J. L. (2013) · Psychiatric Services · doi:10.1176/appi.ps.201100512 · Cited by 31 · see citing works
Self-citationAssessing risk of suicide or self harm in adults
Morriss, R. K., Kapur, N., & Byng, R. (2013) · BMJ · doi:10.1136/bmj.f4572 · Cited by 30 · see citing works
Basham, C., Denneson, L. M., Millet, L. M., Shen, X., Duckart, J. P., & Dobscha, S. K. (2011) · Suicide and Life-Threatening Behavior · doi:10.1111/j.1943-278x.2011.00028.x · Cited by 29 · see citing works
Prognostic models to detect and monitor the near-term risk of suicide: state of the science.
Claassen, C., Harvilchuck-Laurenson, J. D., & Fawcett, J. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.003 · Cited by 28 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- [20]Research Prioritization Task Force. A Prioritized Research Agenda for Suicide Prevention: An Action Plan to Save Lives. Rockville, MD: National Action Alliance for Suicide Prevention; 2014. [Google Scholar]
- [21]Institute of Medicine. Reducing risks for mental disorders: frontiers for preventive intervention research. In: Mrazek PJ, Haggerty RJ, editors. Committee on Prevention of Mental Disorders, Division of Biobehavorial Sciences and Mental Disorders. Washington, DC: National Academies Press; 1994. [PubMed] [Google Scholar]
- [22]The Assessment and Management of Risk for Suicide Working Group. VA/DoD Clinical Practice Guideline for Assessment and Management of Patients at Risk for Suicide. Version 1.0. Washington, DC: Veterans Health Administration and Department of Defense; 2013. [Google Scholar]
Cited by
Sorted by citations
Prediction Models for Suicide Attempts and Deaths: A Systematic Review and Simulation
Belsher, B. E., Smolenski, D. J., Pruitt, L. D., Bush, N. E., Beech, E. H., Workman, D. E., Morgan, R. L., Evatt, D. P., Tucker, J., & Skopp, N. A. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0174 · Cited by 540 · see citing works
Simon, G. E., Johnson, E., Lawrence, J. M., Rossom, R. C., Ahmedani, B., Lynch, F. L., Beck, A., Waitzfelder, B., Ziebell, R., Penfold, R. B., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17101167 · Cited by 400 · see citing works
Major Physical Health Conditions and Risk of Suicide
Ahmedani, B. K., Peterson, E. L., Hu, Y., Rossom, R. C., Lynch, F., Lu, C. Y., Waitzfelder, B. E., Owen-Smith, A. A., Hubley, S., Prabhakar, D., et al. (2017) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2017.04.001 · Cited by 265 · see citing works
Large, M., Kaneson, M., Myles, N., Myles, H., Gunaratne, P., & Ryan, C. (2016) · PLOS ONE · doi:10.1371/journal.pone.0156322 · Cited by 248 · see citing works
Kessler, R. C., Bossarte, R. M., Luedtke, A., Zaslavsky, A. M., & Zubizarreta, J. R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0531-0 · Cited by 234 · see citing works
Self-citationA brain-centric model of suicidal behavior
Mann, J. J., & Rizk, M. M. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20081224 · Cited by 214 · see citing works
Kessler, R. C., Hwang, I., Hoffmire, C. A., McCarthy, J. F., Petukhova, M. V., Rosellini, A. J., Sampson, N. A., Schneider, A. L., Bradley, P. A., Katz, I. R., et al. (2017) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1575 · Cited by 209 · see citing works
Self-citationAtkins, D., Kilbourne, A. M., & Shulkin, D. J. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044255 · Cited by 183 · see citing works
Military Sexual Trauma and Suicide Mortality
Kimerling, R. E., Makin-Byrd, K. N., Louzon, S. A., Ignacio, R. V., & McCarthy, J. F. (2015) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2015.10.019 · Cited by 170 · see citing works
Self-citationKessler, R. C., Stein, M. B., Petukhova, M. V., Bliese, P., Bossarte, R. M., Bromet, E. J., Fullerton, C. S., Gilman, S. E., Ivany, C., Lewandowski-Romps, L., et al. (2017) · Molecular Psychiatry · doi:10.1038/mp.2016.110 · Cited by 163 · see citing works
Self-citationFirearm ownership among American veterans: findings from the 2015 National Firearm Survey
Manchanda, E. C. C., Azrael, D. R., Simonetti, J. A., & Miller, M. (2017) · Injury Epidemiology · doi:10.1186/s40621-017-0130-y · Cited by 128 · see citing works
The Secondary Use of Electronic Health Records for Data Mining: Data Characteristics and Challenges
Sarwar, T., Seifollahi, S., Chan, J., Zhang, X., Aksakallı, V., Hudson, I. L., Verspoor, K. M., & Cavedon, L. (2022) · ACM Computing Surveys · doi:10.1145/3490234 · Cited by 129 · see citing works
Place, S., Blanch-Hartigan, D., Rubin, C., Gorrostieta, C., Mead, C., Kane, J., Marx, B. P., Feast, J., Deckersbach, T., Pentland, A. “., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6678 · Cited by 125 · see citing works
Zheng, L., Wang, O., Hao, S., Ye, C., Liu, M., Xia, M., Sabo, A. N., Markovic, L., Stearns, F., Kanov, L., et al. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-0684-2 · Cited by 112 · see citing works
Shen, Y.-C., Cunha, J. M., & Williams, T. V. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30304-2 · Cited by 102 · see citing works
McCarthy, J. F., Cooper, S. A., Dent, K. R., Eagan, A. E., Matarazzo, B. B., Hannemann, C. M., Reger, M. A., Landes, S. J., Trafton, J. A., Schoenbaum, M., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.29900 · Cited by 98 · see citing works
Self-citationColey, R. Y., Johnson, E., Simon, G. E., Cruz, M., & Shortreed, S. M. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.0493 · Cited by 89 · see citing works
Levis, M., Leonard Westgate, C., Gui, J., Watts, B. V., & Shiner, B. (2021) · Psychological Medicine · doi:10.1017/s0033291720000173 · Cited by 87 · see citing works
Choi, S. B., Lee, W., Yoon, J., Won, J., & Kim, D. W. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.01.019 · Cited by 85 · see citing works
Hostetter, T. A., Hoffmire, C. A., Forster, J. E., Adams, R. S., Stearns-Yoder, K. A., & Brenner, L. A. (2019) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0000000000000489 · Cited by 64 · see citing works
Hoffmire, C. A., Monteith, L. L., Forster, J. E., Bernhard, P. A., Blosnich, J. R., Vogt, D. S., Maguen, S., Smith, A. A., & Schneiderman, A. (2021) · Medical Care · doi:10.1097/mlr.0000000000001431 · Cited by 62 · see citing works
Moral injury and peri- and post-military suicide attempts among post-9/11 veterans
Maguen, S., Griffin, B. J., Vogt, D., Hoffmire, C. A., Blosnich, J. R., Bernhard, P. A., Akhtar, F. Z., Cypel, Y. S., & Schneiderman, A. I. (2023) · Psychological Medicine · doi:10.1017/s0033291721005274 · Cited by 58 · see citing works
Gender Differences in Risks of Suicide and Suicidal Behaviors in the USA: A Narrative Review
Carretta, R. F., McKee, S. A., & Rhee, T. G. (2023) · Current Psychiatry Reports · doi:10.1007/s11920-023-01473-1 · Cited by 66 · see citing works
Recent trends in the rural–urban suicide disparity among veterans using VA health care
Shiner, B. R., Peltzman, T., Cornelius, S. L., Gui, J., Forehand, J. A., & Watts, B. V. (2020) · Journal of Behavioral Medicine · doi:10.1007/s10865-020-00176-9 · Cited by 57 · see citing works
Meta-analysis of the strength of exploratory suicide prediction models; from clinicians to computers
Corke, M., Mullin, K., Angel-Scott, H. N., Xia, S., & Large, M. M. B. (2021) · BJPsych Open · doi:10.1192/bjo.2020.162 · Cited by 57 · see citing works
Suicide Risk Assessment and Prevention: A Systematic Review Focusing on Veterans
Nelson, H. D., Denneson, L. M., Low, A., Bauer, B. W., O'Neil, M. E., Kansagara, D. L., & Teo, A. R. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600384 · Cited by 56 · see citing works
Gradus, J. L., King, M. W., Galatzer‐Levy, I. R., & Street, A. E. (2017) · Journal of Traumatic Stress · doi:10.1002/jts.22210 · Cited by 57 · see citing works
Ribeiro, J. D., Gutierrez, P. M., Joiner, T. E., Kessler, R. C., Petukhova, M. V., Sampson, N. A., Stein, M. B., Ursano, R. J., & Nock, M. K. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000178 · Cited by 55 · see citing works
Blosnich, J. R., Garfin, D. R., Maguen, S., Vogt, D. S., Dichter, M. E., Hoffmire, C. A., Bernhard, P. A., & Schneiderman, A. (2021) · American Psychologist · doi:10.1037/amp0000755 · Cited by 55 · see citing works
Kessler, R. C., Bauer, M. S., Bishop, T. M., Demler, O. V., Dobscha, S. K., Gildea, S. M., Goulet, J. L., Karras, E., Kreyenbuhl, J., Landes, S. J., et al. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00390 · Cited by 52 · see citing works
Self-citationLin, D., Kim, H., Wada, K., Aboumrad, M., Powell, E. I., Zwain, G., Benson, C. J., & Near, A. M. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-04022-x · Cited by 52 · see citing works
The Interpersonal Needs Questionnaire: Statistical Considerations for Improved Clinical Application
Mitchell, S. M., Brown, S. L., Roush, J. F., Tucker, R. P., Cukrowicz, K. C., & Joiner, T. E. (2019) · Assessment · doi:10.1177/1073191118824660 · Cited by 52 · see citing works
Monteith, S., Glenn, T., Geddes, J. R., Whybrow, P. C., & Bauer, M. (2016) · International Journal of Bipolar Disorders · doi:10.1186/s40345-016-0051-7 · Cited by 50 · see citing works
Hallgren, K. A., Bauer, A. M., & Atkins, D. C. (2017) · Depression and Anxiety · doi:10.1002/da.22640 · Cited by 45 · see citing works
Integrating Predictive Modeling Into Mental Health Care: An Example in Suicide Prevention
Reger, G. M., McClure, M. L., Ruskin, D., Carter, S. P., & Reger, M. A. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201800242 · Cited by 50 · see citing works
Mortality among U.S. military participants at eight aboveground nuclear weapons test series
Boice, J. D., Cohen, S. S., Mumma, M. T., Chen, H., Golden, A. P., Beck, H. L., & Till, J. E. (2020) · International Journal of Radiation Biology · doi:10.1080/09553002.2020.1787543 · Cited by 48 · see citing works
Reconciling Statistical and Clinicians’ Predictions of Suicide Risk
Simon, G. E., Matarazzo, B. B., Walsh, C. G., Smoller, J. W., Boudreaux, E. D., Yarborough, B. J. H., Shortreed, S. M., Coley, R. Y., Ahmedani, B. K., Doshi, R., et al. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202000214 · Cited by 44 · see citing works
Self-citationAddressing Suicide in the Veteran Population: Engaging a Public Health Approach
Carroll, D., Kearney, L. K., & Miller, M. A. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.569069 · Cited by 45 · see citing works
The Role of Big Data Analytics in Predicting Suicide
Kessler, R. C., Bernecker, S. L., Bossarte, R. M., Luedtke, A. R., McCarthy, J. F., Nock, M. K., Pigeon, W. R., Petukhova, M. V., Sadikova, E., VanderWeele, T. J., et al. (2019) · Personalized Psychiatry · doi:10.1007/978-3-030-03553-2_5 · Cited by 44 · see citing works
Self-citationSuicidal Self‐Directed Violence Among Homeless US Veterans: A Systematic Review
Hoffberg, A. S., Spitzer, E. G., Mackelprang, J. L., Farro, S. A., & Brenner, L. A. (2017) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12369 · Cited by 44 · see citing works
Suicide in Transgender Veterans: Prevalence, Prevention, and Implications of Current Policy
Tucker, R. P. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691618812680 · Cited by 44 · see citing works
Fink, D. S., Stohl, M., Mannes, Z. L., Shmulewitz, D., Wall, M. M., Gutkind, S., Olfson, M., Gradus, J. L., Keyhani, S., Maynard, C. C., et al. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08899-y · Cited by 45 · see citing works
Iorfino, F., Ho, N., Carpenter, J. S., Cross, S. P. M., Davenport, T. A., Hermens, D. F., Yee, H. F., Nichles, A., Zmicerevska, N., Guastella, A. J., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0243467 · Cited by 42 · see citing works
Britton, P. C., Bohnert, K. M., Ilgen, M. A., Kane, C., Stephens, B., & Pigeon, W. R. (2017) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-017-1377-x · Cited by 41 · see citing works
Machine learning for suicidology: A practical review of exploratory and hypothesis-driven approaches
Cox, C. R., Moscardini, E. H., Cohen, A. S., & Tucker, R. P. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101940 · Cited by 39 · see citing works
Perspectives on the Management of Vascular Depression
Taylor, W. D., Schultz, S. K., Panaite, V., & Steffens, D. C. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.18050568 · Cited by 37 · see citing works
Death by Suicide Within 1 Week of Hospital Discharge
Riblet, N. B. V., Shiner, B. R., Watts, B. V., Mills, P. D., Rusch, B., & Hemphill, R. R. (2017) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000000687 · Cited by 36 · see citing works
Suicidal ideation and behavior in US veterans with schizophrenia or bipolar disorder
Harvey, P. D., Posner, K., Rajeevan, N., Yershova, K. V., Aslan, M., & Concato, J. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.04.014 · Cited by 36 · see citing works
Hill, R. M., Oosterhoff, B. J., & Do, C. (2019) · Archives of Suicide Research · doi:10.1080/13811118.2019.1615018 · Cited by 35 · see citing works
What health records data are required for accurate prediction of suicidal behavior?
Simon, G. E., Shortreed, S. M., Johnson, E., Rossom, R. C., Lynch, F. L., Ziebell, R. A., & Penfold, A. R. B. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz136 · Cited by 35 · see citing works
Yarborough, B. J. H., & Stumbo, S. P. (2021) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2021.02.008 · Cited by 35 · see citing works
Mental Health Needs of Aging Veterans: Recent Evidence and Clinical Recommendations
Karel, M. J., Wray, L. O., Adler, G., Hannum, A. O. R., Luci, K., Brady, L., & McGuire, M. H. (2020) · Clinical Gerontologist · doi:10.1080/07317115.2020.1716910 · Cited by 34 · see citing works
Between-visit changes in suicidal ideation and risk of subsequent suicide attempt
Simon, G. E., Shortreed, S. M., Johnson, E., Beck, A., Coleman, K. J., Rossom, R. C., Whiteside, U. S., Operskalski, B. H., & Penfold, R. B. (2017) · Depression and Anxiety · doi:10.1002/da.22623 · Cited by 34 · see citing works
Lee, J., Jang, H. G., Kim, J.-K., & Min, S. (2019) · Scientific Reports · doi:10.1038/s41598-019-38886-z · Cited by 33 · see citing works
Jiang, T., Rosellini, A. J., Horváth–Puhó, E., Shiner, B. R., Street, A. E., Lash, T. L., Sørensen, H. T., & Gradus, J. L. (2021) · The British Journal of Psychiatry · doi:10.1192/bjp.2021.19 · Cited by 32 · see citing works
Overcoming Challenges to Evidence‐Based Policy Development in a Large, Integrated Delivery System
Frakt, A. B., Prentice, J. C., Pizer, S. D., Elwy, A. R., Garrido, M. M., Kilbourne, A. M., & Atkins, D. (2018) · Health Services Research · doi:10.1111/1475-6773.12986 · Cited by 33 · see citing works
Peltzman, T., Shiner, B. R., & Watts, B. V. (2020) · Journal of Ect · doi:10.1097/yct.0000000000000665 · Cited by 31 · see citing works
Suicide risk among persons living with HIV
Brown, L. A., Majeed, I., Mu, W., McCann, J. P., Durborow, S., Chen, S., & Blank, M. B. (2020) · AIDS Care · doi:10.1080/09540121.2020.1801982 · Cited by 31 · see citing works
Association of Online Risk Factors With Subsequent Youth Suicide-Related Behaviors in the US
Sumner, S. A., Ferguson, B., Bason, B., Dink, J., Yard, E. E., Hertz, M. F., Hilkert, B., Holland, K. M., Mercado-Crespo, M., Tang, S., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.25860 · Cited by 31 · see citing works
Clinical implementation of suicide risk prediction models in healthcare: a qualitative study
Yarborough, B. J. H., Stumbo, S. P., Schneider, J. L., Richards, J. A., Hooker, S. A., & Rossom, R. C. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-04400-5 · Cited by 30 · see citing works
Predictive modeling of housing instability and homelessness in the Veterans Health Administration
Byrne, T. H., Montgomery, A. E., & Fargo, J. D. (2018) · Health Services Research · doi:10.1111/1475-6773.13050 · Cited by 30 · see citing works
Levis, M., Levy, J., Dufort, V., Gobbel, G. T., Watts, B. V., & Shiner, B. R. (2022) · Psychiatry Research · doi:10.1016/j.psychres.2022.114703 · Cited by 30 · see citing works
The Veterans Health Administration REACH VET Program: Suicide Predictive Modeling in Practice
Matarazzo, B. B., Eagan, A. E., Landes, S. J., Mina, L. K., Clark, K., Gerard, G. R., McCarthy, J. F., Trafton, J. A., Bahraini, N. H., Brenner, L. A., et al. (2022) · Psychiatric Services · doi:10.1176/appi.ps.202100629 · Cited by 34 · see citing works
Self-citationPredicting outcomes of psychotherapy for depression with electronic health record data
Coley, R. Y., Boggs, J. M., Beck, A., & Simon, G. E. (2021) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2021.100198 · Cited by 29 · see citing works
Suicide Prevention in U.S. Law Enforcement Agencies: a National Survey of Current Practices
Ramchand, R., Saunders, J. M., Osilla, K. C., Ebener, P., Kotzias, V. I., Thornton, E., Strang, L., & Cahill, M. (2018) · Journal of Police and Criminal Psychology · doi:10.1007/s11896-018-9269-x · Cited by 30 · see citing works
Tucker, R. P., Tackett, M. J., Glickman, D. R., & Reger, M. A. (2018) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12431 · Cited by 28 · see citing works
Comorbidity Profiles Identified in Older Primary Care Patients Who Attempt Suicide
Morin, R. T., Li, Y., Mackin, R. S., Whooley, M. A., Conwell, Y., & Byers, A. L. (2019) · Journal of the American Geriatrics Society · doi:10.1111/jgs.16126 · Cited by 26 · see citing works
Suicide prevention in medical settings: The case for universal screening
Horowitz, L. M., Roaten, K., Pao, M., & Bridge, J. A. (2018) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2018.11.009 · Cited by 26 · see citing works
Ruiz, F., Burgo-Black, L., Hunt, S. C., Miller, M. A., & Spelman, J. F. (2022) · Public Health Reports · doi:10.1177/00333549221085240 · Cited by 24 · see citing works
Morrow, D., Zamora‐Resendiz, R., Beckham, J. C., Kimbrel, N. A., Oslin, D. W., Tamang, S. R., Crivelli, S. N., & Million Veteran Program Suicide Exemplar Work Group (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.04.009 · Cited by 25 · see citing works
Electromagnetic hysteresis modelling: from material science to finite element analysis of devices
Dupré, L. R., & Melkebeek, J. A. A. (2003) · Ghent University Academic Bibliography (Ghent University) · Cited by 25 · see citing works
Zang, C., Hou, Y., Lyu, D., Jin, J., Sacco, S. J., Chen, K., Aseltine, R. H., & Wang, F. (2024) · Translational Psychiatry · doi:10.1038/s41398-024-03034-3 · Cited by 24 · see citing works
Veteran Suicide Risk Factors: A National Sample of Nonveteran and Veteran Men Who Died by Suicide
Wood, D. S., Wood, B. M., Watson, A., Sheffield, D., & Hauter, H. (2019) · Health & Social Work · doi:10.1093/hsw/hlz037 · Cited by 25 · see citing works
Forehand, J. A., Dufort, V., Gradus, J. L., Maguen, S., Watts, B. V., Jiang, T., Holder, N. D., & Shiner, B. R. (2022) · The British Journal of Psychiatry · doi:10.1192/bjp.2022.110 · Cited by 24 · see citing works
Patient Feedback on the Use of Predictive Analytics for Suicide Prevention
Reger, M. A., Ammerman, B. A., Carter, S. P., Gebhardt, H. M., Rojas, S. M., Lee, J. M., & Buchholz, J. R. (2020) · Psychiatric Services · doi:10.1176/appi.ps.202000092 · Cited by 21 · see citing works
Atkins, D., Makridis, C. A., Alterovitz, G., Ramoni, R. B., & Clancy, C. M. (2022) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-122220-110053 · Cited by 24 · see citing works
Levis, M., Levy, J., Dent, K. R., Dufort, V., Gobbel, G. T., Watts, B. V., & Shiner, B. R. (2023) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.22m14568 · Cited by 22 · see citing works
Identifying risk factors for mortality among patients previously hospitalized for a suicide attempt
Doshi, R., Chen, K., Wang, F., Schwartz, H., Herzog, A., & Aseltine, R. H. (2020) · Scientific Reports · doi:10.1038/s41598-020-71320-3 · Cited by 21 · see citing works
A call to integrate health equity into learning health system research training
Coley, R. Y., Duan, K. I., Hoopes, A. J., Lapham, G. T., Liljenquist, K. S., Marcotte, L. M., Ramirez, M., & Schuttner, L. (2022) · Learning Health Systems · doi:10.1002/lrh2.10330 · Cited by 20 · see citing works
Medically Documented Suicide Ideation Among U.S. Army Soldiers
Ursano, R. J., Kessler, R. C., Stein, M. B., Naifeh, J. A., Nock, M. K., Aliaga, P. A., Fullerton, C. S., Wynn, G. H., Ng, T. H. H., Dinh, H. M., et al. (2016) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12316 · Cited by 22 · see citing works
Self-citationRelative accuracy of social and medical determinants of suicide in electronic health records
Alemi, F., Avramovic, S., Renshaw, K. D., Kanchi, R., & Schwartz, M. D. (2020) · Health Services Research · doi:10.1111/1475-6773.13540 · Cited by 21 · see citing works
Prediction models for self-harm and suicide: a systematic review and critical appraisal
Seyedsalehi, A., Bailey, J. P. M., Ogonah, M. G. T., Fanshawe, T. R., & Fazel, S. (2025) · BMC Medicine · doi:10.1186/s12916-025-04367-6 · Cited by 23 · see citing works
Lee, A. A., Sripada, R. K., Hale, A. C., Ganoczy, D. A., TRIVEDI, R. B., Arnow, B. A., & Pfeiffer, P. N. (2021) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000645 · Cited by 20 · see citing works
Dhaubhadel, S., Ganguly, K., Ribeiro, R. M., Cohn, J. D., Hyman, J. M., Hengartner, N., Kolade, B., Singley, A., Tanmoy Bhattacharya, A., Finley, P. D., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-51762-9 · Cited by 20 · see citing works
Self-citationAmmerman, B. A., & Reger, M. A. (2020) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12618 · Cited by 20 · see citing works
Montgomery, A. E., Blosnich, J. R., DeRussy, A. J., Richman, J., Dichter, M. E., & True, G. (2023) · Archives of Suicide Research · doi:10.1080/13811118.2023.2244534 · Cited by 19 · see citing works
Suicide Among Military Personnel and Veterans Aged 18–35 Years by County—16 States
Logan, J. E., Fowler, K. A., Patel, N., & Holland, K. M. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.001 · Cited by 19 · see citing works
Reger, M. A., Smolenski, D. J., Skopp, N. A., Metzger-Abamukong, M. J., Kang, H. K., Bullman, T. A., & Gahm, G. A. (2017) · Annals of Epidemiology · doi:10.1016/j.annepidem.2017.12.008 · Cited by 19 · see citing works
Culhane, D. P., Szymkowiak, D., & Schinka, J. A. (2019) · Psychiatric Services · doi:10.1176/appi.ps.201800415 · Cited by 18 · see citing works
Sex‐Specific Risk Profiles for Suicide Among Persons with Substance Use Disorders in Denmark
Adams, R. S., Jiang, T., Rosellini, A. J., Horváth–Puhó, E., Street, A. E., Keyes, K. M., Cerdá, M., Lash, T. L., Sørensen, H. T., & Gradus, J. L. (2021) · Addiction · doi:10.1111/add.15455 · Cited by 18 · see citing works
A risk calculator to predict suicide attempts among individuals with early‐onset bipolar disorder
Goldstein, T. R., Merranko, J. A., Hafeman, D., Gill, M. K., Liao, F., Sewall, C. J. R., Hower, H. M., Weinstock, L. M., Yen, S., Goldstein, B. I., et al. (2022) · Bipolar Disorders · doi:10.1111/bdi.13250 · Cited by 18 · see citing works
Lavigne, J. E. (2016) · Journal of the American Pharmacists Association · doi:10.1016/j.japh.2015.12.011 · Cited by 17 · see citing works
Predicting Risk of Potentially Preventable Hospitalization in Older Adults with Dementia
Maust, D. T., Kim, H. M., Chiang, C., Langa, K. M., & Kales, H. C. (2019) · Journal of the American Geriatrics Society · doi:10.1111/jgs.16030 · Cited by 17 · see citing works
Veterans Justice Programs: Assessing Population Risks for Suicide Deaths and Attempts
Palframan, K. M., Blue‐Howells, J., Clark, S. C., & McCarthy, J. F. (2020) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12631 · Cited by 17 · see citing works
Self-citationMartinez, C., Levin, D., Jones, J. L., Finley, P. D., McMahon, B. H., Dhaubhadel, S., Cohn, J. D., Program, M. V., Workgroup, M. S. E., Oslin, D. W., et al. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad167 · Cited by 17 · see citing works
Choice Program Expansion Jeopardizes High-Quality VHA Mental Health Services.
Lemle, R. B. (2018) · Europe PMC (PubMed Central) · Cited by 16 · see citing works
Rawat, B. P. S., Reisman, J., Pogoda, T. K., Liu, W., Rongali, S., Aseltine Jr, R. H., Chen, K., Tsai, J., Berlowitz, D., Yu, H., et al. (2023) · JMIR Public Health and Surveillance · doi:10.2196/42803 · Cited by 15 · see citing works
Prevalence of Personality Disorders Across Veteran Samples: A Meta-Analysis
Edwards, E. R., Tran, H., Wrobleski, J. T., Rabhan, Y., Yin, J., Chiodi, C., Goodman, M. S., & Geraci, J. C. (2022) · Journal of Personality Disorders · doi:10.1521/pedi.2022.36.3.339 · Cited by 14 · see citing works
Positive Predictive Values and Potential Success of Suicide Prediction Models
Matarazzo, B. B., Brenner, L. A., & Reger, M. A. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.1519 · Cited by 15 · see citing works
Military and Veteran Suicide Prevention
Jobes, D. A., Haddock, L. A., & Olivares, M. (2019) · Springer eBooks · doi:10.1007/978-3-030-05384-0_5 · Cited by 14 · see citing works
- Authors
- McCarthy, J. F., Bossarte, R. M., Katz, I. R., Thompson, C., Kemp, J., Hannemann, C. M., Nielson, C., & Schoenbaum, M.
- Affiliations
- United States Department of Veterans Affairs (US)
- Venue
- American Journal of Public Health
- Publisher
- American Public Health Association
- Published
- 2015-09
- Volume
- 105
- Issue
- 9
- Pages
- 1935-1942
- ISSN
- 0090-0036 (ISSN-L)
- 1541-0048
- PMC
- PMC4539821
- OpenAlex
- W1727999343
- Cited by
- 251
- References
- 34
- Citations by year
- 2026: 21 · 2025: 22 · 2024: 18 · 2023: 23 · 2022: 37 · 2021: 29 · 2020: 24 · 2019: 23 · 2018: 23 · 2017: 18 · 2016: 11 · 2015: 1
- FWCI
- 21.94
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- American Journal of Public Health (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- U.S. Department of Veterans Affairs
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- suicide risk prediction, suicide prevention, veterans, risk stratification, predictive modeling, Veterans Health Administration, medical records, National Death Index, high-risk patients
- MeSH terms
- Suicide Prevention, Female, Humans, Male, Predictive Value of Tests, Suicide, United States, United States Department of Veterans Affairs, Veterans, Risk Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review