The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Predictive Modeling and Concentration of the Risk of Suicide: Implications for Preventive Interventions in the US Department of Veterans Affairs
Open accessAbstract
Objectives. The Veterans Health Administration (VHA) evaluated the use of predictive modeling to identify patients at risk for suicide and to supplement ongoing care with risk-stratified interventions. Methods. Suicide data came from the National Death Index. Predictors were measures from VHA clinical records incorporating patient-months from October 1, 2008, to September 30, 2011, for all suicide decedents and 1% of living patients, divided randomly into development and validation samples. We used data on all patients alive on September 30, 2010, to evaluate predictions of suicide risk over 1 year. Results. Modeling demonstrated that suicide rates were 82 and 60 times greater than the rate in the overall sample in the highest 0.01% stratum for calculated risk for the development and validation samples, respectively; 39 and 30 times greater in the highest 0.10%; 14 and 12 times greater in the highest 1.00%; and 6.3 and 5.7 times greater in the highest 5.00%. Conclusions. Predictive modeling can identify high-risk patients who were not identified on clinical grounds. VHA is developing modeling to enhance clinical care and to guide the delivery of preventive interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Suicide prediction models based on computational analyses of electronic health records may help identify individuals with the highest risk for suicide at time of discharge, the subgroup that would potentially benefit most from intensive treatment and follow-up (237, 238).”
From A brain-centric model of suicidal behavior (2020) · cites this paper as [238]
In the citing paper
“patients with high suicide risk also have significantly elevated risk of other negative outcomes, such as other types of death by external cause, suicide attempts, severe and permanently disabling injuries, and repeat psychiatric hospitalizations (20, 88).”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
In the citing paper
“These veterans were found to account for approximately 2% of all suicide deaths in VHA.”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
In the citing paper
“The Reach Vet model attempted to isolate the 0.1% of all VHA users with highest suicide risk.”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
In the citing paper
“the VHA Reach Vet model (88), which is used to target preventive interventions to the roughly 35,000 VHA patients each year considered to be at highest suicide risk, is based on a 30-day time horizon, which we showed clearly to be suboptimal in the current application to inpatients.”
From Using Administrative Data to Predict Suicide After Psychiatric Hospitalization in the Veterans Health Administration System (2020) · cites this paper as [88]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861
Suicide Prevention Strategies: A Systematic Review
Mann, J. J., Apter, A., Bertolote, J., Beautrais, A., Currier, D., Haas, A., Hegerl, U., Lonnqvist, J., Malone, K., Marusic, A., et al. (2005) · JAMA · doi:10.1001/jama.294.16.2064 · Cited by 2,852
National Strategy for Suicide Prevention: Goals and Objectives for Action
Service., U. S. P. H. (2001) · PsycEXTRA Dataset · doi:10.1037/e415652005-001 · Cited by 458
Kessler, R. C., Warner, C. H., Ivany, C., Petukhova, M. V., Rose, S., Bromet, E. J., Brown, M., Cai, T., Colpe, L. J., Cox, K. L., et al. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1754 · Cited by 447
Self-citationImproving the Short-Term Prediction of Suicidal Behavior
Glenn, C. R., & Nock, M. K. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.004 · Cited by 328
Psychiatric Diagnoses and Risk of Suicide in Veterans
Ilgen, M. A., Bohnert, A. S. B., Ignacio, R. V., McCarthy, J. F., Valenstein, M. M., Kim, H. M., & Blow, F. C. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.129 · Cited by 311
Self-citationMortality in the United States, 2023
Murphy, S. L., Kochanek, K. D., Xu, J., & Arias, E. (2024) · doi:10.15620/cdc/170564 · Cited by 282
Noncancer pain conditions and risk of suicide
Ilgen, M. A., Kleinberg, F., Ignacio, R. V., Bohnert, A. S. B., Valenstein, M., McCarthy, J. F., Blow, F. C., & Katz, I. R. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.908 · Cited by 238
Self-citation
Flagged first, then by citations
Research works printed but not linked: 4
- Centers for Disease Control and Prevention, 2013, MMWR Morb Mortal Wkly Rep, 62, 321
- Research Prioritization Task Force, 2014, A Prioritized Research Agenda for Suicide Prevention: An Action Plan to Save Lives
- Institute of Medicine, 1994, Committee on Prevention of Mental Disorders, Division of Biobehavorial Sciences and Mental Disorders
- The Assessment and Management of Risk for Suicide Working Group, 2013, VA/DoD Clinical Practice Guideline for Assessment and Management of Patients at Risk for Suicide. Version 1.0
Cited by
Sorted by citations
Items 201–251 of 251
Artificial intelligence and suicide prevention: Promise and pitfalls
Tandon, R. (2026) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2026.105120 · Cited by 1
Mash, H. B. H., Naifeh, J. A., Fullerton, C. S., Morganstein, J. C., & Ursano, R. J. (2018) · Springer eBooks · doi:10.1007/978-1-4939-7438-2_24 · Cited by 1
Evaluating Text Analytic Frameworks for Mental Health Surveillance
Mayer, B. W., Arnold, J., Begoli, E., Rush, E. N., Drewry, M., Brown, K., Lazcano-Ponce, E. C., & Srinivas, S. (2018) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew.2018.00014 · Cited by 1
Saulnier, K. G., Panaite, V., Ganoczy, D. A., Kim, H. M., Zivin, K., Hofer, T. P., Piette, J. D., & Pfeiffer, P. N. (2023) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2023.10.008 · Cited by 1
Roberts‐Pedersen, E. (2024) · Routledge eBooks · doi:10.4324/9780429351464 · Cited by 1
Dent, K. R., Goodrich, M., Gamble, S. A., & McCarthy, J. F. (2024) · Psychiatry Research Communications · doi:10.1016/j.psycom.2024.100181 · Cited by 1
Self-citationConsiderations and Challenges When Using Clinical and Vital Record Review for Suicide Research
Arias, S. A., Gaudiano, B. A., Epstein-Lubow, G., Zylberfuden, S., & Weinstock, L. (2025) · Journal of patient safety · doi:10.1097/pts.0000000000001325 · Cited by 1
Marcus, S. C., Cullen, S. W., Schmutte, T. J., Xie, M., Liu, T., Ungar, L., Cardamone, N. C., Williams, N. J., & Olfson, M. (2025) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2025.04.035 · Cited by 1
Dorsey, S., Pullmann, M. D., Kerns, S. E. U., Deblinger, E., Lucid, L., Harrison, J. P., Thompson, K., & Berliner, L. (2018) · Implementation Science · doi:10.1186/s13012-018-0715-z · Cited by 2
Moral Injury and Suicide Attempts in Nigerian Military Veterans
EBIAI, A. E., James, A. B. E. L., Anongo, F. S., & Dami, B. E. (2023) · Journal of Behavioral Health and Psychology · doi:10.33425/2832-4579/23050 · Cited by 1
Wang, F., Zang, C., Goodman, M. S., Zhu, Z. D., Yang, L., Yin, Z., Tamás, Z., Sharma, V., & Shao, N. (2022) · Research Square · doi:10.21203/rs.3.rs-1350791/v1 · Cited by 1
Murdoch, M., Clothier, B. A., & Noorbaloochi, S. (2023) · doi:10.31234/osf.io/s5bdn · Cited by 1
Life Events Extraction From Healthcare Notes for Veteran Acute Suicide PredictionPreprint
Morrow, D., Zamora‐Resendiz, R., Beckham, J. C., Kimbrel, N. A., McMahon, B. H., & Crivelli, S. N. (2025) · medRxiv · doi:10.1101/2025.02.03.25321612 · Cited by 1
Bossarte, R. M. (2018) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-018-0882-x
Self-citationHomeless Risk Among Post-9/11 Era Veterans
Metraux, S., & Smith, R. T. (2018) · doi:10.1093/oso/9780190695132.003.0009
Hopes and Challenges Moving Forward
Fallin, M. D., Holingue, C., Ostrow, L., Leaf, P. J., Manderscheid, R. W., Shern, D. L., Thrul, J., Zandi, P. P., & Eaton, W. W. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190916602.003.0020
The Medication Adherence Score: A Predictive Analytic ToolPreprint
Brouwer, T. F., Knops, R. E., Burke, M. C., & Reddy, V. Y. (2020) · Research Square · doi:10.21203/rs.3.rs-48523/v1
Zheng, L., Wang, O., Liu, M., Ye, C., Xia, M., Hao, S., Jin, B., Zhu, C., Sabo, A. N., Markovic, L., et al. (2018) · doi:10.2196/preprints.12668
Harris, K. J., & Franchino-Olsen, H. (2022) · IGI Global eBooks · doi:10.4018/978-1-6684-3926-5.ch005
Denneson, L. M., Cameron, D. C., Hooker, E. R., Laliberte, A. Z., & Chen, J. I. (2022) · Community Mental Health Journal · doi:10.1007/s10597-022-01079-6
Hynes, D. M., Niederhausen, M., Chen, J. I., Shahoumian, T. A., Rowneki, M., Hickok, A. W., Shepherd‐Banigan, M. E., Hawkins, E. J., Naylor, J. C., Teo, A. R., et al. (2022) · medRxiv · doi:10.1101/2022.12.23.22283902
Chapter 22. Military Personnel and Veterans
Joshi, K. G., Writer, B. W., & Ritchie, E. C. (2020) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375288.lg22
Biplob, K. B. M. B., Sammak, M. H., Bitto, A. K., & Mahmud, I. (2024) · EAI Endorsed Transactions on Pervasive Health and Technology · doi:10.4108/eetpht.10.3070
Death of the suicide law: A changing standard of liability for clinicians
Syed, S. A., Dixson, B. A., Fontenele, R., Eth, S., & Regan, J. J. (2024) · Journal of Forensic Sciences · doi:10.1111/1556-4029.15530
Panaite, V., Luther, S. L., Finch, D. K., Cohen, N. J., Schultz, S. K., Tsalatsanis, A., & Pfeiffer, P. N. (2024) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796024000465
Britton, P. C., Bohnert, K. M., Denneson, L. M., Ganoczy, D. A., & Ilgen, M. A. (2025) · Psychiatric Services · doi:10.1176/appi.ps.20240352
Veterans at High Risk for Post–COVID-19 Suicide Attempts or Other Self-Directed Violence
Bui, D. P., Niederhausen, M., Hickok, A. W., Govier, D. J., Rowneki, M., Naylor, J. C., Hawkins, E. J., Boyko, E. J., Iwashyna, T. J., Viglianti, E. M., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.0061
Hsin, H., Papini, S., Lu, Y., Clancy, H., Erion, M., Lee, C., Roches, K. B.-D., Ju, J., Girard, K., Koshy, M. T., et al. (2025) · medRxiv · doi:10.1101/2025.03.30.25324907
Needs of Veterans With Personality Disorder Diagnoses in Community-Based Mental Health Care
Edwards, E. R. (2025) · Federal Practitioner · doi:10.12788/fp.0572
Military Veterans Wellness Program: Performance measurement framework
Dale, A., Dale, A., Burns, J., Dale, G., Collins, P. I., & Ellis, J. (2025) · Journal of Military Veteran and Family Health · doi:10.3138/jmvfh-2024-0056
Yarborough, B. J. H., Stumbo, S. P., Schneider, J., Richards, J. E., Hooker, S. A., & Rossom, R. C. (2023) · Figshare · doi:10.6084/m9.figshare.22615858
Yarborough, B. J. H., Stumbo, S. P., Schneider, J. L., Richards, J. E., Hooker, S. A., & Rossom, R. C. (2022) · Figshare · doi:10.6084/m9.figshare.20364930
Fink, D. S., Stohl, M., Mannes, Z. L., Shmulewitz, D., Wall, M., Gutkind, S., Olfson, M., Gradus, J. L., Keyhani, S., Maynard, C. C., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22607671
Predicting and differentiating opioid and non-opioid drug poisonings using health records data
Simon, G. E., Wellman, R., Shortreed, S. M., Johnson, E., Sterling, S., Coleman, K. J., Ahmedani, B. K., Yaseen, Z. S., & Mosholder, A. D. (2025) · Journal of Substance Use and Addiction Treatment · doi:10.1016/j.josat.2025.209861
Woodward, S. H., Ong, L. E., Villasenor, D., Arsenault, N. J., Pigeon, W. R., Khan, C. T., & Bernert, R. A. (2026) · Journal of Affective Disorders · doi:10.1016/j.jad.2026.121184
Meerwijk, E. L., Shotqara, A. S., Finlay, A. K., Reeves, R. R., Tamang, S. R., Ilgen, M. A., & Harris, A. H. S. (2026) · Medical Care · doi:10.1097/mlr.0000000000002289
Murdoch, M., Clothier, B. A., & Noorbaloochi, S. (2026) · Psychiatry International · doi:10.3390/psychiatryint7010034
Precision stratification of risk for suicidal behavior in people with bipolar depressionPreprint
de Lacy, N., Lam, W. Y., Virtosu, M., Deshmukh, V., Wilson, F. A., Pescosolido, B. A., & Smith, K. (2026) · medRxiv · doi:10.64898/2026.02.23.26346921
Levis, M., Dimambro, M., Levy, J., & Shiner, B. R. (2026) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-026-01495-w
Dimambro, M., Levy, J., Gui, J., Goldberg, M., Shiner, B. R., & Levis, M. (2026) · Translational Psychiatry · doi:10.1038/s41398-026-03940-8
Consoloni, J.-L. (2017) · theses.fr (ABES) · doi:10.70675/7589d6ddz96baz427ezaba7z2ffe6d276403
Management of Concomitant Mental Health Conditions in Older Adults with Cognitive Impairment
Tunink, C., Ulen, M., & McNair, S. H. (2026) · Primary Care Clinics in Office Practice · doi:10.1016/j.pop.2026.01.010
Links Between Toxic Exposures and Mental Health Conditions Among US Military
Tsai, J., Castro, C. A., Mukherjee, B., & Cory‐Slechta, D. A. (2026) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2026.0879
Saulnier, K., Brabbs, S., Dent, K. R., & McCarthy, J. F. (2026) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-026-01510-0
Self-citationPeluso, A., Osorio, J. R., Kazanis, W. H., Robinson, A., Martins, S. B., Cook, H., Callaway, K., Schaefferkoetter, N., McCarthy, J. F., Oliva, E. M., et al. (2026) · BMJ Mental Health · doi:10.1136/bmjment-2025-302338
Self-citationState Gun Policies Affect Veteran and Civilian Suicide Rates Differently
Hiraldo, L., Wolansky, R., Sujka, J., Luchette, F., Kuo, P. C., & Kendall, M. (2026) · Journal of Trauma and Acute Care Surgery · doi:10.1097/ta.0000000000005111
Kimbrel, N. A., Dennis, P. A., Patel, T. A., Halverson, T. F., Dillon, K. H., Stephenson, M. E., Bourassa, K. J., Patel, P. R., Qin, X. J., Barr, P. B., et al. (2026) · Archives of Suicide Research · doi:10.1080/13811118.2026.2683477
Trujeque, J., Simonetti, J. A., Ortiz, I., Ingraham, N. E., MESFIN, N. M., Yeung, J., Zhang, R., Brenner, L. A., & Dudley, R. A. (2026) · Journal of Medical Internet Research · doi:10.2196/97485
Predicting suicide attempts in people with autism and co-morbid mood or psychotic disordersPreprint
Baker, M. J., Lam, W. Y., Virtosu, M., & de Lacy, N. (2026) · medRxiv · doi:10.64898/2026.09.25.26364048
Tahseen, H. (2026) · Military Medicine · doi:10.1093/milmed/usag488
Metadata
- Authors
- McCarthy, J. F., Bossarte, R. M., Katz, I. R., Thompson, C., Kemp, J., Hannemann, C. M., Nielson, C., & Schoenbaum, M.
- Affiliations
- United States Department of Veterans Affairs (US)
- Venue
- American Journal of Public Health
- Publisher
- American Public Health Association
- Published
- 2015-09
- Volume
- 105
- Issue
- 9
- Pages
- 1935-1942
- ISSN
- 0090-0036 (ISSN-L)
- 1541-0048
- PMC
- PMC4539821
- OpenAlex
- W1727999343
- Cited by
- 251
- References
- 34
- Citations by year
- 2026: 21 · 2025: 22 · 2024: 18 · 2023: 23 · 2022: 37 · 2021: 29 · 2020: 24 · 2019: 23 · 2018: 23 · 2017: 18 · 2016: 11 · 2015: 1
- FWCI
- 21.94
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- American Journal of Public Health (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- U.S. Department of Veterans Affairs
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- suicide risk prediction, suicide prevention, veterans, risk stratification, predictive modeling, Veterans Health Administration, medical records, National Death Index, high-risk patients
- MeSH terms
- Suicide Prevention, Female, Humans, Male, Predictive Value of Tests, Suicide, United States, United States Department of Veterans Affairs, Veterans, Risk Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review