Effect of an Emergency Department Process Improvement Package on Suicide Prevention: The ED-SAFE 2 Cluster Randomized Clinical Trial
Open accessAbstract
Importance: Suicide is a leading cause of deaths in the US. Although the emergency department (ED) is an opportune setting, ED-initiated interventions remain underdeveloped and understudied. Objective: To determine if an ED process improvement package, with a subfocus on improving the implementation of collaborative safety planning, reduces subsequent suicide-related behaviors. Design, Setting, and Participants: The Emergency Department Safety Assessment and Follow-up Evaluation 2 (ED-SAFE 2) trial, a stepped-wedge cluster randomized clinical trial conducted in 8 EDs across the US, used an interrupted time series design with three 12-month sequential phases: baseline, implementation, and maintenance. A random sample of 25 patients per month per site 18 years and older who screened positive on the Patient Safety Screener, a validated suicide risk screener, were included. The primary analyses focused on those who were discharged from the ED, while secondary analyses focused on all patients who screened positive, regardless of disposition. Data were collected on patients who presented for care from January 2014 to April 2018, and data were analyzed from April to December 2022. Interventions: Each site received lean training and built a continuous quality improvement (CQI) team to evaluate the current suicide-related workflow in the ED, identify areas of improvement, and implement efforts to improve. Each site was expected to increase their universal suicide risk screening and implement collaborative safety planning for patients at risk of suicide who were discharged home from the ED. Site teams were centrally coached by engineers experienced in lean CQI and suicide prevention specialists. Main Outcomes and Measures: The primary outcome was a composite comprising death by suicide or suicide-related acute health care visits, measured over a 6-month follow-up window. Results: Across 3 phases, 2761 patient encounters were included in the analyses. Of these, 1391 (50.4%) were male, and the mean (SD) age was 37.4 (14.5) years. A total of 546 patients (19.8%) exhibited the suicide composite during the 6-month follow-up (9 [0.3%] died by suicide and 538 [19.5%] of a suicide-related acute health care visit). A significant difference was observed for the suicide composite outcome between the 3 phases (baseline, 216 of 1030 [21%]; implementation, 213 of 967 [22%]; maintenance, 117 of 764 [15.3%]; P = .001). The adjusted odds ratios of risk of the suicide composite during the maintenance phase was 0.57 (95% CI, 0.43-0.74) compared with baseline and 0.61 (0.46-0.79) compared with the implementation phase, which reflect a 43% and 39% reduction, respectively. Conclusions and Relevance: In this multisite randomized clinical trial, using CQI methods to implement a department-wide change in suicide-related practices, including the implementation of a safety plan intervention, yielded a significant decrease in suicide behaviors in the maintenance period of the study. Trial Registration: ClinicalTrials.gov Identifier: NCT02453243
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Cites
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724 · see citing works
Safety planning intervention: a brief intervention to mitigate suicide risk.
Stanley, B., & Brown, G. K. (2012) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2011.01.001 · Cited by 1,267 · see citing works
Self-citationKilbourne, A. M., Neumann, M. S., Pincus, H. A., Bauer, M. S., & Stall, R. (2007) · Implementation Science · doi:10.1186/1748-5908-2-42 · Cited by 653 · see citing works
Stanley, B., Brown, G. K., Brenner, L. A., Galfalvy, H. C., Currier, G. W., Knox, K. L., Chaudhury, S. R., Bush, A. L., & Green, K. L. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.1776 · Cited by 648 · see citing works
Self-citationOugrin, D., Tranah, T., Stahl, D., Moran, P., & Asarnow, J. R. (2015) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2014.10.009 · Cited by 508 · see citing works
Suicide Prevention in an Emergency Department Population: The ED-SAFE Study
Miller, I. W., Camargo, C. A., Arias, S. A., Sullivan, A. F., Allen, M. H., Goldstein, A. B., Manton, A. P., Espinola, J. A., Jones, R., Hasegawa, K., et al. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0678 · Cited by 418 · see citing works
Self-citationHospitalization for Suicide Ideation or Attempt: 2008–2015
Plemmons, G., Hall, M., Doupnik, S., Gay, J., Brown, C., Browning, W., Casey, R., Freundlich, K., Johnson, D. P., Lind, C., et al. (2018) · Pediatrics · doi:10.1542/peds.2017-2426 · Cited by 405 · see citing works
WISQARS (Web-Based Injury Statistics Query and Reporting System)
(2011) · Choice Reviews Online · doi:10.5860/choice.48-4227 · Cited by 336 · see citing works
Hemming, K., Lilford, R., & Girling, A. J. (2015) · Statistics in Medicine · doi:10.1002/sim.6325 · Cited by 236 · see citing works
Milner, A. J., Carter, G., Pirkis, J., Robinson, J., & Spittal, M. J. (2015) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.147819 · Cited by 211 · see citing works
Disruptive innovations for designing and diffusing evidence-based interventions
Rotheram-Borus, M. J., Swendeman, D., & Chorpita, B. F. (2012) · American Psychologist · doi:10.1037/a0028180 · Cited by 210 · see citing works
Hickey, L., Hawton, K. E., Fagg, J., & Weitzel, H. (2001) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(00)00225-7 · Cited by 206 · see citing works
Improving Suicide Risk Screening and Detection in the Emergency Department
Boudreaux, E. D., Camargo, C. A., Arias, S. A., Sullivan, A. F., Allen, M. H., Goldstein, A. B., Manton, A. P., Espinola, J. A., & Miller, I. W. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2015.09.029 · Cited by 189 · see citing works
Self-citationOccult suicidality in an emergency department population.
Claassen, C. A., & Larkin, G. L. (2005) · British Journal of Psychiatry · doi:10.1192/bjp.186.4.352 · Cited by 179 · see citing works
Changes in Suicide Rates — United States, 2018–2019
Stone, D. M., Jones, C. M., & Mack, K. A. (2021) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm7008a1 · Cited by 127 · see citing works
Boudreaux, E. D., Miller, I., Goldstein, A. B., Sullivan, A. F., Allen, M. H., Manton, A. P., Arias, S. A., & Camargo, C. A. (2013) · Contemporary Clinical Trials · doi:10.1016/j.cct.2013.05.008 · Cited by 113 · see citing works
Self-citationBest strategies for reducing the suicide rate in Australia
Krysinska, K. E., Batterham, P. J., Tye, M., Shand, F., Calear, A. L., Cockayne, N. L., & Christensen, H. M. (2015) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867415620024 · Cited by 113 · see citing works
Hoffmire, C. A., Kemp, J. E., & Bossarte, R. M. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201400031 · Cited by 96 · see citing works
Betz, M. E., Sullivan, A. F., Manton, A. P., Espinola, J. A., Miller, I. W., Camargo, C. A., Boudreaux, E. D., & on behalf of the ED-SAFE Investigators (2013) · Depression and Anxiety · doi:10.1002/da.22071 · Cited by 94 · see citing works
Self-citationBetz, M. E., Miller, M., Barber, C. W., Miller, I., Sullivan, A. F., Camargo, C. A., Boudreaux, E. D., & on behalf of the ED-SAFE Investigators (2013) · Depression and Anxiety · doi:10.1002/da.22075 · Cited by 92 · see citing works
Self-citationBetz, M. E., Kautzman, M., Segal, D. L., Miller, I. W., Camargo, C. A., Boudreaux, E. D., & Arias, S. A. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.11.038 · Cited by 80 · see citing works
Self-citationBoudreaux, E. D., Jaques, M. L., Brady, K. M., Matson, A., & Allen, M. H. (2015) · Archives of Suicide Research · doi:10.1080/13811118.2015.1034604 · Cited by 74 · see citing works
Self-citationRecent suicidal ideation among patients in an inner city emergency department
Ilgen, M. A., Walton, M. A., Cunningham, R. M., Barry, K. L., Chermack, S. T., De Chavez, P., & Blow, F. C. (2009) · Suicide and Life-Threatening Behavior · doi:10.1521/suli.2009.39.5.508 · Cited by 62 · see citing works
Building a System of Perfect Depression Care in Behavioral Health
Coffey, C. E. (2007) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(07)33022-5 · Cited by 59 · see citing works
Emergency Department Recognition of Mental Disorders and Short-Term Outcome of Deliberate Self-Harm
Olfson, M., Marcus, S. C., & Bridge, J. A. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2013.12121506 · Cited by 54 · see citing works
Klein, D., Miller, R. E., Noble, A., et al. (2004) · Milbank Quarterly · doi:10.1111/milq.2004.82.issue-4 · Cited by 31 · see citing works
Payment Source and Emergency Management of Deliberate Self-Harm
Marcus, S. C., Bridge, J. A., & Olfson, M. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300598 · Cited by 28 · see citing works
Currier, G. W., Brown, G. K., Brenner, L. A., Chesin, M. S., Knox, K. L., Ghahramanlou‐Holloway, M., & Stanley, B. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.05.003 · Cited by 27 · see citing works
Self-citationTranslation of Evidence-Based Practice
Leming-Lee, T. ‘., & Watters, R. (2019) · Nursing Clinics of North America · doi:10.1016/j.cnur.2018.10.006 · Cited by 25 · see citing works
Emergency Department patients with suicide risk: Differences in care by acute alcohol use
Urban, C., Arias, S. A., Segal, D. L., Camargo, C. A., Boudreaux, E. D., Miller, I. W., & Betz, M. E. (2018) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2018.09.010 · Cited by 24 · see citing works
Self-citationBoudreaux, E. D., Haskins, B. L., Larkin, C., Pelletier, L., Johnson, S. A., Stanley, B., Brown, G., Mattocks, K., & Ma, Y. (2020) · Contemporary Clinical Trials · doi:10.1016/j.cct.2020.106075 · Cited by 24 · see citing works
Self-citationEffectiveness of Telephone-Delivered Interventions Following Suicide Attempts: A Systematic Review
Noh, D., Park, Y.-S., & Oh, E. G. (2015) · Archives of Psychiatric Nursing · doi:10.1016/j.apnu.2015.10.012 · Cited by 19 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Zwald ML, Holland KM, Annor FB, Kite-Powell A, Sumner SA, Bowen DA, et al. Syndromic surveillance of suicidal ideation and self-directed violence -United States, January 2017-December 2018. Morbidity and Mortality Weekly Report. 2020;69:103-8.
Cited by
Sorted by citations
O’Keeffe, S. (2026) · Trials · doi:10.1186/s13063-026-09698-0
“Three studies did not specify whether outcome assessors were blinded [28, 46, 63].”
- Authors
- Boudreaux, E. D., Larkin, C., Vallejo Sefair, A., Ma, Y., Li, Y. F., Ibrahim, A. F., Zeger, W., Brown, G. K., Pelletier, L., Miller, I., ED-SAFE 2 Investigators, Arias, S. A., Betz, M. E., Boyle, K., Camargo, C. A., Caterino, J., Eastin, C., Johnson, S., LoVecchio, F., Manton, A., Mattocks, K., Stanley, B., Uebelacker, L., & Wang, B.
- Affiliations
- University of Massachusetts Chan Medical School (US)
- Department of Emergency Medicine, University of Massachusetts Chan Medical School, Worcester
- Independent consultant, Boylston, Massachusetts
- University of Nebraska Medical Center (US)
- University of Pennsylvania (US)
- Connecticut Children's Medical Center (US)
- Brown University (US)
- for the ED-SAFE 2 Investigators
- Corresponding author
- Boudreaux, Edwin D.
- ORCID
- Venue
- JAMA Psychiatry
- Publisher
- American Medical Association (AMA)
- Published
- 2023-07-01
- Volume
- 80
- Issue
- 7
- Pages
- 665
- ISSN
- 2168-622X (ISSN-L)
- PMC
- PMC10193260
- OpenAlex
- W4376872135
- Semantic Scholar
- ac0ac9d8c929f2bbafc79c7018387875d6948e84
- Cited by
- 46
- References
- 32
- Citations by year
- 2026: 12 · 2025: 22 · 2024: 10 · 2023: 2
- FWCI
- 13.41
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- JAMA Psychiatry (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (R01MH106726, P50MH129701)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Health Sciences › Medicine › Emergency Medicine › Emergency and Acute Care Studies
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- suicide prevention, emergency department, suicide risk screening, process improvement, suicide mortality, workflow improvement, discharge planning, stepped-wedge cluster randomized trial, interrupted time series
- MeSH terms
- Suicide Prevention, Adult, Emergency Service, Hospital, Female, Humans, Male, Suicide, Suicidal Ideation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review