Opioid overdose rates and implementation of overdose education and nasal naloxone distribution in Massachusetts: interrupted time series analysis
Open accessAbstract
OBJECTIVE: To evaluate the impact of state supported overdose education and nasal naloxone distribution (OEND) programs on rates of opioid related death from overdose and acute care utilization in Massachusetts. DESIGN: Interrupted time series analysis of opioid related overdose death and acute care utilization rates from 2002 to 2009 comparing community-year strata with high and low rates of OEND implementation to those with no implementation. SETTING: 19 Massachusetts communities (geographically distinct cities and towns) with at least five fatal opioid overdoses in each of the years 2004 to 2006. PARTICIPANTS: OEND was implemented among opioid users at risk for overdose, social service agency staff, family, and friends of opioid users. INTERVENTION: OEND programs equipped people at risk for overdose and bystanders with nasal naloxone rescue kits and trained them how to prevent, recognize, and respond to an overdose by engaging emergency medical services, providing rescue breathing, and delivering naloxone. MAIN OUTCOME MEASURES: Adjusted rate ratios for annual deaths related to opioid overdose and utilization of acute care hospitals. RESULTS: Among these communities, OEND programs trained 2912 potential bystanders who reported 327 rescues. Both community-year strata with 1-100 enrollments per 100,000 population (adjusted rate ratio 0.73, 95% confidence interval 0.57 to 0.91) and community-year strata with greater than 100 enrollments per 100,000 population (0.54, 0.39 to 0.76) had significantly reduced adjusted rate ratios compared with communities with no implementation. Differences in rates of acute care hospital utilization were not significant. CONCLUSIONS: Opioid overdose death rates were reduced in communities where OEND was implemented. This study provides observational evidence that by training potential bystanders to prevent, recognize, and respond to opioid overdoses, OEND is an effective intervention.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Naloxone distribution programs reduce opioid mortality rates.
“Naloxone distribution programs have been shown to reduce opioid mortality rates (Walley et al., 2013).”
From The economic burden of opioid use disorder and fatal opioid overdose in the United States, 2017 (2021) · cites this paper as Walley et al., 2013
In Massachusetts, an interrupted time series analysis found 27% and 46% reductions in opioid overdose mortality rates in low- and high-implementing OEND communities, respectively, compared with communities with no OEND implementation.
“After adjusting for community level demographics and substance use factors, authors found 27% and 46% reductions in opioid overdose mortality rates in the low- and high-implementing communities, respectively, when compared with communities with no OEND implementation [37].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Cornish, R., Macleod, J., Strang, J., Vickerman, P., & Hickman, M. (2010) · BMJ · doi:10.1136/bmj.c5475 · Cited by 307 · see citing works
Saved by the nose: Bystander-administered intranasal naloxone hydrochloride for opioid overdose
Doe-Simkins, M., Walley, A. Y., Epstein, A., & Moyer, P. (2009) · American Journal of Public Health · doi:10.2105/ajph.2008.146647 · Cited by 250 · see citing works
Flagged first, then by citations
Research works printed but not linked: 28
- [1]Warner M, Chen LH, Makuc DM, Anderson RN, Minino AM. Drug poisoning deaths in the United States, 1980-2008. NCHS Data Brief 2011; 81: 1-8. 22617462
- [3]Milloy MJ, Wood E, Reading C, Kane D, Montaner J, Kerr T. Elevated overdose mortality rates among First Nations individuals in a Canadian setting: a population-based analysis. Addiction 2010; 105: 1962-70. 20825372
- [6]Quan VM, Minh NL, Ha TV, Ngoc NP, Vu PT, Celentano DD, et al. Mortality and HIV transmission among male Vietnamese injection drug users. Addiction 2011; 106: 583-9. 21054619 PMC4774249
- [8]Centers for Disease Control and Prevention (CDC). Vital signs: overdoses of prescription opioid pain relievers—United States, 1999-2008. Morb Mortal Wkly Rep 2011; 60: 1487-92. 22048730
- [9]Hall AJ, Logan JE, Toblin RL, Kaplan JA, Kraner JC, Bixler D, et al. Patterns of abuse among unintentional pharmaceutical overdose fatalities. JAMA 2008; 300: 2613-20. 19066381
- [10]Paulozzi LJ, Ryan GW. Opioid analgesics and rates of fatal drug poisoning in the United States. Am J Prev Med 2006; 31: 506-11. 17169712
- [11]Coben JH, Davis SM, Furbee PM, Sikora RD, Tillotson RD, Bossarte RM. Hospitalizations for poisoning by prescription opioids, sedatives, and tranquilizers. Am J Prev Med 2010; 38: 517-24. 20409500
- [13]Paulozzi LJ, Kilbourne EM, Desai HA. Prescription drug monitoring programs and death rates from drug overdose. Pain Med 2011; 12: 747-54. 21332934
- [14]Clausen T, Waal H, Thoresen M, Gossop M. Mortality among opiate users: opioid maintenance therapy, age and causes of death. Addiction 2009; 104: 1356-62. 19426288
- [16]Marshall BD, Milloy MJ, Wood E, Montaner JS, Kerr T. Reduction in overdose mortality after the opening of North America’s first medically supervised safer injecting facility: a retrospective population-based study. Lancet 2011; 377: 1429-37. 21497898
- [17]Centers for Disease Control and Prevention (CDC). Community-based opioid overdose prevention programs providing naloxone—United States, 2010. Morb Mortal Wkly Rep 2012; 61: 101-5. PMC4378715 22337174
- [19]Piper TM, Stancliff S, Rudenstine S, Sherman S, Nandi V, Clear A, et al. Evaluation of a naloxone distribution and administration program in New York City. Subst Use Misuse 2008; 43: 858-70. 18570021
- [21]Enteen L, Bauer J, McLean R, Wheeler E, Huriaux E, Kral AH, et al. Overdose prevention and naloxone prescription for opioid users in San Francisco. J Urban Health 2010; 87: 931-41. 20967505 PMC3005091
- [22]Bennett AS, Bell A, Tomedi L, Hulsey EG, Kral AH. Characteristics of an overdose prevention, response, and naloxone distribution program in Pittsburgh and Allegheny County, Pennsylvania. J Urban Health 2011; 88: 1020-30. 21773877 PMC3232410
- [23]Strang J, Manning V, Mayet S, Best D, Titherington E, Santana L, et al. Overdose training and take-home naloxone for opiate users: prospective cohort study of impact on knowledge and attitudes and subsequent management of overdoses. Addiction 2008; 103: 1648-57. 18821875
- [24]Green TC, Heimer R, Grau LE. Distinguishing signs of opioid overdose and indication for naloxone: an evaluation of six overdose training and naloxone distribution programs in the United States. Addiction 2008; 103: 979-89. 18422830 PMC3163671
- [25]Tobin KE, Sherman SG, Beilenson P, Welsh C, Latkin CA. Evaluation of the Staying Alive programme: training injection drug users to properly administer naloxone and save lives. Int J Drug Policy 2009; 20: 131-6. 18434126
- [26]Wagner KD, Valente TW, Casanova M, Partovi SM, Mendenhall BM, Hundley JH, et al. Evaluation of an overdose prevention and response training programme for injection drug users in the Skid Row area of Los Angeles, CA. Int J Drug Policy 2010; 21: 186-93. 19268564 PMC4291458
- [27]Maxwell S, Bigg D, Stanczykiewicz K, Carlberg-Racich S. Prescribing naloxone to actively injecting heroin users: a program to reduce heroin overdose deaths. J Addict Dis 2006; 25: 89-96. 16956873
- [28]Evans JL, Tsui JI, Hahn JA, Davidson PJ, Lum PJ, Page K. Mortality among young injection drug users in San Francisco: a 10-year follow-up of the UFO study. Am J Epidemiol 2012; 175: 302-8. 22227793 PMC3271816
- [32]Katz N, Panas L, Kim M, Audet AD, Bilansky A, Eadie J, et al. Usefulness of prescription monitoring programs for surveillance—analysis of schedule II opioid prescription data in Massachusetts, 1996-2006. Pharmacoepidemiol Drug Saf 2010; 19: 115-23. 20014166
- [33]Davoli M, Bargagli AM, Perucci CA, Schifano P, Belleudi V, Hickman M, et al. Risk of fatal overdose during and after specialist drug treatment: the VEdeTTE study, a national multi-site prospective cohort study Addiction 2007; 102: 1954-9. 18031430
- [34]Strang J, McCambridge J, Best D, Beswick T, Bearn J, Rees S, et al. Loss of tolerance and overdose mortality after inpatient opiate detoxification: follow up study. BMJ 2003; 326: 959-60. 12727768 PMC153851
- [35]Bailer AJ, Stayner LT, Stout NA, Reed LD, Gilbert SJ. Trends in rates of occupational fatal injuries in the United States (1983-92). Occup Environ Med 1998; 55: 485-9. 9816383 PMC1757606
- [36]Kuhn L, Davidson LL, Durkin MS. Use of Poisson regression and time series analysis for detecting changes over time in rates of child injury following a prevention program. Am J Epidemiol 1994; 140: 943-55. 7977282
- [37]Pan W. Akaike’s information criterion in generalized estimating equations. Biometrics 2001; 57: 120-5. 11252586
- [38]Morgan OW, Griffiths C, Majeed A. Interrupted time-series analysis of regulations to reduce paracetamol (acetaminophen) poisoning. PLoS Med 2007; 4: e105. 17407385 PMC1845154
- [39]O’Malley KJ, Cook KF, Price MD, Wildes KR, Hurdle JF, Ashton CM. Measuring diagnoses: ICD code accuracy. Health Serv Res 2005; 40: 1620-39. 16178999 PMC1361216
Cited by
Sorted by citations
CDC Guideline for Prescribing Opioids for Chronic Pain—United States, 2016
Dowell, D., Haegerich, T. M., & Chou, R. (2016) · JAMA · doi:10.1001/jama.2016.1464 · Cited by 5,161 · see citing works
CDC Guideline for Prescribing Opioids for Chronic Pain — United States, 2016
Dowell, D., Haegerich, T. M., & Chou, R. (2016) · MMWR. Recommendations and Reports · doi:10.15585/mmwr.rr6501e1 · Cited by 2,697 · see citing works
CDC Clinical Practice Guideline for Prescribing Opioids for Pain <b>—</b> United States, 2022
Dowell, D., Ragan, K. R., Jones, C. M., Baldwin, G. T., & Chou, R. (2022) · MMWR. Recommendations and Reports · doi:10.15585/mmwr.rr7103a1 · Cited by 1,886 · see citing works
Prevention and Treatment of Opioid Misuse and Addiction: A Review
Volkow, N. D., Jones, E. B., Einstein, E. B., & Wargo, E. M. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3126 · Cited by 596 · see citing works
The economic burden of opioid use disorder and fatal opioid overdose in the United States, 2017
Florence, C., Luo, F., & Rice, K. (2021) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2020.108350 · Cited by 511 · see citing works
“Naloxone distribution programs have been shown to reduce opioid mortality rates (Walley et al., 2013).”
BackgroundPeiper, N. C., Clarke, S. D., Vincent, L. B., Ciccarone, D., Kral, A. H., & Zibbell, J. E. (2019) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2018.08.007 · Cited by 317 · see citing works
Dowell, D., Zhang, K., Noonan, R. K., & Hockenberry, J. M. (2016) · Health Affairs · doi:10.1377/hlthaff.2016.0448 · Cited by 264 · see citing works
Haegerich, T. M., Paulozzi, L. J., Manns, B. J., & Jones, C. M. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2014.10.001 · Cited by 272 · see citing works
Touchpoints—opportunities to predict and prevent opioid overdose: a cohort study.
Larochelle, M. R., Bernstein, R., Bernson, D., Land, T., Stopka, T. J., Rose, A. J., Bharel, M., Liebschutz, J. M., & Walley, A. Y. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.06.039 · Cited by 189 · see citing works
State-Level Economic Costs of Opioid Use Disorder and Fatal Opioid Overdose — United States, 2017
Luo, F., Li, M., & Florence, C. (2021) · MMWR Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm7015a1 · Cited by 166 · see citing works
Barocas, J. A., White, L. F., Wang, J., Walley, A. Y., LaRochelle, M. R., Bernson, D., Land, T., Morgan, J. R., Samet, J. H., & Linas, B. P. (2018) · American Journal of Public Health · doi:10.2105/ajph.2018.304673 · Cited by 164 · see citing works
Self-citationBohnert, A. S. B., Bonar, E. E., Cunningham, R., Greenwald, M. K., Thomas, L., Chermack, S., Blow, F. C., & Walton, M. (2016) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2016.03.018 · Cited by 123 · see citing works
Impact of a community-based naloxone distribution program on opioid overdose death rates
Naumann, R. B., Durrance, C. P., Ranapurwala, S. I., Austin, A. E., Proescholdbell, S., Childs, R., Marshall, S. W., Kansagra, S., & Shanahan, M. E. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.06.038 · Cited by 112 · see citing works
Rowe, C., Santos, G.-M., Vittinghoff, E., Wheeler, E., Davidson, P., & Coffin, P. O. (2016) · Journal of Urban Health · doi:10.1007/s11524-015-0023-8 · Cited by 80 · see citing works
Medications for opioid use disorder: bridging the gap in care.
Volkow, N. D. (2018) · The Lancet · doi:10.1016/s0140-6736(17)32893-3 · Cited by 79 · see citing works
Projected estimates of opioid mortality after community-level interventions.
Linas, B. P., Savinkina, A., Madushani, R. W. M. A., Wang, J., Eftekhari Yazdi, G., Chatterjee, A., Walley, A. Y., Morgan, J. R., Epstein, R. L., Assoumou, S. A., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.37259 · Cited by 72 · see citing works
Strategies and policies to address the opioid epidemic: a case study of Ohio
Penm, J., MacKinnon, N. J., Boone, J. M., Ciaccia, A., McNamee, C., & Winstanley, E. L. (2017) · Journal of the American Pharmacists Association · doi:10.1016/j.japh.2017.01.001 · Cited by 73 · see citing works
The opioid epidemic in pediatrics: a 2020 update
Yaster, M., McNaull, P. P., & Davis, P. J. (2020) · Current Opinion in Anaesthesiology · doi:10.1097/aco.0000000000000865 · Cited by 56 · see citing works
Fischer, L. S., Asher, A., Stein, R., Becasen, J., Doreson, A., Mermin, J., Meltzer, M. I., & Edlin, B. R. (2025) · BMC Public Health · doi:10.1186/s12889-025-22210-8 · Cited by 59 · see citing works
Coffin, P. O., Santos, G.-M., Matheson, T., Behar, E., Rowe, C., Rubin, T., Silvis, J., & Vittinghoff, E. (2017) · PLoS ONE · doi:10.1371/journal.pone.0183354 · Cited by 44 · see citing works
Health behaviors of young adult heroin injectors in the Seattle area.
Cedarbaum, E. R., & Banta-Green, C. J. (2016) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.11.011 · Cited by 34 · see citing works
A qualitative examination of naloxone access in three states: Connecticut, Kentucky, and Wisconsin
Spector, A. L., Galletly, C. L., Christenson, E. A., Montaque, H. D. G., & Dickson-Gomez, J. (2022) · BMC Public Health · doi:10.1186/s12889-022-13741-5 · Cited by 22 · see citing works
Thylstrup, B., Hesse, M., Jørgensen, M., & Thiesen, H. (2019) · Harm Reduction Journal · doi:10.1186/s12954-019-0328-0 · Cited by 17 · see citing works
- Authors
- Walley, A. Y., Xuan, Z., Hackman, H. H., Quinn, E., Doe-Simkins, M., Sorensen-Alawad, A., Ruiz, S., & Ozonoff, A.
- Affiliations
- Boston University (US)
- Massachusetts Department of Public Health (US)
- Corresponding author
- Walley, A. Y.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2013-01-30
- Volume
- 346
- Issue
- jan30 5
- Pages
- f174-f174
- ISSN
- 1756-1833 (ISSN-L)
- PMC
- PMC4688551
- OpenAlex
- W2139852527
- Cited by
- 999
- References
- 2
- Citations by year
- 2026: 44 · 2025: 56 · 2024: 96 · 2023: 56 · 2022: 88 · 2021: 106 · 2020: 98 · 2019: 104 · 2018: 87 · 2017: 80 · 2016: 76 · 2015: 59 · 2014: 36 · 2013: 12
- FWCI
- 62.38
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- Bureau of Substance Addiction Services
- Centers for Disease Control and Prevention (1r21ce001602-01, 1R21CE001602)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Opioid Use Disorder Treatment
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Health Sciences › Medicine › Epidemiology › HIV, Drug Use, Sexual Risk
- Keywords
- opioid overdose, naloxone, opioid overdose deaths, bystander training, opioid overdose prevention, Massachusetts, harm reduction
- MeSH terms
- Adult, Allied Health Personnel, Analgesics, Opioid, Curriculum, Emergency Service, Hospital, Female, Health Education, Hospitalization, Humans, Male, Massachusetts, Naloxone, Narcotic Antagonists, Survival Rate, Harm Reduction, Prescription Drugs, Drug Overdose
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review