Long-Term Sustainability of Evidence-Based Prevention Interventions and Community Coalitions Survival: a Five and One-Half Year Follow-up Study
Abstract
This study examines (1) coalition survival, (2) prevalence of evidence-based prevention interventions (EBPIs) to reduce substance abuse implemented as part of the Tennessee Strategic Prevention Framework (SPF) State Incentive Grant (SIG), (3) EBPI sustainability, and (4) factors that predict EBPI sustainability. Secondary data were collected on 27 SPF SIG-funded coalitions and 88 EBPI and non-EBPI implementations. Primary data were collected by a telephone interview/web survey five and one-half years after the SPF SIG ended. Results from secondary data show that 25 of the 27 coalitions survived beyond the SPF SIG for one to five and one-half years; 19 coalitions (70%) were still active five and one-half years later. Further, 88 EBPIs and non-EBPIs were implemented by 27 county SPF SIG coalitions. Twenty-one (21) of 27 coalitions (78%) implemented one to three EBPIs, totaling 37 EBPI implementations. Based on primary survey data on 29 of the 37 EBPI implementations, 28 EBPIs (97%) were sustained between two and five and one-half years while 22 EBPI implementations (76%) were sustained for five and one-half years. When controlling for variability among coalitions (nesting of EBPIs in coalitions), increases in data resources (availability of five types of prevention data) was a strong predictor of length of EBPI sustainability. Positive change in extramural funding resources and level of expertise during SPF SIG implementation, as well as level of coalition formalization at the end of the SPF SIG predicted EBPI sustainability length. One intervention attribute (trialability) also predicted length of sustainability. Implications are discussed.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Studies suggest that some factors may be uniquely important for sustaining coalitions, including board/team functioning, data/evaluation resources, and planning for sustainability.
“Studies suggest that some factors may be uniquely important for sustaining coalitions, including board/team functioning, data/evaluation resources, and planning for sustainability (56, 64, 96, 127, 145).”
From The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care (2018) · cites this paper as [64]
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,588 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,385 · see citing works
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,555 · see citing works
Gentleman R: R: A language for data analysis and graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,747 · see citing works
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
Hinkemeyer, M. T. (1971) · The Clearing House A Journal of Educational Strategies Issues and Ideas · doi:10.1080/00098655.1971.11478291 · Cited by 1,852 · see citing works
Things I have learned (so far).
Cohen, J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.12.1304 · Cited by 1,781 · see citing works
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355 · see citing works
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338 · see citing works
An Agenda for Research on the Sustainability of Public Health Programs
Scheirer, M. A., & Dearing, J. W. (2011) · American Journal of Public Health · doi:10.2105/ajph.2011.300193 · Cited by 775 · see citing works
Is Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability
Scheirer, M. A. (2005) · American Journal of Evaluation · doi:10.1177/1098214005278752 · Cited by 710 · see citing works
Reviews of evidence regarding interventions to reduce alcohol-impaired driving
Shults, R. A., Elder, R. W., Sleet, D. A., Nichols, J. L., Alao, M. O., Carande-Kulis, V. G., Zaza, S., Sosin, D. M., & Thompson, R. S. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(01)00381-6 · Cited by 666 · see citing works
Bradford, N., Caffery, L. J., & Smith, A. C. (2016) · Rural and Remote Health · doi:10.22605/rrh3808 · Cited by 412 · see citing works
Building capacity and sustainable prevention innovations: a sustainability planning model
Johnson, K., Hays, C., Center, H., & Daley, C. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.01.002 · Cited by 411 · see citing works
Self-citationA PRACTICAL IMPLEMENTATION SCIENCE HEURISTIC FOR ORGANIZATIONAL READINESS: R = MC 2
Scaccia, J., Cook, B. S., Lamont, A. E., Wandersman, A., Castellow, J., Katz, J., & Beidas, R. S. (2015) · Journal of Community Psychology · doi:10.1002/jcop.21698 · Cited by 396 · see citing works
Self-citationThe Program Sustainability Assessment Tool: A New Instrument for Public Health Programs
Luke, D. A., Calhoun, A., Robichaux, C. B., Elliott, M. B., & Moreland-Russell, S. (2014) · Preventing Chronic Disease · doi:10.5888/pcd11.130184 · Cited by 364 · see citing works
Long-Term Sustainability of Evidence-Based Practices in Community Mental Health Agencies
Bond, G. R., Drake, R. E., McHugo, G. J., Peterson, A. E., Jones, A. M., & Williams, J. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0461-5 · Cited by 172 · see citing works
Improving Survey Methods: Lessons from Recent Research
Olson, K. M. (2016) · Journal of Official Statistics · doi:10.1515/jos-2016-0054 · Cited by 139 · see citing works
National Registry of Evidence-based Programs and Practices
Fisher, G. L., & Roget, N. A. (2009) · doi:10.4135/9781412964500.n218 · Cited by 118 · see citing works
Sustaining Evidence-Based Prevention Programs: Correlates in a Large-Scale Dissemination Initiative
Cooper, B. R., Bumbarger, B. K., & Moore, J. E. (2015) · Prevention Science · doi:10.1007/s11121-013-0427-1 · Cited by 117 · see citing works
Predictors and Level of Sustainability of Community Prevention Coalitions
Feinberg, M. E., Bontempo, D. E., & Greenberg, M. T. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.01.030 · Cited by 97 · see citing works
Tibbits, M. K., Bumbarger, B. K., Kyler, S. J., & Perkins, D. F. (2010) · Prevention Science · doi:10.1007/s11121-010-0170-9 · Cited by 86 · see citing works
Trends: Covering Mental Health And Substance Abuse Services
Buck, J. A., & Umland, B. (1997) · Health Affairs · doi:10.1377/hlthaff.16.4.120 · Cited by 71 · see citing works
Determinants of Community Coalition Ability to Support Evidence-Based Programs
Brown, L. D., Feinberg, M. E., & Greenberg, M. T. (2010) · Prevention Science · doi:10.1007/s11121-010-0173-6 · Cited by 63 · see citing works
Peterson, A. E., Bond, G. R., Drake, R. E., McHugo, G. J., Jones, A. M., & Williams, J. R. (2014) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-013-9347-x · Cited by 60 · see citing works
McIntosh, K., Kim, J., Mercer, S. H., Strickland-Cohen, M. K., & Horner, R. H. (2014) · Assessment for Effective Intervention · doi:10.1177/1534508414556503 · Cited by 59 · see citing works
Implementing Effective Community-Based Prevention Programs in the Community Youth Development Study
Fagan, A. A., Hanson, K. G., Hawkins, J. D., & Arthur, M. W. (2008) · Youth Violence and Juvenile Justice · doi:10.1177/1541204008315937 · Cited by 55 · see citing works
Gloppen, K. M., Arthur, M. W., Hawkins, J. D., & Shapiro, V. B. (2012) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2011.12.018 · Cited by 52 · see citing works
Livet, M., Courser, M. W., & Wandersman, A. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9164-1 · Cited by 50 · see citing works
Self-citationEstimation of Mode Effects in the Health and Retirement Study Using Measurement Models
Cernat, A., Couper, M. P., & Ofstedal, M. B. (2016) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smw021 · Cited by 49 · see citing works
Greenberg, M. T., Feinberg, M. E., Johnson, L. E., Perkins, D. F., Welsh, J. A., & Spoth, R. L. (2015) · Prevention Science · doi:10.1007/s11121-014-0483-1 · Cited by 33 · see citing works
Lean, M., Leavey, G., Killaspy, H. T., Green, N., Harrison, I., Cook, S., Craig, T., Holloway, F. A., Arbuthnott, M., & King, M. (2015) · BMC Psychiatry · doi:10.1186/s12888-015-0592-9 · Cited by 33 · see citing works
Blanchet, K., & James, P. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-77 · Cited by 31 · see citing works
Coalitional Capacities and Environmental Strategies to Prevent Underage Drinking
Nargiso, J. E., Friend, K. B., Egan, C. A., Florin, P. R., Stevenson, J. F., Amodei, B., & Barovier, L. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9536-4 · Cited by 29 · see citing works
Flewelling, R. L., & Hanley, S. M. (2016) · Prevention Science · doi:10.1007/s11121-016-0675-y · Cited by 29 · see citing works
SUSTAINING INNOVATIONS IN COMMUNITY PREVENTION SYSTEMS: A DATA‐INFORMED SUSTAINABILITY STRATEGY
Johnson, K., Collins, D., & Wandersman, A. (2013) · Journal of Community Psychology · doi:10.1002/jcop.21540 · Cited by 20 · see citing works
Self-citationSUSTAINING ADOPTION OF SCIENCE-BASED PREVENTION THROUGH COMMUNITIES THAT CARE
Gloppen, K. M., Brown, E. C., Wagenaar, B. H., Hawkins, J. D., Rhew, I. C., & Oesterle, S. (2015) · Journal of Community Psychology · doi:10.1002/jcop.21743 · Cited by 15 · see citing works
Strategies to Reduce Underage Alcohol Use: Typology and Brief Overview
Stewart, K. (1999) · Cited by 14 · see citing works
Edwards, J. M., Stein-Seroussi, A., Flewelling, R. L., Orwin, R. G., & Zhang, L. (2015) · The Journal of Primary Prevention · doi:10.1007/s10935-015-0382-7 · Cited by 13 · see citing works
Menold, N., Winker, P., Storfinger, N., et al. (2014) · Routledge eBooks · doi:10.4324/9781315756288-10 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014731 · Cited by 806 · see citing works
- Authors
- Johnson, K., Collins, D., Shamblen, S., Kenworthy, T., & Wandersman, A.
- Affiliations
- Pacific Institute For Research and Evaluation (US)
- University of South Carolina (US)
- Corresponding author
- Johnson, Knowlton
- Venue
- Prevention Science
- Published
- 2017-04-11
- Volume
- 18
- Issue
- 5
- Pages
- 610-621
- ISSN
- 1389-4986 (ISSN-L)
- 1573-6695
- OpenAlex
- W2607129793
- Cited by
- 23
- References
- 42
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 3 · 2023: 3 · 2022: 3 · 2021: 2 · 2020: 5 · 2018: 3
- FWCI
- 3.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Prevention Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Pacific Institute for Research and Evaluation (US)
- University of South Carolina
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Health Sciences › Health Professions › General Health Professions › Community Health and Development
- Keywords
- intervention sustainability, community coalitions, substance use prevention, extramural funding, trialability, long-term follow-up
- MeSH terms
- Follow-Up Studies, Humans, Substance-Related Disorders, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review