The DOI matches its Crossref record; 65 of the 66 references it cites were found in a registry or an index.
Evidence-based intervention sustainability strategies: a systematic review
Open accessAbstract
BACKGROUND: Sustainability of evidence-based interventions (EBI) remains a challenge for public health community-based institutions. The conceptual definition of sustainment is not universally agreed upon by researchers and practitioners, and strategies utilized to facilitate sustainment of EBI are not consistently reported in published literature. Given these limitations in the field, a systematic review was conducted to summarize the existing evidence supporting discrete sustainment strategies for public health EBIs and facilitating and hindering factors of sustainment. METHODS: We searched PsychINFO, Embase, ProQuest, PubMed, and Google Scholar. The initial search was run in March 2017 and an update was done in March 2019. Study eligibility criteria included (a) public health evidence-based interventions, (b) conducted in the community or community-based settings, and (c) reported outcomes related to EBI sustainment. Details characterizing the study setting, design, target population, and type of EBI sustained were extracted. RESULTS: A total of 26 articles published from 2004 to 2019 were eligible for data extraction. Overall, the importance of sustainability was acknowledged across all of the studies. However, only seven studies presented a conceptual definition of sustainment explicitly within the text. Six of the included studies reported specific sustainment strategies that were used to facilitate the sustainment of EBI. Only three of the studies reported their activities related to sustainment by referencing a sustainment framework. Multiple facilitators (i.e., adaptation/alignment, funding) and barriers (i.e., limited funding, limited resources) were identified as influencing EBI sustainment. The majority (n = 20) of the studies were conducted in high-income countries. Studies from low-income countries were mostly naturalistic. All of the studies from low-income countries reported lack of funding as a hindrance to sustainment. IMPLICATION FOR DISSEMINATION AND IMPLEMENTATION RESEARCH: Literature focused on sustainment of public health EBIs should present an explicit definition of the concept. Better reporting of the framework utilized, steps followed, and adaptations made to sustain the intervention might contribute to standardizing and developing the concept. Moreover, encouraging longitudinal dissemination and implementation (D&I) research especially in low-income countries might help strengthen D&I research capacity in public health settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, the health benefits of the intervention may not last over an extended period after the intervention is terminated, raising concerns about sustainability [63].”
From Effectiveness of an Internet-Based Acceptance and Commitment Therapy Intervention for Reducing Psychological Distress in Health Care Professionals: Randomized Controlled Trial (2024) · cites this paper as [63]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Extensive implementation research suggests that even when the challenges of implementing EBPs with fidelity have been surmounted, it is difficult to maintain consistent use, as well as intended effects, over longer periods of time (56).”
From The Renfrew Unified Treatment for Eating Disorders and Comorbidity: Long-Term Effects of an Evidence-Based Practice Implementation in Residential Treatment (2021) · cites this paper as [56]
Experimental — accuracy not yet measuredIn the citing paper
“Reported influences on sustainability include characteristics of the innovation and the individuals involved, leadership, capacity, processes, and context [2, 9, 13, 14].”
From Factors influencing sustainability and scale-up of rural primary healthcare memory clinics: perspectives of clinic team members (2022) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
(2005) · Cited by 3,748
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
Knowledge translation of research findings
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-50 · Cited by 2,407
Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724
Managing Clinical Knowledge for Health Care Improvement
Balas, E. A., & Boren, S. A. (2000) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1637943 · Cited by 1,479
What drives change? Barriers to and incentives for achieving evidence‐based practice
Grol, R., & Wensing, M. (2004) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2004.tb05948.x · Cited by 1,378
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355
Shediac-Rizkallah, M. C., & Bone, L. R. (1998) · Health Education Research · doi:10.1093/her/13.1.87 · Cited by 1,129
Evidence-Based Public Health: Moving Beyond Randomized Trials
Victora, C. G., Habicht, J.-P., & Bryce, J. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.400 · Cited by 1,056
The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014731 · Cited by 806
An Agenda for Research on the Sustainability of Public Health Programs
Scheirer, M. A., & Dearing, J. W. (2011) · American Journal of Public Health · doi:10.2105/ajph.2011.300193 · Cited by 775
Understanding Evidence-Based Public Health Policy
Brownson, R. C., Chriqui, J. F., & Stamatakis, K. A. (2009) · American Journal of Public Health · doi:10.2105/ajph.2008.156224 · Cited by 727
Is Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability
Scheirer, M. A. (2005) · American Journal of Evaluation · doi:10.1177/1098214005278752 · Cited by 710
A Glossary for Dissemination and Implementation Research in Health
Rabin, B. A., Brownson, R. C., Haire-Joshu, D., Kreuter, M. W., & Weaver, N. L. (2008) · Journal of Public Health Management and Practice · doi:10.1097/01.phh.0000311888.06252.bb · Cited by 676
Kilbourne, A. M., Neumann, M. S., Pincus, H. A., Bauer, M. S., & Stall, R. (2007) · Implementation Science · doi:10.1186/1748-5908-2-42 · Cited by 653
Developing a comprehensive definition of sustainability
Moore, J. E., Mascarenhas, A., Bain, J., & Straus, S. E. (2017) · Implementation Science · doi:10.1186/s13012-017-0637-1 · Cited by 630
Public health program capacity for sustainability: a new framework
Schell, S. F., Luke, D. A., Schooley, M. W., Elliott, M. B., Herbers, S. H., Mueller, N. B., & Bunger, A. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-15 · Cited by 563
Assessing the Risk of Bias of Individual Studies in Systematic Reviews of Health Care Interventions
Viswanathan, M., Patnode, C. D., Berkman, N. D., Bass, E. B., Chang, S., Hartling, L., Murad, M. H., Treadwell, J. R., & Kane, R. L. (2017) · doi:10.23970/ahrqepcmethguide2 · Cited by 454
Proctor, E., Luke, D., Calhoun, A., McMillen, C., Brownson, R., McCrary, S., & Padek, M. (2015) · Implementation Science · doi:10.1186/s13012-015-0274-5 · Cited by 429
A guiding framework and approach for implementation research in substance use disorders treatment.
Damschroder, L. J., & Hagedorn, H. J. (2011) · Psychology of Addictive Behaviors · doi:10.1037/a0022284 · Cited by 427
Lennox, L., Maher, L., & Reed, J. (2018) · Implementation Science · doi:10.1186/s13012-017-0707-4 · Cited by 421
Sustainability science: an integrated approach for health-programme planning
Gruen, R. L., Elliott, J. H., Nolan, M. L., Lawton, P. D., Parkhill, A., McLaren, C. J., & Lavis, J. N. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61659-1 · Cited by 395
Pai, M., Lloyd, N. S., Cheng, J., Thabane, L., Spencer, F. A., Cook, D. J., Haynes, R. B., Schünemann, H. J., & Douketis, J. D. (2013) · Implementation Science · doi:10.1186/1748-5908-8-1 · Cited by 376
Making public health programs last: conceptualizing sustainability
Pluye, P., Potvin, L., & Denis, J.-L. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.01.001 · Cited by 374
A glossary for evidence based public health
Rychetnik, L., Hawe, P., Waters, E., Barratt, A. L., & Frommer, M. (2004) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2003.011585 · Cited by 349
Publication bias: what is it? How do we measure it? How do we avoid it?
Song, F., Hooper, L., & Loke, Y. K. (2013) · Open Access Journal of Clinical Trials · doi:10.2147/oajct.s34419 · Cited by 298
Aarons, G. A., Green, A. E., Trott, E., Willging, C. E., Torres, E. M., Ehrhart, M. G., & Roesch, S. C. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0751-4 · Cited by 251
Kohatsu, N. D., Robinson, J. G., & Torner, J. (2004) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2004.07.019 · Cited by 250
Yamey, G. (2012) · Globalization and Health · doi:10.1186/1744-8603-8-11 · Cited by 229
Doyle, C., Howe, C., Woodcock, T., Myron, R., Phekoo, K., McNicholas, C., Saffer, J., & Bell, D. (2013) · Implementation Science · doi:10.1186/1748-5908-8-127 · Cited by 166
Translating research into practice: speeding the adoption of innovative health care programs.
Bradley, E. H., Webster, T. R., Baker, D. I., Schlesinger, M. J., Inouye, S. K., Barth, M. C., Lapane, K. L., Lipson, D., Stone, R., & Koren, M. J. (2004) · PubMed · Cited by 156
Green, L. W., Glasgow, R. E., Atkins, D. C., & Stange, K. C. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.08.017 · Cited by 153
Hodge, L. M., & Turner, K. M. T. (2016) · American Journal of Community Psychology · doi:10.1002/ajcp.12082 · Cited by 120
Evidence-based public health: what does it offer developing countries?
McMichael, C., Waters, E., & Volmink, J. (2005) · Journal of Public Health · doi:10.1093/pubmed/fdi024 · Cited by 115
Moving Treatment Research From Clinical Trials to the Real World
Roy‐Byrne, P., Sherbourne, C. D., Craske, M. G., Stein, M. B., Katon, W. J., Sullivan, G., Means‐Christensen, A. J., & Bystritsky, A. (2003) · Psychiatric Services · doi:10.1176/appi.ps.54.3.327 · Cited by 105
Achieving sustainability of community-based dengue control in Santiago de Cuba
Romaní, M. E. T., Vanlerberghe, V., Pérez, D., Lefèvre, P., Ceballos, E., Bandera, D., Gil, A. B., & der Stuyft, P. V. (2006) · Social Science & Medicine · doi:10.1016/j.socscimed.2006.10.033 · Cited by 94
Easier Said than Done: Intervention Sustainability in an Urban After-School Program
Lyon, A. R., Frazier, S. L., Mehta, T. G., Atkins, M. S., & Weisbach, J. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0339-y · Cited by 87
MacDonald, M., Pauly, B., Wong, G., Schick‐Makaroff, K., van Roode, T., Strosher, H., Kothari, A. R., Valaitis, R. K., Manson, H. E., O’Briain, W., et al. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0229-1 · Cited by 84
August, G. J., Bloomquist, M. L., Lee, S. S., Realmuto, G. M., & Hektner, J. M. (2006) · Prevention Science · doi:10.1007/s11121-005-0024-z · Cited by 83
Terminology for Dissemination and Implementation Research
Rabin, B. A., & Brownson, R. C. (2017) · Oxford University Press eBooks · doi:10.1093/oso/9780190683214.003.0002 · Cited by 78
Sustainability of Public Health Programs: The Example of Tobacco Treatment Services in Massachusetts
LaPelle, N. R., Zapka, J. G., & Ockene, J. K. (2006) · American Journal of Public Health · doi:10.2105/ajph.2005.067124 · Cited by 73
Bradley, E. H., Webster, T. R., Baker, D. I., Schlesinger, M. J., & Inouye, S. K. (2005) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2005.53451.x · Cited by 67
Fagan, A. A., Hanson, K. G., Briney, J. S., & Hawkins, J. D. (2011) · American Journal of Community Psychology · doi:10.1007/s10464-011-9463-9 · Cited by 55
The IPS Learning Community: A Longitudinal Study of Sustainment, Quality, and Outcome
Bond, G. R., Drake, R. E., Becker, D. R., & Noel, V. A. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201500301 · Cited by 51
Palinkas, L. A., Weisz, J. R., Chorpita, B. F., Levine, B., Garland, A. F., Hoagwood, K., & Landsverk, J. A. (2013) · Psychiatric Services · doi:10.1176/appi.ps.004682012 · Cited by 50
Bergmark, M., Bejerholm, U., & Markström, U. (2018) · Social Work in Mental Health · doi:10.1080/15332985.2018.1511500 · Cited by 49
Evaluation and Sustainability of the Healthy Learners Asthma Initiative
Splett, P. L., Erickson, C. D., Belseth, S. B., & Jensen, C. S. (2006) · Journal of School Health · doi:10.1111/j.1746-1561.2006.00112.x · Cited by 40
Ahluwalia, I. B., Robinson, D., Vallely, L. M., Gieseker, K. E., & Kabakama, A. (2010) · Global Health Promotion · doi:10.1177/1757975909356627 · Cited by 36
Blanchet, K., & James, P. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-77 · Cited by 31
IMCI what can we learn from an innovation that didn't reach the poor?
Gwatkin, D. R. (2006) · Bulletin of the World Health Organization · doi:10.2471/blt.06.035006 · Cited by 27
Partnering for Success and Sustainability in Community-Based Child Obesity Intervention
Grow, H. M., Hencz, P., Verbovski, M. J., Gregerson, L., Liu, L. L., Dossett, L., Larison, C. L., & Saelens, B. E. (2014) · Family & Community Health · doi:10.1097/fch.0000000000000010 · Cited by 22
Examination of sustainability indicators for fall prevention strategies in three states
Smith, M. L., Durrett, N. K., Schneider, E. C., Byers, I. N., Shubert, T. E., Wilson, A. D., Towne, S. D., & Ory, M. G. (2018) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2018.02.001 · Cited by 22
Dollaghan, C. (2019) · The SAGE Encyclopedia of Human Communication Sciences and Disorders · doi:10.4135/9781483380810.n240 · Cited by 22
Translation and sustainability of an HIV prevention intervention in Lusaka, Zambia
Vamos, S., Mumbi, M., Cook, R., Chitalu, N. W., Weiss, S. M., & Jones, D. L. (2013) · Translational Behavioral Medicine · doi:10.1007/s13142-013-0237-9 · Cited by 17
Llauradó, E., Aceves‐Martins, M., Tarro, L., Papell-Garcia, I., Puiggròs, F., Prades‐Tena, J., Kettner-Høeberg, H., Arola, L., Giralt, M., & Solà, R. (2018) · Translational Behavioral Medicine · doi:10.1093/tbm/ibx065 · Cited by 11
Challenges of Implementing Evidence-Based Practice in the Developing World
Santmyire, A. (2013) · The Journal for Nurse Practitioners · doi:10.1016/j.nurpra.2013.04.001 · Cited by 5
Handbook of Library Training Practice and Development: Volume Three
Brine, A. (2012) · Cited by 4
Challenges for Evidence-Based Care for Children With Developmental Delays in Nicaragua
Salinas‐Miranda, A., Storch, E. A., Nelson, R., & Evans-Baltodano, C. (2014) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.28.3.226 · Cited by 2
Research works printed but not linked: 2
- Qualtrics L. Qualtrics: online survey software & insight platform; 2014.
- Inc S. SPSS Base 14.0 user’s guide: Prentice Hall; 2005.
Cited by
Sorted by citations
The updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
Application of bibliometrics in medicine: a historical bibliometrics analysis
Kokol, P., Vošner, H. B., & Završnik, J. (2020) · Health Information & Libraries Journal · doi:10.1111/hir.12295 · Cited by 538
Klaic, M., Kapp, S., Hudson, P., Chapman, W. W., Denehy, L., Story, D., & Francis, J. (2022) · Implementation Science · doi:10.1186/s13012-021-01171-7 · Cited by 443
Cassar, S., Salmon, J., Timperio, A. F., Naylor, P., van Nassau, F., Ayala, A. M. C., & Koorts, H. (2019) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-019-0876-4 · Cited by 313
Shoesmith, A., Hall, A. E., Wolfenden, L., Shelton, R. C., Powell, B. J., Brown, H., McCrabb, S., Sutherland, R., Yoong, S. L., Lane, C., et al. (2021) · Implementation Science · doi:10.1186/s13012-021-01134-y · Cited by 218
Metadata
- Authors
- Hailemariam, M., Bustos, T., Montgomery, B., Barajas, R., Evans, L. B., & Drahota, A.
- Affiliations
- Michigan State University (US)
- Corresponding author
- Hailemariam, Maji
- Venue
- Implementation Science
- Published
- 2019-06-06
- Volume
- 14
- Issue
- 1
- Pages
- 57-57
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC6554955
- OpenAlex
- W2948464760
- Cited by
- 398
- References
- 66
- Citations by year
- 2026: 43 · 2025: 70 · 2024: 72 · 2023: 73 · 2022: 59 · 2021: 47 · 2020: 25 · 2019: 5
- FWCI
- 6.25
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute on Minority Health and Health Disparities (U54MD011227)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Public Health Policies and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Community Health and Development
- Keywords
- evidence-based interventions, intervention sustainability, public health interventions, community-based intervention, barriers and facilitators, financial constraints, low-income countries, dissemination and implementation research
- MeSH terms
- Health Plan Implementation, Humans, Public Health, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
