The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research
Open accessThe DOI matches its Crossref record; 210 of the 211 references it cites were found in a registry or an index.
Abstract
Background: The introduction of evidence-based programs and practices into healthcare settings has been the subject of an increasing amount of research in recent years. While a number of studies have examined initial implementation efforts, less research has been conducted to determine what happens beyond that point. There is increasing recognition that the extent to which new programs are sustained is influenced by many different factors and that more needs to be known about just what these factors are and how they interact. To understand the current state of the research literature on sustainability, our team took stock of what is currently known in this area and identified areas in which further research would be particularly helpful. This paper reviews the methods that have been used, the types of outcomes that have been measured and reported, findings from studies that reported long-term implementation outcomes, and factors that have been identified as potential influences on the sustained use of new practices, programs, or interventions. We conclude with recommendations and considerations for future research. Methods: Two coders identified 125 studies on sustainability that met eligibility criteria. An initial coding scheme was developed based on constructs identified in previous literature on implementation. Additional codes were generated deductively. Related constructs among factors were identified by consensus and collapsed under the general categories. Studies that described the extent to which programs or innovations were sustained were also categorized and summarized. Results: Although "sustainability" was the term most commonly used in the literature to refer to what happened after initial implementation, not all the studies that were reviewed actually presented working definitions of the term. Most study designs were retrospective and naturalistic. Approximately half of the studies relied on self-reports to assess sustainability or elements that influence sustainability. Approximately half employed quantitative methodologies, and the remainder employed qualitative or mixed methodologies. Few studies that investigated sustainability outcomes employed rigorous methods of evaluation (e.g., objective evaluation, judgement of implementation quality or fidelity). Among those that did, a small number reported full sustainment or high fidelity. Very little research has examined the extent, nature, or impact of adaptations to the interventions or programs once implemented. Influences on sustainability included organizational context, capacity, processes, and factors related to the new program or practice themselves. Conclusions: Clearer definitions and research that is guided by the conceptual literature on sustainability are critical to the development of the research in the area. Further efforts to characterize the phenomenon and the factors that influence it will enhance the quality of future research. Careful consideration must also be given to interactions among influences at multiple levels, as well as issues such as fidelity, modification, and changes in implementation over time. While prospective and experimental designs are needed, there is also an important role for qualitative research in efforts to understand the phenomenon, refine hypotheses, and develop strategies to promote sustainment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“findings indicating that incomplete penetration and sustainment are the norm (Stirman et al., 2012)”
From User‐centered design for psychosocial intervention development and implementation. (2016) · cites this paper as Stirman et al., 2012
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A number of literature reviews of implementation frameworks have also been conducted, concentrating on particular implementation concepts, such as a particular stage, or specifically on either the factors, strategies or evaluations, rather than addressing all the concepts that could affect an innovation’s implementation [13,17,19-26].”
From A systematic review of implementation frameworks of innovations in healthcare and resulting generic implementation framework (2015) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Despite the significant investment of staff time and other resources, many promising initiatives fail to sustain and do not produce long term benefits [1–6].”
From Navigating the sustainability landscape: a systematic review of sustainability approaches in healthcare (2018) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Overall, fewer than half of the programs continued at high levels of fidelity.”
From The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care (2018) · cites this paper as [135]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In a systematic review of 125 empirical studies focused on the sustainability of public health and clinical interventions (135), researchers found that even when full implementation was originally achieved, partial sustainability was much more common than the continued implementation of the entire intervention.”
From The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care (2018) · cites this paper as [135]
Experimental — accuracy not yet measured
18 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 2×
“61 to 1 ("moderate” to “almost perfect” [45]) on more specific categories, which were later collapsed into the three broad categories.”
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 2×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Exploration and Exploitation in Organizational Learning
March, J. G. (1991) · Organization Science · doi:10.1287/orsc.2.1.71 · Cited by 21,942
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Organizational culture and leadership
(1993) · Long Range Planning · doi:10.1016/0024-6301(93)90120-5 · Cited by 16,462
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 2×
“In contrast to the relatively consistent emphasis on characteristics of the innovation within conceptualizations of sustainability and the broader implementation literature, fewer studies than expected found that characteristics of the innovation were associated with sustainability [3,9,64].”
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 13,723
Organizational Culture and Leadership
Tierney, W. G., & Schein, E. H. (1986) · The Academy of Management Review · doi:10.2307/258322 · Cited by 9,601
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · cited 5×
“Additionally, we examined papers that had cited influential models or reviews of implementation or sustainability [2,3,5,19,25,30-32].”
InfluentialEvaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · cited 2×
“Most of the studies we reviewed examined sustainability two or more years after implementation, consistent with suggestions in the literature [24].”
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304 · cited 1×
“We also employed a snowballing strategy, in which we searched the reference sections of reviews and theoretical papers on implementation and sustainability [2-4,19,23,25,28,29] and those found in our review.”
The quality of health care delivered to adults in the United States
McGlynn, E. A., Asch, S. M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., & Kerr, E. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa022615 · Cited by 5,079
An organizational learning framework: From intuition to institution
Crossan, M. M., Lane, H. W., & White, R. E. (1999) · The Academy of Management Review · doi:10.2307/259140 · Cited by 4,544
(2005) · Cited by 3,748
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
The Improvement Guide: A Practical Approach to Enhancing Organizational Performance
(1997) · Quality Management Journal · doi:10.1080/10686967.1998.11919154 · Cited by 2,895
On Studying Organizational Cultures
Pettigrew, A. M. (1979) · Administrative Science Quarterly · doi:10.2307/2392363 · Cited by 2,498 · cited 1×
“Additionally, we examined papers that had cited influential models or reviews of implementation or sustainability [2,3,5,19,25,30-32].”
Kimberly, J. R., & Evanisko, M. J. (1981) · Academy of Management Journal · doi:10.2307/256170 · Cited by 2,468 · cited 1×
“, “de-adoption,” “divestment,” “exnovation,” and “discontinuation” [6,26,27]).”
Self-citationGlanz, K., & Bishop, D. B. (2010) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.012809.103604 · Cited by 2,336
Planning health promotion programs an intervention mapping approach
Bartholomew, L. K., Parcel, G. S., Kok, G., & Gottlieb, N. (2006) · Research Publications (Maastricht University) · Cited by 2,310
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894 · cited 4×
“Additionally, we examined papers that had cited influential models or reviews of implementation or sustainability [2,3,5,19,25,30-32].”
InfluentialDevelopmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use
Patton, M. Q. (2010) · Cited by 1,740
Dusenbury, L. (2003) · Health Education Research · doi:10.1093/her/18.2.237 · Cited by 1,671 · cited 1×
“These findings suggest that the development and study of fidelity-maintenance strategies, such as training and supervision, audit and feedback, building triggers into the process of care, checklists, or reminders, may be particularly important for the sustainment of interventions that require a high degree of fidelity…”
Testing ecological models: the meaning of validation
Rykiel, E. J. (1996) · Ecological Modelling · doi:10.1016/0304-3800(95)00152-2 · Cited by 1,279
Shediac-Rizkallah, M. C., & Bone, L. R. (1998) · Health Education Research · doi:10.1093/her/13.1.87 · Cited by 1,129
A Randomized Trial of Methods to Help Clinicians Learn Motivational Interviewing.
Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.6.1050 · Cited by 1,075 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Feldstein, A. C., & Glasgow, R. E. (2008) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(08)34030-6 · Cited by 987 · cited 1×
“An initial coding scheme was developed based on constructs identified in previous conceptualizations of implementation [2-4,9,34,35] and sustainability [4,5,17,20,36-44].”
Windows of Opportunity: Temporal Patterns of Technological Adaptation in Organizations
Tyre, M. J., & Orlikowski, W. J. (1994) · Organization Science · doi:10.1287/orsc.5.1.98 · Cited by 971
Moher, D. (2009) · Journal of Chinese Integrative Medicine · doi:10.3736/jcim20090918 · Cited by 909
McHugh, R. K., & Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0018121 · Cited by 909 · cited 1×
“Why do some take root and flourish while others languish? Recognizing the need to promote the use of best practices to achieve better outcomes in healthcare, many government agencies and community organizations have devoted significant resources to promoting research on evidence-based practices (EBPs), clinical guidel…”
The improvement guide : a practical approach to enhancing organizational performance
Langley, G. J. (1996) · Jossey-Bass Publishers eBooks · Cited by 875
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873 · cited 3×
“Fidelity has been conceptualized in the mental health literature as a combination of adherence to a prescribed set of practices at adequate dose or intensity, competence in delivery, and differentiation from other interventions [59,74], with judgments of competence taking response to certain contextual factors into ac…”
An Agenda for Research on the Sustainability of Public Health Programs
Scheirer, M. A., & Dearing, J. W. (2011) · American Journal of Public Health · doi:10.2105/ajph.2011.300193 · Cited by 775
Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.65.5.821 · Cited by 755 · cited 1×
“These findings suggest that the development and study of fidelity-maintenance strategies, such as training and supervision, audit and feedback, building triggers into the process of care, checklists, or reminders, may be particularly important for the sustainment of interventions that require a high degree of fidelity…”
Is Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability
Scheirer, M. A. (2005) · American Journal of Evaluation · doi:10.1177/1098214005278752 · Cited by 710 · cited 6×
“Additionally, we examined papers that had cited influential models or reviews of implementation or sustainability [2,3,5,19,25,30-32].”
InfluentialGlisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0148-5 · Cited by 608 · cited 2×
“Finally, given the amount of discussion on leadership, organizational climate, and culture in the literature on implementation and sustainability [5,20,35,39,65,66], we expected greater representation of these constructs in the studies that were reviewed.”
Botvin, G. J., Baker, E., Dusenbury, L., & Tortu, S. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.58.4.437 · Cited by 565 · cited 1×
“Other [9,32,46-56] 12”
Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.829 · Cited by 533 · cited 1×
“Several types of modification, at either a molecular or molar level [74,88], may occur as practitioners, communities, and systems implement specific programs and interventions.”
Pronovost, P. J., Goeschel, C. A., Colantuoni, E., Watson, S., Lubomski, L. H., Berenholtz, S. M., Thompson, D. A., Sinopoli, D. J., Cosgrove, S., Sexton, J. B., et al. (2010) · BMJ · doi:10.1136/bmj.c309 · Cited by 522 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Kennedy, M. T., & Fiss, P. C. (2009) · Academy of Management Journal · doi:10.5465/amj.2009.44633062 · Cited by 474
Models of Organization and Total Quality Management: A Comparison and Critical Evaluation
Spencer, B. A. (1994) · The Academy of Management Review · doi:10.2307/258935 · Cited by 464 · cited 1×
“This type of ongoing evaluation, modification, and replacement of elements or procedures as necessary is an approach advocated in organizational learning and continuous quality-improvement literatures [78-80].”
Implementation of Evidence-based Practice in Child Welfare: Service Provider Perspectives
Aarons, G. A., & Palinkas, L. A. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0121-3 · Cited by 450
Diffusion of a School-Based Substance Abuse Prevention Program: Predictors of Program Implementation
Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993) · Preventive Medicine · doi:10.1006/pmed.1993.1020 · Cited by 431 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Toward the Effective and Efficient Measurement of Implementation Fidelity
Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0321-0 · Cited by 422
What We Say Is Not What We Do: Effective Evaluation of Faculty Professional Development Programs
Ebert-May, D., Derting, T. L., Hodder, J., Momsen, J. L., Long, T. M., & Jardeleza, S. E. (2011) · BioScience · doi:10.1525/bio.2011.61.7.9 · Cited by 420 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Building capacity and sustainable prevention innovations: a sustainability planning model
Johnson, K., Hays, C., Center, H., & Daley, C. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.01.002 · Cited by 411 · cited 2×
“Finally, given the amount of discussion on leadership, organizational climate, and culture in the literature on implementation and sustainability [5,20,35,39,65,66], we expected greater representation of these constructs in the studies that were reviewed.”
Sustainability science: an integrated approach for health-programme planning
Gruen, R. L., Elliott, J. H., Nolan, M. L., Lawton, P. D., Parkhill, A., McLaren, C. J., & Lavis, J. N. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61659-1 · Cited by 395 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Have We Learned Anything New About the Use of Evaluation?
Weiss, C. H. (1998) · American Journal of Evaluation · doi:10.1177/109821409801900103 · Cited by 384 · cited 1×
“This type of ongoing evaluation, modification, and replacement of elements or procedures as necessary is an approach advocated in organizational learning and continuous quality-improvement literatures [78-80].”
Making public health programs last: conceptualizing sustainability
Pluye, P., Potvin, L., & Denis, J.-L. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.01.001 · Cited by 374 · cited 1×
“[57] 2”
The Sonagachi Project: A Sustainable Community Intervention Program
Jana, S., Basu, I., Rotheram-Borus, M. J., & Newman, P. A. (2004) · AIDS Education and Prevention · doi:10.1521/aeap.16.5.405.48734 · Cited by 371 · cited 1×
“In such cases, the range of possible or even necessary adaptations within the program might be quite broad [75,76] and may reflect new priorities or response to local conditions [77].”
The study of macro- and micro-implementation.
Berman, P. (1978) · PubMed · Cited by 349
Administration and Policy in Mental Health and Mental Health Services Research
(2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/10488.1573-3289 · Cited by 324
McHugo, G. J., Drake, R. E., Teague, G. B., & Xie, H. (1999) · Psychiatric Services · doi:10.1176/ps.50.6.818 · Cited by 324 · cited 2×
“First, similar to findings from a previous review [10], we found that those studies that provided information about levels or extent of implementation generally indicated that partial sustainability was more common than continuation of the entire program or intervention, even when full implementation was initially ach…”
Fidelity Outcomes in the National Implementing Evidence-Based Practices Project
McHugo, G. J., Drake, R. E., Whitley, R., Bond, G. R., Campbell, K., Rapp, C. A., Goldman, H. H., Lutz, W. J., & Finnerty, M. T. (2007) · Psychiatric Services · doi:10.1176/appi.ps.58.10.1279 · Cited by 315
Organizational Culture and Climate: Implications for Services and Interventions Research.
Hemmelgarn, A. L., Glisson, C., & James, L. R. (2006) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2006.00008.x · Cited by 307 · cited 1×
“Finally, given the amount of discussion on leadership, organizational climate, and culture in the literature on implementation and sustainability [5,20,35,39,65,66], we expected greater representation of these constructs in the studies that were reviewed.”
Helfrich, C. D., Damschroder, L. J., Hagedorn, H. J., Daggett, G. S., Sahay, A., Ritchie, M., Damush, T., Guihan, M., Ullrich, P. M., & Stetler, C. B. (2010) · Implementation Science · doi:10.1186/1748-5908-5-82 · Cited by 306 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
The fidelity‐adaptation debate: Implications for the implementation of public sector social programs
Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., & Emshoff, J. G. (1987) · American Journal of Community Psychology · doi:10.1007/bf00922697 · Cited by 297 · cited 1×
“In such cases, the range of possible or even necessary adaptations within the program might be quite broad [75,76] and may reflect new priorities or response to local conditions [77].”
Sustainable vector control and management of Chagas disease in the Gran Chaco, Argentina
Gürtler, R. E., Kitron, U., Cecere, M. C., Segura, E. L., & Cohen, J. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700863104 · Cited by 275
The Role of Staff Turnover in the Implementation of Evidence-Based Practices in Mental Health Care
Woltmann, E. M., Whitley, R., McHugo, G. J., Brunette, M., Torrey, W. C., Coots, L., Lynde, D., & Drake, R. E. (2008) · Psychiatric Services · doi:10.1176/ps.2008.59.7.732 · Cited by 246
Measuring the Diffusion of Innovative Health Promotion Programs
Steckler, A., Goodman, R. M., McLeroy, K. R., Davis, S., & Koch, G. (1992) · American Journal of Health Promotion · doi:10.4278/0890-1171-6.3.214 · Cited by 238 · cited 1×
“The Level of Institutionalization scale has been developed to gauge the extent to which key activities for a health-promotion program have occurred [94,95], and the authors suggest that the measure can be modified easily for a variety of health-promotion programs and settings.”
Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0152-9 · Cited by 232 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
A model for the institutionalization of health promotion programs
Goodman, R. M., & Steckler, A. (1989) · Family & Community Health · doi:10.1097/00003727-198902000-00009 · Cited by 224 · cited 1×
“Goodman and Steckler [58] 2”
A perspective on knowledge, competence and strategy
von Krogh, G., & Roos, J. (1995) · Personnel Review · doi:10.1108/00483489510089650 · Cited by 212
Lyon, A. R., Stirman, S. W., Kerns, S. E. U., & Bruns, E. J. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0331-y · Cited by 210 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Self-citationWoolf, S. H. (2005) · The Annals of Family Medicine · doi:10.1370/afm.406 · Cited by 208 · cited 2×
“In the medical literature, it has been defined as “the extent to which the system provides patients the precise interventions they need, delivered properly, precisely when they need them” [71].”
The sustainability of health promotion interventions for different levels of social organization
Swerissen, H. (2004) · Health Promotion International · doi:10.1093/heapro/dah113 · Cited by 205 · cited 2×
“We also employed a snowballing strategy, in which we searched the reference sections of reviews and theoretical papers on implementation and sustainability [2-4,19,23,25,28,29] and those found in our review.”
Hoelscher, D. (2004) · Preventive Medicine · doi:10.1016/j.ypmed.2003.11.017 · Cited by 202 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Sustaining Community‐Based Programs for Families: Conceptualization and Measurement*
Mancini, J. A., & Marek, L. I. (2004) · Family Relations · doi:10.1111/j.0197-6664.2004.00040.x · Cited by 199 · cited 3×
“Mancini and Marek developed a 29-item Program Sustainability Index to assess six factors related to the sustainability of community-based programs [40].”
Bossert, T. J. (1990) · Social Science & Medicine · doi:10.1016/0277-9536(90)90148-l · Cited by 195
The Sustainability of Evidence-Based Practices in Routine Mental Health Agencies
Swain, K., Whitley, R., McHugo, G. J., & Drake, R. E. (2010) · Community Mental Health Journal · doi:10.1007/s10597-009-9202-y · Cited by 193 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Clarke, G. N. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.5.718 · Cited by 193
Sustainability and Scalability of the Hospital Elder Life Program at a Community Hospital
Rubin, F. H., Neal, K., Fenlon, K., Hassan, S., & Inouye, S. K. (2011) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2010.03243.x · Cited by 186 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Development of Level of Institutionalization Scales for Health Promotion Programs
Goodman, R. M., McLeroy, K. R., Steckler, A. B., & Hoyle, R. H. (1993) · Health Education Quarterly · doi:10.1177/109019819302000208 · Cited by 181 · cited 1×
“An initial coding scheme was developed based on constructs identified in previous conceptualizations of implementation [2-4,9,34,35] and sustainability [4,5,17,20,36-44].”
Correlates of the Sustainability of Community-Based Heart Health Promotion Interventions
O'Loughlin, J., Renaud, L., Richard, L., Gomez, L. S., & Paradis, G. (1998) · Preventive Medicine · doi:10.1006/pmed.1998.0348 · Cited by 175 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Changing Urban Bureaucracies: How New Practices Become Routinized
Yin, R. K. (1978) · Cited by 173
Massatti, R. R., Sweeney, H. A., Panzano, P. C., & Roth, D. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0141-z · Cited by 163 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Stetler, C. B., Ritchie, J. A., Rycroft-Malone, J., Schultz, A. A., & Charns, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-78 · Cited by 156 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Self-citationMcCormick, L. K., Steckler, A. B., & McLeroy, K. R. (1995) · American Journal of Health Promotion · doi:10.4278/0890-1171-9.3.210 · Cited by 154 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Health psychology and public health: an integrative approach
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0966 · Cited by 150 · cited 1×
“Other [9,32,46-56] 12”
Sustainability of a practice-individualized preventive service delivery intervention
Stange, K. C., Goodwin, M. A., Zyzanski, S. J., & Dietrich, A. J. (2003) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(03)00219-8 · Cited by 145 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Sustained Benefit of a Community and Professional Intervention to Increase Acute Stroke Therapy
Morgenstern, L. B., Bartholomew, L. K., Grotta, J. C., Staub, L., King, M., & Chan, W. (2003) · Archives of Internal Medicine · doi:10.1001/archinte.163.18.2198 · Cited by 145 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Community ownership and program continuation following a health demonstration project
Bracht, N., Finnegan, J. R., Rissel, C., Weisbrod, R., Gleason, J., Corbett, J., & Veblen-Mortenson, S. (1994) · Health Education Research · doi:10.1093/her/9.2.243 · Cited by 144
Program sustainability: focus on organizational routines
Pluye, P. (2004) · Health Promotion International · doi:10.1093/heapro/dah411 · Cited by 144 · cited 2×
“However, they did develop a 15-question interview to assess degrees of sustainability [41].”
Commentary: applying the BMJ's guidelines on educational interventions.
Ker, J. (2000) · PubMed · Cited by 139
A Focused Approach to Assessing Program Fidelity
Hill, L. G., Maucione, K., & Hood, B. (2006) · Prevention Science · doi:10.1007/s11121-006-0051-4 · Cited by 134 · cited 1×
“To advance the field, subsequent research should include further attention to the nature of the modifications that occur and the process by which modifications are made [84,85].”
Hoque, B. A., Juncker, T., Sack, R. B., Ali, M., & Aziz, K. M. A. (1996) · Europe PMC (PubMed Central) · Cited by 131
Schoenwald, S. K., Carter, R. E., Chapman, J. E., & Sheidow, A. J. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0181-z · Cited by 123 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Sustainability in changing clinical practice promotes evidence‐based nursing care
Wallin, L., Boström, A., Wikblad, K., & Ewald, U. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02574.x · Cited by 123 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Project IMPACT: A Report on Barriers and Facilitators to Sustainability
Blasinsky, M., Goldman, H. H., & Unützer, J. (2006) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-006-0086-7 · Cited by 121 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Levitt, J. T., Malta, L. S., Martin, A. L., Davis, L. L., & Cloître, M. (2007) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.01.004 · Cited by 116
Simonsen, B., Eber, L., Black, A. C., Sugai, G., Lewandowski, H., Sims, B., & Myers, D. (2012) · Journal of Positive Behavior Interventions · doi:10.1177/1098300711412601 · Cited by 111 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Achieving sustainability of community-based dengue control in Santiago de Cuba
Romaní, M. E. T., Vanlerberghe, V., Pérez, D., Lefèvre, P., Ceballos, E., Bandera, D., Gil, A. B., & der Stuyft, P. V. (2006) · Social Science & Medicine · doi:10.1016/j.socscimed.2006.10.033 · Cited by 108 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Training and fidelity monitoring of behavioral interventions in multi-site addictions research
Baer, J. S., Ball, S. A., Campbell, B. K., Miele, G. M., Schoener, E. P., & Tracy, K. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2006.08.028 · Cited by 108 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Measuring persistence of implementation: QUERI Series
Initiative, T. H. Q. E. R., Bowman, C. C., Sobo, E. J., Asch, S. M., & Gifford, A. L. (2008) · Implementation Science · doi:10.1186/1748-5908-3-21 · Cited by 100 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Godley, S. H., Garner, B. R., Smith, J. E., Meyers, R. J., & Godley, M. D. (2011) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2011.01236.x · Cited by 97 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Predictors and Level of Sustainability of Community Prevention Coalitions
Feinberg, M. E., Bontempo, D. E., & Greenberg, M. T. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.01.030 · Cited by 97 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Kirsh, S. R., Lawrence, R. H., & Aron, D. C. (2008) · Implementation Science · doi:10.1186/1748-5908-3-34 · Cited by 95 · cited 1×
“mutually adapt and evolve [21] and how this process impacts sustainability.”
Kolko, D. J., Iselin, A.-M. R., & Gully, K. J. (2011) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2010.09.004 · Cited by 95 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
The Globalization of Managerial Innovation in Health Care
(2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511620003 · Cited by 94
Defining sustainability outcomes of health programs: Illustrations from an on-line survey
Scheirer, M. A., Hartling, G., & Hagerman, D. (2008) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2008.08.004 · Cited by 93 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Sustaining Research-Based Practices in Reading: A 3-Year Follow-up
Klingner, J. K., Vaughn, S., Tejero Hughes, M., & Arguelles, M. E. (1999) · Remedial and Special Education · doi:10.1177/074193259902000502 · Cited by 93
August, G. J., Bloomquist, M. L., Lee, S. S., Realmuto, G. M., & Hektner, J. M. (2006) · Prevention Science · doi:10.1007/s11121-005-0024-z · Cited by 90 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Amazigo, U. V., Okeibunor, J., Matovu, V., Zouré, H., Bump, J. B., & Seketeli, A. (2007) · Social Science & Medicine · doi:10.1016/j.socscimed.2007.01.018 · Cited by 90 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Hoffman, K. A., Ford, J. H., Choi, D., Gustafson, D. H., & McCarty, D. W. (2008) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.04.016 · Cited by 88 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Quasi-experimental evaluation of a national primary school HIV intervention in Kenya
Maticka‐Tyndale, E., Wildish, J., & Gichuru, M. (2007) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2007.01.006 · Cited by 87
Tibbits, M. K., Bumbarger, B. K., Kyler, S. J., & Perkins, D. F. (2010) · Prevention Science · doi:10.1007/s11121-010-0170-9 · Cited by 86 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Sarriot, E. G., Winch, P. J., Ryan, L. J., Bowie, J., Kouletio, M., Swedberg, E., LeBan, K., Edison, J., Welch, R., & Pacqué, M. C. (2004) · The International Journal of Health Planning and Management · doi:10.1002/hpm.744 · Cited by 86 · cited 1×
“An initial coding scheme was developed based on constructs identified in previous conceptualizations of implementation [2-4,9,34,35] and sustainability [4,5,17,20,36-44].”
Mayer, J., Mooney, B. R., Gundlapalli, A. V., Harbarth, S., Stoddard, G. J., Rubin, M. A., Eutropius, L., Brinton, B., & Samore, M. H. (2011) · Infection Control and Hospital Epidemiology · doi:10.1086/657666 · Cited by 85 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Stetler, C. B., Ritchie, J., Rycroft-Malone, J., Schultz, A., & Charns, M. (2007) · Implementation Science · doi:10.1186/1748-5908-2-3 · Cited by 84 · cited 1×
“Other [9,32,46-56] 12”
Self-citationFree school fruit--sustained effect 1 year later
Bere, E. (2005) · Health Education Research · doi:10.1093/her/cyh063 · Cited by 82
Ellingson, K., Muder, R. R., Jain, R., Kleinbaum, D. G., Feng, P.-J. I., Cunningham, C. A., Squier, C. L., Lloyd, J. C., Edwards, J. R., Gebski, V., et al. (2010) · Infection Control and Hospital Epidemiology · doi:10.1086/657665 · Cited by 81
Sustaining the Implementation of an Evidence-Based Guideline for Bronchiolitis
Perlstein, P. H., Kotagal, U. R., Schoettker, P. J., Atherton, H. D., Farrell, M. K., Gerhardt, W. E., & Alfaro, M. P. (2000) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.154.10.1001 · Cited by 80 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Rosenberg, A. P., Hartwig, K. A., & MERSON, M. H. (2007) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2007.08.005 · Cited by 78 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Scheirer, M. A. (1990) · Journal of Health and Social Behavior · doi:10.2307/2137173 · Cited by 78 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Organizational Characteristics of Successful Innovative Health Care Programs Sustained Over Time
Evashwick, C., & Ory, M. (2003) · Family & Community Health · doi:10.1097/00003727-200307000-00003 · Cited by 76 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Strengthening organizations to implement evidence-based clinical practices.
VanDeusen Lukas, C., Engle, R. L., Holmes, S. K., Parker, V. A., Petzel, R. A., Nealon Seibert, M., Shwartz, M., & Sullivan, J. L. (2010) · Health Care Management Review · doi:10.1097/hmr.0b013e3181dde6a5 · Cited by 75
The study of macro and micro implementation of social policy
Berman, P. S. (1978) · Cited by 73
Maintaining prevention in practice
Goodson, P., Smith, M. M., Evans, A., Meyer, B. A., & Gottlieb, N. H. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(00)00310-x · Cited by 71 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Martin, G. W., Herie, M. A., Turner, B. J., & Cunningham, J. A. (1998) · Addiction · doi:10.1046/j.1360-0443.1998.931117038.x · Cited by 71 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Factors supporting sustainability of a community‐based scabies control program
Wong, L., Amega, B., Barker, R., Connors, C., Dulla, M. E., Ninnal, A., Cumaiyi, M. M., Kolumboort, L., & Currie, B. J. (2002) · Australasian Journal of Dermatology · doi:10.1046/j.1440-0960.2002.00626.x · Cited by 70 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Edvardsson, K., Garvare, R., Ivarsson, A., Eurenius, E., Mogren, I., & Nyström, M. E. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-61 · Cited by 70 · cited 1×
“Additional file 1: Articles Included in the Review [37,54,98-220].”
Sustainability of Public Health Programs: The Example of Tobacco Treatment Services in Massachusetts
LaPelle, N. R., Zapka, J., & Ockene, J. K. (2006) · American Journal of Public Health · doi:10.2105/ajph.2005.067124 · Cited by 70 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Sustainability of a successful health and nutrition program in a remote Aboriginal community
Lee, A. J., Bonson, A. P. V., Yarmirr, D., O'Dea, K., & Mathews, J. D. (1995) · Medical Journal of Australia · doi:10.5694/j.1326-5377.1995.tb126048.x · Cited by 68 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Rollins, A. L., Salyers, M. P., Tsai, J., & Lydick, J. M. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-009-0257-4 · Cited by 68
A systematic review of home treatment services: Classification and sustainability
Wright, C., Catty, J., Watt, H., & Burns, T. (2004) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-004-0818-5 · Cited by 68
Visrutaratna, S., Lindan, C., Sirhorachai, A., & Mandel, J. S. (1995) · PubMed · Cited by 67
Long-term sustainability of a worksite canteen intervention of serving more fruit and vegetables
Thorsen, A. V., Lassen, A. D., Tetens, I., Hels, O. H., & Mikkelsen, B. E. (2010) · Public Health Nutrition · doi:10.1017/s1368980010001242 · Cited by 67 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Austin, G., Bell, T., Caperchione, C. M., & Mummery, W. K. (2011) · Health Promotion Practice · doi:10.1177/1524839910366101 · Cited by 66
Baum, F., Jolley, G., Hicks, R., Saint, K., & Parker, S. (2006) · Health Promotion International · doi:10.1093/heapro/dal023 · Cited by 66 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Bisset, S. L., & Potvin, L. (2006) · Health Education Research · doi:10.1093/her/cyl154 · Cited by 65 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Implementation of the Bamako Initiative: strategies in Benin and Guinea
Knippenberg, R., Alihonou, E., Soucat, A. L. B., Oyegbite, K., Calivis, M., Hopwood, I., Niimi, R., Diallo, M. P., Conde, M., & Ofosu-Amaah, S. (1997) · The International Journal of Health Planning and Management · doi:10.1002/(sici)1099-1751(199706)12:1+<s29::aid-hpm465>3.0.co;2-u · Cited by 62
Thompson, B. (2000) · Health Education Research · doi:10.1093/her/15.3.353 · Cited by 62 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Greenwood, C. R., Tapia, Y., Abbott, M., & Walton, C. (2003) · The Journal of Special Education · doi:10.1177/00224669030370020401 · Cited by 61 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Clinical practice guidelines: barriers to durability after effective early implementation
Brand, C., Landgren, F., Hutchinson, A., Jones, C., MacGregor, L., & Campbell, D. (2005) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2004.00763.x · Cited by 56 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Henggeler, S. W., Sheidow, A. J., Cunningham, P. B., Donohue, B. C., & Ford, J. D. (2008) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410802148087 · Cited by 56 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Lundgren, L. M., Amodeo, M., Cohen, A., Chassler, D., & Horowitz, A. (2011) · Addictive Behaviors · doi:10.1016/j.addbeh.2011.01.003 · Cited by 55
Reliable Effectiveness: A Theory on Sustaining and Replicating Worthwhile Innovations
Racine, D. P. (2006) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-006-0047-1 · Cited by 55 · cited 3×
“Such models tend to identify a set of factors or conditions that increase the likelihood of sustainability of a specific intervention [17].”
Dückers, M. L., Wagner, C., Vos, L., & Groenewegen, P. P. (2011) · Implementation Science · doi:10.1186/1748-5908-6-18 · Cited by 54 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Syphilis control during pregnancy: effectiveness and sustainability of a decentralized program
(2001) · American Journal of Public Health · doi:10.2105/ajph.91.5.705 · Cited by 53 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Towards improved understanding of injury prevention program sustainability
Nilsén, P., Timpka, T., Nordenfelt, L., & Lindqvist, K. S. (2005) · Safety Science · doi:10.1016/j.ssci.2005.08.015 · Cited by 52 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Kay, B. H., Tuyet Hanh, T. T., Le, N. H., Quy, T. M., Nam, V. S., Hang, P. V. D., Yen, N. T., Hill, P. S., Vos, T., & Ryan, P. A. (2010) · The American Society of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.2010.09-0503 · Cited by 50 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Hogg, W., Baskerville, N., Nykiforuk, C., & Mallen, D. (2002) · Journal of Health Services Research & Policy · doi:10.1258/135581902320432714 · Cited by 48 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Promoting Sustainability of Community Health Initiatives: An Empirical Case Study
Paine-Andrews, A., Fisher, J. L., Campuzano, M. K., Fawcett, S. B., & Berkley-Patton, J. (2000) · Health Promotion Practice · doi:10.1177/152483990000100311 · Cited by 46 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Beery, W. L., Senter, S., Cheadle, A., Greenwald, H. P., Pearson, D., Brousseau, R., & Nelson, G. D. (2005) · American Journal of Evaluation · doi:10.1177/1098214005275627 · Cited by 45 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Ullrich, S., McCutcheon, H., & Parker, B. A. (2011) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2010.03598.x · Cited by 45 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Xian, Y., Pan, W., Peterson, E. D., Heidenreich, P. A., Cannon, C. P., Hernandez, A. F., Friedman, B., Holloway, R. G., & Fonarow, G. C. (2010) · American Heart Journal · doi:10.1016/j.ahj.2009.11.002 · Cited by 43
Wong, M. L., Chan, K. W. R., & Koh, D. S. Q. (1998) · Preventive Medicine · doi:10.1006/pmed.1998.0398 · Cited by 43 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Marty, D., Rapp, C., McHugo, G. J., & Whitley, R. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0157-4 · Cited by 42 · cited 1×
“An initial coding scheme was developed based on constructs identified in previous conceptualizations of implementation [2-4,9,34,35] and sustainability [4,5,17,20,36-44].”
A framework for institutionalizing quality assurance
SILIMPERI, D. R. (2002) · International Journal for Quality in Health Care · doi:10.1093/intqhc/14.suppl_1.67 · Cited by 42 · cited 1×
“An initial coding scheme was developed based on constructs identified in previous conceptualizations of implementation [2-4,9,34,35] and sustainability [4,5,17,20,36-44].”
Emergent themes in the sustainability of primary health care innovation
Sibthorpe, B. M., Glasgow, N. J., & Wells, R. W. (2005) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2005.tb07185.x · Cited by 42
The Implementation and Institutionalization of a School-Based Youth Suicide Prevention Program
Kalafat, J. D., & Ryerson, D. M. (1999) · The Journal of Primary Prevention · doi:10.1023/a:1022658826641 · Cited by 39 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Sustainability of pharmacy-based innovations: The case of in-house immunization services
Westrick, S. C., & Breland, M. L. (2009) · Journal of the American Pharmacists Association · doi:10.1331/japha.2009.08055 · Cited by 38 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Johnson, C. C., Fargo, J. D., & Kahle, J. B. (2010) · School Science and Mathematics · doi:10.1111/j.1949-8594.2010.00017.x · Cited by 37 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Ahluwalia, I. B., Robinson, D., Vallely, L., Gieseker, K. E., & Kabakama, A. (2010) · Global Health Promotion · doi:10.1177/1757975909356627 · Cited by 37
Sanci, L., Coffey, C., Patton, G., & Bowes, G. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02172.x · Cited by 37 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
The Sustainability of Systems of Care for Children’s Mental Health: Lessons Learned
Stroul, B. A., & Manteuffel, B. A. (2007) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-007-9065-3 · Cited by 36 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Evaluation of the Sustainability of an Intervention to Increase HIV Testing
Program, A. T. Q.-H., Goetz, M. B., Hoang, T., Henry, S. R., Knapp, H., Anaya, H. D., Gifford, A. L., & Asch, S. M. (2009) · Journal of General Internal Medicine · doi:10.1007/s11606-009-1120-8 · Cited by 36 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Program sustainability of a community-based intervention to prevent falls among older Australians
Barnett, L. M. (2004) · Health Promotion International · doi:10.1093/heapro/dah302 · Cited by 35 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Sustainability of a Targeted Intervention Package: First Step to Success in Oregon
Loman, S. L., Rodriguez, B. J., & Horner, R. H. (2010) · Journal of Emotional and Behavioral Disorders · doi:10.1177/1063426610362899 · Cited by 35 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Maticka‐Tyndale, E., Wildish, J., & Gichuru, M. (2010) · Sex Education · doi:10.1080/14681811003666481 · Cited by 34
Plochg, T., Delnoij, D. M. J., Hoogedoorn, N. P., & Klazinga, N. (2006) · BMC Health Services Research · doi:10.1186/1472-6963-6-37 · Cited by 34
Babl, F. E., Krieser, D., Belousoff, J., & Theophilos, T. (2010) · Emergency Medicine Journal · doi:10.1136/emj.2009.077024 · Cited by 34 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Durability of Innovations in Human Service Organizations: A Case-Study Analysis
Glaser, E. M. (1981) · Science Communication · doi:10.1177/107554708100300204 · Cited by 33
Multilevel Interventions: Measurement and Measures
Charns, M. P., Foster, M. K., Alligood, E. C., Benzer, J. K., Burgess, J. F., Li, D., McIntosh, N. M., Burness, A., Partin, M. R., & Clauser, S. B. (2012) · JNCI Monographs · doi:10.1093/jncimonographs/lgs011 · Cited by 33
Self-citationKnudsen, H. K., & Studts, J. L. (2011) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2011.03.028 · Cited by 32
Higuchi, K. S., Davies, B., Edwards, N. C., Ploeg, J., & Virani, T. (2011) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2010.03590.x · Cited by 31 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Seffrin, B., Panzano, P. C., & Roth, D. (2008) · Community Mental Health Journal · doi:10.1007/s10597-008-9151-x · Cited by 31 · cited 1×
“Although a variety of factors may create conditions that facilitate initial implementation, their presence or influence may diminish over time [6-8].”
Abraham, A. J., Knudsen, H. K., & Roman, P. M. (2011) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2011.72.669 · Cited by 31 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Knippenberg, R., Soucat, A., Oyegbite, K., Sene, M., Broun, D., Pangu, K., Hopwood, I., Grandcourt, R., Tinguiri, K. L., Fall, I., et al. (1997) · The International Journal of Health Planning and Management · doi:10.1002/(sici)1099-1751(199706)12:1+<s9::aid-hpm471>3.0.co;2-2 · Cited by 31 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Harris, D. L., HENRY, R. C., Bland, C. J., Starnaman, S. M., & VOYTEK, K. L. (2003) · Journal of Interprofessional Care · doi:10.1080/1356182021000044111 · Cited by 30 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Sustainability and effectiveness of comprehensive diabetes care to a district population
Whitford, D. L., Roberts, S., & Griffin, S. J. (2004) · Diabetic Medicine · doi:10.1111/j.1464-5491.2004.01324.x · Cited by 28 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Stevens, B., & Peikes, D. N. (2006) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2006.01.009 · Cited by 28
Investigating the sustainability of outcomes in a chronic disease treatment programme
Bailie, R. S., Robinson, G., Kondalsamy‐Chennakesavan, S., Halpin, S., & Wang, Z. (2006) · Social Science & Medicine · doi:10.1016/j.socscimed.2006.04.010 · Cited by 28 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Care in the Country: A Historical Case Study of Long-Term Sustainability in 4 Rural Health Centers
Wright, D. B. (2009) · American Journal of Public Health · doi:10.2105/ajph.2008.146050 · Cited by 28 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Nease, D. E., Nutting, P. A., Graham, D. G., Dickinson, W. P., Gallagher, K. M., & Jeffcott-Pera, M. (2010) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2010.05.090212 · Cited by 28 · cited 1×
“Additional file 1: Articles Included in the Review [37,54,98-220].”
Steadman, H. J., Cocozza, J. J., Dennis, D. L., Lassiter, M. G., Randolph, F. L., Goldman, H. H., & Blasinsky, M. (2002) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1023/a:1020776310331 · Cited by 27 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Durability of innovations: How goal attainment scaling programs fare over time
Glaser, E. M., & Backer, T. E. (1980) · Community Mental Health Journal · doi:10.1007/bf00778585 · Cited by 25 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Rog, D. J., Boback, N., Barton-Villagrana, H., Marrone-Bennett, P., Cardwell, J., E.Hawdon, J., Diaz, J., Jenkins, Ṕ., Kridler, J. B., & Reischl, T. M. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2003.10.001 · Cited by 25 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Schetzina, K. E., Dalton, W. T., Pfortmiller, D. T., Fulton-Robinson, H., Lowe, E. F., & Stern, H. P. (2011) · Family & Community Health · doi:10.1097/fch.0b013e31820e0dcb · Cited by 25 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Maintenance of Effects of the Eat Smart School Food Service Program: Results from the Catch-on Study
Osganian, S. K., Hoelscher, D. M., Zive, M., Mitchell, P. D., Snyder, P., & Webber, L. S. (2003) · Health Education & Behavior · doi:10.1177/1090198103253509 · Cited by 24 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Towards sustainability in village health care in rural Cameroon
Eliason, R. N. (1999) · Health Promotion International · doi:10.1093/heapro/14.4.301 · Cited by 24 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Quality Improvement for Asthma Care Within a Hospital-Based Teaching Clinic
Bunik, M. E., Federico, M. J., Beaty, B. L., Rannie, M., Olin, J. T., & Kempe, A. (2011) · Academic Pediatrics · doi:10.1016/j.acap.2010.10.004 · Cited by 23 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Rabin, B. A., Nehl, E. J., Elliott, T., Deshpande, A. D., Brownson, R. C., & Glanz, K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-40 · Cited by 23
Sustainability of the Pacific Diabetes Today coalitions.
Aitaoto, N., Tsark, J. '., & Braun, K. L. (2009) · Preventing Chronic Disease · Cited by 23
Cherry, R. A., West, C. E., Hamilton, M. C., Rafferty, C. M., Hollenbeak, C. S., & Caputo, G. M. (2011) · Patient Safety in Surgery · doi:10.1186/1754-9493-5-15 · Cited by 21 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Barab, S. A., Redman, B. K., & Froman, R. D. (1998) · Journal of Nursing Measurement · doi:10.1891/1061-3749.6.1.19 · Cited by 20 · cited 1×
“The Level of Institutionalization scale has been developed to gauge the extent to which key activities for a health-promotion program have occurred [94,95], and the authors suggest that the measure can be modified easily for a variety of health-promotion programs and settings.”
Sadof, M. D., Boschert, K. A., Brandt, S., & Motyl, A. P. (2006) · Annals of Allergy Asthma & Immunology · doi:10.1016/s1081-1206(10)60783-1 · Cited by 20 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
A Multi-Method Process Evaluation for a Skin Cancer Prevention Diffusion Trial
Escoffery, C., Glanz, K., Hall, D. M., & Elliott, T. (2009) · Evaluation & the Health Professions · doi:10.1177/0163278709333154 · Cited by 20
Epstein, J. N., Langberg, J. M., Lichtenstein, P. K., Kolb, R. C., & Stark, L. J. (2010) · Children s Health Care · doi:10.1080/02739615.2010.515931 · Cited by 19
Sustainable Impact of a Primary Care Depression Intervention
Lee, P. W., Dietrich, A. J., Oxman, T. E., Williams, J. W., & Barry, S. L. (2007) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2007.05.070045 · Cited by 19 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Sustaining better diabetes care in remote indigenous Australian communities
McDermott, R. (2004) · BMJ Quality & Safety · doi:10.1136/qhc.13.4.295 · Cited by 17
Assessment of the Sustainability of the Iodine-Deficiency Disorders Control Program in Lesotho
Sebotsa, M. L. D., Dannhauser, A., Jooste, P. L., & Joubert, G. (2007) · Food and Nutrition Bulletin · doi:10.1177/156482650702800310 · Cited by 16 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
The relative impact of treatment program ‘robustness’ and ‘dosage’ on client outcomes
Jerrell, J. M., & Ridgely, M. S. (1999) · Evaluation and Program Planning · doi:10.1016/s0149-7189(99)00023-3 · Cited by 15
Jansen, M., Harting, J., Ebben, N., Kroon, B., Stappers, J., Van Engelshoven, E., & de Vries, N. (2008) · Family Practice · doi:10.1093/fampra/cmn066 · Cited by 15
Sustainability of a Preschool Curriculum: What Encourages Continued Use Among Teachers?
Lieber, J. A., Butera, G. D., Hanson, M. J., Palmer, S. B., Horn, E. M., & Czaja, C. F. (2010) · NHSA Dialog · doi:10.1080/15240754.2010.513776 · Cited by 14
Coalition Sustainability: Long-Term Successes & Lessons Learned
Lodl, K. A., & Stevens, G. (2002) · Journal of Extension · doi:10.66752/1077-5315.5092 · Cited by 14 · cited 3×
“Figure 1 is a modified PRISMA (which stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses [33]) diagram summarizing the selection process, which includes reasons that potentially relevant papers were excluded.”
Research works printed but not linked: 20
- Greenhalgh T: How to Spread Good Ideas: A systematic review of the literature on diffusion, dissemination, and sustainability of innovations in health service delivery and organization, in Report for the National Co-ordinating Centre for NHS Service Delivery and Organisation R & D (NCCSDO). 2004, London: University College, 362-
- Maher L, Gustafson DA: Sustainability Model and Guide: Evans;. 2007
- Stirman SW: Sustainability: A systematic review of methods and conceptualizations. in Fourth Annual NIH Conference on the Science of Dissemination and Implementation. 2011, Bethesda, MD
- Scheirer MA, J Dearing: An Agenda for Research on the Sustainability of Public Health Programs. 2011, American Journal of Public Health,
- Kimberly JR, Starbuck WH: Managerial Innovation, in Handbook of Organizational Design. Edited by: Nystrom PC. 1981, New York: Oxford University Press, 84-104.
- Claquin P: Sustainability of EPI: Utopia or Sine Qua Non Condition of Child Survival, in Resources for Child Health Project. 1989, Arlington; REACH
- Lafond AK: Improving the quality of investment in health: lessons on sustainability. Health Policy Plan. 1995, 10: 63-76.
- Ovretveit J: Making temporary quality improvement continuous. 2003, Stockholm: Swedish Association of County Councils
- Davies B, Tremblay D, Edwards N: Sustaining evidence-based practice systems and measuring the impacts, in Evaluating the Impact of Implementing Evidence-Based Practice. Edited by: Bick D, Ingram ID. 2010, Oxford: Wiley Blackwell
- Blasinsky M, Goldman HH, Unutzer J: Project IMPACT: a report on barriers and facilitators to sustainability. Adm Policy Ment Health. 2006, 33 (6): 718-729. 10.1007/s10488-006-0086-7. · DOI · Paper page
- Bowman C, Sobo E, Asch S, Gifford A: The H. I. V. Hepatitis Quality Enhancement Research Initiative: Measuring persistence of implementation: QUERI series. Implement Sci. 2008, 3 (1): 21-10.1186/1748-5908-3-21. · DOI · Paper page
- Gruen RL, Elliott JH, Nolan ML, Lawton PD, Parkhill A, McLaren CJ, Lavis JN: Sustainability science: an integrated approach for health-programme planning. Lancet. 2008, 372 (9649): 1579-1589. 10.1016/S0140-6736(08)61659-1. · DOI · Paper page
- Massatti RR, Sweeney HA, Panzano PC, Roth D: The de-adoption of innovative mental health practices (IMHP): why organizations choose not to sustain an IMHP. Adm Policy Ment Health. 2008, 35 (1-2): 50-65. 10.1007/s10488-007-0141-z. · DOI
- Nilsen P, Timpka T, Nordenfelt L, Lindqvist K: Towards improved understanding of injury prevention program sustainability. Saf Sci. 2005, 43 (10): 815-10.1016/j.ssci.2005.08.015. · DOI
- Plochg T, Delnoij DM, Hoogedoorn NP, Klazinga NS: Collaborating while competing? The sustainability of community-based integrated care initiatives through a health partnership. BMC Health Serv Res. 2006, 20: 6-37.
- Rabin B, Nehl E, Elliott T, Deshpande A, Brownson R, Glanz K: Individual and setting level predictors of the implementation of a skin cancer prevention program: a multilevel analysis. Implement Sci. 2010, 5: 40-53. 10.1186/1748-5908-5-40. · DOI
- Rohrbach LA, Graham JW, Hansen WB: Diffusion of a school-based substance abuse prevention program: predictors of program implementation. Prev Med. 1993, 22 (2): 237-260. 10.1006/pmed.1993.1020. · DOI · Paper page
- Ruch-Ross H, Keller D, Miller N, Bassewitz J, Melinkovich P: Evaluation of community-based health projects: the healthy tomorrows experience. Pediatrics. 2008, 122 (3): e564-e572. 10.1542/peds.2006-3273. · DOI
- Scheirer MA: The life cycle of an innovation: adoption versus discontinuation of the fluoride mouth rinse program in schools. J Health Soc Behav. 1990, 31 (2): 203-215. 10.2307/2137173. · DOI · Paper page
- Scheirer MA, Hartling G, Hagerman D: Defining sustainability outcomes of health programs: Illustrations from an on-line survey. Eval Program Plann. 2008, 31 (4): 335-346. 10.1016/j.evalprogplan.2008.08.004. · DOI · Paper page
Cited by
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724
“Recent approaches to sustainability locate key efforts squarely in the implementation phase, arguing that once a practice has been implemented within a care system, those who manage the delivery of that practice should turn their attention to ensuring that the practice can be maintained over time [6,24].”
Wiltsey Stirman, S., Baumann, A. A., & Miller, C. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0898-y · Cited by 1,329
Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019) · Implementation Science · doi:10.1186/s13012-018-0842-6 · Cited by 1,223
The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014731 · Cited by 806
Self-citation
Metadata
- Authors
- Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M.
- Affiliations
- University of Pennsylvania (US)
- VA Boston Healthcare System (US)
- Boston University (US)
- Venue
- Implementation Science
- Published
- 2012-03-14
- Volume
- 7
- Issue
- 1
- Pages
- 17-17
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3317864
- OpenAlex
- W2158467768
- Cited by
- 1,355
- References
- 211
- Citations by year
- 2026: 69 · 2025: 77 · 2024: 113 · 2023: 116 · 2022: 125 · 2021: 145 · 2020: 136 · 2019: 110 · 2018: 103 · 2017: 100 · 2016: 62 · 2015: 90 · 2014: 55 · 2013: 47 · 2012: 7
- FWCI
- 9.51
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ScholarlyCommons (University of Pennsylvania) (submittedVersion, cc-by)
- ScholarlyCommons (University of Pennsylvania) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- U.S. Department of Veterans Affairs (R25 MH080916-01A2)
- Washington University in St. Louis (R25 MH080916-01A2)
- National Institutes of Health
- Quality Enhancement Research Initiative (R25 MH080916-01A2)
- National Institute of Mental Health (MH080916, R00 MH 01800, R00MH080100, R25MH080916, T32MH019836)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- program sustainability, implementation outcomes, evidence-based programs, healthcare innovation, organizational context, organizational capacity, intervention fidelity, intervention adaptation, long-term implementation, sustainability factors, research recommendations, definition of sustainability
- MeSH terms
- Delivery of Health Care, Health Planning Guidelines, Humans, Organizational Innovation, Research Design, Program Evaluation, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.