Advancing understanding and identifying strategies for sustaining evidence-based practices: a review of reviews
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Background: Implementation science has focused mainly on the initial uptake and use of evidence-based practices (EBPs), with less attention to sustainment—i.e., continuous use of these practices, as intended, over time in ongoing operations, often involving adaptation to dynamic contexts. Declining EBP use following implementation is well-documented yet poorly understood. Using theories, models, and frameworks (TMFs) to conceptualize sustainment could advance understanding. We consolidated knowledge from published reviews of sustainment studies to identify TMFs with the potential to conceptualize sustainment, evaluate past uses of TMFs in sustainment studies, and assess the TMFs’ potential contribution to developing sustainment strategies. Methods: We drew upon reviews of sustainment studies published within the past 10 years, evaluated the frequency with which included articles used a TMF for conceptualizing sustainment, and evaluated the relevance of TMFs to sustainment research using the Theory, Model, and Framework Comparison and Selection Tool (T-CaST). Specifically, we examined whether the TMFs were familiar to researchers, hypothesized relationships among constructs, provided a face-valid explanation of relationships, and included sustainment as an outcome. Findings: Nine sustainment reviews referenced 648 studies; these studies cited 76 unique TMFs. Only 28 TMFs were used in more than one study. Of the 19 TMFs that met the criteria for T-CaST analysis, six TMFs explicitly included sustainment as the outcome of interest, 12 offered face-valid explanations of proposed conceptual relationships, and six identified mechanisms underlying relationships between included constructs and sustainment. Only 11 TMFs performed adequately with respect to all these criteria. Conclusions: We identified 76 TMFs that have been used in sustainment studies. Of these, most were only used once, contributing to a fractured understanding of sustainment. Improved reporting and use of TMFs may improve understanding of this critical topic. Of the more consistently used TMFs, few proposed face-valid relationships between included constructs and sustainment, limiting their ability to advance our understanding and identify potential sustainment strategies. Future research is needed to explore the TMFs that we identified as potentially relevant, as well as TMFs not identified in our study that nonetheless have the potential to advance our understanding of sustainment and identification of strategies for sustaining EBP use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Organizational Learning: A Theory of Action Perspective
Argyris, C., & Schön, D. A. (1997) · Reis · doi:10.2307/40183951 · Cited by 11,113 · cited 1×
“TMFs scoring 4 out of 6 included the model of institutionalization [31], diffusion of innovations theory [32], open systems theories [33], normalization process theory [29], organizational learning theory [34], the health belief model [27], network theory [35], the theory of planned behavior [28], the organizational s…”
MethodProctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Self-citationDiffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Historical Origins of the Health Belief Model
Rosenstock, I. M. (1974) · Health Education Monographs · doi:10.1177/109019817400200403 · Cited by 6,116
Reconceptualizing Organizational Routines as a Source of Flexibility and Change
Feldman, M. S., & Pentland, B. T. (2003) · Administrative Science Quarterly · doi:10.2307/3556620 · Cited by 4,020
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000055 · Cited by 2,587 · cited 1×
“reviews to leverage existing reviews to develop new knowledge, it is possible that our review of reviews [51, 52] was not entirely comprehensive, and we did not independently review methodological quality.”
BackgroundThe dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724
Self-citationDevelopment of a theory of implementation and integration: Normalization Process Theory
May, C. R., Mair, F., Finch, T., MacFarlane, A., Dowrick, C., Treweek, S., Rapley, T., Ballini, L., Ong, B. N., Rogers, A., et al. (2009) · Implementation Science · doi:10.1186/1748-5908-4-29 · Cited by 1,409
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355
Cited by
Nathan, N., Powell, B. J., Shelton, R. C., Laur, C. V., Wolfenden, L., Hailemariam, M., Yoong, S. L., Sutherland, R., Kingsland, M., Waltz, T. J., et al. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.905909 · Cited by 105
“Unfortunately, a large proportion of sustainability research is not based on relevant theories, frameworks, or models and for those studies that have, there is wide variation and limited validity in the theories and frameworks commonly applied (59).”
BackgroundAshcraft, L. E., Goodrich, D. E., Hero, J., Phares, A., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Implementation Science · doi:10.1186/s13012-024-01369-5 · Cited by 89
“…but future work should consider including the additional strategies that have been recommended to augment ERIC, around sustainment [13, 79, 106, 108], community and public health research [12, 109–111], consumer or service user engagement [112], de-implementation [104, 113–117] and related…”
BackgroundHall, A., Shoesmith, A., Doherty, E., McEvoy, B., Mettert, K., Lewis, C. C., Wolfenden, L., Yoong, S., Kingsland, M., Shelton, R. C., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01252-1 · Cited by 81
“Furthermore, there has been a lack of distinction between measures of sustainability determinants and sustainability as an outcome [2, 9].”
BackgroundGardner, D. M., Turner, J. P., Magalhaes, S., Rajda, M., & Murphy, A. L. (2024) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2024.2731 · Cited by 19
Roadmap for implementing a multi-tiered system of supports framework to improve school attendance.
Graczyk, P. A., & Kearney, C. A. (2024) · Current Psychology · doi:10.1007/s12144-023-05478-0 · Cited by 14
Metadata
- Authors
- Birken, S. A., Haines, E. R., Hwang, S., Chambers, D. A., Bunger, A. C., & Nilsen, P.
- Venue
- Implementation Science
- Published
- 2020-10-09
- Volume
- 15
- Issue
- 1
- Pages
- 88-88
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W3092375925
- Cited by
- 122
- References
- 23
- FWCI
- 13.91
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Advancing understanding and identifying strategies for sustaining evidence-based practices: a review of reviews. https://app.cochat.ai/papers/10.1186/s13012-020-01040-9
- The paper
- Birken, S. A., Haines, E. R., Hwang, S., Chambers, D. A., Bunger, A. C., & Nilsen, P. (2020). Advancing understanding and identifying strategies for sustaining evidence-based practices: a review of reviews. Implementation Science. https://doi.org/10.1186/s13012-020-01040-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.