Defining the external implementation context: an integrative systematic literature review
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Proper implementation of evidence-based interventions is necessary for their full impact to be realized. However, the majority of research to date has overlooked facilitators and barriers existing outside the boundaries of the implementing organization(s). Better understanding and measurement of the external implementation context would be particularly beneficial in light of complex health interventions that extend into and interact with the larger environment they are embedded within. We conducted a integrative systematic literature review to identify external context constructs likely to impact implementation of complex evidence-based interventions. METHODS: The review process was iterative due to our goal to inductively develop the identified constructs. Data collection occurred in four primary stages: (1) an initial set of key literature across disciplines was identified and used to inform (2) journal and (3) author searches that, in turn, informed the design of the final (4) database search. Additionally, (5) we conducted citation searches of relevant literature reviews identified in each stage. We carried out an inductive thematic content analysis with the goal of developing homogenous, well-defined, and mutually exclusive categories. RESULTS: We identified eight external context constructs: (1) professional influences, (2) political support, (3) social climate, (4) local infrastructure, (5) policy and legal climate, (6) relational climate, (7) target population, and (8) funding and economic climate. CONCLUSIONS: This is the first study to our knowledge to use a systematic review process to identify empirically observed external context factors documented to impact implementation. Comparison with four widely-utilized implementation frameworks supports the exhaustiveness of our review process. Future work should focus on the development of more stringent operationalization and measurement of these external constructs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 11×
“Due to this large number of articles, we have chosen to focus only on 61 describing EBIs published after 2009 because: (1) there is a potential difference in factors affecting implementation of interventions demonstrated to be effective (i.e., EBIs) and (2) it is reasonable to expect attention to external factors woul…”
BackgroundInfluentialDiffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
Writing Integrative Literature Reviews: Guidelines and Examples
Torraco, R. J. (2005) · Human Resource Development Review · doi:10.1177/1534484305278283 · Cited by 3,534 · cited 1×
“The standard process for an integrative review includes the following steps: (1) problem formulation, (2) data collection, (3) evaluation of data, (4) data analysis, and (5) interpretation and presentation of the results [29].”
MethodAdvancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 7×
“Consolidate Framework for Implementation Research (CFIR) [3] Exploration, Preparation, Implementation, Sustainment (EPIS) [4] Integrated Promoting Action on Research Implementation in Health Services (i-PARiHS) [6] Multi-level framework (MLF) predicting implementation outcomes [5]”
BackgroundMethodInfluentialThe challenge of complexity in health care
Plsek, P. E., & Greenhalgh, T. (2001) · BMJ · doi:10.1136/bmj.323.7313.625 · Cited by 2,578
Enabling the implementation of evidence based practice: a conceptual framework.
Kitson, A., Harvey, G., & McCormack, B. (1998) · Quality in Health Care · doi:10.1136/qshc.7.3.149 · Cited by 1,985
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894 · cited 9×
“Due to this large number of articles, we have chosen to focus only on 61 describing EBIs published after 2009 because: (1) there is a potential difference in factors affecting implementation of interventions demonstrated to be effective (i.e., EBIs) and (2) it is reasonable to expect attention to external factors woul…”
BackgroundInfluentialQualitative Text Analysis: A Guide to Methods, Practice & Using Software
Kuckartz, U. (2014) · doi:10.4135/9781446288719 · Cited by 1,411
Dissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355
Cited by
Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019) · Implementation Science · doi:10.1186/s13012-018-0842-6 · Cited by 1,223
Woodward, E. N., Singh, R. S., Ndebele-Ngwenya, P., Melgar Castillo, A., Dickson, K. S., & Kirchner, J. E. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00146-5 · Cited by 270
Quantitative measures of health policy implementation determinants and outcomes: a systematic review
Allen, P., Pilar, M., Walsh-Bailey, C., Hooley, C., Mazzucca, S., Lewis, C. C., Mettert, K. D., Dorsey, C. N., Purtle, J., Kepper, M. M., et al. (2020) · Implementation Science · doi:10.1186/s13012-020-01007-w · Cited by 164
Duan, Y., Iaconi, A., Wang, J., Perez, J. S., Song, Y., Chamberlain, S. A., Shrestha, S., Choroschun, K., Hoben, M., Beeber, A., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01254-z · Cited by 46
“including implementation of complex interventions [14], implementation of public health interventions [15], and evidence application by nursing professionals [16].”
BackgroundWatson, D. P., Ahonen, E. Q., Shuman, V., Brown, M., Tsemberis, S., Huynh, P., Ouyang, F., & Xu, H. (2018) · Substance Abuse Treatment, Prevention, and Policy · doi:10.1186/s13011-018-0172-3 · Cited by 13
Self-citation
Metadata
- Authors
- Watson, D. P., Adams, E. L., Shue, S., Coates, H., McGuire, A., Chesher, J., Jackson, J., & Omenka, O. I.
- Venue
- BMC Health Services Research
- Published
- 2018-03-27
- Volume
- 18
- Issue
- 1
- Pages
- 209-209
- ISSN
- 1472-6963 (ISSN-L)
- OpenAlex
- W2804755177
- Cited by
- 92
- References
- 26
- FWCI
- 2.12
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Defining the external implementation context: an integrative systematic literature review. https://app.cochat.ai/papers/10.1186/s12913-018-3046-5
- The paper
- Watson, D. P., Adams, E. L., Shue, S., Coates, H., McGuire, A., Chesher, J., Jackson, J., & Omenka, O. I. (2018). Defining the external implementation context: an integrative systematic literature review. BMC Health Services Research. https://doi.org/10.1186/s12913-018-3046-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.