The DOI matches its Crossref record; 47 of the 49 references it cites were found in a registry or an index.
The stages of implementation completion for evidence-based practice: protocol for a mixed methods study
Open accessAbstract
BACKGROUND: This protocol describes the 'development of outcome measures and suitable methodologies for dissemination and implementation approaches,' a priority for implementation research. Although many evidence-based practices (EBPs) have been developed, large knowledge gaps remain regarding how to routinely move EBPs into usual care. The lack of understanding of 'what it takes' to install EBPs has costly public health consequences, including a lack of availability of the most beneficial services, wasted efforts and resources on failed implementation attempts, and the potential for engendering reluctance to try implementing new EBPs after failed attempts.The Stages of Implementation Completion (SIC) is an eight-stage tool of implementation process and milestones, with stages spanning three implementation phases (pre-implementation, implementation, sustainability). Items delineate the date that a site completes implementation activities, yielding an assessment of duration (time to complete a stage), proportion (of stage activities completed), and a general measure of how far a site moved in the implementation process. METHODS/DESIGN: We propose to extend the SIC to EBPs operating in child service sectors (juvenile justice, schools, substance use, child welfare). Both successful and failed implementation attempts will be scrutinized using a mixed methods design. Stage costs will be measured and examined. Both retrospective data (from previous site implementation efforts) and prospective data (from newly adopting sites) will be analyzed. The influence of pre-implementation on implementation and sustainability outcomes will be examined (Aim 1). Mixed methods procedures will focus on increasing understanding of the process of implementation failure in an effort to determine if the SIC can provide early detection of sites that are unlikely to succeed (Aim 2). Study activities will include cost mapping of SIC stages and an examination of the relationship between implementation costs and implementation performance (Aim 3). DISCUSSION: This project fills a gap in the field of implementation science by addressing the measurement gap between the implementation process and the associated costs. The goal of this project is to provide tools that will help increase the uptake of EBPs, thereby increasing the availability of services to youth and decreasing wasted resources from failed implementation efforts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“a primary outcome for most of these designs can be constructed as a composite process and output score, using dimensions of speed, quality and quantity (11, 25, 101).”
From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [101]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,525
(1998) · Sage eBooks · Cited by 38,631
Designing and Conducting Mixed Methods Research
Robinson, P. M. (2007) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2007.00096.x · Cited by 23,362
(1998) · Cited by 13,501
Designing and Conducting Mixed Methods Research
นิลพันธุ์, ม. (2010) · Silpakorn Educational Research Journal · Cited by 9,351
Focus Groups as Qualitative Research
Morgan, D. (1997) · doi:10.4135/9781412984287 · Cited by 8,863
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217
Probabilistic Models for Some Intelligence and Attainment Tests
Psychology, M. (1961) · Information and Control · doi:10.1016/s0019-9958(61)80061-2 · Cited by 6,936
Research works printed but not linked: 13
- Mittman B: Presentation. Partnering for Improvement across Research, Practice, and Policy: The Case of Implementation Research in Health. 2011, Los Angeles, CA: VA Greater Los Angeles Healthcare System
- Fixsen DL, Blase K: NIRN Implementation Brief, 1. Implementation: The Missing Link Between Research and Practice. 2009, Chapel Hill: The University of North Carolina
- Proctor EK, Landsverk J: Challenges of Translating Evidence-Based Treatments into Practice Contexts and Service Sectors. Presentation. 2005, Washington, DC: Mental Health Services Research Conference
- Blasé KA, Fixsen DL: The National Implementation Research Network: Improving the science and practice of implementation. Children, Youth & Families (CFY) News. 2005, Washington, DC: American Psychological Association, 8-12.
- Linacre JM: WINSTEPS. Rasch Measurement Computer Program. 2011, Chicago: Winsteps.com
- Linacre JM: FACETS. Rasch Measurement Computer Program. 2011, Chicago: Winsteps.com
- Raudenbush SW, Bryk AS, Congdon R: HLM 6: Hierarchical Linear and Nonlinear Modeling [Computer software and manual]. 2005, Lincolnwood, IL: Scientific Software International
- Liddle HA: Multidimensional Family Therapy Treatment (MDFT) for Adolescent Cannabis Users: Vol. 5 Cannabis Youth Treatment (CYT) Manual Series. 2002, Rockville, MD: Center for Substance Abuse Treatment, Substance Abuse and Mental Health Services Administration
- Kendall PC, Khanna M: Coach’s Manual for Camp Cope-A-Lot: The Coping Cat CD-ROM. 2008, Ardmore, PA: Workbook Publishing Inc.
- Schoenwald SK, Kelleher K, Hoagwood K, Landsverk J, Glisson C: The Research Network on Youth Mental Health Clinic System Project (CSP) Director Survey. Unpublished instrument. 2003, Chicago, IL: The MacArthur Foundation
- Linacre JM: Sample size and item calibrations stability. Rasch Measurement Transactions. 1994, 7: 328-
- Bernard HR: Qualitative Methods in Cultural Anthropology. 1988, Newbury Park, CA: Sage
- Fraser D: QSR NVivo NUS*IST Vivo Reference Guide. 2000, Melbourne: QSR International
Cited by
Sorted by citations
An Overview of Research and Evaluation Designs for Dissemination and Implementation
Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., Collins, L. M., Duan, N., Mittman, B. S., Wallace, A., et al. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044215 · Cited by 509
Standards for Reporting Implementation Studies (StaRI): explanation and elaboration document
Pinnock, H., Barwick, M. A., Carpenter, C. R., Eldridge, S. M., Grandes, G., Griffiths, C., Rycroft‐Malone, J., Meißner, P., Murray, E., Patel, A. K., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013318 · Cited by 355
Tracking implementation strategies: a description of a practical approach and early findings
Bunger, A. C., Powell, B. J., Robertson, H. A., MacDowell, H., Birken, S. A., & Shea, C. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0175-y · Cited by 208
Aarons, G. A., Ehrhart, M. G., Moullin, J. C., Torres, E. M., & Green, A. E. (2017) · Implementation Science · doi:10.1186/s13012-017-0562-3 · Cited by 159
Al‐Ubaydli, O., List, J. A., & Suskind, D. L. (2017) · American Economic Review · doi:10.1257/aer.p20171115 · Cited by 156
Metadata
- Authors
- Saldana, L.
- Affiliations
- Oregon Social Learning Center (US)
- Corresponding author
- Saldana, Lisa
- ORCID
- Saldana, Lisa
- Venue
- Implementation Science
- Published
- 2014-04-05
- Volume
- 9
- Issue
- 1
- Pages
- 43-43
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC4234147
- OpenAlex
- W2135938538
- Cited by
- 188
- References
- 49
- Citations by year
- 2026: 11 · 2025: 21 · 2024: 30 · 2023: 18 · 2022: 19 · 2021: 25 · 2020: 22 · 2019: 15 · 2018: 8 · 2017: 9 · 2016: 4 · 2015: 4 · 2014: 2
- FWCI
- 11.44
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (MH080916, R01MH097748, R25MH080916)
- National Institute on Drug Abuse (P50DA035763)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- evidence-based practice, implementation process, implementation costs, implementation failure, sustainability, pre-implementation, child and youth services, juvenile justice, child welfare, schools, substance use services, cost mapping
- MeSH terms
- Child, Child Welfare, Humans, Outcome and Process Assessment, Health Care, Prospective Studies, Retrospective Studies, Program Development, Evidence-Based Practice, Translational Research, Biomedical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
![Figure 1 Conceptual model for implementation research (adapted from Proctor et al. [3]) Circled area shows target of proposal.](/paper-figures/5c905a0e689f4eb1a05aef8965daf48b/the-stages-of-implementation-completion-for-evidence-based-practice-protocol-for-figure-1.jpg)
