Predicting program start-up using the stages of implementation measure

Saldana, Lisa; Chamberlain, Patricia; Wang, Wei; Hendricks Brown, C.

doi:10.1007/s10488-011-0363-y

Cited by 148Health Policy Implementation ScienceEvaluation and Performance AssessmentPsychiatric care and mental health services

Predicting program start-up using the stages of implementation measure

Open access

Saldana, Lisa, Chamberlain, Patricia, Wang, Wei, Hendricks Brown, C.·2012·Administration and Policy in Mental Health and Mental Health Services Research

DOI 10.1007/s10488-011-0363-yPMC PMC3212640

Open this paper in CoChat — free account

Abstract

Recent efforts to better understand the process of implementation have been hampered by a lack of tools available to define and measure implementation progress. The Stages of Implementation Completion (SIC) was developed as part of an implementation trial of MTFC in 53 sites, and identifies the duration of time spent on implementation activities and the proportion of activities completed. This article examines the ability of the first three stages of the SIC (Engagement, Consideration of Feasibility, Readiness Planning) to predict successful program start-up. Results suggest that completing SIC stages completely, yet relatively quickly, predicts the likelihood of successful implementation.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1007/s10488-011-0363-y

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Implementation can be considered a developmental process, a transition through known stages.
“In order to apply social network theory and methods to implementation, we note first that implementation can be considered a developmental process, a transition through known stages [1, 34].”
From Social Network Analysis for Program Implementation (2015) · cites this paper as [34]
Broad systems for measuring implementation process through key milestones, quality, and quantity, such as the Stages of Implementation Completion or similar unobtrusive measures, can likely be used to measure implementation fidelity and progress in diverse conditions.
“Nevertheless, it is likely that broad systems for measuring implementation process through key milestones, quality, and quantity, such as those identified in the Stages of Implementation Completion [86–88], or similar unobtrusive measures [89] can be used to measure implementation fidelity and progress in diverse conditions.”
From “Scaling-out” evidence-based interventions to new populations or new health care delivery systems (2017) · cites this paper as [87]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Regression Models and Life-Tables
Cox, D. R. (1972) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1972.tb00899.x · Cited by 39,793 · see citing works
Regression Models and Life-Tables
Cox, D. R. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_37 · Cited by 26,297 · see citing works
Finding groups in data: an introduction to cluster analysis
(1991) · Choice Reviews Online · doi:10.5860/choice.28-4558 · Cited by 10,537 · see citing works
Finding Groups in Data: An Introduction to Cluster Analysis
Kaufman, L., & Rousseeuw, P. J. (1990) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316801 · Cited by 7,344 · cited 1× · see citing works
“Analytic Strategy To determine if there were similarities among counties that predicted their success in starting an MTFC program, an agglomerative hierarchical clustering method was used (Kaufman and Rousseeuw 1990).”
Method
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · see citing works
Untitled work
(2005) · Cited by 3,748 · see citing works
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 2× · see citing works
“Recently, there has been an increased effort to understand what steps in the implementation process are essential to effectively transport EBPs to a diverse range of communities, and how to best measure if these steps have occurred well (Aarons et al. 2010; Glasgow et al. 1999).”
Background
Implementation Research in Mental Health Services: an Emerging Science with Conceptual, Methodological, and Training challenges
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894 · see citing works
Mixed method designs in implementation research
Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0314-z · Cited by 1,187 · see citing works
Self-citation
Blueprints for Violence Prevention
Mihalic, S. W., Irwin, K., Elliott, D. S., Fagan, A. A., & Hansen, D. C. (2001) · PsycEXTRA Dataset · doi:10.1037/e304162003-001 · Cited by 497 · see citing works
Toward the Effective and Efficient Measurement of Implementation Fidelity
Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam‐Gerow, M. A. (2010) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0321-0 · Cited by 422 · see citing works
Comparison of two community alternatives to incarceration for chronic juvenile offenders.
Chamberlain, P., & Reid, J. B. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.4.624 · Cited by 356 · see citing works
Self-citation
Comparison of two community alternatives to incarceration for chronic juvenile offenders.
Chamberlain, P., & Reid, J. B. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.4.624 · Cited by 331 · see citing works
Self-citation
Observational measure of implementation progress in community based settings: The Stages of implementation completion (SIC)
Chamberlain, P., Brown, C. H., & Saldana, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-116 · Cited by 262 · see citing works
Self-citation
Multidimensional treatment foster care for girls in the juvenile justice system: 2-year follow-up of a randomized clinical trial.
Chamberlain, P., Leve, L. D., & DeGarmo, D. S. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.1.187 · Cited by 238 · see citing works
Self-citation
Multidimensional Treatment Foster Care
Fisher, P. A., & Chamberlain, P. (2000) · Journal of Emotional and Behavioral Disorders · doi:10.1177/106342660000800303 · Cited by 187 · see citing works
Self-citation
The oregon multidimensional treatment foster care model: Features, outcomes, and progress in dissemination
Chamberlain, P. (2003) · Cognitive and Behavioral Practice · doi:10.1016/s1077-7229(03)80048-2 · Cited by 155 · see citing works
Self-citation
A Randomized Evaluation of Multidimensional Treatment Foster Care: Effects on School Attendance and Homework Completion in Juvenile Justice Girls
Leve, L. D., & Chamberlain, P. (2007) · Research on Social Work Practice · doi:10.1177/1049731506293971 · Cited by 113 · see citing works
Self-citation
Blueprints for Violence Prevention
Mihalic, S. W., Fagan, A. A., Irwin, K., Ballard, D., & Elliott, D. S. (2004) · PsycEXTRA Dataset · doi:10.1037/e302992005-001 · Cited by 108 · see citing works
Methodological Issues in Child Welfare and Children’s Mental Health Implementation Research
Horwitz, S. M., & Landsverk, J. A. (2010) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0316-x · Cited by 14 · see citing works

Flagged first, then by citations

1 of the 21 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

Fixsen DL Blase KA Duda MA Naoom SF Van Dyke MK Weisz JR Kazdin AE Implementation of evidence-based treatments for children and adolescents: Research findings and their implications for the future Evidence-based psychotherapies for children and adolescents 2010 2nd ed New York Guilford Press

Sorted by citations

“Scaling-out” evidence-based interventions to new populations or new health care delivery systems
Aarons, G. A., Sklar, M., Mustanski, B., Benbow, N., & Brown, C. H. (2017) · Implementation Science · doi:10.1186/s13012-017-0640-6 · Cited by 399 · see citing works
Self-citation
Social Network Analysis for Program Implementation
Valente, T. W., Palinkas, L. A., Czaja, S., Chu, K.-H., & Brown, C. H. (2015) · PLOS ONE · doi:10.1371/journal.pone.0131712 · Cited by 332 · see citing works
Observational measure of implementation progress in community based settings: The Stages of implementation completion (SIC)
Chamberlain, P., Brown, C. H., & Saldana, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-116 · Cited by 262 · see citing works
Self-citation
Annual Research Review: The state of implementation science in child psychology and psychiatry: a review and suggestions to advance the field
Williams, N. J., & Beidas, R. S. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12960 · Cited by 233 · see citing works
Tracking implementation strategies: a description of a practical approach and early findings
Bunger, A. C., Powell, B. J., Robertson, H. A., MacDowell, H., Birken, S. A., & Shea, C. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0175-y · Cited by 208 · see citing works
The stages of implementation completion for evidence-based practice: protocol for a mixed methods study
Saldana, L. (2014) · Implementation Science · doi:10.1186/1748-5908-9-43 · Cited by 188 · see citing works
Self-citation
The cost of implementing new strategies (COINS): A method for mapping implementation resources using the stages of implementation completion
Saldana, L., Chamberlain, P., Bradford, W. D., Campbell, M., & Landsverk, J. (2014) · Children and Youth Services Review · doi:10.1016/j.childyouth.2013.10.006 · Cited by 175 · see citing works
Self-citation
Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol
Aarons, G. A., Ehrhart, M. G., Moullin, J. C., Torres, E. M., & Green, A. E. (2017) · Implementation Science · doi:10.1186/s13012-017-0562-3 · Cited by 159 · see citing works
Increasing implementation science literacy to address the research-to-practice gap in school psychology
Hagermoser Sanetti, L. M., & Collier-Meek, M. A. (2019) · Journal of School Psychology · doi:10.1016/j.jsp.2019.07.008 · Cited by 129 · see citing works
Evaluation of two implementation strategies in 51 child county public service systems in two states: results of a cluster randomized head-to-head implementation trial
Brown, C. H., Chamberlain, P., Saldana, L., Padgett, C., Wang, W., & Cruden, G. (2014) · Implementation Science · doi:10.1186/s13012-014-0134-8 · Cited by 89 · see citing works
Self-citation
How do stakeholders from multiple hierarchical levels of a large provincial health system define engagement? A qualitative study
Norris, J. M., White, D. E., Nowell, L., Mrklas, K., & Stelfox, H. (2017) · Implementation Science · doi:10.1186/s13012-017-0625-5 · Cited by 82 · see citing works
A repeated cross-sectional study of clinicians’ use of psychotherapy techniques during 5 years of a system-wide effort to implement evidence-based practices in Philadelphia
Beidas, R. S., Williams, N. J., Becker‐Haimes, E. M., Aarons, G. A., Barg, F. K., Evans, A. C., Jackson, K., Jones, D. T., Hadley, T. R., Hoagwood, K., et al. (2019) · Implementation Science · doi:10.1186/s13012-019-0912-4 · Cited by 85 · see citing works
The relative value of Pre-Implementation stages for successful implementation of evidence-informed programs
Alley, Z. M., Chapman, J. E., Schaper, H., & Saldana, L. (2023) · Implementation Science · doi:10.1186/s13012-023-01285-0 · Cited by 86 · see citing works
Self-citation
Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review
Hall, A., Shoesmith, A., Doherty, E., McEvoy, B., Mettert, K., Lewis, C. C., Wolfenden, L., Yoong, S., Kingsland, M., Shelton, R. C., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01252-1 · Cited by 81 · see citing works
The Active Implementation Frameworks: A roadmap for advancing implementation of Comprehensive Medication Management in Primary care
Blanchard, C., Livet, M., Ward, C. S., Sorge, L. A., Sorensen, T. D., & McClurg, M. R. (2017) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2017.05.006 · Cited by 81 · see citing works
Factors Predicting Sustained Implementation of a Universal Behavior Support Framework
McIntosh, K., Mercer, S. H., Nese, R. N. T., Strickland-Cohen, M. K., Kittelman, A., Hoselton, R. M., & Horner, R. H. (2018) · Educational Researcher · doi:10.3102/0013189x18776975 · Cited by 77 · see citing works
Implementation frameworks in child, youth and family services – Results from a scoping review
Albers, B., Mildon, R. L., Lyon, A. R., & Shlonsky, A. (2017) · Children and Youth Services Review · doi:10.1016/j.childyouth.2017.07.003 · Cited by 79 · see citing works
Conceptualizing and measuring sustainability of prevention programs, policies, and practices
Palinkas, L. A., Spear, S. E., Mendon, S. J., Villamar, J., Reynolds, C., Green, C. D., Olson, C., Adade, A., & Brown, C. H. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz170 · Cited by 66 · see citing works
Supporting Implementation: The Role of Community Development Teams to Build Infrastructure
Saldana, L., & Chamberlain, P. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9503-0 · Cited by 65 · see citing works
Self-citation
A Mixed Methods Study of the Stages of Implementation for an Evidence-Based Trauma Intervention in Schools
Nadeem, E., Saldana, L., Chapman, J. E., & Schaper, H. (2017) · Behavior Therapy · doi:10.1016/j.beth.2017.12.004 · Cited by 66 · see citing works
Self-citation
Adapting Supported Employment for Emerging Adults with Serious Mental Health Conditions
Ellison, M. L., Klodnick, V. V., Bond, G. R., Krzos, I. M., Kaiser, S. M., Fagan, M. A., & Davis, M. (2014) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-014-9445-4 · Cited by 63 · see citing works
Applying an Implementation Science Framework for Adoption of a Comprehensive Program for High School Students With Autism Spectrum Disorder
Odom, S. L., Duda, M. A., Kucharczyk, S., Cox, A. W., & Stabel, A. (2014) · Remedial and Special Education · doi:10.1177/0741932513519826 · Cited by 63 · see citing works
Ready, Set, Change! Development and usability testing of an online readiness for change decision support tool for healthcare organizations
Timmings, C., Khan, S., Moore, J. E., Marquez, C., Pyka, K., & Straus, S. E. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0262-y · Cited by 60 · see citing works
Development and testing of an implementation strategy for a complex housing intervention: protocol for a mixed methods study
Watson, D. P., Young, J., Ahonen, E. Q., Xu, H., Henderson, M. L., Shuman, V., & Tolliver, R. (2014) · Implementation Science · doi:10.1186/s13012-014-0138-4 · Cited by 58 · see citing works
Implementation Outcomes and Indicators as a New Challenge in Health Services Research: A Systematic Scoping Review
Willmeroth, T., Wesselborg, B., & Kuske, S. (2019) · INQUIRY The Journal of Health Care Organization Provision and Financing · doi:10.1177/0046958019861257 · Cited by 52 · see citing works
Integrated urban water management applied to adaptation to climate change
Kirshen, P., Aytur, S., Hecht, J. S., Walker, A., Burdick, D. M., Jones, S. H., Fennessey, N. M., Bourdeau, R., & Mather, L. (2018) · Urban Climate · doi:10.1016/j.uclim.2018.03.005 · Cited by 49 · see citing works
Identifying and Predicting Distinct Patterns of Implementation in a School-Wide Behavior Support Framework
McIntosh, K., Mercer, S. H., Nese, R. N. T., & Ghemraoui, A. (2016) · Prevention Science · doi:10.1007/s11121-016-0700-1 · Cited by 45 · see citing works
Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study
Nevedal, A. L., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B., Gifford, A. L., Orvek, E., DeLaughter, K., White, L., King, H. A., et al. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00053-1 · Cited by 44 · see citing works
A mixed-methods process evaluation of Family Navigation implementation for autism spectrum disorder
Broder‐Fingert, S., Qin, S., Goupil, J., Rosenberg, J., Augustyn, M. C., Blum, N., Bennett, A. E., Weitzman, C. C., Guevara, J. P., Fenick, A. M., et al. (2018) · Autism · doi:10.1177/1362361318808460 · Cited by 45 · see citing works
Scaling Implementation of Collaborative Care for Depression: Adaptation of the Stages of Implementation Completion (SIC)
Saldana, L., Bennett, I. M., Powers, D., Vredevoogd, M., Grover, T., Schaper, H., & Campbell, M. R. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00944-z · Cited by 42 · see citing works
Self-citation
The implementation and sustainment facilitation strategy improved implementation effectiveness and intervention effectiveness: Results from a cluster-randomized, type 2 hybrid trial
Garner, B. R., Gotham, H. J., Chaple, M., Martino, S., Ford, J. H., Roosa, M. R., Speck, K. J., Vandersloot, D., Bradshaw, M., Ball, E. L., et al. (2020) · Implementation Research and Practice · doi:10.1177/2633489520948073 · Cited by 39 · see citing works
Child maltreatment online education for healthcare and social service providers: Implications for the COVID-19 context and beyond
Kimber, M., McTavish, J. R., Vanstone, M. G., Stewart, D. E., & MacMillan, H. L. (2020) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2020.104743 · Cited by 38 · see citing works
Rates of sustainment in the Universal Stages of Implementation Completion
Wong, D. R., Schaper, H., & Saldana, L. (2022) · Implementation Science Communications · doi:10.1186/s43058-021-00250-6 · Cited by 40 · see citing works
Self-citation
Resource Leveraging to Achieve Large-Scale Implementation of Effective Educational Practices
Horner, R. H., Ward, C. S., Fixsen, D. L., Sugai, G. M., McIntosh, K., Putnam, R. F., & Little, H. D. (2018) · Journal of Positive Behavior Interventions · doi:10.1177/1098300718783754 · Cited by 33 · see citing works
Implementation capital: merging frameworks of implementation outcomes and social capital to support the use of evidence-based practices
Neal, J. W., & Neal, Z. P. (2019) · Implementation Science · doi:10.1186/s13012-019-0860-z · Cited by 33 · see citing works
An observational study of the impact of COVID-19 and the rapid implementation of telehealth on community mental health center providers
Sklar, M., Reeder, K., Carandang, K. M., Ehrhart, M. G., & Aarons, G. A. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00123-y · Cited by 33 · see citing works
Social-learning parenting intervention research in the era of translational neuroscience
Fisher, P. A., & Skowron, E. A. (2017) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2017.02.017 · Cited by 33 · see citing works
Use of research evidence and implementation of evidence-based practices in youth-serving systems
Palinkas, L. A., Saldana, L., Chou, C., & Chamberlain, P. (2017) · Children and Youth Services Review · doi:10.1016/j.childyouth.2017.11.005 · Cited by 32 · see citing works
Self-citation
‘It’s All About Context’: Building School Capacity to Implement a Whole-School Approach to Bullying
Pearce, N., Monks, H., Alderman, N., Hearn, L., Burns, S. K., Runions, K., Francis, J., & CROSS, D. S. (2022) · International Journal of Bullying Prevention · doi:10.1007/s42380-022-00138-6 · Cited by 46 · see citing works
A Systematic Review and Meta-Synthesis of Barriers and Facilitators of Help-Seeking Behaviors in South Asian Women Living in High-Income Countries who Have Experienced Domestic Violence: Perception of Domestic Violence Survivors and Service Providers
Sultana, R., Ozen-Dursun, B., Femi-Ajao, O., Husain, N., Varese, F., & Taylor, P. (2022) · Trauma, Violence, & Abuse · doi:10.1177/15248380221126189 · Cited by 30 · see citing works
Toward Creating Synergy Among Policy, Procedures, and Implementation of Evidence-Based Models in Child Welfare Systems: Two Case Examples
Chamberlain, P. (2017) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-017-0226-5 · Cited by 27 · see citing works
Self-citation
Fidelity of Implementation in the Field of Learning Disabilities
Sanetti, L. M. H., & Luh, H.-J. (2019) · Learning Disability Quarterly · doi:10.1177/0731948719851514 · Cited by 29 · see citing works
Expanding access to medications for opioid use disorder in primary care clinics: an evaluation of common implementation strategies and outcomes
Cheng, H. L., McGovern, M. P., Garneau, H. C., Hurley, B., Fisher, T., Copeland, M., & Almirall, D. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00306-1 · Cited by 25 · see citing works
Understanding pathways from implementation to sustainment: a longitudinal, mixed methods analysis of promising practices implemented in the Veterans Health Administration
Nevedal, A., Widerquist, M. A. O., Reardon, C. M., Arasim, M. E., Jackson, G. L., White, B. S., Burns, M., Fix, G. M., DeLaughter, K. L., Cutrona, S. L., et al. (2024) · Implementation Science · doi:10.1186/s13012-024-01361-z · Cited by 25 · see citing works
Getting Ready for Scale-Up of an Effective Older Adult Physical Activity Program: Characterizing the Adaptation Process
Gray, S. M., McKay, H. A., Hoy, C. L., Lau, E. Y., Ahn, R., Lusina‐Furst, S., & Sims‐Gould, J. (2020) · Prevention Science · doi:10.1007/s11121-019-01085-3 · Cited by 24 · see citing works
Implementation Science and Child Maltreatment
Proctor, E. K. (2012) · Child Maltreatment · doi:10.1177/1077559512437034 · Cited by 22 · see citing works
Implementing risk stratification to the treatment of adolescent substance use among youth involved in the juvenile justice system: protocol of a hybrid type I trial
Aalsma, M. C., Dir, A. L., Zapolski, T. C. B., Hulvershorn, L. A., Monahan, P. O., Saldana, L., & Adams, Z. W. (2019) · Addiction Science & Clinical Practice · doi:10.1186/s13722-019-0161-5 · Cited by 21 · see citing works
Self-citation
Influence network linkages across implementation strategy conditions in a randomized controlled trial of two strategies for scaling up evidence-based practices in public youth-serving systems
Palinkas, L. A., Holloway, I. W., Rice, E., Brown, C. H., Valente, T. W., & Chamberlain, P. (2013) · Implementation Science · doi:10.1186/1748-5908-8-133 · Cited by 20 · see citing works
Self-citation
Examining Commitment to Prevention, Equity, and Meaningful Engagement: A Review of School District Discipline Policies
Green, A. L., Hatton, H. L., Stegenga, S. M., Eliason, B., & Nese, R. N. T. (2020) · Journal of Positive Behavior Interventions · doi:10.1177/1098300720951940 · Cited by 20 · see citing works
Engaging stakeholders in the adaptation of the Connect for Health pediatric weight management program for national implementation
Simione, M., Frost, H. M., Cournoyer, R. N., Mini, F. N., Cassidy, J., Craddock, C., Moreland, J., Wallace, J., Metlay, J. P., Kistin, C. J., et al. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00047-z · Cited by 20 · see citing works
Protocol for comparing two training approaches for primary care professionals implementing the Safe Environment for Every Kid (SEEK) model
Dubowitz, H., Saldana, L., Magder, L., Palinkas, L. A., Landsverk, J. A., Belanger, R., & Nwosu, U. S. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00059-9 · Cited by 20 · see citing works
Self-citation
Stages of Change: Moving Community Pharmacies From a Drug Dispensing to Population Health Management Model
Turner, K. L., Weinberger, M., Renfro, C. P., Powell, B. J., Ferreri, S. P., Trodgon, J. G., Mark, N., Trygstad, T. K., & Shea, C. M. (2019) · Medical Care Research and Review · doi:10.1177/1077558719841159 · Cited by 18 · see citing works
Automatic classification of communication logs into implementation stages via text analysis
Wang, D., Ogihara, M., Gallo, C., Villamar, J. A., Smith, J. D., Vermeer, W., Cruden, G., Benbow, N., & Brown, C. H. (2015) · Implementation Science · doi:10.1186/s13012-016-0483-6 · Cited by 17 · see citing works
Using NIATx strategies to implement integrated services in routine care: a study protocol
Ford, J. H., Osborne, E. L., Assefa, M. T., McIlvaine, A. M., King, A. M., Campbell, K. M., & McGovern, M. P. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3241-4 · Cited by 17 · see citing works
What Predicts Clinician Dropout from State-Sponsored Managing and Adapting Practice Training
Olin, S.-C. S., Nadeem, E., Gleacher, A. A., Weaver, J. C., Weiss, D., Hoagwood, K., & Horwitz, S. M. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0709-y · Cited by 16 · see citing works
Characterizing implementation strategies using a systems engineering survey and interview tool: a comparison across 10 prevention programs for drug abuse and HIV sexual risk behavior
Czaja, S. J., Valente, T. W., Nair, S. N., Villamar, J. A., & Brown, C. H. (2015) · Implementation Science · doi:10.1186/s13012-016-0433-3 · Cited by 15 · see citing works
The Secret Sauce? Taking the Mystery Out of Scaling-Up School-Based Physical Activity Interventions
McKay, H. A., Kennedy, S. G., MACDONALD, H. M., Naylor, P., & Lubans, D. R. (2024) · Journal of Physical Activity and Health · doi:10.1123/jpah.2024-0274 · Cited by 16 · see citing works
En Route to Implementation Science 3.0
Albers, B., Shlonsky, A., & Mildon, R. L. (2020) · Springer eBooks · doi:10.1007/978-3-030-03874-8_1 · Cited by 15 · see citing works
Stepped implementation-to-target: a study protocol of an adaptive trial to expand access to addiction medications
Ford, J. H., Cheng, H. L., Gassman, M., Fontaine, H., Garneau, H. C., Keith, R., Michael, E., & McGovern, M. P. (2022) · Implementation Science · doi:10.1186/s13012-022-01239-y · Cited by 14 · see citing works
“I Wish I Knew This Before…”: An Implementation Science Primer and Model to Guide Implementation of Simulation Programs in Medical Education
Dubrowski, R., Barwick, M. A., & Dubrowski, A. (2018) · Springer eBooks · doi:10.1007/978-3-319-90518-1_10 · Cited by 14 · see citing works
Parental substance use and home visiting programs: Implementation considerations for relationship‐based treatment
Lowell, A. F., Suchman, N. E., Byatt, N., Feinberg, E., Friedmann, P. D., & Peacock‐Chambers, E. (2023) · Infant Mental Health Journal · doi:10.1002/imhj.22041 · Cited by 14 · see citing works
Implementation strategies to promote community-engaged efforts to counter tobacco marketing at the point of sale
Leeman, J., Myers, A., Grant, J. C., Wangen, M., & Queen, T. L. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-017-0489-x · Cited by 14 · see citing works
Repeated measures of implementation variables
Fixsen, D. L., Dyke, M. K. V., & Blasé, K. A. (2023) · Frontiers in Health Services · doi:10.3389/frhs.2023.1085859 · Cited by 12 · see citing works
Transforming community prevention systems for sustained impact: embedding active implementation and scaling functions
Aldridge, W. A., Boothroyd, R. I., Fleming, W. O., Jarboe, K. L., Morrow, J., Ritchie, G. F., & Sebian, J. (2016) · Translational Behavioral Medicine · doi:10.1007/s13142-015-0351-y · Cited by 12 · see citing works
A longitudinal mixed method approach for assessing implementation context and process factors: Comparison of three sites from a Housing First implementation strategy pilot
Watson, D. P., Snow‐Hill, N. L., Saldana, L., Walden, A. L., Staton, M. D., Kong, A., & Donenberg, G. R. (2020) · Implementation Research and Practice · doi:10.1177/2633489520974974 · Cited by 13 · see citing works
Self-citation
A framework for designing hybrid effectiveness-implementation trials for digital health interventions
Matson, T. E., Hermes, E. D. A., Lyon, A. R., Quanbeck, A., Schueller, S. M., Wilson, S. M., & Glass, J. E. (2025) · Annals of Epidemiology · doi:10.1016/j.annepidem.2025.02.007 · Cited by 11 · see citing works
Rollout trial designs in implementation research are often necessary and sometimes preferred
Simon, G. E., Garner, B. R., Smith, J. D., Wyman, P. A., Matson, T. E., Chin-Purcell, L., Cero, I., Vermeer, W., Johnson, K., Prado, G. J., et al. (2025) · Implementation Science · doi:10.1186/s13012-025-01422-x · Cited by 11 · see citing works
Implementation of Mobile Teledermatology: Challenges and Opportunities
Peracca, S. B., Fonseca, A., Hines, A. C., King, H. A., Grenga, A. M., Jackson, G. L., Whited, J. D., Chapman, J. G., Lamkin, R. P., Mohr, D. C., et al. (2021) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2020.0500 · Cited by 11 · see citing works
Core Components and Implementation Determinants of Multilevel Service Delivery Frameworks Across Child Mental Health Service Settings
Moore, S. A., Cooper, J. M., Malloy, J. M., & Lyon, A. R. (2023) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-023-01320-8 · Cited by 13 · see citing works
Supporting Evidence-Based Practices: What Implementation Activities Are Needed When for Success?
Ward, C. S., Kittelman, A., & Rowe, D. A. (2021) · Teaching Exceptional Children · doi:10.1177/00400599211010176 · Cited by 10 · see citing works
Opening the “black box”: Four common implementation strategies for expanding the use of medications for opioid use disorder in primary care
Caton, L., Shen, H., Miele, G. M., Darfler, K., Sandoval, J. R., Urada, D. I., & McGovern, M. P. (2021) · Implementation Research and Practice · doi:10.1177/26334895211005809 · Cited by 9 · see citing works
Translating the Intervention Approach into an Appropriate Research Design: The Next-Generation Adaptive Designs for Effectiveness and Implementation Research
Brown, C. H., Mason, W. A., & Brown, E. C. (2014) · Springer eBooks · doi:10.1007/978-1-4899-7424-2_16 · Cited by 9 · see citing works
Sex Venue-Based Network Analysis to Identify HIV Prevention Dissemination Targets for Men Who Have Sex with Men
Patel, R. R., Luke, D. A., Proctor, E. K., Powderly, W. G., Chan, P. A., Mayer, K. H., Harrison, L. C., & Dhand, A. (2018) · LGBT Health · doi:10.1089/lgbt.2017.0018 · Cited by 9 · see citing works
The Nurse–Family Partnership in Colorado: Supporting High‐Quality Programming With Implementation Science
Neal, M., & Fixsen, A. A. M. (2019) · Journal of Nursing Scholarship · doi:10.1111/jnu.12506 · Cited by 9 · see citing works
Implementation of Direct-to-Patient Mobile Teledermatology in VA
Peracca, S. B., Lachica, O., Lamkin, R. P., Jackson, G. L., Mohr, D. C., King, H. A., Whited, J. D., Fonseca, A. S., Morris, I. J., Gifford, A. L., et al. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-023-08480-1 · Cited by 8 · see citing works
Active Implementation Frameworks: Their Importance to Implementing and Sustaining Effective Mental Health Programs in Rural Schools
Sims, B., & Melcher, B. (2017) · Springer eBooks · doi:10.1007/978-3-319-64735-7_22 · Cited by 8 · see citing works
The Early Implementation of FFT-CW®, MST-Psychiatric®, and SafeCare® in Australia
Albers, B., Hateley-Browne, J., Steele, T., Rose, V. K., Shlonsky, A., & Mildon, R. L. (2020) · Research on Social Work Practice · doi:10.1177/1049731520908326 · Cited by 8 · see citing works
An Exploratory Study of a Training Team-Coordinated Approach to Implementation
Sterrett-Hong, E., Saldana, L., Burek, J., Schaper, H., Karam, E. A., Verbist, A. N., & Cameron, K. (2021) · Global Implementation Research and Applications · doi:10.1007/s43477-020-00003-y · Cited by 8 · see citing works
Self-citation
Effective Implementation Capacity to Impact Change Within State Education Systems to Support Students With Disabilities
Ward, C. S., Ihlo, T., Jackson, K. R., & Farmer, S. (2022) · Journal of Disability Policy Studies · doi:10.1177/10442073221096392 · Cited by 8 · see citing works
The Role of Organizational Processes in Dissemination and Implementation Research
Aarons, G. A., Ehrhart, M. G., Lengnick‐Hall, R., & Moullin, J. C. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197660690.003.0009 · Cited by 7 · see citing works
Implementing Measurement-Based Care in a Youth Partial Hospital Setting: Leveraging Feedback for Sustainability
Donelan, J., Douglas, S. R., Willson, A., Lester, T., & Daly, S. (2024) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-024-01358-2 · Cited by 7 · see citing works
Researching the Impact of Service provider Education (RISE) Project — a multiphase mixed methods protocol to evaluate implementation acceptability and feasibility
Kimber, M., Vanstone, M. G., Dimitropoulos, G., Collin‐Vézina, D., & Stewart, D. E. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-01096-y · Cited by 7 · see citing works
Implementation Science: Foundations and Applied Practice in Educational Settings
Farmer, S., Ward, C. S., & Cusumano, D. L. (2023) · Springer eBooks · doi:10.1007/978-3-031-21381-6_2 · Cited by 7 · see citing works
Multiple Levels and Modalities of Measurement in a Population-Based Approach to Improving Parenting
Metzler, C. W., Sanders, M. R., & Rusby, J. C. (2013) · National symposium on family issues · doi:10.1007/978-3-319-01562-0_12 · Cited by 7 · see citing works
Development and psychometric testing of the clinical networks engagement tool
Norris, J. M., Hecker, K. G., Rabatach, L., Noseworthy, T., & White, D. (2017) · PLoS ONE · doi:10.1371/journal.pone.0174056 · Cited by 7 · see citing works
Implementing a pharmacist-integrated collaborative model of medication treatment for opioid use disorder in primary care: study design and methodological considerations
McLeman, B. M., Gauthier, P. R., Lester, L. S., Homsted, F. A. E., Gardner, V. T., Moore, S. K., Joudrey, P. J., Saldana, L., Cochran, G., Harris, J. P., et al. (2024) · Addiction Science & Clinical Practice · doi:10.1186/s13722-024-00452-y · Cited by 7 · see citing works
Self-citation
Prevention System Implementation and Reach: Attitudes and Environmental Predictors in a Randomized Controlled Trial of the NORTH STAR Prevention System
Rhoades, K. A., Slep, A. M. S., Lorber, M. F., Heyman, R. E., Eddy, J. M., & Linkh, D. J. (2022) · Prevention Science · doi:10.1007/s11121-022-01352-w · Cited by 6 · see citing works
Early Head Start start-up planning: Implications for staff support, job satisfaction, burnout, and turnover
Gill, S., Nathans, L., Seidel, A. J., & Greenberg, M. T. (2017) · Journal of Community Psychology · doi:10.1002/jcop.21857 · Cited by 6 · see citing works
The Role of Implementation Science in Behavioral Health
Massey, O. T., & Vroom, E. B. (2019) · Springer eBooks · doi:10.1007/978-3-030-18435-3_5 · Cited by 6 · see citing works
Are Principals’ Social Networks Associated with Interventions’ Social Validity?
Neal, J. W., Neal, Z. P., Barrett, C. A., & Brutzman, B. (2020) · School Mental Health · doi:10.1007/s12310-020-09388-5 · Cited by 6 · see citing works
The Science, and Art, of Program Dissemination: Strategies, Successes, and Challenges
McCoy, K. P. (2015) · New Directions for Child and Adolescent Development · doi:10.1002/cad.20109 · Cited by 6 · see citing works
Using the RE-AIM framework to assess national teledermatology expansion
Lamkin, R. P., Peracca, S. B., Jackson, G. L., Hines, A. C., Gifford, A. L., Lachica, O., Li, D., Morris, I. J., Paiva, M. L., Weinstock, M. A., et al. (2023) · Frontiers in Health Services · doi:10.3389/frhs.2023.1217829 · Cited by 5 · see citing works
Implementation preparation costs of virtual reality job interview training in prisons: a budget impact analysis
Danielson, E. C., Smith, M. J., Ross, B., Parham, B., Johnson, J. E., Cuddeback, G. S., Smith, J. D., McGregor, D., Suganuma, A., & Jordan, N. (2023) · Journal of Offender Rehabilitation · doi:10.1080/10509674.2022.2160040 · Cited by 8 · see citing works
Evaluating the Implementation of the Connect for Health Pediatric Weight Management Program
Simione, M., Frost, H. M., Farrar-Muir, H., Luo, M., Granadeño, J., Torres, C. G., Boudreau, A. A., Moreland, J., Wallace, J., Young, J., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.52648 · Cited by 5 · see citing works
Implementing High-Intensity Gait Training in Stroke Rehabilitation: A Real-World Pragmatic Approach
Moore, J. L., Krøll, P., Berg, H. H., Sinnes, M. B., Arntsen, R., Henderson, C. E., Hornby, T. G., Rimehaug, S. A., Lilleheie, I., & Orpana, A. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14155409 · Cited by 3 · see citing works
A case study of the co-creation of the PrEP-SIC: a roadmap to support introduction of pre-exposure prophylaxis into new settings
Meyers, K. A., Lane, B., Zucker, J. E., Wu, Y., Carnevale, C., Burnside, H., Rowan, S. E., Mayes, E., Narcisse, G., Gold, M. A., et al. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12670-4 · Cited by 5 · see citing works
Self-citation
Ensuring Active Implementation Support for North Carolina Counties Scaling the Triple P System of Interventions.
Aldridge, W. A., Boothroyd, R. I., Veazey, C. A., Powell, B. J., Murray, D., & Prinz, R. J. (2016) · Cited by 4 · see citing works
The Acceptability of Psychedelic‐Assisted Therapy Amongst Mental Health Consumers: Utilising the Theory of Planned Behaviour
Louie, E., Towers, E. E., Morse, A. R., Watt, J., Bryant, Z., Haber, P., & Morley, K. C. (2025) · International Journal of Mental Health Nursing · doi:10.1111/inm.70010 · Cited by 3 · see citing works
Development and evaluation of Goal setting and Action Planning (G-AP) training to support person-centred rehabilitation practice
Scobbie, L., Elliott, K., Boa, S., Grayson, L., Chesnet, E., Izat, I., Barber, M., & Fisher, R. J. (2025) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2025.1505188 · Cited by 3 · see citing works
Practice to Research and Back in a Social Service Agency: Trying to DO BETTER
Tyler, P. M., Mason, W. A., Vollmer, B., & Trout, A. L. (2020) · Child & Youth Care Forum · doi:10.1007/s10566-020-09548-3 · Cited by 3 · see citing works

The relative value of Pre-Implementation stages for successful implementation of evidence-informed programs
Alley, Z. M., Chapman, J. E., Schaper, H., & Saldana, L. (2023) · Implementation Science · doi:10.1186/s13012-023-01285-0 · Cited by 86 · see citing works
Self-citation
Observational measure of implementation progress in community based settings: The Stages of implementation completion (SIC)
Chamberlain, P., Brown, C. H., & Saldana, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-116 · Cited by 262 · see citing works
Self-citation
The stages of implementation completion for evidence-based practice: protocol for a mixed methods study
Saldana, L. (2014) · Implementation Science · doi:10.1186/1748-5908-9-43 · Cited by 188 · see citing works
Self-citation
Implementation timelines across conditions: a universal Stages of Implementation Completion® (SIC) comparison of research-led and real-world implementations
Young, W. N., Glass, J. E., & Saldana, L. (2026) · Implementation Science · doi:10.1186/s13012-026-01510-6 · Cited by 1 · see citing works
Self-citation
Evidence-Based Practice, Part I: Research Update
BURNS, B. (2004) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/s1056-4993(04)00063-x · Cited by 15 · see citing works

Authors: Saldana, L., Chamberlain, P., Wang, W., & Hendricks Brown, C.
Affiliations: University of South Florida (US)
Corresponding author: Saldana, Lisa
ORCID: Saldana, Lisa
Chamberlain, Patricia
Venue: Administration and Policy in Mental Health and Mental Health Services Research
Publisher: Springer Science and Business Media LLC
Published: 2011-06-28
Volume: 39
Issue: 6
Pages: 419-425
ISSN: 0894-587X (ISSN-L)
1573-3289
DOI: 10.1007/s10488-011-0363-y
PMC: PMC3212640
OpenAlex: W1995981850
Cited by: 148
References: 21
Citations by year: 2026: 2 · 2025: 15 · 2024: 16 · 2023: 12 · 2022: 15 · 2021: 6 · 2020: 19 · 2019: 14 · 2018: 10 · 2017: 15 · 2016: 4 · 2015: 6 · 2014: 6 · 2013: 5 · 2012: 2
FWCI: 8.31
Type: journal article
Language: en
Open access: green
europepmc.org
Licence: www.springer.com/tdm (tdm)
Locations: Administration and Policy in Mental Health and Mental Health Services Research (publishedVersion)
PubMed (publishedVersion)
Europe PMC (PubMed Central) (acceptedVersion)
PubMed Central (acceptedVersion)
Funders: National Institute of Mental Health (R01MH076158, R25MH080916)
National Institute on Drug Abuse (P30DA023920, K23DA021603)
Topics: Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
Keywords: program implementation, implementation readiness, feasibility assessment, mental health services
MeSH terms: Mental Disorders, California, Community Mental Health Services, Forecasting, Foster Home Care, Health Plan Implementation, Health Services Needs and Demand, Humans, Ohio, Program Development

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Predicting program start-up using the stages of implementation measure

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks