Cited by 148Health Policy Implementation ScienceEvaluation and Performance AssessmentPsychiatric care and mental health services

The DOI matches its Crossref record; 20 of the 21 references it cites were found in a registry or an index.

Predicting Program Start-Up Using the Stages of Implementation Measure

Open access

Saldana, Lisa, Chamberlain, Patricia, Wang, Wei, Hendricks Brown, C.·2012·Administration and Policy in Mental Health and Mental Health Services Research

DOI 10.1007/s10488-011-0363-yPMC PMC3212640

Open this paper in CoChat — free account

Abstract

Recent efforts to better understand the process of implementation have been hampered by a lack of tools available to define and measure implementation progress. The Stages of Implementation Completion (SIC) was developed as part of an implementation trial of MTFC in 53 sites, and identifies the duration of time spent on implementation activities and the proportion of activities completed. This article examines the ability of the first three stages of the SIC (Engagement, Consideration of Feasibility, Readiness Planning) to predict successful program start-up. Results suggest that completing SIC stages completely, yet relatively quickly, predicts the likelihood of successful implementation.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1007/s10488-011-0363-y

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Regression Models and Life-Tables
Cox, D. R. (1972) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1972.tb00899.x · Cited by 39,793
Regression Models and Life-Tables
Cox, D. R. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_37 · Cited by 26,297
Finding groups in data: an introduction to cluster analysis
(1991) · Choice Reviews Online · doi:10.5860/choice.28-4558 · Cited by 10,537
Finding Groups in Data: An Introduction to Cluster Analysis
Kaufman, L., & Rousseeuw, P. J. (1990) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316801 · Cited by 7,344 · cited 1×
“Analytic Strategy To determine if there were similarities among counties that predicted their success in starting an MTFC program, an agglomerative hierarchical clustering method was used (Kaufman and Rousseeuw 1990).”
Method
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217
Untitled work
(2005) · Cited by 3,748
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 2×
“Recently, there has been an increased effort to understand what steps in the implementation process are essential to effectively transport EBPs to a diverse range of communities, and how to best measure if these steps have occurred well (Aarons et al. 2010; Glasgow et al. 1999).”
Background
Implementation Research in Mental Health Services: an Emerging Science with Conceptual, Methodological, and Training challenges
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894
Mixed method designs in implementation research
Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0314-z · Cited by 1,187
Self-citation
Blueprints for Violence Prevention
Mihalic, S. W., Irwin, K., Elliott, D. S., Fagan, A. A., & Hansen, D. C. (2001) · PsycEXTRA Dataset · doi:10.1037/e304162003-001 · Cited by 497

Show all 21 references

Research works printed but not linked: 1

Fixsen, D., & Blase, K. (2009). Implementation: The missing link between research and practice. NIRN implementation brief, 1. Chapel Hill: The University of North Carolina.

Sorted by citations

Items 101–148 of 148

Análisis de un programa chileno de salud mental escolar desde el enfoque de fases de implementación
Zurita, S. A., López-Donaire, V., Meza-Ibarra, M., Moraga, B. P., Bravo, G. P., Zúñiga, C. C., & Andrade, R. M. R. (2022) · Revista de psicología · doi:10.5354/0719-0581.2022.69305 · Cited by 4
Adapting the stages of implementation completion to an evidence-based implementation strategy: The development of the NIATx stages of implementation completion
Ford, J. H., Zehner, M. E., Schaper, H., & Saldana, L. (2023) · Implementation Research and Practice · doi:10.1177/26334895231200379 · Cited by 3
Self-citation
Addressing Disparities Across Systems: Initial Implementation of Novel Interventions in Children’s Healthcare (NICH)
Norman, M. Z., Torres, K. A., Saldana, L., Spiro, K., Naranjo, D. M., Wong, J. C., Reed, A., Bensen, R., Barry, S., Harris, M. A., et al. (2025) · Global Implementation Research and Applications · doi:10.1007/s43477-025-00182-6 · Cited by 3
Self-citation
What scientific inferences can be made with randomized implementation rollout trials
Brown, C. H., Smith, J. D., Haegerich, T. M., Simon, G. E., Cero, I., Aarons, G. A., Prado, G. J., Wyman, P. A., Kane, J. M., Robinson, D. G., et al. (2025) · Implementation Science · doi:10.1186/s13012-025-01465-0 · Cited by 4
Organizational and Systems Factors Impacting the Adaptation of a Child Welfare Practice Model from the UK to Finland
Isokuortti, N. (2024) · Human Services Organizations Management Leadership & Governance · doi:10.1080/23303131.2024.2304897 · Cited by 4
External relationships as implementation determinants in community-engaged, equity-focused COVID-19 vaccination events
Moore, R. A., Callaghan‐Koru, J. A., Vincenzo, J. L., Patton, S. K., Spear, M. J., Riklon, S., Alik, E., Ramos, A. P., Takamaru, S., McElfish, P. A., et al. (2024) · Frontiers in Health Services · doi:10.3389/frhs.2024.1338622 · Cited by 3
Predictors of the sustainability for an evidence-based eating disorder prevention program delivered by college peer educators
Bearman, S. K., Rohde, P., Pauling, S., Gau, J. M., Shaw, H. E., & Stice, E. M. (2024) · Implementation Science · doi:10.1186/s13012-024-01373-9 · Cited by 4
Evaluating the Early Implementation of a Resilience Intervention Addressing Secondary Traumatic Stress in Child Welfare Workers
Clark, S. L., Akin, B. A., Vanchy, P., Byers, K. D., & Diaz, A. L. (2024) · Human Services Organizations Management Leadership & Governance · doi:10.1080/23303131.2024.2392821 · Cited by 3
Translation of Evidence‐Based Practices in Health
Palinkas, L. A., & Mendon, S. J. (2019) · Wiley eBooks · doi:10.1002/9781119420743.ch11 · Cited by 2
Proceedings of the Fifth Biennial Conference of the Society for Implementation Research Collaboration (SIRC) 2019: where the rubber meets the road: the intersection of research, policy, and practice - part 2
Siegle, A., zu Sayn-Wittgenstein-Hohenstein, F., & Roes, M. (2020) · Implementation Science · doi:10.1186/s13012-020-01033-8 · Cited by 2
How State Administrative Structures Influence Implementation Outcomes for Wraparound Care Coordination
Olson, J. R., Estep, K. M., Coviello, K. A., Linkous, O. S., & Bruns, E. J. (2025) · Psychiatric Services · doi:10.1176/appi.ps.20240288 · Cited by 1
Facilitating implementation of a substance use intervention for youth: Outcomes from a randomized trial of the SIC-coaching implementation strategy
Saldana, L., Dakof, G. A., Cruden, G., Schaper, H., Young, W., Liddle, M., & Chapman, J. E. (2025) · Journal of Substance Use and Addiction Treatment · doi:10.1016/j.josat.2025.209696 · Cited by 1
Self-citation
Exploring the implementation of the Stages2Engage model to support collaborative relationships with families: interprofessional views
Carroll, C. (2025) · Journal of Interprofessional Education & Practice · doi:10.1016/j.xjep.2025.100771 · Cited by 1
Building Capacity for Knowledge Translation in Rehabilitation: The Academy of Neurologic Physical Therapy’s Knowledge Translation Summit
Moore, J. L., Romney, W. M., Crowner, B. E., Hornby, T. G., & Graham, I. D. (2025) · Neurology Report · doi:10.1097/npt.0000000000000533 · Cited by 1
Chapter 8Readiness and Bullying Prevention
Molnar‐Main, S., & Cecil, H. (2013) · American Public Health Association eBooks · doi:10.2105/9780875530413ch08
Leading Instructional Practices in a Performance-Based System.
Kauble, A., & Wise, D. (2015)
The four day school week : a case study examining three stages of implementation
Johnson, C. (2013) · doi:10.32469/10355/42960
Examining the Effects of Systems Barriers and Implementation Strategies on School-wide Positive Behavioral Interventions and Supports Tier 1 Implementation Fidelity Over Time
Kittelman, A. (2019) · Scholars' Bank (University of Oregon)
Maximizing Pilot Phase Measures to Inform Quality Improvement: Using a Sequential Mixed-Methods Design With Interrupted Time Series to Examine Feasibility, Uptake, and Drivers of an Evidence-Based Practice in Part C/Early Intervention Systems
Stegenga, S. M. (2019) · Scholars' Bank (University of Oregon)
Exploration of a smart glasses teleconference system for virtual instructional coaching
Zaccaria, K. (2018) · doi:10.33915/etd.7285
Engaging Stakeholders in the Adaptation of the Connect for Health Pediatric Weight Management Program for National ImplementationPreprint
Simione, M., Frost, H. M., Cournoyer, R. N., Mini, F. N., Cassidy, J., Craddock, C., Moreland, J., Wallace, J., Metlay, J. P., Kistin, C. J., et al. (2020) · doi:10.21203/rs.2.22385/v1
References
Palinkas, L. A. (2018) · Policy Press eBooks · doi:10.51952/9781447338147.bm001
Testing implementation support strategies to facilitate an evidence-based substance use and mental health care intervention in veterans treatment courts: A hybrid type III trial protocol
Smelson, D. A., Yakovchenko, V., Bruzios, K. E., Byrne, T. H., McCullough, M. B., Shaffer, P. M., & Elwy, A. R. (2024) · The European Journal of Psychiatry · doi:10.1016/j.ejpsy.2024.100282
Integrated Behavioral Health and Implementation of the Safe Environment for Every Kid Approach in Pediatric Primary Care: A Mixed Methods Study
Palinkas, L. A., Belanger, R., Saldana, L., Magder, L. S., Landsverk, J. A., Schaper, H., & Dubowitz, H. (2025) · Journal of Developmental & Behavioral Pediatrics · doi:10.1097/dbp.0000000000001362
Self-citation
Real-world quantification of implementation dose across twenty-five implementation instances
Ashcraft, L. E., Pelcher, L. R., Warren, C. M., Brown, R. T., Hall, D. E., Dicks, T. N., Long, J. A., Manges, K. A., Werner, R. M., & Burke, R. E. (2025) · Implementation Science Communications · doi:10.1186/s43058-025-00818-6
District Leadership Strategies for Implementing Effective Individualized Academic and Student Interventions
Freeman, R., Newcomer, L. L., & Miller, D. (2017) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64113-010-320251003
Additional file 3 of Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study
Nevedal, A., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B. S., Gifford, A. L., Orvek, E., DeLaughter, K. L., White, L., King, H. A., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12610079
Additional file 3 of Understanding pathways from implementation to sustainment: a longitudinal, mixed methods analysis of promising practices implemented in the Veterans Health Administration
Nevedal, A., Widerquist, M. A. O., Reardon, C. M., Arasim, M. E., Jackson, G. L., White, B. S., Burns, M., Fix, G. M., DeLaughter, K. L., Cutrona, S. L., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26717059
Additional file 1 of Researching the Impact of Service provider Education (RISE) Project — a multiphase mixed methods protocol to evaluate implementation acceptability and feasibility
Kimber, M., Vanstone, M. G., Dimitropoulos, G., Collin‐Vézina, D., & Stewart, D. (2022) · Figshare · doi:10.6084/m9.figshare.20221924
Additional file 1 of Understanding pathways from implementation to sustainment: a longitudinal, mixed methods analysis of promising practices implemented in the Veterans Health Administration
Nevedal, A., Widerquist, M. A. O., Reardon, C. M., Arasim, M. E., Jackson, G. L., White, B. S., Burns, M., Fix, G. M., DeLaughter, K. L., Cutrona, S. L., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26717053
Additional file 1 of Stepped implementation-to-target: a study protocol of an adaptive trial to expand access to addiction medications
Ford, J. H., Cheng, H. L., Gassman, M., Fontaine, H., Garneau, H. C., Keith, R., Michael, E., & McGovern, M. P. (2022) · Figshare · doi:10.6084/m9.figshare.21249591
Additional file 1 of Predictors of the sustainability for an evidence-based eating disorder prevention program delivered by college peer educators
Bearman, S. K., Rohde, P., Pauling, S., Gau, J., Shaw, H. E., & Stice, E. M. (2024) · Figshare · doi:10.6084/m9.figshare.26743280
Additional file 1 of Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study
Nevedal, A., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B. S., Gifford, A. L., Orvek, E., DeLaughter, K. L., White, L., King, H. A., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12610073
Additional file 3 of Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review
Hall, A., Shoesmith, A., Doherty, E. L., McEvoy, B., Mettert, K. D., Lewis, C. C., Wolfenden, L., Yoong, S., Kingsland, M., Shelton, R. C., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22608673
Additional file 2 of Predictors of the sustainability for an evidence-based eating disorder prevention program delivered by college peer educators
Bearman, S. K., Rohde, P., Pauling, S., Gau, J. M., Shaw, H. E., & Stice, E. M. (2024) · Figshare · doi:10.6084/m9.figshare.26743283
Additional file 5 of Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study
Nevedal, A., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B. S., Gifford, A. L., Orvek, E., DeLaughter, K. L., White, L., King, H. A., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12610085
Additional file 2 of Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review
Hall, A., Shoesmith, A., Doherty, E. L., McEvoy, B., Mettert, K. D., Lewis, C. C., Wolfenden, L., Yoong, S., Kingsland, M., Shelton, R. C., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22608670
Additional file 1 of Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review
Hall, A., Shoesmith, A., Doherty, E. L., McEvoy, B., Mettert, K. D., Lewis, C. C., Wolfenden, L., Yoong, S., Kingsland, M., Shelton, R. C., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22608667
Additional file 2 of Expanding access to medications for opioid use disorder in primary care clinics: an evaluation of common implementation strategies and outcomes
Cheng, H. L., McGovern, M. P., Garneau, H. C., Hurley, B., Fisher, T., Copeland, M., & Almirall, D. (2022) · Figshare · doi:10.6084/m9.figshare.20252872
Additional file 2 of Understanding pathways from implementation to sustainment: a longitudinal, mixed methods analysis of promising practices implemented in the Veterans Health Administration
Nevedal, A., Widerquist, M. A. O., Reardon, C. M., Arasim, M. E., Jackson, G. L., White, B. S., Burns, M., Fix, G. M., DeLaughter, K. L., Cutrona, S. L., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26717056
Additional file 2 of Stepped implementation-to-target: a study protocol of an adaptive trial to expand access to addiction medications
Ford, J. H., Cheng, H. L., Gassman, M., Fontaine, H., Garneau, H. C., Keith, R., Michael, E., & McGovern, M. P. (2022) · Figshare · doi:10.6084/m9.figshare.21249594
Additional file 4 of Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study
Nevedal, A., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B. S., Gifford, A. L., Orvek, E., DeLaughter, K. L., White, L., King, H. A., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12610082
Additional file 1 of An observational study of the impact of COVID-19 and the rapid implementation of telehealth on community mental health center providers
Sklar, M., Reeder, K., Carandang, K. M., Ehrhart, M. G., & Aarons, G. A. (2021) · Figshare · doi:10.6084/m9.figshare.14205194
Additional file 1 of Expanding access to medications for opioid use disorder in primary care clinics: an evaluation of common implementation strategies and outcomes
Cheng, H. L., McGovern, M. P., Garneau, H. C., Hurley, B., Fisher, T., Copeland, M., & Almirall, D. (2022) · Figshare · doi:10.6084/m9.figshare.20252869
Additional file 2 of Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study
Nevedal, A., Reardon, C. M., Jackson, G. L., Cutrona, S. L., White, B. S., Gifford, A. L., Orvek, E., DeLaughter, K. L., White, L., King, H. A., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12610076
Scaling Up Tier 2 and 3 Behavior Supports Within School Districts
Kittelman, A., & Horner, R. (2025) · Behavioral Disorders · doi:10.1177/01987429251407679
Startup activities and challenges implementing an integrated care model for pregnant and postpartum individuals with substance use disorders: a qualitative study
Hall, J. D., Danna, M. N., Cahen, V. C., Baron, A., Cioffi, C. C., & Cohen, D. J. (2026) · Substance Abuse Treatment Prevention and Policy · doi:10.1186/s13011-026-00731-8
Implementation Science for Emergency Physicians: A Schematic Diagram and Step-By-Step Guidance to Implement Evidence-Based Innovations
Fu, E. S., Guzman, L. E., Berlyand, Y., Garbern, S. C., Banerjee, D., Durkin, K., & Frank, H. E. (2026) · Journal of the American College of Emergency Physicians Open · doi:10.1016/j.acepjo.2026.100501

Authors: Saldana, L., Chamberlain, P., Wang, W., & Hendricks Brown, C.
Affiliations: University of South Florida (US)
Corresponding author: Saldana, Lisa
ORCID: Saldana, Lisa
Chamberlain, Patricia
Venue: Administration and Policy in Mental Health and Mental Health Services Research
Publisher: Springer Science and Business Media LLC
Published: 2011-06-28
Volume: 39
Issue: 6
Pages: 419-425
ISSN: 0894-587X (ISSN-L)
1573-3289
DOI: 10.1007/s10488-011-0363-y
PMC: PMC3212640
OpenAlex: W1995981850
Cited by: 148
References: 21
Citations by year: 2026: 2 · 2025: 15 · 2024: 16 · 2023: 12 · 2022: 15 · 2021: 6 · 2020: 19 · 2019: 14 · 2018: 10 · 2017: 15 · 2016: 4 · 2015: 6 · 2014: 6 · 2013: 5 · 2012: 2
FWCI: 8.31
Type: journal article
Language: en
Open access: green
europepmc.org
Licence: www.springer.com/tdm (tdm)
Locations: Administration and Policy in Mental Health and Mental Health Services Research (publishedVersion)
PubMed (publishedVersion)
Europe PMC (PubMed Central) (acceptedVersion)
PubMed Central (acceptedVersion)
Funders: National Institute of Mental Health (R01MH076158, R25MH080916)
National Institute on Drug Abuse (P30DA023920, K23DA021603)
Topics: Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Social Sciences › Public Administration › Evaluation and Performance Assessment
Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
Keywords: program implementation, implementation readiness, feasibility assessment, mental health services
MeSH terms: Mental Disorders, California, Community Mental Health Services, Forecasting, Foster Home Care, Health Plan Implementation, Health Services Needs and Demand, Humans, Ohio, Program Development

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Predicting Program Start-Up Using the Stages of Implementation Measure

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks