Sustained Implementation Support Scale: Validation of a Measure of Program Characteristics and Workplace Functioning for Sustained Program Implementation

Hodge, Lauren M.; Turner, Karen M. T.; Sanders, Matthew R.; Filus, Ania

doi:10.1007/s11414-016-9505-z

Cited by 38Health Policy Implementation ScienceHealth Sciences Research and EducationBehavioral and Psychological Studies

Sustained Implementation Support Scale: Validation of a Measure of Program Characteristics and Workplace Functioning for Sustained Program Implementation

Hodge, Lauren M., Turner, Karen M. T., Sanders, Matthew R., Filus, Ania·2017·The Journal of Behavioral Health Services & Research

DOI 10.1007/s11414-016-9505-z

Open this paper in CoChat — free account

Abstract

An evaluation measure of enablers and inhibitors to sustained evidence-based program (EBP) implementation may provide a useful tool to enhance organizations' capacity. This paper outlines preliminary validation of such a measure. An expert informant and consumer feedback approach was used to tailor constructs from two existing measures assessing key domains associated with sustained implementation. Validity and reliability were evaluated for an inventory composed of five subscales: Program benefits, Program burden, Workplace support, Workplace cohesion, and Leadership style. Exploratory and confirmatory factor analysis with a sample of 593 Triple P-Positive Parenting Program-practitioners led to a 28-item scale with good reliability and good convergent, discriminant, and predictive validity. Practitioners sustaining implementation at least 3 years post-training were more likely to have supervision/peer support, reported higher levels of program benefit, workplace support, and positive leadership style, and lower program burden compared to practitioners who were non-sustainers.

Integrity signals

Registry

Crossref · 10.1007/s11414-016-9505-z

Cites

104 of 104 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

There is emerging evidence for the reliability and validity of a small number of sustainability-specific assessments and tools designed to determine an organization's capacity in key factors linked to sustainment success and to develop strategic action plans.
“There is emerging evidence for the reliability and validity of a small number of sustainability-specific assessments and tools, which are designed to determine an organization's capacity in key factors (e.g., partnerships, strategic planning) that have been shown to be linked to sustainment success (61, 76) and to develop a strategic action plan for building capacity in areas of weakness (19, 35,”
From The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care (2018) · cites this paper as [61]

Evaluating Structural Equation Models with Unobservable Variables and Measurement Error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.2307/3151312 · Cited by 109,314 · see citing works
Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · see citing works
Diffusion of Innovations 1
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
Multiple regression: testing and interpreting interactions
(1992) · Choice Reviews Online · doi:10.5860/choice.29-3352 · Cited by 36,644 · see citing works
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701 · see citing works
Diffusion of innovations
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,555 · see citing works
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,512 · see citing works
Structural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2072165 · Cited by 17,471 · see citing works
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549 · see citing works
Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
Applied Multivariate Statistics for the Social Sciences
Stevens, J. P. (2012) · Routledge eBooks · doi:10.4324/9780203843130 · Cited by 10,652 · see citing works
EQS : structural equations program manual
Bentler, P. M. (1989) · Medical Entomology and Zoology · Cited by 9,669 · see citing works
Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
The American Psychological Association
Langfeld, H. S. (1919) · Science · doi:10.1126/science.49.1254.51 · Cited by 7,453 · see citing works
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · see citing works
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · see citing works
Untitled work
(1991) · Cited by 7,187 · see citing works
An updated paradigm for scale development incorporating unidimensionality and its assessment
Gerbing, D. W., & Anderson, J. C. (1988) · Journal of Marketing Research · doi:10.1177/002224378802500207 · Cited by 6,293 · see citing works
An Updated Paradigm for Scale Development Incorporating Unidimensionality and Its Assessment
Gerbing, D. W., & Anderson, J. C. (1988) · Journal of Marketing Research · doi:10.2307/3172650 · Cited by 6,293 · see citing works
Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304 · see citing works
Applied multivariate statistics for the social sciences
Stevens, J. P., & Stevens, J. P. (2001) · doi:10.4324/9781410604491 · Cited by 4,993 · see citing works
From best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531 · see citing works
Untitled work
(2005) · Cited by 3,748 · see citing works
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 4× · see citing works
“These scales were selected because they measure important influences on continued program use identified in the literature as described in the BIntroduction^ section,(20) include key inner context factors measured at the practitioner (program) and team (organization) level (to match the theory), and have adequate to g…”
BackgroundMethodInfluential
Untitled work
(2002) · Cited by 2,645 · see citing works
Corrections to test statistics and standard errors in covariance structure analysis.
Satorra, A., & Bentler, P. M. (1994) · Cited by 2,388 · see citing works
A theory of organizational readiness for change
Weiner, B. J. (2009) · Implementation Science · doi:10.1186/1748-5908-4-67 · Cited by 2,268 · see citing works
Implementation Research in Mental Health Services: an Emerging Science with Conceptual, Methodological, and Training challenges
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894 · see citing works
Single Sample Cross-Validation Indices for Covariance Structures
Browne, M. W., & Cudeck, R. A. (1989) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2404_4 · Cited by 1,643 · see citing works
Speaking Up in the Operating Room: How Team Leaders Promote Learning in Interdisciplinary Action Teams
Edmondson, A. C. (2003) · Journal of Management Studies · doi:10.1111/1467-6486.00386 · Cited by 1,635 · see citing works
The Innovation Journey
van de Ven, & Haines, A. (1999) · Medical Entomology and Zoology · Cited by 1,421 · see citing works
Latent Variables Analysis: Applications for Developmental Research.
Aa, von Eye, A., & Clogg, C. C. (1995) · Journal of the American Statistical Association · doi:10.2307/2291370 · Cited by 1,380 · see citing works
The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355 · see citing works
Mental Health Provider Attitudes Toward Adoption of Evidence-Based Practice: The Evidence-Based Practice Attitude Scale (EBPAS)
Aarons, G. A. (2004) · Mental Health Services Research · doi:10.1023/b:mhsr.0000024351.12294.65 · Cited by 1,272 · see citing works
The Quality Implementation Framework: A Synthesis of Critical Steps in the Implementation Process
Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9522-x · Cited by 1,102 · see citing works
Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective.
Beidas, R. S., & Kendall, P. C. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01187.x · Cited by 1,085 · see citing works
The Triple P-Positive Parenting Program: a systematic review and meta-analysis of a multi-level system of parenting support
Sanders, M. R., Kirby, J. N., Tellegen, C. L., & Day, J. J. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.04.003 · Cited by 1,077 · cited 2× · see citing works
“A meta-analysis of 101 randomized controlled trials (involving 16,099 families) evaluating different variants and delivery formats showed Triple P to be effective when delivered in group, individual, telephone-assisted, and self-directed formats and in culturally and linguistically diverse contexts.(76) Over the years…”
BackgroundMethod
Psychological Testing and Assessment: An Introduction to Tests and Measurement
Cohen, R. J., & Swerdlik, M. E. (1992) · Cited by 999 · see citing works
Current Methodological Considerations in Exploratory and Confirmatory Factor Analysis
Schmitt, T. A. (2011) · Journal of Psychoeducational Assessment · doi:10.1177/0734282911406653 · Cited by 995 · see citing works
A Practical, Robust Implementation and Sustainability Model (PRISM) for Integrating Research Findings into Practice
Feldstein, A. C., & Glasgow, R. E. (2008) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(08)34030-6 · Cited by 987 · see citing works
Understanding organization-customer links in service settings.
Schneider, B., Ehrhart, M. G., Mayer, D. M., Saltz, J. L., & Niles-Jolly, K. (2005) · Academy of Management Journal · doi:10.5465/amj.2005.19573107 · Cited by 882 · see citing works
Assessing organizational readiness for change
Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(02)00233-7 · Cited by 863 · see citing works
Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures
Chaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013) · Implementation Science · doi:10.1186/1748-5908-8-22 · Cited by 800 · see citing works
Review: Conceptualization and Measurement of Organizational Readiness for Change: A Review of the Literature in Health Services Research and Other Fields
Weiner, B. J., Amick, H., & Lee, S.-Y. D. (2008) · Medical Care Research and Review · doi:10.1177/1077558708317802 · Cited by 786 · see citing works
An Agenda for Research on the Sustainability of Public Health Programs
Scheirer, M. A., & Dearing, J. W. (2011) · American Journal of Public Health · doi:10.2105/ajph.2011.300193 · Cited by 775 · see citing works
Is Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability
Scheirer, M. A. (2005) · American Journal of Evaluation · doi:10.1177/1098214005278752 · Cited by 710 · see citing works
Development, Evaluation, and Multinational Dissemination of the Triple P-Positive Parenting Program
Sanders, M. R. (2012) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032511-143104 · Cited by 619 · see citing works
Self-citation
Implementing computerized technology: An organizational analysis.
Klein, K. J., Conn, A. B., & Sorra, J. S. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.5.811 · Cited by 615 · see citing works
Public health program capacity for sustainability: a new framework
Schell, S. F., Luke, D. A., Schooley, M. W., Elliott, M. B., Herbers, S. H., Mueller, N. B., & Bunger, A. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-15 · Cited by 563 · see citing works
A conceptual framework for transferring research to practice
Simpson, D. D. (2002) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(02)00231-3 · Cited by 538 · see citing works
Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS)
Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014) · Implementation Science · doi:10.1186/s13012-014-0157-1 · Cited by 502 · see citing works
Sustainability science: an integrated approach for health-programme planning
Gruen, R. L., Elliott, J. H., Nolan, M. L., Lawton, P. D., Parkhill, A., McLaren, C. J., & Lavis, J. N. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61659-1 · Cited by 395 · see citing works
Confirmatory analysis of exploratively obtained factor structures
van Prooijen, J.-W., & van der Kloot, W. A. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971518 · Cited by 375 · see citing works
The Organizational Context of Children's Mental Health Services
Glisson, C. A. (2002) · Clinical Child and Family Psychology Review · doi:10.1023/a:1020972906177 · Cited by 366 · see citing works
PROSPER Community–University Partnership Model for Public Education Systems: Capacity-Building for Evidence-Based, Competence-Building Prevention
Spoth, R. L., Greenberg, M. T., Bierman, K. L., & Redmond, C. R. (2004) · Prevention Science · doi:10.1023/b:prev.0000013979.52796.8b · Cited by 357 · see citing works
Analyzing social science data
Vaus, D. (2002) · Cited by 317 · see citing works
Community Health Workers in Low- and Middle-Income Countries: What Do We Know About Scaling Up and Sustainability?
Pallas, S. W., Minhas, D., Pérez‐Escamilla, R., Taylor, L. A., Curry, L. A., & Bradley, E. H. (2013) · American Journal of Public Health · doi:10.2105/ajph.2012.301102 · Cited by 315 · see citing works
Implementation Science
Ogden, T., & Fixsen, D. L. (2014) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000160 · Cited by 304 · see citing works
Evidence-based practice implementation: The impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice
Aarons, G. A., Sommerfeld, D. H., & Walrath-Greene, C. M. (2009) · Implementation Science · doi:10.1186/1748-5908-4-83 · Cited by 276 · see citing works
Measuring the Diffusion of Innovative Health Promotion Programs
Steckler, A., Goodman, R. M., McLeroy, K. R., Thomas, S., & Koch, G. G. (1992) · American Journal of Health Promotion · doi:10.4278/0890-1171-6.3.214 · Cited by 238 · see citing works
A model for the institutionalization of health promotion programs
Goodman, R. M., & Steckler, A. (1989) · Family & Community Health · doi:10.1097/00003727-198902000-00009 · Cited by 224 · see citing works
Sustaining Community‐Based Programs for Families: Conceptualization and Measurement*
Mancini, J. A., & Marek, L. I. (2004) · Family Relations · doi:10.1111/j.0197-6664.2004.00040.x · Cited by 199 · see citing works
Moving innovations into treatment: A stage-based approach to program change
Simpson, D. D., & Flynn, P. M. (2007) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2006.12.023 · Cited by 195 · see citing works
Key Results of Interaction Models with Centering
Afshartous, D. R., & Preston, R. A. (2011) · Journal of Statistics Education · doi:10.1080/10691898.2011.11889620 · Cited by 194 · see citing works
Psychological Testing and Assessment: An Introduction to Tests and Measurement
Cohen−Swerdlik (2009) · Cited by 192 · see citing works
Context matters: measuring implementation climate among individuals and groups
Jacobs, S., Weiner, B. J., & Bunger, A. C. (2014) · Implementation Science · doi:10.1186/1748-5908-9-46 · Cited by 189 · see citing works
Dissemination of evidence-based parenting and family support strategies: Learning from the Triple P—Positive Parenting Program system approach
Turner, K., & Sanders, M. R. (2005) · Aggression and Violent Behavior · doi:10.1016/j.avb.2005.07.005 · Cited by 181 · see citing works
Self-citation
Clinical Supervision in Four Mental Health Professions: A Review of the Evidence
Spence, S. H., Wilson, J., Kavanagh, D. J., Strong, J., & Worrall, L. E. (2001) · Behaviour Change · doi:10.1375/bech.18.3.135 · Cited by 181 · see citing works
Predictors of Community Therapists’ Use of Therapy Techniques in a Large Public Mental Health System
Beidas, R. S., Marcus, S. C., Aarons, G. A., Hoagwood, K., Schoenwald, S. K., Evans, A. C., Hurford, M. O., Hadley, T. R., Barg, F. K., Walsh, L., et al. (2015) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2014.3736 · Cited by 179 · see citing works
Improving the reporting of public health intervention research: advancing TREND and CONSORT
Armstrong, R., Waters, E., Moore, L., Riggs, E., Cuervo, L. G., Lumbiganon, P., & Hawe, P. (2008) · Journal of Public Health · doi:10.1093/pubmed/fdm082 · Cited by 171 · see citing works
Use of psychotherapy research by professional psychologists.
Cohen, L. H., Sargent, M. M., & SECHREST, L. B. (1986) · American Psychologist · doi:10.1037//0003-066x.41.2.198 · Cited by 157 · see citing works
The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation
Lewis, C. C., Stanick, C. F., Martinez, R. G., Weiner, B. J., Kim, M., Barwick, M., & Comtois, K. A. (2016) · Implementation Science · doi:10.1186/s13012-014-0193-x · Cited by 155 · see citing works
Program sustainability begins with the first events
Pluye, P., Potvin, L., Denis, J.-L., Pelletier, J., & Mannoni, C. (2005) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.10.003 · Cited by 147 · see citing works
The Role of Practitioner Self-Efficacy, Training, Program and Workplace Factors on the Implementation of an Evidence-Based Parenting Intervention in Primary Care
Turner, K., Nicholson, J. M., & Sanders, M. R. (2011) · The Journal of Primary Prevention · doi:10.1007/s10935-011-0240-1 · Cited by 132 · see citing works
Self-citation
Facilitators and Barriers to Implementation of an Evidence-Based Parenting Intervention to Prevent Child Maltreatment: The Triple P-Positive Parenting Program
Shapiro, C. J., Prinz, R. J., & Sanders, M. R. (2012) · Child Maltreatment · doi:10.1177/1077559511424774 · Cited by 131 · see citing works
Self-citation
Sustained Implementation of Evidence‐based Programs in Disadvantaged Communities: A Conceptual Framework of Supporting Factors
Hodge, L. M., & Turner, K. M. T. (2016) · American Journal of Community Psychology · doi:10.1002/ajcp.12082 · Cited by 120 · see citing works
Self-citation
Apples Don't Fall Far From the Tree: Influences on Psychotherapists' Adoption and Sustained Use of New Therapies
Cook, J. M., Schnurr, P. P., Biyanova, T., & Coyne, J. C. (2009) · Psychiatric Services · doi:10.1176/appi.ps.60.5.671 · Cited by 111 · see citing works
Mixed-method study of a conceptual model of evidence-based intervention sustainment across multiple public-sector service settings
Aarons, G. A., Green, A. E., Willging, C. E., Ehrhart, M. G., Roesch, S. C., Hecht, D. B., & Chaffin, M. J. (2014) · Implementation Science · doi:10.1186/s13012-014-0183-z · Cited by 107 · see citing works
Use of psychotherapy research by professional psychologists.
Cohen, L. H., Sargent, M. M., & SECHREST, L. B. (1986) · American Psychologist · doi:10.1037/0003-066x.41.2.198 · Cited by 107 · see citing works
Providers’ Attitudes Toward Evidence-Based Practices: Is it Just About Providers, or Do Practices Matter, Too?
Reding, M. E. J., Chorpita, B. F., Lau, A. S., & Innes-Gomberg, D. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0525-1 · Cited by 96 · see citing works
Making supervision supportive and sustainable: new approaches to old problems.
Marquez, L., & Kean, L. H. (2002) · Cited by 94 · see citing works
Beyond evidence: the micropolitics of improvement
Langley, A., & Denis, J. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.046482 · Cited by 88 · see citing works
Facilitator's Manual for Group Triple P
Turner, K., Sanders, M. R., & Markie‐Dadds, C. (2010) · Cited by 85 · see citing works
Self-citation
Exploring Task- and Student-Related Factors in the Method of Propositional Manipulation (MPM)
Leppink, J., Broers, N. J., Imbos, T., van der Vleuten, C. P. M., & Berger, M. P. F. (2011) · Journal of Statistics Education · doi:10.1080/10691898.2011.11889603 · Cited by 84 · see citing works
Six‐Year Sustainability of Evidence‐Based Intervention Implementation Quality by Community‐University Partnerships: The PROSPER Study
Spoth, R. L., Guyll, M., Redmond, C. R., Greenberg, M. T., & Feinberg, M. E. (2011) · American Journal of Community Psychology · doi:10.1007/s10464-011-9430-5 · Cited by 78 · see citing works
Stepping Stones Triple P: A pilot study to evaluate acceptability of the program by parents of a child diagnosed with an Autism Spectrum Disorder
Whittingham, K., Sofronoff, K., & Sheffield, J. K. (2005) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2005.05.003 · Cited by 77 · see citing works
Reflections on the Challenges of Effective Dissemination of Behavioural Family Intervention: Our Experience with the Triple P – Positive Parenting Program
Sanders, M. R., & Turner, K. (2005) · Child and Adolescent Mental Health · doi:10.1111/j.1475-3588.2005.00367.x · Cited by 77 · see citing works
Self-citation
Systems Antecedents for Dissemination and Implementation: A Review and Analysis of Measures
Emmons, K. M., Weiner, B., Fernandez, M. E., & Tu, S.-P. (2012) · Health Education & Behavior · doi:10.1177/1090198111409748 · Cited by 72 · see citing works
Measuring Acceptability of Clinical Decision Rules: Validation of the Ottawa Acceptability of Decision Rules Instrument (OADRI) in Four Countries
Brehaut, J., Graham, I. D., Wood, T. J., Taljaard, M., Eagles, D. A., Lott, A., Clement, C. M., Kelly, A., Mason, S. M., Kellerman, A., et al. (2009) · Medical Decision Making · doi:10.1177/0272989x09344747 · Cited by 70 · see citing works
Sustainability of Public Health Programs: The Example of Tobacco Treatment Services in Massachusetts
LaPelle, N. R., Zapka, J. G., & Ockene, J. K. (2006) · American Journal of Public Health · doi:10.2105/ajph.2005.067124 · Cited by 69 · see citing works
Apples Don't Fall Far From the Tree: Influences on Psychotherapists' Adoption and Sustained Use of New Therapies
Cook, J. M., Schnurr, P. P., Biyanova, T., et al. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.5.671 · Cited by 65 · see citing works
Using structural characteristics of community coalitions to predict progress in adopting evidence-based prevention programs
Jasuja, G. K., Chou, C., Bernstein, K. S., Wang, E. Z., McClure, M., & Pentz, M. A. (2005) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2005.01.002 · Cited by 63 · see citing works
Predictors of Sustainability of Social Programs
Savaya, R., & Spiro, S. E. (2012) · American Journal of Evaluation · doi:10.1177/1098214011408066 · Cited by 61 · see citing works
Factors determining cardiac nurses' intentions to continue using a smoking cessation protocol
Bolman, C. A. W., de Vries, H., & Mesters, I. (2002) · Heart & Lung · doi:10.1067/mhl.2002.119834 · Cited by 53 · see citing works
Applied Missing Data Analysis. Methodology in the Social Sciences Series.
Enders, C. K. (2010) · Cited by 52 · see citing works
Measuring Coalition Functioning
Brown, L. D., Feinberg, M. E., & Greenberg, M. T. (2011) · Health Education & Behavior · doi:10.1177/1090198111419655 · Cited by 51 · see citing works
Sustaining Use of an Evidence-Based Parenting Intervention: Practitioner Perspectives
Shapiro, C. J., Prinz, R. J., & Sanders, M. R. (2014) · Journal of Child and Family Studies · doi:10.1007/s10826-014-9965-9 · Cited by 48 · see citing works
Self-citation
Community and Team Member Factors that Influence the Operations Phase of Local Prevention Teams: The PROSPER Project
Feinberg, M. E., Chilenski, S. M., Greenberg, M. T., Spoth, R. L., & Redmond, C. R. (2007) · Prevention Science · doi:10.1007/s11121-007-0069-2 · Cited by 40 · see citing works
Practitioner's manual for primary care triple P
Turner, K., Sanders, M. R., & Markie‐Dadds, C. (1999) · Triple P International eBooks · Cited by 32 · see citing works
Self-citation
British Medical Journal
(1899) · BMJ · doi:10.1136/bmj.1.1998.921 · Cited by 17 · see citing works
Issues in Professional Training to Implement Evidence‐based Parenting Programs: The Preferences of Indigenous Practitioners
Turner, K., Sanders, M. R., & Hodge, L. M. (2014) · Australian Psychologist · doi:10.1111/ap.12090 · Cited by 13 · see citing works
Self-citation
From training to practice transformation: Implementing a public health parenting program
Gaven, S., & Schorer, J. (2013) · Family matters · Cited by 8 · see citing works
The Triple P – Positive Parenting Program: A Community- Wide Approach to Parenting and Family Support
Sanders, M. R., Turner, K., & McWilliam, J. (2015) · Psychology Press eBooks · doi:10.4324/9781315764917-14 · Cited by 6 · see citing works
Self-citation
Acting Locally and Globally: Dissemination Implementation Around the World and Next Door
Southam‐Gerow, M. A., Arnold, C. C., Rodríguez, A., & Cox, J. R. (2014) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2013.12.007 · Cited by 4 · see citing works

Flagged first, then by citations

Sorted by citations

The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014731 · Cited by 806 · see citing works
Improving the normalization of complex interventions: part 2 - validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT)
Finch, T. L., Girling, M., May, C. R., Mair, F. S., Murray, E., Treweek, S., McColl, E., Steen, I. N., Cook, C., Vernazza, C. R., et al. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0591-x · Cited by 337 · see citing works
Sustained Implementation of Evidence‐based Programs in Disadvantaged Communities: A Conceptual Framework of Supporting Factors
Hodge, L. M., & Turner, K. M. T. (2016) · American Journal of Community Psychology · doi:10.1002/ajcp.12082 · Cited by 120 · see citing works
Self-citation
Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review
Hall, A., Shoesmith, A., Doherty, E., McEvoy, B., Mettert, K., Lewis, C. C., Wolfenden, L., Yoong, S., Kingsland, M., Shelton, R. C., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01252-1 · Cited by 81 · see citing works
Measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale
Palinkas, L. A., Chou, C.-P., Spear, S. E., Mendon, S. J., Villamar, J., & Brown, C. H. (2020) · Implementation Science · doi:10.1186/s13012-020-01030-x · Cited by 70 · see citing works
Predicting evidence-based treatment sustainment: results from a longitudinal study of the Adolescent-Community Reinforcement Approach
Hunter, S. B., Han, B., Slaughter, M. E., Godley, S. H., & Garner, B. R. (2017) · Implementation Science · doi:10.1186/s13012-017-0606-8 · Cited by 56 · see citing works

Developing a Consumer Complaining and Recovery Effort Scale
Lu, L., Gürsoy, D., Chi, C. G.-Q., et al. (2015) · Journal of Hospitality & Tourism Research · doi:10.1177/1096348015597033 · Cited by 25 · see citing works
The development and validation of the Physical Appearance Comparison Scale-Revised (PACS-R)
Schaefer, L. M., & Thompson, J. K. (2014) · Eating Behaviors · doi:10.1016/j.eatbeh.2014.01.001 · Cited by 233 · see citing works
Factor structure and construct validity of the Anxiety Sensitivity Index among island Puerto Ricans.
Cintrón, J. A., Carter, M., Suchday, S., Sbrocco, T., & Gray, J. (2005) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2003.10.007 · Cited by 51 · see citing works
Construct validity of Williams' ostracism needs threat scale
Gerber, J. P., Chang, S.-H., & Reimel, H. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2016.07.008 · Cited by 69 · see citing works
Development and Validity of a Scale to Measure Workplace Culture of Health
Kwon, Y., Marzec, M. L., & Edington, D. W. (2015) · Journal of Occupational and Environmental Medicine · doi:10.1097/jom.0000000000000409 · Cited by 36 · see citing works

Authors: Hodge, L. M., Turner, K. M. T., Sanders, M. R., & Filus, A.
Affiliations: The University of Queensland (AU)
University of Southern California (US)
Corresponding author: Hodge, Lauren M.
ORCID: Turner, Karen M. T.
Sanders, Matthew R.
Filus, Ania
Venue: The Journal of Behavioral Health Services & Research
Publisher: Springer Science and Business Media LLC
Published: 2016-04-05
Volume: 44
Issue: 3
Pages: 442-464
ISSN: 1094-3412 (ISSN-L)
1556-3308
DOI: 10.1007/s11414-016-9505-z
OpenAlex: W2313917495
Cited by: 38
References: 104
Citations by year: 2026: 1 · 2025: 3 · 2024: 6 · 2023: 6 · 2022: 4 · 2021: 1 · 2020: 7 · 2019: 3 · 2018: 3 · 2017: 3 · 2016: 1
FWCI: 6.22
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
www.springer.com/tdm (vor)
Locations: The Journal of Behavioral Health Services & Research (publishedVersion)
PubMed (publishedVersion)
Funders: Australian Research Council (LP110200701)
Topics: Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
Keywords: evidence-based practice, Triple P-Positive Parenting Program, workplace support, leadership styles, workplace cohesion, implementation capacity, scale validation
MeSH terms: Humans, Leadership, Organizational Innovation, Psychometrics, Surveys and Questionnaires, Workplace

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Sustained Implementation Support Scale: Validation of a Measure of Program Characteristics and Workplace Functioning for Sustained Program Implementation

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks