Validation of the Implementation Leadership Scale (ILS) in Substance use Disorder Treatment Organizations

Aarons, Gregory A.; Ehrhart, Mark G.; Torres, Elisa M.; Finn, Natalie K.; Roesch, Scott C.

doi:10.1016/j.jsat.2016.05.004

Cited by 58Health Policy Implementation ScienceHealth Sciences Research and EducationSubstance Abuse Treatment and Outcomes

Validation of the Implementation Leadership Scale (ILS) in Substance use Disorder Treatment Organizations

Open access

Aarons, Gregory A., Ehrhart, Mark G., Torres, Elisa M., Finn, Natalie K., Roesch, Scott C.·2016·Journal of Substance Abuse Treatment

DOI 10.1016/j.jsat.2016.05.004PMC PMC5349507

Open this paper in CoChat — free account

Abstract

There have been recent calls for pragmatic measures to assess factors that influence evidence-based practice (EBP) implementation processes and outcomes. The Implementation Leadership Scale (ILS) is a brief and efficient measure that can be used for research or organizational development purposes to assess leader behaviors and actions that actively support effective EBP implementation. The ILS was developed and validated in mental health settings. This study validates the ILS factor structure with providers in alcohol and other drug (AOD) use treatment agencies. Participants were 323 service providers working in 72 workgroups from three AOD use treatment agencies. Confirmatory factor analyses and reliability analyses were conducted to examine the psychometric properties of the ILS. Convergent and discriminant validity were also assessed. Confirmatory factor analyses demonstrated good fit to the hypothesized first and second order factor structure. Internal consistency reliability was excellent. Convergent and discriminant validity was supported. The ILS psychometric characteristics, reliability, and validity were supported in AOD use treatment agencies. The ILS is a brief and pragmatic measure that can be used for research and practice to assess leadership for EBP implementation in AOD use treatment agencies.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1016/j.jsat.2016.05.004

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The ILS has been successfully validated in child welfare, substance use treatment, and acute care.
“Subsequent studies have begun this work, including successful validation of the instrument in child welfare [30], substance use treatment [31], and acute care [32];”
From Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) (2022) · cites this paper as [31]
All values on the original subscales (proactive, knowledgeable, supportive, perseverant) were consistently higher than the original ILS development sample in outpatient mental health and validations in substance use treatment settings and acute care, but generally comparable to a validation study in child welfare.
“All values on the original subscales (i.e., proactive, knowledgeable, supportive, perseverant) were consistently higher than the original ILS development sample in outpatient mental health [26] and validations in substance use treatment settings [31] and acute care [32], but generally comparable to a validation study in child welfare [30].”
From Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) (2022) · cites this paper as [31]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · see citing works
Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
Self-citation
A Spatial Model of Effectiveness Criteria: Towards a Competing Values Approach to Organizational Analysis
Quinn, R. E., & Rohrbaugh, J. (1983) · Management Science · doi:10.1287/mnsc.29.3.363 · Cited by 3,363 · see citing works
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · see citing works
Self-citation
Validating the organizational climate measure: links to managerial practices, productivity and innovation
Patterson, M. G., West, M. A., Shackleton, V. J., Dawson, J., Lawthom, R., Maitlis, S., Robinson, D. L., & Wallace, A. M. R. (2005) · Journal of Organizational Behavior · doi:10.1002/job.312 · Cited by 1,262 · see citing works
Development and test of a model linking safety-specific transformational leadership and occupational safety.
Barling, J. I., Loughlin, C. A., & Kelloway, E. K. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.3.488 · Cited by 1,063 · see citing works
Understanding organization-customer links in service settings.
Schneider, B., Ehrhart, M. G., Mayer, D. M., Saltz, J. L., & Niles-Jolly, K. (2005) · Academy of Management Journal · doi:10.5465/amj.2005.19573107 · Cited by 882 · see citing works
Self-citation
The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership
Aarons, G. A., Ehrhart, M. G., & Farahnak, L. R. (2014) · Implementation Science · doi:10.1186/1748-5908-9-45 · Cited by 559 · see citing works
Self-citation
Modifying supervisory practices to improve subunit safety: A leadership-based intervention model.
Zohar, D. M. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.1.156 · Cited by 550 · see citing works
A conceptual framework for transferring research to practice
Simpson, D. D. (2002) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(02)00231-3 · Cited by 538 · see citing works
Transformational and Transactional Leadership: Association With Attitudes Toward Evidence-Based Practice
Aarons, G. A. (2006) · Psychiatric Services · doi:10.1176/appi.ps.57.8.1162 · Cited by 525 · see citing works
Self-citation
Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS)
Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014) · Implementation Science · doi:10.1186/s13012-014-0157-1 · Cited by 502 · see citing works
Self-citation
Aligning Leadership Across Systems and Organizations to Develop a Strategic Climate for Evidence-Based Practice Implementation
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032013-182447 · Cited by 474 · see citing works
Self-citation
Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015) · Implementation Science · doi:10.1186/s13012-014-0192-y · Cited by 435 · see citing works
Self-citation
A guiding framework and approach for implementation research in substance use disorders treatment.
Damschroder, L. J., & Hagedorn, H. J. (2011) · Psychology of Addictive Behaviors · doi:10.1037/a0022284 · Cited by 427 · see citing works
Missing link in the service profit chain: A meta-analytic review of the antecedents, consequences, and moderators of service climate.
Hong, Y., Liao, H., Hu, J., & Jiang, K. (2013) · Journal of Applied Psychology · doi:10.1037/a0031666 · Cited by 386 · see citing works
Interrater Agreement Reconsidered: An Alternative to the rwg Indices
Brown, R. D., & Hauenstein, N. M. A. (2005) · Organizational Research Methods · doi:10.1177/1094428105275376 · Cited by 299 · see citing works
Shedding light on followers' innovation implementation behavior: The role of transformational leadership, commitment to change, and climate for initiative
Michaelis, B., Stegmaier, R., & Sonntag, K. (2010) · Journal of Managerial Psychology · doi:10.1108/02683941011035304 · Cited by 219 · see citing works
Affective Commitment to Change and Innovation Implementation Behavior: The Role of Charismatic Leadership and Employees’ Trust in Top Management
Michaelis, B., Stegmaier, R., & Sonntag, K. (2009) · Journal of Change Management · doi:10.1080/14697010903360608 · Cited by 216 · see citing works
Organizational Climate and Culture: An Introduction to Theory, Research, and Practice
Hummer, D. A. (2016) · Human Resource Development Quarterly · doi:10.1002/hrdq.21246 · Cited by 179 · see citing works
After 30 years of dissemination, have we achieved sustained practice change in motivational interviewing?
Hall, K., Staiger, P. K., Simpson, A., Best, D., & Lubman, D. I. (2016) · Addiction · doi:10.1111/add.13014 · Cited by 179 · see citing works
Adoption and implementation of new technologies in substance abuse treatment
Roman, P. M., & Johnson, J. A. (2002) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(02)00241-6 · Cited by 177 · see citing works
Research on the diffusion of evidence-based treatments within substance abuse treatment: A systematic review
Garner, B. R. (2008) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2008.08.004 · Cited by 157 · see citing works
The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation
Lewis, C. C., Stanick, C. F., Martinez, R. G., Weiner, B. J., Kim, M., Barwick, M., & Comtois, K. A. (2016) · Implementation Science · doi:10.1186/s13012-014-0193-x · Cited by 155 · see citing works
Determining the predictors of innovation implementation in healthcare: a quantitative analysis of implementation effectiveness
Jacobs, S., Weiner, B. J., Reeve, B. B., Hofmann, D. A., Christian, M. S., & Weinberger, M. (2015) · BMC Health Services Research · doi:10.1186/s12913-014-0657-3 · Cited by 141 · see citing works
Statewide adoption and initial implementation of contingency management for substance-abusing adolescents.
Henggeler, S. W., Chapman, J. E., Rowland, M. D., Halliday‐Boykins, C. A., Randall, J., Shackelford, J., & Schoenwald, S. K. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.4.556 · Cited by 133 · see citing works
Diffusion of Mental Health and Substance Abuse Treatments: Development Dissemination, and Implementation.
Gotham, H. J. (2004) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.bph067 · Cited by 129 · see citing works
Discrepancies in Leader and Follower Ratings of Transformational Leadership: Relationship with Organizational Culture in Mental Health
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., Sklar, M., & Horowitz, J. T. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0672-7 · Cited by 111 · see citing works
Self-citation
Participation in Workplace Health Promotion Programs: The Contribution of Health and Organizational Factors
Sloan, R. P., & Gruman, J. C. (1988) · Health Education Quarterly · doi:10.1177/109019818801500303 · Cited by 108 · see citing works
The soft underbelly of system change: The role of leadership and organizational climate in turnover during statewide behavioral health reform.
Aarons, G. A., Sommerfeld, D. H., & Willging, C. E. (2011) · Psychological Services · doi:10.1037/a0026196 · Cited by 98 · see citing works
Self-citation
A Preliminary Analysis of the Receipt of Mental Health Services Consistent With National Standards Among Children in the Child Welfare System
Raghavan, R., Inoue, M., Ettner, S. L., Hamilton, B. H., & Landsverk, J. (2010) · American Journal of Public Health · doi:10.2105/ajph.2008.151472 · Cited by 83 · see citing works
Going above and beyond for implementation: the development and validity testing of the Implementation Citizenship Behavior Scale (ICBS)
Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2015) · Implementation Science · doi:10.1186/s13012-015-0255-8 · Cited by 71 · see citing works
Self-citation
The Humble Leader: Association of Discrepancies in Leader and Follower Ratings of Implementation Leadership With Organizational Climate in Mental Health
Aarons, G. A., Ehrhart, M. G., Torres, E. M., Finn, N. K., & Beidas, R. S. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201600062 · Cited by 68 · see citing works
Self-citation
Cross-Validation of the Implementation Leadership Scale (ILS) in Child Welfare Service Organizations
Finn, N. K., Torres, E. M., Ehrhart, M. G., Roesch, S. C., & Aarons, G. A. (2016) · Child Maltreatment · doi:10.1177/1077559516638768 · Cited by 45 · see citing works
Self-citation
Frontline counselors in organizational contexts: A study of treatment practices in community settings
Smith, B. D., & Manfredo, I. T. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.03.002 · Cited by 29 · see citing works
The Role of Leadership in Creating a Strategic Climate for Evidence-Based Practice Implementation and Sustainment in Systems and Organizations
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014) · UKnowledge (University of Kentucky) · doi:10.13023/fphssr.0304.03 · Cited by 26 · see citing works
Self-citation
Designing the optimal JJ-TRIALS study: EPIS as a theoretical framework for selection and timing of implementation interventions
Knight, D. K., Belenko, S. R., Robertson, A. A., Wiley, T., Wasserman, G. A., Leukefeld, C. G., DiClemente, R. J., Brody, G. H., Dennis, M. L., & Scott, C. K. (2015) · Addiction Science & Clinical Practice · doi:10.1186/1940-0640-10-s1-a29 · Cited by 8 · see citing works
Introduction to the Special Issue on the Studies on the Implementation of Integrated Models of Alcohol, Tobacco, and/or Drug Use Interventions and Medical Care
Hunter, S. B., Schwartz, R. P., & Friedmann, P. D. (2015) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2015.10.001 · Cited by 4 · see citing works

Flagged first, then by citations

1 of the 39 references couldn’t be matched to a known paper.

Sorted by citations

Using the Practical, Robust Implementation and Sustainability Model (PRISM) to qualitatively assess multilevel contextual factors to help plan, implement, evaluate, and disseminate health services programs
McCreight, M. S., Rabin, B. A., Glasgow, R. E., Ayele, R. A., Leonard, C., Gilmartin, H., Frank, J. W., Hess, P. L., Burke, R. E., & Battaglia, C. T. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz085 · Cited by 280 · see citing works
Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol
Aarons, G. A., Ehrhart, M. G., Moullin, J. C., Torres, E. M., & Green, A. E. (2017) · Implementation Science · doi:10.1186/s13012-017-0562-3 · Cited by 159 · see citing works
Self-citation
Ottawa Model of Implementation Leadership and Implementation Leadership Scale: mapping concepts for developing and evaluating theory-based leadership interventions
Gifford, W., Graham, I. D., Ehrhart, M. G., Davies, B., & Aarons, G. A. (2017) · Journal of Healthcare Leadership · doi:10.2147/jhl.s125558 · Cited by 84 · see citing works
Self-citation
Associations among unit leadership and unit climates for implementation in acute care: A cross‐sectional study
Shuman, C. J., Liu, X., Aebersold, M. L., Tschannen, D., Banaszak-Holl, J., & Titler, M. G. (2018) · Implementation Science · doi:10.1186/s13012-018-0753-6 · Cited by 67 · see citing works
When east meets west: a qualitative study of barriers and facilitators to evidence-based practice in Hunan China
Gifford, W., Zhang, Q., Chen, S., Davies, B., Xie, R., Wen, S. W., & Harvey, G. (2018) · BMC Nursing · doi:10.1186/s12912-018-0295-x · Cited by 60 · see citing works
Testing a Theory of Implementation Leadership and Climate Across Autism Evidence-Based Interventions of Varying Complexity
Williams, N. J., Hugh, M. L., Cooney, D., Worley, J. A., & Locke, J. J. (2022) · Behavior Therapy · doi:10.1016/j.beth.2022.03.001 · Cited by 49 · see citing works
EBP Implementation Leadership of Frontline Nurse Managers: Validation of the Implementation Leadership Scale in Acute Care
Shuman, C. J., Ehrhart, M. G., Torres, E. M., Veliz, P., Kath, L. M., VanAntwerp, K., Banaszak‐Holl, J., Titler, M. G., & Aarons, G. A. (2020) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12402 · Cited by 46 · see citing works
Self-citation
Advancing theory on the multilevel role of leadership in the implementation of evidence-based health care practices
Guerrero, E. G., Frimpong, J. A., Kong, Y., Fenwick, K. M., & Aarons, G. A. (2018) · Health Care Management Review · doi:10.1097/hmr.0000000000000213 · Cited by 44 · see citing works
Self-citation
Psychometric properties of leadership scales for health professionals: a systematic review
Carlson, M. A., Morris, S., Day, F. L., Dadich, A., Ryan, A., Fradgley, E. A., & Paul, C. L. (2021) · Implementation Science · doi:10.1186/s13012-021-01141-z · Cited by 37 · see citing works
Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS)
Lyon, A. R., Corbin, C. M., Brown, E. C., Ehrhart, M. G., Locke, J., Davis, C., Picozzi, E., Aarons, G. A., & Cook, C. R. (2022) · Implementation Science · doi:10.1186/s13012-022-01222-7 · Cited by 34 · see citing works
Self-citation
Defining, conceptualizing and evaluating pragmatic qualities of quantitative instruments measuring implementation determinants and outcomes: a scoping and critical review of the literature and recommendations for future research
Hull, L., Boulton, R., Jones, F., Boaz, A., & Sevdalis, N. (2022) · Translational Behavioral Medicine · doi:10.1093/tbm/ibac064 · Cited by 32 · see citing works
Improving measurement-based care implementation in youth mental health through organizational leadership and climate: a mechanistic analysis within a randomized trial
Williams, N. J., Ehrhart, M. G., Aarons, G. A., Esp, S. M., Sklar, M., Carandang, K. M., Vega, N. R., Brookman-Frazee, L. I., & Marcus, S. C. (2024) · Implementation Science · doi:10.1186/s13012-024-01356-w · Cited by 33 · see citing works
Self-citation
An introduction to implementation evaluation of school-based interventions
Schultes, M.-T. (2021) · European Journal of Developmental Psychology · doi:10.1080/17405629.2021.1976633 · Cited by 32 · see citing works
Establishing cross-systems collaborations for implementation: protocol for a longitudinal mixed methods study
Bunger, A. C., Chuang, E., Girth, A. M., Lancaster, K. E., Gadel, F., Himmeger, M., Saldana, L., Powell, B. J., & Aarons, G. A. (2020) · Implementation Science · doi:10.1186/s13012-020-01016-9 · Cited by 29 · see citing works
Self-citation
Translation and linguistic validation of the implementation leadership scale in Chinese nursing context
Hu, J., Gifford, W., Ruan, H., Harrison, D. M., Li, Q., Ehrhart, M. G., & Aarons, G. A. (2019) · Journal of Nursing Management · doi:10.1111/jonm.12768 · Cited by 24 · see citing works
Self-citation
Leadership rounds to reduce health care–associated infections
Knobloch, M. J., Chewning, B. A., Musuuza, J., Rees, S., Green, C., Patterson, E., & Safdar, N. (2017) · American Journal of Infection Control · doi:10.1016/j.ajic.2017.08.045 · Cited by 23 · see citing works
Randomized trial of the leadership and organizational change for implementation (LOCI) strategy in substance use treatment clinics
Aarons, G. A., Sklar, M., Ehrhart, M. G., Roesch, S., Moullin, J. C., & Carandang, K. M. (2024) · Journal of Substance Use and Addiction Treatment · doi:10.1016/j.josat.2024.209437 · Cited by 22 · see citing works
Self-citation
Implementing internet- and tele-based interventions to prevent mental health disorders in farmers, foresters and gardeners (ImplementIT): study protocol for the multi-level evaluation of a nationwide project
Freund, J., Titzler, I., Thielecke, J., Braun, L., Baumeister, H., Berking, M., & Ebert, D. D. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02800-z · Cited by 17 · see citing works
Validating the Implementation Leadership Scale in Chinese nursing context: A cross‐sectional study
Hu, J., Gifford, W., Ruan, H., Harrison, D. M., Li, Q., Ehrhart, M. G., Harrison, M., Barrowman, N., & Aarons, G. A. (2021) · Nursing Open · doi:10.1002/nop2.888 · Cited by 16 · see citing works
Self-citation
Alliances to disseminate addiction prevention and treatment (ADAPT): A statewide learning health system to reduce substance use among justice-involved youth in rural communities
Aalsma, M. C., Aarons, G. A., Adams, Z. W., Alton, M., Boustani, M. A., Dir, A. L., Embí, P. J., Grannis, S. J., Hulvershorn, L. A., Huntsinger, D., et al. (2021) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2021.108368 · Cited by 17 · see citing works
Self-citation
En Route to Implementation Science 3.0
Albers, B., Shlonsky, A., & Mildon, R. L. (2020) · Springer eBooks · doi:10.1007/978-3-030-03874-8_1 · Cited by 15 · see citing works
Validity and reliability of the Greek version of Implementation Leadership Scale (ILS)
Mandrou, E., Tsounis, A., & Sarafis, P. (2020) · BMC Psychology · doi:10.1186/s40359-020-00413-5 · Cited by 16 · see citing works
Keep it Up! 3.0: Study Protocol for a Type III Hybrid Implementation-Effectiveness Cluster-Randomized TrialPreprint
Mustanski, B. S., Saber, R., Jones, J. P., Macapagal, K. R., Benbow, N., Li, D. H., Brown, C. H., Janulis, P. F., Smith, J. D., Marsh, E., et al. (2022) · SSRN Electronic Journal · doi:10.1016/j.cct.2023.107134 · Cited by 15 · see citing works
Stepped implementation-to-target: a study protocol of an adaptive trial to expand access to addiction medications
Ford, J. H., Cheng, H. L., Gassman, M., Fontaine, H., Garneau, H. C., Keith, R., Michael, E., & McGovern, M. P. (2022) · Implementation Science · doi:10.1186/s13012-022-01239-y · Cited by 14 · see citing works
Teachers’ Assessment of “Implementation Leadership” during a new Social Emotional Learning Initiative
Shapiro, V. B., Ziemer, K. L., Accomazzo, S., & Kim, B. E. (2019) · Contemporary School Psychology · doi:10.1007/s40688-019-00230-7 · Cited by 13 · see citing works
Pragmatic adaptation of implementation research measures for a novel context and multiple professional roles: a factor analysis study
Smith, J. D., Rafferty, M. R., Heinemann, A. W., Meachum, M. K., Villamar, J. A., Lieber, R. L., & Brown, C. H. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05118-4 · Cited by 13 · see citing works
Protocol: examining the effectiveness of an adaptive implementation intervention to improve uptake of the VA suicide risk identification strategy: a sequential multiple assignment randomized trial
Bahraini, N. H., Matarazzo, B. B., Barry, C. N., Post, E. P., Forster, J. E., Dollar, K. M., Dobscha, S. K., & Brenner, L. A. (2020) · Implementation Science · doi:10.1186/s13012-020-01019-6 · Cited by 12 · see citing works
Attitudes Towards Evidence-Based Practice in Substance Use Treatment Programs Serving American Indian Native Communities
Moullin, J. C., Moore, L. A., Novins, D. K., & Aarons, G. A. (2018) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-018-9643-6 · Cited by 11 · see citing works
Self-citation
The Role of Organizational Processes in Dissemination and Implementation Research
Aarons, G. A., Ehrhart, M. G., Lengnick‐Hall, R., & Moullin, J. C. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197660690.003.0009 · Cited by 7 · see citing works
Self-citation
Using the Consolidated Framework for Implementation Research to evaluate a nationwide depression prevention project (ImplementIT) from the perspective of health care workers and implementers: Results on the implementation of digital interventions for farmers
Freund, J., Ebert, D. D., Thielecke, J., Braun, L., Baumeister, H., Berking, M., & Titzler, I. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1083143 · Cited by 6 · see citing works
Implementation Strategy Fidelity and Organizational Outcomes in a Randomized Trial: Implications for Reentry from Corrections to Community Treatment
Stein, L. A. R., Bassett, S. S., Welsh, W. N., Clair-Michaud, M., Abdel-Salam, S., Monico, L. B., Gallagher, C., Murgo, C., Yang, Y., Friedmann, P. D., et al. (2023) · Substance Use & Misuse · doi:10.1080/10826084.2022.2161311 · Cited by 6 · see citing works
Implementation Leadership in the Point of Care Nursing Context: A Systematic Review Comparing Two Measurement Tools
Castiglione, S. A., Fréchette, J., & Agnihotram, V. R. (2023) · SAGE Open Nursing · doi:10.1177/23779608231216161 · Cited by 5 · see citing works
Implementation leadership and implementation climate in context: A single organization intrinsic case study for implementation of digital measurement-based care
Sklar, M., Ehrhart, M. G., Ramirez, N., Carandang, K. M., Kuhn, N., Day, A., Aarons, G. A., & Williams, N. J. (2024) · Implementation Research and Practice · doi:10.1177/26334895241236680 · Cited by 6 · see citing works
Self-citation
Dimensions of community context that affect coalition effectiveness: development of an instrument
Wang, Y., Orwenyo, E. K., Powell, K. G., Peterson, N. A., Wang, Y., Borys, S. V., & Hallcom, D. K. (2024) · Journal of Social Work Practice in the Addictions · doi:10.1080/1533256x.2024.2414984 · Cited by 4 · see citing works
Effectiveness and implementation of an electronic health record-integrated digital health intervention for managing depressive symptoms in ambulatory oncology: The My Well-Being Guide study rationale and protocol
Yanez, B. R., Czech, K. A., Buitrago, D., Smith, J. D., Schueller, S. M., Taub, C. J., Kircher, S. M., Garcia, S. F., Bass, M., Mercer, A. M., et al. (2023) · Contemporary Clinical Trials · doi:10.1016/j.cct.2023.107121 · Cited by 4 · see citing works
Contextual factors associated with successful alcohol screening and brief intervention implementation and sustainment in adult primary care
Sterling, S., Lu, Y., Grijalva, C., Ross, T. B., Weisner, C. M., Elson, J., & Chi, F. W. (2024) · Journal of Substance Use and Addiction Treatment · doi:10.1016/j.josat.2024.209532 · Cited by 4 · see citing works
Validity and reliability of the transculturally adapted Spanish version of the Implementation Leadership Scale (ILS)
Llarena, M., Rogers, H. L., Macía, P., Pablo, S., González, M., Montejo, M., Paniagua, N., Benito, J., Rueda-Etxebarria, M., Santos, B., et al. (2023) · Implementation Science Communications · doi:10.1186/s43058-023-00495-3 · Cited by 5 · see citing works
A new scale to assess health-facility level management: the development and validation of the facility management scale in Ghana, Uganda, and Malawi
Mubiri, P., Ssengooba, F., O’Byrne, T., Aryaija‐Karemani, A., Namakula, J., Chikaphupha, K. R., Aikins, M., Martineau, T., & Vallières, F. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-10781-y · Cited by 3 · see citing works
Implementation science in higher education: Identifying key determinants in the selection of evidence-based alcohol and substance prevention and treatment
Helle, A. C., Washington, K. T., Masters, J., Sher, K. J., Aarons, G. A., & Hawley, K. M. (2025) · Journal of Substance Use and Addiction Treatment · doi:10.1016/j.josat.2024.209617 · Cited by 3 · see citing works
Self-citation
Addressing the Practice Context in Evidence-Based Practice Implementation: Leadership and Climate
Shuman, C. J. (2017) · Deep Blue (University of Michigan) · Cited by 3 · see citing works
Instruments used for evaluation in substance use disorder: a systematic review
Moreira, D. S., Azeredo, A. A. C., & Dias, P. C. (2022) · Journal of Substance Use · doi:10.1080/14659891.2022.2082334 · Cited by 1 · see citing works
Validation of the extended version of the Implementation Leadership Scale (ILS-X)
Ehrhart, M. G., Williams, N. J., Sklar, M., Vega, N. R., Kandah, A., & Aarons, G. A. (2025) · Implementation Science Communications · doi:10.1186/s43058-025-00786-x · Cited by 1 · see citing works
Self-citation
Evidence-Based Leadership: A Study of Its Application to General Hospital of the Public Health System Through the Implementation Leadership Scale
Platis, C. G., Delimpaltadakis, E., Stergiannis, P. I., Κωσταγιόλας, Π., & Intas, G. (2021) · Advances in experimental medicine and biology · doi:10.1007/978-3-030-78771-4_2 · Cited by 1 · see citing works
Validity and reliability of the Turkish version of the Implementation Leadership Scale in the context of nurses
Yıldız, A. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11721-6 · Cited by 3 · see citing works
An analysis of teacher perspectives on their role in student social-emotional competency development
Lavoie, B. (2022) · doi:10.17760/d20449621
"Fill the educator cup": utilizing educator collaboration, support, and training to better support students' social emotional learning
Griffin, B. (2022) · doi:10.17760/d20467326
A new scale to assess health-facility level management: The development and validation of the Facility Management Scale in Ghana, Uganda, and MalawiPreprint
Mubiri, P., Ssengooba, F., O’Byrne, T., Keremani, A., Namakula, J., Chikaphupha, K. R., Aikins, M., Martineau, T., & Vallières, F. (2023) · Research Square · doi:10.21203/rs.3.rs-3076806/v1
Additional file 1 of Stepped implementation-to-target: a study protocol of an adaptive trial to expand access to addiction medications
Ford, J. H., Cheng, H. L., Gassman, M., Fontaine, H., Garneau, H. C., Keith, R., Michael, E., & McGovern, M. P. (2022) · Figshare · doi:10.6084/m9.figshare.21249591
Additional file 1 of Pragmatic adaptation of implementation research measures for a novel context and multiple professional roles: a factor analysis study
Smith, J. D., Rafferty, M. R., Heinemann, A. W., Meachum, M. K., Villamar, J., Lieber, R. L., & Brown, C. H. (2020) · Figshare · doi:10.6084/m9.figshare.12050433
Additional file 1 of Improving measurement-based care implementation in youth mental health through organizational leadership and climate: a mechanistic analysis within a randomized trial
Williams, N. J., Ehrhart, M. G., Aarons, G. A., Esp, S. M., Sklar, M., Carandang, K. M., Vega, N. R., Brookman-Frazee, L. I., & Marcus, S. C. (2024) · Figshare · doi:10.6084/m9.figshare.25506625
Self-citation
Additional file 2 of Stepped implementation-to-target: a study protocol of an adaptive trial to expand access to addiction medications
Ford, J. H., Cheng, H. L., Gassman, M., Fontaine, H., Garneau, H. C., Keith, R., Michael, E., & McGovern, M. P. (2022) · Figshare · doi:10.6084/m9.figshare.21249594
Additional file 1 of Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS)
Lyon, A. R., Corbin, C. M., Brown, E. C., Ehrhart, M. G., Locke, J. J., Davis, C. J., Picozzi, E., Aarons, G. A., & Cook, C. R. (2022) · Figshare · doi:10.6084/m9.figshare.20342346
Self-citation
Additional file 1 of Psychometric properties of leadership scales for health professionals: a systematic review
Carlson, M. A., Morris, S., Day, F., Dadich, A., Ryan, A., Fradgley, E. A., & Paul, C. (2021) · Figshare · doi:10.6084/m9.figshare.16530009
Additional file 2 of Pragmatic adaptation of implementation research measures for a novel context and multiple professional roles: a factor analysis study
Smith, J. D., Rafferty, M. R., Heinemann, A. W., Meachum, M. K., Villamar, J., Lieber, R. L., & Brown, C. H. (2020) · Figshare · doi:10.6084/m9.figshare.12050436
Additional file 1 of A new scale to assess health-facility level management: the development and validation of the facility management scale in Ghana, Uganda, and Malawi
Mubiri, P., Ssengooba, F., O’Byrne, T., Aryaija‐Karemani, A., Namakula, J., Chikaphupha, K. R., Aikins, M., Martineau, T., & Vallières, F. (2024) · Figshare · doi:10.6084/m9.figshare.25478737
Additional file 1 of Validity and reliability of the transculturally adapted Spanish version of the Implementation Leadership Scale (ILS)
Llarena, M., Rogers, H. L., Macia, P., Pablo, S., González, M., Montejo, M., Paniagua, N., Benito, J., Rueda, M., Santos, B., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26616964
Evaluating Equity-Centered Capacity-Building Programs to Strengthen Implementation Leadership in Southern U.S. HIV Service Organizations
McCormick, K. A., Stanton, M. C., Strohl, K., & Ali, S. (2026) · Journal of the International Association of Providers of AIDS Care (JIAPAC) · doi:10.1177/23259582261470700
Implementation Leadership in Evidence‐Based Practice in Healthcare: A Systematic Review and Meta‐Analysis
Kuha, S., Miettunen, J., & Kanste, O. I. (2026) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.70163

Validation of the Implementation Leadership Scale (ILS) in Substance Use Disorder Treatment Organizations. Copyright: Elsevier, Inc.
Aarons, G. A., Ehrhart, M. G., Torres, E. M., Finn, N. K., & Roesch, S. C. (2016) · Open Scholarship Institutional Repository (Washington University in St. Louis)
Self-citation
The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership
Aarons, G. A., Ehrhart, M. G., & Farahnak, L. R. (2014) · Implementation Science · doi:10.1186/1748-5908-9-45 · Cited by 559 · see citing works
Self-citation
Validation of the Implementation Climate Scale (ICS) in substance use disorder treatment organizations
Ehrhart, M. G., Torres, E. M., Hwang, J., Sklar, M., & Aarons, G. A. (2019) · Substance Abuse Treatment Prevention and Policy · doi:10.1186/s13011-019-0222-5 · Cited by 32 · see citing works
Self-citation
Validation of the Implementation Leadership Scale (ILS) with Supervisors’ Self-Ratings
Torres, E. M., Ehrhart, M. G., Beidas, R. S., Farahnak, L. R., Finn, N. K., & Aarons, G. A. (2017) · Community Mental Health Journal · doi:10.1007/s10597-017-0114-y · Cited by 27 · see citing works
Self-citation
Cross-Validation of the Implementation Leadership Scale (ILS) in Child Welfare Service Organizations
Finn, N. K., Torres, E. M., Ehrhart, M. G., Roesch, S. C., & Aarons, G. A. (2016) · Child Maltreatment · doi:10.1177/1077559516638768 · Cited by 45 · see citing works
Self-citation

Authors: Aarons, G. A., Ehrhart, M. G., Torres, E. M., Finn, N. K., & Roesch, S. C.
Affiliations: University of California San Diego (US)
San Diego State University (US)
Corresponding author: Aarons, Gregory A.
Ehrhart, Mark G.
Torres, Elisa M.
Roesch, Scott C.
ORCID: Aarons, Gregory A.
Ehrhart, Mark G.
Torres, Elisa M.
Roesch, Scott C.
Venue: Journal of Substance Abuse Treatment
Publisher: Elsevier BV
Published: 2016-09
Volume: 68
Pages: 31-35
ISSN: 0740-5472 (ISSN-L)
DOI: 10.1016/j.jsat.2016.05.004
PMC: PMC5349507
OpenAlex: W2354437841
Cited by: 57
References: 39
Citations by year: 2026: 2 · 2025: 2 · 2024: 10 · 2023: 6 · 2022: 11 · 2021: 6 · 2020: 8 · 2019: 4 · 2018: 4 · 2017: 4
FWCI: 6.63
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/legal/tdmrep-license (tdm)
Locations: Journal of Substance Abuse Treatment (publishedVersion)
PubMed (publishedVersion)
Europe PMC (PubMed Central) (acceptedVersion)
PubMed Central (acceptedVersion)
Open Scholarship Institutional Repository (Washington University in St. Louis) (submittedVersion)
eScholarship (California Digital Library) (submittedVersion)
Funders: National Institute of Mental Health (R21MH098124, R21MH082731, R01MH072961, R01MH092950)
National Institute on Drug Abuse (R01DA038466)
Topics: Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
Keywords: implementation leadership, evidence-based practice implementation, scale validation, psychometric properties, factor structure, service providers, organizational development
MeSH terms: Adult, Aged, Alcoholism, Factor Analysis, Statistical, Female, Health Personnel, Humans, Leadership, Male, Middle Aged, Psychometrics, Reproducibility of Results, Substance-Related Disorders, Evidence-Based Practice, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Validation of the Implementation Leadership Scale (ILS) in Substance use Disorder Treatment Organizations

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks