The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index; 30 of the 60 sources its claims cite were checked for support.
Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS)
Open accessPublished version of a preprint
Abstract
Strategic implementation leadership is a critical determinant of successful implementation, hypothesized to create a more supportive implementation climate conducive to the adoption and use of evidence-based practices. The current study adapted and validated the School Implementation Leadership Scale (SILS) (based on the Implementation Leadership Scale) in public school settings, demonstrating its utility in evaluating and supporting school leadership behavior for implementation.
Overview
CoChat Summary
## TL;DR
The study adapted and validated the 21-item School Implementation Leadership Scale (SILS) for elementary school settings using data from 441 teachers in 52 schools across 6 districts. The final 7-factor scale showed strong structural, convergent, and divergent validity for measuring strategic implementation leadership for school-based mental health prevention programs.
## Key findings
- Item reduction from the initial 30-item revision yielded a 21-item instrument with 7 subscales of 3 items each; 5 items were dropped from the original four subscales and 4 from the added subscales.
- The reduced model fit well: CFI = .99, TLI = .99, RMSEA = .07, SRMR = .02; second-order factor loadings were high (λ = .89 to .96), supporting a higher-order implementation leadership factor.
- Internal consistency was strong across subscales, with α = .91–.96.
- Validity evidence matched expectations: SILS subscales correlated moderately to highly with general leadership measures (r = .56–.80), moderately with teaching attitudes (r = .36–.44), and weakly with school demographics (r = −.31 to .22); management-by-exception showed low to near-zero correlations (r = .05–.12).
## Methods
- The authors adapted the original Implementation Leadership Scale for schools, adding new items for communication, vision/mission, and availability, then administered a survey to teachers in elementary schools implementing SWPBIS or PATHS.
- Sample: 441 public school teachers from 52 elementary schools in 6 districts in Washington, Ohio, and Illinois; about 88% of 500 contacted teachers completed the online survey.
- Main analyses: item characteristic curve analysis for item reduction, confirmatory factor analysis in Mplus v8 for structural validity, multigroup models for invariance across general vs intervention-specific item referents, and correlations for convergent/divergent validity.
## Limitations
- The paper states that a larger number of participants implemented SWPBIS than PATHS, so future studies should expand testing across more programs.
- It notes the need for future research on predictive validity with implementation climate and outcomes such as fidelity, and on including informal leaders; it also says the study was not sufficiently powered to rigorously examine the measurement model at the school level.
- Evident from the text: missing data were present and sometimes reduced the number of participants in analyses (<5% overall).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
17 Valid · 2 Not valid · 11 Not checked · 60 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“In pursuit of this objective, Lyon and colleagues conducted an initial adaptation of the ILS for use with mental and behavioral health consultants in the education sector [66].”
§ Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) > Introduction > Implementation leadership in schools
What the sources say
- Supportedcites [66] Lyon AR, Cook CR, Brown EC, Locke J, Davis C, Ehrhart M, et al. Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implement Sci. 2018;13(1):5. https://doi.org/10.1186/s13012-017-0705-6. source
The Study aims section says the authors evaluated adapted versions of the ILS through large-scale administration to school-based behavioral health consultants. The Measures section confirms that the ILS items were adapted for the school context. Page numbers are not provided in our copy. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Subsequent studies have begun this work, including successful validation of the instrument in child welfare [30], substance use treatment [31], and acute care [32];”
§ Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) > Introduction > Organizational leadership for implementation
What the sources say
- Not checked — no full text of the sourcecites [30] Finn NK, Torres EM, Ehrhart MG, Roesch SC, Aarons GA. Cross-validation of the implementation leadership scale (ILS) in child welfare service organizations. Child Maltreat. 2016;21(3):250–5. https://doi.org/10.1177/1077559516638768. source
- Supportedcites [31] Aarons GA, Ehrhart MG, Torres EM, Finn NK, Roesch SC. Validation of the implementation leadership scale (ILS) in substance use disorder treatment organizations. J Subst Abus Treat. 2016;68:31–5 https://www.sciencedirect.com/science/article/pii/S0740547216300654. source
Citation [31] is attached to validation in substance use treatment, not the separate child-welfare or acute-care claims. The Abstract reports that the ILS factor structure, reliability, and validity were supported in alcohol and other drug use treatment agencies; the Discussion reiterates this finding. (LLM, conf=0.94)
- Not checked yetcites [32] Shuman CJ, Ehrhart MG, Torres EM, Veliz P, Kath LM, VanAntwerp K, et al. EBP implementation leadership of frontline nurse managers: validation of the implementation leadership scale in acute care. Worldviews Evid-Based Nurs. 2020;17(1):82–91. https://doi.org/10.1111/wvn.12402. source
Checked before — its earlier verdict is held back until a new check runs.
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“Findings provided strong support for the original ILS factor structure with this new population.”
§ Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) > Introduction > Implementation leadership in schools
What the sources say
- Supportedcites [66] Lyon AR, Cook CR, Brown EC, Locke J, Davis C, Ehrhart M, et al. Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implement Sci. 2018;13(1):5. https://doi.org/10.1186/s13012-017-0705-6. source
The Method (Abstract) identifies the new population as school-based mental/behavioral health consultants. The Results (Confirmatory factor analyses, ILS) report large, significant loadings for the four theorized ILS factors and strong fit statistics, supporting the original factor structure in that population. (LLM, conf=0.92)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Rigorous assessment of implementation leadership is critical to inform implementation research and practice in this domain as recent studies have shown that implementation leadership is a malleable organizational characteristic [28].”
§ Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) > Introduction > Organizational leadership for implementation
What the sources say
- Partly supportedcites [28] Aarons GA, Ehrhart MG, Moullin JC, Torres EM, Green AE. Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: A cluster randomized trial study protocol. Implement Sci. 2017;12(1):29. https://doi.org/10.1186/s13012-017-0562-3. sourceExperimental — accuracy not yet measured
The Background’s Preliminary studies section reports that a small LOCI pilot found change in leadership behavior, and the LOCI development section describes improving implementation leadership as an intervention goal (page numbers unavailable). This supports the idea that leadership can change, but the paper is a study protocol and does not report a demonstrated change specifically in implementation leadership. (LLM, conf=0.83)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, EBP are inconsistently adopted, delivered with fidelity, or sustained over time in schools [5, 6].”
§ Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) > Introduction
What the sources say
- Partly supportedcites [5] Lyon AR, Bruns EJ. From evidence to impact: Joining our best school mental health practices with our best implementation strategies. Sch Ment Heal. 2019;11(1):106–14. https://doi.org/10.1007/s12310-018-09306-w. sourceExperimental — accuracy not yet measured
The section “Viewing School Mental Health Interventions through an Implementation Lens” describes inadequate implementation support in schools and a need to improve adherent uptake of research-based practices. The Conclusion also reports that many EBP implementation efforts fail. These passages support inconsistent adoption and fidelity, but they do not establish that school-based EBPs are inconsistently sustained over time; no page numbers are available in our copy. (LLM, conf=0.82)
- Supportedcites [6] Owens JS, Lyon AR, Brandt NE, Masia Warner C, Nadeem E, Spiel C, et al. Implementation science in school mental health: Key constructs in a developing research agenda. Sch Ment Heal. 2014;6(2):99–111. https://doi.org/10.1007/s12310-013-9115-3. source
The Abstract (page not available in our copy) describes limited use of EBPs by school mental health providers and wide variability in the dose and integrity of implementation. The Intervention Integrity section reports variable adherence that declines without ongoing support, while the Sustainment section explains that improvements may be transitory even after successful implementation. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
52 more claims · 3 with their cited sources checked
Create a free account to see all 90 claims and to verify the 4 references still open.
- Probably not a substantial claim. 12
- It may state two separate claims as one. 21
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 80,032
Testing Structural Equation Models.
Mueller, C. W., Bollen, K. A., & Long, J. S. (1994) · Contemporary Sociology · doi:10.2307/2074955 · Cited by 14,120
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Self-citationA Reliability Coefficient for Maximum Likelihood Factor Analysis
Tucker, L. R., & Lewis, C. (1973) · Psychometrika · doi:10.1007/bf02291170 · Cited by 7,330
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
National Center for Education Statistics
(2008) · Encyclopedia of Educational Psychology · doi:10.4135/9781412963848.n192 · Cited by 4,546
Organizational culture and leadership
Tohidi, H., & Jabbari, M. M. (2012) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2011.12.156 · Cited by 4,303
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
Self-citation
Research works printed but not linked: 3
- Durlak J, Weissberg R. A major meta-analysis of positive youth development programs. Washington D.C: Invited presentation at the Annual Meeting of the American Pschological Association; Washington, DC; 2005.
- Hallinger P. Principal instructional management rating scale. Sarasota: Leading Development Associates; 1990.
- Kotter JP. Leading change: Harvard Business Press; 1996.
Cited by
Daly, B. P., Resnikoff, A. W., & Litke, S. G. (2025) · Behavioral Sciences · doi:10.3390/bs15010036 · Cited by 41
Zhang, Y., Cook, C., Fallon, L. M., Corbin, C. M., Ehrhart, M. G., Brown, E. C., Locke, J. J., & Lyon, A. R. (2022) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-022-01248-5 · Cited by 20
Self-citationAhlers, K. P., Hugh, M. L., Tagavi, D. M., Eayrs, C., Hernandez, A. M., Ho, T., & Locke, J. J. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1241892 · Cited by 25
“, support of adopting new practices; (22, 25)] as well as make structural decisions (e.”
BackgroundSelf-citationLyon, A. R., Cook, C. R., Larson, M. F., Hugh, M. L., Dopp, A. R., Hamlin, C., Reinke, P. H., Bose, M., Law, A., Goosey, R., et al. (2024) · Implementation Science · doi:10.1186/s13012-023-01330-y · Cited by 9
Self-citationCollins, V. K., Corbin, C. M., Locke, J. J., Cook, C. R., Ehrhart, M. G., Hatch, K., & Lyon, A. R. (2024) · School Mental Health · doi:10.1007/s12310-024-09635-z · Cited by 12
“School leaders can influence EBP implementation by allocating resources, communicating the importance of and expectations surrounding implementation of EBP, and recognizing and rewarding EBP use, among other things (Lyon et al., 2022).”
Self-citation
Metadata
- Authors
- Lyon, A. R., Corbin, C. M., Brown, E. C., Ehrhart, M. G., Locke, J., Davis, C., Picozzi, E., Aarons, G. A., & Cook, C. R.
- Affiliations
- University of Washington (US)
- University of Miami (US)
- University of Central Florida (US)
- University of California San Diego (US)
- University of Minnesota (US)
- Corresponding author
- Lyon, Aaron R.
- ORCID
- Venue
- Implementation Science
- Published
- 2022-07-19
- Volume
- 17
- Issue
- 1
- Pages
- 48-48
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC9295535
- OpenAlex
- W4285794646
- Cited by
- 41
- References
- 88
- Citations by year
- 2026: 9 · 2025: 13 · 2024: 13 · 2023: 4 · 2022: 2
- FWCI
- 7.15
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Implementation Science (publishedVersion, cc-by)
- Research Square (submittedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Institute of Education Sciences (R305A160114, R305A200023)
- National Institute on Drug Abuse (R01DA04989)
- National Institute of Mental Health (R03MH117493)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › School Health and Nursing Education
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Keywords
- implementation leadership, scale development, scale validation, school mental health, child and adolescent mental health, mental health prevention programs, primary school teachers, implementation climate, evidence-based practice adoption, leadership assessment, school districts, item characteristic curves, convergent and discriminant validity, factor structure, mission and vision
- MeSH terms
- Adolescent, Child, Factor Analysis, Statistical, Humans, Leadership, Psychometrics, Surveys and Questionnaires, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS). https://app.cochat.ai/papers/10.1186/s13012-022-01222-7
- The paper
- Lyon, A. R., Corbin, C. M., Brown, E. C., Ehrhart, M. G., Locke, J., Davis, C., Picozzi, E., Aarons, G. A., & Cook, C. R. (2022). Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS). Implementation Science. https://doi.org/10.1186/s13012-022-01222-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


