The DOI matches its Crossref record; 78 of the 79 references it cites were found in a registry or an index.
Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship
Open accessAbstract
BACKGROUND: A substantial literature has established the role of the inner organizational setting on the implementation of evidence-based practices in community contexts, but very little of this research has been extended to the education sector, one of the most common settings for the delivery of mental and behavioral health services to children and adolescents. The current study examined the factor structure, psychometric properties, and interrelations of an adapted set of pragmatic organizational instruments measuring key aspects of the organizational implementation context in schools: (1) strategic implementation leadership, (2) strategic implementation climate, and (3) implementation citizenship behavior. METHOD: The Implementation Leadership Scale (ILS), Implementation Climate Scale (ICS), and Implementation Citizenship Behavior Scale (ICBS) were adapted by a research team that included the original scale authors and experts in the implementation of evidence-based practices in schools. These instruments were then administered to a geographically representative sample (n = 196) of school-based mental/behavioral health consultants to assess the reliability and structural validity via a series of confirmatory factor analyses. RESULTS: Overall, the original factor structures for the ILS, ICS, and ICBS were confirmed in the current sample. The one exception was poor functioning of the Rewards subscale of the ICS, which was removed in the final ICS model. Correlations among the revised measures, evaluated as part of an overarching model of the organizational implementation context, indicated both unique and shared variance. CONCLUSIONS: The current analyses suggest strong applicability of the revised instruments to implementation of evidence-based mental and behavioral practices in the education sector. The one poorly functioning subscale (Rewards on the ICS) was attributed to typical educational policies that do not allow for individual financial incentives to personnel. Potential directions for future expansion, revision, and application of the instruments in schools are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In pursuit of this objective, Lyon and colleagues conducted an initial adaptation of the ILS for use with mental and behavioral health consultants in the education sector [66].”
From Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) (2022) · cites this paper as [66]
The cited source says what the claim attributes to it.
In the citing paper
“Findings provided strong support for the original ILS factor structure with this new population.”
From Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) (2022) · cites this paper as [66]
The cited source says what the claim attributes to it.
In the citing paper
“The original ILS [9] and original SILS adaptation [66] are 12-item instruments developed to assess strategic leadership for EBP implementation.”
From Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) (2022) · cites this paper as [66]
The cited source says what the claim attributes to it.
In the citing paper
“Both versions have previously supported a factor structure with four first-order factors (proactive leadership, knowledgeable leadership, supportive leadership, perseverant leadership)—each with three items—loading onto an overarching implementation leadership latent factor [26, 66].”
From Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) (2022) · cites this paper as [66]
The cited source says what the claim attributes to it.
In the citing paper
“Scores also were higher than those observed on the earlier version of the ILS adapted for schools [66].”
From Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS) (2022) · cites this paper as [66]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · cited 1×
“Model fit was assessed based on a preponderance of the evidence from the chi-square statistic, comparative fit index (CFI; [63, 64]), the Tucker-Lewis index (TLI; [65]) and root mean square error of approximation (RMSEA; [66]) with values of the CFI and TLI greater than .”
MethodTabachnick, B. G., & Fidell, L. S. (1983) · Cited by 80,032
Alternative Ways of Assessing Model Fit
Browne, M. W., & Cudeck, R. (1992) · Sociological Methods & Research · doi:10.1177/0049124192021002005 · Cited by 27,200 · cited 1×
“Model fit was assessed based on a preponderance of the evidence from the chi-square statistic, comparative fit index (CFI; [63, 64]), the Tucker-Lewis index (TLI; [65]) and root mean square error of approximation (RMSEA; [66]) with values of the CFI and TLI greater than .”
MethodComparative fit indexes in structural models.
Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266 · cited 1×
“Model fit was assessed based on a preponderance of the evidence from the chi-square statistic, comparative fit index (CFI; [63, 64]), the Tucker-Lewis index (TLI; [65]) and root mean square error of approximation (RMSEA; [66]) with values of the CFI and TLI greater than .”
MethodOrganizational culture and leadership
(1993) · Long Range Planning · doi:10.1016/0024-6301(93)90120-5 · Cited by 16,462
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 1×
“As a result, most leading implementation frameworks provide comprehensive coverage of “inner context” organizational factors [1, 3].”
Background(2007) · Cited by 10,092
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · cited 1×
“Furthermore, ILS, ICS, and ICBS scores were not directly linked to implementation [81] or service recipient outcomes.”
BackgroundSelf-citationA Reliability Coefficient for Maximum Likelihood Factor Analysis
Tucker, L. R., & Lewis, C. (1973) · Psychometrika · doi:10.1007/bf02291170 · Cited by 7,330 · cited 1×
“Model fit was assessed based on a preponderance of the evidence from the chi-square statistic, comparative fit index (CFI; [63, 64]), the Tucker-Lewis index (TLI; [65]) and root mean square error of approximation (RMSEA; [66]) with values of the CFI and TLI greater than .”
MethodPowell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963 · cited 1×
“Subsequent development of data-driven “assessment-to-action” frameworks that link the ILS, ICS, and ICBS to specific, multi-level implementation strategies [84, 85] may represent a next frontier for the implementation behavioral health interventions in the education sector.”
Background
Research works printed but not linked: 7
- Ehrhart MG, Aarons GA, Torres EM, Finn NK, Roesch SC. Implementation in child welfare: leadership, climate, attitudes, and citizenship behavior. Anaheim, CA: Poster presented at the 31st annual conference of the Society for Industrial and Organizational Psychology; 2016.
- Elias MJ, O’Brien U, Weisberg P. Transformative leadership for social-emotional learning. Princ Leadersh. 2006;7:10–3.
- Hallinger P. Principal instructional management rating scale. Sarasota, FL: Leading Development Associates; 1990.
- DiPaola MF, Tarter CJ, Hoy WK. Measuring organizational citizenship in schools: the OCB scale. Educat Leadership Reform. 2005;4:319–41.
- Muthén B, Asparouhov T. Latent variable analysis with categorical outcomes: multiple-group and growth modeling in Mplus. Mplus Web Notes. 2002;4:1–22.
- Muthén LK, Muthén BO. Mplus Version 7 user’s guide. Los Angeles, CA: Muthén & Muthén; 2006.
- National Center on Response to Intervention. Essential components of RTI: a closer look at response to intervention. Washington, DC: U.S. Department of Education, Office of Special Education Programs, National Center on Response to Intervention: National Center on Response to Intervention; 2010.
Cited by
Cook, C. R., Lyon, A. R., Locke, J., Waltz, T., & Powell, B. J. (2019) · Prevention Science · doi:10.1007/s11121-019-01017-1 · Cited by 336
“…to the unique constraints of educational settings, such as school boards, compulsory attendance, and educational policy, financial strategies such as fee-for-service , use capitated payments , and use other payment schemes are not applicable and appropriate to the school context (Lyon et al. 2018).”
BackgroundSelf-citationCassar, S., Salmon, J., Timperio, A., Naylor, P.-J., van Nassau, F., Contardo Ayala, A. M., & Koorts, H. (2019) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-019-0876-4 · Cited by 304
Agran, M., Jackson, L., Kurth, J. A., Ryndak, D., Burnette, K., Jameson, M., Zagona, A., Fitzpatrick, H., & Wehmeyer, M. (2020) · Research and Practice for Persons with Severe Disabilities · doi:10.1177/1540796919878134 · Cited by 270
“Lyon et al. (2018) discussed the importance of constituents having a common vision of the desired change in practice throughout the system, verifying the value placed on the desired change.”
BackgroundMoir, T. (2018) · Frontiers in Education · doi:10.3389/feduc.2018.00061 · Cited by 217
Lyon, A. R., & Bruns, E. J. (2019) · School Mental Health · doi:10.1007/s12310-018-09306-w · Cited by 191
Self-citation
Metadata
- Authors
- Lyon, A. R., Cook, C. R., Brown, E. C., Locke, J., Davis, C., Ehrhart, M., & Aarons, G. A.
- Affiliations
- University of Washington (US)
- University of Minnesota (US)
- University of Miami (US)
- University of Central Florida (US)
- University of California San Diego (US)
- Corresponding author
- Lyon, Aaron R.
- Venue
- Implementation Science
- Published
- 2018-01-08
- Volume
- 13
- Issue
- 1
- Pages
- 5-5
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC5759223
- OpenAlex
- W2783384668
- Semantic Scholar
- cf483ad12a991336269fcae2760238582374fbeb
- Cited by
- 199
- References
- 79
- Citations by year
- 2026: 11 · 2025: 25 · 2024: 33 · 2023: 30 · 2022: 33 · 2021: 27 · 2020: 13 · 2019: 21 · 2018: 5
- FWCI
- 25.20
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Journal of International Crisis and Risk Communication Research (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship (California Digital Library) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Open Scholarship Institutional Repository (Washington University in St. Louis) (submittedVersion, cc-by)
- Grantee Submission
- Funders
- National Institute of Mental Health (K08MH095939, K01MH100199)
- Institute of Education Sciences (R305A160114)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › School Health and Nursing Education
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- implementation leadership, implementation climate, evidence-based practice, school-based mental health services, scale adaptation, psychometric validation, factor structure
- MeSH terms
- Adult, Child, Climate, Factor Analysis, Statistical, Female, Humans, Leadership, Male, Organizational Innovation, Reproducibility of Results, Organizational Culture, Evidence-Based Practice, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. https://app.cochat.ai/papers/10.1186/s13012-017-0705-6
- The paper
- Lyon, A. R., Cook, C. R., Brown, E. C., Locke, J., Davis, C., Ehrhart, M., & Aarons, G. A. (2018). Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implementation Science. https://doi.org/10.1186/s13012-017-0705-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
