Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 78 of the 79 references it cites were found in a registry or an index.

Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship

Open access

Abstract

BACKGROUND: A substantial literature has established the role of the inner organizational setting on the implementation of evidence-based practices in community contexts, but very little of this research has been extended to the education sector, one of the most common settings for the delivery of mental and behavioral health services to children and adolescents. The current study examined the factor structure, psychometric properties, and interrelations of an adapted set of pragmatic organizational instruments measuring key aspects of the organizational implementation context in schools: (1) strategic implementation leadership, (2) strategic implementation climate, and (3) implementation citizenship behavior. METHOD: The Implementation Leadership Scale (ILS), Implementation Climate Scale (ICS), and Implementation Citizenship Behavior Scale (ICBS) were adapted by a research team that included the original scale authors and experts in the implementation of evidence-based practices in schools. These instruments were then administered to a geographically representative sample (n = 196) of school-based mental/behavioral health consultants to assess the reliability and structural validity via a series of confirmatory factor analyses. RESULTS: Overall, the original factor structures for the ILS, ICS, and ICBS were confirmed in the current sample. The one exception was poor functioning of the Rewards subscale of the ICS, which was removed in the final ICS model. Correlations among the revised measures, evaluated as part of an overarching model of the organizational implementation context, indicated both unique and shared variance. CONCLUSIONS: The current analyses suggest strong applicability of the revised instruments to implementation of evidence-based mental and behavioral practices in the education sector. The one poorly functioning subscale (Rewards on the ICS) was attributed to typical educational policies that do not allow for individual financial incentives to personnel. Potential directions for future expansion, revision, and application of the instruments in schools are discussed.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13012-017-0705-6

Cites

78 of 78 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Full confirmatory factor analysis model including measures of implementation leadership, climate, and citizenship
Fig. 1 Full confirmatory factor analysis model including measures of implementation leadership, climate, and citizenshipCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 79 references

Research works printed but not linked: 7

  1. Ehrhart MG, Aarons GA, Torres EM, Finn NK, Roesch SC. Implementation in child welfare: leadership, climate, attitudes, and citizenship behavior. Anaheim, CA: Poster presented at the 31st annual conference of the Society for Industrial and Organizational Psychology; 2016.
  2. Elias MJ, O’Brien U, Weisberg P. Transformative leadership for social-emotional learning. Princ Leadersh. 2006;7:10–3.
  3. Hallinger P. Principal instructional management rating scale. Sarasota, FL: Leading Development Associates; 1990.
  4. DiPaola MF, Tarter CJ, Hoy WK. Measuring organizational citizenship in schools: the OCB scale. Educat Leadership Reform. 2005;4:319–41.
  5. Muthén B, Asparouhov T. Latent variable analysis with categorical outcomes: multiple-group and growth modeling in Mplus. Mplus Web Notes. 2002;4:1–22.
  6. Muthén LK, Muthén BO. Mplus Version 7 user’s guide. Los Angeles, CA: Muthén & Muthén; 2006.
  7. National Center on Response to Intervention. Essential components of RTI: a closer look at response to intervention. Washington, DC: U.S. Department of Education, Office of Special Education Programs, National Center on Response to Intervention: National Center on Response to Intervention; 2010.

Cited by

See all 228

Metadata

Authors
Lyon, A. R., Cook, C. R., Brown, E. C., Locke, J., Davis, C., Ehrhart, M., & Aarons, G. A.
Affiliations
  • University of Washington (US)
  • University of Minnesota (US)
  • University of Miami (US)
  • University of Central Florida (US)
  • University of California San Diego (US)
Corresponding author
Lyon, Aaron R.
Venue
Implementation Science
Published
2018-01-08
Volume
13
Issue
1
Pages
5-5
ISSN
1748-5908 (ISSN-L)
OpenAlex
W2783384668
Cited by
199
References
79
Citations by year
2026: 11 · 2025: 25 · 2024: 33 · 2023: 30 · 2022: 33 · 2021: 27 · 2020: 13 · 2019: 21 · 2018: 5
FWCI
25.20
Type
journal article
Language
en
Open access
Licence
Locations
  • Implementation Science (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Journal of International Crisis and Risk Communication Research (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • eScholarship (California Digital Library) (submittedVersion)
  • eScholarship (California Digital Library) (submittedVersion, cc-by)
  • Open Scholarship Institutional Repository (Washington University in St. Louis) (submittedVersion, cc-by)
  • Grantee Submission
Funders
  • National Institute of Mental Health (K08MH095939, K01MH100199)
  • Institute of Education Sciences (R305A160114)
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › School Health and Nursing Education
  • Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
Keywords
implementation leadership, implementation climate, evidence-based practice, school-based mental health services, scale adaptation, psychometric validation, factor structure
MeSH terms
Adult, Child, Climate, Factor Analysis, Statistical, Female, Humans, Leadership, Male, Organizational Innovation, Reproducibility of Results, Organizational Culture, Evidence-Based Practice, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. https://app.cochat.ai/papers/10.1186/s13012-017-0705-6
The paper
Lyon, A. R., Cook, C. R., Brown, E. C., Locke, J., Davis, C., Ehrhart, M., & Aarons, G. A. (2018). Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implementation Science. https://doi.org/10.1186/s13012-017-0705-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.