Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; the references it cites are not checked yet; none of the 88 sources its claims cite is checked for support yet.

Measures of organizational culture, organizational climate, and implementation climate in behavioral health: A systematic review

Open access

Abstract

Background: Organizational culture, organizational climate, and implementation climate are key organizational constructs that influence the implementation of evidence-based practices. However, there has been little systematic investigation of the availability of psychometrically strong measures that can be used to assess these constructs in behavioral health. This systematic review identified and assessed the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs as defined by the Consolidated Framework for Implementation Research (CFIR) and Ehrhart and colleagues. Methods: Data collection involved search string generation, title and abstract screening, full-text review, construct assignment, and citation searches for all known empirical uses. Data relevant to nine psychometric criteria from the Psychometric and Pragmatic Evidence Rating Scale (PAPERS) were extracted: internal consistency, convergent validity, discriminant validity, known-groups validity, predictive validity, concurrent validity, structural validity, responsiveness, and norms. Extracted data for each criterion were rated on a scale from −1 (“poor”) to 4 (“excellent”), and each measure was assigned a total score (highest possible score = 36) that formed the basis for head-to-head comparisons of measures for each focal construct. Results: We identified full measures or relevant subscales of broader measures for organizational culture ( n = 21), organizational climate ( n = 36), implementation climate ( n = 2), tension for change ( n = 2), compatibility ( n = 6), relative priority ( n = 2), organizational incentives and rewards ( n = 3), goals and feedback ( n = 3), and learning climate ( n = 2). Psychometric evidence was most frequently available for internal consistency and norms. Information about other psychometric properties was less available. Median ratings for psychometric properties across categories of measures ranged from “poor” to “good.” There was limited evidence of responsiveness or predictive validity. Conclusion: While several promising measures were identified, the overall state of measurement related to these constructs is poor. To enhance understanding of how these constructs influence implementation research and practice, measures that are sensitive to change and predictive of key implementation and clinical outcomes are required. There is a need for further testing of the most promising measures, and ample opportunity to develop additional psychometrically strong measures of these important constructs. Plain Language Summary: Organizational culture, organizational climate, and implementation climate can play a critical role in facilitating or impeding the successful implementation and sustainment of evidence-based practices. Advancing our understanding of how these contextual factors independently or collectively influence implementation and clinical outcomes requires measures that are reliable and valid. Previous systematic reviews identified measures of organizational factors that influence implementation, but none focused explicitly on behavioral health; focused solely on organizational culture, organizational climate, and implementation climate; or assessed the evidence base of all known uses of a measure within a given area, such as behavioral health–focused implementation efforts. The purpose of this study was to identify and assess the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs that have been used in behavioral health-focused implementation research. We identified 21 measures of organizational culture, 36 measures of organizational climate, 2 measures of implementation climate, 2 measures of tension for change, 6 measures of compatibility, 2 measures of relative priority, 3 measures of organizational incentives and rewards, 3 measures of goals and feedback, and 2 measures of learning climate. Some promising measures were identified; however, the overall state of measurement across these constructs is poor. This review highlights specific areas for improvement and suggests the need to rigorously evaluate existing measures and develop new measures.

Overview

CoChat Summary

TL;DR

This systematic review identified and rated psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related CFIR subconstructs used in behavioral health implementation research. It found several promising measures but concluded that the overall state of measurement is poor, especially for responsiveness and predictive validity.

Key findings

  • The review identified full measures or relevant subscales for organizational culture (n = 21), organizational climate (n = 36), implementation climate (n = 2), tension for change (n = 2), compatibility (n = 6), relative priority (n = 2), organizational incentives and rewards (n = 3), goals and feedback (n = 3), and learning climate (n = 2).
  • Psychometric evidence was most frequently available for internal consistency and norms; evidence for other properties was less available. Median ratings across measure categories ranged from “poor” to “good,” and there was limited evidence of responsiveness or predictive validity.
  • Only seven measures received an overall score of 10 or higher out of a possible 36 on the PAPERS criteria. The highest-scoring measures included the Texas Christian University Program Training Needs Survey (total score = 13), Organizational Social Context–Climate (12), Organizational Social Context–Culture (11), and Implementation Climate Scale (11).
  • More than 75% of organizational culture and organizational climate measures were used more than once, whereas nearly half of implementation climate and related subconstruct measures were used only once.

Methods

  • Systematic review conducted in three phases: data collection (PubMed and Embase searches, title/abstract screening, full-text review, construct assignment, and measure-forward cited-by searches), data extraction, and data analysis. Original searches were completed 3 April 2017 to 25 May 2017; measure-forward searches were conducted in May 2019.
  • Included empirical studies containing one or more quantitative measures of the target constructs if used in an evaluation of an implementation effort in a behavioral health context. Measures and subscales were mapped to nine constructs based on the CFIR and Ehrhart and colleagues.
  • Data relevant to nine PAPERS psychometric criteria were extracted and rated from −1 (“poor”) to 4 (“excellent”); each measure received a total score (highest possible = 36). Ratings were summarized using a rolled-up median approach, and simple statistics and head-to-head comparisons were generated.

Limitations

  • The paper states that articles may have been missed because the authors did not explicitly search for molar organizational climate, did not search gray literature, completed original searches in 2017, and did not search all potentially relevant databases (e.g., PsycINFO, Google Scholar). One implementation climate measure by Jacobs et al. (2014) was not identified.
  • The paper states that measures developed outside behavioral health and evidence from uses outside behavioral health implementation efforts were not captured, so ratings should be interpreted within this context rather than as overall measure quality.
  • The paper states that construct assignment may have been imperfect due to overlap among constructs, and poor reporting practices may have limited available psychometric evidence. Evident from the text: several median ratings were based on only one measure (e.g., structural validity for organizational culture, discriminant validity for organizational climate), and only two implementation climate measures were identified, limiting conclusions for that construct.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1177/26334895211018862

Cites

Statistics

Nothing to recompute.

Figures

Figure 1. Head-to-head comparison of measures of organizational culture.
Figure 1. Head-to-head comparison of measures of organizational culture.CC BY-NC · PubMed Central
Figure 2. Head-to-head comparison of measures of organizational climate.
Figure 2. Head-to-head comparison of measures of organizational climate.CC BY-NC · PubMed Central
Figure 3. Head-to-head comparison of measures of implementation climate.
Figure 3. Head-to-head comparison of measures of implementation climate.CC BY-NC · PubMed Central
Figure 4. Head-to-head comparison of measures of tension for change.
Figure 4. Head-to-head comparison of measures of tension for change.CC BY-NC · PubMed Central
Figure 5. Head-to-head comparison of measures of compatibility.
Figure 5. Head-to-head comparison of measures of compatibility.CC BY-NC · PubMed Central
Figure 6. Head-to-head comparison of measures of relative priority.
Figure 6. Head-to-head comparison of measures of relative priority.CC BY-NC · PubMed Central
Figure 7. Head-to-head comparison of measures of organizational incentives and rewards.
Figure 7. Head-to-head comparison of measures of organizational incentives and rewards.CC BY-NC · PubMed Central
Figure 8. Head-to-head comparison of measures of goals and feedback.
Figure 8. Head-to-head comparison of measures of goals and feedback.CC BY-NC · PubMed Central
Figure 9. Head-to-head comparison of measures of learning climate.
Figure 9. Head-to-head comparison of measures of learning climate.CC BY-NC · PubMed Central
Figure 10. PRISMA diagram for organizational culture. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.
Figure 10. PRISMA diagram for organizational culture. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.CC BY-NC · PubMed Central
Figure 11. PRISMA diagram for implementation climate. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.
Figure 11. PRISMA diagram for implementation climate. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.CC BY-NC · PubMed Central
Figure 12. PRISMA diagram for tension for change. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.
Figure 12. PRISMA diagram for tension for change. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.CC BY-NC · PubMed Central
Figure 13. PRISMA diagram for compatibility. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.
Figure 13. PRISMA diagram for compatibility. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.CC BY-NC · PubMed Central
Figure 14. PRISMA diagram for relative priority. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.
Figure 14. PRISMA diagram for relative priority. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.CC BY-NC · PubMed Central
Figure 15. PRISMA diagram for organizational incentives and rewards. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.
Figure 15. PRISMA diagram for organizational incentives and rewards. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.CC BY-NC · PubMed Central
Figure 16. PRISMA diagram for goals and feedback. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.
Figure 16. PRISMA diagram for goals and feedback. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.CC BY-NC · PubMed Central
Figure 17. PRISMA diagram for learning climate. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.
Figure 17. PRISMA diagram for learning climate. Note that the number of articles identified did not equal the number of measures included in the analysis because in some cases a single measure was identified in multiple articles, and in others, multiple measures were identified in a single article.CC BY-NC · PubMed Central

Verification

Claims the paper makes

0 Valid · 0 Not valid · 70 Not checked · 83 Own results and interpretations

74 more claims

Create a free account to see all 153 claims and to verify the 88 references still open.

See all claims — free account
  • It may state two separate claims as one. 40
  • The quote only partly states this claim. 2
  • Probably not a substantial claim. 36

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

The citation lists are queued

They are fetched later and appear here then.

References 80 · Cited by 79

Research works printed but not linked: 3

  1. Damschroder L. J., 2009, Implementation Science, 4
  2. Higgins J. P. T., Thomas J., Chandler J., Cumpston M., Li T., Page M. J., Welch V. (2021). Cochrane handbook for systematic reviews of interventions. https://training.cochrane.org/handbook/current/chapter-04
  3. Parry K. W., 2001, International Journal of Organisational Behaviour, 4, 111

Metadata

Authors
Powell, B. J., Mettert, K. D., Dorsey, C. N., Weiner, B. J., Stanick, C. F., Lengnick-Hall, R., Ehrhart, M. G., Aarons, G. A., Barwick, M. A., Damschroder, L. J., & Lewis, C. C.
Affiliations
  • Washington University in St. Louis (US)
  • Kaiser Permanente Washington Health Research Institute (US)
  • University of Washington (US)
  • Hathaway-Sycamores Child and Family Services, Pasadena, CA, USA
  • Brown School and School of Medicine, Washington University in St. Louis, St. Louis, MO, USA
  • University of Central Florida (US)
  • University of California San Diego (US)
  • Hospital for Sick Children (CA)
  • VA Center for Clinical Management Research (US)
Corresponding author
  • Powell, Byron J
  • Lewis, Cara C
Venue
Implementation Research and Practice
Published
2021-01
Volume
2
Pages
26334895211018862-26334895211018862
ISSN
2633-4895 (ISSN-L)
OpenAlex
W3177399763
Cited by
79
References
80
Citations by year
2026: 10 · 2025: 26 · 2024: 16 · 2023: 14 · 2022: 12 · 2021: 1
FWCI
2.22
Type
journal article
Language
en
Open access
Locations
  • Implementation Research and Practice (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • eScholarship (California Digital Library) (submittedVersion, cc-by-nc)
Funders
National Institute of Mental Health (K01MH113806 (Powell, PI), R01MH106510 (Lewis, PI))
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
  • Health Sciences › Nursing › Research and Theory › Health Education and Validation
Keywords
organizational culture, organizational climate, implementation climate, behavioral health, psychometric properties, measurement instruments, evidence-based practice implementation, Consolidated Framework for Implementation Research, scale reliability and validity, predictive validity, convergent and discriminant validity, known-groups validity, internal consistency, behavioral health organizations

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Measures of organizational culture, organizational climate, and implementation climate in behavioral health: A systematic review. https://app.cochat.ai/papers/10.1177/26334895211018862
The paper
Powell, B. J., Mettert, K. D., Dorsey, C. N., Weiner, B. J., Stanick, C. F., Lengnick-Hall, R., Ehrhart, M. G., Aarons, G. A., Barwick, M. A., Damschroder, L. J., & Lewis, C. C. (2021). Measures of organizational culture, organizational climate, and implementation climate in behavioral health: A systematic review. Implementation Research and Practice. https://doi.org/10.1177/26334895211018862

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.