The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Organizational readiness for implementing change: a psychometric assessment of a new measure
Open accessAbstract
BACKGROUND: Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner's theory of organizational readiness for change. METHODS: We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure's factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three. RESULTS: Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis. CONCLUSIONS: This article provides evidence in support of the ORIC measure. We believe this measure will enable testing of theories about determinants and consequences of organizational readiness and, ultimately, assist healthcare leaders to reduce the number of health organization change efforts that do not achieve desired benefits. Although ORIC shows promise, further assessment is needed to test for convergent, discriminant, and predictive validity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 80,032
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
A First Course in Factor Analysis
Comrey, A. L., & Lee, H. B. (2013) · doi:10.4324/9781315827506 · Cited by 4,546
Answers to 20 questions about interrater reliability and interrater agreement
LeBreton, J. M., & Senter, J. L. (2008) · Organizational Research Methods · doi:10.1177/1094428106296642 · Cited by 3,608 · cited 4×
“33, which is much lower t Therefore, the conclusion is that based on the mean rWG(J) we reject the null hypoth both change commitment and change efficacy [15,27].”
BackgroundMethodInfluential(2000) · Cited by 3,573
Construction and Initial Validation of a Multidimensional Measure of Work–Family Conflict
Carlson, D. S., Kacmar, K. M., & Williams, L. J. (2000) · Journal of Vocational Behavior · doi:10.1006/jvbe.1999.1713 · Cited by 2,437
A theory of organizational readiness for change
Weiner, B. J. (2009) · Implementation Science · doi:10.1186/1748-5908-4-67 · Cited by 2,268
Self-citationCommitment to organizational change: Extension of a three-component model.
Herscovitch, L., & Meyer, J. P. (2002) · Journal of Applied Psychology · doi:10.1037//0021-9010.87.3.474 · Cited by 1,626
Levels issues in theory development, data collection and analysis
Klein, K. J., Dansereau, F., & Hall, R. J. (1994) · The Academy of Management Review · doi:10.2307/258703 · Cited by 1,607 · cited 1×
“Although it is tempting to simply compute an organization-level mean from the individual-level data, it is important to first check the reliability and validity of that mean to determine whether it is an adequate representation of the organization-level construct [19,20].”
BackgroundFrom Micro to Meso: Critical Steps in Conceptualizing and Conducting Multilevel Research
Klein, K. J., & Kozlowski, S. W. J. (2000) · Organizational Research Methods · doi:10.1177/109442810033001 · Cited by 1,471
Readiness for Organizational Change: The Systematic Development of a Scale
Holt, D. T., Armenakis, A. A., Feild, H. S., & Harris, S. G. (2007) · The Journal of Applied Behavioral Science · doi:10.1177/0021886306295295 · Cited by 1,243
Assessing organizational readiness for change
Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(02)00233-7 · Cited by 863 · cited 1×
“Convergent validity could be assessed by comparing ORIC to other reliable, valid, but much longer measures, such as the Organizational Readiness for Change Assessment [5] or the Texas Christian University (TCU) Organizational Readiness for Change instrument [28].”
MethodStatistical power analysis: a simple and general model for traditional and modern hypothesis tests
(1998) · Choice Reviews Online · doi:10.5860/choice.36-1020 · Cited by 792
Weiner, B. J., Amick, H., & Lee, S.-Y. D. (2008) · Medical Care Research and Review · doi:10.1177/1077558708317802 · Cited by 786
Self-citationA First Course in Factor Analysis.
Gudgeon, A. C., Comrey, A. L., & Lee, H. B. (1994) · The Statistician · doi:10.2307/2348352 · Cited by 621
Helfrich, C. D., Li, Y.-F., Sharp, N. D., & Sales, A. E. (2009) · Implementation Science · doi:10.1186/1748-5908-4-38 · Cited by 564
Schriesheim, C. A., Powers, K. J., Scandura, T. A., Gardiner, C. C., & Lankau, M. J. (1993) · Journal of Management · doi:10.1016/0149-2063(93)90058-u · Cited by 555
Estimating Interrater Agreement with the Average Deviation Index: A User’s Guide
Burke, M. J., & Dunlap, W. P. (2002) · Organizational Research Methods · doi:10.1177/1094428102005002002 · Cited by 447
Weiner, B. J., Lewis, M. A., & Linnan, L. A. (2008) · Health Education Research · doi:10.1093/her/cyn019 · Cited by 404 · cited 2×
“The second facet of readiness, change efficacy, reflects organizational members’ shared belief in their collective capability to implement a change [3,8].”
BackgroundSelf-citationAn Analysis of Variance Approach to Content Validation
Hinkin, T. R., & Tracey, J. B. (1999) · Organizational Research Methods · doi:10.1177/109442819922004 · Cited by 403
Campbell, M. K., Fayers, P. M., & Grimshaw, J. M. (2005) · Clinical Trials · doi:10.1191/1740774505cn071oa · Cited by 275
Group size and measures of group-level properties: An examination of eta-squared and ICC values
Bliese, P. (1998) · Journal of Management · doi:10.1016/s0149-2063(99)80058-0 · Cited by 241
Direct and contextual effects of individual values on organizational citizenship behavior in teams.
Arthaud-Day, M. L., Rode, J. C., & Turnley, W. H. (2012) · Journal of Applied Psychology · doi:10.1037/a0027352 · Cited by 96
Testing Agreement for Multi-Item Scales With the Indices r WG(J) and AD M(J)
Cohen, A., Doveh, E., & Nahum-Shani, I. B. (2007) · Organizational Research Methods · doi:10.1177/1094428107300365 · Cited by 80
Methods and metrics challenges of delivery-system research
Alexander, J. A., & Hearld, L. R. (2012) · Implementation Science · doi:10.1186/1748-5908-7-15 · Cited by 78
Examining retaliatory responses to justice violations and recovery attempts in teams.
Christian, J. S., Christian, M. S., Garza, A. S., & Ellis, A. P. J. (2012) · Journal of Applied Psychology · doi:10.1037/a0029450 · Cited by 43
Research works printed but not linked: 4
- Kotter JP: Leading change. 1996, Boston: Harvard Business Press
- Nunnally JC: McGraw-Hill series in psychology. Psychometric theory. 1978, New York: McGraw-Hill, xv, 701 p, 2nd
- Bliese PD: Mulilevel modeling in R (2.4): A brief introduction to R, the multilevel package and the nlme package. 2012, Washington DC: Walter Reed Army Institute of Research
- Lehman WE, Greener JM, Simpson DD: Assessing organizational readiness for change. J Subst Abuse Treat. 2002, 22 (4): 197-209. 10.1016/S0740-5472(02)00233-7. 30 · DOI · Paper page
Cited by
Psychometric assessment of three newly developed implementation outcome measures
Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., Boynton, M. H., & Halko, H. (2017) · Implementation Science · doi:10.1186/s13012-017-0635-3 · Cited by 2,819
Self-citationEhrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014) · Implementation Science · doi:10.1186/s13012-014-0157-1 · Cited by 502
Geerligs, L., Rankin, N. M., Shepherd, H. L., & Butow, P. (2018) · Implementation Science · doi:10.1186/s13012-018-0726-9 · Cited by 480
Clarity out of chaos: Use of theory in implementation research
Damschroder, L. J. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.036 · Cited by 422
A PRACTICAL IMPLEMENTATION SCIENCE HEURISTIC FOR ORGANIZATIONAL READINESS: R = MC2
Scaccia, J. P., Cook, B. S., Lamont, A., Wandersman, A., Castellow, J., Katz, J., & Beidas, R. S. (2015) · Journal of Community Psychology · doi:10.1002/jcop.21698 · Cited by 375
Metadata
- Authors
- Shea, C. M., Jacobs, S. R., Esserman, D. A., Bruce, K., & Weiner, B. J.
- Venue
- Implementation Science
- Published
- 2014-01-10
- Volume
- 9
- Issue
- 1
- Pages
- 7-7
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W2104215943
- Cited by
- 856
- References
- 28
- FWCI
- 35.42
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.