The meaning and measurement of implementation climate

Weiner, Bryan J; Belden, Charles M; Bergmire, Dawn M; Johnston, Matthew

doi:10.1186/1748-5908-6-78

Cited by 261Health Policy Implementation ScienceOrganizational Change and LeadershipHealth Sciences Research and Education

The meaning and measurement of implementation climate

Open access

Weiner, Bryan J, Belden, Charles M, Bergmire, Dawn M, Johnston, Matthew·2011·Implementation Science

DOI 10.1186/1748-5908-6-78PMC PMC3224582

Open this paper in CoChat — free account Open PDF

Abstract

BACKGROUND: Climate has a long history in organizational studies, but few theoretical models integrate the complex effects of climate during innovation implementation. In 1996, a theoretical model was proposed that organizations could develop a positive climate for implementation by making use of various policies and practices that promote organizational members' means, motives, and opportunities for innovation use. The model proposes that implementation climate--or the extent to which organizational members perceive that innovation use is expected, supported, and rewarded--is positively associated with implementation effectiveness. The implementation climate construct holds significant promise for advancing scientific knowledge about the organizational determinants of innovation implementation. However, the construct has not received sufficient scholarly attention, despite numerous citations in the scientific literature. In this article, we clarify the meaning of implementation climate, discuss several measurement issues, and propose guidelines for empirical study. DISCUSSION: Implementation climate differs from constructs such as organizational climate, culture, or context in two important respects: first, it has a strategic focus (implementation), and second, it is innovation-specific. Measuring implementation climate is challenging because the construct operates at the organizational level, but requires the collection of multi-dimensional perceptual data from many expected innovation users within an organization. In order to avoid problems with construct validity, assessments of within-group agreement of implementation climate measures must be carefully considered. Implementation climate implies a high degree of within-group agreement in climate perceptions. However, researchers might find it useful to distinguish implementation climate level (the average of implementation climate perceptions) from implementation climate strength (the variability of implementation climate perceptions). It is important to recognize that the implementation climate construct applies most readily to innovations that require collective, coordinated behavior change by many organizational members both for successful implementation and for realization of anticipated benefits. For innovations that do not possess these attributes, individual-level theories of behavior change could be more useful in explaining implementation effectiveness. SUMMARY: This construct has considerable value in implementation science, however, further debate and development is necessary to refine and distinguish the construct for empirical use.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1186/1748-5908-6-78

Cites

93 of 93 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Equifinality is common in complex systems governing implementation.
“Indeed, there is a recognition that equifinality [82] is common in complex systems governing implementation.”
From “Scaling-out” evidence-based interventions to new populations or new health care delivery systems (2017) · cites this paper as [82]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
Research in Organizational Behavior
Hammer, E. R., Cummings, L. L., & Staw, B. M. (1984) · Academy of Management Review · doi:10.2307/258300 · Cited by 11,176 · see citing works
ASSESSING THE WORK ENVIRONMENT FOR CREATIVITY.
AMABILE, T. M., CONTI, R., COON, H., LAZENBY, J., & HERRON, M. (1996) · Academy of Management Journal · doi:10.2307/256995 · Cited by 6,029 · see citing works
Estimating within-group interrater reliability with and without response bias
James, L. R., Demaree, R. G., & Wolf, G. (1984) · Journal of Applied Psychology · doi:10.1037/0021-9010.69.1.85 · Cited by 4,774 · see citing works
Toward a cognitive social learning reconceptualization of personality
Mischel, W. (1973) · Psychological Review · doi:10.1037/h0035002 · Cited by 3,181 · see citing works
Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models.
Chan, D. K. (1998) · Journal of Applied Psychology · doi:10.1037/0021-9010.83.2.234 · Cited by 2,981 · see citing works
Safety climate in industrial organizations: Theoretical and applied implications.
Zohar, D. M. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.1.96 · Cited by 2,687 · see citing works
Aggregation bias in estimates of perceptual agreement.
James, L. R. (1982) · Journal of Applied Psychology · doi:10.1037/0021-9010.67.2.219 · Cited by 2,139 · see citing works
The Challenge of Innovation Implementation
Klein, K. J., & Sorra, J. S. (1996) · The Academy of Management Review · doi:10.2307/259164 · Cited by 2,113 · see citing works
Organizational Climate and Culture
Ehrhart, M. G. (2016) · The SAGE Encyclopedia of Theory in Psychology · doi:10.4135/9781483346274.n219 · Cited by 2,055 · see citing works
Linking service climate and customer perceptions of service quality: Tests of a causal model.
Schneider, B. N., White, S. S., & Paul, M. C. (1998) · Journal of Applied Psychology · doi:10.1037/0021-9010.83.2.150 · Cited by 1,720 · see citing works
Levels issues in theory development, data collection and analysis
Klein, K. J., Dansereau, F., & Hall, R. J. (1994) · The Academy of Management Review · doi:10.2307/258703 · Cited by 1,607 · see citing works
A group-level model of safety climate: Testing the effect of group climate on microaccidents in manufacturing jobs.
Zohar, D. M. (2000) · Journal of Applied Psychology · doi:10.1037/0021-9010.85.4.587 · Cited by 1,506 · see citing works
From Micro to Meso: Critical Steps in Conceptualizing and Conducting Multilevel Research
Klein, K. J., & Kozlowski, S. W. J. (2000) · Organizational Research Methods · doi:10.1177/109442810033001 · Cited by 1,473 · see citing works
Motivation and Organizational Climate
Smith, O. W., Smith, P. C., Litwin, G. H., & Stringer, R. A. (1969) · The American Journal of Psychology · doi:10.2307/1420456 · Cited by 1,372 · see citing works
Employee and customer perceptions of service in banks: Replication and extension.
Schneider, B., & Bowen, D. E. (1985) · Journal of Applied Psychology · doi:10.1037/0021-9010.70.3.423 · Cited by 1,344 · see citing works
Conceptualizing and Measuring Organizational and Psychological Climate: Pitfalls in Multilevel Research
Glick, W. H. (1985) · The Academy of Management Review · doi:10.5465/amr.1985.4279045 · Cited by 1,286 · see citing works
Validating the organizational climate measure: links to managerial practices, productivity and innovation
Patterson, M. G., West, M. A., Shackleton, V. J., Dawson, J., Lawthom, R., Maitlis, S., Robinson, D. L., & Wallace, A. M. R. (2005) · Journal of Organizational Behavior · doi:10.1002/job.312 · Cited by 1,262 · see citing works
ON THE ETIOLOGY OF CLIMATES
Schneider, B., & Reichers, A. E. (1983) · Personnel Psychology · doi:10.1111/j.1744-6570.1983.tb00500.x · Cited by 1,195 · see citing works
Thirty years of safety climate research: Reflections and future directions
Zohar, D. M. (2010) · Accident Analysis & Prevention · doi:10.1016/j.aap.2009.12.019 · Cited by 1,120 · see citing works
Organizational climate: A review of theory and research.
James, L. R., & Jones, A. P. (1974) · Psychological Bulletin · doi:10.1037/h0037511 · Cited by 1,099 · see citing works
ORGANIZATIONAL CLIMATES: AN ESSAY 1
Schneider, B. (1975) · Personnel Psychology · doi:10.1111/j.1744-6570.1975.tb01386.x · Cited by 1,030 · see citing works
Psychological climate: Dimensions and relationships of individual and aggregated work environment perceptions
Jones, A. P., & James, L. R. (1979) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(79)90056-4 · Cited by 824 · see citing works
The effects of leadership dimensions, safety climate, and assigned priorities on minor injuries in work groups
Zohar, D. M. (2002) · Journal of Organizational Behavior · doi:10.1002/job.130 · Cited by 819 · see citing works
Climate strength: a new direction for climate research.
Schneider, B., Salvaggio, A. N., & Ferrer, M. S. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.2.220 · Cited by 775 · see citing works
Climate for Creativity: A Quantitative Review
Hunter, S. T., Bedell, K. E., & Mumford, M. D. (2007) · Creativity Research Journal · doi:10.1080/10400410709336883 · Cited by 709 · see citing works
JUSTICE IN TEAMS: ANTECEDENTS AND CONSEQUENCES OF PROCEDURAL JUSTICE CLIMATE
Colquitt, J. A., Noe, R. A., & JACKSON, C. L. (2002) · Personnel Psychology · doi:10.1111/j.1744-6570.2002.tb00104.x · Cited by 703 · see citing works
A CASE FOR PROCEDURAL JUSTICE CLIMATE: DEVELOPMENT AND TEST OF A MULTILEVEL MODEL.
Naumann, S. E., & Bennett, N. J. (2000) · Academy of Management Journal · doi:10.2307/1556416 · Cited by 642 · see citing works
Employee and Customer Perceptions of Service in Banks
Schneider, B., Parkington, J. J., & Buxton, V. M. (1980) · Administrative Science Quarterly · doi:10.2307/2392454 · Cited by 640 · see citing works
Implementing computerized technology: An organizational analysis.
Klein, K. J., Conn, A. B., & Sorra, J. S. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.5.811 · Cited by 615 · see citing works
Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice
Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0148-5 · Cited by 608 · see citing works
Integration of climate and leadership: Examination of a neglected issue.
Kozlowski, S. W. J., & Doherty, M. L. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.4.546 · Cited by 586 · see citing works
Climate as a Social-Cognitive Construction of Supervisory Safety Practices: Scripts as Proxy of Behavior Patterns.
Zohar, D. M., & Luria, G. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.2.322 · Cited by 540 · see citing works
Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment.
Klein, K. J., Conn, A. B., Smith, D. B., & Sorra, J. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.1.3 · Cited by 511 · see citing works
Diffusion of Innovations in Health Service Organisations: A Systematic Literature Review
Greenhalgh, T., Robert, G., Bate, P., Macfarlane, F., & Kyriakidou, O. (2007) · Cited by 453 · see citing works
Implementation of Evidence-based Practice in Child Welfare: Service Provider Perspectives
Aarons, G. A., & Palinkas, L. A. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0121-3 · Cited by 450 · see citing works
Organizational Climate: Measures, Research and Contingencies.
Hellriegel, D., & Slocum, J. W. (1974) · Academy of Management Journal · doi:10.2307/254979 · Cited by 447 · see citing works
Diffusion of Innovations in Health Service Organisations: A Systematic Literature Review
(2005) · doi:10.1002/9780470987407 · Cited by 439 · see citing works
Organizational Climate and Culture
Ehrhart, M. G., Schneider, B., & Macey, W. H. (2013) · Routledge eBooks · doi:10.4324/9781315857664 · Cited by 415 · see citing works
An examination of the antecedents and moderator influences of climate strength.
González‐Romá, V., Silla, J. M. P., & Tordera, N. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.3.465 · Cited by 394 · see citing works
Self-efficacy partially mediates the effect of a school-based physical-activity intervention among adolescent girls
Dishman, R. (2004) · Preventive Medicine · doi:10.1016/j.ypmed.2003.12.007 · Cited by 373 · see citing works
Determinants of Implementation Effectiveness
Helfrich, C. D., Weiner, B. J., McKinney, M. M., & Minasian, L. M. (2007) · Medical Care Research and Review · doi:10.1177/1077558707299887 · Cited by 311 · see citing works
Self-citation
Interrater Agreement Reconsidered: An Alternative to the rwg Indices
Brown, R. D., & Hauenstein, N. M. A. (2005) · Organizational Research Methods · doi:10.1177/1094428105275376 · Cited by 299 · see citing works
Measuring Provider Attitudes Toward Evidence-Based Practice: Consideration of Organizational Context and Individual Differences
Aarons, G. A. (2005) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2004.04.008 · Cited by 296 · see citing works
Self-care self-efficacy, quality of life, and depression after stroke
Robinson-Smith, G., Johnston, M. V., & Allen, J. (2000) · Archives of Physical Medicine and Rehabilitation · doi:10.1053/mr.2000.3863 · Cited by 293 · see citing works
Self-citation
Sharing knowledge through intranets: a study of organizational culture and intranet implementation
Ruppel, C. P., & Harrington, S. J. (2001) · IEEE Transactions on Professional Communication · doi:10.1109/47.911131 · Cited by 287 · see citing works
A Review of Instruments Assessing Creative and Innovative Environments Within Organizations
Mathisen, G. E., & Einarsen, S. V. (2004) · Creativity Research Journal · doi:10.1207/s15326934crj1601_12 · Cited by 285 · see citing works
A note on organizational climate
Guion, R. M. (1973) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(73)90041-x · Cited by 283 · see citing works
The Creative Climate: Its Determinants and Effects at a Swedish University
Ekvall, G., & Ryhammar, L. (1999) · Creativity Research Journal · doi:10.1207/s15326934crj1204_8 · Cited by 267 · see citing works
Development and validation of a scale measuring self‐efficacy of current and former smokers
Etter, J., Bergman, M. M., Humair, J., & Perneger, T. (2000) · Addiction · doi:10.1046/j.1360-0443.2000.9569017.x · Cited by 260 · see citing works
Group Size and Measures of Group-Level Properties: An Examination of Eta-Squared and ICC Values
Bliese, P. D., & Halverson, R. R. (1998) · Journal of Management · doi:10.1177/014920639802400202 · Cited by 241 · see citing works
Composing Group-Level Constructs From Individual-Level Survey Data
van Mierlo, H., Vermunt, J. K., & Rutte, C. G. (2008) · Organizational Research Methods · doi:10.1177/1094428107309322 · Cited by 240 · see citing works
Therapist Turnover and New Program Sustainability in Mental Health Clinics as a Function of Organizational Culture, Climate, and Service Structure
Glisson, C. A., Schoenwald, S. K., Kelleher, K. J., Landsverk, J. A., Hoagwood, K., Mayberg, S. W., & Green, P. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0152-9 · Cited by 232 · see citing works
THE PRECURSORS AND PRODUCTS OF JUSTICE CLIMATES: GROUP LEADER ANTECEDENTS AND EMPLOYEE ATTITUDINAL CONSEQUENCES
Mayer, D. M., Nishii, L. H., Schneider, B. N., & Goldstein, H. W. (2007) · Personnel Psychology · doi:10.1111/j.1744-6570.2007.00096.x · Cited by 231 · see citing works
Team climate, climate strength and team performance. A longitudinal study
González‐Romá, V., Fortes‐Ferreira, L., & Silla, J. M. P. (2008) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317908x370025 · Cited by 211 · see citing works
Healthcare climate: A framework for measuring and improving patient safety*
Zohar, D. M., Livne, Y., Tenne-Gazit, O., Admi, H., & Donchin, Y. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000262404.10203.c9 · Cited by 200 · see citing works
The Confidence in Diabetes Self-Care Scale
van der Ven, N. C. W., Weinger, K., Yi, J., Pouwer, F., Adèr, H., van der Ploeg, H. M., & Snoek, F. J. (2003) · Diabetes Care · doi:10.2337/diacare.26.3.713 · Cited by 180 · see citing works
Statistical properties of the rWG(J) index of agreement.
Cohen, A., Doveh, E., & Eick, U. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.3.297 · Cited by 167 · see citing works
Situational Outlook Questionnaire: A Measure of the Climate for Creativity and Change
Isaksen, S. G., Lauer, K. J., & Ekvall, G. (1999) · Psychological Reports · doi:10.2466/pr0.1999.85.2.665 · Cited by 157 · see citing works
Climate strength – How leaders form consensus
Luria, G. (2008) · The Leadership Quarterly · doi:10.1016/j.leaqua.2007.12.004 · Cited by 137 · see citing works
Organizational Climate and Culture
Goethals, G. R., J.Sorenson, G., & Burns, J. M. (2004) · Encyclopedia of Leadership · doi:10.4135/9781412952392.n260 · Cited by 137 · see citing works
Evidence-based practice implementation and staff emotional exhaustion in children's services
Aarons, G. A., Fettes, D. L., Flores, L. E., & Sommerfeld, D. H. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.006 · Cited by 121 · see citing works
Salesforce automation systems: an exploratory examination of organizational factors associated with effective implementation and salesforce productivity
Pullig, C., Maxham, J. G., & Hair, J. F. (2002) · Journal of Business Research · doi:10.1016/s0148-2963(00)00159-4 · Cited by 119 · see citing works
Meta-analysis of the effects of psychoeducational care in adults with asthma
Devine, E. C. (1996) · Research in Nursing & Health · doi:10.1002/(sici)1098-240x(199610)19:5 · Cited by 118 · see citing works
Recent Issues Regarding rWG, rWG, rWG(J), and rWG(J)
LeBreton, J. M., James, L. R., & Lindell, M. K. (2004) · Organizational Research Methods · doi:10.1177/1094428104272181 · Cited by 118 · see citing works
Factorial Invariance and Latent Mean Structure of Questionnaires Measuring Social-Cognitive Determinants of Physical Activity among Black and White Adolescent Girls
Dishman, R. K., Motl, R. W., Saunders, R. P., Dowda, M. C., Felton, G., Ward, D. S., & Pate, R. R. (2002) · Preventive Medicine · doi:10.1006/pmed.2001.0959 · Cited by 112 · see citing works
Psychological climate: A comparison of organizational and individual level referents
Baltes, B. B., Zhdanova, L. S., & Parker, C. P. (2009) · Human Relations · doi:10.1177/0018726709103454 · Cited by 106 · see citing works
Response: Organizations Are Not Central Tendencies: Shadowboxing in the Dark, Round 2
Glick, W. H. (1988) · Academy of Management Review · doi:10.5465/amr.1988.4306813 · Cited by 102 · see citing works
Implementing computer technology: a multiorganizational test of Klein and Sorra’s model
Holahan, P. J., Aronson, Z. H., Jurkat, M. P., & Schoorman, F. D. (2004) · Journal of Engineering and Technology Management · doi:10.1016/j.jengtecman.2003.12.003 · Cited by 100 · see citing works
How Do Missing Data Bias Estimates of Within-Group Agreement? Sensitivity of SD WG, CVWG, rWG(J), rWG(J) * , and ICC to Systematic Nonresponse
Newman, D., & Sin, H.-P. (2009) · Organizational Research Methods · doi:10.1177/1094428106298969 · Cited by 94 · see citing works
Translating research into evidence‐based practice
Minasian, L. M., Carpenter, W. R., Weiner, B. J., Anderson, D. E., McCaskill‐Stevens, W., Nelson, S. A., Whitman, C. G., Kelaghan, J. W., O’Mara, A. M., & Kaluzny, A. D. (2010) · Cancer · doi:10.1002/cncr.25248 · Cited by 86 · see citing works
Self-citation
Dissemination of effective mental health treatment procedures: Maximizing the return on a significant investment
Chorpita, B. F., & Regan, J. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.002 · Cited by 75 · cited 1× · see citing works
“Although innovation-values fit seems to have garnered more attention, especially among mental health and substance abuse researchers [2-9], implementation climate is arguably the more important construct, both in terms of its role in Klein and Sorra’s [1] theory and for its potential to bring theoretical and empirical…”
Background
Exploring managerial factors affecting ERP implementation: an investigation of the Klein‐Sorra model using regression splines
Osei-Bryson, K.-M., Dong, L., & Ngwenyama, O. K. (2008) · Information Systems Journal · doi:10.1111/j.1365-2575.2008.00309.x · Cited by 69 · see citing works
Testing Agreement for Multi-Item Scales With the Indices r WG(J) and AD M(J)
Cohen, A., Doveh, E., & Nahum-Shani, I. B. (2007) · Organizational Research Methods · doi:10.1177/1094428107300365 · Cited by 69 · see citing works
Hypothesized Interdependence, Assumed Independence
Glick, W. H., & Roberts, K. H. (1984) · Academy of Management Review · doi:10.5465/amr.1984.4277611 · Cited by 69 · see citing works
Procedural Justice Climate in New Product Development Teams: Antecedents and Consequences
Akgün, A. E., Keski̇n, H., & Byrne, J. C. (2010) · Journal of Product Innovation Management · doi:10.1111/j.1540-5885.2010.00773.x · Cited by 66 · see citing works
The Adoption of Wraparound Services among Substance Abuse Treatment Organizations Serving Criminal Offenders: The Role of a Women-Specific Program
Oser, C., Knudsen, H. K., Staton‐Tindall, M., & Leukefeld, C. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.12.008 · Cited by 62 · see citing works
Testing Klein and Sorra’s innovation implementation model: An empirical examination
Dong, L., Neufeld, D. J., & Higgins, C. D. (2008) · Journal of Engineering and Technology Management · doi:10.1016/j.jengtecman.2008.10.006 · Cited by 60 · see citing works
Multi-level influences on the practice of inter-agency collaboration in child welfare and substance abuse treatment
Smith, B. D., & Mogro‐Wilson, C. (2007) · Children and Youth Services Review · doi:10.1016/j.childyouth.2006.06.002 · Cited by 59 · see citing works
Quality and strength of patient safety climate on medical-surgical units
Hughes, L., Chang, Y., & Mark, B. A. (2009) · Health Care Management Review · doi:10.1097/01.hmr.0000342976.07179.3a · Cited by 58 · see citing works
Avoiding the “Fallacy of the Wrong Level”
Dansereau, F., Cho, J., & Yammarino, F. J. (2006) · Group & Organization Management · doi:10.1177/1059601106291131 · Cited by 55 · see citing works
SITUATIONAL OUTLOOK QUESTIONNAIRE: A MEASURE OF THE CLIMATE FOR CREATIVITY AND CHANGE
Isaksen, S. G. (1999) · Psychological Reports · doi:10.2466/pr0.85.6.665-674 · Cited by 45 · see citing works
Promoting systems change in the health care response to domestic violence
Allen, N. E., Lehrner, A. L., Mattison, E., Miles, T., & Russell, A. (2006) · Journal of Community Psychology · doi:10.1002/jcop.20137 · Cited by 44 · see citing works
Implementation Science
(2020) · Springer eBooks · doi:10.1007/978-3-030-39903-0_300951 · Cited by 44 · see citing works
Inter-Agency Collaboration
Smith, B. D., & Mogro‐Wilson, C. (2008) · Administration in Social Work · doi:10.1300/j147v32n02_02 · Cited by 41 · see citing works
Organizational-level correlates of the provision of detoxification services and medication-based treatments for substance abuse in correctional institutions
Oser, C. B., Knudsen, H. K., Staton, M., Taxman, F. S., & Leukefeld, C. G. (2008) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.11.005 · Cited by 38 · see citing works
Statistical properties of the r-sub(WG(J) ) index of agreement.
Cohen, A., Doveh, E., & Eick, U. (2001) · Psychological Methods · doi:10.1037//1082-989x.6.3.297 · Cited by 32 · see citing works
An evaluation of the psychometric properties of the Smoking Self-Efficacy Questionnaire (SEQ-12) among Chinese cardiac patients who smoke
Leung, D. Y. P., Chan, S. S. C., Lau, C. B., Wong, V. C. W., & Lam, T. (2008) · Nicotine & Tobacco Research · doi:10.1080/14622200802238928 · Cited by 30 · see citing works
Feasibility of Promoting Smoking Cessation Among Methadone Users Using Multimedia Computer-Assisted Education
Finkelstein, J., Lapshin, O., & Cha, E. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1089 · Cited by 24 · see citing works
The Effects of Managed Care and Competition on Community-Based Clinical Research
Carpenter, W. R., Weiner, B. J., Kaluzny, A. D., Domino, M. E., & Lee, S.-Y. D. (2006) · Medical Care · doi:10.1097/01.mlr.0000220269.65196.72 · Cited by 20 · see citing works
Self-citation
MEDIATING EFFECT OF COOPERATIVE NORM IN PREDICTING ORGANIZATIONAL CITIZENSHIP BEHAVIORS FROM PROCEDURAL JUSTICE CLIMATE
Lin, S.-P., Tang, T.-W., Li, C., Wu, C.-M., & Lin, H.-H. (2007) · Psychological Reports · doi:10.2466/pr0.101.1.67-78 · Cited by 20 · see citing works
Adapting clinical trials networks to promote cancer prevention and control research
Weiner, B. J., McKinney, M. M., & Carpenter, W. R. (2005) · Cancer · doi:10.1002/cncr.21548 · Cited by 12 · see citing works
Self-citation
The Teesside Cancer Family History Service: change management and innovation at cancer network level
Brennan, P., Claber, O., & Shaw, T. (2007) · Familial Cancer · doi:10.1007/s10689-007-9125-0 · Cited by 8 · see citing works

Flagged first, then by citations

2 of the 95 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

Zohar D Safety climate in industrial organizations -- theoretical and applied implications Journal of Applied Psychology 1980 65 96 102 7364709
Dansereau F Cho J Yammarino FJ Avoiding the "Fallacy of the wrong level" - A within and between analysis (WABA) approach Group & Organization Management 2006 31 536 577 10.1177/105960110629113121786445 · DOI

Sorted by citations

Conceptualizing outcomes for use with the Consolidated Framework for Implementation Research (CFIR): the CFIR Outcomes Addendum
Damschroder, L. J., Reardon, C. M., Opra Widerquist, M. A., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-021-01181-5 · Cited by 784 · see citing works
Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS)
Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014) · Implementation Science · doi:10.1186/s13012-014-0157-1 · Cited by 502 · see citing works
Ten recommendations for using implementation frameworks in research and practice
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Albers, B., Nilsen, P., Broder-Fingert, S., Mukasa, B., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00023-7 · Cited by 488 · see citing works
“Scaling-out” evidence-based interventions to new populations or new health care delivery systems
Aarons, G. A., Sklar, M., Mustanski, B., Benbow, N., & Brown, C. H. (2017) · Implementation Science · doi:10.1186/s13012-017-0640-6 · Cited by 399 · see citing works
Improving the normalization of complex interventions: part 2 - validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT)
Finch, T. L., Girling, M., May, C. R., Mair, F. S., Murray, E., Treweek, S., McColl, E., Steen, I. N., Cook, C., Vernazza, C. R., et al. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0591-x · Cited by 337 · see citing works
A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions
Powell, B. J., Proctor, E. K., & Glass, J. E. (2014) · Research on Social Work Practice · doi:10.1177/1049731513505778 · Cited by 268 · see citing works
Planning for Implementation Success Using RE-AIM and CFIR Frameworks: A Qualitative Study
King, D. K., Shoup, J. A., Raebel, M. A., Anderson, C. B., Wagner, N. M., Ritzwoller, D. P., & Bender, B. G. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.00059 · Cited by 257 · see citing works
Developing measures to assess constructs from the Inner Setting domain of the Consolidated Framework for Implementation Research
Fernández, M. E., Walker, T. J., Weiner, B. J., Calo, W. A., Liang, S., Risendal, B., Friedman, D. B., Tu, S. P., Williams, R. S., Jacobs, S., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0736-7 · Cited by 255 · see citing works
Self-citation
Annual Research Review: The state of implementation science in child psychology and psychiatry: a review and suggestions to advance the field
Williams, N. J., & Beidas, R. S. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12960 · Cited by 233 · see citing works
A Framework for Enhancing the Value of Research for Dissemination and Implementation
Neta, G., Glasgow, R. E., Carpenter, C. R., Grimshaw, J. M., Rabin, B. A., Fernandez, M. E., & Brownson, R. C. (2015) · American Journal of Public Health · doi:10.2105/ajph.2014.302206 · Cited by 205 · see citing works
Expert recommendations for implementing change (ERIC): protocol for a mixed methods study
Waltz, T. J., Powell, B. J., Chinman, M. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., Damschroder, L. J., & Kirchner, J. E. (2014) · Implementation Science · doi:10.1186/1748-5908-9-39 · Cited by 202 · see citing works
Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship
Lyon, A. R., Cook, C. R., Brown, E. C., Locke, J., Davis, C., Ehrhart, M., & Aarons, G. A. (2018) · Implementation Science · doi:10.1186/s13012-017-0705-6 · Cited by 199 · see citing works
Context matters: measuring implementation climate among individuals and groups
Jacobs, S., Weiner, B. J., & Bunger, A. C. (2014) · Implementation Science · doi:10.1186/1748-5908-9-46 · Cited by 189 · see citing works
Self-citation
Towards successful digital transformation through co-creation: a longitudinal study of a four-year implementation of digital monitoring technology in residential care for persons with dementia
Dugstad, J., Eide, T., Nilsen, E. R., & Eide, H. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4191-1 · Cited by 178 · see citing works
Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol
Aarons, G. A., Ehrhart, M. G., Moullin, J. C., Torres, E. M., & Green, A. E. (2017) · Implementation Science · doi:10.1186/s13012-017-0562-3 · Cited by 159 · see citing works
Testing a theory of strategic implementation leadership, implementation climate, and clinicians’ use of evidence-based practice: a 5-year panel analysis
Williams, N. J., Wolk, C. B., Becker‐Haimes, E. M., & Beidas, R. S. (2020) · Implementation Science · doi:10.1186/s13012-020-0970-7 · Cited by 151 · see citing works
Determining the predictors of innovation implementation in healthcare: a quantitative analysis of implementation effectiveness
Jacobs, S., Weiner, B. J., Reeve, B. B., Hofmann, D. A., Christian, M. S., & Weinberger, M. (2015) · BMC Health Services Research · doi:10.1186/s12913-014-0657-3 · Cited by 141 · see citing works
Self-citation
What supports physiotherapists’ use of research in clinical practice? A qualitative study in Sweden
Dannapfel, P., Peolsson, A. L. C., & Nilsén, P. (2013) · Implementation Science · doi:10.1186/1748-5908-8-31 · Cited by 119 · see citing works
User-centered design to improve clinical decision support in primary care
Brunner, J., Chuang, E., Goldzweig, C. L., Cain, C., Sugar, C. A., & Yano, E. M. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.05.004 · Cited by 117 · see citing works
Advancing the application, quality and harmonization of implementation science measures
Rabin, B. A., Purcell, P., Naveed, S., Moser, R. P., Henton, M. D., Proctor, E. K., Brownson, R. C., & Glasgow, R. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-119 · Cited by 106 · see citing works
Are general and strategic measures of organizational context and leadership associated with knowledge and attitudes toward evidence-based practices in public behavioral health settings? A cross-sectional observational study
Powell, B. J., Mandell, D. S., Hadley, T. R., Rubin, R. M., Evans, A. C., Hurford, M. O., & Beidas, R. S. (2017) · Implementation Science · doi:10.1186/s13012-017-0593-9 · Cited by 102 · see citing works
Predictors of clinician use of exposure therapy in community mental health settings
Becker‐Haimes, E. M., Okamura, K. H., Wolk, C. B., Rubin, R. M., Evans, A. C., & Beidas, R. S. (2017) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2017.04.002 · Cited by 97 · see citing works
Linking molar organizational climate and strategic implementation climate to clinicians’ use of evidence-based psychotherapy techniques: cross-sectional and lagged analyses from a 2-year observational study
Williams, N. J., Ehrhart, M. G., Aarons, G. A., Marcus, S. C., & Beidas, R. S. (2018) · Implementation Science · doi:10.1186/s13012-018-0781-2 · Cited by 92 · see citing works
A conceptual model to guide research on the activities and effects of innovation champions
Shea, C. M. (2021) · Implementation Research and Practice · doi:10.1177/2633489521990443 · Cited by 92 · see citing works
New Evidence on the Green House Model of Nursing Home Care: Synthesis of Findings and Implications for Policy, Practice, and Research
Zimmerman, S. I., Bowers, B. J., Cohen, L. W., Grabowski, D. C., Horn, S. D., & Kemper, P. F. (2015) · Health Services Research · doi:10.1111/1475-6773.12430 · Cited by 83 · see citing works
Applying the Policy Ecology Framework to Philadelphia’s Behavioral Health Transformation Efforts
Powell, B. J., Beidas, R. S., Rubin, R. M., Stewart, R. E., Wolk, C. B., Matlin, S. L., Weaver, S., Hurford, M. O., Evans, A. C., Hadley, T. R., et al. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0733-6 · Cited by 82 · see citing works
Policy to implementation: evidence-based practice in community mental health – study protocol
Beidas, R. S., Aarons, G. A., Barg, F. K., Evans, A. C., Hadley, T. R., Hoagwood, K., Marcus, S. C., Schoenwald, S. K., Walsh, L., & Mandell, D. S. (2013) · Implementation Science · doi:10.1186/1748-5908-8-38 · Cited by 80 · see citing works
It’s time to close the research to practice gap in autism: The need for implementation science
Boyd, B. A., Stahmer, A. C., Odom, S. L., Wallisch, A. M., & Matheis, M. (2021) · Autism · doi:10.1177/13623613211064422 · Cited by 80 · see citing works
Measures of organizational culture, organizational climate, and implementation climate in behavioral health: A systematic review
Powell, B. J., Mettert, K. D., Dorsey, C. N., Weiner, B. J., Stanick, C. F., Lengnick-Hall, R., Ehrhart, M. G., Aarons, G. A., Barwick, M. A., Damschroder, L. J., et al. (2021) · Implementation Research and Practice · doi:10.1177/26334895211018862 · Cited by 79 · see citing works
Self-citation
Methods and metrics challenges of delivery-system research
Alexander, J. A., & Hearld, L. R. (2012) · Implementation Science · doi:10.1186/1748-5908-7-15 · Cited by 78 · see citing works
The relationship between first-level leadership and inner-context and implementation outcomes in behavioral health: a scoping review
Meza, R. D., Triplett, N. S., Woodard, G. S., Martin, P., Khairuzzaman, A. N., Jamora, G., & Dorsey, S. (2021) · Implementation Science · doi:10.1186/s13012-021-01104-4 · Cited by 76 · see citing works
Barriers and facilitators for implementing a new screening tool in an emergency department: A qualitative study applying the Theoretical Domains Framework
Kirk, J. W., Sivertsen, D. M., Petersen, J., Nilsén, P., & Petersen, H. V. (2016) · Journal of Clinical Nursing · doi:10.1111/jocn.13275 · Cited by 72 · see citing works
Associations among unit leadership and unit climates for implementation in acute care: A cross‐sectional study
Shuman, C. J., Liu, X., Aebersold, M. L., Tschannen, D., Banaszak-Holl, J., & Titler, M. G. (2018) · Implementation Science · doi:10.1186/s13012-018-0753-6 · Cited by 67 · see citing works
Digital selling: organizational and managerial influences for frontline readiness and effectiveness
Mullins, R. R., & Agnihotri, R. (2022) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-021-00836-5 · Cited by 67 · see citing works
The Juggling Act of Supervision in Community Mental Health: Implications for Supporting Evidence-Based Treatment
Dorsey, S., Pullmann, M. D., Kerns, S. E. U., Jungbluth, N. J., Meza, R. D., Thompson, K., & Berliner, L. (2017) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-017-0796-z · Cited by 65 · see citing works
The impact of inter-organizational alignment (IOA) on implementation outcomes: evaluating unique and shared organizational influences in education sector mental health
Lyon, A. R., Whitaker, K. M., Locke, J. J., Cook, C. R., King, K. M., Duong, M. T., Davis, C. J., Weist, M. D., Ehrhart, M. G., & Aarons, G. A. (2018) · Implementation Science · doi:10.1186/s13012-018-0721-1 · Cited by 64 · see citing works
Changing nutrition care practices in hospital: a thematic analysis of hospital staff perspectives
Laur, C. V., Valaitis, R. F., Bell, J., & Keller, H. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2409-7 · Cited by 62 · see citing works
It Takes a Village: A Mixed Method Analysis of Inner Setting Variables and Dialectical Behavior Therapy Implementation
Ditty, M. S., Landes, S. J., Doyle, A., & Beidas, R. S. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0602-0 · Cited by 61 · see citing works
Contextual factors that influence quality improvement implementation in primary care: The role of organizations, teams, and individuals
Shea, C. M., Turner, K. L., Albritton, J., & Reiter, K. L. (2018) · Health Care Management Review · doi:10.1097/hmr.0000000000000194 · Cited by 60 · see citing works
Measuring Constructs of the Consolidated Framework for Implementation Research in the Context of Increasing Colorectal Cancer Screening in Federally Qualified Health Center
Kegler, M. C., Liang, S., Weiner, B. J., Tu, S. P., Friedman, D. B., Glenn, B. A., Herrmann, A. K., Risendal, B., & Fernández, M. E. (2018) · Health Services Research · doi:10.1111/1475-6773.13035 · Cited by 53 · see citing works
Self-citation
Elucidating the influence of supervisors’ roles on implementation climate
Bunger, A. C., Birken, S. A., Hoffman, J. A., MacDowell, H., Choy-Brown, M., & Magier, E. (2019) · Implementation Science · doi:10.1186/s13012-019-0939-6 · Cited by 51 · see citing works
A stepped-wedge randomized trial investigating the effect of the Leadership and Organizational Change for Implementation (LOCI) intervention on implementation and transformational leadership, and implementation climate
Skar, A. S., Braathu, N., Peters, N., Bækkelund, H., Endsjø, M., Babaii, A., Borge, R. H., Wentzel‐Larsen, T., Ehrhart, M. G., Sklar, M., et al. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-07539-9 · Cited by 49 · see citing works
Expanding the Frontiers of Population Nutrition Research: New Questions, New Methods, and New Approaches
Pelletier, D. L., Porter, C., Aarons, G. A., Wuehler, S. E., & Neufeld, L. M. (2013) · Advances in Nutrition · doi:10.3945/an.112.003160 · Cited by 47 · see citing works
Validating the Implementation Climate Scale (ICS) in child welfare organizations
Ehrhart, M. G., Torres, E. M., Wright, L. A., Martinez, S., & Aarons, G. A. (2015) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2015.10.017 · Cited by 46 · see citing works
Factors associated with the implementation of community-based peer-led health promotion programs: A scoping review
Lorthios-Guilledroit, A., Richard, L., & Filiatrault, J. (2018) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2018.01.008 · Cited by 46 · see citing works
Adaptability, Scalability and Sustainability (ASaS) of complex health interventions: a systematic review of theories, models and frameworks
Sun, L., Booth, A., & Sworn, K. (2024) · Implementation Science · doi:10.1186/s13012-024-01375-7 · Cited by 42 · see citing works
Advancing theory development: exploring the leadership–climate relationship as a mechanism of the implementation of cultural competence
Guerrero, E. G., Fenwick, K. M., & Kong, Y. (2017) · Implementation Science · doi:10.1186/s13012-017-0666-9 · Cited by 38 · see citing works
A Qualitative Force Field Analysis of Facilitators and Barriers to Evidence-Based Practice in Healthcare Using an Implementation Framework
McNett, M., Tucker, S., Zadvinskis, I. M., Tolles, D., Thomas, B. K., Gorsuch, P., & Gallagher‐Ford, L. (2022) · Global Implementation Research and Applications · doi:10.1007/s43477-022-00051-6 · Cited by 36 · see citing works
Intervening for sustainable change: Tailoring strategies to align with values and principles of communities
Metz, A. J. R., Kainz, K., & Boaz, A. (2023) · Frontiers in Health Services · doi:10.3389/frhs.2022.959386 · Cited by 36 · see citing works
Artificial Intelligence in Health Care—Understanding Patient Information Needs and Designing Comprehensible Transparency: Qualitative Study
Robinson, R. F., Liday, C., Lee, S. J., Williams, I. C., Wright, M. C., An, S., & Nguyen, E. (2023) · JMIR AI · doi:10.2196/46487 · Cited by 34 · see citing works
Implementing Internet-Delivered Cognitive Behavioral Therapy for Depression and Anxiety in Adults: Systematic Review
Duffy, D. J., Richards, D., Hisler, G. C., & Timulák, L. (2024) · Journal of Medical Internet Research · doi:10.2196/47927 · Cited by 34 · see citing works
Leadership profiles associated with the implementation of behavioral health evidence-based practices for autism spectrum disorder in schools
Stadnick, N. A., Meza, R. D., Suhrheinrich, J., Aarons, G. A., Brookman-Frazee, L. I., Lyon, A. R., Mandell, D. S., & Locke, J. J. (2019) · Autism · doi:10.1177/1362361319834398 · Cited by 34 · see citing works
Improving measurement-based care implementation in youth mental health through organizational leadership and climate: a mechanistic analysis within a randomized trial
Williams, N. J., Ehrhart, M. G., Aarons, G. A., Esp, S. M., Sklar, M., Carandang, K. M., Vega, N. R., Brookman-Frazee, L. I., & Marcus, S. C. (2024) · Implementation Science · doi:10.1186/s13012-024-01356-w · Cited by 33 · see citing works
Validation of the Implementation Climate Scale (ICS) in substance use disorder treatment organizations
Ehrhart, M. G., Torres, E. M., Hwang, J., Sklar, M., & Aarons, G. A. (2019) · Substance Abuse Treatment Prevention and Policy · doi:10.1186/s13011-019-0222-5 · Cited by 32 · see citing works
The challenge of change in acute mental health services: measuring staff perceptions of barriers to change and their relationship to job status and satisfaction using a new measure (VOCALISE)
Laker, C., Callard, F. J., Flach, C., Williams, P. R., Sayer, J., & Wykes, T. (2014) · Implementation Science · doi:10.1186/1748-5908-9-23 · Cited by 31 · see citing works
Testing the organizational theory of innovation implementation effectiveness in a community pharmacy medication management program: a hurdle regression analysis
Turner, K. L., Trogdon, J. G., Weinberger, M., Stover, A. M., Ferreri, S. P., Farley, J. F., Ray, N., Patti, M., Renfro, C. P., & Shea, C. M. (2018) · Implementation Science · doi:10.1186/s13012-018-0799-5 · Cited by 31 · see citing works
Applying the Exploration Preparation Implementation Sustainment (EPIS) Framework to the Kigali Imbereheza Project for Rwandan Adolescents Living With HIV
Donenberg, G. R., Cohen, M. H., Ingabire, C., Fabri, M. R., Emerson, E. M., Kendall, A. D., Remera, E., Manzi, O., & Nsanzimana, S. (2019) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000002204 · Cited by 31 · see citing works
Linking organizational climate for evidence-based practice implementation to observed clinician behavior in patient encounters: a lagged analysis
Williams, N. J., Becker‐Haimes, E. M., Schriger, S. H., & Beidas, R. S. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00309-y · Cited by 30 · see citing works
Who does it first? The uptake of medical innovations in the performance of thrombolysis on ischemic stroke patients in Germany: a study based on hospital quality data
Scholten, N., Pfaff, H., Lehmann, H. C., Fink, G. R., & Karbach, U. (2015) · Implementation Science · doi:10.1186/s13012-014-0196-7 · Cited by 29 · see citing works
Otago exercise programme—from evidence to practice: a qualitative study of physiotherapists’ perceptions of the importance of organisational factors of leadership, context and culture for knowledge translation in Norway
Worum, H., Lillekroken, D., Ahlsen, B., Roaldsen, K. S., & Bergland, A. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05853-8 · Cited by 29 · see citing works
A multilevel analysis of the effects of disciplinary climate strength on student reading performance
Guo, S., Li, L., & Zhang, D. (2018) · Asia Pacific Education Review · doi:10.1007/s12564-018-9516-y · Cited by 29 · see citing works
Assessing mental health clinicians’ intentions to adopt evidence-based treatments: reliability and validity testing of the evidence-based treatment intentions scale
Williams, N. J. (2015) · Implementation Science · doi:10.1186/s13012-016-0417-3 · Cited by 28 · see citing works
Implementing community-based provider participation in research: an empirical study
Teal, R., Bergmire, D. M., Johnston, M. A., & Weiner, B. J. (2012) · Implementation Science · doi:10.1186/1748-5908-7-41 · Cited by 27 · see citing works
Self-citation
Testing the implementation and sustainment facilitation (ISF) strategy as an effective adjunct to the Addiction Technology Transfer Center (ATTC) strategy: study protocol for a cluster randomized trial
Garner, B. R., Zehner, M. E., Roosa, M. R., Martino, S., Gotham, H. J., Ball, E. L., Stilen, P., Speck, K. J., Vandersloot, D., Rieckmann, T. R., et al. (2017) · Addiction Science & Clinical Practice · doi:10.1186/s13722-017-0096-7 · Cited by 27 · see citing works
Clinical Adoption of mHealth Technology to Support Pediatric Cystic Fibrosis Care in Sweden: Qualitative Case Study
Longacre, M. R., Grande, S. W., Hager, A., Montan, M. V., Bergquist, R. P., Mårtensson, M. B., & Kotzbauer, G. (2018) · JMIR Pediatrics and Parenting · doi:10.2196/11080 · Cited by 27 · see citing works
Worksite Health Promotion Program Participation: A Study to Examine the Determinants of Participation
Hall, M. E., Bergman, R. J., & Nivens, S. (2014) · Health Promotion Practice · doi:10.1177/1524839913510721 · Cited by 26 · see citing works
Strategies for implementing the Appointment-Based Model at a rural independent chain of community pharmacies
Herbert, S. M. C., Heck, L. A., Vogel, A. N., Coley, K. C., McGivney, M. S., Maher, R. L., & Carroll, J. C. (2021) · Journal of the American Pharmacists Association · doi:10.1016/j.japh.2021.09.009 · Cited by 26 · see citing works
Exploring Associations Between Inner-Context Factors and Implementation Outcomes
Suhrheinrich, J., Rieth, S. R., Dickson, K. S., & Stahmer, A. C. (2019) · Exceptional Children · doi:10.1177/0014402919881354 · Cited by 26 · see citing works
Project MIMIC (Maximizing Implementation of Motivational Incentives in Clinics): A cluster-randomized type 3 hybrid effectiveness-implementation trial
Becker, S. J., Murphy, C. M., Hartzler, B. J., Rash, C. J., Janssen, T., Roosa, M., Madden, L. M., & Garner, B. R. (2021) · Addiction Science & Clinical Practice · doi:10.1186/s13722-021-00268-0 · Cited by 26 · see citing works
Validation of the Implementation Climate Scale in Nursing
Ehrhart, M. G., Shuman, C. J., Torres, E. M., Kath, L. M., Prentiss, A. S., Butler, E., & Aarons, G. A. (2021) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12500 · Cited by 25 · see citing works
Enhancing organizational capacity to provide cancer control programs among Latino churches: design and baseline findings of the CRUZA Study
Allen, J. D., Torres, M. I., Tom, L. S., Rustan, S., Leyva, B., Negrón, R., Linnan, L. A., Jandorf, L. H., & Ospino, H. (2015) · BMC Health Services Research · doi:10.1186/s12913-015-0735-1 · Cited by 25 · see citing works
Implementing community pharmacy-based influenza point-of-care test-and-treat under collaborative practice agreement
Hohmeier, K. C., McKeirnan, K. C., Akers, J. M., Klepser, M. E., Klepser, S. A., Chen, C., & Klepser, D. G. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00324-z · Cited by 23 · see citing works
Implementation context and burnout among Department of Veterans Affairs psychotherapists prior to and during the COVID-19 pandemic
Rosen, C. S., Kaplan, A. N., Nelson, D. B., Bash, H. A. J. L., Chard, K. M., Eftekhari, A., Kehle‐Forbes, S., Stirman, S. W., & Sayer, N. A. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.09.141 · Cited by 23 · see citing works
Improving patient-centeredness of fertility care using a multifaceted approach: study protocol for a randomized controlled trial
Huppelschoten, A. G., van Duijnhoven, N. T. L., Hermens, R., Verhaak, C. M., Kremer, J. A. M., & Nelen, W. L. D. M. (2012) · Trials · doi:10.1186/1745-6215-13-175 · Cited by 23 · see citing works
What Is the Quality of Reporting of Studies of Interventions to Increase Compliance with Antibiotic Prophylaxis?
Levy, S. M., Phatak, U. R., Tsao, K., Wray, C. J., Millas, S. G., Lally, K. P., & Kao, L. S. (2013) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2013.06.018 · Cited by 23 · see citing works
Supervision in Community Mental Health: Understanding Intensity of EBT Focus
Lucid, L., Meza, R. D., Pullmann, M. D., Jungbluth, N. J., Deblinger, E., & Dorsey, S. (2017) · Behavior Therapy · doi:10.1016/j.beth.2017.12.007 · Cited by 23 · see citing works
Educators’ perceptions of organisational readiness for implementation of a pre-adolescent transdisciplinary school health intervention for inter-generational outcomes
Arthur, K., Christofides, N. J., & Nelson, G. (2020) · PLoS ONE · doi:10.1371/journal.pone.0227519 · Cited by 23 · see citing works
Randomized trial of the leadership and organizational change for implementation (LOCI) strategy in substance use treatment clinics
Aarons, G. A., Sklar, M., Ehrhart, M. G., Roesch, S., Moullin, J. C., & Carandang, K. M. (2024) · Journal of Substance Use and Addiction Treatment · doi:10.1016/j.josat.2024.209437 · Cited by 22 · see citing works
Innovation implementation in the context of hospital QI: lessons learned and strategies for success
Rangachari, P. (2018) · Innovation and Entrepreneurship in Health · doi:10.2147/ieh.s151040 · Cited by 22 · see citing works
The implementation and validation of the NoMAD during a complex primary care intervention
Lamarche, L., Clark, R. E., Parascandalo, F., & Mangin, D. A. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01655-0 · Cited by 22 · see citing works
Implementing tobacco use treatment guidelines in community health centers in Vietnam
Shelley, D., VanDevanter, N., Cleland, C. C., Nguyen, L., & Nguyen, N. T. (2015) · Implementation Science · doi:10.1186/s13012-015-0328-8 · Cited by 22 · see citing works
Individual-level associations between implementation leadership, climate, and anticipated outcomes: a time-lagged mediation analysis
Egeland, K. M., Borge, R. H., Peters, N., Bækkelund, H., Braathu, N., Sklar, M., Aarons, G. A., & Skar, A. S. (2023) · Implementation Science Communications · doi:10.1186/s43058-023-00459-7 · Cited by 21 · see citing works
Redesigning the Role of Medical Assistants in Primary Care: Challenges and Strategies During Implementation
Dill, J., Morgan, J. C., Chuang, E., & Mingo, C. A. (2019) · Medical Care Research and Review · doi:10.1177/1077558719869143 · Cited by 21 · see citing works
Top-level leaders and implementation strategies to support organizational diversity, equity, inclusion, and belonging (DEIB) interventions: a qualitative study of top-level DEIB leaders in healthcare organizations
Hogan, T. H., O’Rourke, B. P., Weeks, E., Silvera, G. A., & Choi, S. (2023) · Implementation Science · doi:10.1186/s13012-023-01319-7 · Cited by 20 · see citing works
Advancing heart health in North Carolina primary care: the Heart Health NOW study protocol
Weiner, B. J., Pignone, M. P., DuBard, C. A., Lefebvre, A., Suttie, J. L., Freburger, J. K., & Cykert, S. (2015) · Implementation Science · doi:10.1186/s13012-015-0348-4 · Cited by 20 · see citing works
Self-citation
The Many Organisational Factors Relevant to Planning Change in Emergency Care Departments: A Qualitative Study to Inform a Cluster Randomised Controlled Trial Aiming to Improve the Management of Patients with Mild Traumatic Brain Injuries
Bosch, M., Tavender, E. J., Brennan, S., Knott, J. C., Gruen, R. L., & Green, S. (2016) · PLoS ONE · doi:10.1371/journal.pone.0148091 · Cited by 20 · see citing works
Implementation Climate and Time Predict Intensity of Supervision Content Related to Evidence Based Treatment
Pullmann, M. D., Lucid, L., Harrison, J. P., Martin, P., Deblinger, E., Benjamin, K. S., & Dorsey, S. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00280 · Cited by 20 · see citing works
The motivating power of gamification
Lier, L. M., & Breuer, C. K. (2019) · International Journal of Workplace Health Management · doi:10.1108/ijwhm-04-2019-0055 · Cited by 20 · see citing works
Comparing a standard and tailored approach to scaling up an evidence-based intervention for antiretroviral therapy for people who inject drugs in Vietnam: study protocol for a cluster randomized hybrid type III trial
Nguyen, M. X. B., Chu, A. V., Powell, B. J., Tran, H. V., Nguyen, L. H., Dao, A. T. M., Pham, M. D., Vo, S. H., Bui, N. H., Dowdy, D. W., et al. (2020) · Implementation Science · doi:10.1186/s13012-020-01020-z · Cited by 19 · see citing works
Results of the Kigali Imbereheza Project: A 2-Arm Individually Randomized Trial of TI-CBT Enhanced to Address ART Adherence and Mental Health for Rwandan Youth Living With HIV
Donenberg, G. R., Fitts, J., Ingabire, C., Nsanzimana, S., Fabri, M. R., Emerson, E. M., Remera, E., Manzi, O., Bray, B. C., & Cohen, M. H. (2022) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000002911 · Cited by 19 · see citing works
Individual level predictors of implementation climate in child welfare services
Engell, T., Kirkøen, B., Aarons, G. A., & Hagen, K. A. (2020) · Children and Youth Services Review · doi:10.1016/j.childyouth.2020.105509 · Cited by 19 · see citing works
Estudio de relaciones entre cultura, clima y fuerza de clima laboral en Ecuador
Rámos, V., & Tejera, E. (2017) · Acción Psicológica · doi:10.5944/ap.14.2.17046 · Cited by 19 · see citing works
Evaluation Protocol To Assess an Integrated Framework for the Implementation of the Childhood Obesity Research Demonstration Project at the California (CA-CORD) and Massachusetts (MA-CORD) Sites
Chuang, E., Ayala, G. X., Schmied, E. A., Ganter, C., Gittelsohn, J., & Davison, K. K. (2015) · Childhood Obesity · doi:10.1089/chi.2014.0049 · Cited by 18 · see citing works
Study protocol: implementation of a computer-assisted intervention for autism in schools: a hybrid type II cluster randomized effectiveness-implementation trial
Pellecchia, M., Beidas, R. S., Marcus, S. C., Fishman, J., Kimberly, J. R., Cannuscio, C. C., Reisinger, E. M., Rump, K. M., & Mandell, D. S. (2016) · Implementation Science · doi:10.1186/s13012-016-0513-4 · Cited by 18 · see citing works
A qualitative exploration of factors influencing medical staffs’ decision-making around nutrition prescription after colorectal surgery
Rattray, M., Roberts, S., Desbrow, B., Wullschleger, M., Robertson, T., Hickman, I. J., & Marshall, A. P. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4011-7 · Cited by 18 · see citing works
The influence of formal and informal policies and practices on health care innovation implementation: A mixed-methods analysis
DiMartino, L., Birken, S. A., Hanson, L. C., Trogdon, J. G., Clary, A., Weinberger, M., Reeder-Hayes, K. E., & Weiner, B. J. (2018) · Health Care Management Review · doi:10.1097/hmr.0000000000000193 · Cited by 18 · see citing works
Self-citation
Barriers and Facilitators to Data Use for Decision Making: The Experience of the African Health Initiative Partnerships in Ethiopia, Ghana, and Mozambique
Making, A. H. I. P. C. F. D. U. F. D. (2022) · Global Health: Science and Practice Journal · doi:10.9745/ghsp-d-21-00666 · Cited by 15 · see citing works
Implementation readiness for evidence-based autism practices in school systems
Stahmer, A. C., Suhrheinrich, J., Yu, Y., Melgarejo, M., Schetter, P. L., & Young, G. (2023) · Implementation Research and Practice · doi:10.1177/26334895231199465 · Cited by 17 · see citing works
Barriers to the implementation of prehospital thrombolysis in the treatment of ST-segment elevation myocardial infarction in South Africa: An exploratory inquiry
Lynch, A. C., Sobuwa, S., & Castle, N. R. (2020) · African Journal of Emergency Medicine · doi:10.1016/j.afjem.2020.08.001 · Cited by 17 · see citing works
The Interaction Between General and Strategic Leadership and Climate on Their Multilevel Associations with Implementer Attitudes Toward Universal Prevention Programs for Youth Mental Health: A Cross-Sectional Study
Zhang, Y., Cook, C., Fallon, L. M., Corbin, C. M., Ehrhart, M. G., Brown, E. C., Locke, J. J., & Lyon, A. R. (2022) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-022-01248-5 · Cited by 17 · see citing works

Context matters: measuring implementation climate among individuals and groups
Jacobs, S., Weiner, B. J., & Bunger, A. C. (2014) · Implementation Science · doi:10.1186/1748-5908-9-46 · Cited by 189 · see citing works
Self-citation
The Challenge of Innovation Implementation
Klein, K. J., & Sorra, J. S. (1996) · The Academy of Management Review · doi:10.2307/259164 · Cited by 2,113 · see citing works
Meausures of organizational characteristics associated with adoption and/or implementation of innovations: A systematic review
Allen, J. D., Towne, S. D., Maxwell, A. E., DiMartino, L., Leyva, B., Bowen, D. J., Linnan, L. A., & Weiner, B. (2017) · eScholarship (California Digital Library) · doi:10.6084/m9.figshare.c.3861772.v1
Self-citation
Measures of organizational characteristics associated with adoption and/or implementation of innovations: A systematic review
Allen, J. D., Towne, S. D., Maxwell, A. E., DiMartino, L., Leyva, B., Bowen, D. J., Linnan, L. A., & Weiner, B. J. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2459-x · Cited by 93 · see citing works
Self-citation
RESEARCH ARTICLE Open Access
Jacobs, S., Weiner, B. J., Reeve, B. B., Hofmann, D. A., Christian, M., & Weinberger, M. (2016)
Self-citation

Authors: Weiner, B. J., Belden, C. M., Bergmire, D. M., & Johnston, M.
Affiliations: University of North Carolina at Chapel Hill (US)
Corresponding author: Weiner, Bryan J
ORCID: Weiner, Bryan J
Belden, Charles M
Johnston, Matthew
Venue: Implementation Science
Publisher: Springer Science and Business Media LLC
Published: 2011-07-22
Volume: 6
Issue: 1
Pages: 78-78
ISSN: 1748-5908 (ISSN-L)
DOI: 10.1186/1748-5908-6-78
PMC: PMC3224582
OpenAlex: W2153210627
Cited by: 260
References: 95
Citations by year: 2026: 12 · 2025: 14 · 2024: 36 · 2023: 24 · 2022: 31 · 2021: 23 · 2020: 15 · 2019: 17 · 2018: 22 · 2017: 17 · 2016: 10 · 2015: 12 · 2014: 10 · 2013: 8 · 2012: 8
FWCI: 16.05
Type: journal article
Language: en
Open access: gold
doi.org
Licence: cc-by
www.springer.com/tdm (unspecified)
Locations: Implementation Science (publishedVersion, cc-by)
Europe PMC (PubMed Central) (publishedVersion, cc-by)
PubMed Central (publishedVersion, cc-by)
PubMed (publishedVersion)
Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion)
Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion, cc-by)
DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
UNC Libraries
Funders: National Cancer Institute (R01CA124402)
Topics: Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Organizational Change and Leadership
Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
Keywords: implementation climate, innovation implementation, implementation effectiveness, construct validity, measurement, climate strength, organizational climate, organizational culture
MeSH terms: Cooperative Behavior, Diffusion of Innovation, Health Plan Implementation, Humans, Medical Oncology, Models, Theoretical, Organizational Innovation, Organizational Culture, Biomedical Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The meaning and measurement of implementation climate

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks