Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Open accessThe DOI matches its Crossref record; 162 of the 171 references it cites were found in a registry or an index; 18 of the 120 sources its claims cite were checked for support.
Abstract
Implementation science is a quickly growing discipline. Lessons learned from business and medical settings are being applied but it is unclear how well they translate to settings with different historical origins and customs (e.g., public mental health, social service, alcohol/drug sectors). The purpose of this paper is to propose a multi-level, four phase model of the implementation process (i.e., Exploration, Adoption/Preparation, Implementation, Sustainment), derived from extant literature, and apply it to public sector services. We highlight features of the model likely to be particularly important in each phase, while considering the outer and inner contexts (i.e., levels) of public sector service systems.
Overview
CoChat Summary
TL;DR
This conceptual paper proposes a multi-level, four-phase model of evidence-based practice (EBP) implementation — Exploration, Adoption/Preparation, Implementation, and Sustainment — derived from extant literature and applied specifically to public sector services such as child welfare and specialty mental health. It argues that different outer-context (sociopolitical/funding, interorganizational networks, leadership) and inner-context (organizational characteristics, culture/climate, individual adopter characteristics) factors matter differentially across phases, and that sustainment can recursively inform future implementation efforts.
Key findings
- The model divides implementation into four phases (Exploration, Adoption/Preparation, Active Implementation, Sustainment) and holds that "different aspects of the outer and inner context may be more prominent or manifest differently during different phases" — a feature the authors say few prior models explicitly recognize.
- Exploration is shaped by outer-context forces (sociopolitical/funding, client advocacy, interorganizational networks) and inner-context factors including absorptive capacity, readiness for change, and receptive context; the authors note child welfare agencies often have "varied levels of education and considerable workloads" and few venues for knowledge sharing.
- Sustainment is described as under-studied: "there has been little empirical work examining factors that either facilitate or limit sustainability of EBPs in public sector social services," and the authors state "we currently lack comprehensive models of factors that support maintenance or sustainment."
- Sustainment factors discussed include ongoing fidelity monitoring and support, a critical mass of EBP use, staffing/selection practices, leadership and culture-embedding mechanisms, and funding; the paper cites turnover rates in public sector service organizations "range from 20% to 50% annually" as a sustainment challenge.
Methods
- Design: conceptual/theoretical paper advancing a framework, not an empirical study; the model is "derived from extant literature" and illustrated with examples primarily from child welfare and specialty mental health, with the claim that many factors are "common to public sector services in general."
- Data/sample: none — the paper synthesizes prior implementation models and literature (e.g., RE-AIM, ORC, ARC, QUERI, CDT, IHI collaborative) rather than collecting data.
- Analysis: narrative synthesis organized by implementation phase and by outer vs. inner context levels, presented in two conceptual figures (Fig. 1 global factors; Fig. 2 phases and factors).
Limitations
- Stated: the authors note "few, if any, good measures of the process or progression through the phases" exist, and that process-based measures would be needed to assess status, progression, milestones, and speed of phase traversal.
- Stated: the paper repeatedly acknowledges thin empirical support — "there are few data supporting the importance of the other drivers of EBP exploration suggested by the literature," and consensus on core implementation drivers exists but "the body of concrete research evidence for each core driver in many cases remains to be developed."
- Evident from the text: the model is explicitly a hypothesis-generating framework ("variables hypothesized to play important roles"), its emphasis is skewed toward child welfare with mental health examples, and it offers no empirical test of the proposed phase-specific relationships.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
16 Valid · 9 Not valid · 60 Not checked · 33 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Federal and state agencies may fund implementation demonstration projects and research studies to facilitate the implementation of EBPs, however, there has been little empirical work examining factors that either facilitate or limit sustainability of EBPs in public sector social services (Greenhalgh et al. 2004).”
§ Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors > Sustainment Phase
What the sources say
- Partly supportedcites Greenhalgh et al. 2004 sourceExperimental — accuracy not yet measured
The review says the literature on the sustainability of service innovations was very sparse (passage 1, page unavailable). It focused particularly on health care, however, and does not establish that empirical work on factors affecting sustainability of evidence-based practices was scarce specifically in public-sector social services. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The policies and funding needed for sustained use of practices typically follow from leaders who develop initiatives or set visions that can be maintained over time (Hoagwood et al. 2006).”
§ Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors > Sustainment Phase > Outer Context
What the sources say
- Partly supportedcites Hoagwood et al. 2006 sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) says innovative leaders aided implementation and that all site Directors made plans for sustainability. The paper does not say that policies and funding typically follow from leaders’ initiatives or visions; it instead notes that continuation in Israel depended on securing funding. (LLM, conf=0.83)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Conversely, severe budget restrictions discourage the exploration of innovations since exploration demands staff time, which may be limited when work forces are cut due to funding restrictions”
§ Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors > Exploration Phase1 > The Outer Context
What the sources say
- Partly supportedcites Greenhalgh et al. 2004 sourceExperimental — accuracy not yet measured
The paper’s discussion of organizational innovativeness (section labeled Abstract; page unavailable) associates slack resources with innovation, and its ‘Dedicated Time and Resources’ passage says adequate, continuing resources make assimilation more likely. It does not specifically say that severe budget restrictions lead to workforce cuts that leave staff too little time to explore innovations. (LLM, conf=0.86)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Interorganizational forces, which focus on how individual organizations relate to, partner with, and compete with one another also play a potentially powerful role in adoption decisions.”
§ Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors > Adoption Decision/Preparation Phase > Outer Context
What the sources say
- Partly supportedcites Chamberlain et al. 2008 sourceExperimental — accuracy not yet measured
The conceptual-model passage (Abstract; page unavailable) identifies prior cross-agency collaboration and positive relationships between counties and the California Institute for Mental Health as factors expected to influence adoption. This supports the claim about relationships and partnerships, but our copy does not address competition between organizations as an adoption influence. (LLM, conf=0.84)
- Not checked — no full text of the sourcecites Glisson and Schoenwald 2005 source
- Not matchedcites Institute for Healthcare Improvement [IHI] 2003
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Organizations that start with good knowledge/skills, can incorporate new knowledge, are highly specialized, and have mechanisms in place to spread knowledge throughout the organization, are much more likely to explore EBPs and eventually initiate them”
§ Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors > Exploration Phase1 > The Inner Context
What the sources say
- Not checked — no full text of the sourcecites Damanpour 1991 source
- Not checked — no full text of the sourcecites Ferlie and Shortell 2001 source
- Partly supportedcites Greenhalgh et al. 2004 sourceExperimental — accuracy not yet measured
The passages on structural determinants and absorptive capacity (indexed as Abstract; page unavailable) link specialization, an existing knowledge base, and knowledge sharing to greater organizational innovativeness and assimilation. They do not establish that organizations with these features are *much* more likely to explore and then initiate evidence-based practices specifically; the paper also describes assimilation as a process that can move back and forth between stages. (LLM, conf=0.84)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
57 more claims · 2 with their cited sources checked
Create a free account to see all 118 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 31
- It may state two separate claims as one. 35
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Specifically, unlike traditional feasibility and pilot studies that may include the preliminary testing of interventions on individual clinical or public health outcomes, implementation feasibility and pilot studies that explore strategies to improve intervention implementation often require assessing changes across multiple levels including individuals (e.g. service providers or clinicians) and”
From Guidance for conducting feasibility and pilot studies for implementation trials (2020) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“we propose that the concept of the individual might incorporate: capability, capacity, motivation (including recognising a need for change), resilience, acceptability, feelings, knowledge and beliefs (including self efficacy) about the intervention/evidence, position and fit within the organization/social system, and approach to decision-making (e.g., experimentation, use of information).”
From The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework (2013) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Implementation strategies are too often designed in an unsystematic manner and fail to address key contextual determinants (13–16).”
From Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda (2019) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even if strategies are meticulously described in a study protocol or trial registry, it is often unrealistic to expect that they will not need to be altered as determinants emerge across implementation phases (13, 93, 94).”
From Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda (2019) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Extent, quality, and timeliness of the completion of activities related to specific implementation process strategies”
From Beyond “implementation strategies”: classifying the full range of strategies used in implementation science and practice (2017) · cites this paper as [30]
Experimental — accuracy not yet measured
34 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors > References
“Data Path Design. (2010). ASWB projects.”
§ Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors > References
“Retrieved June 10, 2009”
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
The fifth discipline, the art and practice of the learning organization
Senge, P. M. (1991) · Performance + Instruction · doi:10.1002/pfi.4170300510 · Cited by 20,060
Organizational culture and leadership
(1993) · Long Range Planning · doi:10.1016/0024-6301(93)90120-5 · Cited by 16,462
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 13,723
(1994) · Cited by 13,126
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Self-citationDiffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · cited 11×
“Beginning at the broadest level, the state and federal sociopolitical and funding contexts influence the exploration of innovative interventions or practices (Davies and Nutley 2008; Ganju 2003; Hoagwood 2003).”
BackgroundInfluentialEvaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · cited 2×
“The RE-AIM model (Glasgow et al. 1999; Glasgow et al. 2006) explicitly identifies the ‘‘maintenance’’ phase of implementation as critical in sustaining effective health interventions.”
MethodOrganizational innovation: A meta-analysis of effects of determinants and moderators
Damanpour, F. (1991) · Academy of Management Journal · doi:10.2307/256406 · Cited by 6,542 · cited 9×
“Because the implementation literature has been developed in areas where the adoption of innovation is driven by profit or science, there is little attention to this first phase in the extant literature (Damanpour 1991).”
BackgroundMethodInfluentialFrom Neurons to Neighborhoods: The Science of Early Childhood Development
(2000) · doi:10.17226/9824 · Cited by 4,484 · cited 1×
“While concern exists about the lag between development of innovative, empirically tested practices and their ultimate implementation, the policy and practice landscape is often fragmented and changing rapidly (Shonkoff and Phillips 2000).”
Background(2005) · Cited by 3,748
Wallerstein, N., & Duran, B. (2010) · American Journal of Public Health · doi:10.2105/ajph.2009.184036 · Cited by 2,318 · cited 2×
“A number of approaches to addressing the exploration and adoption decision phases include academic-public partnerships, community-based participatory research, and action research (Leykum et al. 2009; Wallerstein and Duran 2010).”
BackgroundA theory of organizational readiness for change
Weiner, B. J. (2009) · Implementation Science · doi:10.1186/1748-5908-4-67 · Cited by 2,268
The Challenge of Innovation Implementation
Klein, K. J., & Sorra, J. S. (1996) · The Academy of Management Review · doi:10.2307/259164 · Cited by 2,113
Education and Treatment of Children
Hickman, J. A., & Wheatley, J. K. (2008) · Encyclopedia of Special Education · doi:10.1002/9780470373699.speced0741 · Cited by 1,927
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894
Self-citationDisseminating Innovations in Health Care
Berwick, D. M. (2003) · JAMA · doi:10.1001/jama.289.15.1969 · Cited by 1,878 · cited 1×
“They engage in ongoing education, usually follow the professional literature in their fields and are well-networked (Berwick 2003; Grol 2001).”
BackgroundDisrupted Routines: Team Learning and New Technology Implementation in Hospitals
Edmondson, A. C., Bohmer, R. M., & Pisano, G. P. (2001) · Administrative Science Quarterly · doi:10.2307/3094828 · Cited by 1,729 · cited 1×
“Leadership is critical in the effective and sustainable implementation of innovation (Edmondson et al. 2001; Rogers 2003).”
Background(2001) · PubMed · Cited by 1,709
Edmondson, A. C. (2003) · Journal of Management Studies · doi:10.1111/1467-6486.00386 · Cited by 1,635 · cited 2×
“However, strong charismatic leadership may be required to create the conditions for sustained use of EBP once the active implementation phase is complete (Edmondson 2003a).”
BackgroundManaging Clinical Knowledge for Health Care Improvement
Balas, E. A., & Boren, S. A. (2000) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1637943 · Cited by 1,479
Ferlie, E. B., & Shortell, S. M. (2001) · The Milbank Quarterly · doi:10.1111/1468-0009.00206 · Cited by 1,335
Marsick, V. J., & Watkins, K. E. (2003) · Advances in Developing Human Resources · doi:10.1177/1523422303005002002 · Cited by 1,318 · cited 1×
“Readiness for change Conceptualizations, definitions, and measures of organizational readiness to change vary widely and range from organizations that are poised to change and innovate (Marsick and Watkins 2003) to organizations with high levels of inertia that may stifle innovation.”
BackgroundAarons, G. A. (2004) · Mental Health Services Research · doi:10.1023/b:mhsr.0000024351.12294.65 · Cited by 1,272 · cited 6×
“Individual provider attitudes toward adoption of EBPs vary with organizational characteristics as well as demographic predictors such as education level, professional status (Aarons 2004), and organizational culture and climate (Aarons and Sawitzky 2006).”
BackgroundInfluentialSelf-citationFrambach, R. T., & Schillewaert, N. (2002) · Journal of Business Research · doi:10.1016/s0148-2963(00)00152-1 · Cited by 1,270 · cited 3×
“…care (Wagner et al. 2001), public health (Glasgow et al. 1999), organizational development (Glisson and Schoenwald 2005), business (Frambach and Schillewaert 2002), and mental health (Mendel et al. 2008), a variety of different models have been proposed to summarize factors at multiple levels…”
BackgroundInfluentialSuccesses and Failures in the Implementation of Evidence-Based Guidelines for Clinical Practice
Grol, R. (2001) · Medical Care · doi:10.1097/00005650-200108002-00003 · Cited by 1,233 · cited 3×
“The Community Development Team (CDT) model, an implementation strategy adopted by the California Institute for Mental Health that organizes agencies and specific EBP implementations, is a good example of the power of interorganizational networks (California Institute for Mental Health [CIMH] 2006; Chamberlain et al. 2…”
BackgroundMethodCore Implementation Components
Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335549 · Cited by 1,103 · cited 5×
“…involved in public sector services is influenced as much by the process of implementing innovative practices as by the practices selected for implementation (Aarons and Palinkas 2007; Crea et al. 2008; Fixsen et al. 2009; Greenhalgh et al. 2004; Palinkas and Aarons 2009; Palinkas et al. 2008).”
BackgroundInfluentialFeldstein, A. C., & Glasgow, R. E. (2008) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(08)34030-6 · Cited by 987
Planning and Studying Improvement in Patient Care: The Use of Theoretical Perspectives
GROL, R. P. T. M., BOSCH, M. C., HULSCHER, M. E. J. L., ECCLES, M. P., & WENSING, M. (2007) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2007.00478.x · Cited by 943 · cited 4×
“The Exploration Phase involves awareness of either an issue that needs attention or of an improved approach to an organizational challenge (Grol et al. 2007).”
BackgroundInfluentialHenggeler, S. W., Melton, G. B., & Smith, L. A. (1992) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.60.6.953 · Cited by 899 · cited 1×
“In addition, some intervention developers are willing and able to support developing local expertise in their model, while others prefer to retain the training and fidelity support processes (Henggeler et al. 1992; Henggeler et al. 1999; Szapocznik and Williams 2000).”
BackgroundAssessing organizational readiness for change
Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(02)00233-7 · Cited by 863 · cited 2×
“Studies of organizational readiness to change identify both structural (e.g., availability of computer resources) and process (e.g., cohesion, pressure for change) variables that may be related to adoption of EBPs (Lehman et al. 2002).”
BackgroundChanging Provider Behavior: An Overview of Systematic Reviews of Interventions
Grimshaw, J. M., Shirran, L., Thomas, R., Mowatt, G., Fraser, C., Bero, L., Grilli, R., Harvey, E., Oxman, A., & O’Brien, M. A. (2001) · Medical Care · doi:10.1097/00005650-200108002-00002 · Cited by 778
The Blended Value Proposition: Integrating Social and Financial Returns
Emerson, J. (2003) · California Management Review · doi:10.2307/41166187 · Cited by 776
Kontos, P. C., & Poland, B. D. (2009) · Implementation Science · doi:10.1186/1748-5908-4-1 · Cited by 760
The cross‐level effects of culture and climate in human service teams
Glisson, C., & James, L. R. (2002) · Journal of Organizational Behavior · doi:10.1002/job.162 · Cited by 758 · cited 2×
“…has received the most attention in public sector services, due largely to the work of Glisson and colleagues in children’s services (Glisson and Hemmelgarn 1998; Glisson and James 2002; Glisson and Schoenwald 2005) and in substance abuse treatment settings as described by Simpson and Flynn (2007).”
BackgroundGlisson, C., & Hemmelgarn, A. (1998) · Child Abuse & Neglect · doi:10.1016/s0145-2134(98)00005-2 · Cited by 744 · cited 1×
“…has received the most attention in public sector services, due largely to the work of Glisson and colleagues in children’s services (Glisson and Hemmelgarn 1998; Glisson and James 2002; Glisson and Schoenwald 2005) and in substance abuse treatment settings as described by Simpson and Flynn…”
BackgroundQuality Improvement in Chronic Illness Care: A Collaborative Approach
Wagner, E. H., Glasgow, R. E., Davis, C., Bonomi, A. E., Provost, L., McCulloch, D., Carver, P., & Sixta, C. (2001) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(01)27007-2 · Cited by 726
Cooke, R. A., & Rousseau, D. M. (1988) · Group & Organization Studies · doi:10.1177/105960118801300302 · Cited by 718 · cited 1×
“Organizational culture can be defined as the implicit norms and assumptions of a work unit that guide behaviors (Cooke and Rousseau 1988) and can impact how readily new technologies will be considered and adopted in practice (Caccia-Bava et al. 2006; Hemmelgarn et al. 2001).”
BackgroundChorpita, B. F., & Daleiden, E. L. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0014565 · Cited by 687 · cited 1×
“However, the characteristics of the EBP may allow for more or less flexibility in intervention delivery while adhering to EBP core elements demonstrated to be responsible for treatment outcome effects (Chorpita and Daleiden 2009; Chorpita and Regan 2009).”
BackgroundImplementing computerized technology: An organizational analysis.
Klein, K. J., Conn, A. B., & Sorra, J. S. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.5.811 · Cited by 615
Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0148-5 · Cited by 608
Diffusion of Modern Software Practices: Influence of Centralization and Formalization
Zmud, R. W. (1982) · Management Science · doi:10.1287/mnsc.28.12.1421 · Cited by 597 · cited 2×
“Leadership is critical in the effective and sustainable implementation of innovation (Edmondson et al. 2001; Rogers 2003).”
BackgroundGlasgow, R. E. (2006) · Health Education Research · doi:10.1093/her/cyl081 · Cited by 565 · cited 1×
“The RE-AIM model (Glasgow et al. 1999; Glasgow et al. 2006) explicitly identifies the ‘‘maintenance’’ phase of implementation as critical in sustaining effective health interventions.”
MethodA conceptual framework for transferring research to practice
Simpson, D. D. (2002) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(02)00231-3 · Cited by 538 · cited 4×
“Thus, individuals who do not view the climate of their organization as welcoming innovation and organizations whose cultures do not promote exploration of practices in response to challenges are highly unlikely to explore the use of EBPs (Damanpour 1991; Klein and Sorra 1996; Simpson 2002).”
BackgroundInfluentialThe Breakthrough Series: IHI’s Collaborative Model for Achieving Breakthrough Improvement
Institute for Healthcare Improvement (2004) · Diabetes Spectrum · doi:10.2337/diaspect.17.2.97 · Cited by 526
Aarons, G. A. (2006) · Psychiatric Services · doi:10.1176/appi.ps.57.8.1162 · Cited by 518 · cited 6×
“Individual provider attitudes toward adoption of EBPs vary with organizational characteristics as well as demographic predictors such as education level, professional status (Aarons 2004), and organizational culture and climate (Aarons and Sawitzky 2006).”
BackgroundInfluentialSelf-citationAchieving the promise: Transforming mental health care in America: (432262008-003)
The President's New Freedom Commission on Mental Health (2007) · PsycEXTRA Dataset · doi:10.1037/e432262008-003 · Cited by 495
Blueprints for Violence Prevention: (304162003-001)
Mihalic, S., Irwin, K., Elliott, D., Fagan, A., & Hansen, D. (2001) · PsycEXTRA Dataset · doi:10.1037/e304162003-001 · Cited by 487
Aarons, G. A., & Sawitzky, A. C. (2006) · Psychological Services · doi:10.1037/1541-1559.3.1.61 · Cited by 482 · cited 3×
“In addition, readiness is also related to process factors such as organizational culture and climate and individual attitudes toward innovation (Aarons and Sawitzky 2006; Armenakis et al. 2007; Glisson and Schoenwald 2005).”
BackgroundSelf-citationNo going back: A review of the literature on sustaining organizational change
Buchanan, D., Fitzgerald, L., Ketley, D., Gollop, R., Jones, J. L., Lamont, S. S., Neath, A., & Whitby, E. (2005) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2005.00111.x · Cited by 475 · cited 2×
“The direct influence of such pathways on an adoption decision may take the form of educating a potential decision maker about the costs and benefits of using an innovation, which may have the effect of lowering (or raising) perceptions of risk regarding costs and benefits of initiating an…”
BackgroundTeam Effectiveness In Complex Organizations
Salas, E., Goodwin, G. F., & Burke, C. S. (2008) · Journal of International Crisis and Risk Communication Research · doi:10.4324/9780203889312 · Cited by 465
Learning from failure in health care: frequent opportunities, pervasive barriers
Edmondson, A. C. (2004) · Quality and Safety in Health Care · doi:10.1136/qshc.2003.009597 · Cited by 452
Implementation of Evidence-based Practice in Child Welfare: Service Provider Perspectives
Aarons, G. A., & Palinkas, L. A. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0121-3 · Cited by 450 · cited 3×
“Leadership at all pertinent levels (e.g., executive director, middle manager, clinical supervisor) combined with organizational support promotes a positive implementation climate, attitudes, and readiness for implementation (Aarons 2006; Aarons and Palinkas 2007; Klein et al. 2001).”
BackgroundSelf-citationHenggeler, S. W., Pickrel, S. G., & Brondino, M. J. (1999) · Mental Health Services Research · doi:10.1023/a:1022373813261 · Cited by 449
Measuring the perceived support for innovation in organizations.
Siegel, S. M., & Kaemmerer, W. F. (1978) · Journal of Applied Psychology · doi:10.1037/0021-9010.63.5.553 · Cited by 426 · cited 2×
“Such contexts can be found in organizations characterized by support for creative innovation and new ideas, tolerance of differences, personal commitment, and psychological safety (Ash 1997; Siegel and Kaemmerer 1978).”
BackgroundToward the Effective and Efficient Measurement of Implementation Fidelity
Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0321-0 · Cited by 422 · cited 1×
“However, technology transfer may be facilitated by adjusting implementation plans to the culture of a human service agency (Keller and Galanter 1999) and, although a difficult task, some aspects of organizational culture can be changed (Schraeder et al. 2005).”
BackgroundNational Survey of Psychotherapy Training in Psychiatry, Psychology, and Social Work
Weissman, M. M., Verdeli, H., Gameroff, M. J., Bledsoe, S. E., Betts, K., Mufson, L., Fitterling, H., & Wickramaratne, P. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.8.925 · Cited by 422 · cited 2×
“The Inner Context”
BackgroundEvidence-Based Implementation of Evidence-Based Medicine
Grol, R., & Grimshaw, J. (1999) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30464-3 · Cited by 421 · cited 1×
“…of effective implementation, as many different factors need to be addressed in sequence or in tandem for effective implementation that retains impact in community settings (Ferlie and Shortell 2001; Fixsen et al. 2009; Glisson and Schoenwald 2005; Grimshaw et al. 2001; Grol and Grimshaw 1999).”
BackgroundMendel, P., Meredith, L. S., Schoenbaum, M., Sherbourne, C. D., & Wells, K. B. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0144-9 · Cited by 407 · cited 5×
“Others emphasize the significance of ongoing and extensive partnerships with agencies, consumers, and other stakeholders in the community to shape the design and implementation of quality improvement initiatives (Mendel et al. 2008).”
BackgroundInfluentialBlase, K. A., Van Dyke, M., Fixsen, D. L., & Bailey, F. W. (2012) · Handbook of Implementation Science for Psychology in Education · doi:10.1017/cbo9781139013949.004 · Cited by 395
Organizational Change Recipients' Beliefs Scale: Development of an Assessment Instrument
Armenakis, A. A., Bernerth, J. B., Pitts, J. P., & Walker, H. J. (2007) · The Journal of Applied Behavioral Science · doi:10.1177/0021886307303654 · Cited by 386 · cited 1×
“In addition, readiness is also related to process factors such as organizational culture and climate and individual attitudes toward innovation (Aarons and Sawitzky 2006; Armenakis et al. 2007; Glisson and Schoenwald 2005).”
BackgroundHollenbeck, J. R., Ilgen, D. R., Sego, D. J., Hedlund, J., Major, D. A., & Phillips, J. (1995) · Journal of Applied Psychology · doi:10.1037/0021-9010.80.2.292 · Cited by 381
Glisson, C., & Schoenwald, S. K. (2005) · Mental Health Services Research · doi:10.1007/s11020-005-7456-1 · Cited by 373 · cited 10×
“The ARC model developed by Charles Glisson invokes the concept of sustainment in the ‘‘self-regulation’’ phase of the implementation process (Glisson and Schoenwald 2005).”
BackgroundMethodInfluentialThe Use of Research to Improve Professional Practice: a systematic review of the literature
HEMSLEY-BROWN, J., & SHARP, C. (2003) · Oxford Review of Education · doi:10.1080/0305498032000153025 · Cited by 360
National Institute of Mental Health (NIMH)
(2008) · Encyclopedia of Global Health · doi:10.4135/9781412963855.n834 · Cited by 348
IDM Supervision: An Integrated Developmental Model for Supervising Counselors and Therapists
Stoltenberg, C. D., McNeill, B. W., & Delworth, U. (1997) · Medical Entomology and Zoology · Cited by 345
(1982) · Cited by 335
Evidence-based treatments in child abuse and neglect
Chaffin, M., & Friedrich, B. (2004) · Children and Youth Services Review · doi:10.1016/j.childyouth.2004.08.008 · Cited by 325
Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005) · Behavior Therapy · doi:10.1016/s0005-7894(05)80049-8 · Cited by 320 · cited 1×
“Without an internal organizational champion, the probability that a practice will move past the Exploration and Adoption phases and into the Implementation Phase will likely be lower (Forgatch et al. 2005; Price et al. 1998; Rogers 2003).”
BackgroundAarons, G. A., Research Network on Youth Mental Health, Glisson, C., Hoagwood, K., Kelleher, K., Landsverk, J., & Cafri, G. (2010) · Psychological Assessment · doi:10.1037/a0019188 · Cited by 316 · cited 1×
“Level of education, level of professional experience, primary discipline, and race/ethnicity are associated with openness toward adopting EBPs (Aarons 2004, 2005; Aarons et al. 2010).”
BackgroundSelf-citationOrganizational Culture and Climate: Implications for Services and Interventions Research.
Hemmelgarn, A. L., Glisson, C., & James, L. R. (2006) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2006.00008.x · Cited by 307
Aarons, G. A., Wells, R. S., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009) · American Journal of Public Health · doi:10.2105/ajph.2009.161711 · Cited by 299 · cited 6×
“Whether an EBP is part of new services, being integrated into existing services, or replacing existing funded services, fiscal resource availability is critical (Aarons et al. 2009).”
BackgroundInfluentialSelf-citationAarons, G. A., Sommerfeld, D. H., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013223 · Cited by 299 · cited 6×
“Whether an EBP is part of new services, being integrated into existing services, or replacing existing funded services, fiscal resource availability is critical (Aarons et al. 2009).”
BackgroundInfluentialSelf-citationGlisson, C., Dukes, D., & Green, P. (2006) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2005.12.010 · Cited by 298
Aarons, G. A. (2005) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2004.04.008 · Cited by 296 · cited 2×
“Level of education, level of professional experience, primary discipline, and race/ethnicity are associated with openness toward adopting EBPs (Aarons 2004, 2005; Aarons et al. 2010).”
BackgroundSelf-citationSzapocznik, J., & Williams, R. A. (2000) · Clinical Child and Family Psychology Review · doi:10.1023/a:1009512719808 · Cited by 286 · cited 2×
“Creative outer context solutions can be developed.”
BackgroundBorntrager, C. F., Chorpita, B. F., Higa-McMillan, C., & Weisz, J. R. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.5.677 · Cited by 277 · cited 1×
“In addition, definitions of EBP may vary and one study found more favorable attitudes after training in modularized treatment where attitudes were measured relative to perceived evidence rather than manualization (Borntrager et al. 2009).”
BackgroundAarons, G. A., Sommerfeld, D. H., & Walrath-Greene, C. M. (2009) · Implementation Science · doi:10.1186/1748-5908-4-83 · Cited by 276 · cited 6×
“Whether an EBP is part of new services, being integrated into existing services, or replacing existing funded services, fiscal resource availability is critical (Aarons et al. 2009).”
InfluentialSelf-citationBarth, R. P., Landsverk, J., Chamberlain, P., Reid, J. B., Rolls, J. A., Hurlburt, M. S., Farmer, E. M. Z., James, S., McCabe, K. M., & Kohl, P. L. (2005) · Research on Social Work Practice · doi:10.1177/1049731505276321 · Cited by 269 · cited 2×
“Second, the discussion of the use of EBPs in child welfare is reasonably recent (Barth et al. 2005; Chadwick Center 2004; NAPCWA 2005) and traditional social work education has not focused on dissemination of knowledge about EBPs (Weissman et al. 2006), although there is a growing recognition of…”
BackgroundMethodSelf-citationRandomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy.
Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019160 · Cited by 243 · cited 1×
“Considerable information is available on the organizational characteristics that promote the exploration and eventual adoption of innovation (Greenhalgh et al. 2004; Rogers 2003) and EBPs in mental health and social service organizations (Glisson et al. 2010).”
BackgroundScience, Policy, and Practice: Three Cultures in Search of a Shared Mission
Shonkoff, J. P. (2000) · Child Development · doi:10.1111/1467-8624.00132 · Cited by 234
Aarons, G. A., Cafri, G., Lugo, L., & Sawitzky, A. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0302-3 · Cited by 225
Self-citationWallen, G. R., Mitchell, S. A., Melnyk, B., Fineout‐Overholt, E., Miller‐Davis, C., Yates, J., & Hastings, C. (2010) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2010.05442.x · Cited by 224
Glisson, C., & Green, P. (2006) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-005-0016-0 · Cited by 216 · cited 1×
“Culture and Climate Organizational culture and climate can have a profound influence on organizational functioning and effectiveness in public sector services (Glisson et al. 2006; Glisson and Green 2006).”
BackgroundOrganizational Process: A Missing Link Between Research and Practice
Rosenheck, R. A. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.12.1607 · Cited by 202
Moving innovations into treatment: A stage-based approach to program change
Simpson, D. D., & Flynn, P. M. (2007) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2006.12.023 · Cited by 195 · cited 2×
“…has received the most attention in public sector services, due largely to the work of Glisson and colleagues in children’s services (Glisson and Hemmelgarn 1998; Glisson and James 2002; Glisson and Schoenwald 2005) and in substance abuse treatment settings as described by Simpson and Flynn (2007).”
BackgroundMethodInnovation Modification during Intraorganizational Adoption
Lewis, L. K., & Seibold, D. R. (1993) · The Academy of Management Review · doi:10.2307/258762 · Cited by 193 · cited 1×
“In addition, positive social influences within organizations can be facilitated through events, communications, ideas, objects, and behaviors that support positive attitudes, beliefs and behaviors relevant to EBP (Lewis and Seibold 1993).”
BackgroundFoxhall, L. (2010) · THE DEVELOPMENT OF THE POLIS IN ARCHAIC GREECE · doi:10.4324/9780203440827_chapter_10 · Cited by 190
Adaptive Designs for Randomized Trials in Public Health
Brown, C. H., Ten Have, T. R., Jo, B., Dagne, G., Wyman, P. A., Muthén, B., & Gibbons, R. D. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100223 · Cited by 184 · cited 2×
“This phase can also include models for expansion and scaling-up within a service system beyond an initial implementation trial (Brown et al. 2009).”
BackgroundStetler, C. B., Mittman, B. S., & Francis, J. (2008) · Implementation Science · doi:10.1186/1748-5908-3-8 · Cited by 176
Reviewing the behavioral science knowledge base on technology transfer. Introduction.
Backer, T. E., David, S. L., & Soucy, G. (1995) · PubMed · Cited by 175
Ash, J. (1997) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1997.0040102 · Cited by 174 · cited 2×
“Such contexts can be found in organizations characterized by support for creative innovation and new ideas, tolerance of differences, personal commitment, and psychological safety (Ash 1997; Siegel and Kaemmerer 1978).”
BackgroundMeasurement of Perceived Organizational Readiness for Change in the Public Sector
Cinite, I., Duxbury, L. E., & Higgins, C. (2009) · British Journal of Management · doi:10.1111/j.1467-8551.2008.00582.x · Cited by 160
Framing for Learning: Lessons in Successful Technology Implementation
Edmondson, A. C. (2003) · California Management Review · doi:10.2307/41166164 · Cited by 159 · cited 4×
“However, strong charismatic leadership may be required to create the conditions for sustained use of EBP once the active implementation phase is complete (Edmondson 2003a).”
BackgroundInfluentialRole Efficacy, Role Clarity, and Role Performance Effectiveness
Bray, S. R., & Brawley, L. R. (2002) · Small Group Research · doi:10.1177/104649640203300204 · Cited by 150
Schoenwald, S. K., Chapman, J. E., Kelleher, K., Hoagwood, K. E., Landsverk, J., Stevens, J., Glisson, C., Rolls-Reutz, J., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0147-6 · Cited by 149
Leykum, L. K., Pugh, J. A., Lanham, H. J., Harmon, J., & McDaniel, R. R. (2009) · Implementation Science · doi:10.1186/1748-5908-4-69 · Cited by 146
O'REILLY, C. A., & CALDWELL, D. F. (1985) · Journal of Occupational Psychology · doi:10.1111/j.2044-8325.1985.tb00195.x · Cited by 143 · cited 1×
“Four social norms in the workplace are positively associated with a receptive or open context: (1) support for creativity and risk taking (2) teamwork, (3) speed of action, and (4) tolerance of mistakes (O’Reilly and Caldwell 1985).”
BackgroundEvidence-based practice implementation and staff emotional exhaustion in children's services
Aarons, G. A., Fettes, D. L., Flores, L. E., & Sommerfeld, D. H. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.006 · Cited by 135
Self-citationStrategies for Improving Fidelity in the National Evidence-Based Practices Project
Bond, G. R., Drake, R. E., McHugo, G. J., Rapp, C. A., & Whitley, R. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335531 · Cited by 134 · cited 1×
“Unfortunately, the process of implementing evidencebased practices is often complex and fraught with challenges (Backer 2000; Bond et al. 2009; Institute of Medicine [IOM] 2007).”
BackgroundSchraeder, M., Tears, R. S., & Jordan, M. H. (2005) · Leadership & Organization Development Journal · doi:10.1108/01437730510617681 · Cited by 125 · cited 1×
“…service organizations, those with a strong focus on development of new knowledge and understanding of best practices (i.e., ‘‘learning organizations,’’ (Senge 2006), as well as incentives to adopt best practices are likely well poised to explore appropriate practices and implementation strategies…”
BackgroundPalinkas, L. A., Schoenwald, S. K., Hoagwood, K., Landsverk, J. A., Chorpita, B. F., & Weisz, J. R. (2008) · Psychiatric Services · doi:10.1176/ps.2008.59.7.738 · Cited by 119
Child Protection: Using Research to Improve Policy and Practice
Haskins, R., Wulczyn, F., & Webb, M. B. (2007) · Project Muse (Johns Hopkins University) · Cited by 115
Changing Patterns of State Responsibility: A Case Study of North Carolina
Behar, L. (1985) · Journal of Clinical Child Psychology · doi:10.1207/s15374424jccp1403_4 · Cited by 115 · cited 2×
“The Adoption Assistance and Child Welfare Act of 1980 (1980) and the Family Preservation and Support Services Program amendment of 1993 (1993) emerged at a time when there was significant concern about too many children being placed in foster care or other residential care settings (Behar 1985; Knitzer 1982) rather th…”
BackgroundThe Decision to Adopt Evidence-Based and Other Innovative Mental Health Practices: Risky Business?
Panzano, P. C., & Roth, D. (2006) · Psychiatric Services · doi:10.1176/appi.ps.57.8.1153 · Cited by 115
Palinkas, L. A., Holloway, I. W., Rice, E., Fuentes, D., Wu, Q., & Chamberlain, P. (2011) · Implementation Science · doi:10.1186/1748-5908-6-113 · Cited by 113
Hanf, K., & O'Toole, L. J. (1992) · European Journal of Political Research · doi:10.1111/j.1475-6765.1992.tb00293.x · Cited by 112
Emergency Room Culture and the Emotional Support Component of Family-Centered Care
Hemmelgarn, A. L., Glisson, C., & Dukes, D. (2001) · Children's Health Care · doi:10.1207/s15326888chc3002_2 · Cited by 112 · cited 1×
“Organizational culture can be defined as the implicit norms and assumptions of a work unit that guide behaviors (Cooke and Rousseau 1988) and can impact how readily new technologies will be considered and adopted in practice (Caccia-Bava et al. 2006; Hemmelgarn et al. 2001).”
BackgroundClimate Discrepancy: Refining the Concepts of Psychological and Organizational Climate
Joyce, W. F., & Slocum, J. (1982) · Human Relations · doi:10.1177/001872678203501102 · Cited by 112
Foster Care in New York and Illinois: The Challenge of Rapid Change
Wulczyn, F. H., & Goerge, R. M. (1992) · Social Service Review · doi:10.1086/603914 · Cited by 108 · cited 2×
“These laws reflected a heightened awareness of the large and growing numbers of children in foster care (Wulczyn and Goerge 1992) and the lack of services to prevent out-of-home placements.”
BackgroundTraining and fidelity monitoring of behavioral interventions in multi-site addictions research
Baer, J. S., Ball, S. A., Campbell, B. K., Miele, G. M., Schoener, E. P., & Tracy, K. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2006.08.028 · Cited by 108
Evans, C., Connell, J., Barkham, M., Marshall, C., & Mellor‐Clark, J. (2003) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.384 · Cited by 107 · cited 1×
“Improving leadership, developing readiness for innovation, and developing systems and organizations with a learning orientation will likely facilitate EBP implementation (Aarons and Palinkas 2007; Evans et al. 2003; Iles 2003).”
BackgroundOvercoming Barriers to Collaboration: Psychological Safety and Learning in Diverse Teams
Edmondson, A. C., & Roloff, K. S. (2008) · Routledge eBooks · doi:10.4324/9780203889312-16 · Cited by 101
Chamberlain, P., Brown, C. H., Saldana, L., Reid, J., Wang, W., Marsenich, L., Sosna, T., Padgett, C., & Bouwman, G. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0167-x · Cited by 100 · cited 6×
“The Outer Context”
BackgroundMethodInfluentialMeasuring persistence of implementation: QUERI Series
Initiative, T. H. Q. E. R., Bowman, C. C., Sobo, E. J., Asch, S. M., & Gifford, A. L. (2008) · Implementation Science · doi:10.1186/1748-5908-3-21 · Cited by 100
Cost Shifting to Jails after a Change to Managed Mental Health Care
Domino, M. E., Norton, E. C., Morrissey, J. P., & Thakur, N. (2004) · Health Services Research · doi:10.1111/j.1475-6773.2004.00295.x · Cited by 99
Crampton, D. (2007) · Child & Family Social Work · doi:10.1111/j.1365-2206.2006.00442.x · Cited by 95 · cited 3×
“Foundations, such as American Humane and the Annie E. Casey Foundation, which also assume client advocacy roles through efforts to shape policy, have had a strong influence on the adoption of service models such as Team Decision Making (Crampton 2007), which has become increasingly widespread in its application in chi…”
BackgroundKorunka, C., & Vitouch, O. (1999) · Work & Stress · doi:10.1080/02678379950019798 · Cited by 91 · cited 4×
“…‘‘consent decrees’’ that specify mandated changes to be undertaken by the service system under the decree such as increased caseworker training, foster parent training, and use of assessments (Korunka and Vitouch 1999; Robinson et al. 2002) that may be addressed, in part, through the use of EBPs.”
BackgroundInfluentialWebster-Stratton, C. H. (2005) · Cited by 91
The Organizational Readiness for Change scale in adolescent programs: Criterion validity
Saldana, L., Chapman, J. E., Henggeler, S. W., & Rowland, M. D. (2007) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2006.12.029 · Cited by 88
Patterson, F., Ferguson, E., & Thomas, S. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03174.x · Cited by 87
Ganju, V. (2003) · Schizophrenia Bulletin · doi:10.1093/oxfordjournals.schbul.a006982 · Cited by 87 · cited 2×
“…improving services designed to support the mental health and well-being of children and families involved in public sector services is influenced as much by the process of implementing innovative practices as by the practices selected for implementation (Aarons and Palinkas 2007; Crea et al.…”
BackgroundMethodHospital organization culture, capacity to innovate and success in technology adoption
do Carmo Caccia‐Bava, M., Guimaraes, T., & Harrington, S. J. (2006) · Journal of Health Organization and Management · doi:10.1108/14777260610662735 · Cited by 86
Evaluating Intensive Family Preservation Programs: A Methodological Review
Heneghan, A. M., Horwitz, S. M., & Leventhal, J. M. (1996) · Pediatrics · doi:10.1542/peds.97.4.535 · Cited by 85
Self-citationAmerican Psychiatric Association.
Zarin, D. A., & Sabshin, M. (2000) · Oxford University Press eBooks · doi:10.1037/10516-050 · Cited by 81
Organizational culture and leadership
Patching, K. (2007) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230625426_15 · Cited by 78
Chorpita, B. F., & Regan, J. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.002 · Cited by 75
Bruns, E. J., Hoagwood, K., Rivard, J. C., Wotring, J., Marsenich, L., & CARTER, B. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e3181684557 · Cited by 72 · cited 2×
“…has established an Evidence-based Treatment Dissemination Center (EBTDC) to support training and year-long consultation to front-line clinicians (Bruns et al. 2008) and the State of Ohio has developed ‘‘Coordinating Centers of Excellence’’ to promote use of best-practices and EBPs (Ohio…”
BackgroundAdair, J. C. (1990) · Cited by 71
Addressing community problems : psychological research and interventions
Arriaga, X. B., & Oskamp, S. (1998) · Cited by 61
Iterations of the SafeCare Model: An Evidence-Based Child Maltreatment Prevention Program
Edwards, A., & Lutzker, J. R. (2008) · Behavior Modification · doi:10.1177/0145445508317137 · Cited by 60
Normative Influences in Organizations
Cialdini, R. B., Bator, R. J., & Guadagno, R. E. (1999) · Psychology Press eBooks · doi:10.4324/9781410603227-9 · Cited by 57 · cited 1×
“Fostering receptive system and organizational norms can be influential in shaping desired attitudes and behaviors in which adherence to structure and procedure (e.g., EBP) provides social approval and rejection avoidance (Cialdini et al. 1999).”
BackgroundA successful academic-community partnership to improve the publicʼs health
Maurana, C. A., & Goldenberg, K. (1996) · Academic Medicine · doi:10.1097/00001888-199605000-00009 · Cited by 55 · cited 1×
“…partnerships can take different forms but some key elements have been identified including empowering community participants, frank discussion of issues and concerns of all stakeholders, building trust, and identification and valuing of needs of all stakeholders (Maurana and Goldenberg 1996).”
BackgroundDisrupted Routines: Team Learning and New Technology Adaptation
Edmondson, A. C., Bohmer, R. M. J., & Pisano, G. P. (2001) · Cited by 51
(2007) · PubMed · Cited by 51
Hennessy, K. D., & Green‐Hennessy, S. (2011) · Psychiatric Services · doi:10.1176/ps.62.3.pss6203_0303 · Cited by 46
Crea, T. M., Crampton, D. S., Abramson-Madden, A., & Usher, C. L. (2008) · Children and Youth Services Review · doi:10.1016/j.childyouth.2008.03.007 · Cited by 45 · cited 1×
“…involved in public sector services is influenced as much by the process of implementing innovative practices as by the practices selected for implementation (Aarons and Palinkas 2007; Crea et al. 2008; Fixsen et al. 2009; Greenhalgh et al. 2004; Palinkas and Aarons 2009; Palinkas et al. 2008).”
BackgroundA Synthesis of Research on Family Preservation and Family Reunification Programs
Littell, J. H., & Schuerman, J. R. (1995) · Scholarship, Research, and Creative Work at Bryn Mawr College (Bryn Mawr College) · Cited by 45
Gabriel, R. M. (2000) · Journal of Community Psychology · doi:10.1002/(sici)1520-6629(200005)28:3<257::aid-jcop3>3.0.co;2-l · Cited by 40
Palinkas, L. A., & Aarons, G. A. (2009) · International journal of child health and human development · Cited by 38
Self-citationThe Effect of Leadership on Workers in Human Service Organizations
Glisson, C. A. (1989) · Administration in Social Work · doi:10.1300/j147v13n03_06 · Cited by 34 · cited 1×
“More general organizational climate includes perceptions of job characteristics and the work group (Glisson 1989).”
BackgroundJenson, J. M. (2007) · Research on Social Work Practice · doi:10.1177/1049731507300236 · Cited by 32
Iles, I. K. (2003) · Journal of Learning Disabilities · doi:10.1177/1469004703007001985 · Cited by 30 · cited 1×
“Improving leadership, developing readiness for innovation, and developing systems and organizations with a learning orientation will likely facilitate EBP implementation (Aarons and Palinkas 2007; Evans et al. 2003; Iles 2003).”
BackgroundTechnology Transfer of Network Therapy to Community-Based Addictions Counselors
Keller, D. S., & Galanter, M. (1999) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(98)00044-0 · Cited by 29
Graham, I. D., & Tetroe, J. (2009) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2009.00140.x · Cited by 29
Cashin, C., Scheffler, R. M., Felton, M., Adams, N. H., & Miller, L. S. (2008) · Psychiatric Services · doi:10.1176/ps.2008.59.10.1107 · Cited by 27 · cited 2×
“This can be a particularly critical issue in public sector service organizations where turnover rates can range from 20% to 50% annually.”
BackgroundShared Cognition in Organizations
(1999) · Psychology Press eBooks · doi:10.4324/9781410603227 · Cited by 27
Reviewing the Behavioral Science Knowledge Base on Technology Transfer: NIDA Research Monograph 155
Backer, T. E., David, S. L., & Saucy, G. (1995) · PsycEXTRA Dataset · doi:10.1037/e495742006-001 · Cited by 26
Chamberlain, P., Snowden, L. R., Padgett, C., Saldana, L., Roles, J., Holmes, L., Ward, H., Soper, J., Reid, J., & Landsverk, J. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0318-8 · Cited by 24
HOAGWOOD, K. (2003) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1301.015 · Cited by 24 · cited 3×
“Client Advocacy As noted by Hoagwood (2003), clients can be powerful advocates for system change through both their demands on individual providers and through their advocacy efforts with legislators.”
BackgroundEstablishing a Basis for Multi-System Collaboration: Systemic Team Development
Bertram, R. M. (2008) · The Journal of Sociology & Social Welfare · doi:10.15453/0191-5096.3383 · Cited by 20 · cited 2×
“However, building expertise across an entire service system may require collaboration and building expertise across and between organizations to instantiate and sustain an EBP (Bertram 2008; Edmondson and Roloff 2009).”
BackgroundSobo, E. J., Bowman, C., Aarons, G. A., Asch, S., & Gifford, A. L. (2008) · Human Organization · doi:10.17730/humo.67.4.6p5778357w511757 · Cited by 20 · cited 1×
“The Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI) describes a process for utilizing individual medical centers as drivers of change around specific service approaches in other VA centers (Bowman et al. 2008).”
BackgroundSelf-citationHoagwood, K. E., Kelleher, K., Murray, L. K., & Jensen, P. S. (2006) · Revista Brasileira de Psiquiatria · doi:10.1590/s1516-44462006000100012 · Cited by 16
Toward a New Paradigm for Public Health Practice and Academic Partnerships
Quill, B. E., & Aday, L. A. (2000) · Journal of Public Health Management and Practice · doi:10.1097/00124784-200006010-00002 · Cited by 15
Nunno, M. (2006) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2006.03.001 · Cited by 13
Berzin, S. C. (2008) · The Journal of Sociology & Social Welfare · Cited by 9
Cashin, C., Scheffler, R., Felton, M., Adams, N., & Miller, L. (2008) · Psychiatric Services · doi:10.1176/appi.ps.59.10.1107 · Cited by 7
Class Action Litigation: Judicial Reform of Child Welfare Systems in the United States
Lowry, M. R., Freundlich, M., Gerstenzang, S., & Gerstenzang, S. (2002) · Adoption & Fostering · doi:10.1177/030857590202600308 · Cited by 5
Fiester, L. (2008) · Issue Lab (Candid) · Cited by 5
(1998) · doi:10.1002/(sici)1099-1379(199805)19:3<235::aid-job837>3.0.co;2-c
Translation and Implementation of Evidence-Based Practices
Palinkas, L. A. (2011) · Translation and Implementation of Evidence-Based Practice · doi:10.1093/acprof:oso/9780195398489.003.0002
Research works printed but not linked: 8
- Aos, S. (2006). Intensive family preservation programs: Program fidelity influences effectiveness revised (No. 06-02-3901). Olympia: Washington State Institute for Public Policy.
- California Institute for Mental Health [CIMH]. (2006). Community Development Team model: Supporting the model adherent implementation of programs and practices. Sacramento: California Institute for Mental Health.
- Chadwick Center. (2004). Closing the quality chasm in child abuse treatment: Identifying and disseminating best practices. San Diego, CA: Children’s Hospital-San Diego, Chadwich Center for Children and Families.
- Davies, H. T. O., & Nutley, S. M. (2008). Learning more about how research-based knowledge gets used: Guidance in the development of new empirical research. New York, NY: William T. Grant Foundation.
- Institute of Medicine [IOM]. (2007). The state of quality improvement and implementation research: Expert views. Workshop summary. Washington, DC: The National Academies Press.
- National Association of Public Child Welfare Administrators [NAPCWA]. (2005). Guide for child welfare administrators on evidence based practice. Washington DC: APHSA.
- National Institute of Mental Health [NIMH]. (2001). Blueprint for change: Research on child and adolescent mental health. Bethesda, MD: National Institutes of Health.
- Srivastava, S. K., & Bathla, A. (1996). Correlational study of organizational climate and work adjustment among industrial workers. Social Science International, 12(1), 52–60.
Cited by
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0528-y · Cited by 12,038
Self-citationThe updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
“[78] also note four”
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724
“Sustainment The continued use of an intervention within practice [10].”
BackgroundWiltsey Stirman, S., Baumann, A. A., & Miller, C. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0898-y · Cited by 1,329
Metadata
- Authors
- Aarons, G. A., Hurlburt, M., & Horwitz, S. M.
- Affiliations
- University of California San Diego (US)
- University of Southern California (US)
- Rady Children's Hospital-San Diego (US)
- Corresponding author
- Aarons, Gregory A.
- Venue
- Administration and Policy in Mental Health and Mental Health Services Research
- Published
- 2010-12-14
- Volume
- 38
- Issue
- 1
- Pages
- 4-23
- ISSN
- 0894-587X (ISSN-L)
- 1573-3289
- PMC
- PMC3025110
- OpenAlex
- W2044858486
- Cited by
- 3,240
- References
- 171
- Citations by year
- 2026: 306 · 2025: 331 · 2024: 333 · 2023: 311 · 2022: 307 · 2021: 274 · 2020: 251 · 2019: 257 · 2018: 170 · 2017: 168 · 2016: 111 · 2015: 143 · 2014: 107 · 2013: 96 · 2012: 48
- FWCI
- 93.26
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- Administration and Policy in Mental Health and Mental Health Services Research (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (P30MH074678, R01MH072961)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- evidence-based practice implementation, implementation science, public service sector, conceptual model, multi-level model, implementation stages, exploration, adoption, implementation, program sustainability, public mental health services, social services, drug and alcohol services, organizational context
- MeSH terms
- Child, Child Welfare, Diffusion of Innovation, Health Plan Implementation, Humans, Mental Health Services, Social Work, United States, Models, Organizational, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

