A Multi-Level Examination of Stakeholder Perspectives of Implementation of Evidence-Based Practices in a Large Urban Publicly-Funded Mental Health System
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Our goal was to identify barriers and facilitators to the implementation of evidence-based practices from the perspectives of multiple stakeholders in a large publicly funded mental health system. We completed 56 interviews with three stakeholder groups: treatment developers (n = 7), agency administrators (n = 33), and system leadership (n = 16). The three stakeholder groups converged on the importance of inner (e.g., agency competing resources and demands, therapist educational background) and outer context (e.g., funding) factors as barriers to implementation. Potential threats to implementation and sustainability included the fiscal landscape of community mental health clinics and an evolving workforce. Intervention characteristics were rarely endorsed as barriers. Inner context, outer context, and intervention characteristics were all seen as important facilitators. All stakeholders endorsed the importance of coordinated collaboration across stakeholder groups within the system to successfully implement evidence-based practices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maslow, A. H. (1943) · Psychological Review · doi:10.1037/h0054346 · Cited by 21,563
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 3×
“We found that barriers and facilitators clustered around inner context factors, outer context factors, and intervention characteristics, consistent with leading implementation frameworks (Aarons et al. 2011; Damschroder et al. 2009), and specifically the EPIS framework which guided our research questions (Aarons et al.”
BackgroundQualitative Data Analysis for Health Services Research: Developing Taxonomy, Themes, and Theory
Bradley, E. H., Curry, L. A., & Devers, K. J. (2007) · Health Services Research · doi:10.1111/j.1475-6773.2006.00684.x · Cited by 3,437 · cited 4×
“Each reviewer produced memos including examples and commentary to reach consensus regarding newly-derived, emergent themes that emerged from the codes (Bradley et al. 2007).”
BackgroundMethodInfluentialAdvancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 9×
“2009), and specifically the EPIS framework which guided our research questions (Aarons et al. 2011).”
BackgroundMethodInfluentialSelf-citationEvidence-based practice in psychology.
American Psychological Association (2006) · American Psychologist · doi:10.1037/0003-066x.61.4.271 · Cited by 2,478
Linehan, M. M., Comtois, K. A., Murray, A. M., Brown, M. Z., Gallop, R. J., Heard, H. L., Korslund, K. E., Tutek, D. A., Reynolds, S. K., & Lindenboim, N. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.7.757 · Cited by 2,025 · cited 2×
“2005); and Dialectical Behavior Therapy (DBT; Linehan et al. 2006).”
BackgroundMethodA Multisite, Randomized Controlled Trial for Children With Sexual Abuse–Related PTSD Symptoms
Cohen, J. A., Deblinger, E., Mannarino, A. P., & Steer, R. A. (2004) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200404000-00005 · Cited by 1,123 · cited 2×
“DBHIDS subsequently implemented other EBPs, including Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT; Cohen et al. 2004); Prolonged Exposure (Foa et al. 2005); and Dialectical Behavior Therapy (DBT; Linehan et al. 2006).”
MethodCore Implementation Components
Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335549 · Cited by 1,103
Foa, E. B., Hembree, E. A., Cahill, S. P., Rauch, S. A. M., Riggs, D. S., Feeny, N. C., & Yadin, E. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.953 · Cited by 931 · cited 2×
“DBHIDS subsequently implemented other EBPs, including Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT; Cohen et al. 2004); Prolonged Exposure (Foa et al. 2005); and Dialectical Behavior Therapy (DBT; Linehan et al. 2006).”
BackgroundMethodMcHugh, R. K., & Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0018121 · Cited by 909 · cited 2×
“health field and results of efforts to implement EBPs have had some disappointing results (McHugh and Barlow 2010).”
BackgroundLangley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010) · School Mental Health · doi:10.1007/s12310-010-9038-1 · Cited by 477
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015) · Implementation Science · doi:10.1186/s13012-014-0192-y · Cited by 435
Self-citationAarons, G. A., Wells, R. S., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009) · American Journal of Public Health · doi:10.2105/ajph.2009.161711 · Cited by 299 · cited 9×
“Third, this study adds to the literature on potential threats to implementation and sustainability including the fiscal landscape of CMHCs (Aarons et al. 2009; Green and Aarons 2011; Isett et al. 2007; Willging et al. 2015) and a changing workforce (Hoge and Morris 2004; Hoge et al.”
BackgroundResultInfluentialSelf-citationLong-Term Sustainability of Evidence-Based Practices in Community Mental Health Agencies
Bond, G. R., Drake, R. E., McHugo, G. J., Peterson, A. E., Jones, A. M., & Williams, J. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0461-5 · Cited by 172 · cited 1×
“A number of recent papers have identified funding as a critical lever to the implementation of EBPs in systems (Bond et al. 2014; Green and Aarons 2011; Isett et al. 2007; Willging et al. 2015), and it is not surprising that stakeholders from all three groups raised financing as a barrier.”
BackgroundWriting implementation research grant proposals: ten key ingredients
Proctor, E. K., Powell, B. J., Baumann, A. A., Hamilton, A. M., & Santens, R. L. (2012) · Implementation Science · doi:10.1186/1748-5908-7-96 · Cited by 169
Self-citationInteragency collaborative team model for capacity building to scale-up evidence-based practice
Hurlburt, M., Aarons, G. A., Fettes, D., Willging, C., Gunderson, L., & Chaffin, M. J. (2014) · Children and Youth Services Review · doi:10.1016/j.childyouth.2013.10.005 · Cited by 132
Self-citationPalinkas, L. A., Holloway, I. W., Rice, E., Fuentes, D., Wu, Q., & Chamberlain, P. (2011) · Implementation Science · doi:10.1186/1748-5908-6-113 · Cited by 113 · cited 3×
“…important insights about barriers and facilitators to implementation, most of the studies only interviewed therapists (for an exception, see Palinkas et al. 2011) and did not interview different stakeholder groups involved in the implementation process such as agency leaders, system…”
BackgroundRingle, V. A., Read, K. L., Edmunds, J. M., Brodman, D. M., Kendall, P. C., Barg, F., & Beidas, R. S. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201400134 · Cited by 102 · cited 4×
“intervention characteristics (Ringle et al. 2015) and intervention-setting fit (Damschroder et al.”
BackgroundInfluentialSelf-citationWillging, C. E., Green, A. E., Gunderson, L., Chaffin, M., & Aarons, G. A. (2015) · Child Maltreatment · doi:10.1177/1077559514547384 · Cited by 66 · cited 5×
“Third, this study adds to the literature on potential threats to implementation and sustainability including the fiscal landscape of CMHCs (Aarons et al. 2009; Green and Aarons 2011; Isett et al. 2007; Willging et al. 2015) and a changing workforce (Hoge and Morris 2004; Hoge et al.”
BackgroundResultInfluentialSelf-citation
Cited by
Frank, H. E., Becker-Haimes, E. M., & Kendall, P. C. (2020) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12330 · Cited by 297
Williams, N. J., & Beidas, R. S. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12960 · Cited by 233
“…the determinants or test the relationships between these determinants and a variety of implementation outcomes such as EBP adoption, fidelity, and sustainment (Beidas et al., 2015; Beidas et al., 2016; Locke et al., 2017; Palinkas et al., 2017; Stein, Celedonia, Kogan, Swartz, & Frank, 2013).”
BackgroundSelf-citationBeidas, R. S., Volpp, K. G., Buttenheim, A. N., Marcus, S. C., Olfson, M., Pellecchia, M., Stewart, R. E., Williams, N. J., Becker-Haimes, E. M., Candon, M., et al. (2019) · JMIR Research Protocols · doi:10.2196/12121 · Cited by 28
Self-citationDopp, A. R., Perrine, C. M., Iovan, S., & Lantz, P. M. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00940-3 · Cited by 7
Lindhiem, O., Bennett, C. B., Beidas, R. S., Grasso, D. J., Sakolsky, D. J., & Druzdzel, M. J. (2018) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2017.07.002 · Cited by 5
Self-citation
Metadata
- Authors
- Beidas, R. S., Stewart, R. E., Adams, D. R., Fernandez, T., Lustbader, S., Powell, B. J., Aarons, G. A., Hoagwood, K. E., Evans, A. C., Hurford, M. O., Rubin, R., Hadley, T., Mandell, D. S., & Barg, F. K.
- Venue
- Administration and Policy in Mental Health and Mental Health Services Research
- Published
- 2015-12-12
- Volume
- 43
- Issue
- 6
- Pages
- 893-908
- ISSN
- 0894-587X (ISSN-L)
- 1573-3289
- OpenAlex
- W2277762792
- Cited by
- 122
- References
- 20
- FWCI
- 17.53
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.