Policy to implementation: evidence-based practice in community mental health – study protocol
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Evidence-based treatments (EBTs) are not widely available in community mental health settings. In response to the call for implementation of evidence-based treatments in the United States, states and counties have mandated behavioral health reform through policies and other initiatives. Evaluations of the impact of these policies on implementation are rare. A systems transformation about to occur in Philadelphia, Pennsylvania, offers an important opportunity to prospectively study implementation in response to a policy mandate. METHODS/DESIGN: Using a prospective sequential mixed-methods design, with observations at multiple points in time, we will investigate the responses of staff from 30 community mental health clinics to a policy from the Department of Behavioral Health encouraging and incentivizing providers to implement evidence-based treatments to treat youth with mental health problems. Study participants will be 30 executive directors, 30 clinical directors, and 240 therapists. Data will be collected prior to the policy implementation, and then at two and four years following policy implementation. Quantitative data will include measures of intervention implementation and potential moderators of implementation (i.e., organizational- and leader-level variables) and will be collected from executive directors, clinical directors, and therapists. Measures include self-reported therapist fidelity to evidence-based treatment techniques as measured by the Therapist Procedures Checklist-Revised, organizational variables as measured by the Organizational Social Context Measurement System and the Implementation Climate Assessment, leader variables as measured by the Multifactor Leadership Questionnaire, attitudes towards EBTs as measured by the Evidence-Based Practice Attitude Scale, and knowledge of EBTs as measured by the Knowledge of Evidence- Based Services Questionnaire. Qualitative data will include semi-structured interviews with a subset of the sample to assess the implementation experience of high-, average-, and low-performing agencies. Mixed methods will be integrated through comparing and contrasting results from the two methods for each of the primary hypotheses in this study. DISCUSSION: Findings from the proposed research will inform both future policy mandates around implementation and the support required for the success of these policies, with the ultimate goal of improving the quality of treatment provided to youth in the public sector.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Self-citationAdvancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 2×
“Activities under Aim 3 will result in qualitative data from a subset of agencies to understand key informants’ perspective about the implementation process, and will generate information about the mechanisms through which organizational- and leader-level variables may drive implementation [15,32].”
BackgroundMethodSelf-citationEmpirically supported psychological interventions: Controversies and evidence
Chambless, D. L., & Ollendick, T. H. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.685 · Cited by 2,097
Antonakis, J., Avolio, B. J., & Sivasubramaniam, N. (2003) · The Leadership Quarterly · doi:10.1016/s1048-9843(03)00030-4 · Cited by 1,533 · cited 1×
“The MLQ is the gold-standard tool to measure transformational leadership from the organizational literature, and psychometric analyses have confirmed the factor structure of the measurement model [27].”
MethodManaging Clinical Knowledge for Health Care Improvement
Balas, E. A., & Boren, S. A. (2000) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1637943 · Cited by 1,479 · cited 1×
“Despite well-established evidence of EBTs for youth with psychosocial difficulties [1], it takes up to 17 years for these treatments to make their way into community settings [2].”
BackgroundAarons, G. A. (2004) · Mental Health Services Research · doi:10.1023/b:mhsr.0000024351.12294.65 · Cited by 1,272 · cited 3×
“The EBPAS demonstrates good internal consistency, subscale alphas range from .59 to .90 [29], and its validity is supported by its relationship with both therapist-level attributes and organizational characteristics [30].”
BackgroundInfluentialSelf-citationMixed method designs in implementation research
Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0314-z · Cited by 1,187
Self-citationBeidas, R. S., & Kendall, P. C. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01187.x · Cited by 1,085
Self-citationAssessing organizational readiness for change
Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(02)00233-7 · Cited by 863 · cited 2×
“, Organizational Readiness for Change [23], Organizational Readiness for Change Assessment [24]).”
BackgroundThe cross‐level effects of culture and climate in human service teams
Glisson, C., & James, L. R. (2002) · Journal of Organizational Behavior · doi:10.1002/job.162 · Cited by 758
Cited by
A PRACTICAL IMPLEMENTATION SCIENCE HEURISTIC FOR ORGANIZATIONAL READINESS: R = MC2
Scaccia, J. P., Cook, B. S., Lamont, A., Wandersman, A., Castellow, J., Katz, J., & Beidas, R. S. (2015) · Journal of Community Psychology · doi:10.1002/jcop.21698 · Cited by 375
Self-citationLyon, A. R., & Bruns, E. J. (2019) · School Mental Health · doi:10.1007/s12310-018-09306-w · Cited by 191
Quantitative measures of health policy implementation determinants and outcomes: a systematic review
Allen, P., Pilar, M., Walsh-Bailey, C., Hooley, C., Mazzucca, S., Lewis, C. C., Mettert, K. D., Dorsey, C. N., Purtle, J., Kepper, M. M., et al. (2020) · Implementation Science · doi:10.1186/s13012-020-01007-w · Cited by 164
Valenstein-Mah, H., Greer, N., McKenzie, L., Hansen, L., Strom, T. Q., Wiltsey Stirman, S., Wilt, T. J., & Kehle-Forbes, S. M. (2020) · Implementation Science · doi:10.1186/s13012-020-00998-w · Cited by 104
Beidas, R. S., Maclean, J. C., Fishman, J., Dorsey, S., Schoenwald, S. K., Mandell, D. S., Shea, J. A., McLeod, B. D., French, M. T., Hogue, A., et al. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-1034-z · Cited by 50
Self-citation
Metadata
- Authors
- Beidas, R. S., Aarons, G., Barg, F., Evans, A., Hadley, T., Hoagwood, K., Marcus, S., Schoenwald, S., Walsh, L., & Mandell, D. S.
- Venue
- Implementation Science
- Published
- 2013-03-24
- Volume
- 8
- Issue
- 1
- Pages
- 38-38
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W2065367930
- Cited by
- 81
- References
- 20
- FWCI
- 14.38
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Policy to implementation: evidence-based practice in community mental health – study protocol. https://app.cochat.ai/papers/10.1186/1748-5908-8-38
- The paper
- Beidas, R. S., Aarons, G., Barg, F., Evans, A., Hadley, T., Hoagwood, K., Marcus, S., Schoenwald, S., Walsh, L., & Mandell, D. S. (2013). Policy to implementation: evidence-based practice in community mental health – study protocol. Implementation Science. https://doi.org/10.1186/1748-5908-8-38
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.