Measuring Costs to Community-Based Agencies for Implementation of an Evidence-Based Practice
Abstract
Healthcare reform has led to an increase in dissemination of evidence-based practices. Cost is frequently cited as a significant yet rarely studied barrier to dissemination of evidence-based practices and the associated improvements in quality of care. This study describes an approach to measuring the incremental, unreimbursed costs in staff time and direct costs to community-based clinics implementing an evidence-based practice through participating in a learning collaborative. Initial implementation costs exceeding those for providing "treatment as usual" were collected for ten clinics implementing trauma-focused cognitive behavioral therapy through participation in 10-month learning collaboratives. Incremental implementation costs of these ten community-based clinic teams averaged the equivalent of US$89,575 (US$ 2012). The most costly activities were training, supervision, preparation time, and implementation team meetings. Recommendations are made for further research on implementation costs, dissemination of evidence-based practices, and implications for researchers and policy makers.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The added costs of implementing and sustaining EBPs are a barrier to their use in healthcare settings.
“Such translation is important, given that the added costs of implementing and sustaining EBPs are a barrier to their use in healthcare settings [4–6].”
From Translating economic evaluations into financing strategies for implementing evidence-based practices (2021) · cites this paper as [5]
A major challenge to implementing and sustaining EBPs is covering associated costs with the limited, fragmented funding available.
“A major challenge to implementing and sustaining EBPs is covering associated costs with the limited, fragmented funding available [5, 23, 24].”
From Translating economic evaluations into financing strategies for implementing evidence-based practices (2021) · cites this paper as [5]
Cites
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
(2005) · Cited by 3,748 · see citing works
Clinical Psychology: Science and Practice
(2021) · Clinical Psychology Science and Practice · doi:10.1111/(issn)1468-2850 · Cited by 3,683 · see citing works
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · see citing works
Bridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386 · see citing works
Treating Trauma and Traumatic Grief in Children and Adolescents
Cohen, J. A., Mannarino, A. P., & Deblinger, E. (2006) · Cited by 1,199 · see citing works
Beidas, R. S., & Kendall, P. C. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01187.x · Cited by 1,085 · see citing works
Treating Trauma and Traumatic Grief in Children and Adolescents
Bubier, R. B. J. L., & Sloan, D. M. (2007) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-006-9043-8 · Cited by 784 · see citing works
Statewide Implementation of Evidence-Based Programs
Fixsen, D. L., Blasé, K. A., Metz, A. J. R., & Dyke, M. K. V. (2013) · Exceptional Children · doi:10.1177/001440291307900206 · Cited by 535 · see citing works
A Framework for Collaborative Improvement
Kilo, C. M. (1998) · Quality Management in Health Care · doi:10.1097/00019514-199806040-00001 · Cited by 482 · see citing works
Aarons, G. A., Wells, R. S., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009) · American Journal of Public Health · doi:10.2105/ajph.2009.161711 · Cited by 299 · see citing works
Dissemination and Implementation Research in Health
Chambers, D. (2023) · doi:10.1093/oso/9780197660690.001.0001 · Cited by 246 · see citing works
Chorpita, B. F., Research Network on Youth Mental Health, Weisz, J. R., Daleiden, E. L., Schoenwald, S. K., Palinkas, L. A., Miranda, J., Higa-McMillan, C. K., Nakamura, B. J., Austin, A. A., et al. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0034200 · Cited by 241 · see citing works
Raghavan, R., Bright, C. L., & Shadoin, A. L. (2008) · Implementation Science · doi:10.1186/1748-5908-3-26 · Cited by 205 · see citing works
A meta-systems approach to evidence-based practice for children and adolescents.
Kazak, A. E., Hoagwood, K., Weisz, J. R., Hood, K. K., Kratochwill, T. R., Vargas, A., & Banez, G. A. (2010) · American Psychologist · doi:10.1037/a0017784 · Cited by 196 · see citing works
Saldana, L. (2014) · Implementation Science · doi:10.1186/1748-5908-9-43 · Cited by 188 · see citing works
Pagoto, S., Spring, B. J., Coups, E. J., Mulvaney, S. A., Coutu, M., & Özakinci, G. (2007) · Journal of Clinical Psychology · doi:10.1002/jclp.20376 · Cited by 183 · see citing works
Economic evaluation of implementation strategies in health care
Hoomans, T., & Severens, J. L. (2014) · Implementation Science · doi:10.1186/s13012-014-0168-y · Cited by 181 · see citing works
Saldana, L., Chamberlain, P., Bradford, W. D., Campbell, M., & Landsverk, J. (2014) · Children and Youth Services Review · doi:10.1016/j.childyouth.2013.10.006 · Cited by 175 · see citing works
Building Capacity for Trauma-Informed Care in the Child Welfare System
Lang, J. M., Campbell, K., Shanley, P., Crusto, C. A., & Connell, C. M. (2016) · Child Maltreatment · doi:10.1177/1077559516635273 · Cited by 138 · see citing works
Self-citationPasieczny, N., & Connor, J. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.09.006 · Cited by 116 · see citing works
Lenz, A. S., & Hollenbaugh, K. M. (2015) · Counseling Outcome Research and Evaluation · doi:10.1177/2150137815573790 · Cited by 111 · see citing works
A Literature Review of Learning Collaboratives in Mental Health Care: Used but Untested
Nadeem, E., Olin, S.-C. S., Hill, L. C., Hoagwood, K., & Horwitz, S. M. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201300229 · Cited by 95 · see citing works
Ebert, L., Amaya-Jackson, L. M., Markiewicz, J. M., Kisiel, C., & Fairbank, J. A. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0347-y · Cited by 89 · see citing works
Cost–benefit analysis of multisystemic therapy with serious and violent juvenile offenders.
Klietz, S. J., Borduin, C. M., & Schaeffer, C. M. (2010) · Journal of Family Psychology · doi:10.1037/a0020838 · Cited by 79 · see citing works
The costs of screening and brief intervention for risky alcohol use.
Zarkin, G. A., Bray, J. W., Davis, K. L., Babor, T. F., & Higgins-Biddle, J. C. (2003) · Journal of Studies on Alcohol · doi:10.15288/jsa.2003.64.849 · Cited by 64 · see citing works
Sigel, B. A., Benton, A. H., Lynch, C. E., & Kramer, T. L. (2013) · Psychological Trauma Theory Research Practice and Policy · doi:10.1037/a0029095 · Cited by 51 · see citing works
The Role of Economic Evaluation in Dissemination and Implementation Research
Raghavan, R. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199751877.003.0005 · Cited by 49 · see citing works
Trauma-Focused Cognitive-Behavioral Therapy for Sexually Abused Children.
Cohen, J. A., Deblinger, E., & Mannarino, A. (2004) · Cited by 48 · see citing works
Statewide dissemination of an evidence-based practice using Breakthrough Series Collaboratives
Lang, J. M., Franks, R. P., Epstein, C., Stover, C. S., & Oliver, J. A. (2015) · Children and Youth Services Review · doi:10.1016/j.childyouth.2015.06.005 · Cited by 46 · see citing works
Self-citationTrauma-Focused Treatment in a State System of Care: Is It Worth the Cost?
Greer, D., Grasso, D. J., Cohen, A., & Webb, C. P. M. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0468-6 · Cited by 28 · see citing works
Cowell, A. J., Hinde, J. M., Broner, N., et al. (2014) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2014.09.004 · Cited by 15 · see citing works
Creating Public Health Policy: The Dissemination of Evidenced-based Psychological Interventions
Chorpita, B. F., Miranda, J. M., & Bernstein, A. (2010) · doi:10.1093/oxfordhb/9780195366884.013.0011 · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Dopp, A. R., Narcisse, M.-R., Mundey, P., Silovsky, J. F., Smith, A. B., Mandell, D., Funderburk, B. W., Powell, B. J., Schmidt, S., Edwards, D., et al. (2020) · Implementation Research and Practice · doi:10.1177/2633489520939980 · Cited by 79 · see citing works
Bowser, D. M., Henry, B. F., & McCollister, K. E. (2021) · Implementation Science · doi:10.1186/s13012-021-01094-3 · Cited by 61 · see citing works
Costs to Community Mental Health Agencies to Sustain an Evidence-Based Practice
Roundfield, K. D., & Lang, J. M. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600193 · Cited by 60 · see citing works
Self-citationTranslating economic evaluations into financing strategies for implementing evidence-based practices
Dopp, A. R., Kerns, S. E. U., Panattoni, L., Ringel, J. S., Eisenberg, D., Powell, B. J., Low, R., & Raghavan, R. (2021) · Implementation Science · doi:10.1186/s13012-021-01137-9 · Cited by 52 · see citing works
- Authors
- Lang, J. M., & Connell, C. M.
- Affiliations
- Yale University (US)
- Corresponding author
- Lang, Jason M.
- Venue
- The Journal of Behavioral Health Services & Research
- Published
- 2016-11-01
- Volume
- 44
- Issue
- 1
- Pages
- 122-134
- ISSN
- 1094-3412 (ISSN-L)
- 1556-3308
- OpenAlex
- W2547780838
- Cited by
- 41
- References
- 33
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 11 · 2023: 2 · 2022: 6 · 2021: 8 · 2020: 1 · 2019: 4 · 2018: 5 · 2017: 1
- FWCI
- 6.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Behavioral Health Services & Research (publishedVersion)
- PubMed (publishedVersion)
- Funders
- U.S. Children’s Bureau (90C01055)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- implementation costs, evidence-based practice dissemination, community clinics, trauma-focused cognitive behavioral therapy, learning collaborative, staff training and supervision, incremental cost, implementation barriers, health care reform
- MeSH terms
- Ambulatory Care Facilities, Costs and Cost Analysis, Primary Health Care, Surveys and Questionnaires, Wounds and Injuries, Cognitive Behavioral Therapy, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
