Long-Term Sustainability of Evidence-Based Practices in Community Mental Health Agencies

Bond, Gary R.; Drake, Robert E.; McHugo, Gregory J.; Peterson, Alison E.; Jones, Amanda M.; Williams, Jessica

doi:10.1007/s10488-012-0461-5

Cited by 173Health Policy Implementation SciencePsychiatric care and mental health servicesHealth Sciences Research and Education

Long-Term Sustainability of Evidence-Based Practices in Community Mental Health Agencies

Bond, Gary R., Drake, Robert E., McHugo, Gregory J., Peterson, Alison E., Jones, Amanda M., Williams, Jessica·2014·Administration and Policy in Mental Health and Mental Health Services Research

DOI 10.1007/s10488-012-0461-5

Open this paper in CoChat — free account

Abstract

This study examined rates of sustainability, defined as program continuation, and factors associated with sustainability 6 years after full implementation of five evidence-based practices in 49 sites in the National Implementing Evidence-Based Practices Project. Based on interviews with agency leaders and state leaders, 47 % of sites sustained the practice for 6 years, 16 % restarted the practice after a period of discontinuation, and 37 % discontinued the practice permanently. Agency leaders from discontinuing sites identified inadequate financial support, lack of prioritization, and workforce issues as barriers to continuation. Adequate financing, ongoing supervision, and monitoring of fidelity and outcome may promote long-term sustainability.

Integrity signals

Registry

Crossref · 10.1007/s10488-012-0461-5

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Funding is often identified as the major barrier to program sustainment.
“Funding is often identified as the major barrier to program sustainment [20, 31, 55].”
From Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention (2022) · cites this paper as [55]
It is likely that providers do not engage in evidence-based care, given its infrequent practice in the community.
“It is also likely that providers do not engage in evidence-based care, given its infrequent practice in the community.1,11,12”
From Using Machine Learning to Match Clients and Therapy Providers: Evaluating Clinical Quality and Cost of Care (2025) · cites this paper as [11]
Many sustainability studies in clinical/health care and mental health settings suggest that funding, organizational factors and support, and practitioner/workforce characteristics are particularly influential.
“Consistent with organizational contexts in community settings (e.g., schools), many of these studies, particularly those in clinics or hospitals, suggest that funding, organizational factors and support (e.g., champions, supervision), and practitioner/workforce characteristics (e.g., turnover) are particularly influential (13, 98, 125).”
From The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care (2018) · cites this paper as [13]
The added costs of implementing and sustaining EBPs are a barrier to their use in healthcare settings.
“Such translation is important, given that the added costs of implementing and sustaining EBPs are a barrier to their use in healthcare settings [4–6].”
From Translating economic evaluations into financing strategies for implementing evidence-based practices (2021) · cites this paper as [4]

The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · see citing works
Diffusion of Innovations 1
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
Diffusion of innovations
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,555 · see citing works
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · see citing works
Untitled work
(2005) · Cited by 3,748 · see citing works
The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355 · see citing works
Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy
Shediac-Rizkallah, M. C., & Bone, L. R. (1998) · Health Education Research · doi:10.1093/her/13.1.87 · Cited by 1,129 · see citing works
Illness Management and Recovery: A Review of the Research
Mueser, K. T., Corrigan, P. W., Hilton, D. W., W, B. T. M. S., Schaub, A., Gingerich, S. L., Essock, S. M., Tarrier, N., Morey, B., Vogel-Scibilia, S., et al. (2002) · Psychiatric Services · doi:10.1176/appi.ps.53.10.1272 · Cited by 679 · see citing works
A guiding framework and approach for implementation research in substance use disorders treatment.
Damschroder, L. J., & Hagedorn, H. J. (2011) · Psychology of Addictive Behaviors · doi:10.1037/a0022284 · Cited by 427 · see citing works
Generalizability of the Individual Placement and Support (IPS) model of supported employment outside the US
Bond, G. R., Drake, R. E., & Becker, D. R. (2012) · World Psychiatry · doi:10.1016/j.wpsyc.2012.01.005 · Cited by 360 · see citing works
Self-citation
Fidelity Outcomes in the National Implementing Evidence-Based Practices Project
McHugo, G. J., Drake, R. E., Whitley, R., Bond, G. R., Campbell, K., Rapp, C. A., Goldman, H. H., Lutz, W. J., & Finnerty, M. T. (2007) · Psychiatric Services · doi:10.1176/ps.2007.58.10.1279 · Cited by 315 · see citing works
Self-citation
Economic Impacts of Assertive Community Treatment: A Review of the Literature
Latimer, E. A. (1999) · The Canadian Journal of Psychiatry · doi:10.1177/070674379904400504 · Cited by 251 · see citing works
The Sustainability of Evidence-Based Practices in Routine Mental Health Agencies
Swain, K., Whitley, R., McHugo, G. J., & Drake, R. E. (2009) · Community Mental Health Journal · doi:10.1007/s10597-009-9202-y · Cited by 193 · see citing works
Self-citation
The De-adoption of Innovative Mental Health Practices (IMHP): Why Organizations Choose not to Sustain an IMHP
Massatti, R. R., Sweeney, H. A., Panzano, P. C., & Roth, D. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0141-z · Cited by 153 · see citing works
Implementing the Illness Management and Recovery Program in Community Mental Health Settings: Facilitators and Barriers
Whitley, R., Gingerich, S. L., Lutz, W. J., & Mueser, K. T. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.2.202 · Cited by 132 · see citing works
Implementation of Integrated Dual Disorders Treatment: A Qualitative Analysis of Facilitators and Barriers
Brunette, M. F., Asher, D., Whitley, R., Lutz, W. J., Wieder, B., Jones, A. M., & McHugo, G. J. (2008) · Psychiatric Services · doi:10.1176/ps.2008.59.9.989 · Cited by 122 · see citing works
Self-citation
Assertive Community Treatment: Facilitators and Barriers to Implementation in Routine Mental Health Settings
Mancini, A. D., Moser, L. L., Whitley, R., McHugo, G. J., Bond, G. R., Finnerty, M. T., & Burns, B. J. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.2.189 · Cited by 117 · see citing works
Self-citation
Evidence-Based Practice Implementation in Community Mental Health Settings: The Relative Importance of Key Domains of Implementation Activity
Torrey, W. C., Bond, G. R., McHugo, G. J., & Swain, K. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0357-9 · Cited by 108 · see citing works
Self-citation
Illness ManageMent and RecoveRy
Gingerich, S. L., & Mueser, K. T. (2005) · Cited by 100 · see citing works
Fidelity of supported employment: Lessons learned from the National Evidence-Based Practice Project.
Bond, G. R., McHugo, G. J., Becker, D. R., Rapp, C. A., & Whitley, R. (2008) · Psychiatric Rehabilitation Journal · doi:10.2975/31.4.2008.300.305 · Cited by 86 · see citing works
Self-citation
Promoting the Implementation of Practices that are Supported by Research: The National Implementing Evidence-Based Practice Project
Torrey, W. C., Lynde, D., & Gorman, P. (2005) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2004.05.004 · Cited by 56 · see citing works
Assertive Community Treatment
Baron, S., Bond, G. R., Chapman, M. V., Decker, D. J., Edgar, E. R., Cox, J. W., Harron, B., Julius, B., Linkins, K. W., Mueser, K. T., et al. (2002) · Cited by 55 · see citing works
Self-citation
Assertive Community Treatment: Facilitators and Barriers to Implementation in Routine Mental Health Settings
Mancini, A., Moser, L. L., Whitley, R., McHugo, G. J., Bond, G. R., Finnerty, M. T., & Burns, B. J. (2009) · Psychiatric Services · doi:10.1176/appi.ps.60.2.189 · Cited by 33 · see citing works
Self-citation
Evidence-Based Practices for Medicaid Beneficiaries with Schizophrenia and Bipolar DisorderPreprint
Brown, J. D., Barrett, A., Ireys, H. T., Caffery, E., & Hourihan, K. (2012) · RePEc: Research Papers in Economics · Cited by 14 · see citing works

Flagged first, then by citations

1 of the 25 references couldn’t be matched to a known paper.

Sorted by citations

The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014731 · Cited by 806 · see citing works
Economic evaluation in implementation science: Making the business case for implementation strategies
Eisman, A. B., Kilbourne, A. M., Dopp, A. R., Saldana, L., & Eisenberg, D. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.008 · Cited by 210 · see citing works
Making the Case for IPS Supported Employment
Bond, G. R., & Drake, R. E. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0444-6 · Cited by 189 · see citing works
Self-citation
A pragmatic method for costing implementation strategies using time-driven activity-based costing
Cidav, Z., Mandell, D., Pyne, J., Beidas, R., Curran, G., & Marcus, S. (2020) · Implementation Science · doi:10.1186/s13012-020-00993-1 · Cited by 174 · see citing works
A Multi-Level Examination of Stakeholder Perspectives of Implementation of Evidence-Based Practices in a Large Urban Publicly-Funded Mental Health System
Beidas, R. S., Stewart, R. E., Adams, D. R., Fernandez, T., Lustbader, S., Powell, B. J., Aarons, G. A., Hoagwood, K., Evans, A. C., Hurford, M. O., et al. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0705-2 · Cited by 123 · see citing works
Mixed-method approaches to strengthen economic evaluations in implementation research
Dopp, A. R., Mundey, P., Beasley, L. O., Silovsky, J. F., & Eisenberg, D. (2019) · Implementation Science · doi:10.1186/s13012-018-0850-6 · Cited by 118 · see citing works
Built to last? Barriers and facilitators of healthcare program sustainability: a systematic integrative review
Zurynski, Y. A., Ludlow, K., Testa, L., Augustsson, H., Herkes, J., Hutchinson, K., Lamprell, G., McPherson, E., Carrigan, A., Ellis, L. A., et al. (2023) · Implementation Science · doi:10.1186/s13012-023-01315-x · Cited by 109 · see citing works
The Perfect Storm: Collision of the Business of Mental Health and the Implementation of Evidence-Based Practices
Stewart, R. E., Adams, D. R., Mandell, D. S., Hadley, T. R., Evans, A. C., Rubin, R. M., Erney, J., Neimark, G. B., Hurford, M. O., & Beidas, R. S. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201500392 · Cited by 86 · see citing works
A scoping review of strategies for financing the implementation of evidence-based practices in behavioral health systems: State of the literature and future directions
Dopp, A. R., Narcisse, M.-R., Mundey, P., Silovsky, J. F., Smith, A. B., Mandell, D., Funderburk, B. W., Powell, B. J., Schmidt, S., Edwards, D., et al. (2020) · Implementation Research and Practice · doi:10.1177/2633489520939980 · Cited by 79 · see citing works
Predicting the Long-Term Sustainability of Evidence-Based Practices in Mental Health Care: An 8-Year Longitudinal Analysis
Peterson, A. E., Bond, G. R., Drake, R. E., McHugo, G. J., Jones, A. M., & Williams, J. R. (2014) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-013-9347-x · Cited by 60 · see citing works
Self-citation
De-adoption of an Evidence-Based Trauma Intervention in Schools: A Retrospective Report from an Urban School District
Nadeem, E., & Ringle, V. A. M. (2016) · School Mental Health · doi:10.1007/s12310-016-9179-y · Cited by 63 · see citing works
Sustaining complex interventions in long-term care: a qualitative study of direct care staff and managers
Colon-Emeric, C. S., Toles, M., Cary, M. P., Batchelor‐Murphy, M., Yap, T. L., Song, Y., Hall, R. K., Anderson, A. L., Burd, A., & Anderson, R. A. (2015) · Implementation Science · doi:10.1186/s13012-016-0454-y · Cited by 62 · see citing works
Costs to Community Mental Health Agencies to Sustain an Evidence-Based Practice
Roundfield, K. D., & Lang, J. M. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600193 · Cited by 60 · see citing works
Measuring Sustainment of Multiple Practices Fiscally Mandated in Children’s Mental Health Services
Brookman-Frazee, L. I., Stadnick, N. A., Roesch, S. C., Regan, J., Barnett, M. L., Bando, L., Innes-Gomberg, D., & Lau, A. S. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0731-8 · Cited by 56 · see citing works
Experiences with the implementation of Individual Placement and Support for people with severe mental illness: a qualitative study among stakeholders
Vukadin, M., Schaafsma, F. G., Westerman, M. J., Michon, H. W. C., & Anema, J. R. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1729-4 · Cited by 56 · see citing works
Translating economic evaluations into financing strategies for implementing evidence-based practices
Dopp, A. R., Kerns, S. E. U., Panattoni, L., Ringel, J. S., Eisenberg, D., Powell, B. J., Low, R., & Raghavan, R. (2021) · Implementation Science · doi:10.1186/s13012-021-01137-9 · Cited by 52 · see citing works
The IPS Learning Community: A Longitudinal Study of Sustainment, Quality, and Outcome
Bond, G. R., Drake, R. E., Becker, D. R., & Noel, V. A. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201500301 · Cited by 51 · see citing works
Self-citation
Sustainability of innovations in healthcare: A systematic review and conceptual framework for professional pharmacy services
Crespo-González, C., Benrimoj, S. I., Scerri, M., & García‐Cárdenas, V. (2020) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2020.01.015 · Cited by 51 · see citing works
A mixed-methods study of system-level sustainability of evidence-based practices in 12 large-scale implementation initiatives
Scudder, A. T., Taber-Thomas, S., Schaffner, K. F., Pemberton, J. R., Hunter, L., & Herschell, A. D. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0230-8 · Cited by 48 · see citing works
Understanding sustained domestic violence identification in maternal and child health nurse care: process evaluation from a 2‐year follow‐up of the MOVE trial
Hooker, L., Small, R., & Taft, A. (2016) · Journal of Advanced Nursing · doi:10.1111/jan.12851 · Cited by 47 · see citing works
The survivability of dialectical behaviour therapy programmes: a mixed methods analysis of barriers and facilitators to implementation within UK healthcare settings
King, J., Hibbs, R., Saville, C. W. N., & Swales, M. A. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1876-7 · Cited by 47 · see citing works
Exploring the impact of workforce turnover on the sustainability of evidence-based programs: A scoping review
Pascoe, K. M., Petrescu-Prahova, M. G., Steinman, L. E., Bacci, J. L., Mahorter, S. S., Belza, B. L., & Weiner, B. J. (2021) · Implementation Research and Practice · doi:10.1177/26334895211034581 · Cited by 47 · see citing works
Barriers and Facilitators to Sustainment of an Evidence-Based Supported Employment Program
Noel, V. A., Bond, G. R., Drake, R. E., Becker, D. R., McHugo, G. J., Swanson, S. J., Luciano, A. E., & Greene, M. A. (2017) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0778-6 · Cited by 42 · see citing works
Self-citation
Organizational Factors Influencing Implementation of Evidence-Based Practices for Integrated Treatment in Behavioral Health Agencies
Bonham, C. A., Sommerfeld, D. H., Willging, C. E., & Aarons, G. A. (2014) · Psychiatry Journal · doi:10.1155/2014/802983 · Cited by 42 · see citing works
Community-based implementation of trauma-focused interventions for youth: Economic impact of the learning collaborative model.
Dopp, A. R., Hanson, R. F., Saunders, B. E., Dismuke, C. E., & Moreland, A. D. (2017) · Psychological Services · doi:10.1037/ser0000131 · Cited by 41 · see citing works
Social rhythm therapy—A potentially translatable psychosocial intervention for bipolar disorder
Crowe, M., Inder, M., Swartz, H. A., Murray, G., & Porter, R. (2019) · Bipolar Disorders · doi:10.1111/bdi.12840 · Cited by 39 · see citing works
Moving Upstream to Improve Children’s Mental Health Through Community and Policy Change
Dopp, A. R., & Lantz, P. M. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-01001-5 · Cited by 41 · see citing works
Rates of sustainment in the Universal Stages of Implementation Completion
Wong, D. R., Schaper, H., & Saldana, L. (2022) · Implementation Science Communications · doi:10.1186/s43058-021-00250-6 · Cited by 40 · see citing works
Sustained Community Implementation of JASPER Intervention with Toddlers with Autism
Shire, S. Y., Shih, W., Chang, Y., Bracaglia, S., Kodjoe, M., & Kasari, C. L. (2019) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-018-03875-0 · Cited by 37 · see citing works
Improving and sustaining delivery of CPT for PTSD in mental health systems: a cluster randomized trial
Wiltsey Stirman, S., Finley, E. P., Shields, N., Cook, J., Haine-Schlagel, R., Burgess, J. F., Dimeff, L., Koerner, K., Suvak, M., Gutner, C. A., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0544-5 · Cited by 35 · see citing works
Evaluating the Implementation of Health Checks for Adults With Intellectual and Developmental Disabilities in Primary Care: The Importance of Organizational Context
Durbin, J., Selick, A., Casson, I., Green, L., Spassiani, N. A., Perry, A., & Lunsky, Y. (2016) · Intellectual and developmental disabilities · doi:10.1352/1934-9556-54.2.136 · Cited by 34 · see citing works
Using Survival Analysis to Understand Patterns of Sustainment within a System-Driven Implementation of Multiple Evidence-Based Practices for Children’s Mental Health Services
Brookman-Frazee, L. I., Zhan, C., Stadnick, N. A., Sommerfeld, D. H., Roesch, S. C., Aarons, G. A., Innes-Gomberg, D., Bando, L., & Lau, A. S. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00054 · Cited by 34 · see citing works
When Do Therapists Stop Using Evidence-Based Practices? Findings from a Mixed Method Study on System-Driven Implementation of Multiple EBPs for Children
Lau, A. S., Lind, T., Crawley, M., Rodríguez, A., Smith, A. M., & Brookman-Frazee, L. I. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00987-2 · Cited by 34 · see citing works
Lessons From Maslow: Prioritizing Funding to Improve the Quality of Community Mental Health and Substance Use Services
Stewart, R. E., Mandell, D. S., & Beidas, R. S. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202000209 · Cited by 31 · see citing works
How to implement Illness Management and Recovery (IMR) in mental health service settings: evaluation of the implementation strategy
Egeland, K. M., Ruud, T., Ogden, T., Färdig, R., Lindstrøm, J. C., & Heiervang, K. S. (2017) · International Journal of Mental Health Systems · doi:10.1186/s13033-017-0120-z · Cited by 31 · see citing works
A virtual learning collaborative to implement health promotion in routine mental health settings: Protocol for a cluster randomized trial
Aschbrenner, K. A., Pratt, S. I., Bond, G. R., Zubkoff, L., Naslund, J. A., Jue, K., Williams, G., Kinney, A., Cohen, M. J., Godfrey, M. M., et al. (2019) · Contemporary Clinical Trials · doi:10.1016/j.cct.2019.105816 · Cited by 29 · see citing works
Self-citation
Comparing two federal financing strategies on penetration and sustainment of the adolescent community reinforcement approach for substance use disorders: protocol for a mixed-method study
Dopp, A. R., Hunter, S. B., Godley, M. D., Pham, C., Han, B., Smart, R., Cantor, J., Kilmer, B., Hindmarch, G., González, I. E., et al. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00298-y · Cited by 27 · see citing works
An Economic Analysis of the Implementation of Team-based Collaborative Care in Outpatient General Mental Health Clinics
Miller, C. J., Griffith, K. N., Stolzmann, K. L., Kim, B., Connolly, S. L., & Bauer, M. S. (2020) · Medical Care · doi:10.1097/mlr.0000000000001372 · Cited by 27 · see citing works
Automated telehealth for managing psychiatric instability in people with serious mental illness
Pratt, S. I., Naslund, J. A., Wolfe, R. S., Santos, M. M., & Bartels, S. J. (2014) · Journal of Mental Health · doi:10.3109/09638237.2014.928403 · Cited by 26 · see citing works
How is the sustainability of chronic disease health programmes empirically measured in hospital and related healthcare services?—a scoping review
Francis, L., Dunt, D., & Cadilhac, D. A. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010944 · Cited by 24 · see citing works
Disseminating TF‐CBT: A Mixed Methods Investigation of Clinician Perspectives and the Impact of Training Format and Formalized Problem‐Solving Approaches on Implementation Outcomes
Ascienzo, S., Sprang, G., & Eslinger, J. G. (2020) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13351 · Cited by 24 · see citing works
Outer-context determinants in the sustainment phase of a reimbursement-driven implementation of evidence-based practices in children’s mental health services
Lui, J. H. L., Brookman-Frazee, L. I., Lind, T., Le, K., Roesch, S. C., Aarons, G. A., Innes-Gomberg, D., Pesanti, K., & Lau, A. S. (2021) · Implementation Science · doi:10.1186/s13012-021-01149-5 · Cited by 22 · see citing works
Long-Term Sustainability of Evidence-Based Prevention Interventions and Community Coalitions Survival: a Five and One-Half Year Follow-up Study
Johnson, K., Collins, D., Shamblen, S., Kenworthy, T., & Wandersman, A. (2017) · Prevention Science · doi:10.1007/s11121-017-0784-2 · Cited by 23 · see citing works
Transportability of Multisystemic Therapy to Community Settings: Can a Program Sustain Outcomes Without MST Services Oversight?
Smith-Boydston, J. M., Holtzman, R. J., & Roberts, M. C. (2014) · Child & Youth Care Forum · doi:10.1007/s10566-014-9255-0 · Cited by 23 · see citing works
Making Implementation Last: The Impact of Training Design on the Sustainability of an Evidence-Based Treatment in a Randomized Controlled Trial
Jackson, C. B., Herschell, A. D., Scudder, A. T., Hart, J., Schaffner, K. F., Kolko, D. J., & Mrozowski, S. J. (2021) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-021-01126-6 · Cited by 21 · see citing works
A Model for Sustaining Evidence-Based Practices in a Statewide System
Lang, J. M., Randall, K. G., Delaney, M., & Vanderploeg, J. J. (2017) · Families in Society The Journal of Contemporary Social Services · doi:10.1606/1044-3894.2017.5 · Cited by 22 · see citing works
Utilizing complexity theory to explore sustainable responses to intimate partner violence in health care
Gear, C., Eppel, E., & Koziol‐McLain, J. (2017) · Public Management Review · doi:10.1080/14719037.2017.1364407 · Cited by 19 · see citing works
Effects of dialectical behavior therapy skills training on outcomes for mental health staff in a child and adolescent residential setting
Haynos, A. F., Fruzzetti, A. E., Anderson, C., Briggs, D., & Walenta, J. H. (2016) · Journal of Hospital Administration · doi:10.5430/jha.v5n2p55 · Cited by 20 · see citing works
Facilitators and Barriers to the Implementation of EMOTION: An Indicated Intervention for Young Schoolchildren
Rasmussen, L. P., Patras, J., Neumer, S., Adolfsen, F., Martinsen, K. D., Holen, S., Sund, A. M., & Martinussen, M. (2019) · Scandinavian Journal of Educational Research · doi:10.1080/00313831.2019.1596976 · Cited by 21 · see citing works
After the study ends: A qualitative study of factors influencing intervention sustainability.
Bearman, S. K., Bailin, A., Terry, R. L., & Weisz, J. R. (2019) · Professional Psychology Research and Practice · doi:10.1037/pro0000258 · Cited by 19 · see citing works
Coordination of sustainable financing for evidence-based youth mental health treatments: protocol for development and evaluation of the fiscal mapping process
Dopp, A. R., Gilbert, M., Silovsky, J. F., Ringel, J. S., Schmidt, S. R., Funderburk, B. W., Jorgensen, A. G., Powell, B. J., Luke, D. A., Mandell, D. S., et al. (2022) · Implementation Science Communications · doi:10.1186/s43058-021-00234-6 · Cited by 20 · see citing works
Economic value of community-based services for problematic sexual behaviors in youth: A mixed-method cost-effectiveness analysis
Dopp, A. R., Mundey, P., Silovsky, J. F., Hunter, M. D., & Slemaker, A. (2019) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2019.104043 · Cited by 19 · see citing works
Drivers of continued implementation of cultural competence in substance use disorder treatment
Guerrero, E. G., Khachikian, T., Frimpong, J. A., Kong, Y., Howard, D. L., & Hunter, S. B. (2019) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2019.07.009 · Cited by 19 · see citing works
Costs and returns on training investment for empirically supported psychological interventions
Crome, E., Shaw, J., & Baillie, A. (2016) · Australian Health Review · doi:10.1071/ah15129 · Cited by 19 · see citing works
Train-to-Sustain: Predictors of Sustainment in a Large-Scale Implementation of Parent–Child Interaction Therapy
Barnett, M. L., Brookman-Frazee, L. I., Yu, S. H., Lind, T., Lui, J. H. L., Timmer, S. G., Boys, D. K., Urquiza, A. J., Innes-Gomberg, D., Quick-Abdullah, D., et al. (2021) · Evidence-Based Practice in Child and Adolescent Mental Health · doi:10.1080/23794925.2020.1855613 · Cited by 19 · see citing works
Can an Infusion of Federal Funds Result in Sustainable Projects? An Evaluation of Suicide Prevention Programs
Apsler, R., Formica, S. W., Stout, E. R., & Carr, C. M. (2017) · The Journal of Primary Prevention · doi:10.1007/s10935-017-0489-0 · Cited by 18 · see citing works
Evidence‐based policy strategies: A typology.
Bond, G. R. (2018) · Clinical Psychology Science and Practice · doi:10.1111/cpsp.12267 · Cited by 18 · see citing works
Self-citation
Practitioners' Use and Evaluation of Transdiagnostic Youth Psychotherapy Years After Training and Consultation Have Ended
Thomassin, K., Marchette, L. K., & Weisz, J. R. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00962-x · Cited by 17 · see citing works
Pivotal response treatment: A study into the relationship between therapist characteristics and fidelity of implementation
Verschuur, R., Huskens, B., Korzilius, H. P. L. M., Bakker, L. A., Snijder, M. I. J., & Didden, R. (2019) · Autism · doi:10.1177/1362361319876213 · Cited by 17 · see citing works
Role of State Mental Health Leaders in Supporting Evidence-Based Practices over Time
Jones, A. M., Bond, G. R., Peterson, A. E., Drake, R. E., McHugo, G. J., & Williams, J. R. (2013) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-013-9358-7 · Cited by 17 · see citing works
Self-citation
Programmatic Costs of Project ImPACT for Children with Autism: A Time-Driven Activity Based Costing Study
Cidav, Z., Mandell, D. S., Ingersoll, B. R., & Pellecchia, M. (2023) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-022-01247-6 · Cited by 17 · see citing works
Revisiting the policy ecology framework for implementation of evidence-based practices in mental health settings
Wortham, W. K., Rodwin, A. H., Purtle, J., Munson, M. R., & Raghavan, R. (2023) · Implementation Science · doi:10.1186/s13012-023-01309-9 · Cited by 18 · see citing works
Psychometric Properties of the General Organizational Index (GOI): A Measure of Individualization and Quality Improvement to Complement Program Fidelity
Heiervang, K. S., Egeland, K. M., Landers, M., Ruud, T., Joa, I., Drake, R. E., & Bond, G. R. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01025-2 · Cited by 16 · see citing works
Self-citation
Fidelity and sustainability in evidence-based treatments for children: An investigation of implementation determinants
Eslinger, J. G., Sprang, G., Ascienzo, S., & Silman, M. (2020) · Journal of Family Social Work · doi:10.1080/10522158.2020.1724581 · Cited by 16 · see citing works
Barriers and facilitators affecting the sustainability of dialectical behaviour therapy programmes: A qualitative study of clinician perspectives
Popowich, A. D., Mushquash, A. R., Pearson, E., Schmidt, F., & Mushquash, C. J. (2020) · Counselling and Psychotherapy Research · doi:10.1002/capr.12250 · Cited by 15 · see citing works
Cost evaluation of tobacco control interventions in clinical settings: A systematic review
Salloum, R. G., LeLaurin, J. H., Dallery, J., Childs, K., Huo, J. S., Shenkman, E. A., & Warren, G. W. (2021) · Preventive Medicine · doi:10.1016/j.ypmed.2021.106469 · Cited by 15 · see citing works
Comparison of Assertive Community Treatment Fidelity Assessment Methods: Reliability and Validity
Rollins, A. L., McGrew, J. H., Kukla, M., McGuire, A. B., Flanagan, M., Hunt, M. G., LESLIE, D. L., Collins, L. A., Wright-Berryman, J. L., Hicks, L. J., et al. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0641-1 · Cited by 15 · see citing works
Psychometric Properties of a Fidelity Scale for Illness Management and Recovery
Egeland, K. M., Heiervang, K. S., Landers, M., Ruud, T., Drake, R. E., & Bond, G. R. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00992-5 · Cited by 15 · see citing works
Self-citation
Economic Evaluations of Mental Health Programs for Children and Adolescents in the United States: A Systematic Review
Sung, J. Y., Kacmarek, C. N., & Schleider, J. L. (2021) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-020-00333-1 · Cited by 15 · see citing works
Implementation Science: Increasing the Public Health Impact of Audiology Research
Studts, C. R. (2022) · American Journal of Audiology · doi:10.1044/2022_aja-21-00205 · Cited by 14 · see citing works
Implementation of the Recovery Guide in inpatient mental health services in Sweden—A process evaluation study
Bejerholm, U., Allaskog, C., Andersson, J., Nordström, L., & Roe, D. (2022) · Health Expectations · doi:10.1111/hex.13480 · Cited by 11 · see citing works
Clinical decision-making style preferences of European psychiatrists: Results from the Ambassadors survey in 38 countries
Kuzman, M. R., Slade, M., Puschner, B., Scanferla, E., Bajić, Ž., Courtet, P., Samochowiec, J., Arango, C., Vahip, S., Taube, M., et al. (2022) · European Psychiatry · doi:10.1192/j.eurpsy.2022.2330 · Cited by 13 · see citing works
Implementing Evidence Based Practices for Children’s Mental Health: A Case Study in Implementing Modular Treatments in Community Mental Health
Cheron, D. M., Chiu, A. W., Stanick, C., Stern, H. G., Donaldson, A. R., Daleiden, E. L., & Chorpita, B. F. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00922-5 · Cited by 13 · see citing works
Health economic evaluation of a nurse-led care model from the nursing home perspective focusing on residents’ hospitalisations
Bartáková, J., Zúñiga, F., Guerbaaï, R.-A., Basinska, K., Brunkert, T., Simon, M., Denhaerynck, K., Geest, S. D., Wellens, N. I. H., Serdaly, C., et al. (2022) · BMC Geriatrics · doi:10.1186/s12877-022-03182-5 · Cited by 14 · see citing works
A Tale of Four States: Factors Influencing the Statewide Adoption of IPS
Bond, G. R., Johnson-Kwochka, A. V., Pogue, J. A., Langfitt-Reese, S., Becker, D. R., & Drake, R. E. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01087-2 · Cited by 12 · see citing works
Self-citation
A micro costing analysis of the development of a primary care intervention to improve the uptake of diabetic retinopathy screening
Ahern, S., Riordan, F., Murphy, A., Browne, J. P., Kearney, P. M., Smith, S. M., & McHugh, S. (2021) · Implementation Science · doi:10.1186/s13012-021-01085-4 · Cited by 12 · see citing works
Impact of Human Resources on Implementing an Evidence-Based HIV Prevention Intervention
McKay, V., Dolcini, M. M., & Catania, J. A. (2016) · AIDS and Behavior · doi:10.1007/s10461-016-1425-7 · Cited by 12 · see citing works
Comparing the Costs and Acceptability of Three Fidelity Assessment Methods for Assertive Community Treatment
Rollins, A. L., Kukla, M., Salyers, M. P., McGrew, J. H., Flanagan, M., LESLIE, D. L., Hunt, M. G., & McGuire, A. B. (2017) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0785-7 · Cited by 12 · see citing works
Using “remote” training and coaching to increase providers' skills for working effectively with older youth and young adults with serious mental health conditions
Walker, J. S., & Baird, C. (2019) · Children and Youth Services Review · doi:10.1016/j.childyouth.2019.02.040 · Cited by 13 · see citing works
Analysis of Start-Up Digital Mental Health Platforms for Enterprise: Opportunities for Enhancing Communication between Managers and Employees
Truong, H., & McLachlan, C. S. (2022) · Sustainability · doi:10.3390/su14073929 · Cited by 12 · see citing works
Using audit and feedback to guide tailored implementations of measurement-based care in community mental health: a multiple case study
Snider, M. D. H., Boyd, M. R., Walker, M. R., Powell, B. J., & Lewis, C. C. (2023) · Implementation Science Communications · doi:10.1186/s43058-023-00474-8 · Cited by 11 · see citing works
The Price of Practice Change
Lehman, V. E. R., Siegel, J. E., & Chiang, E. N. (2023) · Medical Care · doi:10.1097/mlr.0000000000001873 · Cited by 11 · see citing works
A Case Study of Implementing Grant-Funded Integrated Care in a Community Mental Health Center
Aby, M. (2019) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-019-09671-7 · Cited by 11 · see citing works
Significance of Leaders for Sustained Use of Evidence-Based Practices: A Qualitative Focus-Group Study with Mental Health Practitioners
Egeland, K. M., Hauge, M., Ruud, T., Ogden, T., & Heiervang, K. S. (2019) · Community Mental Health Journal · doi:10.1007/s10597-019-00430-8 · Cited by 11 · see citing works
A Cross-Site Partnership to Examine Implementation and Sustainability of a School-Based Trauma Program
Vona, P., Baweja, S., Santiago, C. D., Pears, G., Langley, A. K., & Kataoka, S. (2018) · Ethnicity & Disease · doi:10.18865/ed.28.s2.427 · Cited by 10 · see citing works
Analysis of barriers and facilitators of existing programs in Belgium for the purpose of implementing individual placement and support (IPS).
Greef, V. D. (2019) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000371 · Cited by 10 · see citing works
Evaluating and prioritizing antimicrobial stewardship programs for nursing homes: A modified Delphi panel
Kruger, S. Z., Bronskill, S. E., Jeffs, L. P., Steinberg, M., Morris, A. M., & Bell, C. M. (2020) · Infection Control and Hospital Epidemiology · doi:10.1017/ice.2020.214 · Cited by 10 · see citing works
Sporting programs aimed at inactive population groups in the Netherlands: factors influencing their long-term sustainability in the organized sports setting
Ooms, L., van Kruijsbergen, M., Collard, D. C. M., Leemrijse, C. J., & Veenhof, C. (2019) · BMC Sports Science Medicine and Rehabilitation · doi:10.1186/s13102-019-0137-5 · Cited by 10 · see citing works
Sustainability of a biobehavioral intervention implemented by therapists and sustainment in community settings
Ryba, M. M., Lo, S. B., & Andersen, B. L. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz175 · Cited by 10 · see citing works
Community-based behavioral health administrator perspectives on sustainability of Dialectical Behavior Therapy: a qualitative evaluation
Quetsch, L. B., Herschell, A. D., Kogan, J. N., Gavin, J. G., Hale, G., & Stein, B. D. (2020) · Borderline Personality Disorder and Emotion Dysregulation · doi:10.1186/s40479-020-0120-5 · Cited by 10 · see citing works
Sustainment Rates and Factors for Multidimensional Family Therapy in Europe and North America
Dakof, G. A., Ricardo, M. M., Rowe, C. L., Henderson, C. E., Rigter, H., & Liddle, H. A. (2022) · Global Implementation Research and Applications · doi:10.1007/s43477-022-00043-6 · Cited by 9 · see citing works
It’s not just the Therapist: Therapist and Country-Wide Experience Predict Therapist Adherence and Adolescent Outcome
Lange, A. M. C., van der Rijken, R. E. A., Busschbach, J. J. V., Delsing, M. J. M. H., & Scholte, R. H. J. (2017) · Child & Youth Care Forum · doi:10.1007/s10566-016-9388-4 · Cited by 9 · see citing works
Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention
Cooper, B. R., Hill, L. G., Parker, L., Jenkins, G. J., Shrestha, G., & Funaiole, A. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00303-4 · Cited by 7 · see citing works
“Funding is often identified as the major barrier to program sustainment [20, 31, 55].”
Background
Using Machine Learning to Match Clients and Therapy Providers: Evaluating Clinical Quality and Cost of Care
Lee, J. L., Billovits, C., Chen, S.-Y., Wickham, R. E., Kocher, B., Chen, C. E., & Lungu, A. (2025) · Value in Health · doi:10.1016/j.jval.2025.06.002 · Cited by 8 · see citing works
Predictors of sustainment of two distinct nutrition and physical activity programs in early care and education
Swindle, T., Bellows, L. L., Mitchell, V., Johnson, S. L., Shakya, S., Zhang, D., Selig, J. P., Whiteside-Mansell, L., & Curran, G. M. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.1010305 · Cited by 8 · see citing works
Comparing organization-focused and state-focused financing strategies on provider-level reach of a youth substance use treatment model: a mixed-method study
Dopp, A. R., Hunter, S. B., Godley, M. D., González, I. E., Bongard, M., Han, B., Cantor, J., Hindmarch, G., Lindquist, K. M., Wright, B., et al. (2023) · Implementation Science · doi:10.1186/s13012-023-01305-z · Cited by 7 · see citing works
Qualitative Analysis of Administrator, Provider, and Stakeholder Views on the Costs and Benefits of a Treatment for Problematic Sexual Behavior of Youth
Mundey, P., Slemaker, A., Dopp, A. R., Beasley, L. O., & Silovsky, J. F. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00978-3 · Cited by 8 · see citing works
The Potential of Pay-for-Success as a Financing Strategy for Evidence-Based Practices: An Illustration with Multisystemic Therapy
Dopp, A. R., Perrine, C. M., Iovan, S., & Lantz, P. M. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00940-3 · Cited by 7 · see citing works
Developing a sustainability readiness strategy for health systems: Toolkit, interactive tools, and virtual support system
Johnson, K., Collins, D. A., & Wandersman, A. (2023) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2023.102241 · Cited by 8 · see citing works
Overcoming Small to Medium Business Failure through Leadership Strategies
Jackson, G. R. (2021) · Open Journal of Business and Management · doi:10.4236/ojbm.2021.91019 · Cited by 8 · see citing works

The Sustainability of Evidence-Based Practices in Routine Mental Health Agencies
Swain, K., Whitley, R., McHugo, G. J., & Drake, R. E. (2009) · Community Mental Health Journal · doi:10.1007/s10597-009-9202-y · Cited by 193 · see citing works
Self-citation
Predicting the Long-Term Sustainability of Evidence-Based Practices in Mental Health Care: An 8-Year Longitudinal Analysis
Peterson, A. E., Bond, G. R., Drake, R. E., McHugo, G. J., Jones, A. M., & Williams, J. R. (2014) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-013-9347-x · Cited by 60 · see citing works
Self-citation
Using Survival Analysis to Understand Patterns of Sustainment within a System-Driven Implementation of Multiple Evidence-Based Practices for Children’s Mental Health Services
Brookman-Frazee, L. I., Zhan, C., Stadnick, N. A., Sommerfeld, D. H., Roesch, S. C., Aarons, G. A., Innes-Gomberg, D., Bando, L., & Lau, A. S. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00054 · Cited by 34 · see citing works
Role of State Mental Health Leaders in Supporting Evidence-Based Practices over Time
Jones, A. M., Bond, G. R., Peterson, A. E., Drake, R. E., McHugo, G. J., & Williams, J. R. (2013) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-013-9358-7 · Cited by 17 · see citing works
Self-citation
Implementation of evidence-based interventions: analyzing critical components for sustainability in community mental health services
Bergmark, M., Bejerholm, U., & Markström, U. (2018) · Social Work in Mental Health · doi:10.1080/15332985.2018.1511500 · Cited by 49 · see citing works

Authors: Bond, G. R., Drake, R. E., McHugo, G. J., Peterson, A. E., Jones, A. M., & Williams, J.
Affiliations: Dartmouth College (US)
Manila Consulting Group (United States) (US)
Corresponding author: Bond, Gary R.
ORCID: Bond, Gary R.
Drake, Robert E.
McHugo, Gregory J.
Jones, Amanda M.
Williams, Jessica
Venue: Administration and Policy in Mental Health and Mental Health Services Research
Publisher: Springer Science and Business Media LLC
Published: 2012-12-25
Volume: 41
Issue: 2
Pages: 228-236
ISSN: 0894-587X (ISSN-L)
1573-3289
DOI: 10.1007/s10488-012-0461-5
OpenAlex: W2045592170
Cited by: 172
References: 25
Citations by year: 2026: 4 · 2025: 7 · 2024: 16 · 2023: 16 · 2022: 18 · 2021: 15 · 2020: 18 · 2019: 28 · 2018: 8 · 2017: 12 · 2016: 12 · 2015: 8 · 2014: 6 · 2013: 3 · 2012: 1
FWCI: 10.24
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Administration and Policy in Mental Health and Mental Health Services Research (publishedVersion)
PubMed (publishedVersion)
Funders: Substance Abuse and Mental Health Services Administration
Topics: Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
Keywords: evidence-based practice, sustainability, community mental health centers, program continuation, implementation, barriers to sustainability, financial support, workforce challenges, supervision, fidelity monitoring
MeSH terms: Community Mental Health Services, Humans, Program Evaluation, Evidence-Based Practice

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Long-Term Sustainability of Evidence-Based Practices in Community Mental Health Agencies

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks