Employing external facilitation to implement cognitive behavioral therapy in VA clinics: a pilot study
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Although for more than a decade healthcare systems have attempted to provide evidence-based mental health treatments, the availability and use of psychotherapies remains low. A significant need exists to identify simple but effective implementation strategies to adopt complex practices within complex systems of care. Emerging evidence suggests that facilitation may be an effective integrative implementation strategy for adoption of complex practices. The current pilot examined the use of external facilitation for adoption of cognitive behavioral therapy (CBT) in 20 Department of Veteran Affairs (VA) clinics. METHODS: The 20 clinics were paired on facility characteristics, and 23 clinicians from these were trained in CBT. A clinic in each pair was randomly selected to receive external facilitation. Quantitative methods were used to examine the extent of CBT implementation in 10 clinics that received external facilitation compared with 10 clinics that did not, and to better understand the relationship between individual providers' characteristics and attitudes and their CBT use. Costs of external facilitation were assessed by tracking the time spent by the facilitator and therapists in activities related to implementing CBT. Qualitative methods were used to explore contextual and other factors thought to influence implementation. RESULTS: Examination of change scores showed that facilitated therapists averaged an increase of 19% [95% CI: (2, 36)] in self-reported CBT use from baseline, while control therapists averaged a 4% [95% CI: (-14, 21)] increase. Therapists in the facilitated condition who were not providing CBT at baseline showed the greatest increase (35%) compared to a control therapist who was not providing CBT at baseline (10%) or to therapists in either condition who were providing CBT at baseline (average 3%). Increased CBT use was unrelated to prior CBT training. Barriers to CBT implementation were therapists' lack of control over their clinic schedule and poor communication with clinical leaders. CONCLUSIONS: These findings suggest that facilitation may help clinicians make complex practice changes such as implementing an evidence-based psychotherapy. Furthermore, the substantial increase in CBT usage among the facilitation group was achieved at a modest cost.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
(2005) · Cited by 3,748
Wang, P. S., Lane, M., Olfson, M., Pincus, H. A., Wells, K. B., & Kessler, R. C. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.629 · Cited by 2,695 · cited 1×
“, only 41% of individuals who were diagnosed with a MH disorder received any MH services in a 12-month period [20].”
BackgroundBero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7156.465 · Cited by 2,396
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254
Enabling the implementation of evidence based practice: a conceptual framework.
Kitson, A., Harvey, G., & McCormack, B. (1998) · Quality in Health Care · doi:10.1136/qshc.7.3.149 · Cited by 1,985
Forsetlund, L., Bjørndal, A., Rashidian, A., Jamtvedt, G., O'Brien, M. A., Wolf, F. M., Davis, D., Odgaard-Jensen, J., & Oxman, A. D. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030.pub2 · Cited by 1,849
The Cochrane Database of Systematic Reviews
Handoll, H. H., Howe, T. E., & Madhok, R. (2002) · Physiotherapy · doi:10.1016/s0031-9406(05)60709-2 · Cited by 1,497
Kitson, A. L., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008) · Implementation Science · doi:10.1186/1748-5908-3-1 · Cited by 1,314
A Randomized Trial of Methods to Help Clinicians Learn Motivational Interviewing.
Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.6.1050 · Cited by 1,075
McHugh, R. K., & Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0018121 · Cited by 909 · cited 2×
“In the past decade, many healthcare systems have engaged in efforts to increase the use of evidence-based MH treatments, including psychotherapies [4].”
BackgroundA Multifaceted Intervention to Improve Treatment of Depression in Primary Care
Katon, W. (1996) · Archives of General Psychiatry · doi:10.1001/archpsyc.1996.01830100072009 · Cited by 835 · cited 1×
“Additionally, it is unnecessary given that brief CBT sessions have been effective for treating depression in PC settings [27-31].”
BackgroundGetting evidence into practice: the role and function of facilitation
Harvey, G., Loftus‐Hills, A., Rycroft‐Malone, J., Titchen, A., Kitson, A., McCormack, B., & Seers, K. (2002) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2002.02126.x · Cited by 730
Ingredients for change: revisiting a conceptual framework
Rycroft-Malone, J. (2002) · Quality and Safety in Health Care · doi:10.1136/qhc.11.2.174 · Cited by 701
Shortell, S. M., Bennett, C. L., & Byck, G. R. (1998) · The Milbank Quarterly · doi:10.1111/1468-0009.00107 · Cited by 639
Improving Patient Care: The Implementation of Change in Clinical Practice
Cosby, J. L. (2006) · Quality and Safety in Health Care · doi:10.1136/qshc.2005.016824 · Cited by 557
Improving Patient Care: The Implementation of Change in Clinical Practice
Grol, R. P. T. M., Wensing, M., Eccles, M., Davis, D., & Wensign, M. (2005) · Cited by 553
Mynors-Wallis, L. M., Gath, D. H., Lloyd-Thomas, A. R., & Tomlinson, D. (1995) · BMJ · doi:10.1136/bmj.310.6977.441 · Cited by 492
Stetler, C. B., Legro, M. W., Rycroft-Malone, J., Bowman, C., Curran, G., Guihan, M., Hagedorn, H., Pineros, S., & Wallace, C. M. (2006) · Implementation Science · doi:10.1186/1748-5908-1-23 · Cited by 411
Disseminating evidence-based practices in substance abuse treatment: A review with suggestions
Miller, W. R., Sorensen, J. L., Selzer, J. A., & Brigham, G. S. (2006) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2006.03.005 · Cited by 401
O'Brien, M. A., Freemantle, N., Oxman, A. D., Wolfe, F., Davis, D., & Herrin, J. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030 · Cited by 336
Fidelity Outcomes in the National Implementing Evidence-Based Practices Project
McHugo, G. J., Drake, R. E., Whitley, R., Bond, G. R., Campbell, K., Rapp, C. A., Goldman, H. H., Lutz, W. J., & Finnerty, M. T. (2007) · Psychiatric Services · doi:10.1176/appi.ps.58.10.1279 · Cited by 315
Cancer: improving early detection and prevention. A community practice randomised trial.
Dietrich, A. J., O'Connor, G. T., Keller, A., Carney, P. A., Levy, D., & Whaley, F. S. (1992) · BMJ · doi:10.1136/bmj.304.6828.687 · Cited by 236
Cognitive therapy for depression: Individual differences and the process of change
Fennell, M. J. V., & Teasdale, J. D. (1987) · Cognitive Therapy and Research · doi:10.1007/bf01183269 · Cited by 229
A clinical trial of tailored office systems for preventive service delivery
Goodwin, M. A., Zyzanski, S. J., Zronek, S., Ruhe, M., Weyer, S. M., Konrad, N., Esola, D., & Stange, K. C. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(01)00310-5 · Cited by 144 · cited 1×
“Nevertheless, in four of five randomized controlled studies, facilitation has shown a modest-tostrong effect on adoption of new clinical procedures, such as health screenings, monitoring procedures, and motivational interviewing across diverse settings [13-17].”
BackgroundScott, C., Tacchi, M. J., Jones, R., & Scott, J. (1997) · British Journal of Psychiatry · doi:10.1192/bjp.171.2.131 · Cited by 137
Lemelin, J., Hogg, W. E., & Baskerville, N. B. (2001) · Europe PMC (PubMed Central) · Cited by 128
Wolf, N. J., & Hopko, D. R. (2008) · Clinical Psychology Review · doi:10.1016/j.cpr.2007.04.004 · Cited by 116
Cook, J. M., Schnurr, P. P., Biyanova, T., & Coyne, J. C. (2009) · Psychiatric Services · doi:10.1176/appi.ps.60.5.671 · Cited by 110
Implementation and Maintenance of Quality Improvement for Treating Depression in Primary Care
Meredith, L. S., Mendel, P., Pearson, M., Wu, S.-Y., Joyce, G., Straus, J. B., Ryan, G., Keeler, E., & Unützer, J. (2006) · Psychiatric Services · doi:10.1176/appi.ps.57.1.48 · Cited by 99
Use of Psychotherapy by Rural and Urban Veterans
Cully, J. A., Jameson, J. P., Phillips, L. L., Kunik, M. E., & Fortney, J. C. (2010) · The Journal of Rural Health · doi:10.1111/j.1748-0361.2010.00294.x · Cited by 93
Self-citationPsychotherapy in the veterans health administration: Missed opportunities?
Cully, J. A., Tolpin, L., Henderson, L., Jimenez, D., Kunik, M. E., & Petersen, L. A. (2008) · Psychological Services · doi:10.1037/a0013719 · Cited by 81
Self-citationFacilitating practice change: lessons from the STEP-UP clinical trial
Ruhe, M. C., Weyer, S. M., Zronek, S., WILKINSON, A., WILKINSON, P., & Stange, K. C. (2004) · Preventive Medicine · doi:10.1016/j.ypmed.2004.09.015 · Cited by 52
Sullivan, G., Blevins, D., & Kauth, M. R. (2008) · Implementation Science · doi:10.1186/1748-5908-3-33 · Cited by 51
Self-citationA team quality improvement sequence for complex problems.
Ovretveit, J. (1999) · Quality in Health Care · doi:10.1136/qshc.8.4.239 · Cited by 37
Cully, J. A., Teten, A. L., Benge, J. F., Sorocco, K. H., & Kauth, M. R. (2010) · The Primary Care Companion to The Journal of Clinical Psychiatry · doi:10.4088/pcc.09m00838blu · Cited by 20
Self-citationHepner, K. A., Azocar, F., Greenwood, G. L., Miranda, J., & Burnam, M. A. (2010) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-009-0249-4 · Cited by 20
Cognitive-Behavioural Therapy in Two-Plus-One Sessions: A Pilot Field Trial
Barkham, M., Moorey, J., & Davis, G. (1992) · Behavioural Psychotherapy · doi:10.1017/s014134730001692x · Cited by 18
Development of a Patient-Report Measure of Psychotherapy for Depression
Miranda, J. M., Hepner, K. A., Azocar, F., Greenwood, G., Ngo, V. K., & Burnam, M. A. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-009-0238-7 · Cited by 17
Research works printed but not linked: 1
- Cully JA Teten AT A Therapist's Guide to Brief Cognitive Behavioral Therapy 2008 Houston, TX: South Central Mental Illness Research, Education, and Clinical Center
Cited by
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
“Thus, details about the dose or intensity of implementation strategies such as the amount of time spent with an external facilitator [39], the time and intensity of training [80], or the frequency of audit and feedback [81] should be designated a priori and reported.”
BackgroundChaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013) · Implementation Science · doi:10.1186/1748-5908-8-22 · Cited by 800
“Therapist Characteristics and Barriers to Implementation [174] X X O: clinic type, location, organizational support [174] None Mental Health/ Substance Abuse PR: Perceived skills and ability, counseling discipline, level of education, workload, motivation”
InfluentialMichie, S., Wood, C. E., Johnston, M., Abraham, C., Francis, J. J., & Hardeman, W. (2015) · Health Technology Assessment · doi:10.3310/hta19990 · Cited by 680
Systematic Review and Meta-Analysis of Practice Facilitation Within Primary Care Settings
Baskerville, N. B., Liddy, C., & Hogg, W. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1312 · Cited by 571
A multidisciplinary European guideline for tinnitus: diagnostics, assessment, and treatment
Cima, R. F. F., Mazurek, B., Haider, H., Kikidis, D., Lapira, A., Noreña, A., & Hoare, D. J. (2019) · HNO · doi:10.1007/s00106-019-0633-7 · Cited by 442
Metadata
- Authors
- Kauth, M. R., Sullivan, G., Blevins, D., Cully, J. A., Landes, R. D., Said, Q., & Teasdale, T. A.
- Affiliations
- Michael E. DeBakey VA Medical Center (US)
- United States Department of Veterans Affairs (US)
- Central Arkansas Veterans Healthcare System (US)
- Corresponding author
- Kauth, Michael R
- Venue
- Implementation Science
- Published
- 2010-10-13
- Volume
- 5
- Issue
- 1
- Pages
- 75-75
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC2964555
- OpenAlex
- W2132636203
- Cited by
- 98
- References
- 39
- Citations by year
- 2026: 10 · 2025: 8 · 2024: 7 · 2023: 7 · 2022: 5 · 2021: 6 · 2020: 10 · 2019: 3 · 2018: 5 · 2017: 6 · 2016: 1 · 2015: 8 · 2014: 2 · 2013: 8 · 2012: 6
- FWCI
- 11.39
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Quality Enhancement Research Initiative
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- external facilitation, cognitive behavioral therapy, veterans' mental health services, implementation costs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.