Bridging the Gap Between Research and Practice in Mental Health Service Settings: An Overview of Developments in Implementation Theory and Research
Abstract
Twenty years after Sobell's (1996) influential call to integrate advances in behavior therapy into clinical settings, significant progress has been made in implementation science. In this narrative review, we provide an overview of implementation research findings and highlight recent findings that can inform efforts to bridge the gap between research and practice in mental health service settings. Key findings are summarized, organized according to levels of influence described in two implementation frameworks: The Exploration, Planning, Implementation, and Sustainment Framework (EPIS; Aarons et al., 2011) and the Consolidated Framework for Implementation Research (CFIR; Damschroder et al., 2009). Important levels of influence to consider when implementing new treatments include the outer context, inner context, characteristics of the individual, and characteristics of the innovation. Research on strategies to prepare clinicians to deliver evidence-based psychosocial treatments (EBPTs) and to address contextual barriers to implementation at each level is described, with discussion of implications for the implementation of EBPTs and next steps for research.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The adaptation-fidelity tension is a critical component of scaling-out and is addressed head on in more dynamic models of implementation process.
“This “adaptation-fidelity” tension is a critical component of scaling-out in that it is addressed head on as proposed in more dynamic models of implementation process [60–62].”
From “Scaling-out” evidence-based interventions to new populations or new health care delivery systems (2017) · cites this paper as [60]
Adaptations to accommodate an EBI are likely to be needed at the service system or organization levels, and often to the EBI itself.
“However, adaptations to accommodate an EBI are likely to be needed at the service system or organization levels, and often to the EBI itself [47, 60].”
From “Scaling-out” evidence-based interventions to new populations or new health care delivery systems (2017) · cites this paper as [60]
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,555 · see citing works
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963 · see citing works
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · see citing works
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.1.7 · Cited by 3,067 · see citing works
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · see citing works
Evidence-based practice in psychology.
American Psychological Association (2006) · American Psychologist · doi:10.1037/0003-066x.61.4.271 · Cited by 2,478 · see citing works
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254 · see citing works
An introduction to implementation science for the non-specialist
Bauer, M. S., Damschroder, L. J., Hagedorn, H., Smith, J. L., & Kilbourne, A. M. (2015) · BMC Psychology · doi:10.1186/s40359-015-0089-9 · Cited by 2,023 · see citing works
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724 · see citing works
Bridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386 · see citing works
Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-17 · Cited by 1,355 · see citing works
Beidas, R. S., & Kendall, P. C. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01187.x · Cited by 1,085 · see citing works
A Randomized Trial of Methods to Help Clinicians Learn Motivational Interviewing.
Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.6.1050 · Cited by 1,075 · see citing works
A compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069 · see citing works
Human resources for mental health care: current situation and strategies for action
Kakuma, R., Minas, H., van Ginneken, N., Dal Poz, M. R., Desiraju, K., Morris, J. E., Saxena, S., & Scheffler, R. M. (2011) · The Lancet · doi:10.1016/s0140-6736(11)61093-3 · Cited by 979 · see citing works
Methods to Improve the Selection and Tailoring of Implementation Strategies
Powell, B. J., Beidas, R. S., Lewis, C. C., Aarons, G. A., McMillen, J. C., Proctor, E. K., & Mandell, D. S. (2017) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-015-9475-6 · Cited by 967 · see citing works
McHugh, R. K., & Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0018121 · Cited by 909 · see citing works
Weisz, J. R. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.147 · Cited by 827 · see citing works
Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.02.005 · Cited by 713 · see citing works
Clark, D. M. (2011) · International Review of Psychiatry · doi:10.3109/09540261.2011.606803 · Cited by 699 · see citing works
Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.1.106 · Cited by 628 · see citing works
Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0148-5 · Cited by 608 · see citing works
Improving access to psychological therapy: initial evaluation of two UK demonstration sites
Clark, D. M., Layard, R., Smithies, R., Richards, D. A., Suckling, R., & Wright, B. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.010 · Cited by 599 · see citing works
Mind the gap: improving the dissemination of CBT
Shafran, R., Clark, D. M., Fairburn, C. G., Arntz, A., Barlow, D. H., Ehlers, A., Freeston, M., Garety, P. A., Hollon, S. D., Ost, L. G., et al. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.003 · Cited by 569 · see citing works
Aarons, G. A. (2006) · Psychiatric Services · doi:10.1176/appi.ps.57.8.1162 · Cited by 525 · see citing works
Implementing Evidence-Based Practices for Persons With Severe Mental Illnesses
Torrey, W. C., Drake, R. E., Dixon, L. B., Burns, B. J., Flynn, L. M., Rush, A. J., Clark, R. E., & Klatzker, D. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.1.45 · Cited by 490 · see citing works
Dynamic adaptation process to implement an evidence-based child maltreatment intervention
Aarons, G. A., Green, A. E., Palinkas, L. A., Self-Brown, S., Whitaker, D. J., Lutzker, J. R., Silovsky, J. F., Hecht, D. B., & Chaffin, M. J. (2012) · Implementation Science · doi:10.1186/1748-5908-7-32 · Cited by 449 · see citing works
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015) · Implementation Science · doi:10.1186/s13012-014-0192-y · Cited by 435 · see citing works
Pai, M., Lloyd, N. S., Cheng, J., Thabane, L., Spencer, F. A., Cook, D. J., Haynes, R. B., Schünemann, H. J., & Douketis, J. D. (2013) · Implementation Science · doi:10.1186/1748-5908-8-1 · Cited by 376 · see citing works
Implementation of the CALM intervention for anxiety disorders: a qualitative study
Curran, G. M., Sullivan, G., Mendel, P. J., Craske, M. G., Sherbourne, C. D., Stein, M. B., McDaniel, A., & Roy‐Byrne, P. (2012) · Implementation Science · doi:10.1186/1748-5908-7-14 · Cited by 349 · see citing works
Aarons, G. A. (2006) · Psychiatric Services · doi:10.1176/ps.2006.57.8.1162 · Cited by 341 · see citing works
Effectiveness of national implementation of prolonged exposure therapy in Veterans affairs care
Eftekhari, A., Ruzek, J. I., Crowley, J. J., Rosen, C. S., Greenbaum, M. A., & Karlin, B. E. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.36 · Cited by 338 · see citing works
Understanding the Components of Quality Improvement Collaboratives: A Systematic Literature Review
NADEEM, E., OLIN, S. S., HILL, L. C., HOAGWOOD, K. E., & HORWITZ, S. M. (2013) · The Milbank Quarterly · doi:10.1111/milq.12016 · Cited by 332 · see citing works
Bolton, P., Lee, C., Haroz, E. E., Murray, L., Dorsey, S., Robinson, C., Ugueto, A. M., & Bass, J. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001757 · Cited by 319 · see citing works
Aarons, G. A., Sommerfeld, D. H., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013223 · Cited by 297 · see citing works
Manualized therapy for PTSD: Flexing the structure of cognitive processing therapy.
Galovski, T. E., Blain, L. M., Mott, J. M., Elwood, L. S., & Houle, T. T. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0030600 · Cited by 286 · see citing works
Karlin, B. E., & Cross, G. (2014) · American Psychologist · doi:10.1037/a0033888 · Cited by 283 · see citing works
Rakovshik, S. G., & McManus, F. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.03.004 · Cited by 281 · see citing works
Borntrager, C. F., Chorpita, B. F., Higa-McMillan, C., & Weisz, J. R. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.5.677 · Cited by 277 · see citing works
Chorpita, B. F., Yim, L. M., Donkervoet, J. C., Arensdorf, A. M., Amundsen, M. J., McGee, C., Serrano, A. C., Yates, A., Burns, J. A., & Morelli, P. T. T. (2002) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.2002.tb00504.x · Cited by 256 · see citing works
Dissemination and Implementation Research in Health
Chambers, D. (2023) · doi:10.1093/oso/9780197660690.001.0001 · Cited by 246 · see citing works
Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy.
Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019160 · Cited by 243 · see citing works
Instrumentation issues in implementation science
Martinez, R. G., Lewis, C. C., & Weiner, B. J. (2014) · Implementation Science · doi:10.1186/s13012-014-0118-8 · Cited by 243 · see citing works
Glisson, C. A., Schoenwald, S. K., Kelleher, K. J., Landsverk, J. A., Hoagwood, K., Mayberg, S. W., & Green, P. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0152-9 · Cited by 232 · see citing works
Change What? Identifying Quality Improvement Targets by Investigating Usual Mental Health Care
Garland, A. F., Bickman, L., & Chorpita, B. F. (2010) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0279-y · Cited by 226 · see citing works
Murray, L. K., Skavenski, S. V. W., Kane, J. C., Mayeya, J., Dorsey, S., Cohen, J., Michalopoulos, L., Imasiku, M. L., & Bolton, P. A. (2015) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2015.0580 · Cited by 217 · see citing works
Nelson, T. D., & Steele, R. G. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-006-0111-x · Cited by 216 · see citing works
Raghavan, R., Bright, C. L., & Shadoin, A. L. (2008) · Implementation Science · doi:10.1186/1748-5908-3-26 · Cited by 205 · see citing works
Edmunds, J. M., Beidas, R., & Kendall, P. (2013) · Clinical Psychology · doi:10.1111/cpsp.12031 · Cited by 198 · see citing works
The Sustainability of Evidence-Based Practices in Routine Mental Health Agencies
Swain, K., Whitley, R., McHugo, G. J., & Drake, R. E. (2009) · Community Mental Health Journal · doi:10.1007/s10597-009-9202-y · Cited by 193 · see citing works
Wiltsey Stirman, S., A Gutner, C., Crits-Christoph, P., Edmunds, J., Evans, A. C., & Beidas, R. S. (2015) · Implementation Science · doi:10.1186/s13012-015-0308-z · Cited by 188 · see citing works
Predictors of Community Therapists’ Use of Therapy Techniques in a Large Public Mental Health System
Beidas, R. S., Marcus, S. C., Aarons, G. A., Hoagwood, K., Schoenwald, S. K., Evans, A. C., Hurford, M. O., Hadley, T. R., Barg, F. K., Walsh, L., et al. (2015) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2014.3736 · Cited by 179 · see citing works
Bearman, S. K., Weisz, J. R., Chorpita, B. F., Hoagwood, K., Ward, A. M., Ugueto, A. M., & Bernstein, A. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0485-5 · Cited by 178 · see citing works
Clinical supervision in treatment transport: Effects on adherence and outcomes.
Schoenwald, S. K., Sheidow, A. J., & Chapman, J. E. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013788 · Cited by 178 · see citing works
Show Me, Don’t Tell Me: Behavioral Rehearsal as a Training and Analogue Fidelity Tool
Beidas, R., Cross, W. F., & Dorsey, S. (2013) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2013.04.002 · Cited by 159 · see citing works
Schoenwald, S. K., Chapman, J. E., Kelleher, K., Hoagwood, K. E., Landsverk, J., Stevens, J., Glisson, C., Rolls-Reutz, J., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0147-6 · Cited by 149 · see citing works
Measuring Use of Evidence Based Psychotherapy for Posttraumatic Stress Disorder
Shiner, B. R., DʼAvolio, L., Nguyen, T. M., Zayed, M. H., Young‐Xu, Y., Desai, R. A., Schnurr, P. P., Fiore, L. D., & Watts, B. V. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0421-0 · Cited by 140 · see citing works
Henggeler, S. W., Chapman, J. E., Rowland, M. D., Halliday‐Boykins, C. A., Randall, J., Shackelford, J., & Schoenwald, S. K. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.4.556 · Cited by 133 · see citing works
Karlin, B. E., Trockel, M., Taylor, C. B., Gimeno, J., & Manber, R. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0032554 · Cited by 131 · see citing works
Shapiro, C. J., Prinz, R. J., & Sanders, M. R. (2012) · Child Maltreatment · doi:10.1177/1077559511424774 · Cited by 131 · see citing works
Dissemination and experience with cognitive processing therapy
Chard, K. M., Ricksecker, E. G., Healy, E. T., Karlin, B. E., & Resick, P. A. (2012) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2011.10.0198 · Cited by 131 · see citing works
Proctor, E. K., Landsverk, J. A., Baumann, A. A., Mittman, B. S., Aarons, G. A., Brownson, R. C., Glisson, C. A., & Chambers, D. (2013) · Implementation Science · doi:10.1186/1748-5908-8-105 · Cited by 127 · see citing works
Green, A. E., & Aarons, G. A. (2011) · Implementation Science · doi:10.1186/1748-5908-6-104 · Cited by 125 · see citing works
Sustaining Evidence-Based Prevention Programs: Correlates in a Large-Scale Dissemination Initiative
Cooper, B. R., Bumbarger, B. K., & Moore, J. E. (2015) · Prevention Science · doi:10.1007/s11121-013-0427-1 · Cited by 117 · see citing works
Using evidence-based treatments: The experiences of youth providers working under a mandate.
Jensen‐Doss, A., Hawley, K. M., Lopez, M. A., & Osterberg, L. D. (2009) · Professional Psychology Research and Practice · doi:10.1037/a0014690 · Cited by 117 · see citing works
Implementing dialectical behaviour therapy: programme survival in routine healthcare settings
Swales, M. A., Taylor, B., & Hibbs, R. A. B. (2012) · Journal of Mental Health · doi:10.3109/09638237.2012.689435 · Cited by 112 · see citing works
Bridging the gap between scientists and practitioners: The challenge before us
Sobell, L. C. (1996) · Behavior Therapy · doi:10.1016/s0005-7894(96)80019-0 · Cited by 109 · see citing works
Torrey, W. C., Bond, G. R., McHugo, G. J., & Swain, K. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0357-9 · Cited by 108 · see citing works
Predicting adoption of exposure therapy in a randomized controlled dissemination trial
Harned, M. S., Dimeff, L. A., Woodcock, E. A., & Contreras, I. (2013) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2013.02.006 · Cited by 108 · see citing works
MAPping Los Angeles County: Taking an Evidence-Informed Model of Mental Health Care to Scale
Southam‐Gerow, M. A., Daleiden, E. L., Chorpita, B. F., Bae, C., Mitchell, C., Faye, M., & Alba, M. (2013) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2013.833098 · Cited by 104 · see citing works
Schoenwald, S. K., Carter, R. E., Chapman, J. E., & Sheidow, A. J. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0181-z · Cited by 102 · see citing works
Godley, S. H., Garner, B. R., Smith, J. E., Meyers, R. J., & Godley, M. D. (2011) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.2011.01236.x · Cited by 97 · see citing works
Reding, M. E. J., Chorpita, B. F., Lau, A. S., & Innes-Gomberg, D. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0525-1 · Cited by 96 · see citing works
A Literature Review of Learning Collaboratives in Mental Health Care: Used but Untested
Nadeem, E., Olin, S.-C. S., Hill, L. C., Hoagwood, K., & Horwitz, S. M. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201300229 · Cited by 95 · see citing works
Beidas, R. S., Edmunds, J., Ditty, M. S., Watkins, J., Walsh, L., Marcus, S. C., & Kendall, P. C. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0529-x · Cited by 94 · see citing works
Who's using treatment manuals? A national survey of practicing therapists
Becker, E. M., Smith, A. M., & Jensen‐Doss, A. (2013) · Behaviour Research and Therapy · doi:10.1016/j.brat.2013.07.008 · Cited by 93 · see citing works
Magnabosco, J. L. (2006) · Implementation Science · doi:10.1186/1748-5908-1-13 · Cited by 90 · see citing works
Brown, C. H., Chamberlain, P., Saldana, L., Padgett, C., Wang, W., & Cruden, G. (2014) · Implementation Science · doi:10.1186/s13012-014-0134-8 · Cited by 89 · see citing works
Schoenwald, S. K., Chapman, J. E., Sheidow, A. J., & Carter, R. E. (2009) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410802575388 · Cited by 88 · see citing works
Stewart, R. E., Adams, D. R., Mandell, D. S., Hadley, T. R., Evans, A. C., Rubin, R. M., Erney, J., Neimark, G. B., Hurford, M. O., & Beidas, R. S. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201500392 · Cited by 86 · see citing works
Cook, J. M., Dinnen, S., Simiola, V., Thompson, R., & Schnurr, P. P. (2014) · Professional Psychology Research and Practice · doi:10.1037/a0036183 · Cited by 86 · see citing works
Cabassa, L. J., Gomes, A. P., Meyreles, Q., Capitelli, L., Younge, R. G., Dragatsi, D., Alvarez, J., Manrique, Y., & Lewis‐Fernández, R. (2014) · Implementation Science · doi:10.1186/s13012-014-0178-9 · Cited by 82 · see citing works
Perceived Characteristics of Intervention Scale
Cook, J. M., Thompson, R., & Schnurr, P. P. (2014) · Assessment · doi:10.1177/1073191114561254 · Cited by 80 · see citing works
Improving public addiction treatment through performance contracting: The Delaware experiment
McLellan, A. T., Kemp, J., Brooks, A. C., & Carise, D. (2008) · Health Policy · doi:10.1016/j.healthpol.2008.01.010 · Cited by 77 · see citing works
The gap between science and practice: how therapists make their clinical decisions
Gyani, A., Shafran, R., Myles, P., & Rose, S. (2014) · Behavior Therapy · doi:10.1016/j.beth.2013.10.004 · Cited by 73 · see citing works
An evaluation of the effectiveness of diploma-level training in cognitive behaviour therapy.
Mcmanus, F., Westbrook, D., Vazquez-Montes, M., Fennell, M., & Kennerley, H. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.08.002 · Cited by 71 · see citing works
Willging, C. E., Aarons, G. A., Trott, E. M., Green, A. E., Finn, N. K., Ehrhart, M. G., & Hecht, D. B. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0681-6 · Cited by 71 · see citing works
Forman, S. G., & Barakat, N. M. (2011) · Psychology in the Schools · doi:10.1002/pits.20547 · Cited by 70 · see citing works
Carpenter, K. M., Cheng, W., Smith, J. L., Brooks, A. C., Amrhein, P. C., Wain, R., & Nunes, E. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028362 · Cited by 69 · see citing works
Assessing and Changing Organizational Social Contexts for Effective Mental Health Services
Glisson, C. A., & Williams, N. J. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031914-122435 · Cited by 69 · see citing works
Zazzali, J. L., Sherbourne, C. D., Hoagwood, K., Greene, D., Bigley, M. F., & Sexton, T. L. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0145-8 · Cited by 68 · see citing works
Creed, T. A., Wolk, C. B., Feinberg, B. E., Evans, A. C., & Beck, A. T. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0618-5 · Cited by 68 · see citing works
Cook, J. M., Dinnen, S., Thompson, R., Simiola, V., & Schnurr, P. P. (2014) · Journal of Traumatic Stress · doi:10.1002/jts.21902 · Cited by 67 · see citing works
Stewart, R. E., & Chambless, D. L. (2009) · Journal of Clinical Psychology · doi:10.1002/jclp.20630 · Cited by 66 · see citing works
Willging, C. E., Green, A. E., Gunderson, L., Chaffin, M., & Aarons, G. A. (2015) · Child Maltreatment · doi:10.1177/1077559514547384 · Cited by 66 · see citing works
Lim, A., Nakamura, B. J., Higa-McMillan, C., Shimabukuro, S., & Slavin, L. A. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.03.008 · Cited by 65 · see citing works
Bennett–Levy, J., Hawkins, R. M. F., Perry, H., Cromarty, P., & Mills, J. (2012) · Australian Psychologist · doi:10.1111/j.1742-9544.2012.00089.x · Cited by 64 · see citing works
Using Pay for Performance to Improve Treatment Implementation for Adolescent Substance Use Disorders
Garner, B. R., Godley, S. H., Dennis, M. L., Hunter, B. D., Bair, C. M. L., & Godley, M. D. (2012) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpediatrics.2012.802 · Cited by 64 · see citing works
Therapists’ Perspectives on the Effective Elements of Consultation Following Training
Beidas, R., Edmunds, J. M., Cannuscio, C., Gallagher, M., Downey, M. M., & Kendall, P. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0475-7 · Cited by 63 · see citing works
Dimeff, L. A., Harned, M. S., Woodcock, E. A., Skutch, J. M., Koerner, K., & Linehan, M. M. (2015) · Behavior Therapy · doi:10.1016/j.beth.2015.01.001 · Cited by 62 · see citing works
Direct-to-consumer marketing of psychological treatments for anxiety disorders
Gallo, K. P., Comer, J. S., & Barlow, D. H. (2013) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2013.03.005 · Cited by 59 · see citing works
Implementation of AF-CBT by Community Practitioners Serving Child Welfare and Mental Health
Kolko, D., Baumann, B. L., Herschell, A., Hart, J., Holden, E. A., & Wisniewski, S. (2012) · Child Maltreatment · doi:10.1177/1077559511427346 · Cited by 58 · see citing works
Brimhall, K. C., Fenwick, K. M., Farahnak, L. R., Hurlburt, M. S., Roesch, S. C., & Aarons, G. A. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0670-9 · Cited by 55 · see citing works
Kilpela, L. S., Hill, K. A., Kelly, M. C., Elmquist, J., Ottoson, P. E., Keith, D., Hildebrandt, T., & Becker, C. B. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.09.005 · Cited by 53 · see citing works
Aarons, G. A., Miller, E. A., Green, A. E., Perrott, J. A., & Bradway, R. (2012) · Journal of Children's Services · doi:10.1108/17466661211286463 · Cited by 51 · see citing works
Is Openness to Using Empirically Supported Treatments Related to Organizational Culture and Climate?
Patterson, D. A., Dulmus, C. N., & Maguin, E. (2013) · Journal of Social Service Research · doi:10.1080/01488376.2013.804023 · Cited by 49 · see citing works
An Examination of Behavioral Rehearsal During Consultation as a Predictor of Training Outcomes
Edmunds, J. M., Kendall, P., Ringle, V. A., Read, K. L., Brodman, D. M., Pimentel, S. S., & Beidas, R. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0490-8 · Cited by 47 · see citing works
Comparing Client Outcomes for Two Evidence-Based Treatment Consultation Strategies
Funderburk, B. W., Chaffin, M. J., Bard, E. A., Shanley, J. R., Bard, D., & Berliner, L. (2014) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2014.910790 · Cited by 47 · see citing works
Statewide dissemination of an evidence-based practice using Breakthrough Series Collaboratives
Lang, J. M., Franks, R. P., Epstein, C., Stover, C. S., & Oliver, J. A. (2015) · Children and Youth Services Review · doi:10.1016/j.childyouth.2015.06.005 · Cited by 46 · see citing works
Rieckmann, T. R., Kovas, A. E., Fussell, H. E., & Stettler, N. M. (2008) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-008-9122-6 · Cited by 44 · see citing works
Kilmer, B., Eibner, C., Ringel, J. S., & Pacula, R. L. (2011) · Psychological Trauma Theory Research Practice and Policy · doi:10.1037/a0020592 · Cited by 43 · see citing works
Lopez, M. A., & Basco, M. A. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0546-4 · Cited by 42 · see citing works
Nakamura, B. J., Chorpita, B. F., Hirsch, M., Daleiden, E. L., Slavin, L. A., Amundson, M. J., Rocco, S. A. L., Mueller, C. W., Osiecki, S., Southam‐Gerow, M. A., et al. (2011) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.2010.01231.x · Cited by 42 · see citing works
Schumm, J. A., Walter, K. H., Bartone, A. S., & Chard, K. M. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.04.006 · Cited by 41 · see citing works
Lu, W., Yanos, P. T., Gottlieb, J. D., Marcello, S. C., Silverstein, S. M., Xie, H., Rosenberg, S. D., & Mueser, K. T. (2012) · Psychiatric Services · doi:10.1176/appi.ps.201000458 · Cited by 41 · see citing works
Ruzek, J., Rosen, R., Garvert, D., Smith, L., Sears, K. C., Marceau, L., Harty, B., & Stoddard, A. (2014) · Journal of Traumatic Stress · doi:10.1002/jts.21977 · Cited by 35 · see citing works
Stirman, S., Pontoski, K. E., Creed, T. A., Xhezo, R., Evans, A., Beck, A., & Crits-Christoph, P. (2017) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0700-7 · Cited by 35 · see citing works
Self-citationGibbons, M. B. C., Kurtz, J. E., Thompson, D. L., Mack, R. A., Lee, J. K., Rothbard, A. B., Eisen, S. V., Gallop, R., & Crits-Christoph, P. F. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0039302 · Cited by 34 · see citing works
Effects of Workshop Training for Providers Under Mandated Use of an Evidence-Based Practice
Lopez, M. A., Osterberg, L. D., Jensen‐Doss, A., & Rae, W. A. (2010) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0326-8 · Cited by 34 · see citing works
Garner, B. R., Hunter, B. D., Godley, S. H., & Godley, M. D. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.10.016 · Cited by 34 · see citing works
Psychological Science and Innovative Strategies for Informing Health Care Redesign: A Policy Brief
Asarnow, J. R., Hoagwood, K., Stancin, T., Lochman, J. E., Hughes, J. L., Miranda, J. M., Wysocki, T., Portwood, S. G., Piacentini, J. C., Tynan, W. D., et al. (2015) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2015.1077451 · Cited by 31 · see citing works
A Quantitative Test of an Implementation Framework in 38 VA Residential PTSD Programs
Cook, J. M., Dinnen, S., Thompson, R., Ruzek, J. I., Coyne, J. C., & Schnurr, P. P. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0590-0 · Cited by 30 · see citing works
Williams, N. J., & Glisson, C. A. (2014) · Cited by 30 · see citing works
Glisson, C. A., Williams, N. J., Hemmelgarn, A. L., Proctor, E. K., & Green, P. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.11.008 · Cited by 29 · see citing works
Knudsen, H. K., & Roman, P. M. (2014) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2014.08.003 · Cited by 28 · see citing works
Evaluating training methods for transporting contingency management to therapists
Henggeler, S. W., Chapman, J. E., Rowland, M. D., Sheidow, A. J., & Cunningham, P. B. (2013) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2013.06.008 · Cited by 27 · see citing works
Szymanski, J. (2011) · Behavior Therapy · doi:10.1016/j.beth.2011.05.005 · Cited by 25 · see citing works
Stirman, S. W., Matza, A., Gamarra, J., Toder, K., Xhezo, R., Evans, A. C., Hurford, M., Beck, A. T., Crits-Christoph, P., & Creed, T. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201400147 · Cited by 20 · see citing works
Self-citationD'Angelo, G., Pullmann, M. D., & Lyon, A. R. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0664-7 · Cited by 12 · see citing works
Palinkas, L. A., Olin, S.-C. S., Chor, B., Um, M. Y., Jeong, C. H., O’Connor, B. C., Horwitz, S. M., & Hoagwood, K. (2015) · Implementation Science · doi:10.1186/1748-5908-10-s1-a41 · Cited by 10 · see citing works
Hamm, M., Williams, K. R., Nikolajski, C., Celedonia, K. L., Frank, E., Swartz, H. A., Zickmund, S. L., & Stein, B. D. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201400424 · Cited by 8 · see citing works
Systematic Reviews in Public Health
McPheeters, M. L., Briss, P. A., Teutsch, S. M., & Truman, B. I. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195187410.003.0004 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
“Scaling-out” evidence-based interventions to new populations or new health care delivery systems
Aarons, G. A., Sklar, M., Mustanski, B., Benbow, N., & Brown, C. H. (2017) · Implementation Science · doi:10.1186/s13012-017-0640-6 · Cited by 399 · see citing works
“However, adaptations to accommodate an EBI are likely to be needed at the service system or organization levels, and often to the EBI itself [47, 60].”
BackgroundRosen, C. S., Matthieu, M. M., Stirman, S. W., Cook, J. M., Landes, S. J., Bernardy, N. C., Chard, K. M., Crowley, J. J., Eftekhari, A., Finley, E. P., et al. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0755-0 · Cited by 140 · see citing works
Self-citationFinch, J., Ford, C. E. L., Grainger, L., & Meiser‐Stedman, R. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.143 · Cited by 88 · see citing works
Monson, C. M., Shields, N., Suvak, M. K., Lane, J. E. M., Shnaider, P., Landy, M. S. H., Wagner, A. C., Sijercic, I., Masina, T., Wanklyn, S. G., et al. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.08.007 · Cited by 86 · see citing works
Self-citationHaroz, E. E., Bolton, P., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4097-y · Cited by 70 · see citing works
“Consumers are often included in the major theoretical frameworks that guide current D&I research [1, 14, 16], and are considered key stakeholders in the implementation process [36, 37].”
BackgroundOwen, J. E., Kuhn, E. R., Jaworski, B. K., McGee-Vincent, P. A., Juhasz, K. M., Hoffman, J. E., & Rosen, C. S. (2018) · mHealth · doi:10.21037/mhealth.2018.05.07 · Cited by 67 · see citing works
“A number of implementation science-based strategies have been proposed for rapidly disseminating evidenceinformed interventions, including learning collaboratives, task-sharing, and therapist- level implementation strategies (66).”
BackgroundWilliams, N. J., Hugh, M. L., Cooney, D., Worley, J. A., & Locke, J. J. (2022) · Behavior Therapy · doi:10.1016/j.beth.2022.03.001 · Cited by 49 · see citing works
Sripada, R., Bohnert, K. M., Ganoczy, D., & Pfeiffer, P. N. (2018) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-017-0828-8 · Cited by 45 · see citing works
“Rates of EBP implementation may vary substantially by facility, depending on the fit with existing practices (Stirman et al. 2015).”
BackgroundHiggins, A., Murphy, R., Downes, C., Barry, J., Monahan, M., Hevey, D., Kroll, T., Doyle, L., & Gibbons, P. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05852-9 · Cited by 44 · see citing works
Petsolari, M., Ibrahim, S. B., & Slovak, P. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642619 · Cited by 35 · see citing works
“Specifcally, most research often focuses on technical feasibility with less consideration of real-world clinical impact [2, 78, 129, 333].”
The Sustained Effects of CBT Training on Therapist Competence and Patient Outcomes
Liness, S., Beale, S., Lea, S. J., Byrne, S., Hirsch, C. R., & Clark, D. M. (2018) · Cognitive Therapy and Research · doi:10.1007/s10608-018-9987-5 · Cited by 32 · see citing works
Kopelovich, S. L., Strachan, E. D., Sivec, H. J., & Kreider, V. A. L. (2019) · Community Mental Health Journal · doi:10.1007/s10597-018-00365-6 · Cited by 30 · see citing works
“Although stepped care has demonstrated promise as a model for delivering mental health treatments to individuals served by public mental health agencies or systems, it has received far less attention as method of implementing EBPIs in community mental health agencies (e.g., training providers in the CBT protocol that…”
BackgroundInfluentialEhrenreich, J. T., Dimeff, L. A., Woodcock, E. A., Queen, A. H., Kelly, T. B., Contreras, I., Rash, B., Kelley-Brimer, A., Hauschildt, J., Danner, S., et al. (2016) · Evidence-Based Practice in Child and Adolescent Mental Health · doi:10.1080/23794925.2016.1245116 · Cited by 28 · see citing works
Implementation Science and Practice-Oriented Research: Convergence and Complementarity
Youn, S. J., Boswell, J. F., Douglas, S. R., Harris, B. A., Aajmain, S. T., Arnold, K. T., Creed, T. A., Gutner, C. A., Orengo‐Aguayo, R., Oswald, J. M., et al. (2023) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-023-01296-5 · Cited by 22 · see citing works
“…fidelity is important both in initial training, provision of ongoing support, and monitoring of ongoing quality (Aarons et al., 2011; Racine, 2006; Stirman et al., 2016), as implementers measure initial and growing therapist skills, identify areas for further growth after the initial training has…”
Self-citationMendelson, D., Thibaudeau, É., Sauvé, G., Lavigne, K. M., Bowie, C. R., Menon, M., Woodward, T. S., Lepage, M., & Raucher‐Chéné, D. (2021) · Schizophrenia Research Cognition · doi:10.1016/j.scog.2021.100230 · Cited by 22 · see citing works
“Such positive impressions are crucial for the implementation and further development of such programs (Atkins et al., 2017; Stirman et al., 2016).”
BackgroundWorley, C. B., LoSavio, S. T., Aajmain, S. T., Rosen, C. S., Stirman, S. W., & Sloan, D. M. (2020) · Journal of Traumatic Stress · doi:10.1002/jts.22589 · Cited by 23 · see citing works
“Numerous factors contribute to the gap between research and practice, including the broad sociopolitical context; organizational factors, such as leadership support and availability of resources; provider motivation, attitudes, and skills; and characteristics of the interventions themselves (Chen et al., 2017; Stirman…”
Self-citationAllchin, B., Goodyear, M. J., O’Hanlon, B., & Weimand, B. M. (2020) · Journal of Psychiatric and Mental Health Nursing · doi:10.1111/jpm.12615 · Cited by 21 · see citing works
Pilar, M. R., Jost, E., Walsh‐Bailey, C., Powell, B. J., Mazzucca, S., Eyler, A. A., Purtle, J., Allen, P. M., & Brownson, R. C. (2022) · Implementation Research and Practice · doi:10.1177/26334895221141116 · Cited by 24 · see citing works
“Unfortunately, access to mental health services is limited for many, due to barriers such as provider shortages, distance from services, and insufficient funding (Kilbourne et al., 2018; Saxena et al., 2007; Stirman et al., 2016; Williams, 2016).”
BackgroundStirman, S. W. (2022) · Current Directions in Psychological Science · doi:10.1177/09637214221109601 · Cited by 19 · see citing works
“Over time, frameworks have been developed to guide the study of the determinants and process of implementation, as well as the assessment of relevant outcomes, including feasibility, acceptability, appropriateness, cost, implementation fidelity, sustainability, and clinical outcomes (Nilsen, 2015; Stirman et al., 2016…”
BackgroundInfluentialSelf-citationGotham, H. J., Cummings, J. R., Dolce, J. N., Druss, B. G., Gill, K. J., Kopelovich, S. L., Molfenter, T. D., Olson, J. R., Benson, F., & Chwastiak, L. (2022) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2022.01.004 · Cited by 17 · see citing works
Sauer-Zavala, S. E., Ametaj, A., Wilner, J. G., Bentley, K. H., Marquez, S., Patrick, K. A., Starks, B. A., Shtasel, D. L., & Marques, L. M. (2018) · Psychotherapy · doi:10.1037/pst0000187 · Cited by 16 · see citing works
Chen, J. A., Olin, C. C., Stirman, S. W., & Kaysen, D. L. (2016) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2016.11.007 · Cited by 15 · see citing works
Self-citationCrowe, C., Collie, C., Johnson, C., & Wiltsey Stirman, S. (2020) · American Psychologist · doi:10.1037/amp0000631 · Cited by 14 · see citing works
Community Health Worker programmes’ integration into national health systems: Scoping review
Mupara, L. M., Mogaka, J., Brieger, W. R., & Tsoka-Gwegweni, J. M. (2023) · African Journal of Primary Health Care & Family Medicine · doi:10.4102/phcfm.v15i1.3204 · Cited by 14 · see citing works
“33,34 Many conditions, such as unanticipated budgetary restrictions, public opinion, political values and ideology, epidemiologic occurrences, and social and economic realities, frequently affect policies, which are not represented in the simple ways in which policies are constructed.”
BackgroundDavidson, T. M., Espeleta, H. C., Ridings, L. E., Witcraft, S. M., Bravoco, O., Higgins, K., Houchins, R., Kitchens, D., Manning, B. M., Jones, S., et al. (2023) · Journal of the American College of Surgeons · doi:10.1097/xcs.0000000000000862 · Cited by 14 · see citing works
Aby, M. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01033-2 · Cited by 14 · see citing works
Allchin, B., O’Hanlon, B., Weimand, B. M., Boyer, F., Cripps, G., Gill, L., Paisley, B., Pietsch, S., Wynne, B., & Goodyear, M. J. (2020) · International Journal of Mental Health Systems · doi:10.1186/s13033-020-00380-9 · Cited by 14 · see citing works
Dunn, B. D., O’Mahen, H., Wright, K. A., & Brown, G. P. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103417 · Cited by 13 · see citing works
Mancebo, M. C., Yip, A. G., Boisseau, C. L., Rasmussen, S. A., & Zlotnick, C. (2021) · Behavior Therapy · doi:10.1016/j.beth.2021.02.009 · Cited by 12 · see citing works
Walker, J. S., & Baird, C. (2019) · Children and youth services review · doi:10.1016/j.childyouth.2019.02.040 · Cited by 12 · see citing works
Finley, E. P., Garcia, H. A., Ramirez, V., Haro, E. K., Mignogna, J., DeBeer, B. B., & Stirman, S. W. (2019) · Psychological Trauma Theory Research Practice and Policy · doi:10.1037/tra0000477 · Cited by 12 · see citing works
Self-citationHarnessing Implementation Science in Clinical Psychology: Past, Present, and Future
Beidas, R. S., Boyd, M. R., Casline, E. P., Scott, K., Patel, Z. S., Mills, C., Mustanski, B. S., Schriger, S. H., Williams, F. S., Waller, C., et al. (2025) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081423-021727 · Cited by 12 · see citing works
Côté, M., & Gagné, M. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05939-3 · Cited by 12 · see citing works
Norris, L. A., Rabner, J. C., Crane, M. E., Cervin, M., Ney, J. S., Benito, K., Kendall, P. C., & Frank, H. E. (2023) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2023.102742 · Cited by 10 · see citing works
Allchin, B., Weimand, B. M., O’Hanlon, B., & Goodyear, M. J. (2020) · International Journal of Mental Health Nursing · doi:10.1111/inm.12754 · Cited by 10 · see citing works
Vax, S., Farkas, M. D., Mueser, K. T., Drainoni, M., & Russinova, Z. L. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00257-7 · Cited by 11 · see citing works
Isobel, S., Allchin, B., Goodyear, M. J., & Gladstone, B. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00310 · Cited by 10 · see citing works
“The current study illustrates the complexity of systems change to support families where a parent has a mental illness and highlights the need for coordinated action in multiple spheres for long-term sustainable change (18, 23, 33, 34).”
BackgroundGreenberg, J. L., Berman, N. C., Braddick, V., Schwartz, R. A., Mothi, S. S., & Wilhelm, S. (2017) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2017.12.004 · Cited by 8 · see citing works
Ametaj, A. A., Wilner Tirpak, J., Cassiello-Robbins, C., Snow, R., Rassaby, M. M., Beer, K., & Sauer-Zavala, S. (2021) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01101-7 · Cited by 7 · see citing works
Bellehsen, M. H., Moline, J. M., Rasul, R., Bevilacqua, K., Schneider, S., Kornrich, J., & Schwartz, R. M. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16091536 · Cited by 7 · see citing works
“Furthermore, EBT implementation and quality assurance processes have greater chances of success when the stakeholders’ voices and the contexts of implementation are factored into the process of change [43,44].”
BackgroundCavero, V., Toyama, M., Castro, H. C. M., Couto, M. T., Brandt, L., Quayle, J., Menezes, P. R., Mohr, D. C., Araya, R., Miranda, J. J., et al. (2022) · Discover Mental Health · doi:10.1007/s44192-022-00015-0 · Cited by 7 · see citing works
“However, many interventions successfully tested in RCTs are not further implemented in real-world settings due to a variety of factors, including healthcare policies, available funding or providers’ attitudes towards the intervention [11].”
BackgroundStirman, S. W., Gumport, N. B., Calloway, A. L., Gunter, C., Marques, L. M., Hernandez, S., Song, J., Johnson, C. M., Youn, S. J., Elhusseini, S. A., et al. (2024) · Behavior Therapy · doi:10.1016/j.beth.2024.12.003 · Cited by 6 · see citing works
Self-citationTaxman, F. S., Shukla, N., Ramezani, N., Viglione, J., & Johnson, J. E. (2025) · Corrections · doi:10.1080/23774657.2024.2447693 · Cited by 5 · see citing works
“Scholars have identified practices and treatments that have sufficient research studies to demonstrate they can improve mental health services, service quality, and/or patient outcomes (American Psychological Association, 2005; Johnson et al., 2023; S. W. Stirman et al., 2016).”
Thibaudeau, É., Peyroux, É., Nicolas Franck, B., Carling, H., & Lepage, M. (2024) · JMIR Research Protocols · doi:10.2196/54251 · Cited by 6 · see citing works
“This information is central to documentation in any intervention study, given the significant research-to-practice gap [48] limiting the implementation of interventions developed in the context of research in clinical settings.”
BackgroundFadem, S. J., Crabtree, B. F., O’Malley, D. M., Mikesell, L., Ferrante, J. M., Toppmeyer, D., Ohman‐Strickland, P., Hemler, J. R., Howard, J., Bator, A., et al. (2023) · BMC Family Practice · doi:10.1186/s12875-023-02186-3 · Cited by 5 · see citing works
“EPIS is a program implementation-based framework that provides assessment constructs for exploring inner and outer context factors that impact evidence-based intervention implementation [52–54].”
BackgroundSoleimanian-Boroujeni, F., Badihian, N., Badihian, S., Shaygannejad, V., & Gorji, Y. (2022) · BMC Neurology · doi:10.1186/s12883-022-02729-8 · Cited by 5 · see citing works
“Despite the observed efficacy in research setting, a gap in practice exists in delivering mental health services [25, 26].”
BackgroundMadden, E., Prior, K., Gückel, T., Bock, S. G., Bryant, Z., O’Dean, S., Nepal, S., Ward, C., & Thornton, L. K. (2023) · Journal of Health Communication · doi:10.1080/10810730.2023.2278617 · Cited by 5 · see citing works
“Despite the prevalence and impact of these disorders, research-to-practice gaps continue to slow the effective implementation of evidence-based practice and policy (Jorm & Malhi, 2013; Proctor et al., 2009; Wainberg et al., 2017; Wiltsey Stirman, Gutner, Langdon, & Graham, 2016).”
BackgroundSklar, M., Seijo, C., Goldman, R. E., & Eaton, C. B. (2019) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13136 · Cited by 5 · see citing works
Statewide implementation of high-fidelity recovery-oriented ACT: A case study
Herinckx, H. A., Kerlinger, A., & Cellarius, K. (2021) · Implementation Research and Practice · doi:10.1177/2633489521994938 · Cited by 5 · see citing works
“Despite the awareness of the gap between research and practice, it continues to exist (Stirman et al., 2016).”
BackgroundThe effect of an online lecture on psychosocial cancer care providers’ attitudes about hypnosis.
Montgomery, G. H., Force, J., Dillon, M. J., David, D. O., & Schnur, J. B. (2019) · Psychology of Consciousness Theory Research and Practice · doi:10.1037/cns0000191 · Cited by 5 · see citing works
The Relation Between Research and Practice
Oliveira, V. (2021) · The urban book series · doi:10.1007/978-3-030-66460-2_1 · Cited by 4 · see citing works
Community Health Worker programmes’ integration into national health systems: Scoping review
Mupara, L. M., Mogaka, J., Brieger, W. R., & Tsoka-Gwegweni, J. M. (2022) · African Journal of Primary Health Care & Family Medicine · doi:10.4102/phcfm.v14i1.3204 · Cited by 4 · see citing works
Conceptualizing Neighborhood Context in Youth Psychotherapy Research
Patel, Z. S., Moise, I. K., Bulotsky‐Shearer, R. J., Price, M. A., Becker, S. J., & Jensen‐Doss, A. (2024) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2024.2303705 · Cited by 4 · see citing works
“First, task sharing is an approach that empowers paraprofessionals (e.g., peers, community health workers) to deliver a specific intervention under supervision (Stirman et al., 2016).”
Gehrmann, J., Stephan, J., Dehner, J., Stullich, A., & Richter, M. (2026) · BMC Health Services Research · doi:10.1186/s12913-026-14631-x · Cited by 3 · see citing works
“Therefore, a theoretical implementation framework tailored to the intervention setting and the specifics of the newly developed intervention is beneficial, also offering an in-depth understanding of the processes and the framework conditions surrounding its implementation [27, 31].”
D'Sa, M. B., Relph, N., Liverpool, S., Tebble, G., & Owen, M. B. (2025) · PLOS mental health. · doi:10.1371/journal.pmen.0000227 · Cited by 3 · see citing works
“Therefore, it is recommended that future research efforts focus on documenting and analysing these emerging practices to bridge the gap between real-world application and academic understanding [142,143].”
Stöd till personer med psykisk funktionsnedsättning
Markström, U. (2020) · Socialvetenskaplig tidskrift · doi:10.3384/svt.2019.26.3-4.3093 · Cited by 2 · see citing works
Nedelcu, A., & Grégoire, S. (2020) · Journal of College Student Psychotherapy · doi:10.1080/87568225.2020.1806162 · Cited by 3 · see citing works
“With respect to financing, Stirman et al. (2016) note that interventions already receiving financial support are more readily implemented than those requiring additional investment from the institution.”
BackgroundAcri, M. C., Bornheimer, L. A., Hamovitch, E., & Lambert, K. (2019) · Research on Social Work Practice · doi:10.1177/1049731519841439 · Cited by 3 · see citing works
Badeja, D., Schier, F., McGinity, M., & Hoyer, J. (2026) · Psychotherapy Research · doi:10.1080/10503307.2025.2534978 · Cited by 2 · see citing works
“Post-training, long-term implementation may be supported through consultation and mentoring by experts within psychotherapeutic communities, aligning with theories conceptualizing implementation as a process partly driven by social learning (Stirman et al., 2016; Straub, 2009; Wray et al., 2023).”
O’Malley, D. M., Crabtree, B. F., Kaloth, S., Ohman‐Strickland, P., Ferrante, J. M., Hudson, S. V., & Kinney, A. Y. (2024) · BMC Family Practice · doi:10.1186/s12875-024-02496-0 · Cited by 2 · see citing works
“Guided by EPIS, contextual factors were selected based on suggestions from clinical stakeholders, community partners, and previous literature suggesting they may influence implementation success [54–56] (see Table 4).”
MethodNewman, M. G. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.08.003 · Cited by 2 · see citing works
Farr, J., Malta, G. D., & Cooper, M. (2019) · Counselling and Psychotherapy Research · doi:10.1002/capr.12262 · Cited by 1 · see citing works
Siegle, A., zu Sayn-Wittgenstein-Hohenstein, F., & Roes, M. (2020) · Implementation Science · doi:10.1186/s13012-020-01033-8 · Cited by 2 · see citing works
Dev, S., & Shidhaye, R. R. (2024) · Wellcome Open Research · doi:10.12688/wellcomeopenres.18602.2 · Cited by 1 · see citing works
“It then becomes imperative to give these underlying interactions adequate thought, so that optimal performance of the EBmhI and favorable outcomes may be expected (Stirman et al. , 2016).”
BackgroundThe Exposure Guide: A Practical Measure of Exposure Quality
Benito, K., Herren, J. A., Norris, L. A., Gardiner, K. M., Choate-Summers, M. L., & Freeman, J. B. (2024) · Behavior Therapy · doi:10.1016/j.beth.2024.11.002 · Cited by 1 · see citing works
Rosen, C. S., Peterson, A. L., Riggs, D. S., Haddock, C. K., Fong, C., Young‐McCaughan, S., Cook, J. H., Comtois, K. A., Borah, E. V., Davis, C. A., et al. (2025) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2025.103080 · Cited by 2 · see citing works
Self-citationHybrid effectiveness-implementation studies in mental health: three practical examples
Lorente-Català, R., & García‐Palacios, A. (2026) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000592 · Cited by 1 · see citing works
O’Donnell, R., Ayton, D., Pizzirani, B., Savaglio, M., Fast, D., Vicary, D., & Skouteris, H. (2020) · Australian Journal of Primary Health · doi:10.1071/py20046 · Cited by 1 · see citing works
Trauma- and Stressor-Related Disorders
Sherrill, A. M., & Rauch, S. A. M. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108140416.031 · Cited by 1 · see citing works
Dev, S. (2021) · doi:10.17760/d20416628 · Cited by 1 · see citing works
Administering CPT across health care systems and clinical settings
Galovski, T. E., Nixon, R. D. V., & Kaysen, D. L. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-816715-1.00012-1
Oliveira, V. (2021) · The urban book series · doi:10.1007/978-3-030-92454-6_7
Soleimanian-Boroujeni, F., Badihian, N., Badihian, S., Shaygannejad, V., & Gorji, Y. (2022) · Research Square · doi:10.21203/rs.3.rs-1143097/v1
Muse, K., Walklet, E., Anderson, K., & Rees-Davies, L. N. (2025) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x25100160
How can citizen science enhance mental health research quality: theory of change development
Todowede, O. O., Rennick‐Egglestone, S., Boyd, D. S., Moran, S., Bell, A., Sweeney, A., Hart, A., Tomlin, A., Robotham, D., Repper, J., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-091007 · Cited by 1 · see citing works
Nickelsen, T., Muller, G. N., Clark, S. L., Bordiuzhenko, O., Liberzon, I., & Ory, M. G. (2025) · International Journal of Mental Health Systems · doi:10.1186/s13033-025-00690-w · Cited by 1 · see citing works
“We note that due to a relatively small number of trainees, this analysis may have been underpowered, potentially leading to type 2 error, a limitation also noted by Stirman et al. [33] in similar implementation studies.”
Implementing AMBIT Benefits, Challenges, and Perceived Impact
Fee, B., Wilson, C., & Butlin, B. (2025) · Journal of Infant Child and Adolescent Psychotherapy · doi:10.1080/15289168.2025.2556398
“The research suggests that there is a need to identify core components and use fidelity checklists to measure adherence to these (Stirman et al., 2016).”
Panek, A., Butler, E. J., Jensen‐Doss, A., Ehrenreich, J. T., & Ginsburg, G. S. (2025) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/s13034-025-00970-w
“There are several potential reasons for this gap in effectiveness between research and practice settings [45].”
Higgins, A., Murphy, R., Downes, C., Barry, J., Monahan, M., Hevey, D., Kroll, T., Doyle, L., & Gibbons, P. (2020) · Figshare · doi:10.6084/m9.figshare.13212740
Vax, S., Farkas, M. D., Mueser, K. T., Drainoni, M., & Russinova, Z. L. (2022) · Figshare · doi:10.6084/m9.figshare.19298459
Fadem, S. J., Crabtree, B. F., O’Malley, D. M., Mikesell, L., Ferrante, J. M., Toppmeyer, D., Ohman-Strickland, P. A., Hemler, J. R., Howard, J., Bator, A., et al. (2023) · Figshare · doi:10.6084/m9.figshare.24540554
Haroz, E. E., Bolton, P. A., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. K. (2019) · Figshare · doi:10.6084/m9.figshare.8057684
Vax, S., Farkas, M. D., Mueser, K. T., Drainoni, M., & Russinova, Z. L. (2022) · Figshare · doi:10.6084/m9.figshare.19298465
Higgins, A., Murphy, R., Downes, C., Barry, J., Monahan, M., Hevey, D., Kroll, T., Doyle, L., & Gibbons, P. (2020) · Figshare · doi:10.6084/m9.figshare.13212746
Higgins, A., Murphy, R., Downes, C., Barry, J., Monahan, M., Hevey, D., Kroll, T., Doyle, L., & Gibbons, P. (2020) · Figshare · doi:10.6084/m9.figshare.13212749
Haroz, E. E., Bolton, P. A., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. K. (2019) · Figshare · doi:10.6084/m9.figshare.8057690
Haroz, E. E., Bolton, P. A., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. K. (2019) · Figshare · doi:10.6084/m9.figshare.8057696
Haroz, E. E., Bolton, P. A., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. K. (2019) · Figshare · doi:10.6084/m9.figshare.8057702
Vax, S., Farkas, M. D., Mueser, K. T., Drainoni, M., & Russinova, Z. L. (2022) · Figshare · doi:10.6084/m9.figshare.19298468
O’Malley, D. M., Crabtree, B. F., Kaloth, S., Ohman-Strickland, P., Ferrante, J., Hudson, S. V., & Kinney, A. Y. (2024) · Figshare · doi:10.6084/m9.figshare.26744309
Higgins, A., Murphy, R., Downes, C., Barry, J., Monahan, M., Hevey, D., Kroll, T., Doyle, L., & Gibbons, P. (2020) · Figshare · doi:10.6084/m9.figshare.13212743
Haroz, E. E., Bolton, P. A., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. K. (2019) · Figshare · doi:10.6084/m9.figshare.8057678
Higgins, A., Murphy, R., Downes, C., Barry, J., Monahan, M., Hevey, D., Kroll, T., Doyle, L., & Gibbons, P. (2020) · Figshare · doi:10.6084/m9.figshare.13212737
Higgins, A., Murphy, R., Downes, C., Barry, J., Monahan, M., Hevey, D., Kroll, T., Doyle, L., & Gibbons, P. (2020) · Figshare · doi:10.6084/m9.figshare.13212734
Barriers to research utilization among North American drama therapists
Frydman, J. S., & Cook, A. (2026) · The Arts in Psychotherapy · doi:10.1016/j.aip.2026.102470
Beauvoir, K. F., Ison, J. M., Coates, E. E., & Barnett, M. L. (2026) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2026.2660302
“Moreover, as clinicians are less inclined to use EBPs with populations for whom the treatment seems disconnected (Wiltsey Stirman et al., 2016), this potentially compounds the cycle of Black youth and families receiving less quality treatments, which in turn may increase their stigma toward mental…”
‘Amazing and Daunting’: Providers’ Perspectives on the Implementation of Neurofeedback
Norris, W. K., Allison, M. K., Shaw-Smith, E., Pro, G. C., Curran, G. M., & Rojo, M. O. (2026) · Global Implementation Research and Applications · doi:10.1007/s43477-026-00237-2
Purkey, E., Bartels, S. A., Carter, R., Chan-Nguyen, S., Cole, M., Davison, C., Ford, M., Jackson, L., Knox, B., Watson, A., et al. (2026) · PLoS ONE · doi:10.1371/journal.pone.0347479
“[5–7 , 30 ].”
- Authors
- Stirman, S. W., Gutner, C. A., Langdon, K., & Graham, J. R.
- Affiliations
- VA Palo Alto Health Care System (US)
- Boston University (US)
- Rhode Island Hospital (US)
- Salem State University (US)
- Corresponding author
- Stirman, Shannon Wiltsey
- Venue
- Behavior Therapy
- Publisher
- Elsevier BV
- Published
- 2016-11
- Volume
- 47
- Issue
- 6
- Pages
- 920-936
- ISSN
- 0005-7894 (ISSN-L)
- OpenAlex
- W2211497785
- Cited by
- 103
- References
- 135
- Citations by year
- 2026: 9 · 2025: 10 · 2024: 8 · 2023: 7 · 2022: 12 · 2021: 7 · 2020: 21 · 2019: 17 · 2018: 5 · 2017: 3 · 2016: 4
- FWCI
- 0.72
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Behavior Therapy (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (K23MH103396)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- implementation research, implementation theory, research-practice gap, mental health services, Consolidated Framework for Implementation Research, EPIS framework, treatment implementation
- MeSH terms
- Humans, Mental Health Services, Psychotherapy, Evidence-Based Medicine, Information Dissemination, Translational Research, Biomedical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review