Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy.
Open accessThe DOI matches its Crossref record; 53 of the 55 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: A randomized trial assessed the effectiveness of a 2-level strategy for implementing evidence-based mental health treatments for delinquent youth. METHOD: A 2 x 2 design encompassing 14 rural Appalachian counties included 2 factors: (a) the random assignment of delinquent youth within each county to a multisystemic therapy (MST) program or usual services and (b) the random assignment of counties to the ARC (for availability, responsiveness, and continuity) organizational intervention for implementing effective community-based mental health services. The design created 4 treatment conditions (MST plus ARC, MST only, ARC only, control). Outcome measures for 615 youth who were 69% male, 91% Caucasian, and aged 9-17 years included the Child Behavior Checklist and out-of-home placements. RESULTS: A multilevel, mixed-effects, regression analysis of 6-month treatment outcomes found that youth total problem behavior in the MST plus ARC condition was at a nonclinical level and significantly lower than in other conditions. Total problem behavior was equivalent and at nonclinical levels in all conditions by the 18-month follow-up, but youth in the MST plus ARC condition entered out-of-home placements at a significantly lower rate (16%) than youth in the control condition (34%). CONCLUSIONS: Two-level strategies that combine an organizational intervention such as ARC and an evidence-based treatment such as MST are promising approaches to implementing effective community-based mental health services. More research is needed to understand how such strategies can be used effectively in a variety of organizational contexts and with other types of evidence-based treatments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Considerable information is available on the organizational characteristics that promote the exploration and eventual adoption of innovation (Greenhalgh et al. 2004; Rogers 2003) and EBPs in mental health and social service organizations”
From Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors (2011) · cites this paper as Glisson et al. 2010
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“For example, Glisson et al. (2010) demonstrated in a randomized trial that multisystemic therapy (MST) is more effective when implemented in the context of an organization development intervention that focuses on improving leadership and community agency culture and climate than when MST is implemented alone.”
From Standards of Evidence for Efficacy, Effectiveness, and Scale-up Research in Prevention Science: Next Generation (2015) · cites this paper as Glisson et al. 2010
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724 · cited 4×
“The analysis used a binomial sampling model based on the Bernoulli distribution and a logit link function with the log of the odds of custody as the outcome variable (Raudenbush & Bryk, 2002, pp. 294–309).”
MethodInfluentialBowman, P. W. (1963) · AIBS Bulletin · doi:10.2307/1292957 · Cited by 3,638
Child abuse and neglect: The myth of classlessness.
Pelton, L. H. (1978) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1978.tb02565.x · Cited by 1,949
Lenggenhager, J. (1947) · PubMed · Cited by 1,772
(2018) · The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation · doi:10.4135/9781506326139.n404 · Cited by 1,528
Evidence-Based Psychosocial Treatments for Children and Adolescents With Disruptive Behavior
Eyberg, S. M., Nelson, M. M., & Boggs, S. R. (2008) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410701820117 · Cited by 1,335
(2003) · Guilford Press eBooks · Cited by 1,037
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873
Identifying and developing empirically supported child and adolescent treatments.
Kazdin, A. E., & Weisz, J. R. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.1.19 · Cited by 758 · cited 1×
“…of the implementation and outcomes of MST in community settings have been summarized in peerreviewed journals (e.g., Eyberg, Nelson & Boggs, 2008; Kazdin & Weisz, 1998; Schoenwald, 2008), government reports (e.g., National Institute on Drug Abuse, 1999; National Institutes of Health, 2006; U.S.…”
Background
Research works printed but not linked: 3
- Glisson C Sowers K Dulmus C 2008 Interventions with organizations: The ARC model The Comprehensive Handbook of Social Work and Social Welfare 3 556 581 Hoboken, NJ John Wiley & Sons
- Glisson C Webb MB Dowd K Harden BJ Landsverk J Testa MF 2009 Organizational climate and service outcomes in child welfare agencies Child welfare and child protection: New perspectives from the National Survey of Child and Adolescent Well-being New York Oxford University Press
- Myford CM Wolfe EW 2003 Detecting and measuring rater effects using many-facet Rasch measurement: Part I Journal of Applied Measurement 4 386 422 14523257
Cited by
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
“Considerable information is available on the organizational characteristics that promote the exploration and eventual adoption of innovation (Greenhalgh et al. 2004; Rogers 2003) and EBPs in mental health and social service organizations (Glisson et al. 2010).”
BackgroundImplementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724
“, culture, climate, structure) to enable improved fit between the intervention and the setting [19]; harnessing the understanding of context can enable beneficial adaptation of the intervention and improve sustainability.”
BackgroundBridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386
A compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069
“There are several examples of such models, including the Translating Research Into Practice intervention, the Availability, Responsibility and Continuity model, and the Institute for Healthcare Improvement’s Framework for Spread (Brooks, Titler, Ardery, & Herr, 2009; Glisson & Schoenwald, 2005; Glisson, Schoenwald, He…”
MethodWeisz, J. R., Kuppens, S., Ng, M. Y., Eckshtain, D., Ugueto, A. M., Vaughn-Coaxum, R., Jensen-Doss, A., Hawley, K. M., Krumholz Marchette, L. S., Chu, B. C., et al. (2017) · American Psychologist · doi:10.1037/a0040360 · Cited by 862
Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda
Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., McHugh, S. M., & Weiner, B. J. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00003 · Cited by 775
Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012) · American Journal of Public Health · doi:10.2105/ajph.2012.300755 · Cited by 762
Gottfredson, D. C., Cook, T. D., Gardner, F. E. M., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015) · Prevention Science · doi:10.1007/s11121-015-0555-x · Cited by 627
“For example, Glisson et al. (2010) demonstrated in a randomized trial that”
BackgroundEhrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014) · Implementation Science · doi:10.1186/s13012-014-0157-1 · Cited by 502
Dynamic adaptation process to implement an evidence-based child maltreatment intervention
Aarons, G. A., Green, A. E., Palinkas, L. A., Self-Brown, S., Whitaker, D. J., Lutzker, J. R., Silovsky, J. F., Hecht, D. B., & Chaffin, M. J. (2012) · Implementation Science · doi:10.1186/1748-5908-7-32 · Cited by 449
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015) · Implementation Science · doi:10.1186/s13012-014-0192-y · Cited by 435
“Previous studies have found that organizational development interventions can improve workplace climate and patient-level outcomes [71].”
BackgroundWeisz, J. R., Kuppens, S., Eckshtain, D., Ugueto, A. M., Hawley, K. M., & Jensen-Doss, A. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.1176 · Cited by 412
A PRACTICAL IMPLEMENTATION SCIENCE HEURISTIC FOR ORGANIZATIONAL READINESS: R = MC2
Scaccia, J. P., Cook, B. S., Lamont, A., Wandersman, A., Castellow, J., Katz, J., & Beidas, R. S. (2015) · Journal of Community Psychology · doi:10.1002/jcop.21698 · Cited by 375
A systematic review of empirical studies examining mechanisms of implementation in health
Lewis, C. C., Boyd, M. R., Walsh-Bailey, C., Lyon, A. R., Beidas, R., Mittman, B., Aarons, G. A., Weiner, B. J., & Chambers, D. A. (2020) · Implementation Science · doi:10.1186/s13012-020-00983-3 · Cited by 363
“Therapists’ intention to achieve targeted threshold Glisson et al. 2010 [25] Availability responsiveness and continuity (ARC) Intervention + Multisystemic Therapy quality assurance, pay for performance Fidelity to multisystemic therapy Rate of change in child behavior out of home placements Holth…”
BackgroundMethodInfluentialAarons, G. A., & Sommerfeld, D. H. (2012) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2012.01.018 · Cited by 318
The effectiveness of Multisystemic Therapy (MST): A meta-analysis
van der Stouwe, T., Asscher, J. J., Stams, G. J. J. M., Deković, M., & van der Laan, P. H. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.06.006 · Cited by 321
“Two studies were excluded because they provided no usable statistics to extract an effect size for MST versus control treatment (i.e., Glisson et al., 2010; Henggeler et al., 2006).”
BackgroundImplementation Science: A Brief Overview and a Look Ahead
Ogden, T., & Fixsen, D. L. (2014) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000160 · Cited by 296
The Research Network on Youth Mental Health, Aarons, G. A., Glisson, C., Green, P. D., Hoagwood, K., Kelleher, K. J., & Landsverk, J. A. (2012) · Implementation Science · doi:10.1186/1748-5908-7-56 · Cited by 271
Self-citationNovins, D. K., Green, A. E., Legha, R. K., & Aarons, G. A. (2013) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2013.07.012 · Cited by 270
A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions
Powell, B. J., Proctor, E. K., & Glass, J. E. (2014) · Research on Social Work Practice · doi:10.1177/1049731513505778 · Cited by 268
“Some studies testing very comprehensive implementation strategies demonstrated positive effects (e.g., Forsner et al., 2010; Glisson et al., 2010); however, other studies also demonstrated positive effects with less comprehensive strategies (e.”
BackgroundInfluentialWeisz, J. R., Ng, M. Y., & Bearman, S. K. (2014) · Clinical Psychological Science · doi:10.1177/2167702613501307 · Cited by 246
“Glisson et al. (2010) and Glisson et al. (2012) have demonstrated in two RCTs that an organizational intervention can improve the OSC of community mental-health organizations and the effectiveness and efficiency of multisystemic therapy for delinquent youths.”
BackgroundChorpita, B. F., Research Network on Youth Mental Health, Weisz, J. R., Daleiden, E. L., Schoenwald, S. K., Palinkas, L. A., Miranda, J., Higa-McMillan, C. K., Nakamura, B. J., Austin, A. A., et al. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0034200 · Cited by 241
Self-citationTracking implementation strategies: a description of a practical approach and early findings
Bunger, A. C., Powell, B. J., Robertson, H. A., MacDowell, H., Birken, S. A., & Shea, C. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0175-y · Cited by 208
Aarons, G. A., Fettes, D. L., Sommerfeld, D. H., & Palinkas, L. A. (2012) · Child Maltreatment · doi:10.1177/1077559511426908 · Cited by 194
Glisson, C., Green, P., & Williams, N. J. (2012) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2012.06.002 · Cited by 188
Self-citationOrganizational climate, services, and outcomes in child welfare systems
Glisson, C., & Green, P. (2011) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2011.04.009 · Cited by 185
Self-citationNadeem, E., Gleacher, A., & Beidas, R. S. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0502-8 · Cited by 185
“…innovation implementation (e.g., Klein et al. 2001), and emerging research on organizationally-focused strategies for improving clinical care (e.g., Glisson et al. 2010; Saldana and Chamberlain 2012) suggest that a successful support system is likely to include administrative or leadership…”
BackgroundEvidence-Based Psychosocial Treatments for Adolescents With Disruptive Behavior
McCart, M. R., & Sheidow, A. J. (2016) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2016.1146990 · Cited by 179
“Three RCTs did not find favorable outcomes (see Table 2; Glisson et al., 2010; Henggeler et al., 1997; Henggeler et al., 1999), although the two studies by Henggeler and colleagues included demonstrations of low adherence impacting outcomes.”
ResultPredictors of Community Therapists’ Use of Therapy Techniques in a Large Public Mental Health System
Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C., Hurford, M. O., Hadley, T., Barg, F. K., Walsh, L. M., et al. (2015) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2014.3736 · Cited by 177
“Age, mean, y (n = 122 therapists) 35 (29-47)”
Self-citationHenggeler, S. W. (2011) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032210-104615 · Cited by 168
“Indeed, as noted above, Glisson et al. (2010) recently completed a study in which 14 rural Appalachian counties were randomized, in a 2 × 2 design, to clinical (MST program versus usual services) and organizational (ARC to help organizations implement effective communitybased mental health services…”
BackgroundMethodWilliams, N. J. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0693-2 · Cited by 164
Aarons, G. A., Ehrhart, M. G., Moullin, J. C., Torres, E. M., & Green, A. E. (2017) · Implementation Science · doi:10.1186/s13012-017-0562-3 · Cited by 159
The role of treatment fidelity on outcomes during a randomized field trial of an autism intervention
Mandell, D. S., Stahmer, A. C., Shin, S., Xie, M., Reisinger, E., & Marcus, S. C. (2013) · Autism · doi:10.1177/1362361312473666 · Cited by 156
“Finally, recent studies have found that interventions addressing organizational climate as well as program content can have a powerful effect on outcomes (Aarons et al., 2011; Glisson et al., 2010).”
BackgroundHogue, A., Henderson, C. E., Ozechowski, T. J., & Robbins, M. S. (2014) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2014.915550 · Cited by 150
“…an even larger scale, MST has been combined with intensive implementation strategies to improve behavioral health across multiple rural communities (Glisson et al., 2007), FFT has been adopted in statewide initiatives to improve child welfare and juvenile justice outcomes (Barnoski, 2003; Zazzali…”
BackgroundFixsen, D. L., Blasé, K. A., Metz, A. J. R., & Dyke, M. K. V. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.10548-3 · Cited by 171
Improving Community-Based Mental Health Care for Children: Translating Knowledge into Action
Garland, A. F., Haine-Schlagel, R., Brookman-Frazee, L., Baker-Ericzen, M., Trask, E., & Fawley-King, K. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0450-8 · Cited by 142
von Sydow, K., Retzlaff, R., Beher, S., Haun, M. W., & Schweitzer, J. (2013) · Family Process · doi:10.1111/famp.12047 · Cited by 166
“c15 Glisson et al. (2010) USA x 349 n/i”
InfluentialGlisson, C. A., Hemmelgarn, A. L., Green, P., Dukes, D., Atkinson, S., & Williams, N. J. (2012) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2012.05.010 · Cited by 136
Self-citationAtkins, M. S., Rusch, D. B., Mehta, T. G., & Lakind, D. (2015) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2015.1050724 · Cited by 141
“In a recent study, an organizational intervention derived from this work (Availability, Responsiveness, Continuity; Glisson & Schoenwald, 2005) was shown to enhance the effectiveness of Multisystemic Therapy for seriously conducted disordered youth (MST; Henggeler, Schoenwald, Borduin, Rowland, & Cunningham, 2009), in…”
BackgroundMethodThe Role of Organizational Culture and Climate in Innovation and Effectiveness
Glisson, C. A. (2015) · Human Services Organizations Management Leadership & Governance · doi:10.1080/23303131.2015.1087770 · Cited by 180
Self-citationFarrelly, S., Lester, H., Rose, D., Birchwood, M., Marshall, M., Waheed, W., Henderson, R. C., Szmukler, G., & Thornicroft, G. (2016) · Health Expectations · doi:10.1111/hex.12368 · Cited by 105
Stirman, S. W., Gutner, C. A., Langdon, K., & Graham, J. R. (2016) · Behavior Therapy · doi:10.1016/j.beth.2015.12.001 · Cited by 103
Powell, B. J., Mandell, D. S., Hadley, T. R., Rubin, R. M., Evans, A. C., Hurford, M. O., & Beidas, R. S. (2017) · Implementation Science · doi:10.1186/s13012-017-0593-9 · Cited by 102
“Glisson C, Hemmelgarn A, Green P, Williams NJ. Randomized trial of the Availability, Responsiveness and Continuity (ARC) organizational intervention for improving youth outcomes in community mental health programs.”
BackgroundInfluentialCooperative, T. J.-T., Knight, D. K., Belenko, S., Wiley, T., Robertson, A. A., Arrigona, N., Dennis, M., Bartkowski, J. P., McReynolds, L. S., Becan, J. E., et al. (2015) · Implementation Science · doi:10.1186/s13012-016-0423-5 · Cited by 100
“Implementation studies typically have focused on a single evidence-based intervention [44–46], a specific set of best practices [47, 48], generic best practices [49], or a single evidence-based instrument [50].”
BackgroundGlisson, C. A., Hemmelgarn, A. L., Green, P., & Williams, N. J. (2013) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2013.02.005 · Cited by 109
“org previous randomized trials that confirmed the positive effects of the ARC intervention on organizational social context and youth outcomes, respectively, and previous surveys that found an association between organizational social context and service outcomes.(1,11,13,33) The current study extends the previous wor…”
BackgroundMethodResultInfluentialSelf-citationAarons, G. A., Sommerfeld, D. H., & Willging, C. E. (2011) · Psychological Services · doi:10.1037/a0026196 · Cited by 98
Defining the external implementation context: an integrative systematic literature review
Watson, D. P., Adams, E. L., Shue, S., Coates, H., McGuire, A., Chesher, J., Jackson, J., & Omenka, O. I. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3046-5 · Cited by 92
“Overly complicated, strict, burdensome, and unclear policies, including “unnecessary red tape within service systems” [52] (p.”
BackgroundBeidas, R. S., Edmunds, J., Ditty, M., Watkins, J., Walsh, L., Marcus, S., & Kendall, P. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0529-x · Cited by 95
“Examples of implementation strategies include discrete strategies, such as audit and feedback, as well as more complex strategies, such as the use of community development teams to implement EBP (Saldana and Chamberlain 2012) and the availability, responsiveness, and continuity (ARC) organizational implementation stra…”
Gleacher, A. A., Olin, S. S., Nadeem, E., Pollock, M., Ringle, V., Bickman, L., Douglas, S., & Hoagwood, K. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0642-0 · Cited by 91
“…et al. 2003; Glisson 2008; Glisson and Durick 1988; Glisson and Green 2006; Glisson and Hemmelgarn 1998; Glisson et al. 2013a; Glisson et al. 2008a; Glisson et al. 2010; Greener et al. 2007; Guzzo et al. 1985; Neuman et al. 1989; Olin et al. 2014; Parker et al. 2003; Robertson et al. 1993;…”
Risks, Outcomes, and Evidence-Based Interventions for Girls in the US Juvenile Justice System
Leve, L. D., Chamberlain, P., & Kim, H. K. (2015) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-015-0186-6 · Cited by 106
Littell, J. H., Pigott, T., Nilsen, W., Green, S. J., & Montgomery, O. L. K. (2021) · Campbell Systematic Reviews · doi:10.1002/cl2.1158 · Cited by 115
Williams, N. J., Glisson, C., Hemmelgarn, A., & Green, P. (2017) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0742-5 · Cited by 86
Self-citationPromoting Healthy Outcomes Among Youth with Multiple Risks: Innovative Approaches
Greenberg, M. T., & Lippold, M. A. (2013) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031811-124619 · Cited by 83
“Eighteen months after treatment, youth receiving both ARC and MST had lower rates of out-of-home placements than did those receiving usual services (50).”
BackgroundApplying the Policy Ecology Framework to Philadelphia’s Behavioral Health Transformation Efforts
Powell, B. J., Beidas, R. S., Rubin, R. M., Stewart, R. E., Wolk, C. B., Matlin, S. L., Weaver, S., Hurford, M. O., Evans, A. C., Hadley, T. R., et al. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0733-6 · Cited by 82
“…general functioning of provider agencies has led to discussions within EPIC about whether more intensive organizational interventions (e.g., ARC; Glisson et al., 2010) or support pertaining to business practices (e.g., New York State’s efforts; Hoagwood et al., 2014) might be necessary and…”
BackgroundResultInfluentialWike, T. L., Bledsoe, S. E., Manuel, J. I., Despard, M., Johnson, L. V., Bellamy, J. L., & Killian-Farrell, C. (2014) · Clinical Social Work Journal · doi:10.1007/s10615-014-0492-3 · Cited by 103
Hoagwood, K. E., Purtle, J., Spandorfer, J., Peth-Pierce, R., & Horwitz, S. M. (2020) · American Psychologist · doi:10.1037/amp0000706 · Cited by 81
“This differs from instances where an evidence-based treatment (EBT) or EBP is rolled out with consideration of the policy context (e.g., Glisson et al., 2010; Chaffin et al., 2012; Grimes et al., 2011).”
Child Welfare Caseworkers as Service Brokers for Youth in Foster Care
Dorsey, S., Kerns, S. E. U., Trupin, E. W., Conover, K. L., & Berliner, L. (2012) · Child Maltreatment · doi:10.1177/1077559511429593 · Cited by 81
“Other research has demonstrated that combining systems-level interventions with EBPs can be particularly effective for implementation of specific EBPs (e.g., Glisson et al., 2010) and could enhance EBP brokering interventions.”
BackgroundA Statewide Common Elements Initiative for Children’s Mental Health
Dorsey, S., Berliner, L., Lyon, A. R., Pullmann, M. D., & Murray, L. K. (2016) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-014-9430-y · Cited by 79
Policy to implementation: evidence-based practice in community mental health – study protocol
Beidas, R. S., Aarons, G., Barg, F., Evans, A., Hadley, T., Hoagwood, K., Marcus, S., Schoenwald, S., Walsh, L., & Mandell, D. S. (2013) · Implementation Science · doi:10.1186/1748-5908-8-38 · Cited by 81
Self-citationImplementation frameworks in child, youth and family services – Results from a scoping review
Albers, B., Mildon, R. L., Lyon, A. R., & Shlonsky, A. (2017) · Children and Youth Services Review · doi:10.1016/j.childyouth.2017.07.003 · Cited by 89
“…these frameworks in their implementation of specific programs or services (Barbee, Christensen, Antle, Wandersman, & Cahn, 2011; Brown et al., 2014; Glisson et al., 2010); and in major government institutions, charitable funding organizations, and professional associations listing implementation…”
BackgroundWilliams, N. J., & Glisson, C. A. (2013) · Children and Youth Services Review · doi:10.1016/j.childyouth.2013.09.002 · Cited by 95
Self-citationTraining School Mental Health Providers to Deliver Cognitive-Behavioral Therapy
Beidas, R. S., Mychailyszyn, M. P., Edmunds, J. M., Khanna, M. S., Downey, M. M., & Kendall, P. C. (2012) · School Mental Health · doi:10.1007/s12310-012-9074-0 · Cited by 89
Powell, B. J., Proctor, E. K., Glisson, C. A., Kohl, P. L., Raghavan, R., Brownson, R. C., Stoner, B. P., Carpenter, C. R., & Palinkas, L. A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-92 · Cited by 71
Self-citationAssessing and Changing Organizational Social Contexts for Effective Mental Health Services
Glisson, C., & Williams, N. J. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031914-122435 · Cited by 70
“Third, the ARC specialist builds a network of relationships through meetings that focus on issues identified as important by the organizational leadership, line-level supervisors, and other stakeholders (43).”
BackgroundInfluentialSelf-citationAarons, G. A., Ehrhart, M. G., Torres, E. M., Finn, N. K., & Beidas, R. S. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600062 · Cited by 68
Forman‐Hoffman, V. L., Middleton, J. C., McKeeman, J. L., Stambaugh, L. F., Christian, R. B., Gaynes, B. N., Kane, H., Kahwati, L. C., Lohr, K. N., & Viswanathan, M. (2017) · Implementation Science · doi:10.1186/s13012-017-0626-4 · Cited by 98
“Such strategies target changes in the organization and delivery of mental health services [13, 14].”
BackgroundResultNew Horizons of Translational Research and Research Translation in Social Work
Palinkas, L. A., & Soydan, H. (2012) · Research on Social Work Practice · doi:10.1177/1049731511408738 · Cited by 66
Lyon, A. R., Whitaker, K. M., Locke, J. J., Cook, C. R., King, K. M., Duong, M. T., Davis, C. J., Weist, M. D., Ehrhart, M. G., & Aarons, G. A. (2018) · Implementation Science · doi:10.1186/s13012-018-0721-1 · Cited by 67
“Inner context factors may be particularly critical to successful implementation and sustainment of EBP [2, 17, 22, 23].”
BackgroundLocke, J., Beidas, R. S., Marcus, S., Stahmer, A., Aarons, G. A., Lyon, A. R., Cannuscio, C., Barg, F., Dorsey, S., & Mandell, D. S. (2016) · Implementation Science · doi:10.1186/s13012-016-0501-8 · Cited by 62
Boxer, P., Kubik, J., Ostermann, M., & Veysey, B. M. (2015) · Children and Youth Services Review · doi:10.1016/j.childyouth.2015.02.012 · Cited by 69
“Although a fair amount of research has examined the dissemination and implementation ofMST in “realworld” clinical service environments (Glisson et al., 2010; Schoenwald, 2008), less work by comparison has investigated directly the outcomes of MST as delivered in these environments.”
BackgroundHoagwood, K. E., Jensen, P. S., Acri, M. C., Serene Olin, S., Eric Lewandowski, R., & Herman, R. J. (2012) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2012.09.004 · Cited by 61
Kolko, D. J., Baumann, B. L., Herschell, A. D., Hart, J. A., Holden, E. A., & Wisniewski, S. R. (2012) · Child Maltreatment · doi:10.1177/1077559511427346 · Cited by 60
“A few studies have identified moderators of training outcome that reflect practitioner degree or educational background (Herschell, Kogan, Celedonia, Gavin, & Stein, 2009) and perceived organizational climate (Glisson & Schoenwald, 2010).”
BackgroundMethodInfluentialOlin, S.-C. S., Williams, N., Pollock, M., Armusewicz, K., Kutash, K., Glisson, C. A., & Hoagwood, K. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0499-z · Cited by 67
Self-citationCommunity engagement in dissemination and implementation models: A narrative review
Pinto, R. M., Park, S., Miles, R., & Ong, P. N. (2021) · Implementation Research and Practice · doi:10.1177/2633489520985305 · Cited by 71
Encouraging Desistance from Crime
Doleac, J. L. (2023) · Journal of Economic Literature · doi:10.1257/jel.20211536 · Cited by 62
Lee, B. R., Ebesutani, C. K., Kolivoski, K. M., Becker, K. D., Lindsey, M. A., Brandt, N. E., Cammack, N. L., Strieder, F. H., Chorpita, B. F., & Barth, R. P. (2014) · American Journal of Orthopsychiatry · doi:10.1037/h0099811 · Cited by 76
Fishman, J., Beidas, R. S., Reisinger, E. M., & Mandell, D. S. (2018) · Journal of School Health · doi:10.1111/josh.12618 · Cited by 65
Direct-to-Consumer Marketing of Evidence-Based Psychological Interventions
Santucci, L. C., McHugh, R. K., & Barlow, D. H. (2011) · Behavior Therapy · doi:10.1016/j.beth.2011.07.003 · Cited by 63
How Can the Use of Evidence in Mental Health Policy Be Increased? A Systematic Review
Williamson, A. B., Makkar, S. R., McGrath, C., & Redman, S. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201400329 · Cited by 51
“Three studies (17,33,34) focused on policy influences as a key strategy for increasing the use of evidence in mental health policy.”
BackgroundMethodInfluentialStanick, C. F., Halko, H. M., Dorsey, C. N., Weiner, B. J., Powell, B. J., Palinkas, L. A., & Lewis, C. C. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3709-2 · Cited by 54
Naar-King, S., Ellis, D., King, P. S., Lam, P., Cunningham, P., Secord, E., Bruzzese, J.-M., & Templin, T. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0036092 · Cited by 54
Hanson, R. F., Self‐Brown, S., Rostad, W. L., & Jackson, M. C. (2015) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2015.09.014 · Cited by 67
Reliability of Therapist Self-Report on Treatment Targets and Focus in Family-Based Intervention
Hogue, A., Dauber, S., Henderson, C. E., & Liddle, H. A. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0520-6 · Cited by 52
Taxman, F. S., Henderson, C. E., Young, D., & Farrell, J. L. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0445-5 · Cited by 61
“Organizational strategies that focus on increasing administrative and staff support for evidence based practices have resulted in reducing rates of undesirable outcomes such as out of home placements (Glisson et al. 2010), but the science is slowly evolving on which implementation strategies may be the most effective…”
BackgroundInfluentialSuhrheinrich, J., Melgarejo, M., Root, B. V., Aarons, G. A., & Brookman-Frazee, L. I. (2021) · Autism · doi:10.1177/13623613211016729 · Cited by 59
“This is consistent with literature indicating that implementation leadership and implementation climate influence the use of EBPs (Aarons et al., 2014; Novins et al., 2013) and overall organizational climate (Glisson et al., 2010).”
ResultGarbacz, L. L., Brown, D. M., Spee, G. A., Polo, A. J., & Budd, K. S. (2014) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-014-0166-2 · Cited by 67
Nadeem, E., Weiss, D., Olin, S.-C. S., Hoagwood, K., & Horwitz, S. M. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0735-4 · Cited by 57
“The LC might also be compared and contrasted with the ARC model (e.g., Glisson et al. 2010), which has a similar emphasis on withinsite team effectiveness, goal setting, identification of implementation barriers, and feedback systems, but differs in its structure and depth of focus on the overall…”
Elucidating the influence of supervisors’ roles on implementation climate
Bunger, A. C., Birken, S. A., Hoffman, J. A., MacDowell, H., Choy-Brown, M., & Magier, E. (2019) · Implementation Science · doi:10.1186/s13012-019-0939-6 · Cited by 56
Dennhag, I., Gibbons, M. B. C., Barber, J. P., Gallop, R., & Crits-Christoph, P. (2012) · Psychotherapy Research · doi:10.1080/10503307.2012.674790 · Cited by 51
“The two dissemination studies we found with variables of interests investigated two and three sessions per patient, respectively (Glisson et al., 2010; Weisz et al., 2009).”
BackgroundPalinkas, L. A., Weisz, J. R., Chorpita, B. F., Levine, B., Garland, A. F., Hoagwood, K. E., & Landsverk, J. (2013) · Psychiatric Services · doi:10.1176/appi.ps.004682012 · Cited by 50
Bruns, E. J., Pullmann, M. D., Sather, A., Brinson, R. D., & Ramey, M. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0571-3 · Cited by 48
“Local systems should also consider how best to promote features of organizations and the system that are necessary to implement a model such as wraparound successfully, and that might also be directly related to positive child and family outcomes (Glisson et al. 2010).”
BackgroundResultSchultes, M.-T., Stefanek, E., van de Schoot, R., Strohmeier, D., & Spiel, C. (2014) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000165 · Cited by 64
Fixsen, D. L., Blasé, K. A., & Fixsen, A. A. M. (2017) · Criminology & Public Policy · doi:10.1111/1745-9133.12288 · Cited by 54
Multisystemic Therapy: Clinical Foundations and Research Outcomes
Henggeler, S. W. (2012) · Psychosocial Intervention · doi:10.5093/in2012a12 · Cited by 68
“In the third (Glisson et al., 2010), 14 rural Appalachian counties were randomized to receive MST programs or not, and 615 juvenile offenders at risk of out-of-home placement and their families participated.”
MethodIntraorganizational Conditions Supporting Social Innovations by Human Service Nonprofits
Shier, M. L., Handy, F., & Jennings, C. (2018) · Nonprofit and Voluntary Sector Quarterly · doi:10.1177/0899764018797477 · Cited by 54
“…in decision making, and concentrating on relationships between organizational units that impact the quality of services for clients (Glisson, Dukes, & Green, 2006; Glisson, Hemmelgarn, Green, & Williams, 2013; Glisson, Hemmelgarn, Green, Dukes, Atkinson, et al., 2012; Glisson et al., 2010).”
BackgroundLocke, J. J., Shih, W., Kang‐Yi, C. D., Caramanico, J., Shingledecker, T., Gibson, J., Frederick, L., & Mandell, D. S. (2018) · Autism · doi:10.1177/1362361318787802 · Cited by 48
“…effects on a larger group of staff’s behavior that resulted in much more positive child outcomes similar to other organizational interventions such as Availability, Responsiveness, and Continuity on the use of evidencebased practices in community-based mental health services (Glisson et al., 2010).”
Technology-Based Alcohol Interventions in Primary Care: Systematic Review
Ramsey, A. T., Satterfield, J. M., Gerke, D. R., & Proctor, E. K. (2019) · Journal of Medical Internet Research · doi:10.2196/10859 · Cited by 40
“[81], this remains a relatively novel finding that contributes to the accumulating evidence of the value-added benefit of employing implementation strategies to facilitate EBIs.”
Aligning organizational priorities with ARC to improve youth mental health service outcomes.
Glisson, C. A., Williams, N. J., Hemmelgarn, A. L., Proctor, E. K., & Green, P. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000107 · Cited by 45
“The APQ was developed and validated in two prior RCTs of ARC in which it demonstrated reliability, sensitivity to change, and discriminant validity with respect to agencies in ARC and control conditions (Glisson et al., 2010; Glisson et al., 2013).”
MethodSelf-citation
Metadata
- Authors
- Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E.
- Affiliations
- University of Tennessee at Knoxville (US)
- Medical University of South Carolina (US)
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2010
- Volume
- 78
- Issue
- 4
- Pages
- 537-550
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- PMC
- PMC3951378
- OpenAlex
- W2070012218
- Cited by
- 243
- References
- 55
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 9 · 2023: 8 · 2022: 4 · 2021: 6 · 2020: 16 · 2019: 13 · 2018: 21 · 2017: 16 · 2016: 19 · 2015: 30 · 2014: 29 · 2013: 28 · 2012: 25
- FWCI
- 36.35
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (R01-MH066905, R01-MH084855, MH59138)
- National Institute on Drug Abuse (DA018107)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Sociology and Political Science › Child Welfare and Adoption
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- multisystemic therapy, organizational interventions, treatment implementation, delinquent youth, juvenile delinquency, community mental health services, out-of-home placement, behavioral problems, rural Appalachia, evidence-based treatment
- MeSH terms
- Adolescent, Appalachian Region, Mental Disorders, Child, Community Mental Health Services, Family Therapy, Humans, Juvenile Delinquency, Male, Rural Population, Systems Theory, Tennessee, Comorbidity, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.