Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy.
Open accessThe DOI matches its Crossref record; 53 of the 55 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: A randomized trial assessed the effectiveness of a 2-level strategy for implementing evidence-based mental health treatments for delinquent youth. METHOD: A 2 x 2 design encompassing 14 rural Appalachian counties included 2 factors: (a) the random assignment of delinquent youth within each county to a multisystemic therapy (MST) program or usual services and (b) the random assignment of counties to the ARC (for availability, responsiveness, and continuity) organizational intervention for implementing effective community-based mental health services. The design created 4 treatment conditions (MST plus ARC, MST only, ARC only, control). Outcome measures for 615 youth who were 69% male, 91% Caucasian, and aged 9-17 years included the Child Behavior Checklist and out-of-home placements. RESULTS: A multilevel, mixed-effects, regression analysis of 6-month treatment outcomes found that youth total problem behavior in the MST plus ARC condition was at a nonclinical level and significantly lower than in other conditions. Total problem behavior was equivalent and at nonclinical levels in all conditions by the 18-month follow-up, but youth in the MST plus ARC condition entered out-of-home placements at a significantly lower rate (16%) than youth in the control condition (34%). CONCLUSIONS: Two-level strategies that combine an organizational intervention such as ARC and an evidence-based treatment such as MST are promising approaches to implementing effective community-based mental health services. More research is needed to understand how such strategies can be used effectively in a variety of organizational contexts and with other types of evidence-based treatments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Considerable information is available on the organizational characteristics that promote the exploration and eventual adoption of innovation (Greenhalgh et al. 2004; Rogers 2003) and EBPs in mental health and social service organizations”
From Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors (2011) · cites this paper as Glisson et al. 2010
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“For example, Glisson et al. (2010) demonstrated in a randomized trial that multisystemic therapy (MST) is more effective when implemented in the context of an organization development intervention that focuses on improving leadership and community agency culture and climate than when MST is implemented alone.”
From Standards of Evidence for Efficacy, Effectiveness, and Scale-up Research in Prevention Science: Next Generation (2015) · cites this paper as Glisson et al. 2010
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724 · cited 4×
“The analysis used a binomial sampling model based on the Bernoulli distribution and a logit link function with the log of the odds of custody as the outcome variable (Raudenbush & Bryk, 2002, pp. 294–309).”
MethodInfluentialBowman, P. W. (1963) · AIBS Bulletin · doi:10.2307/1292957 · Cited by 3,638
Child abuse and neglect: The myth of classlessness.
Pelton, L. H. (1978) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1978.tb02565.x · Cited by 1,949
Lenggenhager, J. (1947) · PubMed · Cited by 1,772
(2018) · The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation · doi:10.4135/9781506326139.n404 · Cited by 1,528
Evidence-Based Psychosocial Treatments for Children and Adolescents With Disruptive Behavior
Eyberg, S. M., Nelson, M. M., & Boggs, S. R. (2008) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410701820117 · Cited by 1,335
(2003) · Guilford Press eBooks · Cited by 1,037
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873
Identifying and developing empirically supported child and adolescent treatments.
Kazdin, A. E., & Weisz, J. R. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.1.19 · Cited by 758 · cited 1×
“…of the implementation and outcomes of MST in community settings have been summarized in peerreviewed journals (e.g., Eyberg, Nelson & Boggs, 2008; Kazdin & Weisz, 1998; Schoenwald, 2008), government reports (e.g., National Institute on Drug Abuse, 1999; National Institutes of Health, 2006; U.S.…”
Background
Research works printed but not linked: 3
- Glisson C Sowers K Dulmus C 2008 Interventions with organizations: The ARC model The Comprehensive Handbook of Social Work and Social Welfare 3 556 581 Hoboken, NJ John Wiley & Sons
- Glisson C Webb MB Dowd K Harden BJ Landsverk J Testa MF 2009 Organizational climate and service outcomes in child welfare agencies Child welfare and child protection: New perspectives from the National Survey of Child and Adolescent Well-being New York Oxford University Press
- Myford CM Wolfe EW 2003 Detecting and measuring rater effects using many-facet Rasch measurement: Part I Journal of Applied Measurement 4 386 422 14523257
Cited by
Items 201–242 of 242
Reducing unnecessary preoperative testing through a comprehensive EMR based digital algorithm
Esper, S. A., Holder‐Murray, J., Meister, K., Lin, H. S., Bauer, A. K., Artman, J., Garver, M., Lukanski, A., Zuckerbraun, B. S., Marroquin, O. C., et al. (2024) · EBioMedicine · doi:10.1016/j.ebiom.2024.105509 · Cited by 3
Park, S., Bakko, M., & Pinto, R. M. (2025) · Human Services Organizations Management Leadership & Governance · doi:10.1080/23303131.2025.2471533 · Cited by 3
VanGompel, E. W., Verma, S., Wator, C., Carlock, F., Lyndon, A., Borders, A. E. B., & Holl, J. L. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-12108-3 · Cited by 3
“Existing implementation science research has demonstrated that changing organizational characteristics, such as culture, enhance the adoption and sustainability of an intervention, ostensibly by improving the fit between the intervention and the context [23, 24].”
Advancing Implementation: Toward an Inclusive View of Research in Behavioral Medicine
Fixsen, D. L., Boothroyd, R. I., Blasé, K. A., Fixsen, A. A. M., & Metz, A. J. R. (2018) · Springer eBooks · doi:10.1007/978-0-387-93826-4_8 · Cited by 5
Schawo, S. J., Eeren, H. V., Soeteman, D. I., van der Veldt, M.-C., Noom, M. J., Brouwer, W. B. F., Busschbach, J. J. V., & Hakkaart, L. (2012) · PubMed · Cited by 3
s ysteMatiC review of y outh CriMe Prevention interventions
Manuel, C. (2012) · Cited by 3
Applegarth, D. M., Jones, P., & Holliday, S. B. (2023) · RAND Corporation eBooks · doi:10.7249/rra1663-2 · Cited by 3
Mommerency, G., den Heede, K. V., Verhaeghe, N., Swartenbroekx, N., Annemans, L., Schoentjes, E., & Eyssen, M. (2011) · Ghent University Academic Bibliography (Ghent University) · Cited by 7
Establishing usable innovations
Fixsen, D. L., Dyke, M. K. V., & Blasé, K. A. (2026) · Frontiers in Health Services · doi:10.3389/frhs.2025.1745148 · Cited by 2
Implementation from a habit perspective
Potthoff, S., McCleary, N., Sniehotta, F. F., & Presseau, J. (2020) · Edward Elgar Publishing eBooks · doi:10.4337/9781788975995.00027 · Cited by 2
Conduct Disorders and Substance Use Problems in Rural School Settings
Zajac, K., Andrews, A. R., & Sheidow, A. J. (2017) · Springer eBooks · doi:10.1007/978-3-319-64735-7_12 · Cited by 2
Scaccia, J. (2014) · Scholar Commons (University of South Carolina) · Cited by 6
Dissemination of Evidence-Based Treatments for Children and Families in Practice Settings
Cox, J. R., & Southam‐Gerow, M. A. (2020) · Issues in clinical child psychology · doi:10.1007/978-3-030-44226-2_22 · Cited by 2
Long-Term Effects of a Social Intervention for Vulnerable Youth: A Register-Based Study
Arendt, J. N., & Verner, M. (2018) · Springer eBooks · doi:10.1007/978-3-319-78461-8_14 · Cited by 1
Aarons, G. A. (2014) · the Clinical Research Education Library · doi:10.1044/cred-pvid-implscid2p1 · Cited by 1
Powell, B. J. (2014) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k7571943 · Cited by 1
“Two aspects of organizational context (culture and climate) have been linked to clinical and service system outcomes (Glisson, 2007; Glisson et al., 2010); however, the impact of organizational culture and climate on implementation processes is not well explored.”
BackgroundCommunity Child Psychiatry: The Example of Mobile Mental Health Units in the NE and Western Cyclades
Pantelidou, S., Antonopoulou, V., Πούλιος, Α., Soumaki, J., & Stylianidis, S. (2016) · Springer eBooks · doi:10.1007/978-3-319-28616-7_11 · Cited by 2
Unraveling the Hidden Curriculum. Values in Youth Care Interventions and Youth Policy
Hopman, M. (2012) · Utrecht University Repository (Utrecht University) · Cited by 2
Examining effective interventions for deep-end youth in the juvenile justice system
McCann, E. P. (2012) · Rutgers University Community Repository (Rutgers University) · doi:10.7282/t3kp8132 · Cited by 1
Implementation Science and Practice
Proctor, E. K., Powell, B. J., & McGinnis, H. (2011) · Oxford University Press eBooks · doi:10.1093/obo/9780195389678-0012 · Cited by 1
Editorial: Fixing Implementation Science’s Implementation Problem
Mandell, D. S. (2025) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2025.04.003 · Cited by 1
Naar‐King, S., Ellis, D. A., King, P. S., Lam, P. K., Cunningham, P., Secord, E. A., Bruzzese, J., & Templin, T. (2016) · Gezinstherapie Wereldwijd · doi:10.1007/s12440-016-0025-1
Job perceptions following statewide evidence-based treatment implementation
Green, A. E., Cafri, G., & Aarons, G. A. (2016) · Journal of Children s Services · doi:10.1108/jcs-07-2016-0013 · Cited by 1
Ronan, K. R., Davies, G., Wikman, R., Canoy, D., Jarrett, M., & Evans, C. (2018) · Gezinstherapie Wereldwijd · doi:10.1007/s12440-018-0072-x
Dissemination and Implementation
Cox, J. R., & Southam‐Gerow, M. A. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-813004-9.00019-0
Implementing Research into Everyday Systemic Family Therapy Practice
Withers, M. C., & Duncan, J. M. (2020) · Wiley eBooks · doi:10.1002/9781119438519.ch22
Stakeholder Views on Children's Mental Health Services
Rodríguez, A. (2012) · PubMed Central · doi:10.25772/gzpt-rg80
Franklin, M. E., & Morris, S. H. (2017) · Springer eBooks · doi:10.1007/978-3-319-57196-6_12 · Cited by 1
Implementing Research into Everyday Systemic Family Therapy Practice
Withers, M. C., & Duncan, J. M. (2020) · Wiley eBooks · doi:10.1002/9781119790181.ch22
What are the future directions for AMBIT?
Cracknell, L., Talbot, L., Smith, R. K., Fairbairn, J., Bevington, D., & Fuggle, P. (2023) · Oxford University Press eBooks · doi:10.1093/med-psych/9780198855910.003.0014
Williams, N. J., Russo, J. E., Vredevoogd, M. A., Grover, T., Green, P., Proctor, E. K., Bhat, A. S., Unützer, J., & Bennett, I. M. (2023) · Implementation Research and Practice · doi:10.1177/26334895231205891
“…research has linked these dimensions of culture and climate to service outcomes in social service agencies (Glisson & Green, 2011; Williams & Glisson, 2014) and has shown that interventions targeting these dimensions are associated with improved social service outcomes (Glisson et al., 2010, 2013).”
BackgroundSelf-citationBenjamin, L. R., Stahmer, A. C., Johnson, A. R., Lau, A. S., Roesch, S. C., Hernandez, S. H., & Brookman-Frazee, L. I. (2025) · Evidence-Based Practice in Child and Adolescent Mental Health · doi:10.1080/23794925.2025.2579293
Lewis, C. C., Boyd, M. R., Walsh‐Bailey, C., Lyon, A. R., Beidas, R., Mittman, B., Aarons, G. A., Weiner, B. J., & Chambers, D. (2020) · Figshare · doi:10.6084/m9.figshare.12144159
Lewis, C. C., Boyd, M. R., Walsh‐Bailey, C., Lyon, A. R., Beidas, R., Mittman, B., Aarons, G. A., Weiner, B. J., & Chambers, D. (2020) · Figshare · doi:10.6084/m9.figshare.12144168
Zhang, Y., Larson, M. F., Ehrhart, M. G., King, K., Locke, J. J., Cook, C. R., & Lyon, A. R. (2024) · Figshare · doi:10.6084/m9.figshare.26726057
Lewis, C. C., Boyd, M. R., Walsh‐Bailey, C., Lyon, A. R., Beidas, R., Mittman, B., Aarons, G. A., Weiner, B. J., & Chambers, D. (2020) · Figshare · doi:10.6084/m9.figshare.12144174
Zhang, Y., Larson, M. F., Ehrhart, M. G., King, K., Locke, J. J., Cook, C. R., & Lyon, A. R. (2024) · Figshare · doi:10.6084/m9.figshare.26726060
Zhang, Y., Larson, M. F., Ehrhart, M. G., King, K., Locke, J. J., Cook, C. R., & Lyon, A. R. (2024) · Figshare · doi:10.6084/m9.figshare.26726054
Zhang, Y., Larson, M. F., Ehrhart, M. G., King, K., Locke, J. J., Cook, C. R., & Lyon, A. R. (2024) · Figshare · doi:10.6084/m9.figshare.26726063
Farran, G. (2014) · UPT. Syiah Kuala University Library (Syiah Kuala University) · doi:10.15123/pub.3978 · Cited by 1
“Glisson et al. (2010) note that simply training clinicians in new evidence-based treatments is not sufficient to create effective services.”
Background
Metadata
- Authors
- Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E.
- Affiliations
- University of Tennessee at Knoxville (US)
- Medical University of South Carolina (US)
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2010
- Volume
- 78
- Issue
- 4
- Pages
- 537-550
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- PMC
- PMC3951378
- OpenAlex
- W2070012218
- Cited by
- 243
- References
- 55
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 9 · 2023: 8 · 2022: 4 · 2021: 6 · 2020: 16 · 2019: 13 · 2018: 21 · 2017: 16 · 2016: 19 · 2015: 30 · 2014: 29 · 2013: 28 · 2012: 25
- FWCI
- 36.35
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (R01-MH066905, R01-MH084855, MH59138)
- National Institute on Drug Abuse (DA018107)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Sociology and Political Science › Child Welfare and Adoption
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- multisystemic therapy, organizational interventions, treatment implementation, delinquent youth, juvenile delinquency, community mental health services, out-of-home placement, behavioral problems, rural Appalachia, evidence-based treatment
- MeSH terms
- Adolescent, Appalachian Region, Mental Disorders, Child, Community Mental Health Services, Family Therapy, Humans, Juvenile Delinquency, Male, Rural Population, Systems Theory, Tennessee, Comorbidity, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.