The role of treatment fidelity on outcomes during a randomized field trial of an autism intervention
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
This randomized field trial comparing Strategies for Teaching based on Autism Research and Structured Teaching enrolled educators in 33 kindergarten-through-second-grade autism support classrooms and 119 students, aged 5–8 years in the School District of Philadelphia. Students were assessed at the beginning and end of the academic year using the Differential Ability Scales. Program fidelity was measured through video coding and use of a checklist. Outcomes were assessed using linear regression with random effects for classroom and student. Average fidelity was 57% in Strategies for Teaching based on Autism Research classrooms and 48% in Structured Teaching classrooms. There was a 9.2-point (standard deviation = 9.6) increase in Differential Ability Scales score over the 8-month study period, but no main effect of program. There was a significant interaction between fidelity and group. In classrooms with either low or high program fidelity, students in Strategies for Teaching based on Autism Research experienced a greater gain in Differential Ability Scales score than students in Structured Teaching (11.2 vs 5.5 points and 11.3 vs 8.9 points, respectively). In classrooms with moderate fidelity, students in Structured Teaching experienced a greater gain than students in Strategies for Teaching based on Autism Research (10.1 vs 4.4 points). The results suggest significant variability in implementation of evidence-based practices, even with supports, and also suggest the need to address challenging issues related to implementation measurement in community settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., Pickles, A., & Rutter, M. (2000) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1005592401947 · Cited by 7,520 · cited 6×
“The average score on the Autism Diagnostic Observation Schedule (ADOS) severity algorithm was 6.7 (SD = 1.0).”
MethodInfluentialBehavioral treatment and normal educational and intellectual functioning in young autistic children.
Lovaas, O. I. (1987) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.55.1.3 · Cited by 3,288 · cited 2×
“The best tested of these interventions are in the family of applied behavior analysis (ABA) and include didactic (Lord and McGee, 2001; Lovaas, 1987) and more incidental (Koegel et al.”
BackgroundAdvancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 2×
“This is especially true in human service organizations such as schools, in which interventions are delivered through the behavior of individuals, who are heavily influenced by the culture and resources of their work environment (Aarons et al., 2011).”
BackgroundThe Challenge of Innovation Implementation
Klein, K. J., & Sorra, J. S. (1996) · The Academy of Management Review · doi:10.2307/259164 · Cited by 2,113 · cited 1×
“In the second phase of AIMS, we have begun to measure factors such as climate for innovation implementation (Klein and Sorra, 1996) and classroom staff cohesion to examine their effects on both fidelity and outcomes.”
BackgroundProctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894 · cited 1×
“Increasingly, studies of the treatment of child psychopathology have noted the differences in outcomes between RCTs and community practice and the need to conduct research that examines the outcomes in community practice settings (Hoagwood and Olin, 2002; Proctor et al., 2009; Weisz et al., 2005).”
BackgroundStandardizing ADOS Scores for a Measure of Severity in Autism Spectrum Disorders
Gotham, K., Pickles, A., & Lord, C. (2009) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-008-0674-3 · Cited by 1,605 · cited 6×
“The average score on the Autism Diagnostic Observation Schedule (ADOS) severity algorithm was 6.7 (SD = 1.0).”
MethodInfluentialEvidence-Based Comprehensive Treatments for Early Autism
Rogers, S. J., & Vismara, L. A. (2008) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410701817808 · Cited by 984
Therapist adherence/competence and treatment outcome: A meta-analytic review.
Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018912 · Cited by 657 · cited 2×
“In this case, increased hours were “chasing” lack of fidelity, but did not comprise an effective strategy for improving it (Webb et al., 2010).”
BackgroundSustainability of Teacher Implementation of School-Based Mental Health Programs
Han, S. S., & Weiss, B. (2005) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-005-7646-2 · Cited by 641 · cited 1×
“The middle tertile of fidelity in the STAR group may include teachers who implemented STAR components with less deep structure knowledge (Han and Weiss, 2005).”
BackgroundHome-Based Behavioral Treatment of Young Children with Autism
Sheinkopf, S. J., & Siegel, B. (1998) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1026054701472 · Cited by 416 · cited 1×
“It is not surprising, therefore, that the few studies of community practice find considerable deviations from proven-efficacious practice and relatively poor outcomes (Bibby et al., 2001; Boyd and Corley, 2001; Chasson et al., 2007; Sheinkopf and Siegel, 1998; Stahmer et al., 2005).”
Background
Cited by
The Lancet Commission on the future of care and clinical research in autism
Lord, C., Charman, T., Havdahl, A., Carbone, P., Anagnostou, E., Boyd, B., Carr, T., de Vries, P. J., Dissanayake, C., Divan, G., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)01541-5 · Cited by 924
Project AIM: Autism intervention meta-analysis for studies of young children.
Sandbank, M., Bottema-Beutel, K., Crowley, S., Cassidy, M., Dunham, K., Feldman, J. I., Crank, J., Albarran, S. A., Raj, S., Mahbub, P., et al. (2020) · Psychological Bulletin · doi:10.1037/bul0000215 · Cited by 606
Evidence Base Update for Autism Spectrum Disorder
Smith, T., & Iadarola, S. (2015) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2015.1077448 · Cited by 339
Communication interventions for autism spectrum disorder in minimally verbal children
Brignell, A., Chenausky, K. V., Song, H., Zhu, J., Suo, C., & Morgan, A. T. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012324.pub2 · Cited by 197
Nahmias, A. S., Pellecchia, M., Stahmer, A. C., & Mandell, D. S. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13073 · Cited by 156
Self-citation
Metadata
- Authors
- Mandell, D. S., Stahmer, A. C., Shin, S., Xie, M., Reisinger, E., & Marcus, S. C.
- Venue
- Autism
- Publisher
- SAGE Publications
- Published
- 2013-04-16
- Volume
- 17
- Issue
- 3
- Pages
- 281-295
- ISSN
- 1362-3613 (ISSN-L)
- 1461-7005
- OpenAlex
- W1981916579
- Cited by
- 156
- References
- 15
- FWCI
- 25.12
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The role of treatment fidelity on outcomes during a randomized field trial of an autism intervention. https://app.cochat.ai/papers/10.1177/1362361312473666
- The paper
- Mandell, D. S., Stahmer, A. C., Shin, S., Xie, M., Reisinger, E., & Marcus, S. C. (2013). The role of treatment fidelity on outcomes during a randomized field trial of an autism intervention. Autism. https://doi.org/10.1177/1362361312473666
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.