Updating a meta-analysis of intervention research with challenging behaviour: treatment validity and standards of practice
Abstract
BACKGROUND: This meta-analysis of interventions with challenging behaviour in children with disabilities updates a comprehensive meta-analysis that previously addressed reported standards of practice and effectiveness of different strategies. METHOD: Four effect-size algorithms were calculated for published intervention cases, and results analysed and compared to previous findings by behaviour target, intervention type, and other factors. RESULTS: The evidence largely supports intervention effectiveness, with some inconsistency reflecting the fact that the four metrics assess different aspects of change. Skills replacement, consequence combined with systems change, and antecedent interventions generated selective positive results, large enough to be clinically meaningful. CONCLUSIONS: Behavioural interventions effectively reduce challenging behaviour, particularly when preceded by a functional analysis. Teaching replacement skills was most effective, especially if used in combination with systems change and/or traditional antecedent and consequence manipulation. Positive changes as well as enduring limitations to both research design and standards of clinical practice in comparison to 18 years ago are discussed.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Behavioural interventions can be effective in reducing challenging behaviour in individuals with autism spectrum disorder and/or intellectual and developmental disabilities.
“Behavioural interventions can be effective in reducing CB in individuals with ASD and/or IDD (32, 33).”
Cites
(2000) · Cited by 9,198 · see citing works
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542 · see citing works
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023 · see citing works
American Journal of Mental Retardation
Staff (2008) · Encyclopedia of Special Education · doi:10.1002/9780470373699.speced0106 · Cited by 2,972 · see citing works
REDUCING BEHAVIOR PROBLEMS THROUGH FUNCTIONAL COMMUNICATION TRAINING
Carr, E. G., & Durand, V. M. (1985) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1985.18-111 · Cited by 2,162 · see citing works
Empirically supported psychological interventions: Controversies and evidence
Chambless, D. L., & Ollendick, T. H. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.685 · Cited by 2,097 · see citing works
Update on empirically validated therapies, II: (619622010-001)
Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., Daiuto, A., DeRubeis, R., Detweiler, J., Haaga, D. A. F., et al. (1997) · PsycEXTRA Dataset · doi:10.1037/e619622010-001 · Cited by 1,488 · see citing works
Writing meta-analytic reviews.
Rosenthal, R. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.183 · Cited by 1,108 · see citing works
Carr, E. G., Dunlap, G., Horner, R. H., Koegel, R. L., Turnbull, A. P., Sailor, W. S., Anderson, J. L., Albin, R. W., Koegel, L. K., & Fox, L. (2002) · Journal of Positive Behavior Interventions · doi:10.1177/109830070200400102 · Cited by 980 · see citing works
The Quantitative Synthesis of Single-Subject Research
Scruggs, T. E., Mastropieri, M. A., & Casto, G. C. (1987) · Remedial and Special Education · doi:10.1177/074193258700800206 · Cited by 971 · see citing works
Psychological Treatments That Cause Harm
Lilienfeld, S. O. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00029.x · Cited by 959 · see citing works
Emerson, E. (2003) · Journal of Intellectual Disability Research · doi:10.1046/j.1365-2788.2003.00464.x · Cited by 699 · see citing works
Goldfried, M. R. (1985) · Springer eBooks · doi:10.1007/978-1-4615-7278-7_3 · Cited by 687 · see citing works
Single-case research design and analysis : new directions for psychology and education
Kratochwill, T. R., & Levin, J. R. (1992) · Routledge eBooks · Cited by 574 · see citing works
Agius, M. (1996) · University of Malta. Department of Psychiatry eBooks · Cited by 528 · see citing works
Shapiro, E. S., & Browder, D. M. (1990) · Springer eBooks · doi:10.1007/978-1-4899-2501-5_5 · Cited by 450 · see citing works
Critical Issues in the Lives of People With Severe Disabilities
Meyer, L. H., Peck, C. A., & Brown, L. (1991) · DigitalGeorgetown (Georgetown University Library) · Cited by 382 · see citing works
Self-citationChallenging behaviours: prevalence and topographies
Lowe, K., Allen, D. G., Jones, E. C., Brophy, S., Moore, K., & James, W. (2007) · Journal of Intellectual Disability Research · doi:10.1111/j.1365-2788.2006.00948.x · Cited by 356 · see citing works
Didden, R., Duker, P. C., & Korzilius, H. P. L. M. (1997) · PubMed · Cited by 308 · see citing works
Goldfried, M. R. (1982) · Springer eBooks · doi:10.1007/978-1-4615-7275-6_4 · Cited by 307 · see citing works
Design and analysis of single-case research
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1208 · Cited by 297 · see citing works
Heyvaert, M., Saenen, L., Campbell, J. M., Maes, B., & Onghena, P. (2014) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2014.06.017 · Cited by 285 · see citing works
Scotti, J. R., Evans, I. M., Meyer, L. H., & Walker, P. (1991) · PubMed · Cited by 267 · see citing works
Self-citationMurphy, G. H., Beadle‐Brown, J., Wing, L., Gould, J., Shah, A., & Holmes, N. (2005) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-005-5030-2 · Cited by 247 · see citing works
Calculating effect sizes for meta-analysis: The case of the single case∗
Allison, D. B., & Gorman, B. S. (1993) · Behaviour Research and Therapy · doi:10.1016/0005-7967(93)90115-b · Cited by 246 · see citing works
Campbell, J. M. (2003) · Research in Developmental Disabilities · doi:10.1016/s0891-4222(03)00014-3 · Cited by 237 · see citing works
A Meta-Analysis of Single-Subject-Design Intervention Research for Students with LD
Swanson, H. L., & Sachse-Lee, C. (2000) · Journal of Learning Disabilities · doi:10.1177/002221940003300201 · Cited by 232 · see citing works
Effect size calculations and single subject designs
Olive, M. L., & Smith, B. W. (2004) · Educational Psychology · doi:10.1080/0144341042000301238 · Cited by 220 · see citing works
Barnett, D. W., Daly, E. J., Jones, K. M., & Lentz, F. E. (2004) · The Journal of Special Education · doi:10.1177/00224669040380020101 · Cited by 215 · see citing works
Hierarchical linear models for the quantitative integration of effect sizes in single-case research
Noortgate, W. V. D., & Onghena, P. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195492 · Cited by 190 · see citing works
Statistical Comparison of Four Effect Sizes for Single-Subject Designs
Campbell, J. M. (2004) · Behavior Modification · doi:10.1177/0145445503259264 · Cited by 178 · see citing works
Sanders, M. R., Mazzucchelli, T. G., & Studman, L. J. (2004) · Journal of Intellectual & Developmental Disability · doi:10.1080/13668250412331285127 · Cited by 177 · see citing works
INTERRUPTED TIME‐SERIES ANALYSIS AND ITS APPLICATION TO BEHAVIORAL DATA
Hartmann, D. P., Gottman, J. M., Jones, R. R., Gardner, W. P., Kazdin, A. E., & Vaught, R. S. (1980) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1980.13-543 · Cited by 166 · see citing works
Didden, R., Korzilius, H. P. L. M., van Oorsouw, W. M. W. J., & Sturmey, P. (2006) · American Journal on Mental Retardation · doi:10.1352/0895-8017(2006)111[290:btocbi]2.0.co;2 · Cited by 165 · see citing works
Nonaversive Intervention for Behavior Problems: A Manual for Home and Community
Meyer, L. H., & Evans, I. M. (1989) · Medical Entomology and Zoology · Cited by 160 · see citing works
Self-citationMathur, S. R., Kavale, K. A., Quinn, M. M., Forness, S. R., & Rutherford, R. B. (1998) · Behavioral Disorders · doi:10.1177/019874299802300306 · Cited by 156 · see citing works
Evaluating Single-Case Research Data: A Comparison of Seven Statistical Methods
Parker, R. I., & Brossart, D. F. (2003) · Behavior Therapy · doi:10.1016/s0005-7894(03)80013-8 · Cited by 144 · see citing works
The Handbook of Intellectual Disability and Clinical Psychology Practice
Dagnan, D., Jahoda, A., & Stenfert Kroese, B. (2016) · Routledge eBooks · doi:10.4324/9781315739229 · Cited by 144 · see citing works
Statistical reform: Evidence‐based practice, meta‐analyses, and single subject designs
Jenson, W. R., Clark, E., Kircher, J. C., & Kristjansson, S. D. (2007) · Psychology in the Schools · doi:10.1002/pits.20240 · Cited by 130 · see citing works
Effect Sizes in Single Case Research: How Large is Large?
Parker, R. I., Brossart, D. F., Vannest, K. J., Long, J. R., De-Alba, R. G., Baugh, F. G., & Sullivan, J. R. (2005) · School Psychology Review · doi:10.1080/02796015.2005.12086279 · Cited by 122 · see citing works
Autocorrelation in applied behavior analysis: A myth.
Huitema, B. E. (1985) · Behavioral Assessment · Cited by 111 · see citing works
Atypical Visual Orienting to Gaze- and Arrow-Cues in Adults with High Functioning Autism
Vlamings, P. H. J. M., Stauder, J. E. A., van Son, I. A. M., & Mottron, L. (2005) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-005-3289-y · Cited by 108 · see citing works
Applications of meta analysis in individual-subject research.
White, D. M., Rusch, F. R., Kazdin, A. E., & Hartmann, D. P. (1989) · Behavioral Assessment · Cited by 83 · see citing works
Evans, I. M., & Meyer, L. H. (1984) · Medical Entomology and Zoology · Cited by 66 · see citing works
Self-citationMeyer, L. H., & Evans, I. M. (1993) · Research and Practice for Persons with Severe Disabilities · doi:10.1177/154079699301800402 · Cited by 64 · see citing works
Self-citationThe utility of the PND statistic: A reply to Allison and Gorman
Scruggs, T. E., & Mastropieri, M. A. (1994) · Behaviour Research and Therapy · doi:10.1016/0005-7967(94)90169-4 · Cited by 63 · see citing works
Luiselli, J. K. (1986) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(86)90052-2 · Cited by 36 · see citing works
Analysis of Interrupted Time-Series Experiments Using ITSE: A Critique
Huitema, B. E. (2004) · Understanding Statistics · doi:10.1207/s15328031us0301_2 · Cited by 34 · see citing works
Measuring Interpersonal Problems in People With Mental Retardation
Kellett, S., Beail, N., & Newman, D. W. (2005) · American Journal on Mental Retardation · doi:10.1352/0895-8017(2005)110 · Cited by 26 · see citing works
Mostert, M. P. (2001) · Exceptionality · doi:10.1207/s15327035ex0904_4 · Cited by 20 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Newcomb, E. T., & Hagopian, L. P. (2018) · International Review of Psychiatry · doi:10.1080/09540261.2018.1435513 · Cited by 119 · see citing works
Heyvaert, M., Maes, B., & Onghena, P. (2010) · Journal of Intellectual Disability Research · doi:10.1111/j.1365-2788.2010.01291.x · Cited by 102 · see citing works
Szeftel, R., Mandelbaum, S., Sulman-Smith, H., Naqvi, S., Lawrence, L., Szeftel, Z., Coleman, S., & Gross, L. (2011) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2010.08.011 · Cited by 31 · see citing works
Meerson, R., Buchholz, H., Kammerer, K., Göster, M., Schobel, J., Ratz, C., Pryss, R., Taurines, R., Romanos, M., Gamer, M., et al. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1462682 · Cited by 4 · see citing works
“Behavioural interventions can be effective in reducing CB in individuals with ASD and/or IDD (32, 33).”
Background
- Authors
- Harvey, S. T., Boer, D., Meyer, L. H., & Evans, I. M.
- Affiliations
- Massey University (NZ)
- Victoria University of Wellington (NZ)
- Corresponding author
- Evans, Ian M.
- Venue
- Journal of Intellectual & Developmental Disability
- Publisher
- Informa UK Limited
- Published
- 2009-03
- Volume
- 34
- Issue
- 1
- Pages
- 67-80
- ISSN
- 0045-0634 (ISSN-L)
- 1366-8250
- 1469-9532
- OpenAlex
- W2075870960
- Cited by
- 112
- References
- 50
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 5 · 2023: 3 · 2022: 4 · 2021: 3 · 2020: 8 · 2019: 6 · 2018: 8 · 2017: 3 · 2016: 11 · 2015: 8 · 2014: 10 · 2013: 14 · 2012: 10
- FWCI
- 1.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Intellectual & Developmental Disability (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Autism Spectrum Disorder Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Down syndrome and intellectual disability research
- Keywords
- behavioral problems, children with disabilities, behavioral interventions, treatment validity, standards of practice, functional analysis, antecedent interventions, systemic change, intervention effectiveness
- MeSH terms
- Algorithms, Humans, Intellectual Disability, Practice Patterns, Physicians', Psychomotor Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
