The Aggregation of single-case results using hierarchical linear models
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
To investigate the generalizability of the results of single-case experimental studies, evaluating the effect of one or more treatments, in applied research various simultaneous and sequential replication strategies are used. We discuss one approach for aggregating the results for single-cases: the use of hierarchical linear models. This approach has the potential to allow making improved inferences about the effects for the individual cases, but also to estimate and test the overall effect, and explore the generality of this effect across cases and under different conditions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Though group designs would require massive samples to power so many interaction effects, results from SCED, including the current study, can be aggregated to provide guidelines for personalized selection and evaluation of treatment components (Van den Noortgate & Onghena, 2007).”
From Acceptance and Commitment Therapy modules: Differential impact on treatment processes and outcomes (2016) · cites this paper as Van den Noortgate & Onghena, 2007
In the citing paper
“The diary and questionnaire data will be aggregated across all iterations, thus include data from 40 to 60 participants. This approach allows to investigate the generalisability of results of the SCED and evaluate treatment effects in applied research.71”
From Development, evaluation and implementation of a digital behavioural health treatment for chronic pain: study protocol of the multiphase DAHLIA project (2022) · cites this paper as [71]
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Time Series Analysis: Forecasting and Control
Geurts, M., Box, G. E. P., & Jenkins, G. M. (1977) · Journal of Marketing Research · doi:10.2307/3150485 · Cited by 19,186
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Multilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 13,775
Single-Case Research Designs: Methods for Clinical and Applied Settings
Kazdin, A. E. (1982) · Cited by 3,985
Single Case Experimental Designs: Strategies for Studying Behavior Change
Barlow, D. H., Nock, M. K., & Hersen, M. (1976) · Cited by 3,036
Edgington, E., Edgington, E., & Onghena, P. (2007) · doi:10.1201/9781420011814 · Cited by 2,030
Self-citationEdgington, E. S. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess2169 · Cited by 2,028
Self-citationEncyclopedia of Statistics in Behavioral Science
(2005) · Wiley eBooks · doi:10.1002/0470013192 · Cited by 1,441
Single-case research design and analysis : new directions for psychology and education
Kratochwill, T. R., & Levin, J. R. (1992) · Routledge eBooks · Cited by 576
Single-case and Small-n Experimental Designs: A Practical Guide To Randomization Tests
Todman, J. B., & Dugard, P. (2001) · Psychology Press eBooks · doi:10.4324/9781410600943 · Cited by 244
Design and Analysis of Single-Case Research
(2014) · Psychology Press eBooks · doi:10.4324/9781315806402 · Cited by 243
Matyas, T. A., & Greenwood, K. M. (1990) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1990.23-341 · Cited by 222
Combining single-case experimental data using hierarchical linear models.
Van den Noortgate, W., & Onghena, P. (2003) · School Psychology Quarterly · doi:10.1521/scpq.18.3.325.22577 · Cited by 194
Self-citationHierarchical linear models for the quantitative integration of effect sizes in single-case research
Van Den Noortgate, W., & Onghena, P. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195492 · Cited by 189
Self-citationCaramazza, A. (1990) · Cited by 173
Statistical Power of Randomization Tests Used with Multiple-Baseline Designs
Ferron, J. M., & Sentovich, C. (2002) · The Journal of Experimental Education · doi:10.1080/00220970209599504 · Cited by 133
Randomized single-subject experimental designs
Edgington, E. S. (1996) · Behaviour Research and Therapy · doi:10.1016/0005-7967(96)00012-5 · Cited by 89 · cited 1×
“The effect of such confounding variables may further be controlled by means of randomization while setting up the study, for instance by randomly assigning measurement occasions over treatments or randomizing the time of intervention (Edgington, 1996).”
MethodMeta-analysis for Single-Subject Research: When Does It Clarify, When Does It Obscure?
Salzberg, C. L., Strain, P. S., & Baer, D. M. (1987) · Remedial and Special Education · doi:10.1177/074193258700800209 · Cited by 85
The robustness of the two—samplet—test over the Pearson system
Posten, H. O. (1978) · Journal of Statistical Computation and Simulation · doi:10.1080/00949657808810197 · Cited by 73
The Power of Randomization Tests for Single-Case Phase Designs
Ferron, J. M., & Onghena, P. (1996) · The Journal of Experimental Education · doi:10.1080/00220973.1996.9943805 · Cited by 68
Self-citationFerron, J. M., & Scott, H. (2005) · Wiley eBooks · doi:10.1002/0470013192.bsa419 · Cited by 53
Conceptual Issues in Research Synthesis
Pillemer, D. B. (1984) · The Journal of Special Education · doi:10.1177/002246698401800105 · Cited by 28
Randomized trials in single subjects: the N of 1 study.
Cook, D. J. (1996) · PubMed · Cited by 23
Teaching the function of writing to middle school students with academic delays.
Lawson, T. R., & Greer, R. D. (2006) · Journal of Early and Intensive Behavior Intervention · doi:10.1037/h0100328 · Cited by 22
Onghena, P. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat06190 · Cited by 5
Self-citation
Cited by
A multilevel meta-analysis of single-subject experimental design studies
Van den Noortgate, W., & Onghena, P. (2008) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489530802505362 · Cited by 192
“Van den Noortgate and Onghena (2003a; 2003b; 2007) described in detail some of these extensions, and gave codes to perform the analyses using SAS or SPSS .”
MethodSelf-citationThe state of the science in the meta-analysis of single-case experimental designs
Shadish, W. R., Rindskopf, D. M., & Hedges, L. V. (2008) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489530802581603 · Cited by 180
“For example, van den Noortgate and Onghena (2007) discussed a study in which Phase 1 was baseline, Phase 2 was a treatment, and Phase 3 was a different treatment.”
BackgroundSingle-Case Experimental Designs to Evaluate Novel Technology-Based Health Interventions
Dallery, J., Cassidy, R. N., & Raiff, B. R. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2227 · Cited by 169
“Although a complete discussion of these techniques is beyond the scope of this paper, several regression-based approaches are available, such as autoregressive models, robust regression, and hierarchical linear modeling (HLM) [57,58].”
MethodGage, N. A., Lewis, T. J., & Stichter, J. P. (2012) · Behavioral Disorders · doi:10.1177/019874291203700201 · Cited by 166
Wang, S.-Y., Cui, Y., & Parrila, R. (2011) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2010.06.023 · Cited by 158
Metadata
- Authors
- Van den Noortgate, W., & Onghena, P.
- ORCID
- Onghena, Patrick
- Venue
- The Behavior Analyst Today
- Published
- 2007
- Volume
- 8
- Issue
- 2
- Pages
- 196-209
- ISSN
- 1539-4352 (ISSN-L)
- OpenAlex
- W2154736788
- Cited by
- 86
- References
- 26
- Citations by year
- 2026: 5 · 2025: 4 · 2024: 1 · 2023: 6 · 2022: 1 · 2021: 12 · 2020: 5 · 2019: 2 · 2018: 3 · 2017: 6 · 2016: 1 · 2015: 2 · 2014: 9 · 2013: 8 · 2012: 9
- FWCI
- 2.21
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- The Behavior Analyst Today (publishedVersion, other-oa)
- Lirias (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- single-case experimental design, multilevel analysis, replication strategies, generalizability, applied behavior analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.