Design-Comparable Effect Sizes in Multiple Baseline Designs: A General Modeling Framework
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
In single-case research, the multiple baseline design is a widely used approach for evaluating the effects of interventions on individuals. Multiple baseline designs involve repeated measurement of outcomes over time and the controlled introduction of a treatment at different times for different individuals. This article outlines a general framework for defining effect sizes in multiple baseline designs that are directly comparable to the standardized mean difference from a between-subjects randomized experiment. The target, design-comparable effect size parameter can be estimated using restricted maximum likelihood together with a small sample correction analogous to Hedges’s g. The approach is demonstrated using hierarchical linear models that include baseline time trends and treatment-by-time interactions. A simulation compares the performance of the proposed estimator to that of an alternative, and an application illustrates the model-fitting process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Singer, J. D., & Willett, J. B. (2003) · doi:10.1093/acprof:oso/9780195152968.001.0001 · Cited by 10,647
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · cited 1×
“The bias of d̂AB is analogous to the small-sample bias of the Cohen’s d statistic from a between-subjects experiment, which can be corrected using methods described by Hedges (1981); the corrected effect size estimate is sometimes referred to as Hedges’s g.”
MethodSelf-citationStatistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · cited 1×
“These are often called potential outcomes (Holland, 1986).”
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Small sample inference for fixed effects from restricted maximum likelihood
Kenward, M. G., & Roger, J. H. (1997) · Biometrics · doi:10.2307/2533558 · Cited by 4,552 · cited 1×
“Parametric bootstrapping (Efron & Tibshirani, 1998, section 6.5) and small-sample corrections for the covariance matrix of fixed effect estimates (Kenward & Roger, 1997, 2009) warrant further investigation as well, as they may provide better means of estimating the effect size variance and…”
BackgroundInfluentialGelman, A. (2006) · Bayesian Analysis · doi:10.1214/06-ba117a · Cited by 4,050 · cited 1×
“…model fitting may offer some advantage and should be investigated further, including in particular fully Bayesian methods with weakly informative priors (Baldwin & Fellingham, 2013; Gelman, 2006) or related varieties of penalized likelihood methods (Chung, Rabe-Hesketh, Dorie, Gelman, & Liu, 2013).”
BackgroundThe Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005) · Exceptional Children · doi:10.1177/001440290507100203 · Cited by 3,368 · cited 2×
“SCDs are used frequently in fields such as applied behavior analysis (Bailey & Burch, 2002), special education research (Horner et al., 2005), school psychology (Busse, Kratochwill, & Elliott, 1995), and psychotherapy (Borckardt et al., 2008).”
MethodRobust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086
Self-citationSingle-Case Intervention Research Design Standards
Kratochwill, T. R., Hitchcock, J. H., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2013) · Remedial and Special Education · doi:10.1177/0741932512452794 · Cited by 1,331
Self-citation
Cited by
Shadish, W. R., Zelinsky, N. A. M., Vevea, J. L., & Kratochwill, T. R. (2016) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.308 · Cited by 130
Ruiz, F. J., Flórez, C. L., García-Martín, M. B., Monroy-Cifuentes, A., Barreto-Montero, K., García-Beltrán, D. M., Riaño-Hernández, D., Sierra, M. A., Suárez-Falcón, J. C., Cardona-Betancourt, V., et al. (2018) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2018.04.004 · Cited by 65
A Priori Justification for Effect Measures in Single-Case Experimental Designs
Manolov, R., Moeyaert, M., & Fingerhut, J. E. (2022) · Perspectives on Behavior Science · doi:10.1007/s40614-021-00282-2 · Cited by 53
“• Data transformations or trend corrections are easily represented on the time series plot? intervention effectiveness for reversal and multiple-baseline designs (Hedges et al., 2012, 2013; Pustejovsky et al., 2014), but cannot be applied to alternating treatments designs.”
BackgroundMethodInfluentialRuiz, F. J., Luciano, C., Flórez, C. L., Suárez-Falcón, J. C., & Cardona-Betancourt, V. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00356 · Cited by 59
Ruiz, F. J., Peña-Vargas, A., Ramírez, E. S., Suárez-Falcón, J. C., García-Martín, M. B., García-Beltrán, D. M., Henao, Á. M., Monroy-Cifuentes, A., & Sánchez, P. D. (2020) · Psychotherapy · doi:10.1037/pst0000273 · Cited by 48
“The SCEDs cannot control for the participants’ hope and expectancies for change and, although WLC conditions control for these variables, they cannot control for the potentially beneficial effect of unspecific factors such as attention and support (Knock, Janis, & Wedig, 2008).”
MethodInfluential
Metadata
- Authors
- Pustejovsky, J. E., Hedges, L. V., & Shadish, W. R.
- Venue
- Journal of Educational and Behavioral Statistics
- Published
- 2014-10
- Volume
- 39
- Issue
- 5
- Pages
- 368-393
- ISSN
- 1076-9986 (ISSN-L)
- 1935-1054
- OpenAlex
- W2332122555
- Cited by
- 213
- References
- 12
- FWCI
- 6.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Design-Comparable Effect Sizes in Multiple Baseline Designs: A General Modeling Framework. https://app.cochat.ai/papers/10.3102/1076998614547577
- The paper
- Pustejovsky, J. E., Hedges, L. V., & Shadish, W. R. (2014). Design-Comparable Effect Sizes in Multiple Baseline Designs: A General Modeling Framework. Journal of Educational and Behavioral Statistics. https://doi.org/10.3102/1076998614547577
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.