The Three-Level Synthesis of Standardized Single-Subject Experimental Data: A Monte Carlo Simulation Study
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Previous research indicates that three-level modeling is a valid statistical method to make inferences from unstandardized data from a set of single-subject experimental studies, especially when a homogeneous set of at least 30 studies are included (Moeyaert, Ugille, Ferron, Beretvas, & Van den Noortgate, 2013a Moeyaert, M., Ugille, M., Ferron, J., Beretvas, N. and Van den Noortgate, W. 2013a. Three-level analysis of single-case experimental data: Empirical validation.. Journal of Experimental Education, Advance online publication, doi: 10.1080/00220973.2012.745470[Web of Science ®] , [Google Scholar]). When single-subject data from multiple studies are combined, however, it often occurs that the dependent variable is measured on a different scale, requiring standardization of the data before combining them over studies. One approach is to divide the dependent variable by the residual standard deviation. In this study we use Monte Carlo methods to evaluate this approach. We examine how well the fixed effects (e.g., immediate treatment effect and treatment effect on the time trend) and the variance components (the between- and within-subject variance) are estimated under a number of realistic conditions. The three-level synthesis of standardized single-subject data is found appropriate for the estimation of the treatment effects, especially when many studies (30 or more) and many measurement occasions within subjects (20 or more) are included and when the studies are rather homogeneous (with small between-study variance). The estimates of the variance components are less accurate.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introducing Multilevel Modeling
Kreft, I., & de Leeuw, J. (1998) · doi:10.4135/9781849209366 · Cited by 2,997
Edgington, E., Edgington, E., & Onghena, P. (2007) · doi:10.1201/9781420011814 · Cited by 2,030
Robustness Studies in Covariance Structure Modeling: An Overview and a Meta-Analysis
HOOGLAND, J. J., & BOOMSMA, A. (1998) · Sociological Methods & Research · doi:10.1177/0049124198026003003 · Cited by 734
A multilevel meta-analysis of single-subject experimental design studies
Van den Noortgate, W., & Onghena, P. (2008) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489530802505362 · Cited by 192
Cited by
A Guide to Conducting a Meta-Analysis with Non-Independent Effect Sizes
Cheung, M. W.-L. (2019) · Neuropsychology Review · doi:10.1007/s11065-019-09415-6 · Cited by 610
“When researchers metaanalyze these effect sizes, they have to take the dependence of the effect sizes into account (Moeyaert, Ugille, Ferron, Beretvas, & Van den Noortgate, 2013).”
BackgroundTesting the Intervention Effect in Single-Case Experiments: A Monte Carlo Simulation Study
Heyvaert, M., Moeyaert, M., Verkempynck, P., Van den Noortgate, W., Vervloet, M., Ugille, M., & Onghena, P. (2017) · The Journal of Experimental Education · doi:10.1080/00220973.2015.1123667 · Cited by 42
“…trends (linear and nonlinear; Shadish et al., 2013; Van den Noortgate & Onghena, 2003b), autocorrelation (Van den Noorgate & Onghena, 2003a), unequal within-phase variances (Baek & Ferron, 2013), external events (Moeyaert et al., 2013b), or nonnormal outcomes such as counts (Shadish et al., 2013).”
BackgroundMethodSelf-citationMichiels, B., Tanious, R., De, T. K., & Onghena, P. (2020) · Behavior Research Methods · doi:10.3758/s13428-019-01266-6 · Cited by 23
Fingerhut, J., Xu, X., & Moeyaert, M. (2021) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489539.2021.1933727 · Cited by 12
“The effect of measurement occasions and number of cases on MSE has been demonstrated in previous studies (e.g. Moeyaert et al., 2013b), and so it not displayed visually.”
MethodResultInfluentialSelf-citation
Metadata
- Authors
- Moeyaert, M., Ugille, M., Ferron, J. M., Beretvas, S. N., & Van den Noortgate, W.
- Venue
- Multivariate Behavioral Research
- Publisher
- Informa UK Limited
- Published
- 2013-09
- Volume
- 48
- Issue
- 5
- Pages
- 719-748
- ISSN
- 0027-3171 (ISSN-L)
- 1532-7906
- OpenAlex
- W1992244729
- Cited by
- 80
- References
- 4
- FWCI
- 3.44
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Three-Level Synthesis of Standardized Single-Subject Experimental Data: A Monte Carlo Simulation Study. https://app.cochat.ai/papers/10.1080/00273171.2013.816621
- The paper
- Moeyaert, M., Ugille, M., Ferron, J. M., Beretvas, S. N., & Van den Noortgate, W. (2013). The Three-Level Synthesis of Standardized Single-Subject Experimental Data: A Monte Carlo Simulation Study. Multivariate Behavioral Research. https://doi.org/10.1080/00273171.2013.816621
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.