A multilevel meta-analysis of single-subject experimental design studies
Abstract
A multilevel approach is proposed to synthesize the results of single-subject experimental research by combining either raw data or effect-size measures. A multilevel meta-analysis of single-subject data allows us to make inferences not only about the effects for the participants that are investigated, but also about the generality of the effects. It also permits a systematic exploration of the possible moderating effect of study and participant characteristics. We also discuss the possibility of combining single-subject experimental research and group-comparison research in one single meta-analysis, and the difficulties involved, especially in making effect-size measures comparable for both kinds of studies.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · see citing works
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023 · see citing works
Morris, S. B., & DeShon, R. P. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.105 · Cited by 2,502 · see citing works
Parametric empirical Bayes inference: theory and applications
Morris, C. N. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477920 · Cited by 1,448 · cited 1× · see citing works
“It can be shown that these estimates are typically more accurate than the estimates based on the data from that participant or study only (Morris, 1983).”
BackgroundEmpirical bayes meta-analysis.
Raudenbush, S. W., & Bryk, A. S. (1985) · Journal of Educational Statistics · doi:10.3102/10769986010002075 · Cited by 299 · see citing works
The Aggregation of single-case results using hierarchical linear models
Van den Noortgate, W., & Onghena, P. (2007) · The Behavior Analyst Today · doi:10.1037/h0100613 · Cited by 86 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Three-level meta-analysis of dependent effect sizes
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0261-6 · Cited by 1,130 · see citing works
Self-citationEffect Size in Single-Case Research: A Review of Nine Nonoverlap Techniques
Parker, R. I., Vannest, K. J., & Davis, J. L. (2011) · Behavior Modification · doi:10.1177/0145445511399147 · Cited by 841 · see citing works
Ingersoll, B., & Wainer, A. (2013) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-013-1840-9 · Cited by 263 · see citing works
Bottom-up analysis of single-case research designs
Parker, R. I., & Vannest, K. J. (2012) · Journal of Behavioral Education · doi:10.1007/s10864-012-9153-1 · Cited by 117 · see citing works
Comparing Visual and Statistical Analysis in Single-Case Studies Using Published Studies
Harrington, M., & Velicer, W. F. (2015) · Multivariate Behavioral Research · doi:10.1080/00273171.2014.973989 · Cited by 114 · see citing works
Heyvaert, M., & Onghena, P. (2014) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2013.10.002 · Cited by 98 · see citing works
Self-citationKlingbeil, D. A., Fischer, A. J., Renshaw, T. L., Bloomfield, B. S., Polakoff, B., Willenbrink, J. B., Copek, R. A., & Chan, K. T. (2017) · Psychology in the Schools · doi:10.1002/pits.21982 · Cited by 67 · see citing works
Analysis of single-case data: Randomisation tests for measures of effect size
Heyvaert, M., & Onghena, P. (2014) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2013.818564 · Cited by 64 · see citing works
Self-citationSimons, L. E., Vlaeyen, J. W. S., Declercq, L., Smith, A. M., Beebe, J., Hogan, M., Li, E., Kronman, C. A., Mahmud, F., Corey, J. R., et al. (2020) · Pain · doi:10.1097/j.pain.0000000000001735 · Cited by 56 · see citing works
A Priori Justification for Effect Measures in Single-Case Experimental Designs
Manolov, R., Moeyaert, M., & Fingerhut, J. E. (2022) · Perspectives on Behavior Science · doi:10.1007/s40614-021-00282-2 · Cited by 53 · see citing works
Testing the Intervention Effect in Single-Case Experiments: A Monte Carlo Simulation Study
Heyvaert, M., Moeyaert, M., Verkempynck, P., Van den Noortgate, W., Vervloet, M., Ugille, M., & Onghena, P. (2017) · The Journal of Experimental Education · doi:10.1080/00220973.2015.1123667 · Cited by 42 · see citing works
Self-citationSimons, L. E., Harrison, L. E., O'Brien, S. F., Heirich, M. S., Loecher, N., Boothroyd, D. B., Vlaeyen, J. W. S., Wicksell, R. K., Schofield, D., Hood, K. K., et al. (2019) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2019.100448 · Cited by 24 · see citing works
Michiels, B., Tanious, R., De, T. K., & Onghena, P. (2020) · Behavior Research Methods · doi:10.3758/s13428-019-01266-6 · Cited by 23 · see citing works
Self-citation
- Authors
- Van den Noortgate, W., & Onghena, P.
- Affiliations
- Katholieke Universiteit Leuven
- KU Leuven (BE)
- ORCID
- Onghena, Patrick
- Venue
- Evidence-Based Communication Assessment and Intervention
- Publisher
- Informa UK Limited
- Published
- 2008-09
- Volume
- 2
- Issue
- 3
- Pages
- 142-151
- ISSN
- 1748-9539 (ISSN-L)
- 1748-9547
- OpenAlex
- W1998187724
- Cited by
- 192
- References
- 6
- Citations by year
- 2026: 7 · 2025: 8 · 2024: 6 · 2023: 9 · 2022: 15 · 2021: 10 · 2020: 7 · 2019: 20 · 2018: 13 · 2017: 17 · 2016: 10 · 2015: 7 · 2014: 21 · 2013: 14 · 2012: 13
- FWCI
- 1.61
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Evidence-Based Communication Assessment and Intervention (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- multilevel meta-analysis, single-case experimental design, effect size measures, moderating effect, study characteristics, participant characteristics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
