The Aggregation of single-case results using hierarchical linear models
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
To investigate the generalizability of the results of single-case experimental studies, evaluating the effect of one or more treatments, in applied research various simultaneous and sequential replication strategies are used. We discuss one approach for aggregating the results for single-cases: the use of hierarchical linear models. This approach has the potential to allow making improved inferences about the effects for the individual cases, but also to estimate and test the overall effect, and explore the generality of this effect across cases and under different conditions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Though group designs would require massive samples to power so many interaction effects, results from SCED, including the current study, can be aggregated to provide guidelines for personalized selection and evaluation of treatment components (Van den Noortgate & Onghena, 2007).”
From Acceptance and Commitment Therapy modules: Differential impact on treatment processes and outcomes (2016) · cites this paper as Van den Noortgate & Onghena, 2007
In the citing paper
“The diary and questionnaire data will be aggregated across all iterations, thus include data from 40 to 60 participants. This approach allows to investigate the generalisability of results of the SCED and evaluate treatment effects in applied research.71”
From Development, evaluation and implementation of a digital behavioural health treatment for chronic pain: study protocol of the multiphase DAHLIA project (2022) · cites this paper as [71]
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Time Series Analysis: Forecasting and Control
Geurts, M., Box, G. E. P., & Jenkins, G. M. (1977) · Journal of Marketing Research · doi:10.2307/3150485 · Cited by 19,186
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Multilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 13,775
Single-Case Research Designs: Methods for Clinical and Applied Settings
Kazdin, A. E. (1982) · Cited by 3,985
Single Case Experimental Designs: Strategies for Studying Behavior Change
Barlow, D. H., Nock, M. K., & Hersen, M. (1976) · Cited by 3,036
Edgington, E., Edgington, E., & Onghena, P. (2007) · doi:10.1201/9781420011814 · Cited by 2,030
Self-citationEdgington, E. S. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess2169 · Cited by 2,028
Self-citationEncyclopedia of Statistics in Behavioral Science
(2005) · Wiley eBooks · doi:10.1002/0470013192 · Cited by 1,441
Cited by
A multilevel meta-analysis of single-subject experimental design studies
Van den Noortgate, W., & Onghena, P. (2008) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489530802505362 · Cited by 192
“Van den Noortgate and Onghena (2003a; 2003b; 2007) described in detail some of these extensions, and gave codes to perform the analyses using SAS or SPSS .”
MethodSelf-citationThe state of the science in the meta-analysis of single-case experimental designs
Shadish, W. R., Rindskopf, D. M., & Hedges, L. V. (2008) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489530802581603 · Cited by 180
“For example, van den Noortgate and Onghena (2007) discussed a study in which Phase 1 was baseline, Phase 2 was a treatment, and Phase 3 was a different treatment.”
BackgroundSingle-Case Experimental Designs to Evaluate Novel Technology-Based Health Interventions
Dallery, J., Cassidy, R. N., & Raiff, B. R. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2227 · Cited by 169
“Although a complete discussion of these techniques is beyond the scope of this paper, several regression-based approaches are available, such as autoregressive models, robust regression, and hierarchical linear modeling (HLM) [57,58].”
MethodGage, N. A., Lewis, T. J., & Stichter, J. P. (2012) · Behavioral Disorders · doi:10.1177/019874291203700201 · Cited by 166
Wang, S.-Y., Cui, Y., & Parrila, R. (2011) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2010.06.023 · Cited by 158
Shadish, W. R., Kyse, E. N., & Rindskopf, D. (2013) · Psychological Methods · doi:10.1037/a0032964 · Cited by 172
“Van den Noortgate and Onghena (2007) showed how multilevel models can be applied to three-phase (ABC) designs where a baseline phase is followed by a first treatment and then a second treatment.”
BackgroundMethodAcceptance and Commitment Therapy modules: Differential impact on treatment processes and outcomes
Villatte, J. L., Vilardaga, R., Villatte, M., Plumb Vilardaga, J. C., Atkins, D. C., & Hayes, S. C. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.12.001 · Cited by 136
Bottom-up analysis of single-case research designs
Parker, R. I., & Vannest, K. J. (2012) · Journal of Behavioral Education · doi:10.1007/s10864-012-9153-1 · Cited by 117
“The purpose of this article is to distinguish a ‘‘bottom-up’’ approach to analysis of data from SCR designs from the ‘‘top-down’’ approach typified by hierarchical or multi-level modeling (HLM, MLM) (van den Noorgate and Onghena 2007, 2008), randomization (Kratochwill and Levin 2010), and complex multi-series regressi…”
Comparing Visual and Statistical Analysis in Single-Case Studies Using Published Studies
Harrington, M., & Velicer, W. F. (2015) · Multivariate Behavioral Research · doi:10.1080/00273171.2014.973989 · Cited by 114
“Other methods that have been proposed for the same task, including multiple regression (e.g., Huitema, 2011; Maggin et al., 2011), multilevel modeling (e.g., Van den Noortgate & Onghena, 2003a, 2003b, 2007, 2008), and the overlap statistics proposed by Parker and others (e.g., Parker et al., 2011).”
Using generalized additive (mixed) models to analyze single case designs
Shadish, W. R., Zuur, A. F., & Sullivan, K. J. (2013) · Journal of School Psychology · doi:10.1016/j.jsp.2013.11.004 · Cited by 116
“3 Other R programs that can estimate GAMs are gam (Hastie, 2006; Hastie & Tibshirani, 1986) and gamlss (Stasinopoulos & Rigby, 2007; Stasinopoulos, Rigby, & Akantziliotou, 2008). See Zuur (2012) for discussion of their relative strengths and weaknesses.”
BackgroundHeyvaert, M., & Onghena, P. (2014) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2013.10.002 · Cited by 98
“…Edgington & Onghena, 2007, pp. 225- 259; Franklin, Allison, & Gorman, 1996; Kazdin, 2011; Parker, Vannest, & Davis, 2011), as well as software for the design and analysis of SCE research (e.g., Bulté & Onghena, 2008, 2009, 2012; Koehler & Levin, 2000; Van den Noortgate & Onghena, 2003a, 2007).”
MethodSelf-citationFerron, J. M., Farmer, J. L., & Owens, C. M. (2010) · Behavior Research Methods · doi:10.3758/brm.42.4.930 · Cited by 94
“Multilevel models have been suggested as an alternative method for analyzing multiple-baseline data (Nugent, 1996; Shadish & Rindskopf, 2007; Van den Noortgate & Onghena, 2003a, 2003b, 2007).”
BackgroundMethodHeyvaert, M., Maes, B., Noortgate, W. V. D., Kuppens, S., & Onghena, P. (2011) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2011.10.010 · Cited by 105
“In this model, the coefficient that indicates the magnitude of the effect of the intervention on the CB of a participant can be considered as a standardized difference between means, since it is equal to the difference in condition means, divided by the within-condition standard deviation (Van den Noortgate & Onghena,…”
BackgroundMethodResultInfluentialSelf-citationDallery, J., & Raiff, B. R. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-014-0258-z · Cited by 92
Lupas, K. K., & Fabiano, G. A. (2017) · Exceptional Children · doi:10.1177/0014402917706370 · Cited by 91
“…in turn are nested within participants and separate studies) and because HLM analyses can account for complex data structures (missing data, varying intervention lengths) likely to be found in single-case studies (Gage & Lewis, 2014; Raudenbush & Bryk, 2002; Van den Noorgate & Onghena, 2007, 2008).”
BackgroundWang, S.-Y., Parrila, R., & Cui, Y. D. (2012) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-012-1726-2 · Cited by 82
Benner, G. J., Nelson, J. R., Ralston, N. C., & Mooney, P. (2010) · Behavioral Disorders · doi:10.1177/019874291003500202 · Cited by 88
Analysis of Effect for Single-Case Design Research
Gage, N. A., & Lewis, T. J. (2012) · Journal of Applied Sport Psychology · doi:10.1080/10413200.2012.660673 · Cited by 87
“Van den Noortgate and Onghena (2003, 2007, 2008) developed a complex HLM procedure with a number of nuances particular to design type and number of studies, but can be generally represented in the following equation: Level 1: DVti = n0i + π1i ∗ (SESS1ti ) + π2i ∗ (PHASEti ) + π3i ∗ (SXPti ) +…”
MethodBaek, E. K., & Ferron, J. M. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0231-z · Cited by 73
Tau-U: A Quantitative Approach for Analysis of Single-Case Experimental Data in Aphasia
Lee, J. B., & Cherney, L. R. (2018) · American Journal of Speech-Language Pathology · doi:10.1044/2017_ajslp-16-0197 · Cited by 85
Heyvaert, M., Saenen, L., Maes, B., & Onghena, P. (2014) · Journal of Applied Research in Intellectual Disabilities · doi:10.1111/jar.12094 · Cited by 72
Self-citationNonlinear Bayesian analysis for single case designs
Rindskopf, D. (2014) · Journal of School Psychology · doi:10.1016/j.jsp.2013.12.003 · Cited by 58
Making Prisoners Accountable: Are Contingency Management Programs the Answer?
Gendreau, P., Listwan, S. J., Kuhns, J. B., & Exum, M. L. (2014) · Criminal Justice and Behavior · doi:10.1177/0093854814540288 · Cited by 66
“…through mutual discussion and review. effect size (es) calculation and interPretation As of yet, there are no fixed rules for analyzing applied behavior analysis designs that monitor and track the behavior of single subjects (Chen & Ma, 2007; Shadish, 2001; Van den Noortgate & Onghena, 2007).”
BackgroundSullivan, K. J., Shadish, W. R., & Steiner, P. M. (2014) · Psychological Methods · doi:10.1037/met0000020 · Cited by 62
The effect of drama-based group therapy on aspects of mental illness stigma
Orkibi, H., Bar, N., & Eliakim, I. (2014) · The Arts in Psychotherapy · doi:10.1016/j.aip.2014.08.006 · Cited by 49
Baek, E. K., Moeyaert, M., Petit-Bois, M., Beretvas, S. N., Noortgate, W. V. D., & Ferron, J. M. (2013) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2013.835740 · Cited by 57
“Using multilevel models has been recently suggested as an alternative to single-level models for the analysis of SCEDs (e.g., Nugent,1996; Shadish & Rindskopf, 2007; Shadish, Rindskopf, & Hedges, 2008; Van den Noortgate & Onghena, 2003a, 2003b, 2007, 2008).”
MethodDeclercq, L., Jamshidi, L., Fernández‐Castilla, B., Beretvas, S. N., Moeyaert, M., Ferron, J. M., & Noortgate, W. V. D. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1091-y · Cited by 51
Synthesizing single-case studies: A Monte Carlo examination of a three-level meta-analytic model
Owens, C. M., & Ferron, J. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0180-y · Cited by 52
“Van den Noortgate and Onghena (2003a, 2003b, 2007, 2008) proposed the use of multilevel modeling to aggregate single-case data for the purposes of meta-analysis.”
BackgroundDenis, J., Noortgate, W. V. D., & Maes, B. (2011) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2011.01.014 · Cited by 52
One by One: Accumulating Evidence by using Meta-Analytical Procedures for Single-Case Experiments
Onghena, P., Michiels, B., Jamshidi, L., Moeyaert, M., & Noortgate, W. V. D. (2017) · Brain Impairment · doi:10.1017/brimp.2017.25 · Cited by 42
“Van den Noortgate and Onghena (2007) suggested that multilevel meta ‐ analysis of SCEs should include at least about 20 entities at the highest level (patients or studies).”
BackgroundSelf-citationToward Data-Driven Digital Therapeutics Analytics: Literature Review and Research Directions
Lee, U., Jung, G., Ma, E.-Y., Kim, J. S., Kim, H., Alikhanov, J., Noh, Y., & Kim, H. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123015 · Cited by 45
“Similarly, the GEE and MLM can be used to estimate the treatment effect in single-case studies with appropriate modifications [159], [160].”
MethodHierarchical Linear Modeling Meta-Analysis of Single-Subject Design Research
Gage, N. A., & Lewis, T. J. (2012) · The Journal of Special Education · doi:10.1177/0022466912443894 · Cited by 43
Augmenting Visual Analysis in Single-Case Research With Hierarchical Linear Modeling
Davis, D. H., Gagné, P., Fredrick, L. D., Alberto, P. A., Waugh, R. E., & Haardörfer, R. (2012) · Behavior Modification · doi:10.1177/0145445512453734 · Cited by 36
“Some researchers have made effect-size comparisons across AB designs (Van den Noortgate & Onghena, 2003, 2007), and Ferron, Bell, Hess, Rendina-Gobioff, and Hibbard (2009) have used simulated data to demonstrate effect-size comparisons across multiple phases of a multiple baseline design.”
MethodUgille, M., Moeyaert, M., Beretvas, S. N., Ferron, J. M., & Noortgate, W. V. D. (2013) · The Journal of Experimental Education · doi:10.1080/00220973.2013.813366 · Cited by 38
“This aggregation is possible through the use of multilevel models (Van den Noortgate & Onghena, 2003a, 2007).”
MethodSingle Subject Designs: Current Methodologies and Future Directions
Johnston, M. V., & Smith, R. O. (2010) · OTJR Occupational Therapy Journal of Research · doi:10.3928/15394492-20091214-02 · Cited by 37
“Simpler statistical methods include per centage of nonoverlapping data and points exceed ing the median; more rigorous methods (e.g., hierar chical models) have also been developed (van den Noortgate & Onghena, 2003, 2007).”
MethodDebodinance, E., Maljaars, J., Noens, I. L. J., & Noortgate, W. V. D. (2017) · Research in Autism · doi:10.1016/j.rasd.2017.01.010 · Cited by 36
Research Synthesis and Meta-Analysis of Single-Case Designs
Pustejovsky, J., & Ferron, J. (2017) · doi:10.4324/9781315517698.ch12 · Cited by 76
“Further modifications to the level-1 model have been suggested to accommodate non-linear trends (Hembry, Bunuan, Beretvas, Ferron, & Van den Noortgate, 2015) or designs with more than two phases (Rindskopf & Ferron, 2014; Van den Noortgate & Onghena, 2007).”
MethodApproaches for Specifying the Level-1 Error Structure When Synthesizing Single-Case Data
Joo, S., Ferron, J. M., Moeyaert, M., Beretvas, S. N., & Noortgate, W. V. D. (2017) · The Journal of Experimental Education · doi:10.1080/00220973.2017.1409181 · Cited by 28
“One approach for combining SCED data within and across studies that is of particular interest in the current study involves the use of multilevel modeling (Rindskopf & Ferron, 2014; Shadish, Kyse, & Rindskopf, 2013; Van den Noortgate & Onghena, 2003a, 2003b, 2007, 2008).”
MethodDeclercq, L., Jamshidi, L., Fernández‐Castilla, B., Moeyaert, M., Beretvas, S. N., Ferron, J. M., & Noortgate, W. V. D. (2020) · Multivariate Behavioral Research · doi:10.1080/00273171.2020.1822148 · Cited by 33
“To account for this nested structure, Van den Noortgate & Onghena (2003b, 2003a, 2003c, 2007, 2008) proposed a hierarchical linear model with three levels to synthesize the raw SCED data from multiple cases.”
MethodBartels, S. L., Johnsson, S. I., Boersma, K., Flink, I., McCracken, L. M., Petersson, S., Christie, H. L., Feldman, I., Simons, L. E., Onghena, P., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059152 · Cited by 23
Self-citationMcClain, M. B., Callan, G. L., Harris, B., Floyd, R. G., Haverkamp, C. R., Golson, M. E., Longhurst, D. N., & Benallie, K. J. (2021) · Journal of School Psychology · doi:10.1016/j.jsp.2020.11.002 · Cited by 25
Quantitative Synthesis of Research Evidence: Multilevel Meta-Analysis
Moeyaert, M. (2018) · Behavioral Disorders · doi:10.1177/0198742918806926 · Cited by 30
“Multilevel meta-analysis is a promising analysis technique used to quantitatively summarize research findings across similarly focused studies (Van den Noortgate & Onghena, 2007).”
MethodMichiels, B., Tanious, R., De, T. K., & Onghena, P. (2020) · Behavior Research Methods · doi:10.3758/s13428-019-01266-6 · Cited by 23
Self-citationMoeyaert, M., Yang, P., & Xu, X. (2021) · Perspectives on Behavior Science · doi:10.1007/s40614-021-00304-z · Cited by 27
Degroote, L., Paepe, A. L. D., Bourdeaudhuij, I. D., Dyck, D. V., & Crombez, G. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-021-01163-2 · Cited by 24
“aggregated single case data, see Van den Noortgate & Onghena, 2007) [53].”
BackgroundMethodHow to Be RAD: Repeated Acquisition Design Features that Enhance Internal and External Validity
Kirby, M. S., Spencer, T. D., & Ferron, J. M. (2021) · Perspectives on Behavior Science · doi:10.1007/s40614-021-00301-2 · Cited by 24
“In many ways, RAD may be the most efficient and practical design for measuring skill acquisition, mastery monitoring of learning targets, and facilitating data-informed instructional decisions (Van den Noortgate & Onghena, 2007).”
BackgroundAsaro‐Saddler, K., Moeyaert, M., Xu, X., & Yerden, X. (2020) · Exceptionality · doi:10.1080/09362835.2020.1850457 · Cited by 25
“…structure of the SCED data into account (i.e., raw SCED data are nested within cases, and cases are nested within SCED studies), a three-level meta-analysis was conducted (Moeyaert et al., 2013; Van den Noorgate & Onghena, 2007; Van Den Noortgate & Onghena, 2003b; Van de Noorgate & Onghena, 2003a).”
MethodVanderkerken, L., Heyvaert, M., Onghena, P., & Maes, B. (2017) · Applied Research in Quality of Life · doi:10.1007/s11482-017-9558-z · Cited by 24
Self-citationSingle-Case Experimental Design in Rehabilitation: Basic Concepts, Advantages, and Challenges
Yang, L., Armijo-Olivo, S. L., & Gross, D. P. (2023) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000002215 · Cited by 23
“Additional statistical analysis may be needed if the intervention effects are not prominent or obvious on visual observation.(26) This will be discussed in the next session.”
BackgroundMiočević, M., Klaassen, F., Geuke, G. G. M., Moeyaert, M., & Marić, M. (2020) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489539.2020.1732029 · Cited by 18
“Future research should extend the methods described in this paper to include standardization, as described by van den Noortgate and Onghena (2007) for frequentist regressionbased effect sizes.”
MethodThe use of mixed modeling to evaluate the impact of treatment integrity on learning
Bottini, S. B., Morton, H. E., Gillis, J. L., & Romanczyk, R. G. (2020) · Behavioral Interventions · doi:10.1002/bin.1718 · Cited by 15
Vanderkerken, L., Heyvaert, M., Maes, B., & Onghena, P. (2013) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2013.09.030 · Cited by 19
“Consequently, it was possible to apply a multilevel approach and to obtain quite precise parameter estimates, despite of the small amount of observations for some cases (cf. Van den Noortgate & Onghena, 2003a, 2007).”
BackgroundMethodInfluentialSelf-citationSingle-case design meta-analyses in education and psychology: a systematic review of methodology
Moeyaert, M., Dehghan‐Chaleshtori, M., Xu, X., & Yang, P. (2023) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2023.1190362 · Cited by 20
Li, H., Luo, W., Baek, E., Thompson, C. G., & Lam, K. H. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01691-6 · Cited by 15
Spencer, T. D., Kirby, M. S., & Petersen, D. B. (2023) · American Journal of Speech-Language Pathology · doi:10.1044/2023_ajslp-23-00004 · Cited by 15
Fingerhut, J., Xu, X., & Moeyaert, M. (2021) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489539.2021.1933727 · Cited by 12
“Other parametric measures [e.g. BC-SMD (Hedges et al., 2012, 2013); hierarchical linear modeling approach (Moeyaert et al., 2014; Van den Noortgate & Onghena, 2003a, 2003b, 2007) can account for between-case variance in intervention effectiveness (Baek & Ferron, 2013).”
BackgroundMethodInfluentialMeta-Analysis of Single-Case Experimental Design using Multilevel Modeling
Baek, E., Luo, W., & Lam, K. H. (2023) · Behavior Modification · doi:10.1177/01454455221144034 · Cited by 14
“MLM provides in-depth information for treatment effects and allows for the modeling of the complexities of SCED time-series data (Baek et al., 2014; Nugent, 1996; Pustejovsky et al., 2014; Shadish & Rindskopf, 2007; Van Den Noortgate & Onghena, 2007, 2008).”
MethodMoeyaert, M., & Yang, P. (2021) · Behaviormetrika · doi:10.1007/s41237-021-00141-z · Cited by 11
Noortgate, W. V. D., & Onghena, P. (2024) · Psychologica Belgica · doi:10.5334/pb.1307 · Cited by 8
Self-citationSequential meta-analysis of single-case experimental data
Kuppens, S., Heyvaert, M., Noortgate, W. V. D., & Onghena, P. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0080-1 · Cited by 8
“Van den Noortgate and Onghena (2007) have suggested that combining single-case studies using a multilevel framework should be postponed until at least about 20 entities are available at the highest level.”
BackgroundSelf-citationKim, D., & Choi, S. (2021) · PLoS ONE · doi:10.1371/journal.pone.0261120 · Cited by 7
“It can consider the issue of autocorrelation even when the number of measurements is relatively small and when the frequency of measurements is different across study participants [34, 42].”
BackgroundMethodA Gentle Introduction to Bayesian Posterior Predictive Checking for Single-Case Researchers
Grekov, P., & Pustejovsky, J. E. (2026) · Journal of Behavioral Education · doi:10.1007/s10864-025-09613-8 · Cited by 5
Meta-Analysis of Single-Case Data: A Monte Carlo Investigation of a Three Level Model
Owens, C. M. (2011) · Digital Commons - University of South Florida (University of South Florida) · Cited by 12
A quantitative analysis of accuracy, reliability and bias in judgements of functional analyses
Rader, A. E., Young, M. E., & Leaf, J. B. (2021) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.711 · Cited by 5
Tanious, R., & Onghena, P. (2026) · Journal of Behavioral Education · doi:10.1007/s10864-026-09624-z · Cited by 3
“…statistical analysis methods has greatly advanced over the last two decades, with the development of techniques such as hierarchical linear models (Van Den Noortgate & Onghena, 2003 , 2007 ); Bayesian analysis (Rindskopf, 2014 ; Natesan, 2019 ), or mediation analysis (Langenberg et al., 2022 ;…”
Self-citationAssessing consistency of effects when applying multilevel models to single-case data
Manolov, R., & Ferron, J. M. (2020) · Behavior Research Methods · doi:10.3758/s13428-020-01417-0 · Cited by 4
Stone, B. A. (2016) · Digital Commons - University of South Florida (University of South Florida) · Cited by 4
Systematic Review of Single-Case Designs to Identify Mediator Characteristics
Moeyaert, M., Lou, Y., Yang, P., Fingerhut, J., Miočević, M., & Valente, M. J. (2025) · Journal of Behavioral Education · doi:10.1007/s10864-025-09600-z · Cited by 3
“…optimal methods for synthesizing findings across case-specific effect estimates (e.g., Baek et al., 2014; Lee & Gates, 2024; Moeyaert & Yang, 2021; Van den Noortgate & Onghena, 2007; Van den Noortgate & Onghena, 2008) and evaluated the statistical properties of estimates obtained in meta-analysis…”
Kim, J. Y., Ravichandran, V., Moeyaert, M., Ditzler, H. M., Ryan, M., & Fienup, D. M. (2026) · Behavior Modification · doi:10.1177/01454455261421144 · Cited by 2
“In order to combine the raw outcomes (i.e., Y ijk ) across studies, the outcomes were standardized following the procedure outlined by Van den Noortgate and Onghena (2007) and empirically validated by Moeyaert et al. (2013).”
Collier‐Meek, M. A. (2013) · OpenCommons at University of Connecticut (University of Connecticut) · Cited by 2
AAC narrative intervention for children with autism
Almubark, N. M., Spencer, T. D., & Foster, M. E. (2025) · Augmentative and Alternative Communication · doi:10.1080/07434618.2024.2433959 · Cited by 3
“the data analytic plan followed the pre-registry and was designed following best practices in single-case multiple baseline research design (Kratochwill et al., 2013; Rindskopf & Ferron, 2014; Van den Noortgate & Onghena, 2007).”
King, S., Rijkeboer, M. M., Winkens, I., Tuts, N., Ford, M. E., Frankenmolen, N. L., Tanious, R., van der Naalt, J., & Heugten, C. M. V. (2025) · Behaviour Research and Therapy · doi:10.1016/j.brat.2025.104941 · Cited by 1
Bosch, J., Lüke, T., Steiner, T. M., & Wilbert, J. (2026) · Journal of Behavioral Education · doi:10.1007/s10864-026-09615-0 · Cited by 2
“The methodological literature often describes the AB design as the basic design or building block upon which more sophisticated designs — such as ABAB (reversal), multiple baseline, and alternating treatment designs — are constructed (Moeyaert et al., 2015 ; Van Den Noortgate & Onghena, 2007 ).”
Wadda’wah, U. I. I. D., & Abidin, Z. (2023) · Perspectives of science and education · doi:10.32744/pse.2023.3.45 · Cited by 13
“However, the meta-analysis is mostly partial in specific fields by combining the research results of several studies on the same topic [22].”
Becker, S. D. (2014) · KU ScholarWorks (The University of Kansas) · Cited by 1
Hierarchical Linear Modeling versus visual analysis of single subject design data
Nelson, E. G. (2012) · Louisiana State University · doi:10.31390/gradschool_dissertations.1106 · Cited by 1
“These models were much like those shown in Van der Noortgate and Onghena (2007) and Waddell et al. (2011) and were purely explanations of how to model simple single-subject designs with one to two studies as examples.”
BackgroundMethodA Monte Carlo Study: The Consequences of the Misspecification of the Level-1 Error Structure
Petit-Bois, M. (2014) · Digital Commons - University of South Florida (University of South Florida)
Rindskopf, D., Shadish, W. R., & Lake, N. (2012) · Cited by 2
A Systematic Review of Meta-Analyzing Single-Case Data Using Multilevel Modeling
Baek, E. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1434762
Crangle, C., Longino, H. E., Nguyen, M., & Suppes, P. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5353032
Degroote, L., De Paepe, A., De Bourdeaudhuij, I., Van Dyck, D., & Crombez, G. (2021) · Figshare · doi:10.6084/m9.figshare.14927215
Degroote, L., De Paepe, A., De Bourdeaudhuij, I., Van Dyck, D., & Crombez, G. (2021) · Figshare · doi:10.6084/m9.figshare.14927218
Degroote, L., De Paepe, A., De Bourdeaudhuij, I., Van Dyck, D., & Crombez, G. (2021) · Figshare · doi:10.6084/m9.figshare.14927212
Elliott, T. C., Wise, C. N., Torelli, J. N., Ayres, K. M., & Ringdahl, J. E. (2026) · Behavior Analysis in Practice · doi:10.1007/s40617-025-01140-2 · Cited by 1
Metadata
- Authors
- Van den Noortgate, W., & Onghena, P.
- ORCID
- Onghena, Patrick
- Venue
- The Behavior Analyst Today
- Published
- 2007
- Volume
- 8
- Issue
- 2
- Pages
- 196-209
- ISSN
- 1539-4352 (ISSN-L)
- OpenAlex
- W2154736788
- Cited by
- 86
- References
- 26
- Citations by year
- 2026: 5 · 2025: 4 · 2024: 1 · 2023: 6 · 2022: 1 · 2021: 12 · 2020: 5 · 2019: 2 · 2018: 3 · 2017: 6 · 2016: 1 · 2015: 2 · 2014: 9 · 2013: 8 · 2012: 9
- FWCI
- 2.21
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- The Behavior Analyst Today (publishedVersion, other-oa)
- Lirias (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- single-case experimental design, multilevel analysis, replication strategies, generalizability, applied behavior analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.