Modeling dependent effect sizes with three-level meta-analyses: A structural equation modeling approach
The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Abstract
Meta-analysis is an indispensable tool used to synthesize research findings in the social, educational, medical, management, and behavioral sciences. Most meta-analytic models assume independence among effect sizes. However, effect sizes can be dependent for various reasons. For example, studies might report multiple effect sizes on the same construct, and effect sizes reported by participants from the same cultural group are likely to be more similar than those reported by other cultural groups. This article reviews the problems and common methods to handle dependent effect sizes. The objective of this article is to demonstrate how 3-level meta-analyses can be used to model dependent effect sizes. The advantages of the structural equation modeling approach over the multilevel approach with regard to conducting a 3-level meta-analysis are discussed. This article also seeks to extend the key concepts of Q statistics, I2, and R2 from 2-level meta-analyses to 3-level meta-analyses. The proposed procedures are implemented using the open source metaSEM package for the R statistical environment. Two real data sets are used to illustrate these procedures. New research directions related to 3-level meta-analyses are discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Therefore, this study employed the three-level meta-analysis model proposed by Cheung (2014), which decomposes variance into three levels: Level 1, sampling variance; Level 2, within-study variance across multiple effect sizes from the same study; and Level 3, between-study variance across independent studies.”
From Mindfulness- and acceptance-based interventions for music performance anxiety: a three-level meta-analysis of therapeutic effects, mechanisms, and boundary conditions (2026) · cites this paper as Cheung, 2014
In the citing paper
“A major advantage of this three-level approach to meta-analysis is that all relevant effects reported in each primary study can be included, implying that all relevant information is preserved.”
From Risk Factors for School Absenteeism and Dropout: A Meta-Analytic Review (2019) · cites this paper as Cheung 2014
In the citing paper
“As we included five studies that provided two effect sizes, this violates the normal requirement of independent effect size measures in meta-analysis (Cheung, 2014).”
From Therapeutic games to reduce anxiety and depression in young people: A systematic review and exploratory meta‐analysis of their use and effectiveness. (2024) · cites this paper as Cheung, 2014
In the citing paper
“To account for the dependency of estimates at multiple times within studies, we fit three-level meta-analytic models with time periods (short-term or long-term) as a moderator.26”
From Adherence to PCSK9 Inhibitors in Clinical Practice (2026) · cites this paper as [26]
In the citing paper
“We thus adopted a three-level meta-analytic model in which effect sizes are nested within experiments, so we explicitly took the dependencies in our data into account in the model63,64.”
From When combinations of humans and AI are useful: A systematic review and meta-analysis (2024) · cites this paper as [64]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870 · cited 1×
“Second, conducting MI for multilevel data is challenging (cf. van Buuren & Groothuis-Oudshoorn, 2011).”
MethodMultilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 13,775
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278
(2010) · Cited by 7,034
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793 · cited 1×
“On the other hand, random-effects models allow for unconditional inferences to be generalized beyond the studies included under the assumption that the studies were randomly selected (see Borenstein et al., 2010; Hedges & Vevea, 1998).”
MethodMethods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Cited by
Items 101–200 of 1,003
Internalization of body shape ideals and body dissatisfaction: A systematic review and meta‐analysis
Paterna, A., Alcaraz‐Ibáñez, M., Fuller‐Tyszkiewicz, M., & Sicilia, Á. (2021) · International Journal of Eating Disorders · doi:10.1002/eat.23568 · Cited by 193
Panadero, E., Jonsson, A., Pinedo, L., & Fernández-Castilla, B. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09823-4 · Cited by 141
Multimedia Design for Learning: An Overview of Reviews With Meta-Meta-Analysis
Noetel, M., Griffith, S., Delaney, O., Harris, N. R., Sanders, T., Parker, P., del Pozo Cruz, B., & Lonsdale, C. (2022) · Review of Educational Research · doi:10.3102/00346543211052329 · Cited by 148
“The subject domain (science, mathematics, humanities, etc.) For moderation analyses, we calculated the percentage of variance in outcomes explained by the moderator using R 2 (Cheung 2014a).”
InfluentialTrait-dependent tolerance of bats to urbanization: a global meta-analysis
Jung, K., & Threlfall, C. G. (2018) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2018.1222 · Cited by 168
The association between social anxiety and mobile phone addiction: A three-level meta-analysis
Ran, G., Li, J., Zhang, Q., & Niu, X. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107198 · Cited by 164
Jukic, I., Castilla, A. P., Ramos, A. G., Van Hooren, B., McGuigan, M. R., & Helms, E. R. (2023) · Sports Medicine · doi:10.1007/s40279-022-01754-4 · Cited by 138
Garavan, T. N., McCarthy, A. M., Lai, Y., Murphy, K. R., Sheehan, M., & Carbery, R. (2020) · Human Resource Management Journal · doi:10.1111/1748-8583.12284 · Cited by 275
Platt, L., Melendez-Torres, G. J., O'Donnell, A., Bradley, J., Newbury-Birch, D., Kaner, E., & Ashton, C. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011473 · Cited by 136
“For our main analysis, we used a multilevel meta-analysis method to estimate the pooled effect sizes.(33) Models included random effects on the effect size and study levels because of anticipated heterogeneity both within and across studies.”
MethodAlcohol use disorder and circulating cytokines: A systematic review and meta-analysis
Adams, C., Conigrave, J. H., Lewohl, J., Haber, P., & Morley, K. C. (2020) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2020.08.002 · Cited by 136
Effects of digital games on student motivation in mathematics: A meta‐analysis in K‐12
Fadda, D., Pellegrini, M., Vivanet, G., & Zandonella Callegher, C. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12618 · Cited by 135
Fang (2022) · doi:10.1016/s2352-4642(22)00033-5 · Cited by 136
Narcissism and Social Networking Behavior: A Meta‐Analysis
Gnambs, T., & Appel, M. (2018) · Journal of Personality · doi:10.1111/jopy.12305 · Cited by 133
A quantitative meta-analysis of face recognition deficits in autism: 40 years of research.
Griffin, J. W., Bauer, R. M., & Scherf, K. S. (2020) · Psychological Bulletin · doi:10.1037/bul0000310 · Cited by 156
Oduro, S., Nisco, A. D., & Mainolfi, G. (2023) · Technovation · doi:10.1016/j.technovation.2023.102836 · Cited by 193
The association between parent-reported and observed parenting: A multi-level meta-analysis.
Hendriks, A. M., der Giessen, D. V., Stams, G. J. J. M., & Overbeek, G. J. (2017) · Psychological Assessment · doi:10.1037/pas0000500 · Cited by 150
Kapsal, N. J., Dicke, T., Morin, A. J. S., Vasconcellos, D., Maïano, C., Lee, J. J., & Lonsdale, C. (2019) · Journal of Physical Activity and Health · doi:10.1123/jpah.2018-0675 · Cited by 170
Verhaeghen, P. (2020) · Mindfulness · doi:10.1007/s12671-020-01532-1 · Cited by 166
Biological motion perception in autism spectrum disorder: a meta-analysis
Todorova, G. K., Hatton, R. E. M., & Pollick, F. E. (2019) · Molecular Autism · doi:10.1186/s13229-019-0299-8 · Cited by 147
Reid, A. E., Dovidio, J. F., Ballester, E., & Johnson, B. T. (2014) · Social Science & Medicine · doi:10.1016/j.socscimed.2013.06.028 · Cited by 128
Schizophrenia and creativity: A meta-analytic review
Acar, S., Chen, X., & Cayırdağ, N. (2017) · Schizophrenia Research · doi:10.1016/j.schres.2017.08.036 · Cited by 153
Blom, R., Kruyen, P. M., HEIJDEN, B. I. J. M. V. D., & van Thiel, S. (2018) · Review of Public Personnel Administration · doi:10.1177/0734371x18773492 · Cited by 171
Fernández-Castilla, B., Declercq, L., Jamshidi, L., Beretvas, S. N., Onghena, P., & Van den Noortgate, W. (2020) · Methodology · doi:10.5964/meth.4013 · Cited by 127
Microbial Responses to Biochar Soil Amendment and Influential Factors: A Three-Level Meta-Analysis
Kerner, P., Struhs, E., Mirkouei, A., Aho, K. A., Lohse, K. A., Dungan, R. S., & You, Y. (2023) · Environmental Science & Technology · doi:10.1021/acs.est.3c04201 · Cited by 148
Personality and intelligence: A meta-analysis.
Anglim, J., Dunlop, P. D., Wee, S., Horwood, S., Wood, J. K., & Marty, A. (2022) · Psychological Bulletin · doi:10.1037/bul0000373 · Cited by 125
“In particular, there is extensive discussion in the metaanalytic literature of the implications of analyzing dependent effect sizes (Cheung, 2014, 2019; Hedges et al., 2010; Scammacca et al., 2014).”
BackgroundMallawaarachchi, S., Burley, J., Mavilidi, M., Howard, S. J., Straker, L., Kervin, L., Staton, S., Hayes, N., Machell, A., Torjinski, M., et al. (2024) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2024.2620 · Cited by 142
Effectiveness of digital educational game and game design in STEM learning: a meta-analytic review
Gui, Y., Cai, Z., Yang, Y., Kong, L., Fan, X., & Tai, R. H. (2023) · International Journal of STEM Education · doi:10.1186/s40594-023-00424-9 · Cited by 287
Leijten, P. H. O., Meléndez‐Torres, G. J., Knerr, W., & Gardner, F. E. M. (2016) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2016.05.003 · Cited by 151
Owen, K., Nau, T., Reece, L. J., Bellew, W., Rose, C. L., Bauman, A. E., Halim, N. K., & Smith, B. J. (2022) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-022-01263-7 · Cited by 177
Who believes in conspiracy theories? A meta-analysis on personality correlates
Stasielowicz, L. (2022) · Journal of Research in Personality · doi:10.1016/j.jrp.2022.104229 · Cited by 156
Financial Profitability of Diversified Farming Systems: A Global Meta-Analysis
Sánchez, A. C., Kamau, H., Grazioli, F., & Jones, S. K. (2022) · Ecological Economics · doi:10.1016/j.ecolecon.2022.107595 · Cited by 183
Yan, Z., Lao, H., Panadero, E., Fernández‐Castilla, B., Yang, L., & Yang, M. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100484 · Cited by 207
Said-Metwaly, S., Fernández-Castilla, B., Kyndt, E., & Van den Noortgate, W. (2020) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/aca0000244 · Cited by 121
Chiang, J. J., Lam, P. H., Chen, E., & Miller, G. E. (2022) · Psychological Bulletin · doi:10.1037/bul0000351 · Cited by 151
Cai, Z., Mao, P., Wang, D., He, J., Chen, X., & Fan, X. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09655-0 · Cited by 179
Spearman's law of diminishing returns. A meta-analysis
Blum, D., & Holling, H. (2017) · Intelligence · doi:10.1016/j.intell.2017.07.004 · Cited by 123
Price, M. A., Weisz, J. R., McKetta, S., Hollinsaid, N. L., Lattanner, M. R., Reid, A. E., & Hatzenbuehler, M. L. (2022) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2021.07.808 · Cited by 115
Risky decision making in attention-deficit/hyperactivity disorder: a meta-regression analysis
Dekkers, T. J., Popma, A., Agelink van Rentergem, J. A., Bexkens, A., & Huizenga, H. M. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.03.001 · Cited by 119
Intranasal oxytocin in the treatment of autism spectrum disorders: A multilevel meta-analysis
Huang, Y., Huang, X., Ebstein, R. P., & Yu, R. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.12.028 · Cited by 119
Longitudinal tests of the theory of planned behaviour: A meta-analysis
Hagger, M. S., & Hamilton, K. (2023) · European Review of Social Psychology · doi:10.1080/10463283.2023.2225897 · Cited by 194
Hedger, N., Gray, K. L. H., Garner, M., & Adams, W. J. (2016) · Psychological Bulletin · doi:10.1037/bul0000054 · Cited by 115
“First, we created multilevel models (see Cheung, 2014) wherein conditions (level 2) were nested within their samples (level 3).”
MethodDecades of research on foreign subsidiary divestment: What do we really know about its antecedents?
Schmid, D., & Morschett, D. (2019) · International Business Review · doi:10.1016/j.ibusrev.2019.101653 · Cited by 129
Prevention of eating disorders at universities: A systematic review and meta‐analysis
Harrer, M., Adam, S. H., Messner, E., Baumeister, H., Cuijpers, P., Bruffaerts, R., Auerbach, R. P., Kessler, R. C., Jacobi, C., Taylor, C. B., et al. (2020) · International Journal of Eating Disorders · doi:10.1002/eat.23224 · Cited by 114
McCoy, A., Meléndez‐Torres, G. J., & Gardner, F. E. M. (2020) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2020.104444 · Cited by 142
Mao, P., Cai, Z., He, J., Chen, X., & Fan, X. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.784068 · Cited by 162
van der Put, C. E., Assink, M., & van Solinge, N. F. B. (2017) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2017.09.016 · Cited by 151
Executive functions in trauma-exposed youth: a meta-analysis
Op den Kelder, R., Van den Akker, A. L., Geurts, H. M., Lindauer, R. J. L., & Overbeek, G. (2018) · European Journal of Psychotraumatology · doi:10.1080/20008198.2018.1450595 · Cited by 110
Yu, B. C. L., Chio, F. H. N., Mak, W. W. S., Corrigan, P. W., & Chan, K. K. Y. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102029 · Cited by 110
Is Your Accent Right for the Job? A Meta-Analysis on Accent Bias in Hiring Decisions
Spence, J. L., Hornsey, M. J., Stephenson, E. M., & Imuta, K. (2022) · Personality and Social Psychology Bulletin · doi:10.1177/01461672221130595 · Cited by 143
Back, J., Johnson, U., Svedberg, P., McCall, A., & Ivarsson, A. (2022) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2022.102205 · Cited by 185
Nerattini, M., Jett, S., Andy, C., Carlton, C., Zarate, C., Boneu, C., Battista, M., Pahlajani, S. S., Loeb‐Zeitlin, S., Havryulik, Y., et al. (2023) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2023.1260427 · Cited by 137
Shared Book Reading Interventions With English Learners: A Meta-Analysis
Fitton, L., McIlraith, A. L., & Wood, C. L. (2018) · Review of Educational Research · doi:10.3102/0034654318790909 · Cited by 140
van der Pol, T. M., Hoeve, M., Noom, M. J., Stams, G. J. J. M., Doreleijers, T. A. H., van Domburgh, L., & Vermeiren, R. R. J. M. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12685 · Cited by 108
Non-specific versus targeted approaches to youth mentoring: A follow-up meta-analysis
Christensen, K. M., Hagler, M. A., Stams, G.-J., Raposa, E. B., Burton, S., & Rhodes, J. E. (2020) · Journal of Youth and Adolescence · doi:10.1007/s10964-020-01233-x · Cited by 107
Newbury, C. R., Crowley, R., Rastle, K., & Tamminen, J. (2021) · Psychological Bulletin · doi:10.1037/bul0000348 · Cited by 136
Kaiser, J., Hanschmidt, F., & Kersting, A. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106512 · Cited by 106
Sebri, V., Durosini, I., Triberti, S., & Pravettoni, G. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.611954 · Cited by 104
“, 2020); 4) To deal with dependency of effect sizes (Van den Noortgate et al., 2013; Cheung, 2014), three levels of the model were included in the analysis:”
BackgroundMethodInfluentialGnambs, T., & Kaspar, K. (2016) · Assessment · doi:10.1177/1073191115624547 · Cited by 140
Williams, Z. J., Suzman, E., & Woynaroski, T. G. (2021) · Ear and Hearing · doi:10.1097/aud.0000000000001005 · Cited by 129
Xiao, S. X., Hashi, E. C., Korous, K. M., & Eisenberg, N. (2019) · Journal of Adolescence · doi:10.1016/j.adolescence.2019.09.003 · Cited by 136
Associations Between Rejection Sensitivity, Aggression, and Victimization: A Meta-Analytic Review
Gao, S., Assink, M., Liu, T., Chan, K. L., & Ip, P. (2019) · Trauma Violence & Abuse · doi:10.1177/1524838019833005 · Cited by 120
Goal adjustment capacities and quality of life: A meta‐analytic review
Barlow, M. A., Wrosch, C., & McGrath, J. J. (2019) · Journal of Personality · doi:10.1111/jopy.12492 · Cited by 121
Weeland, J., Moens, M. A., Beute, F., Assink, M., Staaks, J. P. C., & Overbeek, G. J. (2019) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2019.101326 · Cited by 128
Janovsky, T., Rock, A. J., Thorsteinsson, E., Clark, G. I., & Murray, C. (2020) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2439 · Cited by 136
Traut, H. J., Guild, R. M., & Munakata, Y. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.662139 · Cited by 100
Geiger, S. J., Brick, C., Nalborczyk, L., Bosshard, A., & Jostmann, N. B. (2021) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2021.101694 · Cited by 131
Paek, S. H., Abdulla, A. M., & Cramond, B. (2016) · Gifted Child Quarterly · doi:10.1177/0016986216630600 · Cited by 97
Cheng, C., Cheung, M. W. ‐., & Lo, B. C. Y. (2016) · Health Psychology Review · doi:10.1080/17437199.2016.1219672 · Cited by 109
Self-citationTeachers' Implicit Attitudes Toward Students From Different Social Groups: A Meta-Analysis
Cate, I. P.-T., & Glock, S. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02832 · Cited by 133
Teacher–student relationships and student outcomes: A systematic second-order meta-analytic review.
Emslander, V., Holzberger, D., Ofstad, S. B., Fischbach, A., & Scherer, R. (2025) · Psychological Bulletin · doi:10.1037/bul0000461 · Cited by 171
Measuring creative imagery abilities
Jankowska, D. M., & Karwowski, M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01591 · Cited by 114
A Meta-Analysis of the Effects of Cross-Cutting Exposure on Political Participation
Matthes, J., Knoll, J., Valenzuela, S., Hopmann, D. N., & von Sikorski, C. (2019) · Political Communication · doi:10.1080/10584609.2019.1619638 · Cited by 137
Transdiagnostic treatment of depression and anxiety: a meta-analysis
Cuijpers, P., Miguel, C., Ciharova, M., Ebert, D., Harrer, M., & Karyotaki, E. (2023) · Psychological Medicine · doi:10.1017/s0033291722003841 · Cited by 96
“For the three-level models, we calculated a multilevel extension of I 2 , which describes the amount of total variability attributable to heterogeneity within studies (level 2) and heterogeneity between studies (level 3) (Cheung, 2014; Harrer et al., 2021).”
MethodGubbels, J., van der Put, C. E., & Assink, M. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16132404 · Cited by 121
The behavioral phenotype of early life adversity: A 3-level meta-analysis of rodent studies
Bonapersona, V., Kentrop, J., Van Lissa, C. J., van der Veen, R., Joëls, M., & Sarabdjitsingh, R. A. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.04.021 · Cited by 91
The Impact of Social Factors on Job Crafting: A Meta-Analysis and Review
Wang, H., Li, P., & Chen, S. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17218016 · Cited by 133
Effects of habit and intention on behavior: Meta-analysis and test of key moderators.
Hagger, M. S., Hamilton, K., Phipps, D. J., Protogerou, C., Zhang, C., Girelli, L., Mallia, L., & Lucidi, F. (2023) · Motivation Science · doi:10.1037/mot0000294 · Cited by 106
A meta-analysis of the association between mental disorders and juvenile recidivism
Wibbelink, C. J. M., Hoeve, M., Stams, G. J. J. M., & Oort, F. J. (2017) · Aggression and Violent Behavior · doi:10.1016/j.avb.2017.01.005 · Cited by 101
Big Five Personality Traits and Second Language Learning: a Meta-analysis of 40 Years’ Research
Chen, X., He, J., Swanson, E., Cai, Z., & Fan, X. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09641-6 · Cited by 120
The effect of self-assessment on academic performance and the role of explicitness: a meta-analysis
Yan, Z., Xiang, W., Boud, D. J., & Lao, H. (2021) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2021.2012644 · Cited by 183
Handling effect size dependency in meta-analysis
Gucciardi, D. F., Lines, R. L. J., & Ntoumanis, N. (2021) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1946835 · Cited by 99
Interventions to Mitigate COVID-19 Misinformation: A Systematic Review and Meta-Analysis
Janmohamed, K., Walter, N., Nyhan, K., Khoshnood, K., Tucker, J. D., Sangngam, N., Altice, F. L., Ding, Q., Wong, A., Schwitzky, Z. M., et al. (2021) · Journal of Health Communication · doi:10.1080/10810730.2021.2021460 · Cited by 104
ten Bokkel, I. M., Roorda, D. L., Maes, M., Verschueren, K., & Colpin, H. (2022) · School Psychology Review · doi:10.1080/2372966x.2022.2029218 · Cited by 133
Risk factors for (violent) radicalization in juveniles: A multilevel meta-analysis
Emmelkamp, J., Asscher, J. J., Wissink, I. B., & Stams, G. J. J. M. (2020) · Aggression and Violent Behavior · doi:10.1016/j.avb.2020.101489 · Cited by 116
Gerver, C. R., Griffin, J. W., Dennis, N. A., & Beaty, R. E. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02303-4 · Cited by 119
Oosterhoff, M., Joore, M., & Ferreira, I. (2016) · Obesity Reviews · doi:10.1111/obr.12446 · Cited by 87
Eisenberg, M. J., van Horn, J. E., Dekker, J. M., Assink, M., van der Put, C. E., Hendriks, J., & Stams, G. J. J. M. (2019) · Criminal Justice and Behavior · doi:10.1177/0093854819826109 · Cited by 109
Yanagisawa, A., Webb, S., & Uchihara, T. (2020) · Studies in Second Language Acquisition · doi:10.1017/s0272263119000688 · Cited by 118
Block, J., Hansen, C., & Steinmetz, H. (2022) · Entrepreneurship Theory and Practice · doi:10.1177/10422587221084249 · Cited by 96
Gao, R., Zhuo, L., Duan, Y., Yan, C., Yue, Z., Zhao, Z., & Wu, P. (2024) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2024.110075 · Cited by 110
Predicting domestic violence: A meta-analysis on the predictive validity of risk assessment tools
van der Put, C. E., Gubbels, J., & Assink, M. (2019) · Aggression and Violent Behavior · doi:10.1016/j.avb.2019.03.008 · Cited by 83
“Because most studies reported on more than one e ff ect size, a traditional random e ff ects (two-level) model was extended to a three-level random e ff ects model (Cheung, 2014; Houben, Van den & Sánchez-Meca, 2015).”
MethodProblematic smartphone use and academic achievement: A systematic review and meta-analysis
Paterna, A., Alcaraz-Ibáñez, M., Aguilar-Parra, J. M., Salavera, C., Demetrovics, Z., & Griffiths, M. D. (2024) · Journal of Behavioral Addictions · doi:10.1556/2006.2024.00014 · Cited by 83
“First, when there were multiple dependent effects obtained from different PSU measures in one study (e.g., Olufadi, 2015), random removal of effect sizes was conducted until just one effect size remained (Cheung, 2014).”
Schoenherr, J., Strohmaier, A., & Schukajlow, S. (2024) · Educational Research Review · doi:10.1016/j.edurev.2024.100639 · Cited by 198
Shame, guilt, and posttraumatic stress symptoms: A three-level meta-analysis
Shi, C., Ren, Z., Zhao, C., Zhang, T., & Chan, S. H.-W. (2021) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2021.102443 · Cited by 80
Dryburgh, N. S. J., Ponath, E., Bukowski, W. M., & Dirks, M. A. (2021) · Child Development · doi:10.1111/cdev.13728 · Cited by 96
Cavicchioli, M., Tobia, V., & Ogliari, A. L. (2022) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-022-00980-8 · Cited by 117
Screen media exposure and young children's vocabulary learning and development: A meta-analysis
Jing, M., Ye, T., Kirkorian, H. L., & Mares, M. (2023) · Child Development · doi:10.1111/cdev.13927 · Cited by 130
Bettariga, F., Taaffe, D. R., Galvão, D. A., Lopez, P., Bishop, C., Markarian, A. M., Natalucci, V., Kim, J.-S., & Newton, R. U. (2024) · Journal of Sport and Health Science · doi:10.1016/j.jshs.2024.04.005 · Cited by 83
Systematic review and meta-analysis of the effects of menopause hormone therapy on cognition
Andy, C., Nerattini, M., Jett, S., Carlton, C., Zarate, C., Boneu, C., Fauci, F., Ajila, T., Battista, M., Pahlajani, S. S., et al. (2024) · Frontiers in Endocrinology · doi:10.3389/fendo.2024.1350318 · Cited by 97
Effect size calculation in meta-analyses of psychotherapy outcome research
Hoyt, W. T., & Del Re, A. C. (2018) · Psychotherapy Research · doi:10.1080/10503307.2017.1405171 · Cited by 80
Parental Influence on Child and Adolescent Physical Activity Level: A Meta-Analysis
Su, D. L. Y., Tang, T. C. W., Chung, J. S. K., Lee, A., Capio, C. M., & Chan, D. K. C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192416861 · Cited by 126
Metadata
- Authors
- Cheung, M. W.-L.
- Affiliations
- National University of Singapore (SG)
- Corresponding author
- Cheung, Mike W.-L.
- ORCID
- Cheung, Mike W.-L.
- Venue
- Psychological Methods
- Published
- 2014
- Volume
- 19
- Issue
- 2
- Pages
- 211-229
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2122962297
- Semantic Scholar
- 80381b0d516d07e42e308f983624bffd497b1d9b
- Cited by
- 1,342
- References
- 73
- Citations by year
- 2026: 294 · 2025: 203 · 2024: 174 · 2023: 157 · 2022: 143 · 2021: 91 · 2020: 80 · 2019: 69 · 2018: 41 · 2017: 29 · 2016: 27 · 2015: 22 · 2014: 8
- FWCI
- 22.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Ministry of Education (R581-000-111-112)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- dependent effect sizes, structural equation modeling, multilevel meta-analysis, q-statistics, I2 statistic, cultural similarity, heterogeneity measures
- MeSH terms
- Humans, Models, Psychological, Research Design, Meta-Analysis as Topic, Models, Statistical, Multivariate Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.