The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Fitting three-level meta-analytic models in R: A step-by-step tutorial
Open accessAbstract
Applying a multilevel approach to meta-analysis is a strong method for dealing with dependency of effect sizes.However, this method is relatively unknown among researchers and, to date, has not been widely used in meta-analytic research.Therefore, the purpose of this tutorial was to show how a three-level random effects model can be applied to meta-analytic models in R using the rma.mv function of the metafor package.This application is illustrated by taking the reader through a step-by-step guide to the multilevel analyses comprising the steps of (1) organizing a data file; (2) setting up the R environment; (3) calculating an overall effect; (4) examining heterogeneity of within-study variance and between-study variance; (5) performing categorical and continuous moderator analyses; and (6) examining a multiple moderator model.By example, the authors demonstrate how the multilevel approach can be applied to meta-analytically examining the association between mental health disorders of juveniles and juvenile offender recidivism.In our opinion, the rma.mv function of the metafor package provides an easy and flexible way of applying a multi-level structure to meta-analytic models in R. Further, the multilevel meta-analytic models can be easily extended so that the potential moderating influence of variables can be examined.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As a result, there no information is lost and (moderator) effects can be estimated more precisely and with maximum power in the statistical analyses (Assink and Wibbelink 2016).”
From Risk Factors for School Absenteeism and Dropout: A Meta-Analytic Review (2019) · cites this paper as Assink and Wibbelink 2016
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As recommended by Assink and Wibbelink (2016), moderation analyses should be conducted if less than 75% of the variance can be attributed to Level 1.”
From Therapeutic games to reduce anxiety and depression in young people: A systematic review and exploratory meta‐analysis of their use and effectiveness. (2024) · cites this paper as Assink and Wibbelink (2016)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“There is no need to know the correlations between outcomes extracted from one study for estimating the covariance matrix of the effect sizes since the second level in the model accounts for sampling covariation ( Assink and Wibbelink, 2016 ).”
From The effect of contextual interference on transfer in motor learning - a systematic review and meta-analysis (2024) · cites this paper as Assink and Wibbelink, 2016
The cited source says what the claim attributes to it.
In the citing paper
“To deal with this intra-study dependency of prevalence estimates, we opted for the three-level model with random effects for data points obtained within one article to calculate pooled prevalence estimates (29, 30).”
From The global prevalence of autism spectrum disorder: A three-level meta-analysis (2023) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“we used a multilevel approach to metaanalysis (Assink & Wibbelink, 2016), which is a strong method for dealing with dependency of effect sizes, as it accounts for the hierarchical structure of the data in which effect sizes are nested within studies (Van Den Noortgate & Onghena, 2003).”
From Associations between rejection sensitivity and mental health outcomes: A meta-analytic review (2017) · cites this paper as Assink & Wibbelink, 2016
The cited source says what the claim attributes to it.
In the citing paper
“The Knapp and Hartung method (2003) has the advantage that it reduces Type I‐errors (Assink & Wibbelink, 2016).”
From Does Natural Mentoring Matter? A Multilevel Meta‐analysis on the Association Between Natural Mentoring and Youth Outcomes (2018) · cites this paper as Assink & Wibbelink, 2016
The cited source says what the claim attributes to it.
In the citing paper
“A three‐level random effects model was used to account for three levels of variance, including the sampling variance of each effect size (level 1), the variance between effect sizes extracted from the same study (level 2), and the variance between the studies (level 3).”
From Does Natural Mentoring Matter? A Multilevel Meta‐analysis on the Association Between Natural Mentoring and Youth Outcomes (2018) · cites this paper as Assink & Wibbelink, 2016
The cited source says what the claim attributes to it.
In the citing paper
“Likelihood‐ratio tests were used to compare the deviance scores of the full model to the deviance of models excluding level 2 or level 3 variance parameters, making it possible to determine whether significant variance is present at the two levels (Assink & Wibbelink, 2016).”
From Does Natural Mentoring Matter? A Multilevel Meta‐analysis on the Association Between Natural Mentoring and Youth Outcomes (2018) · cites this paper as Assink & Wibbelink, 2016
The cited source says what the claim attributes to it.
In the citing paper
“This analysis considers three levels of variance components distributed across the model, including variance between effect sizes from the same study and variance between studies; this therefore allows for an examination of how effect sizes vary between participants (Level 1), outcomes (Level 2) and studies (Level 3; Assink & Wibbelink, 2016).”
From Therapeutic games to reduce anxiety and depression in young people: A systematic review and exploratory meta‐analysis of their use and effectiveness. (2024) · cites this paper as Assink & Wibbelink, 2016
The cited source says what the claim attributes to it.
In the citing paper
“The analyses suggested that there was significant variability ( p = .001) between effect sizes (Level 2) and between studies (Level 3), indicating that moderator analyses should be conducted (Assink & Wibbelink, 2016).”
From Therapeutic games to reduce anxiety and depression in young people: A systematic review and exploratory meta‐analysis of their use and effectiveness. (2024) · cites this paper as Assink & Wibbelink, 2016
The cited source says what the claim attributes to it.
In the citing paper
“Dependency of effect sizes normally means that effect sizes within studies are correlated (as these are expected to show a certain similarity); this creates an overlap of information and inflates information produced by the analysis, which can result in an overconfidence in its results (Assink & Wibbelink, 2016).”
From Therapeutic games to reduce anxiety and depression in young people: A systematic review and exploratory meta‐analysis of their use and effectiveness. (2024) · cites this paper as Assink & Wibbelink, 2016
In the citing paper
“A hierarchical multi-level multivariate meta-analytical approach for data plotting was used to account for statistical dependence in effect sizes from multiple within-study comparison arms (cannabis use frequencies) to a common control group (non-use)”
From Risk-thresholds for the association between frequency of cannabis use and the development of psychosis: a systematic review and meta-analysis (2023) · cites this paper as Assink & Wibbelink, 2016
In the citing paper
“As studies reported more than one effect size (for example, depression and suicidal ideation), we opted for a multilevel meta-analysis with three levels (for example, ref. 47), a random-effect model, which enables modelling the dependent effect sizes from the same study.”
From Prevalence and severity of mental health problems in early-career researchers: a systematic review and meta-analysis (2026) · cites this paper as [47]
In the citing paper
“For parameter estimation, restricted maximum likelihood estimation was applied, and for standard errors, P values and 95% CIs, Knapp and Hartung’s adjustment47,227 was used.”
From Prevalence and severity of mental health problems in early-career researchers: a systematic review and meta-analysis (2026) · cites this paper as [47]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
(2007) · Cited by 10,092
(2000) · Cited by 9,198
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Flagged first, then by citations
Research works printed but not linked: 1
- Egger, M. and Davey-Smith, G. and Altman, D., 2001, Systematic Reviews in Healthcare
Cited by
Sorted by citations
How to perform a meta-analysis with R: a practical tutorial
Balduzzi, S., Rücker, G., & Schwarzer, G. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300117 · Cited by 5,827
Risk Factors for School Absenteeism and Dropout: A Meta-Analytic Review
Gubbels, J., van der Put, C. E., & Assink, M. (2019) · Journal of Youth and Adolescence · doi:10.1007/s10964-019-01072-5 · Cited by 596
“The R syntaxes were written so that the three sources of variance were modeled (Assink and Wibbelink 2016).”
BackgroundMethodSelf-citationLi, H., Zhang, R., Lee, Y.-C., Kraut, R. E., & Mohr, D. C. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00979-5 · Cited by 598
Effects of music interventions on stress-related outcomes: a systematic review and two meta-analyses
de Witte, M., Spruit, A., van Hooren, S., Moonen, X., & Stams, G.-J. (2020) · Health Psychology Review · doi:10.1080/17437199.2019.1627897 · Cited by 539
Journal of Youth and Adolescence
(2013) · Journal of Youth and Adolescence · doi:10.1007/10964.1573-6601 · Cited by 502
Rocci, K. S., Lavallee, J. M., Stewart, C. E., & Cotrufo, M. F. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.148569 · Cited by 494
Effects of music in exercise and sport: A meta-analytic review.
Terry, P. C., Karageorghis, C. I., Curran, M., Martin, O., & Parsons-Smith, R. L. (2019) · Psychological Bulletin · doi:10.1037/bul0000216 · Cited by 527
Digital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390
Visual attentional orienting by eye gaze: A meta-analytic review of the gaze-cueing effect.
McKay, K. T., Grainger, S. A., Coundouris, S. P., Skorich, D. P., Phillips, L. H., & Henry, J. D. (2021) · Psychological Bulletin · doi:10.1037/bul0000353 · Cited by 453
Music therapy for stress reduction: a systematic review and meta-analysis
de Witte, M., Pinho, A. D. S., Stams, G.-J., Moonen, X., Bos, A. E. R., & van Hooren, S. (2022) · Health Psychology Review · doi:10.1080/17437199.2020.1846580 · Cited by 444
Colich, N. L., Rosen, M. L., Williams, E. S., & McLaughlin, K. A. (2020) · Psychological Bulletin · doi:10.1037/bul0000270 · Cited by 433
Zeegers, M. A. J., Colonnesi, C., Stams, G. J. J. M., & Meins, E. (2017) · Psychological Bulletin · doi:10.1037/bul0000114 · Cited by 478
Gender differences in loneliness across the lifespan: a meta-analysis
Maes, M., Qualter, P., Vanhalst, J., Van den Noortgate, W., & Goossens, L. (2019) · European Journal of Personality · doi:10.1002/per.2220 · Cited by 405
The Effects of Youth Mentoring Programs: A Meta-analysis of Outcome Studies
Raposa, E. B., Rhodes, J., Stams, G. J. J. M., Card, N., Burton, S., Schwartz, S., Sykes, L. A. Y., Kanchewa, S., Kupersmidt, J., & Hussain, S. (2019) · Journal of Youth and Adolescence · doi:10.1007/s10964-019-00982-8 · Cited by 366
Risk factors for child neglect: A meta-analytic review
Mulder, T. M., Kuiper, K. C., van der Put, C. E., Stams, G. J. J. M., & Assink, M. (2018) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2018.01.006 · Cited by 437
Self-citationThe association between weight stigma and mental health: A meta‐analysis
Emmer, C., Bošnjak, M., & Mata, J. (2019) · Obesity Reviews · doi:10.1111/obr.12935 · Cited by 416
Peverill, M., Dirks, M. A., Narvaja, T., Herts, K. L., Comer, J. S., & McLaughlin, K. A. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101933 · Cited by 348
Associations between rejection sensitivity and mental health outcomes: A meta-analytic review
Gao, S., Assink, M., Cipriani, A., & Lin, K. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.08.007 · Cited by 330
Self-citationRisk factors for child sexual abuse victimization: A meta-analytic review.
Assink, M., van der Put, C. E., Meeuwsen, M. W. C. M., de Jong, N. M., Oort, F. J., Stams, G. J. J. M., & Hoeve, M. (2019) · Psychological bulletin · doi:10.1037/bul0000188 · Cited by 322
Self-citationBaldwin, J. R., Wang, B., Karwatowska, L., Schoeler, T., Tsaligopoulou, A., Munafò, M. R., & Pingault, J.-B. (2023) · American Journal of Psychiatry · doi:10.1176/appi.ajp.20220174 · Cited by 313
The global prevalence of autism spectrum disorder: A three-level meta-analysis
Talantseva, O. I., Romanova, R. S., Shurdova, E. M., Dolgorukova, T. A., Sologub, P. S., Titova, O. S., Kleeva, D. F., & Grigorenko, E. L. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1071181 · Cited by 318
van de Wetering, J., Leijten, P. H. O., Spitzer, J. E., & Thomaes, S. C. E. (2022) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2022.101782 · Cited by 504
Schoeler, T., Duncan, L., Cecil, C. A. M., Ploubidis, G. B., & Pingault, J. (2018) · Psychological Bulletin · doi:10.1037/bul0000171 · Cited by 344
Complex agricultural landscapes host more biodiversity than simple ones: A global meta-analysis
Estrada-Carmona, N., Sánchez, A. C., Remans, R., & Jones, S. K. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2203385119 · Cited by 338
Detecting Selection Bias in Meta-Analyses with Multiple Outcomes: A Simulation Study
Fernández‐Castilla, B., Declercq, L., Jamshidi, L., Beretvas, S. N., Onghena, P., & Noortgate, W. V. D. (2019) · The Journal of Experimental Education · doi:10.1080/00220973.2019.1582470 · Cited by 312
Tomaso, C. C., Johnson, A. B., & Nelson, T. D. (2021) · SLEEP · doi:10.1093/sleep/zsaa289 · Cited by 282
Spruit, A., Goos, L., Weenink, N., Rodenburg, R., Niemeyer, H., Stams, G. J., & Colonnesi, C. (2020) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-019-00299-9 · Cited by 280
“Log-likelihood-ratio tests were performed to compare the deviance of the full model to the deviance of the models excluding one of the variance parameters, making it possible to determine whether significant variance is present at the second and third levels (Assink and Wibbelink 2016).”
MethodInfluentialSteffens, N. K., Munt, K. A., van Knippenberg, D., Platow, M. J., & Haslam, S. A. (2020) · Organizational Psychology Review · doi:10.1177/2041386620962569 · Cited by 316
McClelland, S. C., Paustian, K. H., & Schipanski, M. E. (2020) · Ecological Applications · doi:10.1002/eap.2278 · Cited by 271
Steffens, N. K., LaRue, C. J., Haslam, C., Walter, Z. C., Cruwys, T., Munt, K. A., Haslam, S. A., Jetten, J., & Tarrant, M. (2021) · Health Psychology Review · doi:10.1080/17437199.2019.1669481 · Cited by 259
Moitra, M., Santomauro, D., Degenhardt, L., Collins, P. Y., Whiteford, H., Vos, T., & Ferrari, A. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.02.053 · Cited by 252
van Eldik, W. M., de Haan, A. D., Parry, L. Q., Davies, P. T., Luijk, M. P. C. M., Arends, L. R., & Prinzie, P. (2020) · Psychological Bulletin · doi:10.1037/bul0000233 · Cited by 301
Identifying Effective Components of Child Maltreatment Interventions: A Meta-analysis
van der Put, C. E., Assink, M., Gubbels, J., & van Solinge, N. F. B. (2017) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-017-0250-5 · Cited by 277
Self-citationFoster care placement instability: A meta-analytic review
Konijn, C., Admiraal, S., Baart, J., van Rooij, F., Stams, G.-J., Colonnesi, C., Lindauer, R., & Assink, M. (2019) · Children and Youth Services Review · doi:10.1016/j.childyouth.2018.12.002 · Cited by 253
Self-citationLi, C., Wang, P., Martín-Moratinos, M., Bella-Fernández, M., & Blasco-Fontecilla, H. (2022) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-022-02128-x · Cited by 310
The intergenerational transmission of child maltreatment: A three-level meta-analysis
Assink, M., Spruit, A., Schuts, M., Lindauer, R., van der Put, C. E., & Stams, G.-J. J. M. (2018) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2018.07.037 · Cited by 275
Self-citationLi, J., Dou, K., & Liang, Y. (2020) · Journal of Happiness Studies · doi:10.1007/s10902-020-00230-y · Cited by 267
Virtual Reality Applications in Chronic Pain Management: Systematic Review and Meta-analysis
Goudman, L., Jansen, J., Billot, M., Vets, N., Smedt, A. D., Manuel Roulaud, B., Rigoard, P., & Moens, M. (2022) · JMIR Serious Games · doi:10.2196/34402 · Cited by 255
van Dijk, R., van der Valk, I. E., Deković, M., & Branje, S. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101861 · Cited by 290
Boele, S., Van der Graaff, J., de Wied, M., Van der Valk, I. E., Crocetti, E., & Branje, S. (2019) · Journal of Youth and Adolescence · doi:10.1007/s10964-019-00993-5 · Cited by 216
van Aar, J., Leijten, P. H. O., de Castro, B. O., & Overbeek, G. J. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.11.006 · Cited by 236
Maes, M., Nelemans, S. A., Danneel, S., Fernández-Castilla, B., Van den Noortgate, W., Goossens, L., & Vanhalst, J. (2019) · Developmental Psychology · doi:10.1037/dev0000719 · Cited by 207
When Problem Solving Followed by Instruction Works: Evidence for Productive Failure
Sinha, T., & Kapur, M. (2021) · Review of Educational Research · doi:10.3102/00346543211019105 · Cited by 212
“A multilevel meta-analysis model was used to pool the effect sizes (Assink & Wibbelink, 2016).”
He is a Stud, She is a Slut! A Meta-Analysis on the Continued Existence of Sexual Double Standards
Endendijk, J. J., van Baar, A. L., & Deković, M. (2020) · Personality and Social Psychology Review · doi:10.1177/1088868319891310 · Cited by 200
de Lange, J., Baams, L., van Bergen, D. D., Bos, H., & Bosker, R. (2022) · LGBT Health · doi:10.1089/lgbt.2021.0106 · Cited by 220
Scionti, N., Cavallero, M., Zogmaister, C., & Marzocchi, G. M. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02812 · Cited by 193
Cai, Z., Mao, P., Wang, Z., Wang, D., He, J., & Fan, X. (2023) · Adolescent Research Review · doi:10.1007/s40894-022-00201-9 · Cited by 192
The Acute Effect of High-Intensity Exercise on Executive Function: A Meta-Analysis
Moreau, D., & Chou, E. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619850568 · Cited by 209
Reverter, M., Tapissier‐Bontemps, N., Sarter, S., Sasal, P., & Caruso, D. (2020) · Reviews in Aquaculture · doi:10.1111/raq.12485 · Cited by 186
Lehmann, A., Leifheit, E. F., Gerdawischke, M., & Rillig, M. C. (2021) · Microplastics and Nanoplastics · doi:10.1186/s43591-021-00007-x · Cited by 220
Fernández‐Castilla, B., Jamshidi, L., Declercq, L., Beretvas, S. N., Onghena, P., & Noortgate, W. V. D. (2020) · Behavior Research Methods · doi:10.3758/s13428-020-01373-9 · Cited by 195
Batastini, A. B., Paprzycki, P., Jones, A. C. T., & MacLean, N. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101944 · Cited by 181
The effects of educational robotics in STEM education: a multilevel meta-analysis
Ouyang, F., & Xu, W. (2024) · International Journal of STEM Education · doi:10.1186/s40594-024-00469-4 · Cited by 300
Parenting and Self-Control Across Early to Late Adolescence: A Three-Level Meta-Analysis
Li, J., Willems, Y. E., Stok, F. M., Deković, M., Bartels, M., & Finkenauer, C. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619863046 · Cited by 199
Johnson, D., Policelli, J., Li, M., Dharamsi, A., Hu, Q., Sheridan, M. A., McLaughlin, K. A., & Wade, M. (2021) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2021.2511 · Cited by 209
Van Dam, L., Smit, D., Wildschut, B., Branje, S. J. T., Rhodes, J. E., Assink, M., & Stams, G. J. J. M. (2018) · American Journal of Community Psychology · doi:10.1002/ajcp.12248 · Cited by 174
“In this way, multiple effect sizes can be extracted from each included primary study, so that all information in the studies can be preserved and maximum statistical power is achieved (Assink & Wibbelink, 2016).”
BackgroundMethodInfluentialSelf-citationRestoring particulate and mineral-associated organic carbon through regenerative agriculture
Prairie, A. M., King, A. E., & Cotrufo, M. F. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2217481120 · Cited by 193
McCartney, D., Arkell, T. R., Irwin, C., & McGregor, I. S. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.01.003 · Cited by 170
The heritability of self-control: A meta-analysis
Willems, Y. E., Boesen, N., Li, J., Finkenauer, C., & Bartels, M. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.02.012 · Cited by 190
Task characteristics influence facial emotion recognition age-effects: A meta-analytic review.
Hayes, G. S., McLennan, S. N., Henry, J. D., Phillips, L. H., Terrett, G., Rendell, P. G., Pelly, R. M., & Labuschagne, I. (2020) · Psychology and Aging · doi:10.1037/pag0000441 · Cited by 165
Recreational angler satisfaction: What drives it?
Birdsong, M. H., Hunt, L. M., & Arlinghaus, R. (2021) · Fish and Fisheries · doi:10.1111/faf.12545 · Cited by 173
Dekkers, T. J., van Rentergem, J. A. A., Meijer, B., Popma, A., Wagemaker, E., & Huizenga, H. M. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.12.004 · Cited by 152
Automated feedback and writing: a multi-level meta-analysis of effects on students' performance
Fleckenstein, J., Liebenow, L. W., & Meyer, J. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1162454 · Cited by 145
“We combined the effect sizes of the included studies by applying a three-level model with random effects to take into account that several studies of our meta-analysis reported more than one effect size (Geeraert et al., 2004; Konstantopoulos, 2011; Cheung, 2014; Van den Noortgate et al., 2015; Assink and Wibbelink, 2…”
MethodTrait-dependent tolerance of bats to urbanization: a global meta-analysis
Jung, K., & Threlfall, C. G. (2018) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2018.1222 · Cited by 141
Effects of Acute Sleep Loss on Physical Performance: A Systematic and Meta-Analytical Review
Craven, J., McCartney, D., Desbrow, B., Sabapathy, S., Bellinger, P., Roberts, L. A., & Irwin, C. G. (2022) · Sports Medicine · doi:10.1007/s40279-022-01706-y · Cited by 162
The association between social anxiety and mobile phone addiction: A three-level meta-analysis
Ran, G., Li, J., Zhang, Q., & Niu, X. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107198 · Cited by 156
de Heus, R. A. A., Tzourio, C., Lee, E. J. L., Opozda, M., Vincent, A. D., Anstey, K. J., Hofman, A., Kario, K., Lattanzi, S., Launer, L. J., et al. (2021) · Hypertension · doi:10.1161/hypertensionaha.121.17797 · Cited by 138
Garavan, T. N., McCarthy, A. M., Lai, Y., Murphy, K. R., Sheehan, M., & Carbery, R. (2020) · Human Resource Management Journal · doi:10.1111/1748-8583.12284 · Cited by 212
Jukic, I., Castilla, A. P., Ramos, A. G., Van Hooren, B., McGuigan, M. R., & Helms, E. R. (2023) · Sports Medicine · doi:10.1007/s40279-022-01754-4 · Cited by 138
A quantitative meta-analysis of face recognition deficits in autism: 40 years of research.
Griffin, J. W., Bauer, R. M., & Scherf, K. S. (2020) · Psychological Bulletin · doi:10.1037/bul0000310 · Cited by 134
Coyne, S. M., Ward, L. M., Kroff, S. L., Davis, E. J., Holmgren, H. G., Jensen, A. C., Erickson, S. E., & Essig, L. W. (2019) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2018.11.016 · Cited by 165
When Is Silence Golden? A Meta-analysis on Antecedents and Outcomes of Employee Silence
Hao, L., Zhu, H., He, Y., Duan, J., Zhao, T., & Meng, H. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-021-09788-7 · Cited by 132
van Loon, A. W. G., Creemers, H. E., Beumer, W. Y., Okorn, A., Vogelaar, S., Saab, N., Miers, A. C., Westenberg, P. M., & Asscher, J. J. (2020) · Journal of Youth and Adolescence · doi:10.1007/s10964-020-01201-5 · Cited by 128
Kostyrka‐Allchorne, K., Wass, S. V., & Sonuga-Barke, E. J. S. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13144 · Cited by 145
Microbial Responses to Biochar Soil Amendment and Influential Factors: A Three-Level Meta-Analysis
Kerner, P., Struhs, E., Mirkouei, A., Aho, K. A., Lohse, K. A., Dungan, R. S., & You, Y. (2023) · Environmental Science & Technology · doi:10.1021/acs.est.3c04201 · Cited by 138
Baldwin, J. R., Coleman, O., Francis, E., & Danese, A. (2024) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2024.0818 · Cited by 145
Mallawaarachchi, S., Burley, J., Mavilidi, M., Howard, S. J., Straker, L., Kervin, L., Staton, S., Hayes, N., Machell, A., Torjinski, M., et al. (2024) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2024.2620 · Cited by 142
Berry, J. W., Lepshokova, Z. K., & Grigoryev, D. S. (2021) · Applied Psychology · doi:10.1111/apps.12332 · Cited by 149
Who believes in conspiracy theories? A meta-analysis on personality correlates
Stasielowicz, L. (2022) · Journal of Research in Personality · doi:10.1016/j.jrp.2022.104229 · Cited by 146
Financial Profitability of Diversified Farming Systems: A Global Meta-Analysis
Sánchez, A. C., Kamau, H., Grazioli, F., & Jones, S. K. (2022) · Ecological Economics · doi:10.1016/j.ecolecon.2022.107595 · Cited by 157
Tully, P. J., Yano, Y., Launer, L. J., Kario, K., Nagai, M., Mooijaart, S. P., Claassen, J. A. H. R., Lattanzi, S., Vincent, A. D., Tzourio, C., et al. (2019) · Journal of the American Heart Association · doi:10.1161/jaha.119.013841 · Cited by 125
Pastor, D. A., & Lazowski, R. A. (2017) · Multivariate Behavioral Research · doi:10.1080/00273171.2017.1365684 · Cited by 124
van IJzendoorn, M. H., Schuengel, C., Wang, Q., & Bakermans-Kranenburg, M. J. (2023) · Development and Psychopathology · doi:10.1017/s0954579421001462 · Cited by 116
Mao, P., Cai, Z., He, J., Chen, X., & Fan, X. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.784068 · Cited by 162
van der Put, C. E., Assink, M., & van Solinge, N. F. B. (2017) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2017.09.016 · Cited by 138
Self-citationExecutive functions in trauma-exposed youth: a meta-analysis
den Kelder, R. O., van den Akker, A. L., Geurts, H. M., Lindauer, R., & Overbeek, G. J. (2018) · European Journal of Psychotraumatology · doi:10.1080/20008198.2018.1450595 · Cited by 132
Wang, B., Baldwin, J. R., Schoeler, T., Cheesman, R., Barkhuizen, W., Dudbridge, F., Bann, D., Morris, T. T., & Pingault, J.-B. (2021) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2021.07.010 · Cited by 103
Is Your Accent Right for the Job? A Meta-Analysis on Accent Bias in Hiring Decisions
Spence, J. L., Hornsey, M. J., Stephenson, E. M., & Imuta, K. (2022) · Personality and Social Psychology Bulletin · doi:10.1177/01461672221130595 · Cited by 130
Donath, J. L., Lüke, T., Graf, E., Tran, U. S., & Götz, T. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09752-2 · Cited by 266
Non-specific versus targeted approaches to youth mentoring: A follow-up meta-analysis
Christensen, K. M., Hagler, M. A., Stams, G.-J., Raposa, E. B., Burton, S., & Rhodes, J. E. (2020) · Journal of Youth and Adolescence · doi:10.1007/s10964-020-01233-x · Cited by 107
Moldes, O., & Ku, L. (2020) · Psychology and Marketing · doi:10.1002/mar.21387 · Cited by 112
Chevance, G., Bernard, P., Chamberland, P.-É., & Rebar, A. L. (2019) · Health Psychology Review · doi:10.1080/17437199.2019.1618726 · Cited by 121
Parenting and prosocial behaviors: A meta‐analysis
Wong, T. K. Y., Konishi, C., & Kong, X. (2020) · Social Development · doi:10.1111/sode.12481 · Cited by 130
Spaniol, M., & Danielsson, H. (2021) · Journal of Intellectual Disability Research · doi:10.1111/jir.12878 · Cited by 134
Sebri, V., Durosini, I., Triberti, S., & Pravettoni, G. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.611954 · Cited by 104
Ellis, B. J., Horn, A. J., Carter, C. S., van IJzendoorn, M. H., & Bakermans‐Kranenburg, M. J. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.101985 · Cited by 103
Associations Between Rejection Sensitivity, Aggression, and Victimization: A Meta-Analytic Review
Gao, S., Assink, M., Liu, T., Chan, K. L., & Ip, P. (2019) · Trauma Violence & Abuse · doi:10.1177/1524838019833005 · Cited by 114
Self-citationWeeland, J., Moens, M. A., Beute, F., Assink, M., Staaks, J. P. C., & Overbeek, G. J. (2019) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2019.101326 · Cited by 114
Self-citationJanovsky, T., Rock, A. J., Thorsteinsson, E., Clark, G. I., & Murray, C. (2020) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2439 · Cited by 122
Traut, H. J., Guild, R. M., & Munakata, Y. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.662139 · Cited by 100
Metadata
- Authors
- Assink, M., & Wibbelink, C. J. M.
- Affiliations
- University of Amsterdam (NL)
- Corresponding author
- Assink, Mark
- Venue
- The Quantitative Methods for Psychology
- Published
- 2016-10-01
- Volume
- 12
- Issue
- 3
- Pages
- 154-174
- ISSN
- 2292-1354 (ISSN-L)
- OpenAlex
- W2532414435
- Semantic Scholar
- 95f645af7a355ecf2b9a7958c12734ad1768e44f
- Cited by
- 1,330
- References
- 47
- Citations by year
- 2026: 345 · 2025: 244 · 2024: 208 · 2023: 146 · 2022: 134 · 2021: 93 · 2020: 81 · 2019: 44 · 2018: 22 · 2017: 9 · 2016: 2
- FWCI
- 21.40
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The Quantitative Methods for Psychology (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- Universiteit Maastricht
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- multilevel meta-analysis, R programming language, effect size heterogeneity, between-study variance, moderator analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
