The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Estimation of the predictive power of the model in mixed‐effects meta‐regression: A simulation study
Open accessAbstract
Several methods are available to estimate the total and residual amount of heterogeneity in meta‐analysis, leading to different alternatives when estimating the predictive power in mixed‐effects meta‐regression models using the formula proposed by Raudenbush (1994, 2009). In this paper, a simulation study was conducted to compare the performance of seven estimators of these parameters under various realistic scenarios in psychology and related fields. Our results suggest that the number of studies ( k ) exerts the most important influence on the accuracy of the results, and that precise estimates of the heterogeneity variances and the model predictive power can only be expected with at least 20 and 40 studies, respectively. Increases in the average within‐study sample size ( ) also improved the results for all estimators. Some differences among the accuracy of the estimators were observed, especially under adverse (small k and ) conditions, while the results for the different methods tended to convergence for more optimal scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Random-effects model for meta-analysis of clinical trials: An update
DerSimonian, R., & Kacker, R. (2007) · Contemporary Clinical Trials · doi:10.1016/j.cct.2006.04.004 · Cited by 2,374
Improved tests for a random effects meta‐regression with a single covariate
Knapp, G., & Hartung, J. (2003) · Statistics in Medicine · doi:10.1002/sim.1482 · Cited by 2,075 · cited 1×
“…to values representative of no, low, medium, or large amounts of heterogeneity in psychology and related fields (0, 0.08, 0.16, and 0.32, respectively), similar to the values employed inprevious simulation studies (e.g., Knapp & Hartung, 2003; Mar ın-Mart ınez & S anchez-Meca, 2010; Schulze, 2004).”
ResultInfluentialBias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699 · cited 10×
“Several alternatives have been proposed in the literature to estimate the total heterogeneity variance, τ(2), in random-effects models (DerSimonian & Laird, 1986; Morris, 1983; S anchez-Meca&Mar ın-Mart ınez, 2008; Sidik& Jonkman, 2005b, 2007; Viechtbauer, 2005).”
BackgroundMethodResultInfluentialSelf-citationCross-national patterns of gender differences in mathematics: A meta-analysis.
Else-Quest, N. M., Hyde, J. S., & Linn, M. C. (2010) · Psychological Bulletin · doi:10.1037/a0018053 · Cited by 1,630
Parametric empirical Bayes inference: theory and applications
Morris, C. N. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477920 · Cited by 1,448 · cited 2×
“Several alternatives have been proposed in the literature to estimate the total heterogeneity variance, τ2, in random-effects models (DerSimonian & Laird, 1986; Morris, 1983; S anchez-Meca&Mar ın-Mart ınez, 2008; Sidik& Jonkman, 2005b, 2007; Viechtbauer, 2005).”
BackgroundSystematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017 · cited 2×
“…obtained in this simulation study suggest that about 40 studies are required to get accurate estimates of P2 in mixed-effects meta-regression models, so that a cautious interpretation of R2 values should be advised for meta-regression models fitted with a smaller number of studies (Thompson, 1994).”
MethodThe power of statistical tests for moderators in meta-analysis
Hedges, L. V., & Pigott, T. D. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.426 · Cited by 672
A comparison of heterogeneity variance estimators in combining results of studies
Sidik, K., & Jonkman, J. N. (2007) · Statistics in Medicine · doi:10.1002/sim.2688 · Cited by 380
Cited by
Stein, A., Gerstner, K., & Kreft, H. (2014) · Ecology Letters · doi:10.1111/ele.12277 · Cited by 2,054
Cheung, M. W.-L. (2014) · Psychological Methods · doi:10.1037/a0032968 · Cited by 1,342
Cupp, M. A., Cariolou, M., Tzoulaki, I., Aune, D., Evangelou, E., & Berlanga-Taylor, A. J. (2020) · BMC Medicine · doi:10.1186/s12916-020-01817-1 · Cited by 697
Effects of flipping the classroom on learning outcomes and satisfaction: A meta-analysis
van Alten, D. C. D., Phielix, C., Janssen, J., & Kester, L. (2019) · Educational Research Review · doi:10.1016/j.edurev.2019.05.003 · Cited by 546
The Effectiveness of Customer Participation in New Product Development: A Meta-Analysis
Chang, W., & Taylor, S. A. (2016) · Journal of Marketing · doi:10.1509/jm.14.0057 · Cited by 507
van Dis, E. A. M., van Veen, S. C., Hagenaars, M. A., Batelaan, N. M., Bockting, C. L. H., van den Heuvel, R. M., Cuijpers, P., & Engelhard, I. M. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.3986 · Cited by 335
Peters, G.-J. Y., de Bruin, M., & Crutzen, R. (2015) · Health Psychology Review · doi:10.1080/17437199.2013.848409 · Cited by 276
A comparison of procedures to test for moderators in mixed-effects meta-regression models
Viechtbauer, W., López-López, J. A., Sánchez-Meca, J., & Marín-Martínez, F. (2015) · Psychological Methods · doi:10.1037/met0000023 · Cited by 241
Self-citationMeron, D., Hedger, N., Garner, M., & Baldwin, D. S. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.07.012 · Cited by 220
Fire Reduces Fungal Species Richness and In Situ Mycorrhizal Colonization: A Meta-Analysis
Dove, N. C., & Hart, S. C. (2017) · Fire Ecology · doi:10.4996/fireecology.130237746 · Cited by 171
Akbari, M., Seydavi, M., Hosseini, Z. S., Krafft, J., & Levin, M. E. (2022) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2022.03.007 · Cited by 155
Mwanri, A. W., Kinabo, J., Ramaiya, K., & Feskens, E. J. M. (2015) · Tropical Medicine & International Health · doi:10.1111/tmi.12521 · Cited by 128
Hedger, N., Gray, K. L. H., Garner, M., & Adams, W. J. (2016) · Psychological Bulletin · doi:10.1037/bul0000054 · Cited by 115
A Meta-analysis of Gut Microbiota in Children with Autism
Andreo-Martínez, P., Rubio-Aparicio, M., Sánchez-Meca, J., Veas, A., & Martínez-González, A. E. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05002-y · Cited by 96
Self-citationEfficacy of group psychotherapy for anxiety disorders: A systematic review and meta-analysis
Barkowski, S., Schwartze, D., Strauss, B., Burlingame, G. M., & Rosendahl, J. (2020) · Psychotherapy Research · doi:10.1080/10503307.2020.1729440 · Cited by 95
Adverse Childhood Experiences and Body Dysmorphic Symptoms: A Meta-Analysis
Longobardi, C., Badenes-Ribera, L., & Fabris, M. A. (2022) · Body Image · doi:10.1016/j.bodyim.2022.01.003 · Cited by 86
Salvo, F., Pariente, A., Shakir, S., Robinson, P., Arnaud, M., Thomas, S., Raschi, E., Fourrier‐Réglat, A., Moore, N., Sturkenboom, M., et al. (2016) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.250 · Cited by 83
Badenes-Ribera, L., Rubio-Aparicio, M., Sánchez-Meca, J., Fabris, M. A., & Longobardi, C. (2019) · Journal of Behavioral Addictions · doi:10.1556/2006.8.2019.44 · Cited by 80
“12002 *Magallares, A. (2016). Drive for thinness and pursuit of muscularity: The role of gender ideologies.Universitas Psychologica, 15(2), 353–360. doi:10.11144/Javeriana.upsy15-2.dtpm *Maida, D. M., & Armstrong, S. L. (2005). The classification of muscle dysmorphia. International Journal of Men’s Health, 4(1), 73–91…”
BackgroundMethodInfluentialSelf-citationThe Yale–Brown Obsessive Compulsive Scale: A Reliability Generalization Meta-Analysis
López-Pina, J. A., Sánchez-Meca, J., López-López, J. A., Marín-Martínez, F., Núñez-Núñez, R. M., Rosa-Alcázar, A. I., Gómez-Conesa, A., & Ferrer-Requena, J. (2015) · Assessment · doi:10.1177/1073191114551954 · Cited by 79
Self-citationGuidelines for reporting systematic reviews and meta-analyses
Rubio-Aparicio, M., Sánchez-Meca, J., Marín-Martínez, F., & López-López, J. A. (2018) · Anales de Psicología · doi:10.6018/analesps.34.2.320131 · Cited by 56
Self-citationHealth Effects of Psychological Interventions for Worry and Rumination: A Meta-analysis
McCarrick, D., Prestwich, A., Prudenzi, A., & O'Connor, D. B. (2021) · Health Psychology · doi:10.1037/hea0000985 · Cited by 51
Ortiz-Ruiz, A. J., Pérez-Guzmán, N., Rubio-Aparicio, M., & Sánchez-Meca, J. (2020) · Scientific Reports · doi:10.1038/s41598-020-63497-4 · Cited by 29
Self-citationRodriguez, J. E., Williams, D. R., & Bürkner, P. (2023) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12299 · Cited by 14
Emotional Intelligence and Gaming Disorder Symptomatology: A Systematic Review and Meta-Analysis
Gisbert-Pérez, J., Badenes-Ribera, L., & Martí-Vilar, M. (2024) · Adolescent Research Review · doi:10.1007/s40894-024-00233-3 · Cited by 12
Emotional intelligence in gifted and non-gifted individuals: A systematic review with meta-analysis
Ferrándiz, C., Ferrando-Prieto, M., Sánchez-Meca, J., Pons-Parra, R. M., & Infantes-Paniagua, Á. (2026) · Intelligence · doi:10.1016/j.intell.2026.102037
Self-citation
Metadata
- Authors
- López‐López, J. A., Marín‐Martínez, F., Sánchez‐Meca, J., Van den Noortgate, W., & Viechtbauer, W.
- Venue
- British Journal of Mathematical and Statistical Psychology
- Publisher
- Wiley
- Published
- 2013-01-08
- Volume
- 67
- Issue
- 1
- Pages
- 30-48
- ISSN
- 0007-1102 (ISSN-L)
- 2044-8317
- OpenAlex
- W2076855643
- Cited by
- 191
- References
- 14
- FWCI
- 7.53
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.