The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Estimation of the predictive power of the model in mixed‐effects meta‐regression: A simulation study
Open accessAbstract
Several methods are available to estimate the total and residual amount of heterogeneity in meta‐analysis, leading to different alternatives when estimating the predictive power in mixed‐effects meta‐regression models using the formula proposed by Raudenbush (1994, 2009). In this paper, a simulation study was conducted to compare the performance of seven estimators of these parameters under various realistic scenarios in psychology and related fields. Our results suggest that the number of studies ( k ) exerts the most important influence on the accuracy of the results, and that precise estimates of the heterogeneity variances and the model predictive power can only be expected with at least 20 and 40 studies, respectively. Increases in the average within‐study sample size ( ) also improved the results for all estimators. Some differences among the accuracy of the estimators were observed, especially under adverse (small k and ) conditions, while the results for the different methods tended to convergence for more optimal scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Random-effects model for meta-analysis of clinical trials: An update
DerSimonian, R., & Kacker, R. (2007) · Contemporary Clinical Trials · doi:10.1016/j.cct.2006.04.004 · Cited by 2,374
Improved tests for a random effects meta‐regression with a single covariate
Knapp, G., & Hartung, J. (2003) · Statistics in Medicine · doi:10.1002/sim.1482 · Cited by 2,075 · cited 1×
“…to values representative of no, low, medium, or large amounts of heterogeneity in psychology and related fields (0, 0.08, 0.16, and 0.32, respectively), similar to the values employed inprevious simulation studies (e.g., Knapp & Hartung, 2003; Mar ın-Mart ınez & S anchez-Meca, 2010; Schulze, 2004).”
ResultInfluentialBias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699 · cited 10×
“Several alternatives have been proposed in the literature to estimate the total heterogeneity variance, τ(2), in random-effects models (DerSimonian & Laird, 1986; Morris, 1983; S anchez-Meca&Mar ın-Mart ınez, 2008; Sidik& Jonkman, 2005b, 2007; Viechtbauer, 2005).”
BackgroundMethodResultInfluentialSelf-citationCross-national patterns of gender differences in mathematics: A meta-analysis.
Else-Quest, N. M., Hyde, J. S., & Linn, M. C. (2010) · Psychological Bulletin · doi:10.1037/a0018053 · Cited by 1,630
Parametric empirical Bayes inference: theory and applications
Morris, C. N. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477920 · Cited by 1,448 · cited 2×
“Several alternatives have been proposed in the literature to estimate the total heterogeneity variance, τ2, in random-effects models (DerSimonian & Laird, 1986; Morris, 1983; S anchez-Meca&Mar ın-Mart ınez, 2008; Sidik& Jonkman, 2005b, 2007; Viechtbauer, 2005).”
BackgroundSystematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017 · cited 2×
“…obtained in this simulation study suggest that about 40 studies are required to get accurate estimates of P2 in mixed-effects meta-regression models, so that a cautious interpretation of R2 values should be advised for meta-regression models fitted with a smaller number of studies (Thompson, 1994).”
MethodThe power of statistical tests for moderators in meta-analysis
Hedges, L. V., & Pigott, T. D. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.426 · Cited by 672
A comparison of heterogeneity variance estimators in combining results of studies
Sidik, K., & Jonkman, J. N. (2007) · Statistics in Medicine · doi:10.1002/sim.2688 · Cited by 380
Cooper, H., & Patall, E. A. (2009) · Psychological Methods · doi:10.1037/a0015565 · Cited by 339 · cited 1×
“Formore details on so-called individual participant datameta-analyses, see, for example, Cooper and Patall (2009). y ¼ Xbþ uþ e; ð1Þ whereb is a (p + 1) 9 1vector containing the regression coefficients b0; b1; . . .; bp ,u is a k 9 1 vector of independent between-studies errors {ui} with…”
BackgroundMultilevel Meta-analysis: a comparison with traditional meta-analytical procedures
Van Den Noortgate, W., & Onghena, P. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164403251027 · Cited by 218
Accounting for heterogeneity via random-effects models and moderator analyses in meta-analysis.
Viechtbauer, W. (2007) · Zeitschrift für Psychologie / Journal of Psychology · doi:10.1027/0044-3409.215.2.104 · Cited by 193
Self-citationSánchez-Meca, J., & Marín-Martínez, F. (2010) · International Encyclopedia of Education · doi:10.1016/b978-0-08-044894-7.01345-2 · Cited by 31
Self-citation
Cited by
Stein, A., Gerstner, K., & Kreft, H. (2014) · Ecology Letters · doi:10.1111/ele.12277 · Cited by 2,054
Cheung, M. W.-L. (2014) · Psychological Methods · doi:10.1037/a0032968 · Cited by 1,342
Cupp, M. A., Cariolou, M., Tzoulaki, I., Aune, D., Evangelou, E., & Berlanga-Taylor, A. J. (2020) · BMC Medicine · doi:10.1186/s12916-020-01817-1 · Cited by 697
Effects of flipping the classroom on learning outcomes and satisfaction: A meta-analysis
van Alten, D. C. D., Phielix, C., Janssen, J., & Kester, L. (2019) · Educational Research Review · doi:10.1016/j.edurev.2019.05.003 · Cited by 546
The Effectiveness of Customer Participation in New Product Development: A Meta-Analysis
Chang, W., & Taylor, S. A. (2016) · Journal of Marketing · doi:10.1509/jm.14.0057 · Cited by 507
Metadata
- Authors
- López‐López, J. A., Marín‐Martínez, F., Sánchez‐Meca, J., Van den Noortgate, W., & Viechtbauer, W.
- Venue
- British Journal of Mathematical and Statistical Psychology
- Publisher
- Wiley
- Published
- 2013-01-08
- Volume
- 67
- Issue
- 1
- Pages
- 30-48
- ISSN
- 0007-1102 (ISSN-L)
- 2044-8317
- OpenAlex
- W2076855643
- Cited by
- 191
- References
- 14
- FWCI
- 7.53
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.