Small-Sample Adjustments for Tests of Moderators and Model Fit Using Robust Variance Estimation in Meta-Regression
The DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Meta-analyses often include studies that report multiple effect sizes based on a common pool of subjects or that report effect sizes from several samples that were treated with very similar research protocols. The inclusion of such studies introduces dependence among the effect size estimates. When the number of studies is large, robust variance estimation (RVE) provides a method for pooling dependent effects, even when information on the exact dependence structure is not available. When the number of studies is small or moderate, however, test statistics and confidence intervals based on RVE can have inflated Type I error. This article describes and investigates several small-sample adjustments to F -statistics based on RVE. Simulation results demonstrate that one such test, which approximates the test statistic using Hotelling’s T 2 distribution, is level-α and uniformly more powerful than the others. An empirical application demonstrates how results based on this test compare to the large-sample F -test.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Since there is uncertainty around the correlation value used for imputation, robust inference methods with an adjustment for small samples was used, so that the interpretation of fi xed effects were unbiased [51].”
From The effect of caffeine on subsequent sleep: A systematic review and meta-analysis (2023) · cites this paper as [51]
In the citing paper
“Given the limited number of studies included, we employed small sample correction to adjust for inflated Type I errors in test statistics based on RVE using t tests (Tipton, 2015;Tipton & Pustejovsky, 2015).”
From Teacher Professional Development and Student Mathematics Achievement: A Meta-Analysis of the Effects and Moderators (2025) · cites this paper as Tipton & Pustejovsky, 2015
In the citing paper
“These findings follow closely those from Tipton and Pustejovsky (2015), which indicated that the Type I error of the AHT test was close to nominal even when the working model was quite discrepant from the data-generating model.”
From Small-Sample Methods for Cluster-Robust Variance Estimation and Hypothesis Testing in Fixed Effects Models (2018) · cites this paper as Tipton and Pustejovsky (2015)
In the citing paper
“Like the bias of the CRVE estimator itself, the accuracy of the asymptotic approximations depends on design features such as the degree of imbalance across clusters, skewness or leverage of the covariates, and the similarity of cluster sizes (Tipton and Pustejovsky 2015; McCaffrey, Bell, and Botts 2001; MacKinnon and Webb 2016; Carter, Schnepel, and Steigerwald 2013).”
From Small-Sample Methods for Cluster-Robust Variance Estimation and Hypothesis Testing in Fixed Effects Models (2018) · cites this paper as Tipton and Pustejovsky 2015
In the citing paper
“However, simulation studies reported here and elsewhere (Tipton 2015; Tipton and Pustejovsky 2015) have demonstrated that the approach is actually robust to a high degree of misspecification in the working model.”
From Small-Sample Methods for Cluster-Robust Variance Estimation and Hypothesis Testing in Fixed Effects Models (2018) · cites this paper as Tipton and Pustejovsky 2015
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,723
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553 · cited 1×
“The multivariate meta-analysis model requires good estimates of the correlation between dependent effect sizes (Gleser & Olkin, 2009), which typically are not available to the meta-analyst.”
MethodAspects of multivariate statistical theory
Muirhead, R. J. 1. (1982) · Cited by 3,032
Aspects of Multivariate Statistical Theory
Muirhead, R. J. (1982) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316559 · Cited by 2,260 · cited 2×
“For a random q q matrix D such that ηD follows a Wishart distribution with η degrees of freedom and scale matrix Iq, the covariances among the entries of D satisfy: ηCovðdst; duvÞ ¼ Iðs ¼ uÞIðt ¼ vÞ þ Iðs ¼ vÞIðt ¼ uÞ; ð11Þ for s,t,u,v¼ 1, . . . , q (Muirhead, 1982, section 3.2.2).”
BackgroundInfluentialRobust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086 · cited 20×
“However, evidence from several simulation studies indicates that, even with these corrections, the test has inflated Type I error when there are fewer than 40 independent studies (Hedges et al., 2010; Tipton, 2013, 2015; Williams, 2012). Tipton (2015) proposed alternative methods for testing single meta-regression coe…”
BackgroundMethodSelf-citationThe malleability of spatial skills: A meta-analysis of training studies.
Uttal, D. H., Meadow, N. G., Tipton, E., Hand, L. L., Alden, A. R., Warren, C., & Newcombe, N. S. (2013) · Psychological Bulletin · doi:10.1037/a0028446 · Cited by 1,899 · cited 1×
“…(e.g., Wilson, Lipsey, Tanner-Smith, Huang, & Steinka-Fry, 2011), psychology (e.g., Samson, Tipton and Pustejovsky 605 Ojanen, & Hollo, 2012; Uttal et al., 2013), and intervention science (e.g., De Vibe, Bjørndal, Tipton, Hammerstrøm, & Kowalski, 2012; Tanner-Smith, Wilson, & Lipsey, 2013).”
Self-citationSmall sample adjustments for robust variance estimation with meta-regression.
Tipton, E. (2015) · Psychological Methods · doi:10.1037/met0000011 · Cited by 810 · cited 28×
“Another approach, introduced by Bell and McCaffrey (2002) and followed by Tipton (2015), is to instead use the same working model that was used to develop the weighting matrices Wj and adjustment matrices Aj.”
BackgroundMethodResultSelf-citationTanner-Smith, E. E., & Tipton, E. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1091 · Cited by 588 · cited 4×
“The per-group sample size per study (nj) ranged from 32 to 130 and included the same values as in the second simulation from Tipton (2015). We chose to use a variable number of effect sizes per study and variable sample sizes in order to emulate conditions likely to be observed in practice as well as to induce a great…”
MethodResultSelf-citationResearch Synthesis and Meta-Analysis
Cooper, H., Patall, E., & Lindsay, J. (2009) · The SAGE Handbook of Applied Social Research Methods · doi:10.4135/9781483348858.n11 · Cited by 397
Tanner-Smith, E. E., Wilson, S. J., & Lipsey, M. W. (2013) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2012.05.006 · Cited by 331 · cited 2×
“As with the t-test developed by Tipton (2015) for single-parameter hypothesis tests, we seek a test that performs well in small samples, thus enabling broad application in meta-analysis.”
Method
Research works printed but not linked: 6
- 10.3102/10769986019002091 · doi:10.3102/10769986019002091 · Paper page
- Bell R. M., McCaffrey D. F. (2002). Bias reduction in standard errors for linear regression with multi-stage samples. Survey Methodology, 28, 169–181.
- Cooper H. M. (2010). Research synthesis and meta-analysis (4th ed.). Thousand Oaks, CA: SAGE.
- 10.4073/csr.2012.3 · DOI · Paper page
- Fisher Z. Tipton E. (2014). robumeta: An R-package for robust variance estimation in meta-analysis. Retrieved from arXiv preprint arXiv:1503.02220 · arXiv
- McCaffrey D. F. Bell R. M. Botts C. H. (2001 August). Generalizations of biased reduced linearization. In Proceedings of the Annual Meeting of the American Statistical Association.
Cited by
Items 301–367 of 367
Attachment Styles and Degree of Internet Use: A Meta-Analysis
李, 枝. (2022) · Advances in Psychology · doi:10.12677/ap.2022.122052
Do jihadist terrorist attacks cause changes in institutional trust? A multi-site natural experimentPreprint
Nägel, C., Nivette, A. E., & Czymara, C. S. (2022) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/rgfbd
Investigating Preferences and Behavior within Environmental Economics
Bastola, S. (2022) · Louisiana State University · doi:10.31390/gradschool_dissertations.5952
Stewart, G. K. (2023) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc2179287
Dietrichson, J., Klokker, R. H., Filges, T., Bengtsen, E., & Pigott, T. (2024) · Campbell Systematic Reviews · doi:10.1002/cl2.70009 · Cited by 1
Chen, Q. (2023) · Scholars Archive - University at Albany (University at Albany, State University of New York) · doi:10.54014/hwjx-ek1r · Cited by 1
Yang, Y., Liu, M., Morrison, K., Lagisz, M., & Nakagawa, S. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.06.02.657339
Brunner, M., Preckel, F., Goetz, T., Lüdtke, O., & Keller, L. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6pmhr_v2
Hedges, L. V. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-26629-4.00033-2
Quantifying the impact of ambient temperature on varicella incidence: Evidence from a meta-analysis
Wang, L., Zhang, S., Xu, C., Zhang, Z., Zhang, X., & Qiao, J. (2025) · Environmental Research · doi:10.1016/j.envres.2025.123448
Bourke, M., Haddara, A., Loh, A., Saravanamuttoo, K., Bruijns, B. A., & Tucker, P. (2024) · Figshare · doi:10.6084/m9.figshare.26725952
Bourke, M., Haddara, A., Loh, A., Saravanamuttoo, K., Bruijns, B. A., & Tucker, P. (2024) · Figshare · doi:10.6084/m9.figshare.26725949
Bourke, M., Haddara, A., Loh, A., Saravanamuttoo, K., Bruijns, B. A., & Tucker, P. (2024) · Figshare · doi:10.6084/m9.figshare.26725940
Bourke, M., Haddara, A., Loh, A., Saravanamuttoo, K., Bruijns, B. A., & Tucker, P. (2024) · Figshare · doi:10.6084/m9.figshare.26725943
Bourke, M., Haddara, A., Loh, A., Saravanamuttoo, K., Bruijns, B. A., & Tucker, P. (2024) · Figshare · doi:10.6084/m9.figshare.26725946
Meta-Analysis with Robust Variance Estimation: Expanding the Range of Working ModelsPreprint
Tipton, E., & Pustejovsky, J. E. (2021) · OSF Preprints (OSF Preprints) · Cited by 1
Self-citationLu, Y., Tang, L., Wang, Y., Huang, X., Jing, J., Fang, Y., & Yin, J. (2025) · International Journal of Sport and Exercise Psychology · doi:10.1080/1612197x.2025.2600982
A meta-analytic comparison of divergent thinking in gifted and nongifted students
Alabbasi, A. M. A., Acar, S., Runco, M. A., Martinez, C., Sultan, Z. M., & Oğurlu, Ü. (2026) · High Ability Studies · doi:10.1080/13598139.2025.2607991 · Cited by 1
“Besides testing each moderator using Wald test, we also conducted analyses using dummy-coded categorical moderators (Tipton & Pustejovsky, 2015).”
Oliveira, R. E. N. D. N., Machado, G. F., Salvador, I. C. M. C., Ambrosio, P. D. D., Delgado, L. M., Passos, F. S., & Caldonazo, T. M. M. (2026) · Frontiers in Surgery · doi:10.3389/fsurg.2025.1755084
Kansızoğlu, H. B., Kansızoğlu, N., & Memiş, M. (2026) · Journal of Computer and Education Research · doi:10.18009/jcer.1701299
Face processing in infants at elevated likelihood for autism: A systematic review and meta-analysis
Fico, K., Krol, M. A., Bussu, G., Gosling, C. J., Tye, C., Hunnius, S., & Buitelaar, J. K. (2026) · Research in Autism · doi:10.1016/j.reia.2026.202874
Meta-analytic pooling of intraclass correlation coefficient estimates
Bhat, B. H., & Beretvas, S. N. (2026) · Research Synthesis Methods · doi:10.1017/rsm.2026.10077
Second-Order Meta-Analysis of the Creativity Research
Runco, M. A., Mammadov, S., Sui, D., KIM, T., & Neher, L. G. (2026) · Creativity Research Journal · doi:10.1080/10400419.2026.2644245 · Cited by 2
Latimier, A. (2019) · theses.fr (ABES) · doi:10.70675/d005cf32z3feez45d4z8dd6z5047380d3ff1 · Cited by 8
Durand, A., & Bègue, L. (2026) · Journal of Research in Personality · doi:10.1016/j.jrp.2026.104725
Racial Discrimination and Relationship Outcomes: A Meta-Analysis
Kelley, Z., Lam, P. H., Huang, L., Trujillo, M. A., McLeod, L., & Helgeson, V. S. (2026) · Journal of Social and Personal Relationships · doi:10.1177/02654075261448934
“Following best-practice recommendations, we conducted random effects models with robust variance estimation to account for within-study dependencies (Tipton, 2015; Tipton et al., 2023; Tipton & Pustejovsky, 2015).”
The processing advantage of emotion words in L1 speakers and L2 speakers: A meta-analysis
Zhong, Y., Liu, L., & Brehm, L. E. (2026) · Applied Psycholinguistics · doi:10.1017/s0142716426100630 · Cited by 1
“Cluster-robust variance estimation (Hedges et al., 2010), with small-sample corrections (Tipton & Pustejovsky, 2015), was used to account for dependency among effect sizes and ensure valid inference under unbalanced conditions.”
Statistical Methods for Assessing Non-Replicable, Outlying, and Influential Studies
Yang, Y., & Nakagawa, S. (2026) · Mathematics · doi:10.3390/math14193436
“Additionally, methods for small-sample adjustments have been developed to address issues related to small sample sizes (Tipton (2015), Tipton and Pustejovsky (2015), Joshi et al. (2022)).”
Andrews, K., Masood, N., Mansoor, A., Gross, J., Drmic, I., & Bennett, T. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-116131
“…effect sizes will be retained and robust variance estimation 32 will be used to account for the dependence among effect sizes within studies 33 34 ; (iii) for studies that include more than one relevant outcome using the same measurement instrument, we will examine measurement specificity…”
Alaycı, B., & Gerçek, Ö. Z. (2026) · BMC Endocrine Disorders · doi:10.21203/rs.3.rs-9973131/v1
Attractive Things Do Work Better: A Meta-Analysis on Visual Aesthetics and User Performance
Schlamann, M., Nestler, S., & Thielsch, M. T. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2664081 · Cited by 1
Executive function in adolescents with obesity: A systematic review and meta-analysis
Asgeirsdottir, U. A., Janssen, L., Villringer, A., & Witte, A. V. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.106828 · Cited by 2
Li, M., Zhao, Y., Shan, X., & Du, X. (2026) · Journal of Intelligence · doi:10.3390/jintelligence14070126 · Cited by 2
“These analyses were treated as supplementary robustness checks to the primary three-level models (Hedges et al., 2010; Pustejovsky & Tipton, 2022; Tipton, 2015; Tipton & Pustejovsky, 2015).”
Zhang, Z., Li, J., An, D., 李建彬, & Sun, J. (2026) · Teaching and Teacher Education · doi:10.1016/j.tate.2026.105716
Johansen, S. B., Bentzen, T. Ø., & Christensen, S. L. (2026) · Social Science & Medicine · doi:10.1016/j.socscimed.2026.119555 · Cited by 10
Hoskins, J. I., Gooch, D., & Gilligan-Lee, K. A. (2026) · Journal of Attention Disorders · doi:10.1177/10870547261459712
“RVE is particularly useful for handling cases where multiple effect sizes are extracted from a single study, as it accounts for within-study correlations and prevents over-weighting of studies contributing multiple outcomes (Fisher & Tipton, 2015; Tipton, 2015; Tipton & Pustejovsky, 2015).”
León, S. P., Lipnevich, A. A., & Garrido, M. G. (2026) · Review of Educational Research · doi:10.3102/00346543261458396
Zainal, N. H. (2024) · OSF Preprints (OSF Preprints)
Imaginary companions: A meta-analytic investigation on anthropomorphism and chronic loneliness
Durand, A., & Bègue, L. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.107436
Tao, M., Hooren, B. V., Dai, S., Wang, X., Yin, M., Xu, K., Zhu, C., Lyu, M., Song, Y., Li, Z., et al. (2026) · International Journal of Sports Physiology and Performance · doi:10.1123/ijspp.2025-0584
Lu, J., Liu, M., Xu, S., Zhang, L., Bao, D., Xue, Z., He, L., Huang, Y., Bao, K., & Girard, O. (2026) · BMC Sports Science Medicine and Rehabilitation · doi:10.1186/s13102-026-01765-y
“When studies reported multiple time points, we extracted the As a further sensitivity analysis, CR2 cluster-robust inference was examined [40–42].”
Wang, H.-Q., Jiang, Y., Zhu, L., Fan, M., Zhao, Y.-Q., & Wang, D.-M. (2026) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2026.1902938
“Therefore, a random-effects robust variance estimation (RVE) meta-analytic framework was used as the primary analytic approach (Hedges et al., 2010; Tipton, 2015; Tipton and Pustejovsky, 2015).”
Luo, W., Li, C., & Baek, E. (2026) · Research Square · doi:10.21203/rs.3.rs-10704580/v1
Qin, Y., Dai, E., Zhang, X., & Fu, G. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7347223
Psychological interventions for death anxiety and distress: Systematic review and meta-analysis
Yazd, S. A. R. (2026) · Death Studies · doi:10.1080/07481187.2026.2724107
Hu, X., Zheng, H., Qiu, J., & Chen, P. (2026) · Frontiers in Nutrition · doi:10.3389/fnut.2026.1941705
Peer feedback quality matters for post-feedback outcomes: A meta-analysis
Alemdağ, E., Lipnevich, A. A., Bardach, L., & Lindner, M. A. (2026) · Educational Research Review · doi:10.1016/j.edurev.2026.100848
Hillmann, A. R., Lam, P. H., Forest, A. L., Depro, J. M., Zou, H., Marsland, A. L., & Reed, R. G. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.106962
Cao, L., Xie, Y., Cheng, X.-F., Xu, T.-W., Lu, K., Jian, L., & Li, M. (2026) · Journal of Addiction Medicine · doi:10.1097/adm.0000000000001778
Zhang, J., Li, Y., Wei, B., Li, X., Xiao, Z., Wu, X., Ye, X., & Zhang, S. (2026) · Frontiers in Physiology · doi:10.3389/fphys.2026.1960237
Workplace Interventions to Promote Employees' Pro‐Environmental Behaviour: A Meta‐Analysis
Brack, F., Petrowsky, H. M., Hörisch, J., & Loschelder, D. D. (2026) · Human Resource Management Journal · doi:10.1111/1748-8583.70066
Finnes, A., Johansson, M., Bernhardtz, R., & Öst, L. (2026) · BMC Psychology · doi:10.1186/s40359-026-05648-2
“Cluster-robust (CR2) standard errors and confidence intervals with Satterthwaite degrees of freedom were estimated using the `clubSandwich` R package [57, 58].”
Mehri-Kakavand, G., Mdletshe, S., Pursamimi, M., & Wang, A. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02282-7
Xu, J., Yu, D., Liu, M., Zhang, X., Liu, H., & Liu, Y. (2026) · Plants · doi:10.3390/plants15192911
“As a sensitivity analysis, CR2-adjusted robust inference clustered by study was used to examine the influence of within-study dependence [48], and the results were compared with the multilevel estimates (Table S5).”
Lu, W., Shi, S., & Chen, J. (2026) · Behavioral Sciences · doi:10.3390/bs16101774
“…independent study clusters contributed to the primary spline model, inference was additionally checked by exact enumeration of all 2 7 = 128 study-level Rademacher sign patterns under the restricted linear null (Hedges et al., 2010; Tipton, 2015; Tipton & Pustejovsky, 2015; Cameron et al., 2008).”
Li, H., & Zhong, L. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1956100
“CR2 small-sample correction and Satterthwaite approximations for the degrees of freedom were used to assess the robustness of the primary statistical inferences to within-study dependence structures (22–24).”
Kim, M. Y., & Cho, M. (2026) · Healthcare · doi:10.3390/healthcare14193336
“To account for statistical dependence arising from multiple comparisons within the same study, effect estimates were clustered at the study level, and inference was based on small-sample-adjusted cluster-robust variance estimation (CR2) [23,24].”
Ikuemonisan, E. S., Fadairo, A. O., Gbadamosi, A. E., Daramola, O., & Johnson, S. B. (2026) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2026.103706
Cortisol and cognition in psychotic disorders: A systematic review and multi-level meta-analysis
Chen, Z., Yong, J. X. M., Haussler, S. M., Murray, R. M., Pariante, C. M., Ibrahim, F., & Kravariti, E. (2026) · Psychological Medicine · doi:10.1017/s0033291726106266
“…among effect sizes remained within significant moderator subgroups, or when unmoderated models were analysed, robust variance estimation (RVE) was used to obtain robust standard errors and valid statistical inference (Hedges, Tipton, & Johnson, 2010; Tipton, 2015; Tipton & Pustejovsky, 2015).”
The Effects of Generative Artificial Intelligence on Self-Regulated Learning: A Meta-Analysis
Jin, Y., Osman, K., & Arsad, N. M. (2026) · Information · doi:10.3390/info17101028 · Cited by 8
Li, J., Zhang, Y., Sun, J., Shan, X., Ding, L., Qiu, X., Zhang, B., Li, X., Liang, X., & XueTao, G. (2026) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2026.143959
Abro, Z. A., & Mumtaz, Z. (2026) · Social Policy and Society · doi:10.1017/s1474746426101547
Parent technoference and child mental health problems: A meta-analysis
Eirich, R., Marsh, A., & Madigan, S. L. (2026) · Computers in Human Behavior · doi:10.2139/ssrn.6613900
Responses of Soil Fauna Abundance to Climatic Extremes and Wildfire
He, C., Wu, Q., Dai, Z., Yang, Q., Yue, K., Li, Z., An, N., Tan, S., & Peng, Y. (2026) · Sustainability · doi:10.3390/su182110906
Qiao, C., Yang, C., Guo, S., Yang, S., & Wang, Y. (2026) · International Journal of Molecular Sciences · doi:10.3390/ijms27219657
Exploring the statistical fragility of creativity studies using the alternate uses task
Arora, V., Sutoski, A., Boilard, J., Vasilyev, J., Madden, K., Bhandari, M., & Thabane, A. (2026) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2026.102410
Feng, X., Zhang, L., & Lu, C. (2026) · Educational Research Review · doi:10.1016/j.edurev.2026.100866
Metadata
- Authors
- Tipton, E., & Pustejovsky, J. E.
- Affiliations
- Columbia University (US)
- The University of Texas at Austin (US)
- Venue
- Journal of Educational and Behavioral Statistics
- Published
- 2015-12
- Volume
- 40
- Issue
- 6
- Pages
- 604-634
- ISSN
- 1076-9986 (ISSN-L)
- 1935-1054
- OpenAlex
- W2276186231
- Cited by
- 362
- References
- 31
- Citations by year
- 2026: 66 · 2025: 49 · 2024: 46 · 2023: 47 · 2022: 49 · 2021: 30 · 2020: 31 · 2019: 21 · 2018: 14 · 2017: 6 · 2016: 3
- FWCI
- 7.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Educational and Behavioral Statistics (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Keywords
- robust variance estimation, meta-regression, type I error inflation, F-statistic, moderators, dependent effect sizes, confidence intervals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.