CoChat

Small sample adjustments for robust variance estimation with meta-regression.

Tipton, Elizabeth · 2015 · Psychological Methods

The DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index.

Abstract

Although primary studies often report multiple outcomes, the covariances between these outcomes are rarely reported. This leads to difficulties when combining studies in a meta-analysis. This problem was recently addressed with the introduction of robust variance estimation. This new method enables the estimation of meta-regression models with dependent effect sizes, even when the dependence structure is unknown. Although robust variance estimation has been shown to perform well when the number of studies in the meta-analysis is large, previous simulation studies suggest that the associated tests often have Type I error rates that are much larger than nominal. In this article, I introduce 6 estimators with better small sample properties and study the effectiveness of these estimators via 2 simulation studies. The results of these simulations suggest that the best estimator involves correcting both the residuals and degrees of freedom used in the robust variance estimator. These studies also suggest that the degrees of freedom depend on not only the number of studies but also the type of covariates in the meta-regression. The fact that the degrees of freedom can be small, even when the number of studies is large, suggests that these small-sample corrections should be used more generally. I conclude with an example comparing the results of a meta-regression with robust variance estimation with the results from the corrected estimator.

Overview

Integrity signals

Registry

Crossref · 10.1037/met0000011

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

5 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 30 references

Cited by

See all 846

Metadata

Authors
Tipton, E.
Affiliations
Columbia University (US)
Corresponding author
Tipton, Elizabeth
Venue
Psychological Methods
Published
2015
Volume
20
Issue
3
Pages
375-393
ISSN
  • 1082-989X (ISSN-L)
  • 1939-1463
OpenAlex
W2317922289
Cited by
810
References
31
Citations by year
2026: 152 · 2025: 77 · 2024: 91 · 2023: 83 · 2022: 89 · 2021: 87 · 2020: 69 · 2019: 55 · 2018: 38 · 2017: 34 · 2016: 18 · 2015: 14
FWCI
22.11
Type
journal article
Language
en
Open access
closed
Locations
  • Psychological Methods (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords
robust variance estimation, meta-regression, small sample correction, type I error rate, dependent effect sizes, multiple outcomes, residual correction, meta-analysis
MeSH terms
Data Interpretation, Statistical, Humans, Regression Analysis, Meta-Analysis as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Small sample adjustments for robust variance estimation with meta-regression. https://app.cochat.ai/papers/10.1037/met0000011
The paper
Tipton, E. (2015). Small sample adjustments for robust variance estimation with meta-regression. Psychological Methods. https://doi.org/10.1037/met0000011

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.