Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.

Obtaining Unbiased Results in Meta-Analysis: The Importance of Correcting for Statistical Artifacts

Wiernik, Brenton M., Dahlke, Jeffrey A. · 2020 · Advances in Methods and Practices in Psychological Science

Abstract

Most published meta-analyses address only artifactual variance due to sampling error and ignore the role of other statistical and psychometric artifacts, such as measurement error variance (due to factors including unreliability of measurements, group misclassification, and variable treatment strength) and selection effects (including range restriction or enhancement and collider biases). These artifacts can have severe biasing effects on the results of individual studies and meta-analyses. Failing to account for these artifacts can lead to inaccurate conclusions about the mean effect size and between-studies effect-size heterogeneity, and can influence the results of meta-regression, publication-bias, and sensitivity analyses. In this article, we provide a brief introduction to the biasing effects of measurement error variance and selection effects and their relevance to a variety of research designs. We describe how to estimate the effects of these artifacts in different research designs and correct for their impacts in primary studies and meta-analyses. We consider meta-analyses of correlations, observational group differences, and experimental effects. We provide R code to implement the corrections described.

Overview

Integrity signals

Registry

Crossref · 10.1177/2515245919885611

Cites

92 of 92 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 91 references

Research works printed but not linked: 5

  1. 10.1037/0021-9010.74.3.478 · doi:10.1037/0021-9010.74.3.478 · Paper page
  2. Carter E., 2017, PsyArXiv
  3. 10.1037/0021-9010.79.5.767 · doi:10.1037/0021-9010.79.5.767 · Paper page
  4. Kulinskaya E., 2018, Paper presented at the Society for Research Synthesis Methodology conference
  5. 10.1037/0021-9010.85.1.112 · doi:10.1037/0021-9010.85.1.112 · Paper page

Cited by

See all 153

Metadata

Authors
Wiernik, B. M., & Dahlke, J. A.
Affiliations
  • University of South Florida (US)
  • Human Resources Research Organization (US)
Corresponding author
Wiernik, Brenton M.
Venue
Advances in Methods and Practices in Psychological Science
Published
2020-01-22
Volume
3
Issue
1
Pages
94-123
ISSN
  • 2515-2459 (ISSN-L)
  • 2515-2467
OpenAlex
W3002826573
Cited by
135
References
91
Citations by year
2026: 20 · 2025: 19 · 2024: 28 · 2023: 21 · 2022: 19 · 2021: 20 · 2020: 7
FWCI
10.22
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
Advances in Methods and Practices in Psychological Science (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Keywords
meta-analysis bias, measurement error variance, selection effects, range restriction, collider bias, effect size heterogeneity, meta-regression, publication bias, sampling error, measurement reliability, experimental effects

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Obtaining Unbiased Results in Meta-Analysis: The Importance of Correcting for Statistical Artifacts. https://app.cochat.ai/papers/10.1177/2515245919885611
The paper
Wiernik, B. M., & Dahlke, J. A. (2020). Obtaining Unbiased Results in Meta-Analysis: The Importance of Correcting for Statistical Artifacts. Advances in Methods and Practices in Psychological Science. https://doi.org/10.1177/2515245919885611

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.