CoChat

Modeling dependent effect sizes with three-level meta-analyses: A structural equation modeling approach

Cheung, Mike W.-L. · 2014 · Psychological Methods

The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.

Abstract

Meta-analysis is an indispensable tool used to synthesize research findings in the social, educational, medical, management, and behavioral sciences. Most meta-analytic models assume independence among effect sizes. However, effect sizes can be dependent for various reasons. For example, studies might report multiple effect sizes on the same construct, and effect sizes reported by participants from the same cultural group are likely to be more similar than those reported by other cultural groups. This article reviews the problems and common methods to handle dependent effect sizes. The objective of this article is to demonstrate how 3-level meta-analyses can be used to model dependent effect sizes. The advantages of the structural equation modeling approach over the multilevel approach with regard to conducting a 3-level meta-analysis are discussed. This article also seeks to extend the key concepts of Q statistics, I2, and R2 from 2-level meta-analyses to 3-level meta-analyses. The proposed procedures are implemented using the open source metaSEM package for the R statistical environment. Two real data sets are used to illustrate these procedures. New research directions related to 3-level meta-analyses are discussed.

Overview

Integrity signals

Registry

Crossref · 10.1037/a0032968

Cites

73 of 73 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

3 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 73 references

Cited by

Items 601–700 of 1,003

Metadata

Authors
Cheung, M. W.-L.
Affiliations
National University of Singapore (SG)
Corresponding author
Cheung, Mike W.-L.
Venue
Psychological Methods
Published
2014
Volume
19
Issue
2
Pages
211-229
ISSN
  • 1082-989X (ISSN-L)
  • 1939-1463
OpenAlex
W2122962297
Cited by
1,342
References
73
Citations by year
2026: 294 · 2025: 203 · 2024: 174 · 2023: 157 · 2022: 143 · 2021: 91 · 2020: 80 · 2019: 69 · 2018: 41 · 2017: 29 · 2016: 27 · 2015: 22 · 2014: 8
FWCI
22.07
Type
journal article
Language
en
Open access
closed
Locations
  • Psychological Methods (publishedVersion)
  • PubMed (publishedVersion)
Funders
Ministry of Education (R581-000-111-112)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Keywords
dependent effect sizes, structural equation modeling, multilevel meta-analysis, q-statistics, I2 statistic, cultural similarity, heterogeneity measures
MeSH terms
Humans, Models, Psychological, Research Design, Meta-Analysis as Topic, Models, Statistical, Multivariate Analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.