The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
The power of statistical tests in meta-analysis
Abstract
Calculations of the power of statistical tests are important in planning research studies (including meta-analyses) and in interpreting situations in which a result has not proven to be statistically significant. The authors describe procedures to compute statistical power of fixed- and random-effects tests of the mean effect size, tests for heterogeneity (or variation) of effect size parameters across studies, and tests for contrasts among effect sizes of different studies. Examples are given using 2 published meta-analyses. The examples illustrate that statistical power is not always high in meta-analysis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The analysis suggests that at least seven studies are required to achieve 80% power at an α of .05.”
From Menstrual cycle effects on cognitive performance: A meta-analysis (2025) · cites this paper as [74]
In the citing paper
“Assuming the availability of 15 datasets, each with a mean within-study N of 80, and statistical significance set at 0.05, power to detect a small effect (r=0.10 [46]) using a fixed-effects model was 0.97.Assuming also high between-study heterogeneity, power to detect a small effect using random effects procedures was 0.80.”
From A Systematic Review and Meta-analysis of Applications of the Self-Report Habit Index to Nutrition and Physical Activity Behaviours (2011) · cites this paper as [45]
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
(2001) · Statistics for Psychologists · doi:10.4324/9781410605542-11 · Cited by 6,877
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Self-citationImpact of sexual abuse on children: A review and synthesis of recent empirical studies
Kendall-Tackett, K. A., Williams, L. M., & Finkelhor, D. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.113.1.164 · Cited by 2,537
Statistical Power Analysis for the Behavioral Sciences
(1977) · doi:10.1016/c2013-0-10517-x · Cited by 2,457
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
Analysis of Longitudinal Data.
Have, T. R. T., Diggle, P. J., Liang, K.-Y., & Zeger, S. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291352 · Cited by 1,171
Research works printed but not linked: 12
- Bornstein, 2000, Power and Precision (Version 2.0).
- Cohen, 1977, Statistical power analysis for the behavioralsciences.
- 10.1037/0033-2909.92.2.490 · DOI · Paper page
- 10.1037/0033-2909.93.2.388 · doi:10.1037/0033-2909.93.2.388 · Paper page
- Hedges, 1985, Statistical models formeta-analysis.
- Kraemer, 1987, How many subjects? Statistical power analysis inresearch.
- Lipsey, 1990, Design sensitivity: Statistical power for experimentalresearch.
- 10.1037/0033-2909.124.1.22 · DOI · Paper page
- 10.1037/0033-2909.92.2.500 · doi:10.1037/0033-2909.92.2.500 · Paper page
- 10.1037/0021-9010.65.6.643 · doi:10.1037/0021-9010.65.6.643 · Paper page
- 10.2307/1165134 · doi:10.2307/1165134 · Paper page
- 1999, SPSS Base 10.0 applications guide.
Cited by
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793
“However, to the extent that the standard error is high because of large between-study variance, we can reduce it (and increase power) only by increasing the number of studies [2].”
BackgroundSelf-citationSiddaway, A. P., Wood, A. M., & Hedges, L. V. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-102803 · Cited by 2,550
“Type II errors can still be a problem (Cohn & Becker 2003, Hedges & Pigott 2001).”
BackgroundSelf-citationEagly, A. H., Johannesen-Schmidt, M. C., & van Engen, M. L. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.4.569 · Cited by 2,547
“…and its subscales were negative (i.e., female direction), we confined our additional analyses to the 44 study-level transformational effect sizes, for which the sample size was largest and thus provided adequate statistical power for testing moderator variables (see Hedges & Pigott, 2001).”
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
A meta-analytic review of benefit finding and growth.
Helgeson, V. S., Reynolds, K. A., & Tomich, P. L. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.5.797 · Cited by 1,864
“Ideally, one would conduct a power analysis prior to conducting the meta-analysis and, in fact, Hedges and Pigott (2001) advised against calculating power after the fact.”
Method
Metadata
- Authors
- Hedges, L. V., & Pigott, T. D.
- Affiliations
- University of Chicago (US)
- ORCID
- Hedges, Larry V.
- Venue
- Psychological Methods
- Published
- 2001
- Volume
- 6
- Issue
- 3
- Pages
- 203-217
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2001107817
- Cited by
- 716
- References
- 26
- Citations by year
- 2026: 26 · 2025: 28 · 2024: 30 · 2023: 30 · 2022: 37 · 2021: 42 · 2020: 36 · 2019: 32 · 2018: 37 · 2017: 56 · 2016: 50 · 2015: 47 · 2014: 21 · 2013: 30 · 2012: 31
- FWCI
- 8.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- statistical power, meta-analysis, fixed effects model, random effects models, effect size heterogeneity, non-significant results, learning planning
- MeSH terms
- Humans, Models, Psychological, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The power of statistical tests in meta-analysis. https://app.cochat.ai/papers/10.1037/1082-989x.6.3.203
- The paper
- Hedges, L. V., & Pigott, T. D. (2001). The power of statistical tests in meta-analysis. Psychological Methods. https://doi.org/10.1037/1082-989x.6.3.203
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.