The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
The power of statistical tests in meta-analysis
Abstract
Calculations of the power of statistical tests are important in planning research studies (including meta-analyses) and in interpreting situations in which a result has not proven to be statistically significant. The authors describe procedures to compute statistical power of fixed- and random-effects tests of the mean effect size, tests for heterogeneity (or variation) of effect size parameters across studies, and tests for contrasts among effect sizes of different studies. Examples are given using 2 published meta-analyses. The examples illustrate that statistical power is not always high in meta-analysis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The analysis suggests that at least seven studies are required to achieve 80% power at an α of .05.”
From Menstrual cycle effects on cognitive performance: A meta-analysis (2025) · cites this paper as [74]
In the citing paper
“Assuming the availability of 15 datasets, each with a mean within-study N of 80, and statistical significance set at 0.05, power to detect a small effect (r=0.10 [46]) using a fixed-effects model was 0.97.Assuming also high between-study heterogeneity, power to detect a small effect using random effects procedures was 0.80.”
From A Systematic Review and Meta-analysis of Applications of the Self-Report Habit Index to Nutrition and Physical Activity Behaviours (2011) · cites this paper as [45]
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
(2001) · Statistics for Psychologists · doi:10.4324/9781410605542-11 · Cited by 6,877
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Self-citationImpact of sexual abuse on children: A review and synthesis of recent empirical studies
Kendall-Tackett, K. A., Williams, L. M., & Finkelhor, D. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.113.1.164 · Cited by 2,537
Statistical Power Analysis for the Behavioral Sciences
(1977) · doi:10.1016/c2013-0-10517-x · Cited by 2,457
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
Analysis of Longitudinal Data.
Have, T. R. T., Diggle, P. J., Liang, K.-Y., & Zeger, S. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291352 · Cited by 1,171
Estimation of effect size from a series of independent experiments.
Hedges, L. V. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.2.490 · Cited by 1,062
Self-citationDesign Sensitivity: Statistical Power for Experimental Research.
Eliason, S. R., & Lipsey, M. W. (1991) · Contemporary Sociology · doi:10.2307/2072167 · Cited by 1,040
A meta-analytic examination of assumed properties of child sexual abuse using college samples.
Rind, B., Tromovitch, P., & Bauserman, R. L. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.1.22 · Cited by 988
How Many Subjects?: Statistical Power Analysis in Research
Kraemer, H. C., & Blasey, C. (2016) · SAGE Publications Ltd eBooks · doi:10.4135/9781483398761 · Cited by 910
Design Sensitivity: Statistical Power for Experimental Research.
Lachenbruch, P. A., & Lipsey, M. W. (1990) · Journal of the American Statistical Association · doi:10.2307/2289636 · Cited by 782
Development of a general solution to the problem of validity generalization.
Schmidt, F. L., & Hunter, J. E. (1977) · Journal of Applied Psychology · doi:10.1037/0021-9010.62.5.529 · Cited by 769
The Non-Central χ 2 - and F-Distribution and their Applications
PATNAIK, P. B. (1949) · Biometrika · doi:10.2307/2332542 · Cited by 602
What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.
Schmidt, F. L. (1992) · American Psychologist · doi:10.1037/0003-066x.47.10.1173 · Cited by 564 · cited 3×
“For example, Schmidt (1992) examined many meta-analyses in psychology and found that the ratio of between-studies variance to within-studies variance rarely exceeds one and that 0.”
BackgroundInfluentialThe long-term sequelae of childhood sexual abuse in women: a meta-analytic review
Neumann, D. A., Houskamp, B. M., Pollock, V. E., & Briere, J. (1996) · Child Maltreatment · doi:10.1177/1077559596001001002 · Cited by 512
Standard Errors and Sample Sizes for Two-Level Research
Snijders, T. A. B., & Bosker, R. J. (1993) · Journal of Educational Statistics · doi:10.3102/10769986018003237 · Cited by 487
Comparing effect sizes of independent studies.
Rosenthal, R., & Rubin, D. B. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.2.500 · Cited by 406
A random effects model for effect sizes.
Hedges, L. V. (1983) · Psychological Bulletin · doi:10.1037//0033-2909.93.2.388 · Cited by 399
Self-citationDesigning Experiments and Analysing Data.
Morrey, G. H., Maxwell, S. E., & Delaney, H. D. (1991) · Applied Statistics · doi:10.2307/2347533 · Cited by 366
Fitting Categorical Models to Effect Sizes from a Series of Experiments
Hedges, L. V. (1982) · Journal of Educational Statistics · doi:10.2307/1164961 · Cited by 296
Self-citationValidity generalization results for computer programmers.
Schmidt, F. L., Gast-Rosenberg, I., & Hunter, J. E. (1980) · Journal of Applied Psychology · doi:10.1037//0021-9010.65.6.643 · Cited by 166
Kraemer, H. C., Gardner, C., Brooks, J. O., & Yesavage, J. A. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.1.23 · Cited by 141
Research works printed but not linked: 12
- Bornstein, 2000, Power and Precision (Version 2.0).
- Cohen, 1977, Statistical power analysis for the behavioralsciences.
- 10.1037/0033-2909.92.2.490 · DOI · Paper page
- 10.1037/0033-2909.93.2.388 · doi:10.1037/0033-2909.93.2.388 · Paper page
- Hedges, 1985, Statistical models formeta-analysis.
- Kraemer, 1987, How many subjects? Statistical power analysis inresearch.
- Lipsey, 1990, Design sensitivity: Statistical power for experimentalresearch.
- 10.1037/0033-2909.124.1.22 · DOI · Paper page
- 10.1037/0033-2909.92.2.500 · doi:10.1037/0033-2909.92.2.500 · Paper page
- 10.1037/0021-9010.65.6.643 · doi:10.1037/0021-9010.65.6.643 · Paper page
- 10.2307/1165134 · doi:10.2307/1165134 · Paper page
- 1999, SPSS Base 10.0 applications guide.
Cited by
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793
“However, to the extent that the standard error is high because of large between-study variance, we can reduce it (and increase power) only by increasing the number of studies [2].”
BackgroundSelf-citationSiddaway, A. P., Wood, A. M., & Hedges, L. V. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-102803 · Cited by 2,550
“Type II errors can still be a problem (Cohn & Becker 2003, Hedges & Pigott 2001).”
BackgroundSelf-citationEagly, A. H., Johannesen-Schmidt, M. C., & van Engen, M. L. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.4.569 · Cited by 2,547
“…and its subscales were negative (i.e., female direction), we confined our additional analyses to the 44 study-level transformational effect sizes, for which the sample size was largest and thus provided adequate statistical power for testing moderator variables (see Hedges & Pigott, 2001).”
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
A meta-analytic review of benefit finding and growth.
Helgeson, V. S., Reynolds, K. A., & Tomich, P. L. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.5.797 · Cited by 1,864
“Ideally, one would conduct a power analysis prior to conducting the meta-analysis and, in fact, Hedges and Pigott (2001) advised against calculating power after the fact.”
Method
Metadata
- Authors
- Hedges, L. V., & Pigott, T. D.
- Affiliations
- University of Chicago (US)
- ORCID
- Hedges, Larry V.
- Venue
- Psychological Methods
- Published
- 2001
- Volume
- 6
- Issue
- 3
- Pages
- 203-217
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2001107817
- Cited by
- 716
- References
- 26
- Citations by year
- 2026: 26 · 2025: 28 · 2024: 30 · 2023: 30 · 2022: 37 · 2021: 42 · 2020: 36 · 2019: 32 · 2018: 37 · 2017: 56 · 2016: 50 · 2015: 47 · 2014: 21 · 2013: 30 · 2012: 31
- FWCI
- 8.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- statistical power, meta-analysis, fixed effects model, random effects models, effect size heterogeneity, non-significant results, learning planning
- MeSH terms
- Humans, Models, Psychological, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.