CoChat

Do studies of statistical power have an effect on the power of studies?

Open access
Sedlmeier, Peter, Gigerenzer, Gerd · 1989 · Psychological Bulletin

The DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index.

Abstract

The long-term impact of studies of statistical power is investigated using J. Cohen's (1962) pioneering work as an example. We argue that the impact is nil; the power of studies in the same journal that Cohen reviewed (now the Journal of Abnormal Psychology) has not increased over the past 24 years. In 1960 the median power (i.e., the probability that a significant result will be obtained if there is a true effect) was.46 for a medium size effect, whereas in 1984 it was only.37. The decline of power is a result of alpha-adjusted procedures. Low power seems to go unnoticed: only 2 out of 64 experi-ments mentioned power, and it was never estimated. Nonsignificance was generally interpreted as confirmation of the null hypothesis (if this was the research hypothesis), although the median power was as low as.25 in these cases. We discuss reasons for the ongoing neglect of power. Since J. Cohen's (1962) classical study on the statistical power of the studies published in the 1960 volume of the Journal of Abnormal and Social Psychology, a number of power analyses have been performed. These studies exhorted researchers to pay attention to the power of their tests rather than to focus exclu-sively on the level of significance. Historically, the concept of

Overview

Integrity signals

Registry

Crossref · 10.1037/0033-2909.105.2.309

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Cited by

  • A power primer.

    Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771

  • Statistical power analysis

    Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870

  • GPOWER: A general power analysis program

    Erdfelder, E., Faul, F., & Buchner, A. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203630 · Cited by 4,864

    “According to Sedlmeier and Gigerenzer (1989), a major reason for this confusion is the "hybridization" of the Fisherian and the Neyman-Pearson theories ofstatistical inference in the psychological literature (see also Giger enzer, 1993).”
    Background
  • Issues and opinion on structural equation modeling

    Chin, W. W. (1998) · Journal of the Association for Information Systems · doi:10.5555/290231.290235 · Cited by 4,577

  • The earth is round (p < .05).

    Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003

    “He reminded researchers that, given the fact that the nil hypothesis is always false, the rate of Type I errors is 0%, not 5%, and that only Type II errors can be made, which run typically at about 50% (Cohen, 1962; Sedlmeier & Gigerenzer, 1989).”
    Background

See all 753

Metadata

Authors
Sedlmeier, P., & Gigerenzer, G.
Venue
Psychological Bulletin
Published
1989-03
Volume
105
Issue
2
Pages
309-316
ISSN
  • 0033-2909 (ISSN-L)
  • 1939-1455
OpenAlex
W2155449866
Cited by
748
References
55
Citations by year
2026: 3 · 2025: 7 · 2024: 7 · 2023: 14 · 2022: 22 · 2021: 30 · 2020: 23 · 2019: 30 · 2018: 34 · 2017: 35 · 2016: 26 · 2015: 26 · 2014: 30 · 2013: 24 · 2012: 25
FWCI
27.89
Type
journal article
Language
en
Open access
Licence
other-oa
Locations
  • Psychological Bulletin (publishedVersion)
  • Max Planck Digital Library (submittedVersion, other-oa)
  • MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
Keywords
statistical power, power analysis, effect size, multiple comparisons, non-significant results, null hypothesis significance testing, history of statistics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.