Do studies of statistical power have an effect on the power of studies?
Open accessThe DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index.
Abstract
The long-term impact of studies of statistical power is investigated using J. Cohen's (1962) pioneering work as an example. We argue that the impact is nil; the power of studies in the same journal that Cohen reviewed (now the Journal of Abnormal Psychology) has not increased over the past 24 years. In 1960 the median power (i.e., the probability that a significant result will be obtained if there is a true effect) was.46 for a medium size effect, whereas in 1984 it was only.37. The decline of power is a result of alpha-adjusted procedures. Low power seems to go unnoticed: only 2 out of 64 experi-ments mentioned power, and it was never estimated. Nonsignificance was generally interpreted as confirmation of the null hypothesis (if this was the research hypothesis), although the median power was as low as.25 in these cases. We discuss reasons for the ongoing neglect of power. Since J. Cohen's (1962) classical study on the statistical power of the studies published in the 1960 volume of the Journal of Abnormal and Social Psychology, a number of power analyses have been performed. These studies exhorted researchers to pay attention to the power of their tests rather than to focus exclu-sively on the level of significance. Historically, the concept of
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A little over two decades after Cohen’s original paper, two meta-analyses by Sedlmeier & Gigerenzer [66] and Rossi [67] examined a total of 25 reviews of statistical power in the psychological and social science literature between 1960 and 1984.”
From The natural selection of bad science (2016) · cites this paper as [66]
In the citing paper
“In fact, the average power of studies published in the 1984 volume of the Journal of Abnormal Psychology (a successor to the JASP) had dropped slightly compared with Cohen's (1962) results.”
From GPOWER: A general power analysis program (1996) · cites this paper as Sedlmeier and Gigerenzer (1989)
In the citing paper
“Sedlmeier and Gigerenzer (1989) investigated the impact of power analysis studies and textbooks on the power of recent psychological studies. Surprisingly, these authors found no significant increase in power values since 1962 when Cohen published his power study of the 1960 volume of the Journal of Abnormal & Social Psychology (JASP).”
From GPOWER: A general power analysis program (1996) · cites this paper as Sedlmeier and Gigerenzer (1989)
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Fundamental Statistics in Psychology and Education.
Smith, B. B., & Guilford, J. P. (1951) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2980908 · Cited by 3,455
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
Statistical Methods and Scientific Inference.
Bartlett, M. S., & Fisher, R. A. (1957) · Biometrika · doi:10.2307/2333276 · Cited by 1,278
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022
Handbook of clinical psychology
Wolman, B. B. (1965) · McGraw-Hill eBooks · Cited by 960
Cited by
Items 601–700 of 753
Precision Power Method for Selecting Regression Sample Sizes.
Brooks, G. P., & Barcikowski, R. S. (1995) · Cited by 3
Critical Differences in Bayesian and Non‐Bayesian Inference and why the Former is Better
Gill, J. (2010) · Wiley eBooks · doi:10.1002/9780470583333.ch5 · Cited by 4
Good, bad, and ugly questions about heredity
Nyborg, H. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0007802x · Cited by 3
On the relativity of quantitative genetic variance components
Goodnight, C. J. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077931 · Cited by 3
Contributions towards understanding and building sustainable sciencePreprint
Hartgerink, C. H. J. (2019) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/4wtpc · Cited by 3
The low statistical power of psychological research: Causes, consequences and potential remedies
Thorn, F. S. (2020) · Minerva Access (University of Melbourne) · Cited by 6
From theories to models to predictions: A Bayesian model comparison approachPreprint
Rouder, J. N., Haaf, J. M., & Aust, F. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/jt4th · Cited by 5
Bestimmung von Teststärke, Effektgröße und optimalem Stichprobenumfang
Döring, N. M. (2023) · Springer eBooks · doi:10.1007/978-3-662-64762-2_14 · Cited by 4
Liu, X. S. (2025) · Behaviormetrika · doi:10.1007/s41237-025-00283-4 · Cited by 2
Power Analysis Models and Methods: A Latent Variable Framework for Power Estimation and Analysis
Duncan, T. E., Duncan, S. C., & Li, F. (2007) · Springer eBooks · doi:10.1007/0-387-35408-5_31 · Cited by 3
The accuracy of four approximations to noncentralF
Bradley, D. R., Russell, R. L., & Reeve, C. P. (1998) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200682 · Cited by 2
La perception du prestige des occupations illicites par des délinquants
Charette, Y. (2014) · Canadian Journal of Criminology and Criminal Justice/La Revue canadienne de criminologie et de justice pénale · doi:10.3138/cjccj.2012.f04 · Cited by 2
Additivity, interaction, and developmental good sense
Chiszar, D., & Gollin, E. S. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077840 · Cited by 2
Kmetz, J. L. (2016) · International Journal of Business Administration · doi:10.5430/ijba.v7n3p101 · Cited by 2
Kim, D. S. (2015) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1510900305 · Cited by 8
Probing the Effects of Individual Components in Multiple Component Prevention Programs
West, S. G., Aiken, L. S., & Todd, M. W. (2002) · Springer eBooks · doi:10.1007/978-1-4615-0565-5_2 · Cited by 3
AIDS Counseling for Low-Risk Clients
Gigerenzer, G. (2002) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195153729.003.0005 · Cited by 2
Self-citationPuissance statistique des tests et date de publication : une corrélation trompeuse ?
Bonache, A. (2018) · Comptabilité - Contrôle - Audit · doi:10.3917/cca.241.0013 · Cited by 3
Issues in Designing and Conducting Randomized Human Service Trials
Solomon, P. (1997) · Journal of Social Service Research · doi:10.1300/j079v22n04_04 · Cited by 2
Holender, D. (2008) · Psychologie du Travail et des Organisations · doi:10.1016/s1420-2530(16)30216-3 · Cited by 2
Interaction and dependence prevent estimation
Dudley, R. M. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077918 · Cited by 2
An Alternative Method for Sample Size Determination in Substance Misuse Prevention Research
Yoo, S., & Spoth, R. L. (1993) · International Journal of the Addictions · doi:10.3109/10826089309056244 · Cited by 2
Monotone interactions: It's even simpler than that
Dawes, R. M. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077888 · Cited by 3
Methodological heterogeneity and the anachronistic status of ANOVA in psychology
Bullock, D. H. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077815 · Cited by 3
Statistical Power in Ergonomic Intervention Studies
Hurley, K. (2010) · UWSpace (University of Waterloo) · Cited by 2
King, K. M., & Jackson, K. M. (2019) · Addictive Behaviors · doi:10.1016/j.addbeh.2019.05.003 · Cited by 5
The Cultural Evolution of SciencePreprint
Wu, J., O’Connor, C., & Smaldino, P. E. (2022) · doi:10.31222/osf.io/2ekcr · Cited by 2
ANSWERING TWO CRITICISMS OF HYPOTHESIS TESTING
Leventhal, L. (1999) · Psychological Reports · doi:10.2466/pr0.85.5.3-18 · Cited by 2
Mimnaugh, K. J., Häkkinen, J. P., & LaValle, S. M. (2022) · Wiley eBooks · doi:10.1002/9781119865810.ch7 · Cited by 2
Buchberger, E., Ngo, C. T., Peikert, A., Brandmaier, A. M., & Werkle‐Bergner, M. (2022) · doi:10.31234/osf.io/gsdvz · Cited by 2
Sample Size Planning for Statistical Power and Accurate Estimation
Anderson, S. F., & Lamp, S. J. (2022) · Oxford University Press eBooks · doi:10.1093/obo/9780199828340-0296 · Cited by 4
Munk, T., Rui, N., Zhu, W., & Carlson, E. (2020) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2020.100969 · Cited by 1
Liang, X., Liu, N., Zhu, X., & He, Y. (2021) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2021.03.012 · Cited by 2
Psychology and Law, Meet Open Science
McAuliff, B. D., Fessinger, M. B., Perillo, A. D., & Perillo, J. T. (2023) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197649138.013.5 · Cited by 1
From Dynamic Lesions to Brain Imaging of Behavioral Lesions: Response to Commentaries
Raz, A. (2010) · Neuropsychoanalysis · doi:10.1080/15294145.2010.10773630 · Cited by 2
Vallejo, G., Cuesta, M., Fernández, P., Herrero, J., & Livacic-Rojas, P. E. (2007) · Redalyc (Universidad Autónoma del Estado de México) · Cited by 1
SPSS Programs for Addressing Two Forms of Power for Multiple Regression Coefficients
Aberson, C. L. (2015) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1430454000 · Cited by 1
Castro, M. C., & Martini, H. A. (2014) · Dialnet (Universidad de la Rioja) · Cited by 1
Henderson, N. D. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077955 · Cited by 1
JOB SECURITY AND JOB SATISFACTION AMONG GREEK FITNESS INSTRUCTORS
Koustelios, A. D. (2003) · Perceptual and Motor Skills · doi:10.2466/pms.97.5.192-194 · Cited by 1
In models we trust: preregistration, large samples, and replication may not suffice
Spieß, M., & Jordan, P. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1266447 · Cited by 1
Communicating Applied Social Psychology to Users
Posavac, E. J. (1992) · Social psychological applications to social issues · doi:10.1007/978-1-4899-2308-0_13 · Cited by 1
Paradigma subjacente ao estudo das correlações ilusórias na percepção de grupos
Garcia‐Marques, L., Santos, A. S., & de Almeida, F. (2013) · Laboratório de Psicologia · doi:10.14417/lp.668 · Cited by 1
Sandra, S., Lazaraton, A., Crookes, G. V., Davis, K. A., Brown, H. D., Kupetz, M., Hartman, C. L., Bachman, L. F., Bardovi‐Harlig, K., Lightbown, P. M., et al. (1994) · Cited by 1
Inferential misconceptions and replication crisis
Hirschauer, N., Mußhoff, O., Grüner, S., Frey, U. J., Theesfeld, I., & Wagner, P. (2022) · Epidemiology Biostatistics and Public Health · doi:10.2427/12066 · Cited by 2
Epistemic Closure in ScienceEpistemic Closure in ScienceConor Mayo-Wilson
Mayo‐Wilson, C. (2018) · The Philosophical Review · doi:10.1215/00318108-4230067 · Cited by 8
The Biomedical Writer: What You Need to Succeed in Academic Medicine
Douglas, Y., & Grant, M. B. (2018) · Cited by 1
Understanding Concepts in Estimating Sample Size in Hypothesis Testing Experiments
Verma, J. P. V., & Verma, P. (2020) · Springer eBooks · doi:10.1007/978-981-15-5204-5_4 · Cited by 3
de Bruin, B. (2021) · Synthese · doi:10.1007/s11229-021-03131-6 · Cited by 1
On the importance of modeling the invisible world of underlying effect sizes
Wilson, B. M., & Wixted, J. T. (2023) · Social Psychological Bulletin · doi:10.32872/spb.9981 · Cited by 2
“Previous work suggests that experiments in the field of psychology have about ~50% power to detect a medium effect size (e.g., Cohen, 1962; Fraley & Vazire, 2014; Maxwell, 2004; Sedlmeier & Gigerenzer, 1989; Szucs & Ioannidis, 2017).”
BackgroundAssessing Corporate Social Responsibility Education in Europe: Trends and Comparisons
Orlitzky, M., & Moon, J. (2010) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-61735-164-820251010 · Cited by 16
Algunas consideraciones metodológicas relevantes para la investigación aplicada
del Rosal, Á. B., & Sánchez-Bruno, A. (2004) · R E M A Revista electrónica de metodología aplicada · doi:10.17811/rema.9.1.2004.1-11 · Cited by 3
Sleep inertia: Is there a worst time to wake up?
Naitoh, P., Kelly, T. L., & Babkoff, H. (1992) · PsycEXTRA Dataset · doi:10.1037/e478782004-001 · Cited by 1
A note on the growth of the use of statistical tests in Perception & Psychophysics
Parker, S. (1990) · Bulletin of the Psychonomic Society · doi:10.3758/bf03334085 · Cited by 1
Good science, bad science: Questioning research practices in psychological research
Bakker, M. (2014) · UvA-DARE (University of Amsterdam) · Cited by 1
Enhancing subsidiary absorptive capacity
Colakoglu, S. S. (2009) · Rutgers University Community Repository (Rutgers University) · doi:10.7282/t3cf9q94 · Cited by 1
Lancaster, B. P. (2006) · OakTrust (Texas A&M University Libraries) · Cited by 5
Inheritance and the additive genetic model
Cheverud, J. M. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077839 · Cited by 1
Effects of correlation on interactions in the analysis of variance
Denenberg, V. H. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0007789x · Cited by 1
DTM: determinación del tamaño de la muestra en el entorno SPSS
Navarro, M. D. F., Llobell, J. P. I., & Pérez, J. F. G. (1996) · Psicologica · Cited by 1
Trischler, J. (2014) · Cross Connect (Southern Cross University) · Cited by 1
A Computational Guide to Power Analysis of Fixed Effects in Balanced Analysis of Variance Designs.
Dollins, A. B. (1995) · Defense Technical Information Center (DTIC) · doi:10.21236/ada300769 · Cited by 1
Pabico, C. G. (2019) · KU ScholarWorks (The University of Kansas) · Cited by 2
Correlational Equivalence Testing
Kraatz, M. (2007) · Cited by 1
Howell, D. C. (2014) · Wiley eBooks · doi:10.1002/9781118445112.stat06345 · Cited by 1
Weighted Histogram for a Meta-Analysis (WHaM): Descriptive graphics using R ShinyPreprint
Wu, F. Y., Ercan, S., Ock, J., & Oswald, F. L. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/q64sw · Cited by 1
Publication Bias in Psychology
Kühberger, A. (2023) · Oxford University Press eBooks · doi:10.1093/obo/9780199828340-0307 · Cited by 3
The State of our Toolbox: A Meta-analysis of Reliability Measurement Precision
Duniewicz, K. (2012) · FIU - Digital Commons (Florida International University) · doi:10.25148/etd.fi13040901 · Cited by 1
Charette, Y. (2010) · doi:10.71781/23575 · Cited by 1
Ziliak and McClosky's criticisms of significance tests: A damage assessmentPreprint
Mayer, T. F. (2012) · RePEc: Research Papers in Economics
Can confidence intervals save psychology? Part 1.
Etz, A. J. (2015) · The Winnower
Kmetz, J. L. (2003) · SSRN Electronic Journal · doi:10.2139/ssrn.334180
The Role of Statistical And Formal Techniques in Experimental Psychology
Lories, G. (2002) · Springer eBooks · doi:10.1007/978-1-4020-4676-6_3
Paul Meehl’s search for the optimal epistemology for the behavioral and social sciences
Schmidt, F. M. (2004) · Applied and Preventive Psychology · doi:10.1016/j.appsy.2004.02.011
Foisy, P. (1994) · Canadian Journal on Aging / La Revue canadienne du vieillissement · doi:10.1017/s0714980800006176
Christensen, B. (2003) · UC Research Repository (University of Canterbury) · doi:10.26021/1928
Multiple memory systems: contributions of human and animal serial reaction time tasks
Christie, M. A. (2001) · UC Research Repository (University of Canterbury) · doi:10.26021/8645
Institute for Educational Psychology
Weinberger, A., Ertl, B., Fischer, F., & Mandl, H. (2003)
Weisburd, D. L., & Mason, G. (2015)
Robinson, D. H., & Levin, J. R. (2001)
Subsidiary staffing and performance: the case of foreign multinationals in the U.S.
Colakoglu, S. S. (2007) · Rutgers University Community Repository (Rutgers University) · doi:10.7282/t3pc32rx
Flechsig's rule and quantitative behavior genetics
Lipp, H. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077992
Llobell, J. P. I., Navarro, M. D. F., & Pérez, J. F. G. (2004) · Metodología de las ciencias del comportamiento · Cited by 3
On the insensitivity of the ANOVA to interactions: Some suggested simulations
Cicchetti, D. V. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077852
Heredity and environment: How important is the interaction?
Kline, P. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077980
One statistician's perspective
Goodall, C. R. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0007792x
Through the ANOVA looking-glass: Distortions of heredity-environment interactions
Harrington, G. M. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077943
Variation in means and in ends
van Noordwijk, A. J. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00078055
Inherited quality control problems
Schönemann, P. H. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00078043
Alan, S., State, T., Onwuegbuzie, J., Bauer, C., Kaufman, N., Mathews, G. S., Barnette, J. J., Oxford, M. H., Onwuegbuzie, A. J., Lapp, I., et al. (2001)
An interaction effect is not a measurement
Bookstein, F. L. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077803
New Search | View Folder | Preferences | Help
Anna, T., Chiara, D., & Maria, R. (2006)
Smyth, D. (2008) · Cancer Nursing Practice · doi:10.7748/cnp.7.6.22.s11
Effectiveness of Early Childhood Programs on the Literacy Achievement of Kindergarten Children
Cox, L. (2016) · ScholarWorks (Walden University)
Statistical Consultation: What Should a Client Know?
Wu, Y.-W. B. (1994) · Journal of Nursing Education · doi:10.3928/0148-4834-19940901-08
Ideas in Exile: The Struggles of an Upright Man
Gigerenzer, G. (2002) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195153729.003.0003
Self-citationAC2011-266: INVESTIGATINGINFLUENCESOFTHEMESAPROGRAM UPON UNDERREPRESENTED STUDENTS
Hailey, C. E., Austin, C. Y., Denson, C. D., & Householder, D. L. (2011)
BRIEF REPORTS Power to Detect Homework Effects in Psychotherapy Outcome Research
Kazantzis, N. (2000)
Responding to a trust violation : the relative effectiveness of apology, denial, and reticence
Riddington, L. (2015) · UTAS Research Repository · doi:10.25959/23240153
Radulovic, A. B. (2017) · Aston Publications Explorer (Aston University) · doi:10.48780/publications.aston.ac.uk.00030856 · Cited by 1
Metadata
- Authors
- Sedlmeier, P., & Gigerenzer, G.
- Venue
- Psychological Bulletin
- Published
- 1989-03
- Volume
- 105
- Issue
- 2
- Pages
- 309-316
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2155449866
- Cited by
- 748
- References
- 55
- Citations by year
- 2026: 3 · 2025: 7 · 2024: 7 · 2023: 14 · 2022: 22 · 2021: 30 · 2020: 23 · 2019: 30 · 2018: 34 · 2017: 35 · 2016: 26 · 2015: 26 · 2014: 30 · 2013: 24 · 2012: 25
- FWCI
- 27.89
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- other-oa
- Locations
- Psychological Bulletin (publishedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- statistical power, power analysis, effect size, multiple comparisons, non-significant results, null hypothesis significance testing, history of statistics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.