Do studies of statistical power have an effect on the power of studies?
Open accessThe DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index.
Abstract
The long-term impact of studies of statistical power is investigated using J. Cohen's (1962) pioneering work as an example. We argue that the impact is nil; the power of studies in the same journal that Cohen reviewed (now the Journal of Abnormal Psychology) has not increased over the past 24 years. In 1960 the median power (i.e., the probability that a significant result will be obtained if there is a true effect) was.46 for a medium size effect, whereas in 1984 it was only.37. The decline of power is a result of alpha-adjusted procedures. Low power seems to go unnoticed: only 2 out of 64 experi-ments mentioned power, and it was never estimated. Nonsignificance was generally interpreted as confirmation of the null hypothesis (if this was the research hypothesis), although the median power was as low as.25 in these cases. We discuss reasons for the ongoing neglect of power. Since J. Cohen's (1962) classical study on the statistical power of the studies published in the 1960 volume of the Journal of Abnormal and Social Psychology, a number of power analyses have been performed. These studies exhorted researchers to pay attention to the power of their tests rather than to focus exclu-sively on the level of significance. Historically, the concept of
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A little over two decades after Cohen’s original paper, two meta-analyses by Sedlmeier & Gigerenzer [66] and Rossi [67] examined a total of 25 reviews of statistical power in the psychological and social science literature between 1960 and 1984.”
From The natural selection of bad science (2016) · cites this paper as [66]
In the citing paper
“In fact, the average power of studies published in the 1984 volume of the Journal of Abnormal Psychology (a successor to the JASP) had dropped slightly compared with Cohen's (1962) results.”
From GPOWER: A general power analysis program (1996) · cites this paper as Sedlmeier and Gigerenzer (1989)
In the citing paper
“Sedlmeier and Gigerenzer (1989) investigated the impact of power analysis studies and textbooks on the power of recent psychological studies. Surprisingly, these authors found no significant increase in power values since 1962 when Cohen published his power study of the 1960 volume of the Journal of Abnormal & Social Psychology (JASP).”
From GPOWER: A general power analysis program (1996) · cites this paper as Sedlmeier and Gigerenzer (1989)
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Fundamental Statistics in Psychology and Education.
Smith, B. B., & Guilford, J. P. (1951) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2980908 · Cited by 3,455
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
Statistical Methods and Scientific Inference.
Bartlett, M. S., & Fisher, R. A. (1957) · Biometrika · doi:10.2307/2333276 · Cited by 1,278
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022
Handbook of clinical psychology
Wolman, B. B. (1965) · McGraw-Hill eBooks · Cited by 960
Cited by
Items 401–500 of 753
Implicit Bias in Predictive Data Profiling Within Recruitments
Persson, A. (2016) · IFIP advances in information and communication technology · doi:10.1007/978-3-319-55783-0_15 · Cited by 38
A Path to Greater Credibility: Large-Scale Collaborative Education Research
Makel, M. C., Smith, K. N., McBee, M. T., Peters, S. J., & Miller, E. M. (2019) · AERA Open · doi:10.1177/2332858419891963 · Cited by 31
“However, small sample sizes mean that most studies performed under this model are seriously underpowered to detect anything but strong effects (Chase & Chase, 1976; Sedlmeier & Gigerenzer, 1989; see also Schochet, 2008) and can produce only weak evidence.”
BackgroundAverage Power: A Cautionary Note
McShane, B. B., Böckenholt, U., & Hansen, K. T. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920902370 · Cited by 25
“Instead, it relates to efforts in the history of science to catalogue the power of prior studies (Cohen, 1962; Rossi, 1990; Sedlmeier & Gigerenzer, 1989).”
BackgroundDeveloping effective environmental indicators––does a new dog need old tricks?
Nicholson, M., & Fryer, R. J. (2002) · Marine Pollution Bulletin · doi:10.1016/s0025-326x(02)00123-6 · Cited by 20
Domain-Specific Reasoning: Social Contracts and Cheating Detection
Gigerenzer, G. (2002) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195153729.003.0010 · Cited by 20
Self-citationStatistical Power and the Rorschach: 1975-1991
Acklin, M. W., McDowell, C. J., & Orndoff, S. (1992) · Journal of Personality Assessment · doi:10.1207/s15327752jpa5902_12 · Cited by 20
Gandhi, L., Manning, B. S., & Duckworth, A. L. (2024) · Current Directions in Psychological Science · doi:10.1177/09637214241268222 · Cited by 26
Statistical Conclusion Validity for Organizational Science Researchers: A Review
Austin, J. T., Boyle, K. A., & Lualhati, J. C. (1998) · Organizational Research Methods · doi:10.1177/109442819812002 · Cited by 34
Researcher Degrees of Freedom in the Psychology of Religion
Charles, S. J., Bartlett, J. E., Messick, K. J., Coleman, T. J., III, & Uzdavines, A. (2019) · International Journal for the Psychology of Religion · doi:10.1080/10508619.2019.1660573 · Cited by 21
“This review suggests that research within the psychology of religion is still conducted without statistical power in mind, despite repeated warnings of the implications of underpowered studies (Cohen, 1962; Sedlmeier & Gigerenzer, 1989; Button et al., 2013).”
BackgroundGuo, J., & Luh, W. (2008) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711007x267289 · Cited by 19
Cumulating Psychology: An Appreciation of Donald T. Campbell
Rosenthal, R. (1991) · Psychological Science · doi:10.1111/j.1467-9280.1991.tb00138.x · Cited by 20
Plonsky, L. (2011) · ProQuest LLC eBooks · Cited by 19
Machery, É. (2019) · Review of Philosophy and Psychology · doi:10.1007/s13164-019-00440-1 · Cited by 22
Null Hypothesis Significance Testing Does Not Show Equivalence
Barchard, K. A. (2015) · Analyses of Social Issues and Public Policy · doi:10.1111/asap.12095 · Cited by 18
Consideraciones generales en torno a los estudios de potencia
Bono, R., & Gras, J. A. (1995) · Digitum: Institutional Repository of the University of Murcia (University of Murcia) · Cited by 18
Some cautions regarding statistical power in split-plot designs
Bradley, D. R., & Russell, R. L. (1998) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200681 · Cited by 18
A Multiple Mediator Model: Power Analysis Based on Monte Carlo Simulation
Ma, Z., & Zeng, W.-N. (2014) · American Journal of Applied Psychology · doi:10.11648/j.ajap.20140303.15 · Cited by 23
Inducing Health Care Voluntarism Through Sequential Requests: Perceptions of Effort and Novelty
Cantrill, J. G. (1991) · Health Communication · doi:10.1207/s15327027hc0301_4 · Cited by 18
Roisman, G. I. (2021) · Child Development · doi:10.1111/cdev.13538 · Cited by 18
Should Psychology Journals Adopt Specialized Statistical Review?
Hardwicke, T. E., Frank, M. C., Vazire, S., & Goodman, S. N. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919858428 · Cited by 23
“Moreover, there has generally been no increase in power over time despite repeated calls to address the issue (Button et al., 2013; Cohen, 1962; Sedlmeier & Gigerenzer, 1989; but see Sassenberg & Ditrich, 2019).”
BackgroundInfluentialOlsen, J., Mosen, J., Voracek, M., & Kirchler, E. M. (2019) · Royal Society Open Science · doi:10.1098/rsos.190738 · Cited by 20
“One rather concerning similarity is the neglect of power considerations which has repeatedly been stressed in academic papers [11,50,58] and also holds for student theses.”
BackgroundA Bayes Factor for Replications of ANOVA Results
Harms, C. (2019) · The American Statistician · doi:10.1080/00031305.2018.1518787 · Cited by 24
“Since power is notoriously low in psychological science (Sedlmeier and Gigerenzer 1989; Button et al. 2013; Szucs and Ioannidis 2017), confidence intervals tend to be generally wide for original studies from the published literature (Morey and Lakens 2016).”
BackgroundBeyond the Basics: Effective Reading Programs for the Upper Elementary Grades.
Slavin, R. E., Lake, C., Cheung, A., & Davis, S. (2009) · Cited by 19
Lies, Damned Lies and More Statistics: The Neglected Issue of Multiplicity in Accounting Research
Lindsay, R. M. (1997) · Accounting and Business Research · doi:10.1080/00014788.1997.9729548 · Cited by 19
Effect Sizes and F Ratios < 1.0
Voelkle, M. C., Ackerman, P. L., & Wittmann, W. W. (2007) · Methodology · doi:10.1027/1614-2241.3.1.35 · Cited by 20
THE REPRESENTATION OF LEXICAL CONCEPTS: A PSYCHOLINGUISTIC INQUIRY
de Almeida, R. G. (1999) · Cited by 16
Chapter 9. Watershed Restoration— Adaptive Decision Making in the Face of Uncertainty
Anderson, J. L., Hilborn, R. W., Lackey, R. T., & Ludwig, D. (2003) · Cited by 20
Interpreting and Reporting Results
Hallahan, M., & Rosenthal, R. (2000) · Elsevier eBooks · doi:10.1016/b978-012691360-6/50006-9 · Cited by 19
Ng, Y.-L. (2022) · Behaviour and Information Technology · doi:10.1080/0144929x.2022.2111273 · Cited by 17
“As suggested by Cohen (1992), assuming a medium e ff ect size can achieve su ffi cient power in social science research (Cooper and Findley 1982; Sedlmeier and Gigerenzer 1989).”
BackgroundXuan, Q., Cheung, A., & Jinhong, L. (2022) · Language Teaching Research · doi:10.1177/13621688221131127 · Cited by 20
“The effect sizes for pre-tests were subtracted from the effect sizes for post-tests (Lipsey & Wilson, 2001; Sedlmeier & Gigerenzer, 1989).”
Hayes, T., & McArdle, J. J. (2017) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2017.05.006 · Cited by 17
Optimizing Research Output: How Can Psychological Research Methods Be Improved?
Miller, J. O., & Ulrich, R. (2021) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-094927 · Cited by 21
Conducting Research on the Internet
Maniaci, M. R., & Rogge, R. D. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9780511996481.021 · Cited by 23
Insights into Criteria for Statistical Significance from Signal Detection Analysis
Witt, J. K. (2019) · Meta-Psychology · doi:10.15626/mp.2018.871 · Cited by 18
“Many studies are underpowered (e.g., Etz & Vandekerckhove, 2016; Fraley & Vazire, 2014; Ioannidis, 2005; Sedlmeier & Gigerenzer, 1989).”
Statistical power in complex experimental designs
Bradley, D. R., Russell, R. L., & Reeve, C. P. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204790 · Cited by 16
Statistical power: An historical introduction
Descôteaux, J. (2007) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.03.2.p028 · Cited by 20
Conducting and Reporting Integrative Research Reviews: Accumulating Scientific Knowledge
Ellis, M. V. (1991) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.1991.tb01203.x · Cited by 16
Using Power Analysis to Evaluate and Improve Research
Murphy, K. R. (2004) · Wiley eBooks · doi:10.1002/9780470756669.ch6 · Cited by 22
Addressing Validity Concerns in Clinical Psychology Research
Finger, M. S., & Rand, K. L. (2003) · doi:10.1002/9780470756980.ch2 · Cited by 16
Kirk, R. E. (2015) · Wiley eBooks · doi:10.1002/9781118445112.stat06242.pub2 · Cited by 17
Maximizing the Reproducibility of Your ResearchPreprint
Bosco, F. A., Carp, J., Field, J. G., IJzerman, H. R., Lewis, M., Munafo, M. R., Nosek, B. A., Prenoveau, J. M., Spies, J. R., & Giner‐Sorolla, R. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/k9mn3_v1 · Cited by 17
Selective and (mis)leading economics journals: Meta‐research evidence
Askarov, Z., Doucouliagos, A., Doucouliagos, H., & Stanley, T. D. (2023) · Journal of Economic Surveys · doi:10.1111/joes.12598 · Cited by 24
Predictors of Citation Rate in Psychology: Inconclusive Influence of Effect and Sample Size
Hanel, P. H. P., & Haase, J. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01160 · Cited by 19
“The neglect of effect and sample size while deciding what to cite is in line with numerous findings showing that psychological studies are underpowered, i.e., the sample size is too small for the effect they wish to detect (Sedlmeier and Gigerenzer, 1989; Fraley and Vazire, 2014).”
BackgroundResultMachery, É. (2021) · European Journal for Philosophy of Science · doi:10.1007/s13194-021-00354-9 · Cited by 24
Inconsistency of findings due to low power: A structural MRI study of bilingualism
Munson, B. A., & Hernández, A. E. (2019) · Brain and Language · doi:10.1016/j.bandl.2019.104642 · Cited by 16
Vallejo, G., Izquierdo, M. C., Fernández, P., & Díez, F. J. H. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164404273943 · Cited by 15
Human performance and physiology: A statistical power analysis of ELF electromagnetic field research
Whittington, C. J., & Podd, J. (1996) · Bioelectromagnetics · doi:10.1002/(sici)1521-186x(1996)17:4<274::aid-bem3>3.0.co;2-0 · Cited by 15
Who believes estimating heritability as an end in itself?
McGuffin, P., & Katz, R. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00078018 · Cited by 15
MINSIZE: A Computer Program for Obtaining Minimum Sample Size as an Indicator of Effect Size
Morse, D. T. (1998) · Educational and Psychological Measurement · doi:10.1177/0013164498058001012 · Cited by 15
Don't kill the ANOVA messenger for bearing bad interaction news
Detterman, D. K. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077906 · Cited by 16
Research Methods for Education With Technology: Four Concerns, Examples, and Recommendations
Wright, D. B. (2019) · Frontiers in Education · doi:10.3389/feduc.2019.00147 · Cited by 17
Effective Programs for Elementary Science: A Best-Evidence Synthesis.
Slavin, R. E., Lake, C., Hanley, P., & Thurston, A. (2012) · Cited by 23
Powering Reproducible Research
Button, K. S., & Munafo, M. R. (2017) · Wiley eBooks · doi:10.1002/9781119095910.ch2 · Cited by 20
Schmidt, F. L., & Hunter, J. E. (2003) · Wiley eBooks · doi:10.1002/0471264385.wei0221 · Cited by 20
The Methodological War of the "Hardheads" versus the "Softheads"
Rodgers, R. C., & Hunter, J. E. (1996) · The Journal of Applied Behavioral Science · doi:10.1177/0021886396322006 · Cited by 13
Institutionalized Dualism: Statistical Significance Testing as Myth and Ceremony
Orlitzky, M. (2009) · Journal of Management Control · doi:10.1007/s00187-011-0126-7 · Cited by 13
Diagnosing Estimate Distortion Due to Significance Testing in Literature on Detection of Deception
Bradley, M. T., & Stoica, G. (2004) · Perceptual and Motor Skills · doi:10.2466/pms.98.3.827-839 · Cited by 16
Comparing Sample Size Requirements for Significance Tests and Confidence Intervals
Liu, X. S. (2013) · Counseling Outcome Research and Evaluation · doi:10.1177/2150137812472194 · Cited by 13
Diseños cuasi-experimentales y longitudinales
Bono, R. (2012) · Cited by 69
Horwitz, S. K., & Horwitz, I. B. (2012) · Human Resource Management · doi:10.1002/hrm.20465 · Cited by 13
Waldman, I. D., & Lilienfeld, S. O. (2015) · Psychometrika · doi:10.1007/s11336-015-9447-z · Cited by 14
Conducting tests of hypotheses: The need for an adequate sample size
Asraf, R. M., & Brewer, J. K. (2004) · The Australian Educational Researcher · doi:10.1007/bf03216806 · Cited by 22
Methods of Determining Sample Sizes
Ryan, T. P. (2013) · Wiley series in probability and statistics · doi:10.1002/9781118439241.ch2 · Cited by 20
Statistical Power of within and Between-Subjects Designs in Economic ExperimentsPreprint
Bellemare, C., Bissonnette, L., & Kröger, S. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2517886 · Cited by 13
Maximizing the Reproducibility of Your Research
Open Science Collaboration (2017) · Wiley eBooks · doi:10.1002/9781119095910.ch1 · Cited by 17
Buchberger, E. S., Ngo, C. T., Peikert, A., Brandmaier, A. M., & Werkle‐Bergner, M. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02396-2 · Cited by 25
“However, also more specialized cognitive abilities such as executive functions (Hedden & Sedlmeier & Gigerenzer, 1989; Vankov, Bowers, & Munafó, 2014).”
BackgroundAnticipation and Computation: Is Anticipatory Computing Possible?
Nadin, M. (2015) · Cognitive systems monographs · doi:10.1007/978-3-319-22599-9_18 · Cited by 16
Sample Size Requirements for Accurate Estimation of Squared Semi-Partial Correlation Coefficients
Algina, J. J., Moulder, B. C., & Moser, B. K. (2002) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3701_02 · Cited by 12
Falagas, M. E., Kouranos, V., Michalopoulos, A. S., Rodopoulou, S., Athanasoulia, A. P., & Karageorgopoulos, D. E. (2010) · Clinical Infectious Diseases · doi:10.1086/649929 · Cited by 12
Empirical Sample Size Guidelines for Use of Latent Difference Score Mediation
Simone, M., & Lockhart, G. (2018) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2018.1540934 · Cited by 14
Overland, C. T. (2014) · Bulletin of the Council for Research in Music Education · doi:10.5406/bulcouresmusedu.201.0043 · Cited by 14
How to Fool Yourself With Experiments in Testing Theories in Psychological Research.
Wittmann, W. W., & Klumb, P. L. (2006) · Strengthening research methodology: Psychological measurement and evaluation. · doi:10.1037/11384-010 · Cited by 6
Kenett, R. S., & Rubinstein, A. (2021) · Scientometrics · doi:10.1007/s11192-021-03914-1 · Cited by 11
Pruebas de significación y magnitud del efecto:Reflexiones y propuestas
Valera, A. C., & Sánchez‐Meca, J. (1997) · Anales de Psicología · Cited by 23
Karing, C., & Beelmann, A. (2016) · Zeitschrift für Gesundheitspsychologie · doi:10.1026/0943-8149/a000159 · Cited by 11
Die Interpretation des p -Wertes – Grundsätzliche Missverständnisse
Hirschauer, N., Mußhoff, O., Grüner, S., Frey, U. J., Theesfeld, I., & Wagner, P. (2016) · Jahrbücher für Nationalökonomie und Statistik · doi:10.1515/jbnst-2015-1030 · Cited by 21
Osborne, J. W., Christianson, W. R., & Gunter, J. S. (2001) · Cited by 11
A Note on the Noncentrality Parameter and Effect Size Estimates for the F Test in ANOVA
Liu, X., & Raudenbush, S. W. (2004) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986029002251 · Cited by 11
Psychology’s Replication Crisis and Clinical Psychological SciencePreprint
Tackett, J. L., Brandes, C. M., King, K. M., & Markon, K. E. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kc8xt · Cited by 16
Clayson, P. E., Carbine, K. A., Shuford, J. L., McDonald, J. B., & Larson, M. J. (2025) · Cortex · doi:10.1016/j.cortex.2025.02.008 · Cited by 13
Mudge, J. F. (2013) · New Phytologist · doi:10.1111/nph.12410 · Cited by 9
Davis, K. E., & Maiden, R. (2021) · Studies in Social Science Research · doi:10.22158/sssr.v2n2p1 · Cited by 11
When Do Children Lose the Language Instinct? A Critical Review of the Critical Periods Literature
Hartshorne, J. K. (2021) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-032521-053234 · Cited by 14
Character Trouble: Undisciplined Essays on Moral Agency and Personality
Doris, J. M. (2021) · doi:10.1093/oso/9780198719601.001.0001 · Cited by 18
An Interactionist Approach to Cognitive Debiasing
Bland, S. (2020) · Episteme · doi:10.1017/epi.2020.9 · Cited by 14
“Worse still, the average and median statistical power of psychological studies over the last 50 years has consistently been found to be below 50% (Cohen 1962; Sedlmeier and Gigerenzer 1989; Szucs and Ioannidis 2017).”
BackgroundA Consonance Criterion for Choosing Sample Size
Nicewander, W. A., & Price, J. M. (1997) · The American Statistician · doi:10.1080/00031305.1997.10474404 · Cited by 10
Extracting a maximum of useful information from statistical research data
Sohlberg, S., & Andersson, G. (2005) · Scandinavian Journal of Psychology · doi:10.1111/j.1467-9450.2005.00436.x · Cited by 11
Sex and Power: Why Sex/Gender Neuroscience Should Motivate Statistical Reform
Fine, C., & Fidler, F. M. (2014) · Springer eBooks · doi:10.1007/978-94-007-4707-4_156 · Cited by 14
A Bayes Factor for Replications of ANOVA ResultsPreprint
Harms, C. (2018) · OSF Preprints (OSF Preprints) · Cited by 9
Wiliam, D. (2022) · Educational Research and Evaluation · doi:10.1080/13803611.2021.2022309 · Cited by 15
“https://doi.org/10.1080/13803611.2021.2022309 These are serious problems in any field (see, e.g., Goldacre et al., 2019) but are exacerbated in the social sciences, where the statistical power of reported studies is generally low (Sedlmeier & Gigerenzer, 1989).”
BackgroundInfluentialA Systematic Review on the Evolution of Power Analysis Practices in Psychological Research
Vankelecom, L., Schacht, O., Laroy, N., Loeys, T., & Moerkerke, B. (2025) · Psychologica Belgica · doi:10.5334/pb.1318 · Cited by 19
On the Use and Misuses of Preregistration: A Reply to Klonsky (2024)
Vize, C. E., Phillips, N. L., Miller, J. D., & Lynam, D. R. (2024) · Assessment · doi:10.1177/10731911241275256 · Cited by 15
“…does provide room for optimism—the reform movement appears to be far more responsive to evidence of problems compared to how the field responded to evidence of other more impact-ful issues (e.g., concerns about insufficient statistical power went unheeded for decades; Sedlmeier & Gigerenzer, 1989).”
Statistical power in international business research: Study levels and data types
Zhan, G. (2012) · International Business Review · doi:10.1016/j.ibusrev.2012.10.004 · Cited by 9
Simulations on spreadsheets for complex concepts: teaching statistical power as an example
Black, T. R. (1999) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/002073999287752 · Cited by 9
What If We Were Texas Sharpshooters? Predictor Reporting Bias in Regression Analysis
Biemann, T. (2013) · Organizational Research Methods · doi:10.1177/1094428113485135 · Cited by 9
A Plea for Preregistration in Personality Disorders Research: The Case of Psychopathy
Verschuère, B., Yasrebi, F., van Zelm, I., & Lilienfeld, S. O. (2019) · Journal of Personality Disorders · doi:10.1521/pedi_2019_33_426 · Cited by 11
“For at least five decades, most psychological studies have been known to be substantially underpowered (Cohen, 1962; Sedlmeier & Gigerenzer, 1989).”
BackgroundPavlova, M., Graham, S. A., Peterson, C., Lund, T., Kennedy, M., Nania, C. G., & Noel, M. E. (2020) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsaa107 · Cited by 12
Intuitive Judgments about Sample Size
Sedlmeier, P. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511614576.003 · Cited by 9
Self-citationRaz, A., & Wolfson, J. B. (2010) · Neuropsychoanalysis · doi:10.1080/15294145.2010.10773621 · Cited by 11
Schweizer, G., & Furley, P. (2016) · Zeitschrift für Sportpsychologie · doi:10.1026/1612-5010/a000171 · Cited by 11
Metadata
- Authors
- Sedlmeier, P., & Gigerenzer, G.
- Venue
- Psychological Bulletin
- Published
- 1989-03
- Volume
- 105
- Issue
- 2
- Pages
- 309-316
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2155449866
- Cited by
- 748
- References
- 55
- Citations by year
- 2026: 3 · 2025: 7 · 2024: 7 · 2023: 14 · 2022: 22 · 2021: 30 · 2020: 23 · 2019: 30 · 2018: 34 · 2017: 35 · 2016: 26 · 2015: 26 · 2014: 30 · 2013: 24 · 2012: 25
- FWCI
- 27.89
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- other-oa
- Locations
- Psychological Bulletin (publishedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- statistical power, power analysis, effect size, multiple comparisons, non-significant results, null hypothesis significance testing, history of statistics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.