Do studies of statistical power have an effect on the power of studies?
Open accessThe DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index.
Abstract
The long-term impact of studies of statistical power is investigated using J. Cohen's (1962) pioneering work as an example. We argue that the impact is nil; the power of studies in the same journal that Cohen reviewed (now the Journal of Abnormal Psychology) has not increased over the past 24 years. In 1960 the median power (i.e., the probability that a significant result will be obtained if there is a true effect) was.46 for a medium size effect, whereas in 1984 it was only.37. The decline of power is a result of alpha-adjusted procedures. Low power seems to go unnoticed: only 2 out of 64 experi-ments mentioned power, and it was never estimated. Nonsignificance was generally interpreted as confirmation of the null hypothesis (if this was the research hypothesis), although the median power was as low as.25 in these cases. We discuss reasons for the ongoing neglect of power. Since J. Cohen's (1962) classical study on the statistical power of the studies published in the 1960 volume of the Journal of Abnormal and Social Psychology, a number of power analyses have been performed. These studies exhorted researchers to pay attention to the power of their tests rather than to focus exclu-sively on the level of significance. Historically, the concept of
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A little over two decades after Cohen’s original paper, two meta-analyses by Sedlmeier & Gigerenzer [66] and Rossi [67] examined a total of 25 reviews of statistical power in the psychological and social science literature between 1960 and 1984.”
From The natural selection of bad science (2016) · cites this paper as [66]
In the citing paper
“In fact, the average power of studies published in the 1984 volume of the Journal of Abnormal Psychology (a successor to the JASP) had dropped slightly compared with Cohen's (1962) results.”
From GPOWER: A general power analysis program (1996) · cites this paper as Sedlmeier and Gigerenzer (1989)
In the citing paper
“Sedlmeier and Gigerenzer (1989) investigated the impact of power analysis studies and textbooks on the power of recent psychological studies. Surprisingly, these authors found no significant increase in power values since 1962 when Cohen published his power study of the 1960 volume of the Journal of Abnormal & Social Psychology (JASP).”
From GPOWER: A general power analysis program (1996) · cites this paper as Sedlmeier and Gigerenzer (1989)
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Fundamental Statistics in Psychology and Education.
Smith, B. B., & Guilford, J. P. (1951) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2980908 · Cited by 3,455
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
Statistical Methods and Scientific Inference.
Bartlett, M. S., & Fisher, R. A. (1957) · Biometrika · doi:10.2307/2333276 · Cited by 1,278
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022
Handbook of clinical psychology
Wolman, B. B. (1965) · McGraw-Hill eBooks · Cited by 960
Cited by
Items 101–200 of 753
Neuropsychological correlates of hypertension: Review and methodologic considerations.
Waldstein, S. R., Manuck, S. B., Ryan, C. M., & Muldoon, M. F. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.110.3.451 · Cited by 205
What is Missing in p< .05? Effect Size
Thomas, J. R., Salazar, W., & Landers, D. M. (1991) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1991.10608733 · Cited by 205
The Superego, the Ego, and the Id in Statistical Reasoning
Gigerenzer, G. (2002) · Adaptive Thinking · doi:10.1093/acprof:oso/9780195153729.003.0013 · Cited by 203
Self-citationEffectiveness of behavioral therapy for chronic low back pain: A component analysis.
Turner, J. A., Clancy, S., McQuade, K. J., & Cardenas, D. D. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.58.5.573 · Cited by 204
Finkel, E. J., Eastwick, P. W., & Reis, H. T. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000007 · Cited by 202
Science and Ethics in Conducting, Analyzing, and Reporting Psychological Research
Rosenthal, R. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00646.x · Cited by 200
“Actually, if the effect is quite substantial, say, r = .24, and each study employs a sample size of, say, 64, the power level is .50 (Cohen, 1962, 1988; Rosenthal, 1994; Sedlmeier & Gigerenzer, 1989 ).”
BackgroundPsychology's Replication Crisis and Clinical Psychological Science
Tackett, J. L., Brandes, C. M., King, K. M., & Markon, K. E. (2019) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050718-095710 · Cited by 198
Lou, Y., Bernard, R. M., & Abrami, P. C. (2006) · Educational Technology Research and Development · doi:10.1007/s11423-006-8252-x · Cited by 197
“…was reported for no significant difference, a " midpoint " approach was taken to estimate a representative t-value (i.e., midpoint between 0 and the critical t-value for the sample size to be significant) (Sedlmeier & Gigerenzer, 1989) (e.g., the midpoint for t = 1.96 for α = .05 would be 0.98).”
BackgroundMethodInfluentialPaterson, T. A., Harms, P. D., Steel, P., & Credé, M. (2016) · Journal of Leadership & Organizational Studies · doi:10.1177/1548051815614321 · Cited by 194
Virtual reality in paediatric rehabilitation: a review
Parsons, T. D., Rizzo, A. A., Rogers, S., & York, P. (2009) · Developmental Neurorehabilitation · doi:10.1080/17518420902991719 · Cited by 192
“Increasing the number of participants will strengthen the statistical power, complexity and robustness of these research findings [51–55].”
BackgroundSusman, E. J., Dockray, S., Schiefelbein, V. L., Herwehe, S., Heaton, J. A., & Dorn, L. D. (2007) · Developmental Psychology · doi:10.1037/0012-1649.43.4.811 · Cited by 189
Colakoglu, S., & Caligiuri, P. (2008) · The International Journal of Human Resource Management · doi:10.1080/09585190701799804 · Cited by 188
“37 (Seldmeier and Gigerenzer 1989).”
Reproducible research in sport and exercise psychology: The role of sample sizes
Schweizer, G., & Furley, P. (2016) · Psychology of Sport and Exercise · doi:10.1016/j.psychsport.2015.11.005 · Cited by 185
“Nevertheless, psychological studies still often suffer from low power (Bakker, van Dijk, &Wicherts, 2012; Button et al., 2013; Fraley & Vazire, 2014; Sedlmeier & Gigerenzer, 1989).”
BackgroundReporting effect size estimates in school psychology research
Volker, M. A. (2006) · Psychology in the Schools · doi:10.1002/pits.20176 · Cited by 182
Deception in Experiments: Revisiting the Arguments in Its Defense
Hertwig, R., & Ortmann, A. (2008) · Ethics & Behavior · doi:10.1080/10508420701712990 · Cited by 181
Powering population health research: Considerations for plausible and actionable effect sizes
Matthay, E. C., Hagan, E., Gottlieb, L. M., Tan, M. L., Vlahov, D., Adler, N., & Glymour, M. M. (2021) · SSM - Population Health · doi:10.1016/j.ssmph.2021.100789 · Cited by 177
Post Hoc Power: A Concept Whose Time Has Come
Onwuegbuzie, A. J., & Leech, N. L. (2004) · Understanding Statistics · doi:10.1207/s15328031us0304_1 · Cited by 177
“An even more alarming picture is painted by Schmidt and Hunter (1997) who reported that “the average [hypothesized] power of null hypothesis significance tests in typical studies and research literature is in the .40 to .60 range (Cohen, 1962, 1965, 1988, 1992; Schmidt, 1996; Schmidt, Hunter, & Urry, 1976; Sedlmeier &…”
BackgroundDeterminants of the gait transition speed during human locomotion: Kinematic factors
Hreljac, A. (1995) · Journal of Biomechanics · doi:10.1016/0021-9290(94)00120-s · Cited by 177
Framing Effects and Arenas of Choice: Your Money or Your Life?
Fagley, N. S., & Miller, P. M. (1997) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1997.2725 · Cited by 171
Evaluating single-case research data: A comparison of seven statistical methods
Parker, R. I., & Brossart, D. F. (2003) · Behavior Therapy · doi:10.1016/s0005-7894(03)80013-8 · Cited by 168
Sample size in psychological research over the past 30 years
Marszalek, J. M., Barber, C., Kohlhart, J., & Cooper, B. H. (2011) · Perceptual and Motor Skills · doi:10.2466/03.11.pms.112.2.331-348 · Cited by 167
“(1981) parallel the surveys of observed power reported in the literature (Cohen, 1962; Sedlmeier & Gigerenzer, 1989; Rossi, 1990; Maddock & Ros-si, 2001; Maxwell, 2004), and even overlap in specific journals (i.e., Journal of Abnormal Psychology ).”
Detecting and Correcting the Lies That Data Tell
Schmidt, F. (2010) · Perspectives on Psychological Science · doi:10.1177/1745691610369339 · Cited by 163
Promoting language and literacy development through parent–child reading in Hong Kong preschoolers
Wing-Yin Chow, B., & McBride-Chang, C. (2003) · Early Education and Development · doi:10.1207/s15566935eed1402_6 · Cited by 164
“The typical effect size in published reports of educational and psychological interventions is about .33 (Cohen, 1977; Sedlmeier & Gigerenzer, 1989).”
BackgroundCheung, A. C. K., & Slavin, R. E. (2013) · Reading Research Quarterly · doi:10.1002/rrq.50 · Cited by 162
“Procedures described by Lipsey & Wilson (2001) and Sedlmeier & Gigerenzer (1989) were used to estimate effect sizes when unadjusted standard deviations were not available, as when the only standard deviation presented was already adjusted for covariates or when only gain score standard deviations…”
MethodOn the Reliability of Implicit and Explicit Memory Measures
Buchner, A., & Wippich, W. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0731 · Cited by 161
Lessons From Pinocchio: Cues to Deception May Be Highly Exaggerated
Luke, T. J. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619838258 · Cited by 159
Vanhove, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0069172 · Cited by 158
Optimal design in psychological research.
McClelland, G. H. (1997) · Psychological Methods · doi:10.1037//1082-989x.2.1.3 · Cited by 155
Cafri, G., Kromrey, J. D., & Brannick, M. T. (2010) · Multivariate Behavioral Research · doi:10.1080/00273171003680187 · Cited by 156
“Previous power surveys evaluated power based on likelihood of the design (sample size, alpha level, directional nature of test) to detect Cohen's designations of small, medium, and large effect sizes (eg, Cohen, 1962 ; Rossi, 1990 ; Sedlmeier & Gigerenzer, 1989 ).”
MethodRevisiting field experimentation: Field notes for the future.
Shadish, W. R. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.3 · Cited by 153
Flexible cutoff values for fit indices in the evaluation of structural equation models
Niemand, T., & Mai, R. (2018) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-018-0602-9 · Cited by 192
Misuse of statistical tests in three decades of psychotherapy research.
Dar, R., Serlin, R. C., & Omer, H. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.62.1.75 · Cited by 152
FIDLER, F., BURGMAN, M. A., CUMMING, G., BUTTROSE, R., & THOMASON, N. (2006) · Conservation Biology · doi:10.1111/j.1523-1739.2006.00525.x · Cited by 148
Cheung, A. C. K., & Slavin, R. E. (2012) · Review of Educational Research · doi:10.3102/0034654312465472 · Cited by 148
Clinical supervision research from 1981 to 1993: A methodological critique.
Ellis, M. V., Ladany, N., Krengel, M., & Schult, D. (1996) · Journal of Counseling Psychology · doi:10.1037//0022-0167.43.1.35 · Cited by 148
Schmidt, F. L., & Oh, I.-S. (2016) · Archives of Scientific Psychology · doi:10.1037/arc0000029 · Cited by 145
Demographic antecedents and performance consequences of structural holes in work teams
Balkundi, P., Kilduff, M., Barsness, Z. I., & Michael, J. H. (2007) · Journal of Organizational Behavior · doi:10.1002/job.428 · Cited by 143
Rutledge, T., & Loh, C. (2004) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2702_9 · Cited by 144
Suicide Risk and Sexual Orientation: A Critical Review
Plöderl, M., Wagenmakers, E., Tremblay, P., Ramsay, R. F., Kralovec, K., Fartacek, C., & Fartacek, R. R. (2013) · Archives of Sexual Behavior · doi:10.1007/s10508-012-0056-y · Cited by 172
Significance tests as sorcery: Science is empirical—significance tests are not
Lambdin, C. (2012) · Theory & Psychology · doi:10.1177/0959354311429854 · Cited by 143
Do We Know Which Interventions are Effective for Disruptive and Delinquent Girls?
Hipwell, A. E., & Loeber, R. (2006) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-006-0012-2 · Cited by 172
Experiments and Surveys on Political Elites
Kertzer, J. D., & Renshon, J. (2022) · Annual Review of Political Science · doi:10.1146/annurev-polisci-051120-013649 · Cited by 190
A Critical Assessment of Null Hypothesis Significance Testing in Quantitative Communication Research
Levine, T. R., Weber, R., Hullett, C., Park, H. S., & Lindsey, L. L. M. (2008) · Human Communication Research · doi:10.1111/j.1468-2958.2008.00317.x · Cited by 138
Espírito‐Santo, H., & Daniel, F. (2015) · Revista Portuguesa de Investigação Comportamental e Social · doi:10.7342/ismt.rpics.2015.1.1.14 · Cited by 285
Embracing Uncertainty: The Interface of Bayesian Statistics and Cognitive Psychology
Anderson, J. L. (1998) · Conservation Ecology · doi:10.5751/es-00043-020102 · Cited by 148
“Finally, the conventions of classical statistics were initially convincing enough that they were endorsed and enforced by dominant members of the scientific community: professors and journal editors (Sedlmeier and Gigerenzer 1989).”
InfluentialOn Traits, Situations, and Their Integration: A Developmental Perspective
Roberts, B. W., & Pomerantz, E. M. (2004) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0804_5 · Cited by 134
“Given the small sample sizes and lack of power found in most experimental studies (Sedlmeier & Gigerenzer, 1989), it was only by chance that the modest effect sizes of broad personality traits ever hit the mark.”
BackgroundThe case against retrospective statistical power analyses with an introduction to power analysis
Nakagawa, S., & Foster, T. M. (2004) · acta ethologica · doi:10.1007/s10211-004-0095-z · Cited by 159
Outcome-Reporting Bias in Education Research
Pigott, T. D., Valentine, J. C., Polanin, J. R., Williams, R. T., & Canada, D. D. (2013) · Educational Researcher · doi:10.3102/0013189x13507104 · Cited by 127
Anderson, S. F., & Maxwell, S. E. (2017) · Multivariate Behavioral Research · doi:10.1080/00273171.2017.1289361 · Cited by 131
Sample Extensiveness in Qualitative Nutrition Education Research
Sobal, J. (2001) · Journal of Nutrition Education · doi:10.1016/s1499-4046(06)60030-4 · Cited by 159
Mann, L., Burnett, P., Radford, M., & Ford, S. (1997) · Journal of Behavioral Decision Making · doi:10.1002/(sici)1099-0771(199703)10:1<1::aid-bdm242>3.0.co;2-x · Cited by 449
Self-citationThe surprisingly limited malleability of implicit racial evaluations
Joy-Gaba, J. A., & Nosek, B. A. (2010) · Social Psychology · doi:10.1027/1864-9335/a000020 · Cited by 123
Reporting Practices and APA Editorial Policies Regarding Statistical Significance and Effect Size
Vacha-Haase, T., Nilsson, J. E., Reetz, D. R., Lance, T. S., & Thompson, B. (2000) · Theory & Psychology · doi:10.1177/0959354300103006 · Cited by 126
Using Dissertations to Examine Potential Bias in Child and Adolescent Clinical Trials.
McLeod, B. D., & Weisz, J. R. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.2.235 · Cited by 125
“They have argued that the use of small sample sizes has led to a collection of published works that have a greater number of statistically significant results than analysis of their power would indicate they should (Chase & Chase, 1976; Sedlmeier & Gigerenzer, 1989).”
BackgroundDickinson, E. R., Adelson, J. L., & Owen, J. J. (2012) · Archives of Sexual Behavior · doi:10.1007/s10508-011-9887-1 · Cited by 169
Design Sensitivity in Criminal Justice Experiments
Weisburd, D., Petrosino, A., & Mason, G. (1993) · Crime and Justice · doi:10.1086/449216 · Cited by 124
Multiple regression and correlation techniques: Recent controversies and best practices.
Hoyt, W. T., Imel, Z. E., & Chan, F. H. (2008) · Rehabilitation Psychology · doi:10.1037/a0013021 · Cited by 149
Morse, D. T. (1999) · Educational and Psychological Measurement · doi:10.1177/00131649921969901 · Cited by 121
Cashen, L. H., & Geiger, S. W. (2004) · Organizational Research Methods · doi:10.1177/1094428104263676 · Cited by 118
Psychopathy Factors and Risk for Aggressive Behavior: A Test of the "Threatened Egotism" Hypothesis.
Cale, E. M., & Lilienfeld, S. O. (2006) · Law and Human Behavior · doi:10.1007/s10979-006-9004-5 · Cited by 152
Replication, Communication, and the Population Dynamics of Scientific Discovery
McElreath, R., & Smaldino, P. E. (2015) · PLOS ONE · doi:10.1371/journal.pone.0136088 · Cited by 117
“The bottom cluster represents a pessimistic, or perhaps more realistic [24, 25], scenario with low base rate (b = 1/1000), lower power (1 − β = The Population Dynamics of Scientific Discovery”
BackgroundInterpreting Interaction Effects in Generalized Linear Models of Nonlinear Probabilities and Counts
McCabe, C. J., Halvorson, M. A., King, K. M., Cao, X., & Kim, D. S. (2021) · Multivariate Behavioral Research · doi:10.1080/00273171.2020.1868966 · Cited by 140
Experimental evaluations of elementary science programs: A best-evidence synthesis
Slavin, R. E., Lake, C., Hanley, P., & Thurston, A. (2014) · Journal of Research in Science Teaching · doi:10.1002/tea.21139 · Cited by 115
The Massive Auditory Lexical Decision (MALD) database
Tucker, B. V., Brenner, D., Danielson, D. K., Kelley, M. C., Nenadić, F., & Sims, M. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1056-1 · Cited by 139
“Their size also affords the statistical power to detect small effects and reduces the possibility of type II error, which has been a serious recurring issue in the social sciences (Cohen, 1962; Sedlmeier & Gigerenzer, 1989; Ioannidis, 2005; Maxwell et al., 2015).”
BackgroundReplicability Crisis in Social Psychology: Looking at the Past to Find New Pathways for the Future
Świątkowski, W., & Dompnier, B. (2017) · International Review of Social Psychology · doi:10.5334/irsp.66 · Cited by 114
On Making Progress in Communication Science
Boster, F. J. (2002) · Human Communication Research · doi:10.1093/hcr/28.4.473 · Cited by 115
Connelly, B. L., Miller, T. L., & Devers, C. E. (2011) · Strategic Management Journal · doi:10.1002/smj.974 · Cited by 138
Recognition memory impairment in Parkinson's disease: Power and meta-analyses.
Whittington, C. J., Podd, J., & Kan, M. M. (2000) · Neuropsychology · doi:10.1037//0894-4105.14.2.233 · Cited by 125
The impact of customer expectation on software development effort estimates
Jørgensen, M., & Sjøberg, D. I. K. (2003) · International Journal of Project Management · doi:10.1016/s0263-7863(03)00085-1 · Cited by 110
Masset, E., Haddad, L. B., Cornelius, A., & Castro, J. G. I. (2011) · Cited by 157
A confidence interval approach to data analysis
Stefano, J. D. (2003) · Forest Ecology and Management · doi:10.1016/s0378-1127(03)00331-1 · Cited by 118
“The inability to detect effects with sufficient precision results from low power statistical tests, an occurrence that is common in the scientific literature (Sedlmeier and Gigerenzer, 1989; Peterman, 1990; Fairweather, 1991).”
BackgroundTracking Replicability as a Method of Post-Publication Open Evaluation
Hartshorne, J. K., & Schachner, A. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00008 · Cited by 107
“…to multiple meta-analyses, the statistical power of a psychology or neuroscience study to detect a medium-sized effect (defined variously as r = 0.3, r = 0.4, or d = 0.5) is approximately 0.5 or below (Cohen,1962;Sedlmeier and Gigerenzer,1989;Kosci-ulek and Szymanski, 1993; Bezeau and Graves, 2001).”
BackgroundInfluentialRole ambiguity, role conflict and job satisfaction among physical education teachers in Greece
Koustelios, A. D., Theodorakis, N., & Goulimaris, D. (2004) · International Journal of Educational Management · doi:10.1108/09513540410522216 · Cited by 105
Are transitions in human gait determined by mechanical, kinetic or energetic factors?
Raynor, A. J., Yi, C. J., Abernethy, B., & Quek, J. J. (2002) · Human Movement Science · doi:10.1016/s0167-9457(02)00180-x · Cited by 119
Adaptive Thinking: Rationality in the Real World
Gigerenzer, G. (2002) · DIAL (Catholic University of Leuven) · doi:10.1093/acprof:oso/9780195153729.001.0001 · Cited by 1,120
Self-citationCalibrating the Scientific Ecosystem Through Meta-Research
Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., & Ioannidis, J. P. A. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041104 · Cited by 98
Effect magnitude: A different focus
Kirk, R. E. (2006) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2006.09.011 · Cited by 120
Fidler, F. (2002) · Educational and Psychological Measurement · doi:10.1177/001316402236876 · Cited by 102
“The author receives e-mail at f.fidler1@pgrad.unimelb.edu.au. criticisms (cf. Cohen, 1962, 1969, 1988; Rossi, 1990, 1997; Sedlmeier & Gigerenzer, 1989).”
Risk Taking in Decision Making for Others Versus the Self1
Stone, E. R., Yates, A. J., & Caruthers, A. S. (2002) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2002.tb00260.x · Cited by 131
Power to detect homework effects in psychotherapy outcome research.
Kazantzis, N. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.1.166 · Cited by 101
How to Make Cognitive Illusions Disappear
Gigerenzer, G. (2002) · Adaptive Thinking · doi:10.1093/acprof:oso/9780195153729.003.0012 · Cited by 85
Self-citationWhy the resistance to statistical innovations? Bridging the communication gap.
Sharpe, D. (2013) · Psychological Methods · doi:10.1037/a0034177 · Cited by 100
“Cohen found the psychological literature to be riddled with underpowered studies, a finding replicated a quarter century later by Sedlmeier and Gigerenzer (1989).”
BackgroundBeauchaine, T. P., & Beauchaine, R. J., III (2002) · Psychological Methods · doi:10.1037//1082-989x.7.2.245 · Cited by 98
Brekke, J. S., Ansel, M., Long, J. D., Slade, E., & Weinstein, M. (1999) · Psychiatric Services · doi:10.1176/ps.50.2.248 · Cited by 97
Williams, C. R., Labig, C. E., & Stone, T. H. (1993) · Journal of Applied Psychology · doi:10.1037//0021-9010.78.2.163 · Cited by 96
Statistical reform in medicine, psychology and ecology
Fidler, F. M., Cumming, G., Burgman, M. A., & Thomason, N. R. (2004) · The Journal of Socio-Economics · doi:10.1016/j.socec.2004.09.035 · Cited by 102
The Importance of Effect Magnitude
Kirk, R. E. (2003) · Handbook of Research Methods in Experimental Psychology · doi:10.1002/9780470756973.ch5 · Cited by 94
The Data Analysis Dilemma: Ban or Abandon. A Review of Null Hypothesis Significance Testing.
Nix, T. W., & Barnette, J. J. (1998) · Research in the schools · Cited by 108
Shearman, S. M., & Dumlao, R. J. (2008) · Journal of Family Communication · doi:10.1080/15267430802182456 · Cited by 118
“This is discussed by other researchers such as Seldmeier & Gigerenzer (1989) .”
MethodSleep Inertia: Best Time Not to Wake Up?
Naitoh, P., Kelly, T., & Babkoff, H. (1993) · Chronobiology International · doi:10.1080/07420529309059699 · Cited by 94
Spalding, T. W., Lyon, L. A., Steel, D. H., & Hatfield, B. D. (2004) · Psychophysiology · doi:10.1111/j.1469-8986.2004.00184.x · Cited by 93
“These values exceed the average of approximately 0.50 found in several surveys of effect sizes in behavioral research (Cooper & Findley, 1982; Crews & Landers, 1987; Haase, Waechter, & Solomon, 1982; Kirk, 1996; Sedlmeier & Gigerenzer, 1989).”
BackgroundInfluentialOn measuring (in)dependence of cognitive processes.
Howe, M. L., Rabinowitz, F. M., & Grant, M. J. (1993) · Psychological Review · doi:10.1037//0033-295x.100.4.737 · Cited by 92
Statistical Techniques Employed in AERJ and JCP Articles from 1988 to 1997: A Methodological Review
Kieffer, K. M., Reese, R. J., & Thompson, B. (2001) · The Journal of Experimental Education · doi:10.1080/00220970109599489 · Cited by 91
Power analysis and sustainable forest management
Stefano, J. D. (2001) · Forest Ecology and Management · doi:10.1016/s0378-1127(00)00627-7 · Cited by 90
Statistical power: Concepts, procedures, and applications
Hallahan, M., & Rosenthal, R. (1996) · Behaviour Research and Therapy · doi:10.1016/0005-7967(95)00082-8 · Cited by 119
The Current Status of Research on Sequential-Request Compliance Techniques
Dillard, J. P. (1991) · Personality and Social Psychology Bulletin · doi:10.1177/0146167291173008 · Cited by 89
A Meta-Analytic Re-Appraisal of the Framing Effect
Steiger, A., & Kühberger, A. (2018) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000321 · Cited by 106
The Statistical versus Clinical Significance Debate
LeFort, S. M. (1993) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.1993.tb00754.x · Cited by 103
Unconscious or underpowered? Probabilistic cuing of visual attention.
Vadillo, M. A., Linssen, D., Orgaz, C., Parsons, S., & Shanks, D. R. (2020) · Journal of Experimental Psychology: General · doi:10.1037/xge0000632 · Cited by 87
THE PERCEPTIONS AND USAGE OF STATISTICAL POWER IN APPLIED PSYCHOLOGY AND MANAGEMENT RESEARCH
MONE, M. A., MUELLER, G. C., & MAULAND, W. (1996) · Personnel Psychology · doi:10.1111/j.1744-6570.1996.tb01793.x · Cited by 86
Metadata
- Authors
- Sedlmeier, P., & Gigerenzer, G.
- Venue
- Psychological Bulletin
- Published
- 1989-03
- Volume
- 105
- Issue
- 2
- Pages
- 309-316
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2155449866
- Cited by
- 748
- References
- 55
- Citations by year
- 2026: 3 · 2025: 7 · 2024: 7 · 2023: 14 · 2022: 22 · 2021: 30 · 2020: 23 · 2019: 30 · 2018: 34 · 2017: 35 · 2016: 26 · 2015: 26 · 2014: 30 · 2013: 24 · 2012: 25
- FWCI
- 27.89
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- other-oa
- Locations
- Psychological Bulletin (publishedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- statistical power, power analysis, effect size, multiple comparisons, non-significant results, null hypothesis significance testing, history of statistics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.