Do studies of statistical power have an effect on the power of studies?
Open accessThe DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index.
Abstract
The long-term impact of studies of statistical power is investigated using J. Cohen's (1962) pioneering work as an example. We argue that the impact is nil; the power of studies in the same journal that Cohen reviewed (now the Journal of Abnormal Psychology) has not increased over the past 24 years. In 1960 the median power (i.e., the probability that a significant result will be obtained if there is a true effect) was.46 for a medium size effect, whereas in 1984 it was only.37. The decline of power is a result of alpha-adjusted procedures. Low power seems to go unnoticed: only 2 out of 64 experi-ments mentioned power, and it was never estimated. Nonsignificance was generally interpreted as confirmation of the null hypothesis (if this was the research hypothesis), although the median power was as low as.25 in these cases. We discuss reasons for the ongoing neglect of power. Since J. Cohen's (1962) classical study on the statistical power of the studies published in the 1960 volume of the Journal of Abnormal and Social Psychology, a number of power analyses have been performed. These studies exhorted researchers to pay attention to the power of their tests rather than to focus exclu-sively on the level of significance. Historically, the concept of
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A little over two decades after Cohen’s original paper, two meta-analyses by Sedlmeier & Gigerenzer [66] and Rossi [67] examined a total of 25 reviews of statistical power in the psychological and social science literature between 1960 and 1984.”
From The natural selection of bad science (2016) · cites this paper as [66]
In the citing paper
“In fact, the average power of studies published in the 1984 volume of the Journal of Abnormal Psychology (a successor to the JASP) had dropped slightly compared with Cohen's (1962) results.”
From GPOWER: A general power analysis program (1996) · cites this paper as Sedlmeier and Gigerenzer (1989)
In the citing paper
“Sedlmeier and Gigerenzer (1989) investigated the impact of power analysis studies and textbooks on the power of recent psychological studies. Surprisingly, these authors found no significant increase in power values since 1962 when Cohen published his power study of the 1960 volume of the Journal of Abnormal & Social Psychology (JASP).”
From GPOWER: A general power analysis program (1996) · cites this paper as Sedlmeier and Gigerenzer (1989)
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Fundamental Statistics in Psychology and Education.
Smith, B. B., & Guilford, J. P. (1951) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2980908 · Cited by 3,455
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
Statistical Methods and Scientific Inference.
Bartlett, M. S., & Fisher, R. A. (1957) · Biometrika · doi:10.2307/2333276 · Cited by 1,278
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022
Handbook of clinical psychology
Wolman, B. B. (1965) · McGraw-Hill eBooks · Cited by 960
Cited by
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
GPOWER: A general power analysis program
Erdfelder, E., Faul, F., & Buchner, A. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203630 · Cited by 4,864
“According to Sedlmeier and Gigerenzer (1989), a major reason for this confusion is the "hybridization" of the Fisherian and the Neyman-Pearson theories ofstatistical inference in the psychological literature (see also Giger enzer, 1993).”
BackgroundIssues and opinion on structural equation modeling
Chin, W. W. (1998) · Journal of the Association for Information Systems · doi:10.5555/290231.290235 · Cited by 4,577
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
“He reminded researchers that, given the fact that the nil hypothesis is always false, the rate of Type I errors is 0%, not 5%, and that only Type II errors can be made, which run typically at about 50% (Cohen, 1962; Sedlmeier & Gigerenzer, 1989).”
BackgroundA manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
“Studies of statistical power persistently find it to be below (sometimes well below) 50%, across both time and the different disciplines studied 2,35,36 .”
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
Using Bayes to get the most out of non-significant results
Dienes, Z. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00781 · Cited by 1,998
“Cohen (1962), Sedlmeier and Gigerenzer (1989); see Button et al. (2013), for a considerably lower recent estimate in some disciplines.”
BackgroundLakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning
Yarkoni, T., & Westfall, J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617693393 · Cited by 1,916
Issues and Opinion on Structural Equation Modeling
Chin, W. W. (1998) · MIS Quarterly · doi:10.2307/249674 · Cited by 249
Things I have learned (so far).
Cohen, J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.12.1304 · Cited by 1,781
“Psychological Bulletin, 83.”
BackgroundPractical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778
Bernard, R. M., Abrami, P. C., Lou, Y., Borokhovski, E., Wade, A., Wozney, L., Wallet, P. A., Fiset, M., & Huang, B. (2004) · Review of Educational Research · doi:10.3102/00346543074003379 · Cited by 1,761
El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada
Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014) · Anales de Psicología · doi:10.6018/analesps.30.3.199361 · Cited by 1,616
A Typology of Mixed Methods Sampling Designs in Social Science Research
Onwuegbuzie, A., & Collins, K. (2015) · The Qualitative Report · doi:10.46743/2160-3715/2007.1638 · Cited by 1,565
How Many Studies Do You Need?: A Primer on Statistical Power for Meta-Analysis
Valentine, J. C., Pigott, T. D., & Rothstein, H. R. (2010) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998609346961 · Cited by 1,294
“…and alarming point is the Hedges and Olkin (1985) demonstration that in conditions of low-to-moderate statistical power in primary studies (a situation common in the social sciences; Sedlmeier & Gigerenzer, 1989), vote counting actually has less statistical power, the more evidence accumulates.”
BackgroundAguinis, H., Beaty, J. C., Boik, R. J., & Pierce, C. A. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.1.94 · Cited by 1,216
“…have used Cohen’s definitions of small, medium, and large effect sizes in conducting power analyses (e.g., Mone, Mueller, & Mauland, 1996; Sedlmeier & Gigerenzer, 1989) and, moreover, have not acknowledged explicitly that these values are actually based on observed effect sizes for…”
MethodNachar, N. (2008) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.04.1.p013 · Cited by 1,166
Null hypothesis significance testing: a review of an old and continuing controversy
Nickerson, R. S. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.241 · Cited by 1,090
QUANTITATIVE METHODS IN PSYCHOLOGY A Power Primer
Cohen, J. (1992) · Cited by 1,040
Use of structural equation modeling in operations management research: Looking back and forward
Shah, R., & Goldstein, S. M. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2005.05.001 · Cited by 976
“These proportions are consistent with similar analyses in psychology (MacCallum and Austin, 2000), MIS (Chin and Todd, 1995), and strategy (Shook et al., 2004), and have not changed since 1960 ( Sedlmeier and Gigenrenzer, 1989 ).”
ResultThe natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
“These data, along with the data from Sedlmeier and Gigerenzer (1989) and Rossi (1990) , are plotted in Figure 1.”
BackgroundMethodInfluentialGigerenzer, G. (2004) · The Journal of Socio-Economics · doi:10.1016/j.socec.2004.09.033 · Cited by 890
“Sedlmeier and Gigerenzer (1989) checked the studies in the same journal, 24 years later, a time period that should allow for change.”
BackgroundSelf-citationSameroff, A. J., Seifer, R., Baldwin, A. L., & Baldwin, C. P. (1993) · Child Development · doi:10.1111/j.1467-8624.1993.tb02896.x · Cited by 855
Sameroff, A. J., Seifer, R., Baldwin, A., & Baldwin, C. (1993) · Child Development · doi:10.2307/1131438 · Cited by 856
Wicherts, J. M., Veldkamp, C. L. S., Augusteijn, H. E. M., Bakker, M., van Aert, R. C. M., & van Assen, M. A. L. M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01832 · Cited by 754
Hunter, J. E., & Schmidt, F. L. (2000) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00156 · Cited by 833
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.115 · Cited by 830
Small Telescopes: Detectability and the Evaluation of Replication Results
Simonsohn, U. (2015) · Psychological Science · doi:10.1177/0956797614567341 · Cited by 742
Cheung, A. C. K., & Slavin, R. E. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.001 · Cited by 792
“Procedures described by Lipsey & Wilson (2001) and Sedlmeier & Gigerenzer (1989) were used to estimate effect sizes when unadjusted standard deviations were not available, as when the only standard deviation presented was already adjusted for covariates or when only gain score standard deviations…”
MethodSchäfer, T., & Schwarz, M. A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00813 · Cited by 774
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1989) · American Psychologist · doi:10.1037/0003-066x.44.10.1276 · Cited by 777
Replicability, Robustness, and Reproducibility in Psychological Science
Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., et al. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-114157 · Cited by 770
Szucs, D., & Ioannidis, J. P. A. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2000797 · Cited by 761
Rosnow, R. L., & Rosenthal, R. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.4.331 · Cited by 761
p -Curve and Effect Size: Correcting for Publication Bias Using Only Significant Results
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614553988 · Cited by 717
Within-Class Grouping: A Meta-Analysis
Lou, Y., Abrami, P. C., Spence, J. C., Poulsen, C., Chambers, B., & d’Apollonia, S. (1996) · Review of Educational Research · doi:10.3102/00346543066004423 · Cited by 727
Small Group and Individual Learning with Technology: A Meta-Analysis
Lou, Y., Abrami, P. C., & d’Apollonia, S. (2001) · Review of Educational Research · doi:10.3102/00346543071003449 · Cited by 721
Clinical Research Centre, S. G. H., Bujang, M. A., Sa’at, N., Biostatistics Unit, N. C. R. C., Tg Abu Bakar Sidik, T. M. I., Biostatistics Unit, N. C. R. C., Chien Joo, L., & Clinical Research Centre, S. G. H. (2018) · Malaysian Journal of Medical Sciences · doi:10.21315/mjms2018.25.4.12 · Cited by 682
Experimental practices in economics: A challenge for psychologists?: (683322011-032)
Hertwig, R., & Ortmann, A. (2000) · PsycEXTRA Dataset · doi:10.1037/e683322011-032 · Cited by 668
Maxwell, S. E. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.147 · Cited by 654
From tools to theories: A heuristic of discovery in cognitive psychology.
Gigerenzer, G. (1991) · Psychological Review · doi:10.1037//0033-295x.98.2.254 · Cited by 634
Self-citationWhat do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.
Schmidt, F. L. (1992) · American Psychologist · doi:10.1037/0003-066x.47.10.1173 · Cited by 564
Collins, K. M. T., Onwuegbuzie, A. J., & Jiao, Q. G. (2007) · Journal of Mixed Methods Research · doi:10.1177/1558689807299526 · Cited by 552
“…to .6, with an average statistical power of .5; Cohen, 1962, 1965, 1988, 1992; Schmidt, 1996; Schmidt & Hunter, 1997; Schmidt, Hunter, & Urry, 1976; Sedlmeier & Gigerenzer, 1989) and utilize nonrandom samples that prevent effect-size estimates from being generalized to the underlying population…”
BackgroundYarkoni, T. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01127.x · Cited by 549
Things I have learned (so far).
Cohen, J. (1992) · Methodological issues & strategies in clinical research. · doi:10.1037/10109-028 · Cited by 553
Nelson, L. D., Simmons, J., & Simonsohn, U. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011836 · Cited by 548
Corcoran, R. P., Cheung, A. C. K., Kim, E., & Xie, C. (2018) · Educational Research Review · doi:10.1016/j.edurev.2017.12.001 · Cited by 502
How meta-analysis increases statistical power.
Cohn, L. D., & Becker, B. J. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.3.243 · Cited by 498
Rationality for mortals: how people cope with uncertainty
(2009) · Choice Reviews Online · doi:10.5860/choice.46-4133 · Cited by 469
Insensitivity of the analysis of variance to heredity-environment interaction
Wahlsten, D. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077797 · Cited by 468
The ironic effect of significant results on the credibility of multiple-study articles.
Schimmack, U. (2012) · Psychological Methods · doi:10.1037/a0029487 · Cited by 455
Sample size and multiple regression analysis.
Maxwell, S. E. (2000) · Psychological Methods · doi:10.1037//1082-989x.5.4.434 · Cited by 452
Szucs, D., & Ioannidis, J. P. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117164 · Cited by 453
Fraley, R. C., & Vazire, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109019 · Cited by 409
Effective Programs in Elementary Mathematics: A Best-Evidence Synthesis
Slavin, R. E., & Lake, C. (2008) · Review of Educational Research · doi:10.3102/0034654308317473 · Cited by 407
Anderson, S. F., Kelley, K., & Maxwell, S. E. (2017) · Psychological Science · doi:10.1177/0956797617723724 · Cited by 406
“Twenty-seven years later, Sedlmeier and Gigerenzer (1989) published a report on the change in power following Cohen’s and other researchers’ writings on this subject.”
BackgroundThomas, L. (1997) · Conservation Biology · doi:10.1046/j.1523-1739.1997.96102.x · Cited by 403
Thompson, B. (2002) · Journal of Counseling & Development · doi:10.1002/j.1556-6678.2002.tb00167.x · Cited by 398
Effective programs for struggling readers: A best-evidence synthesis
Slavin, R. E., Lake, C., Davis, S., & Madden, N. A. (2011) · Educational Research Review · doi:10.1016/j.edurev.2010.07.002 · Cited by 353
The relation between statistical power and inference in fMRI
Cremers, H. R., Wager, T. D., & Yarkoni, T. (2017) · PLOS ONE · doi:10.1371/journal.pone.0184923 · Cited by 349
“And the finding was no fluke: twenty-seven years later Sedlmeier and, Gigerenzer analyzed studies in the 1984 volume of the Journal of Abnormal Psychology and found that the statistical power of the average analysis remained essentially unchanged over the intervening period [30].”
BackgroundPlonsky (2013) · doi:10.1017/s0272263113000399 · Cited by 347
Zakzanis, K. K. (2001) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/16.7.653 · Cited by 346
The Insignificance of Null Hypothesis Significance Testing
Gill, J. (1999) · Political Research Quarterly · doi:10.1177/106591299905200309 · Cited by 338
Sharpe, D. (1997) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00056-1 · Cited by 334
Bröder, A. (2000) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.26.5.1332 · Cited by 332
Negative outcome in psychotherapy: A critical review.
Mohr, D. C. (1995) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.1995.tb00022.x · Cited by 330
Statistical power of psychological research: What have we gained in 20 years?
Rossi, J. S. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.58.5.646 · Cited by 323
Implementing Reproducible Research
Stodden, V. (2014) · doi:10.1201/b16868 · Cited by 314
Needed: A Ban on the Significance Test
Hunter, J. E. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00534.x · Cited by 314
Effective Reading Programs for the Elementary Grades: A Best-Evidence Synthesis
Slavin, R. E., Lake, C., Chambers, B., Cheung, A., & Davis, S. (2009) · Review of Educational Research · doi:10.3102/0034654309341374 · Cited by 312
Kelley, K., & Maxwell, S. E. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.3.305 · Cited by 310
The earth is flat ( p > 0.05): significance thresholds and the crisis of unreplicable research
Amrhein, V., Korner-Nievergelt, F., & Roth, T. (2017) · PeerJ · doi:10.7717/peerj.3544 · Cited by 308
How features of educational technology applications affect student reading outcomes: A meta-analysis
Cheung, A. C. K., & Slavin, R. E. (2012) · Educational Research Review · doi:10.1016/j.edurev.2012.05.002 · Cited by 307
What meta-analyses reveal about the replicability of psychological research.
Stanley, T. D., Carter, E. C., & Doucouliagos, H. (2018) · Psychological Bulletin · doi:10.1037/bul0000169 · Cited by 307
Power Analysis for Complex Mediational Designs Using Monte Carlo Methods
Thoemmes, F., MacKinnon, D., & Reiser, M. (2010) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2010.489379 · Cited by 298
Final Collapse of the Neyman-Pearson Decision Theoretic Framework and Rise of the neoFisherian
Hurlbert, S. H., & Lombardi, C. M. (2009) · Annales Zoologici Fennici · doi:10.5735/086.046.0501 · Cited by 301
Continuously Cumulating Meta-Analysis and Replicability
Braver, S. L., Thoemmes, F. J., & Rosenthal, R. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614529796 · Cited by 297
The Value of Codesign: The Effect of Customer Involvement in Service Design Teams
Trischler, J., Pervan, S. J., Kelly, S. J., & Scott, D. R. (2018) · Journal of Service Research · doi:10.1177/1094670517714060 · Cited by 292
A systematic review of statistical power in software engineering experiments
Dybå, T., Kampenes, V. B., & Sjøberg, D. I. K. (2006) · Information and Software Technology · doi:10.1016/j.infsof.2005.08.009 · Cited by 289
A survey of the statistical power of research in behavioral ecology and animal behavior
Jennions, M. D. (2003) · Behavioral Ecology · doi:10.1093/beheco/14.3.438 · Cited by 278
When Null Hypothesis Significance Testing Is Unsuitable for Research: A Reassessment
Szucs, D., & Ioannidis, J. P. A. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00390 · Cited by 298
“While some “rules of thumb” exist about what are small, modest, and large effects (e.g. Cohen, 1962; Cohen, 1988; Sedlmeier and Gigerenzer, 1989; Jaeschke et al. 1989), some large effects may not be actionable (e.g. a change in some biomarker that is a poor surrogate and thus bears little…”
BackgroundNull hypothesis significance testing: On the survival of a flawed method.
Krueger, J. (2001) · American Psychologist · doi:10.1037//0003-066x.56.1.16 · Cited by 282
Effective Reading Programs for Middle and High Schools: A Best‐Evidence Synthesis
Slavin, R. E., Cheung, A., Groff, C., & Lake, C. (2008) · Reading Research Quarterly · doi:10.1598/rrq.43.3.4 · Cited by 283
Effective Programs in Middle and High School Mathematics: A Best-Evidence Synthesis
Slavin, R. E., Lake, C., & Groff, C. (2009) · Review of Educational Research · doi:10.3102/0034654308330968 · Cited by 281
Tackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617690042 · Cited by 251
The Desperate Need for Replications
Hunter, J. E. (2001) · Journal of Consumer Research · doi:10.1086/321953 · Cited by 280
Meaningful Mediation Analysis: Plausible Causal Inference and Informative Communication
Pieters, R. (2017) · Journal of Consumer Research · doi:10.1093/jcr/ucx081 · Cited by 266
Statistical Rituals: The Replication Delusion and How We Got There
Gigerenzer, G. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918771329 · Cited by 263
“Given the median total sample size of 40 in four representative journals (Journal of Abnormal Psychology, Journal of Applied Psychology, Journal of Experimental Psychology: Human Perception and Performance, and Developmental Psychology; Marszalek, Barber, Kohlhart, & Holmes, 2011) and the average meta-analytic effect…”
BackgroundInfluentialSelf-citationMisinterpretations of Significance: A Problem Students Share with Their Teachers?
Haller, H., & Krauss, S. (2002) · IPN - Institute for Science Education at the University of Kiel, Germany · doi:10.23668/psycharchives.12769 · Cited by 250
A Short (Personal) Future History of Revolution 2.0
Spellman, B. A. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615609918 · Cited by 213
Aguinis, H., Werner, S., Lanza Abbott, J., Angert, C., Park, J. H., & Kohlhausen, D. (2010) · Organizational Research Methods · doi:10.1177/1094428109333339 · Cited by 238
Minimizing the cost of environmental management decisions by optimizing statistical thresholds
Field, S. A., Tyre, A. J., Jonzén, N., Rhodes, J. R., & Possingham, H. P. (2004) · Ecology Letters · doi:10.1111/j.1461-0248.2004.00625.x · Cited by 236
Fiedler, K., Kutzner, F., & Krueger, J. I. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612462587 · Cited by 229
Multiple Imputation for Missing Data: Making the most of What you Know
Fichman, M., & Cummings, J. N. (2003) · Organizational Research Methods · doi:10.1177/1094428103255532 · Cited by 224
The Effect of Exercise on Global Self-Esteem: A Quantitative Review
Spence, J. C., McGannon, K. R., & Poon, P. (2005) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.27.3.311 · Cited by 223
Personal characteristics and job satisfaction of Greek teachers
Koustelios, A. D. (2001) · International Journal of Educational Management · doi:10.1108/eum0000000005931 · Cited by 221
Data Analysis: Continuing Issues in the Everyday Analysis of Psychological Data
Judd, C. M., McClelland, G. H., & Culhane, S. E. (1995) · Annual Review of Psychology · doi:10.1146/annurev.ps.46.020195.002245 · Cited by 216
The Null Ritual: What You Always Wanted to Know About Significance Testing but Were Afraid to Ask
Gigerenzer, G., Krauss, S., & Vitouch, O. (2004) · The SAGE Handbook of Quantitative Methodology for the Social Sciences · doi:10.4135/9781412986311.n21 · Cited by 205
“Th is result was widely cited, but did it change researchers’ practice? Sedlmeier and Gigerenzer (1989) checked the studies in the same journal, 24 years later, a time period that should allow for change.”
BackgroundSelf-citation
Metadata
- Authors
- Sedlmeier, P., & Gigerenzer, G.
- Venue
- Psychological Bulletin
- Published
- 1989-03
- Volume
- 105
- Issue
- 2
- Pages
- 309-316
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2155449866
- Cited by
- 748
- References
- 55
- Citations by year
- 2026: 3 · 2025: 7 · 2024: 7 · 2023: 14 · 2022: 22 · 2021: 30 · 2020: 23 · 2019: 30 · 2018: 34 · 2017: 35 · 2016: 26 · 2015: 26 · 2014: 30 · 2013: 24 · 2012: 25
- FWCI
- 27.89
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- other-oa
- Locations
- Psychological Bulletin (publishedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- statistical power, power analysis, effect size, multiple comparisons, non-significant results, null hypothesis significance testing, history of statistics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.