Cited by 2,046Statistical Methods and Bayesian InferenceStatistical Methods in Clinical TrialsStatistical Methods in Epidemiology

The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.

The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis

Hoenig, John M, Heisey, Dennis M·2001·The American Statistician

DOI 10.1198/000313001300339897

Open this paper in CoChat — free account

Abstract

It is well known that statistical power calculations can be valuable in planning an experiment. There is also a large literature advocating that power calculations be made whenever one performs a statistical test of a hypothesis and one obtains a statistically nonsignificant result. Advocates of such post-experiment power calculations claim the calculations should be used to aid in the interpretation of the experimental results. This approach, which appears in various forms, is fundamentally flawed. We document that the problem is extensive and present arguments to demonstrate the flaw in the logic.

Integrity signals

Registry

Crossref · 10.1198/000313001300339897

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
Statistical power analysis
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
Fundamentals of Biostatistics.
(1969) · Annals of Internal Medicine · doi:10.7326/0003-4819-70-4-873 · Cited by 4,573
A comparison of the Two One-Sided Tests Procedure and the Power Approach for assessing the equivalence of average bioavailability
Schuirmann, D. J. (1987) · Journal of Pharmacokinetics and Biopharmaceutics · doi:10.1007/bf01068419 · Cited by 2,696
Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00008 · Cited by 1,188
Toward Evidence-Based Medical Statistics. 2: The Bayes Factor
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00019 · Cited by 913
Statistical Power Analysis can Improve Fisheries Research and Management
Peterman, R. M. (1990) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/f90-001 · Cited by 788
The Journal of Wildlife Management
Voller, J., & Voller, J. (2011) · Journal of Wildlife Management · doi:10.1002/(issn)1937-2817 · Cited by 709
The Use of Predicted Confidence Intervals When Planning Experiments and the Misuse of Power When Interpreting Results
Goodman, S. N., & Berlin, J. A. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-3-199408010-00008 · Cited by 658
Bioequivalence trials, intersection-union tests and equivalence confidence sets
Berger, R. L., & Hsu, J. C. (1996) · Statistical Science · doi:10.1214/ss/1032280304 · Cited by 621

Show all 38 references

Research works printed but not linked: 3

Anon, 1998, Animal Behavior, 55, i
Hauck W. W., 1996, Statistical Science, 11, 303
Smith A. D., 1983, The Compass of Sigma Gamma Epsilon, 61, 22

Sorted by citations

G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
The ASA Statement on p -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199
Relaxing the Rule of Ten Events per Variable in Logistic and Cox Regression
Vittinghoff, E., & McCulloch, C. E. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwk052 · Cited by 4,359
Distance‐Based Tests for Homogeneity of Multivariate Dispersions
Anderson, M. J. (2006) · Biometrics · doi:10.1111/j.1541-0420.2005.00440.x · Cited by 3,304
Inbreeding effects in wild populations
Keller, L. F. (2002) · Trends in Ecology & Evolution · doi:10.1016/s0169-5347(02)02489-8 · Cited by 3,375
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations
Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016) · European Journal of Epidemiology · doi:10.1007/s10654-016-0149-3 · Cited by 3,200
Sample size determination and power analysis using the G*Power software
Kang, H. (2021) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2021.18.17 · Cited by 2,572
SIMR : an R package for power analysis of generalized linear mixed models by simulation
Green, P., & MacLeod, C. J. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12504 · Cited by 2,467
The Essential Guide to Effect Sizes: Statistical Power, Meta-Analysis, and the Interpretation of Research Results
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
Un sistema de clasificación de los diseños de investigación en psicología
Ato, M., López-García, J. J., & Benavente, A. (2013) · Anales de Psicología · doi:10.6018/analesps.29.3.178511 · Cited by 2,254
A farewell to Bonferroni: the problems of low statistical power and publication bias
Nakagawa, S. (2004) · Behavioral Ecology · doi:10.1093/beheco/arh107 · Cited by 2,102
Sample Size Justification
Lakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
Bayesian estimation supersedes the t-test
Kruschke, J. K. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0029146 · Cited by 1,530
Beyond Power Calculations: Assessing Type S (Sign) and Type M (Magnitude) Errors
Gelman, A., & Carlin, J. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614551642 · Cited by 1,343
How Many Studies Do You Need?: A Primer on Statistical Power for Meta-Analysis
Valentine, J. C., Pigott, T. D., & Rothstein, H. R. (2010) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998609346961 · Cited by 1,294
Effect Size and Power in Assessing Moderating Effects of Categorical Variables Using Multiple Regression: A 30-Year Review.
Aguinis, H., Beaty, J. C., Boik, R. J., & Pierce, C. A. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.1.94 · Cited by 1,216
Some Practical Guidelines for Effective Sample Size Determination
Lenth, R. (2001) · The American Statistician · doi:10.1198/000313001317098149 · Cited by 1,200
How Many Participants Do We Have to Include in Properly Powered Experiments? A Tutorial of Power Analysis with Reference Tables
Brysbaert, M. (2019) · Journal of Cognition · doi:10.5334/joc.72 · Cited by 996
Sample Size Estimation: How Many Individuals Should Be Studied?
Eng, J. (2003) · Radiology · doi:10.1148/radiol.2272012051 · Cited by 811
Bayesian Methods for Ecology
Mccarthy, M. A. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511802454 · Cited by 758
. Caution regarding the use of pilot studies to guide power calculations for study proposals.
Kraemer, H. C., Mintz, J., Noda, A., Tinklenberg, J., & Yesavage, J. A. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.5.484 · Cited by 702
Early Use of the Pulmonary Artery Catheter and Outcomes in Patients With Shock and Acute Respiratory Distress Syndrome A Randomized Controlled Trial
Richard, C. (2003) · JAMA · doi:10.1001/jama.290.20.2713 · Cited by 677
MorePower 6.0 for ANOVA with relational confidence intervals and Bayesian analysis
Campbell, J. I. D., & Thompson, V. A. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0186-0 · Cited by 701
Predicting the cost of environmental management system adoption: the role of capabilities, resources and ownership structure
Darnall, N., & Edwards, D. D. (2006) · Strategic Management Journal · doi:10.1002/smj.518 · Cited by 634
Power analysis for random-effects meta-analysis
Jackson, D., & Turner, R. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1240 · Cited by 619
Platelet‐Rich Plasma Intra‐Articular Injection Versus Hyaluronic Acid Viscosupplementation as Treatments for Cartilage Pathology: From Early Degeneration to Osteoarthritis
Kon, E., Mandelbaum, B. R., Buda, R., Filardo, G., Delcogliano, M., Timoncini, A., Fornasari, P. M., Giannini, S., & Marcacci, M. (2011) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2011.05.011 · Cited by 588
Estimating power in (generalized) linear mixed models: An open introduction and tutorial in R
Kumle, L., Võ, M. L.-H., & Draschkow, D. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01546-0 · Cited by 552
Sample Size Planning for Statistical Power and Accuracy in Parameter Estimation
Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093735 · Cited by 542
Reporting of stepped wedge cluster randomised trials: extension of the CONSORT 2010 statement with explanation and elaboration
Hemming, K., Taljaard, M., McKenzie, J. E., Hooper, R., Copas, A., Thompson, J. A., Dixon-Woods, M., Aldcroft, A., Doussau, A., Grayling, M., et al. (2018) · BMJ · doi:10.1136/bmj.k1614 · Cited by 475
Why most conservation monitoring is, but need not be, a waste of time.
Legg, C., & Nagy, L. (2006) · Journal of Environmental Management · doi:10.1016/j.jenvman.2005.04.016 · Cited by 480
Contingent Political Capital and International Alliances: Evidence from South Korea
Siegel, J. I. (2007) · Administrative Science Quarterly · doi:10.2189/asqu.52.4.621 · Cited by 465
Suggestions for Presenting the Results of Data Analyses
Anderson, D. R., Link, W. A., Johnson, D. H., & Burnham, K. P. (2001) · Journal of Wildlife Management · doi:10.2307/3803088 · Cited by 468
The ironic effect of significant results on the credibility of multiple-study articles.
Schimmack, U. (2012) · Psychological Methods · doi:10.1037/a0029487 · Cited by 455
Heterogeneity of Psychosis Risk Within Individuals at Clinical High Risk: A Meta-analytical Stratification
Fusar-Poli, P., Cappucciati, M., Borgwardt, S., Woods, S. W., Addington, J., Nelson, B., Nieman, D. H., Stahl, D. R., Rutigliano, G., Riecher-Rössler, A., et al. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.2324 · Cited by 440
Effect Size, Statistical Power, and Sample Size Requirements for the Bootstrap Likelihood Ratio Test in Latent Class Analysis
Dziak, J. J., Lanza, S. T., & Tan, X. (2014) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2014.919819 · Cited by 441
Robust misinterpretation of confidence intervals
Hoekstra, R., Morey, R. D., Rouder, J. N., & Wagenmakers, E.-J. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0572-3 · Cited by 425
Applied Longitudinal Data Analysis for Epidemiology: A Practical Guide
Hu, X. J. (2004) · Journal of the American Statistical Association · doi:10.1198/jasa.2004.s366 · Cited by 440
The N-Pact Factor: Evaluating the Quality of Empirical Journals with Respect to Sample Size and Statistical Power
Fraley, R. C., & Vazire, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109019 · Cited by 409
Statistics in Brief: The Importance of Sample Size in the Planning and Interpretation of Medical Research
Biau, D. J., Kernéis, S., & Porcher, R. (2008) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-008-0346-9 · Cited by 428
Bayesian alternatives for common null-hypothesis significance tests in psychiatry: a non-technical guide using JASP
Quintana, D. S., & Williams, D. R. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1761-4 · Cited by 451
Testing differences between nested covariance structure models: Power analysis and null hypotheses.
Maccallum, R., Browne, M., & Cai, L. (2006) · Psychological methods · doi:10.1037/1082-989x.11.1.19 · Cited by 374
Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars
Mayo, D. G. (2018) · doi:10.1017/9781107286184 · Cited by 376
Post hoc power analysis: is it an informative and meaningful analysis?
Zhang, Y., Hedo, R., Rivera, A. C., Rull, R. P., Richardson, S. M., & Tu, X. M. (2019) · General Psychiatry · doi:10.1136/gpsych-2019-100069 · Cited by 374
Application of statistical power analysis – How to determine the right sample size in human health, comfort and productivity research
Lan, L., & Lian, Z. (2009) · Building and Environment · doi:10.1016/j.buildenv.2009.11.002 · Cited by 359
Measuring individual differences in reaction norms in field and experimental studies: a power analysis of random regression models
Martin, J. G. A., Nussey, D. H., Wilson, A. J., & Réale, D. J. F. (2010) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2010.00084.x · Cited by 358
A Comprehensive Review of Effect Size Reporting and Interpreting Practices in Academic Journals in Education and Psychology.
Sun, S.-Y., Pan, W., & Wang, L. (2010) · Journal of Educational Psychology · doi:10.1037/a0019507 · Cited by 329
Global mycorrhizal plant distribution linked to terrestrial carbon stocks
Soudzilovskaia, N. A., van Bodegom, P. M., Terrer, C., Zelfde, M. V., McCallum, I., McCormack, M., Fisher, J. B., Brundrett, M. C., de Sá, N. C., & Tedersoo, L. (2019) · Nature Communications · doi:10.1038/s41467-019-13019-2 · Cited by 340
Left Ventricular Concentric Geometry During Treatment Adversely Affects Cardiovascular Prognosis in Hypertensive Patients
Muiesan, M. L., Salvetti, M., Monteduro, C., Bonzi, B., Paini, A., Viola, S., Poisa, P., Rizzoni, D., Castellano, M., & Agabiti‐Rosei, E. (2004) · Hypertension · doi:10.1161/01.hyp.0000121223.44837.de · Cited by 330
The effectiveness of Multisystemic Therapy (MST): A meta-analysis
van der Stouwe, T., Asscher, J. J., Stams, G. J. J. M., Deković, M., & van der Laan, P. H. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.06.006 · Cited by 352
Outcome of Nonoperative Treatment of Symptomatic Rotator Cuff Tears Monitored by Magnetic Resonance Imaging
Maman, E., Harris, C., White, L. M., TOMLINSON, G. A., Shashank, M., & Boynton, E. L. (2009) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.g.01335 · Cited by 300
A survey of the statistical power of research in behavioral ecology and animal behavior
Jennions, M. D. (2003) · Behavioral Ecology · doi:10.1093/beheco/14.3.438 · Cited by 278
Voxelwise genome-wide association study (vGWAS)
Stein, J. L., Hua, X., Lee, S., Ho, A. J., Leow, A., Toga, A. W., Saykin, A. J., Shen, L., Foroud, T., Pankratz, N., et al. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.02.032 · Cited by 276
Repeatable evaluation of search services in dynamic environments
Jensen, E. C., Beitzel, S. M., Chowdhury, A., & Frieder, O. (2007) · ACM Transactions on Information Systems · doi:10.1145/1292591.1292592 · Cited by 269
Comparison of the Performance of Nonparametric and Parametric MANOVA Test Statistics when Assumptions Are Violated
Finch, H. (2005) · Methodology · doi:10.1027/1614-1881.1.1.27 · Cited by 267
A CHecklist for statistical Assessment of Medical Papers (the CHAMP statement): explanation and elaboration
Mansournia, M. A., Collins, P. G. S., Nielsen, R. O., Nazemipour, M., Jewell, N. P., Altman, D. G., & Campbell, M. J. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-103652 · Cited by 268
Single versus Multifraction Stereotactic Radiosurgery for Large Brain Metastases: An International Meta-analysis of 24 Trials
Lehrer, E. J., Peterson, J., Zaorsky, N. G., Brown, P. D., Sahgal, A., Chiang, V., Chao, S. T., Sheehan, J. P., & Trifiletti, D. M. (2018) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2018.10.038 · Cited by 261
Intravenous Contrast Material Exposure Is Not an Independent Risk Factor for Dialysis or Mortality
McDonald, R. J., McDonald, J. S., Carter, R. E., Hartman, R. P., Katzberg, R. W., Kallmes, D. F., & Williamson, E. E. (2014) · Radiology · doi:10.1148/radiol.14132418 · Cited by 264
A Functional Genetic Variation of the Serotonin (5-HT) Transporter Affects 5-HT1AReceptor Binding in Humans
David, S. P., Murthy, N. V., Rabiner, E. A., Munafo, M. R., Johnstone, E. C., Jacob, R., Walton, R. T., & Grasby, P. M. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.3769-04.2005 · Cited by 257
Confidence intervals are a more useful complement to nonsignificant tests than are power calculations
Colegrave, N. (2003) · Behavioral Ecology · doi:10.1093/beheco/14.3.446 · Cited by 251
Sample size determination for image classification accuracy assessment and comparison
Foody, G. M. (2009) · International Journal of Remote Sensing · doi:10.1080/01431160903130937 · Cited by 248
Providing education on evidence-based practice improved knowledge but did not change behaviour: a before and after study
McCluskey, A., & Lovarini, M. (2005) · BMC Medical Education · doi:10.1186/1472-6920-5-40 · Cited by 246
Brief Report: Post Hoc Power, Observed Power, A Priori Power, Retrospective Power, Prospective Power, Achieved Power: Sorting Out Appropriate Uses of Statistical Power Analyses
O’Keefe, D. J. (2007) · Communication Methods and Measures · doi:10.1080/19312450701641375 · Cited by 249
Improving the Dependability of Research in Personality and Social Psychology
Funder, D. C., Levine, J. M., Mackie, D. M., Morf, C. C., Sansone, C., Vazire, S., & West, S. G. (2013) · Personality and Social Psychology Review · doi:10.1177/1088868313507536 · Cited by 299
Vaginal progesterone is associated with a decrease in risk for early preterm birth and improved neonatal outcome in women with a short cervix: a secondary analysis from a randomized, double‐blind, placebo‐controlled trial
Franco, E. A. D., O’Brien, J., Adair, C. D., Lewis, D. F., Hall, D. R., Fusey, S., Soma‐Pillay, P., Porter, K. B., How, H., Schackis, R. C., et al. (2007) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.5159 · Cited by 238
Association of Telemedicine for Remote Monitoring of Intensive Care Patients With Mortality, Complications, and Length of Stay
Thomas, E. J. (2009) · JAMA · doi:10.1001/jama.2009.1902 · Cited by 245
How Many Participants Do I Need to Test an Interaction? Conducting an Appropriate Power Analysis and Achieving Sufficient Power to Detect an Interaction
Sommet, N., Weissman, D. L., Cheutin, N., & Elliot, A. J. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231178728 · Cited by 313
Current sample size conventions: Flaws, harms, and alternatives
Bacchetti, P. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-17 · Cited by 231
What meta-analyses reveal about the replicability of psychological research.
Stanley, T. D., Carter, E. C., & Doucouliagos, H. (2018) · Psychological Bulletin · doi:10.1037/bul0000169 · Cited by 307
Classification accuracy comparison: Hypothesis tests and the use of confidence intervals in evaluations of difference, equivalence and non-inferiority
Foody, G. M. (2009) · Remote Sensing of Environment · doi:10.1016/j.rse.2009.03.014 · Cited by 232
What makes and what does not make a real option? A study of equity shares in international joint ventures
Cuypers, I. R. P., & Martín, X. (2009) · Journal of International Business Studies · doi:10.1057/jibs.2009.17 · Cited by 232
Power Analysis, Sample Size, and Assessment of Statistical Assumptions—Improving the Evidential Value of Lighting Research
Uttley, J. (2019) · LEUKOS The Journal of the Illuminating Engineering Society of North America · doi:10.1080/15502724.2018.1533851 · Cited by 217
Power to Detect What? Considerations for Planning and Evaluating Sample Size
Giner‐Sorolla, R., Montoya, A. K., Reifman, A. S., Carpenter, T., Lewis, N. A., Aberson, C. L., Bostyn, D. H., Conrique, B. G., Ng, B., Schoemann, A. M., et al. (2024) · Personality and Social Psychology Review · doi:10.1177/10888683241228328 · Cited by 324
I can see clearly now: Reinterpreting statistical significance
Dushoff, J. G., Kain, M. P., & Bolker, B. M. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13159 · Cited by 211
The statistical significance filter leads to overoptimistic expectations of replicability
Vasishth, S., Mertzen, D., Jäger, L. A., & Gelman, A. (2018) · Journal of Memory and Language · doi:10.1016/j.jml.2018.07.004 · Cited by 200
The interpretation of statistical power after the data have been gathered
Dziak, J. J., Dierker, L., & Abar, B. W. (2018) · Current Psychology · doi:10.1007/s12144-018-0018-1 · Cited by 230
Bergmann’s Rule in Ectotherms: A Test Using Freshwater Fishes
Belk, M. C., & Houston, D. D. (2002) · The American Naturalist · doi:10.1086/343880 · Cited by 198
Direct Access Compared With Referred Physical Therapy Episodes of Care: A Systematic Review
Ojha, H. A., Snyder, R. S., & Davenport, T. E. (2013) · Physical Therapy · doi:10.2522/ptj.20130096 · Cited by 189
Osteoporosis-related fracture case definitions for population-based administrative data
Lix, L. M., Azimaee, M., Osman, B. A., Caetano, P. A., Morin, S. N., Metge, C. J., Goltzman, D., Kreiger, N., Prior, J. C., & Leslie, W. D. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-301 · Cited by 188
The “Costs” of Urinary Incontinence for Women
Subak, L. L., Brown, J. S., Kraus, S. R., Brubaker, L. T., Lin, F., Richter, H. E., Bradley, C. S., & Grady, D. G. (2006) · Obstetrics and Gynecology · doi:10.1097/01.aog.0000206213.48334.09 · Cited by 183
Citizen science reveals trends in bat populations: The National Bat Monitoring Programme in Great Britain
Barlow, K. E., Briggs, P. A., Haysom, K. A., HUTSON, A. M., Lechiara, N. L., Racey, P. A., Walsh, A. L., & Langton, S. D. (2014) · Biological Conservation · doi:10.1016/j.biocon.2014.11.022 · Cited by 182
An Investigation of U.S. Critical Audit Matter Disclosures
Burke, J. J., Hoitash, R., Hoitash, U., & Xiao, S. (2020) · The Accounting Review · doi:10.2308/tar-2021-0013 · Cited by 192
What's in a Name? Initial Evidence of U.S. Audit Partner Identification Using Difference-in-Differences Analyses
Cunningham, L. M., Li, C., Stein, S. E., & Wright, N. S. (2018) · The Accounting Review · doi:10.2308/accr-52305 · Cited by 178
A power calculation guide for fMRI studies
Mumford, J. A. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss059 · Cited by 171
Pinpointing needles in giant haystacks: use of text mining to reduce impractical screening workload in extremely large scoping reviews
Shemilt, I., Simon, A., Hollands, G. J., Marteau, T. M., Ogilvie, D., O'Mara‐Eves, A., Kelly, M. P., & Thomas, J. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1093 · Cited by 170
The impact of transgenic plants on natural enemies: a critical review of laboratory studies
Löveï, G. L., & Arpaia, S. (2005) · Entomologia Experimentalis et Applicata · doi:10.1111/j.0013-8703.2005.00235.x · Cited by 165
Statistical power calculations1
Lenth, R. V. (2007) · Journal of Animal Science · doi:10.2527/jas.2006-449 · Cited by 169
Enhancing Rigor in Quantitative Entrepreneurship Research
MAULA, M. V. J., & Stam, W. (2019) · Entrepreneurship Theory and Practice · doi:10.1177/1042258719891388 · Cited by 190
IDENTIFYING ECOLOGICAL CHANGE AND ITS CAUSES: A CASE STUDY ON CORAL REEFS
Fabricius, K., & De’ath, G. (2004) · Ecological Applications · doi:10.1890/03-5320 · Cited by 168
Statistical considerations for reporting and planning heart rate variability case‐control studies
Quintana, D. S. (2017) · Psychophysiology · doi:10.1111/psyp.12798 · Cited by 192
Practical Sample Size Calculations for Surveillance and Diagnostic Investigations
Fosgate, G. T. (2009) · Journal of Veterinary Diagnostic Investigation · doi:10.1177/104063870902100102 · Cited by 162
On the Post Hoc Power in Testing Mean Differences
Yuan, K.-H., & Maxwell, S. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030002141 · Cited by 168
Quality of life in patients with allergic contact dermatitis
Kadyk, D. L., McCarter, K. S., Achen, F., & Belsito, D. V. (2003) · Journal of the American Academy of Dermatology · doi:10.1016/s0190-9622(03)02112-1 · Cited by 160
A meta-meta-analysis: Empirical review of statistical power, type I error rates, effect sizes, and model selection of meta-analyses published in psychology
Cafri, G., Kromrey, J. D., & Brannick, M. T. (2010) · Multivariate Behavioral Research · doi:10.1080/00273171003680187 · Cited by 156
Differing effects of denosumab and alendronate on cortical and trabecular bone
Zebaze, R., Libanati, C. R., Austin, M., Ghasemzadeh, A., Hanley, D. A., Zanchetta, J., Thomas, T., Boutroy, S., Bogado, C. E., Bilezikian, J. P., et al. (2013) · Bone · doi:10.1016/j.bone.2013.11.016 · Cited by 158
How much baseline correction do we need in ERP research? Extended GLM model can replace baseline correction while lifting its limits
Alday, P. M. (2019) · Psychophysiology · doi:10.1111/psyp.13451 · Cited by 192
Are 60-Minute Prolonged Exposure Sessions With 20-Minute Imaginal Exposure to Traumatic Memories Sufficient to Successfully Treat PTSD? A Randomized Noninferiority Clinical Trial
Nacasch, N., Huppert, J. D., Su, Y., Kivity, Y., Dinstein, Y., Yeh, R., & Foa, E. B. (2014) · Behavior Therapy · doi:10.1016/j.beth.2014.12.002 · Cited by 162
The response of Arctic vegetation and soils following an unusually severe tundra fire
Bret-Harte, M. S., Mack, M. C., Shaver, G. R., Huebner, D. C., Johnston, M. R., Mojica, C. A., Pizano, C., & Reiskind, J. A. (2013) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2012.0490 · Cited by 151
Monte Carlo based statistical power analysis for mediation models: methods and software
Zhang, Z. J. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0424-0 · Cited by 150

Authors: Hoenig, J. M., & Heisey, D. M.
Affiliations: University of Wisconsin–Madison (US)
ORCID: Hoenig, John M
Venue: The American Statistician
Publisher: Informa UK Limited
Published: 2001-02
Volume: 55
Issue: 1
Pages: 19-24
ISSN: 0003-1305 (ISSN-L)
1537-2731
DOI: 10.1198/000313001300339897
OpenAlex: W2069523442
Cited by: 2,046
References: 38
Citations by year: 2026: 213 · 2025: 104 · 2024: 80 · 2023: 97 · 2022: 111 · 2021: 111 · 2020: 124 · 2019: 131 · 2018: 103 · 2017: 87 · 2016: 90 · 2015: 79 · 2014: 84 · 2013: 89 · 2012: 79
FWCI: 42.63
Type: journal article
Language: en
Open access: closed
Locations: The American Statistician (publishedVersion)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords: statistical power, non-significant results, experimental design

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks