The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Abstract
It is well known that statistical power calculations can be valuable in planning an experiment. There is also a large literature advocating that power calculations be made whenever one performs a statistical test of a hypothesis and one obtains a statistically nonsignificant result. Advocates of such post-experiment power calculations claim the calculations should be used to aid in the interpretation of the experimental results. This approach, which appears in various forms, is fundamentally flawed. We document that the problem is extensive and present arguments to demonstrate the flaw in the logic.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Post-hoc power analysis is criticized because the type II error calculated using the results of negative clinical trials is always high, which sometimes leads to incorrect conclusions regarding power [13,14].”
From Sample size determination and power analysis using the G*Power software (2021) · cites this paper as [14]
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
Fundamentals of Biostatistics.
(1969) · Annals of Internal Medicine · doi:10.7326/0003-4819-70-4-873 · Cited by 4,573
Schuirmann, D. J. (1987) · Journal of Pharmacokinetics and Biopharmaceutics · doi:10.1007/bf01068419 · Cited by 2,696
Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00008 · Cited by 1,188
Toward Evidence-Based Medical Statistics. 2: The Bayes Factor
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00019 · Cited by 913
Statistical Power Analysis can Improve Fisheries Research and Management
Peterman, R. M. (1990) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/f90-001 · Cited by 788
The Journal of Wildlife Management
Voller, J., & Voller, J. (2011) · Journal of Wildlife Management · doi:10.1002/(issn)1937-2817 · Cited by 709
Goodman, S. N., & Berlin, J. A. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-3-199408010-00008 · Cited by 658
Bioequivalence trials, intersection-union tests and equivalence confidence sets
Berger, R. L., & Hsu, J. C. (1996) · Statistical Science · doi:10.1214/ss/1032280304 · Cited by 621
Research works printed but not linked: 3
- Anon, 1998, Animal Behavior, 55, i
- Hauck W. W., 1996, Statistical Science, 11, 303
- Smith A. D., 1983, The Compass of Sigma Gamma Epsilon, 61, 22
Cited by
Sorted by citations
Items 201–300 of 1,003
Tempelman, R. J. (2004) · PubMed · doi:10.2527/2004.8213_supple162x · Cited by 89
Vaessen, J., Rivas, A., Duvendack, M., Jones, R. P., Leeuw, F. L., Gils, G. H. C. V., Lukach, R., Holvoet, N., Bastiaensen, J., Hombrados, J. G., et al. (2014) · Campbell Systematic Reviews · doi:10.4073/csr.2014.8 · Cited by 90
Neutral and presumptive doubt perspectives of professional skepticism and auditor job outcomes
Cohen, J. R., Dalton, D. W., & Harp, N. L. (2017) · Accounting Organizations and Society · doi:10.1016/j.aos.2017.08.003 · Cited by 87
Once bitten, not necessarily shy? Determinants of foreign market re-entry commitment strategies
Surdu, I. M., Mellahi, K., & Glaister, K. W. (2018) · Journal of International Business Studies · doi:10.1057/s41267-018-0167-3 · Cited by 87
Charousset, C., Zaoui, A., Bellaïche, L., & Piterman, M. (2014) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2013.12.018 · Cited by 86
Pantalone, K. M., Kattan, M. W., Yu, C., Wells, B. J., Arrigain, S., Jain, A., Atreja, A., & Zimmerman, R. S. (2010) · Diabetes Care · doi:10.2337/dc10-0017 · Cited by 87
Cross, P. C., Heisey, D. M., Bowers, J., Hay, C., Wolhuter, J., Buss, P. E., Hofmeyr, M., Michel, A. L., Bengis, R. G., Bird, T. L. F., et al. (2008) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2008.01589.x · Cited by 86
Self-citationMarkert, J. A., Grant, P. R., Grant, B. R., Keller, L. F., Coombs, J. L., & Petren, K. (2004) · Heredity · doi:10.1038/sj.hdy.6800409 · Cited by 86
Risk Factors for Fast Visual Field Progression in Glaucoma
Kim, J. H., Rabiolo, A., Morales, E., Yu, F., Afifi, A. A., Nouri‐Mahdavi, K., & Caprioli, J. (2019) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2019.06.019 · Cited by 85
Simon, N., McGillivray, L., Roberts, N. P., Barawi, K., Lewis, C. E., & Bisson, J. I. (2019) · European Journal of Psychotraumatology · doi:10.1080/20008198.2019.1646092 · Cited by 84
With Little Power Comes Great Responsibility
Card, D., Henderson, P., Khandelwal, U., Jia, R., Mahowald, K., & Jurafsky, D. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.745 · Cited by 84
What did we learn from forty years of research on semantic interference? A Bayesian meta-analysis
Bürki, A., Elbuy, S., Madec, S., & Vasishth, S. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2020.104125 · Cited by 124
Improving transparency and scientific rigor in academic publishing
Prager, E. M., Chambers, K. E., Plotkin, J. L., McArthur, D. L., Bandrowski, A. E., Bansal, N., Martone, M. E., Bergstrom, H. C., Bespalov, A., & Graf, C. (2019) · Journal of Neuroscience Research · doi:10.1002/jnr.24340 · Cited by 83
Greenland, S. (2020) · Paediatric and Perinatal Epidemiology · doi:10.1111/ppe.12711 · Cited by 83
Treatment for ischial tuberosity avulsion fractures in adolescent athletes
Ferlic, P. W., Sadoghi, P., Singer, G., Kraus, T., & Eberl, R. (2013) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1007/s00167-013-2570-4 · Cited by 83
Do Women's Voices Provide Cues of the Likelihood of Ovulation? The Importance of Sampling Regime
Fischer, J., Semple, S., Kopp, G. H., Jürgens, R., Kruse, E., Heistermann, M., & Amir, O. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024490 · Cited by 83
Groh, M., Krishnan, N., McKenzie, D. J., & Vishwanath, T. (2016) · IZA Journal of Labor & Development · doi:10.1186/s40175-016-0055-9 · Cited by 87
Trends in nutrient intake among adults with diabetes in the United States: 1988–2004
Oza-Frank, R., Cheng, Y. J., Narayan, K. M. V., & Gregg, E. W. (2009) · Journal of the American Dietetic Association · doi:10.1016/j.jada.2009.04.007 · Cited by 82
Interference patterns in subject-verb agreement and reflexives revisited: A large-sample study
Jäger, L. A., Mertzen, D., Van Dyke, J. A., & Vasishth, S. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2019.104063 · Cited by 142
Got power? A systematic review of sample size adequacy in health professions education research
Cook, D. A., & Hatala, R. A. (2014) · Advances in Health Sciences Education · doi:10.1007/s10459-014-9509-5 · Cited by 82
Lee, M.-S. S., Eum, K.-D., Fang, S. C., Rodrigues, E., Modest, G. A., & Christiani, D. C. (2014) · International Journal of Cardiology · doi:10.1016/j.ijcard.2014.07.012 · Cited by 82
Eick, S. M., Goin, D. E., Chartres, N., Lam, J., & Woodruff, T. J. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01490-8 · Cited by 82
New labor management guidelines and changes in cesarean delivery patterns
Rosenbloom, J. I., Stout, M. J., Tuuli, M. G., Woolfolk, C., López, J. D., Macones, G. A., & Cahill, A. G. (2017) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2017.10.007 · Cited by 84
Moving Towards the Post p < 0.05 Era via the Analysis of Credibility
Matthews, R. (2019) · The American Statistician · doi:10.1080/00031305.2018.1543136 · Cited by 84
Why and how we should join the shift from significance testing to estimation
Berner, D., & Amrhein, V. (2022) · Journal of Evolutionary Biology · doi:10.1111/jeb.14009 · Cited by 87
Seagrass bed patchiness: effects on epifaunal communities in San Diego Bay, USA
Healey, D., & Hovel, K. A. (2004) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/j.jembe.2004.08.002 · Cited by 81
The Role of Oxytocin in the Dog–Owner Relationship
Marshall‐Pescini, S., Schaebs, F. S., Gaugg, A., Meinert, A. A., Deschner, T., & Range, F. (2019) · Animals · doi:10.3390/ani9100792 · Cited by 89
Changing importance of habitat structure across multiple spatial scales for three species of insects
Krawchuk, M. A., & Taylor, P. D. (2003) · Oikos · doi:10.1034/j.1600-0706.2003.12487.x · Cited by 80
Incidence and predictors of postdischarge nausea and vomiting in a 7-day population
Odom‐Forren, J., Jalota, L., Moser, D. K., Lennie, T. A., Hall, L. A., Holtman, J. R., Hooper, V. D., & Apfel, C. C. (2013) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2013.05.008 · Cited by 80
“Statistical Significance” and Statistical Reporting: Moving Beyond Binary
McShane, B. B., Bradlow, E. T., Lynch, J. G., & Meyer, R. J. (2023) · Journal of Marketing · doi:10.1177/00222429231216910 · Cited by 79
Stoeckli, S. J., Haerle, S. K., Strobel, K., Haile, S. R., Hany, T. F., & Schuknecht, B. (2011) · Head & Neck · doi:10.1002/hed.21764 · Cited by 79
Groh, M., Krishnan, N., McKenzie, D. J., & Vishwanath, T. (2016) · The Review of Economics and Statistics · doi:10.1162/rest_a_00584 · Cited by 79
Page, D. S., Boehm, P. D., Stubblefield, W. A., Parker, K. R., Gilfillan, E. S., Neff, J. M., & Maki, A. W. (2002) · Environmental Toxicology and Chemistry · doi:10.1002/etc.5620210715 · Cited by 79
The Realization of Scalar Inferences: Context Sensitivity without Processing Cost
Politzer‐Ahles, S., & Fiorentino, R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0063943 · Cited by 78
Berk, R. A., Barnes, G. C., Ahlman, L., & Kurtz, E. (2010) · Journal of Experimental Criminology · doi:10.1007/s11292-010-9095-3 · Cited by 78
Divided destinies: group choice by female savannah baboons during social group fission
HORN, R. C. V., Buchan, J. C., Jeanne Altmann, A., & Alberts, S. C. (2007) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-007-0415-1 · Cited by 78
The emergency life-history stage and immunity in the cricket, Gryllus texensis
Adamo, S. A., & Parsons, N. M. (2006) · Animal Behaviour · doi:10.1016/j.anbehav.2006.01.011 · Cited by 77
Validity Tests of Benefit Transfer ? Are We Performing the Wrong Tests?
Kristófersson, D. M., & Ståle Navrud, A. (2005) · Environmental and Resource Economics · doi:10.1007/s10640-004-2303-8 · Cited by 77
de Jonge, S., Tol, J. L., Weir, A., Waarsing, J. H., Verhaar, J. A. N., & de Vos, R. (2015) · The American Journal of Sports Medicine · doi:10.1177/0363546515605077 · Cited by 77
Frost, A. D. S., & Ledgerwood, A. (2020) · Journal of Pacific Rim Psychology · doi:10.1017/prp.2020.7 · Cited by 75
Constrained Labour: Maternal Employment When Children Have Disabilities
Gordon, M., Rosenman, L. S., & Cuskelly, M. (2006) · Journal of Applied Research in Intellectual Disabilities · doi:10.1111/j.1468-3148.2006.00325.x · Cited by 76
Estimating Population Mean Power Under Conditions of Heterogeneity and Selection for Significance
Brunner, J., & Schimmack, U. (2020) · Meta-Psychology · doi:10.15626/mp.2018.874 · Cited by 76
Inferential statistics in Language Teaching Research : A review and ways forward
Lindstromberg, S. (2016) · Language Teaching Research · doi:10.1177/1362168816649979 · Cited by 90
Tampin, B., Vollert, J., & Schmid, A. B. (2018) · Current Medical Research and Opinion · doi:10.1080/03007995.2018.1451313 · Cited by 76
Bamberger, P. A. (2019) · Academy of Management Discoveries · doi:10.5465/amd.2019.0121 · Cited by 82
Statistical power in retrieval experimentation
Webber, W., Moffat, A., & Zobel, J. (2008) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1458082.1458158 · Cited by 75
Clinical Characteristics of Severe Supracondylar Humerus Fractures in Children
Garg, S., Weller, A., Larson, A. N., Fletcher, N. D., Kwon, M. S., Schiller, J. R., Browne, R. H., Copley, L. A., & Ho, C. A. (2013) · Journal of Pediatric Orthopaedics · doi:10.1097/bpo.0b013e31829c0046 · Cited by 75
Kennealey, P. T., Elias, N., Hertl, M., Ko, D. S. C., Saidi, R. F., Markmann, J. F., Smoot, E. E., Schoenfeld, D., & Kawai, T. (2011) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2011.02.008 · Cited by 75
Salivary testosterone does not predict mental rotation performance in men or women
Puts, D. A., Cárdenas, R. A., Bailey, D. H., Burriss, R. P., Jordan, C. L., & Breedlove, S. M. (2010) · Hormones and Behavior · doi:10.1016/j.yhbeh.2010.03.005 · Cited by 89
Adam, C. E., Fitzpatrick, A. L., Leary, C. S., Hajat, A., Ilango, S. D., Park, C., Phelan, E. A., & Semmens, E. O. (2023) · BMC Geriatrics · doi:10.1186/s12877-023-03890-6 · Cited by 85
Impact of previous rotator cuff repair on the outcome of reverse shoulder arthroplasty
Sadoghi, P., Vavken, P., Leithner, A., Hochreiter, J., Weber, G., Pietschmann, M. F., & Müller, P. E. (2011) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2011.01.013 · Cited by 73
The Built Environment Moderates Effects of Family-Based Childhood Obesity Treatment over 2 Years
Epstein, L. H., Raja, S., Daniel, T. O., Paluch, R. A., Wilfley, D. E., Saelens, B. E., & Roemmich, J. N. (2012) · Annals of Behavioral Medicine · doi:10.1007/s12160-012-9383-4 · Cited by 73
Richard, C., Warszawski, J., & Anguel, N. (2004) · ACC Current Journal Review · doi:10.1016/j.accreview.2004.02.035 · Cited by 73
Play fighting does not affect subsequent fighting success in wild meerkats
Sharpe, L. L. (2005) · Animal Behaviour · doi:10.1016/j.anbehav.2004.07.013 · Cited by 72
Why Figures with Error Bars Should Replace p Values
Fidler, F. M., & Loftus, G. R. (2009) · Zeitschrift für Psychologie · doi:10.1027/0044-3409.217.1.27 · Cited by 77
Althouse, A. D., Below, J. E., Claggett, B. L., Cox, N. J., de Lemos, J. A., Deo, R. C., Duval, S., Hachamovitch, R., Kaul, S., Keith, S. W., et al. (2021) · Circulation · doi:10.1161/circulationaha.121.055393 · Cited by 74
Communication of Prognostic Information for Critically Ill Patients
LeClaire, M. M., Oakes, J. M., & Weinert, C. (2005) · CHEST Journal · doi:10.1378/chest.128.3.1728 · Cited by 71
Alas, A., Chinthakanan, O., Espaillat, L., Plowright, L. N., Davila, G. W., & Aguilar, V. C. (2016) · International Urogynecology Journal · doi:10.1007/s00192-016-3149-7 · Cited by 75
Leaching and recovery of gold from ore in cyanide-free glycine media
Altınkaya, P., Wang, Z., Korolev, I., Hamuyuni, J., Haapalainen, M., Kolehmainen, E., Yliniemi, K., & Lundström, M. (2020) · Minerals Engineering · doi:10.1016/j.mineng.2020.106610 · Cited by 70
Thompson‐Brenner, H., Franko, D. L., Thompson, D. R., Grilo, C. M., Boisseau, C. L., Roehrig, J. P., Richards, L. K., Bryson, S. W., Bulik, C. M., Crow, S. J., et al. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0032946 · Cited by 70
Statistical inference, Type II error, and decision making under the US Endangered Species Act
Brosi, B. J., & Biber, E. (2008) · Frontiers in Ecology and the Environment · doi:10.1890/080003 · Cited by 69
Risher, M., Fleming, R. L., Boutros, N., Semenova, S., Wilson, W. A., Levin, E. D., Markou, A., Swartzwelder, H. S., & Acheson, S. K. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062940 · Cited by 69
Kim, S. Y., Lee, K. H., Kim, K., Kim, T., Lee, H. S., Hwang, S.-S., Song, K., Kang, H. S., Kim, Y. H., & Rhee, J. E. (2011) · Radiology · doi:10.1148/radiol.11102247 · Cited by 69
Elango, R., Humayun, M. A., Ball, R. O., & Pencharz, P. B. (2009) · Journal of Nutrition · doi:10.3945/jn.108.101147 · Cited by 68
Consultants' forum: should post hoc sample size calculations be done?
Walters, S. J. (2008) · Pharmaceutical Statistics · doi:10.1002/pst.334 · Cited by 68
Does incorrect guessing impair fact learning?
Kang, S. H. K., Pashler, H., Cepeda, N. J., Rohrer, D., Carpenter, S. K., & Mozer, M. C. (2011) · Journal of Educational Psychology · doi:10.1037/a0021977 · Cited by 67
Training Load and Its Role in Injury Prevention, Part 2: Conceptual and Methodologic Pitfalls
Impellizzeri, F. M., McCall, A., Ward, P., Bornn, L., & Coutts, A. J. (2020) · Journal of Athletic Training · doi:10.4085/1062-6050-501-19 · Cited by 67
Pelletier, L., Chiaradia, A., Kato, A., & Ropert‐Coudert, Y. (2014) · Oecologia · doi:10.1007/s00442-014-3018-3 · Cited by 67
Extrapair paternity, song, and genetic quality in song sparrows
Hill, C. E., Akçay, Ç., Campbell, S. E., & Beecher, M. D. (2010) · Behavioral Ecology · doi:10.1093/beheco/arq171 · Cited by 67
Mueser, K. T., Glynn, S. M., Cather, C., Xie, H., Zárate, R. C., Smith, L. F., Clark, R. E., Gottlieb, J. D., Wolfe, R. S., & Feldman, J. (2012) · Schizophrenia Bulletin · doi:10.1093/schbul/sbr203 · Cited by 65
Wilson, C. J., Brain, R. A., Sanderson, H., Johnson, D. J., Bestari, K. T., Sibley, P. K., & Solomon, K. R. (2004) · Environmental Science & Technology · doi:10.1021/es049766f · Cited by 67
How to Statistically Show the Absence of an Effect
Quertemont, É. (2011) · Psychologica Belgica · doi:10.5334/pb-51-2-109 · Cited by 66
Guidelines for the Design and Conduct of Clinical Studies in Knee Articular Cartilage Repair
Mithoefer, K., Saris, D., Farr, J., Kon, E., Zaslav, K., Cole, B., Ranstam, J., Yao, J., Shive, M., Levine, D. W., et al. (2011) · Cartilage · doi:10.1177/1947603510392913 · Cited by 72
Interactive Dimensions in the Construction of Mental Representations for Text.
Rapp, D. N., & Taylor, H. A. (2004) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.30.5.988 · Cited by 66
Hippocampal gray matter volume in bilateral vestibular failure
Göttlich, M., Jandl, N. M., Sprenger, A., Wojak, J. F., Münte, T. F., Krämer, U. M., & Helmchen, C. (2016) · Human Brain Mapping · doi:10.1002/hbm.23152 · Cited by 67
Pascal, J. A., Bearer, E. L., Wang, Z., Koay, E. J., Curley, S. A., & Vittorio Cristini, C. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1300619110 · Cited by 65
A cerebellar substrate for cognition evolved multiple times independently in mammals
Smaers, J. B., Turner, A. H., Gómez‐Robles, A., & Sherwood, C. C. (2018) · eLife · doi:10.7554/elife.35696 · Cited by 67
The occurrence and correlates of emotional interdependence in romantic relationships.
Sels, L., Cabrieto, J., Butler, E. A., Reis, H. T., Ceulemans, E., & Kuppens, P. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000212 · Cited by 86
Sample Size in the Study of Behaviour
Michael Taborsky, A. (2010) · Ethology · doi:10.1111/j.1439-0310.2010.01751.x · Cited by 66
Comprehensive Stroke Centers and the ‘Weekend Effect’: The SPOTRIAS Experience
Albright, K. C., Savitz, S. I., Raman, R., Martin‐Schild, S., Broderick, J. P., Ernstrom, K. B., Ford, A. L., Khatri, R., Kleindorfer, D., Liebeskind, D. S., et al. (2012) · Cerebrovascular Diseases · doi:10.1159/000345077 · Cited by 64
Alday, P. M., Schlesewsky, M., & Bornkessel‐Schlesewsky, I. (2017) · eNeuro · doi:10.1523/eneuro.0311-16.2017 · Cited by 63
Temporal Variation in Trout Populations: Implications for Monitoring and Trend Detection
Dauwalter, D. C., Rahel, F. J., & Gerow, K. (2009) · Transactions of the American Fisheries Society · doi:10.1577/t07-154.1 · Cited by 63
What happened to Popperian falsification? Publishing neutral and negative findings
van Witteloostuijn, A. C. (2016) · Cross Cultural & Strategic Management · doi:10.1108/ccsm-03-2016-0084 · Cited by 63
Rossi, J. S. (2012) · Wiley eBooks · doi:10.1002/9781118133880.hop202003 · Cited by 64
Paredes, R., Jones, I. L., Boness, D. J., Tremblay, Y., & Renner, M. (2008) · Canadian Journal of Zoology · doi:10.1139/z08-036 · Cited by 62
Bos, I., Verhey, F. R. J., Ramakers, I. H. G. B., Jacobs, H. I. L., Soininen, H. S., Freund‐Levi, Y., Hampel, H. J., Tsolaki, M., Wallin, Å. K., van Buchem, M. A., et al. (2017) · Alzheimer s Research & Therapy · doi:10.1186/s13195-017-0328-9 · Cited by 62
EMPIRICAL EVIDENCE FOR NONSELECTIVE RECRUITMENT AND A SOURCE–SINK DYNAMIC IN A MAYFLY METAPOPULATION
Caudill, C. C. (2003) · Ecology · doi:10.1890/0012-9658(2003)084[2119:eefnra]2.0.co;2 · Cited by 62
Doyle, N., McDowall, A., & Waseem, U. (2022) · Autism in Adulthood · doi:10.1089/aut.2021.0082 · Cited by 71
Effect of road deicing salt on the susceptibility of amphibian embryos to infection by water molds
Karraker, N. E., & Ruthig, G. R. (2008) · Environmental Research · doi:10.1016/j.envres.2008.09.001 · Cited by 61
Risk of Kidney Injury Following Oral Phosphosoda Bowel Preparations
Brunelli, S. M., Lewis, J. D., Gupta, M., Latif, S. M., Weiner, M. G., & Feldman, H. I. (2007) · Journal of the American Society of Nephrology · doi:10.1681/asn.2007040440 · Cited by 61
Inference without significance: measuring support for hypotheses rather than rejecting them
Gerrodette, T. (2011) · Marine Ecology · doi:10.1111/j.1439-0485.2011.00466.x · Cited by 57
Improving transparency and scientific rigor in academic publishing
Prager, E. M., Chambers, K. E., Plotkin, J. L., McArthur, D. L., Bandrowski, A. E., Bansal, N., Martone, M. E., Bergstrom, H. C., Bespalov, A., & Graf, C. (2018) · Brain and Behavior · doi:10.1002/brb3.1141 · Cited by 70
Loescher, H. W., Ayres, E., Duffy, P. A., Luo, H., & Max, B. (2014) · PLoS ONE · doi:10.1371/journal.pone.0083216 · Cited by 60
Radley, J. J., & Sawchenko, P. E. (2015) · The Journal of Comparative Neurology · doi:10.1002/cne.23815 · Cited by 58
Recent cannabis use and myocardial infarction in young adults: a cross-sectional study
Ladha, K. S., Mistry, N., Wijeysundera, D. N., Clarke, H. A., Verma, S., Hare, G. M. T., & Mazer, C. D. (2021) · Canadian Medical Association Journal · doi:10.1503/cmaj.202392 · Cited by 61
Post‐hoc power analysis: a conceptually valid approach for power based on observed study data
Quach, N. E., Yang, K. Y., Chen, R., Tu, J. S. Y., Xu, M., Tu, X. M., & Zhang, X. (2022) · General Psychiatry · doi:10.1136/gpsych-2022-100764 · Cited by 59
Play does not enhance social cohesion in a cooperative mammal
Sharpe, L. L. (2005) · Animal Behaviour · doi:10.1016/j.anbehav.2004.08.025 · Cited by 59
Krist, M., Remeš, V., Uvírová, L., Nádvorník, P., & Bureš, S. (2004) · Oecologia · doi:10.1007/s00442-004-1568-5 · Cited by 59
The Prevalence of Negative Studies with Inadequate Statistical Power
Chung, K. C., Kalliainen, L. K., Spilson, S. V., Walters, M. R., Kim, H. M., & Chung, K. C. (2002) · Plastic & Reconstructive Surgery · doi:10.1097/00006534-200201000-00001 · Cited by 59
Specification Searching and Significance Inflation Across Time, Methods and Disciplines
Vivalt, E. (2019) · Oxford Bulletin of Economics and Statistics · doi:10.1111/obes.12289 · Cited by 58
Metadata
- Authors
- Hoenig, J. M., & Heisey, D. M.
- Affiliations
- University of Wisconsin–Madison (US)
- ORCID
- Hoenig, John M
- Venue
- The American Statistician
- Publisher
- Informa UK Limited
- Published
- 2001-02
- Volume
- 55
- Issue
- 1
- Pages
- 19-24
- ISSN
- 0003-1305 (ISSN-L)
- 1537-2731
- OpenAlex
- W2069523442
- Cited by
- 2,046
- References
- 38
- Citations by year
- 2026: 213 · 2025: 104 · 2024: 80 · 2023: 97 · 2022: 111 · 2021: 111 · 2020: 124 · 2019: 131 · 2018: 103 · 2017: 87 · 2016: 90 · 2015: 79 · 2014: 84 · 2013: 89 · 2012: 79
- FWCI
- 42.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The American Statistician (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- statistical power, non-significant results, experimental design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review