Cited by 3,200Statistics Education and MethodologiesStatistical Methods in EpidemiologyMeta-analysis and systematic reviews

The DOI matches its Crossref record; 130 of the 135 references it cites were found in a registry or an index, and 1 are not checked yet.

Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations

Open access

Greenland, Sander, Senn, Stephen J., Rothman, Kenneth J., Carlin, John B., Poole, Charles, Goodman, Steven N., Altman, Douglas G.·2016·European Journal of Epidemiology

DOI 10.1007/s10654-016-0149-3PMC PMC4877414

Open this paper in CoChat — free account Open PDF

Abstract

Misinterpretation and abuse of statistical tests, confidence intervals, and statistical power have been decried for decades, yet remain rampant. A key problem is that there are no interpretations of these concepts that are at once simple, intuitive, correct, and foolproof. Instead, correct use and interpretation of these statistics requires an attention to detail which seems to tax the patience of working scientists. This high cognitive demand has led to an epidemic of shortcut definitions and interpretations that are simply wrong, sometimes disastrously so-and yet these misinterpretations dominate much of the scientific literature. In light of this problem, we provide definitions and a discussion of basic statistics that are more general and critical than typically found in traditional introductory expositions. Our goal is to provide a resource for instructors, researchers, and consumers of statistics whose knowledge of statistical theory and technique may be limited but who wish to avoid and spot misinterpretations. We emphasize how violation of often unstated analysis protocols (such as selecting analyses for presentation based on the P values they produce) can lead to small P values even if the declared test hypothesis is correct, and can lead to large P values even if that hypothesis is incorrect. We then provide an explanatory list of 25 misinterpretations of P values, confidence intervals, and power. We conclude with guidelines for improving statistical interpretation and reporting.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1007/s10654-016-0149-3

Cites

130 of 131 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Introduction to Meta‐Analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Introduction to Meta‐Analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
The environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,804
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Association between Water Intake, Chronic Kidney Disease, and Cardiovascular Disease: A Cross-Sectional Analysis of NHANES Data
Sontrop, J. M., Dixon, S. N., Garg, A. X., Jiménez, I. B., Dohein, O., Huang, S. S., & Clark, W. F. (2013) · American Journal of Nephrology · doi:10.1159/000350377 · Cited by 5,903
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
The earth is round (p < .05).
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Theoretical Statistics
Cox, D. R., & Hinkley, D. V. (1974) · doi:10.1007/978-1-4899-2887-0 · Cited by 3,089
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490

Flagged first, then by citations

Show all 135 references

4 of the 135 references couldn’t be matched to a known paper.

Research works printed but not linked: 12

Ashworth A. Veto on the use of null hypothesis testing and p intervals: right or wrong? Taylor & Francis Editor. 2015. Resources online, http://editorresources.taylorandfrancisgroup.com/veto-on-the-use-of-null-hypothesis-testing-and-p-intervals-right-or-wrong/ . Accessed 27 Feb 2016.
Flanagan O. Journal’s ban on null hypothesis significance testing: reactions from the statistical arena. 2015. Stats Life online, https://www.statslife.org.uk/opinion/2114-journal-s-ban-on-null-hypothesis-significance-testing-reactions-from-the-statistical-arena . Accessed 27 Feb 2016.
Cox DR. The role of significance tests (with discussion). Scand J Stat. 1977;4:49–70.
Freedman DA, Pisani R, Purves R. Statistics. 4th ed. New York: Norton; 2007.
Hogben L. Statistical theory. London: Allen and Unwin; 1957.
Ware JH, Mosteller F, Ingelfinger JA. p-Values. In: Bailar JC, Hoaglin DC, editors. Ch. 8. Medical uses of statistics. 3rd ed. Hoboken, NJ: Wiley; 2009. p. 175–94.
Gigerenzer G. Mindless statistics. J Socioecon. 2004;33:567–606.
Greenland S, Poole C. Problems in common interpretations of statistics in scientific articles, expert reports, and testimony. Jurimetrics. 2011;51:113–29.
Kaye DH. Is proof of statistical significance relevant? Wash Law Rev. 1986;61:1333–66.
Royall R. Statistical evidence. New York: Chapman and Hall; 1997.
Greenland S, O’Rourke K. Meta-analysis Ch. 33. In: Rothman KJ, Greenland S, Lash TL, editors. Modern epidemiology. 3rd ed. Philadelphia: Lippincott-Wolters-Kluwer; 2008. p. 682–5.
Sterne JAC. Meta-analysis: an updated collection from the Stata journal. College Station, TX: Stata Press; 2009.

Sorted by citations

Items 301–400 of 1,004

Missing not at random in end of life care studies: multiple imputation and sensitivity analysis on data from the ACTION study
Carreras, G., Miccinesi, G., Wilcock, A., Preston, N. J., Nieboer, D., Deliëns, L., Grøenvold, M., Lunder, U., van der Heide, A., & Baccini, M. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01180-y · Cited by 42
Techno-economic and environmental approaches of Cd2+ adsorption by olive leaves (Olea europaea L.) waste
Fawzy, M., Nasr, M., Abdel-Rahman, A. M., Hosny, G., & Odhafa, B. R. (2019) · International Journal of Phytoremediation · doi:10.1080/15226514.2019.1612848 · Cited by 42
The incidence rate of ACL injuries and ankle sprains in basketball players: A systematic review and meta‐analysis
Stojanović, E., Faude, O., Nikić, M., Scanlan, A., Radovanović, D., & Jakovljevic, V. (2023) · Scandinavian Journal of Medicine & Science in Sports · doi:10.1111/sms.14328 · Cited by 42
Scientific Opinion of the PPR Panel on the follow‐up of the findings of the External Scientific Report ‘Literature review of epidemiological studies linking exposure to pesticides and health effects’
(PPR), E. P. O. P. P. P. A. T. R., Ockleford, C., Adriaanse, P., Berny, P. J., Brock, T. C. M., Duquesne, S., Grilli, S., Bennekou, S. H., Klein, M., Kühl, T., et al. (2017) · EFSA Journal · doi:10.2903/j.efsa.2017.5007 · Cited by 46
Reasons High School Students Use Marijuana: Prevalence and Correlations With Use Across Four Decades
Patrick, M. E., Evans‐Polce, R. J., Kloska, D. D., & Maggs, J. L. (2019) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2019.80.15 · Cited by 47
Should ecologists prefer model‐ over distance‐based multivariate methods?
Jupke, J. F., & Schäfer, R. B. (2020) · Ecology and Evolution · doi:10.1002/ece3.6059 · Cited by 41
P-values – a chronic conundrum
Gao, J. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01051-6 · Cited by 51
The Behavioral Immune System Shapes Partisan Preferences in Modern Democracies: Disgust Sensitivity Predicts Voting for Socially Conservative Parties
Aarøe, L., Petersen, M. B., & Arceneaux, K. (2020) · Political Psychology · doi:10.1111/pops.12665 · Cited by 37
Sequence Braiding: Visual Overviews of Temporal Event Sequences and Attributes
Bartolomeo, S. D., Zhang, Y., Sheng, F., & Dunne, C. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030442 · Cited by 41
On p-Values and Statistical Significance
Bonovas, S., & Piovani, D. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12030900 · Cited by 51
Is There a Confidence Interval for That? A Critical Examination of Null Outcome Reporting in Accounting Research
Cready, W. M., He, J., Lin, W., Shao, C., Wang, D., & Zhang, Y. (2022) · Behavioral Research in Accounting · doi:10.2308/bria-2020-033 · Cited by 40
Movement of lithics by trampling: An experiment in the Madjedbebe sediments, northern Australia
Marwick, B., Hayes, E. H., Clarkson, C., & Fullagar, R. (2017) · Journal of Archaeological Science · doi:10.1016/j.jas.2017.01.008 · Cited by 40
Long-term patient-reported outcomes and quality of the evidence in ventral hernia mesh repair: a systematic review
Sandø, A., Rosen, M. J., Heniford, B. T., & Bisgaard, T. (2020) · Hernia · doi:10.1007/s10029-020-02154-1 · Cited by 40
Prevalence of self-harm among lesbian, gay, bisexual, and transgender adolescents: a comparison of personal and social adversity with a heterosexual sample in Ghana
Quarshie, E. N., Waterman, M. G., & House, A. O. (2020) · BMC Research Notes · doi:10.1186/s13104-020-05111-4 · Cited by 41
The Role of GI Products or Local Products in the Environment—Consumer Awareness and Preferences in Albania, Bulgaria and Poland
Muça, E., Pomianek, I., & Peneva, M. (2021) · Sustainability · doi:10.3390/su14010004 · Cited by 39
A hybrid error correction method based on EEMD and ConvLSTM for offshore wind power forecasting
Melalkia, L., Berrezzek, F., Khelil, K., Saim, A., & Nebili, R. (2025) · Ocean Engineering · doi:10.1016/j.oceaneng.2025.120773 · Cited by 39
The effect of damage control laparotomy on major abdominal complications: A matched analysis
George, M. J., Adams, S. D., McNutt, M. K., Love, J. D., Albarado, R. P., Moore, L. J., Wade, C. E., Cotton, B. A., Holcomb, J. B., & Harvin, J. A. (2017) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2017.10.044 · Cited by 39
贝叶斯因子及其在JASP中的实现
Chuan-Peng, H., Kong, X., Er, I.-J., Al, E., & Peng, K. (2018) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2018.00951 · Cited by 44
Associative word learning in infancy: A meta-analysis of the switch task.
Tsui, A. S. M., Byers‐Heinlein, K., & Fennell, C. T. (2019) · Developmental Psychology · doi:10.1037/dev0000699 · Cited by 39
Are interventions in reproductive medicine assessed for plausible and clinically relevant effects? A systematic review of power and precision in trials and meta-analyses
Stocking, K., Wilkinson, J., Lensen, S. F., Brison, D. R., Roberts, S. A., & Vail, A. (2019) · Human Reproduction · doi:10.1093/humrep/dez017 · Cited by 39
Meta-Analysis: Effects of Zinc Supplementation Alone or with Multi-Nutrients, on Glucose Control and Lipid Levels in Patients with Type 2 Diabetes
Jafarnejad, S., Mahboobi, S., McFarland, L. V., Taghizadeh, M., & Rahimi, F. C. (2019) · Preventive Nutrition and Food Science · doi:10.3746/pnf.2019.24.1.8 · Cited by 41
The other-race effect and holistic processing across racial groups
Wong, H. K., Estudillo, A. J., Stephen, I. D., & Keeble, D. R. T. (2021) · Scientific Reports · doi:10.1038/s41598-021-87933-1 · Cited by 40
Dehydration risk is associated with reduced nest attendance and hatching success in a cooperatively breeding bird, the southern pied babbler Turdoides bicolor
Bourne, A. R., Ridley, A. R., McKechnie, A. E., Spottiswoode, C. N., & Cunningham, S. J. (2021) · Conservation Physiology · doi:10.1093/conphys/coab043 · Cited by 50
Diabetes as a Prognostic Factor in Frozen Shoulder: A Systematic Review
Dyer, B. P., Burton, C. L., Rathod‐Mistry, T., Bucknall, M., & van der Windt, D. (2021) · Archives of Rehabilitation Research and Clinical Translation · doi:10.1016/j.arrct.2021.100141 · Cited by 39
Impact of COVID-19 forecast visualizations on pandemic risk perceptions
Padilla, L., Hosseinpour, H., Fygenson, R., Howell, J. L., Chunara, R., & Bertini, E. (2022) · Scientific Reports · doi:10.1038/s41598-022-05353-1 · Cited by 44
Systematic review and meta-analysis of randomized trials of hydroxychloroquine for the prevention of COVID-19
García‐Albéniz, X., del Amo, J., Polo, R., Morales‐Asencio, J. M., & Hernán, M. Á. (2022) · European Journal of Epidemiology · doi:10.1007/s10654-022-00891-4 · Cited by 38
Effectiveness of hybrid discarded tire/Industrial steel fibers for improving the sustainability of concrete structures
Zia, A., Zhang, P., & Hollý, I. (2023) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2023.131226 · Cited by 38
Statistical inference in abstracts of major medical and epidemiology journals 1975–2014: a systematic review
Stang, A., Deckert, M., Poole, C., & Rothman, K. J. (2016) · European Journal of Epidemiology · doi:10.1007/s10654-016-0211-1 · Cited by 36
Self-citation
Occupational exposure to high-frequency electromagnetic fields and brain tumor risk in the INTEROCC study: An individualized assessment approach
Vila, J., Turner, M. C., Gràcia‐Lavedan, E., Figuerola, J., Bowman, J. D., Kincl, L. D., Richardson, L., Benke, G., Hours, M., Krewski, D. R., et al. (2018) · Environment International · doi:10.1016/j.envint.2018.06.038 · Cited by 40
Fimbria-Fornix Volume Is Associated With Spatial Memory and Olfactory Identification in Humans
Dahmani, L., Courcot, B., Near, J., Patel, R., Amaral, R. S. C., Chakravarty, M. M., & Bohbot, V. D. (2020) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2019.00087 · Cited by 37
Future land use changes in a peri-urban context: Local stakeholder views
Gomes, E., Banos, A., Abrantes, P. C. D. R. M., Rocha, J., & Schläpfer, M. (2020) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2020.137381 · Cited by 39
Structurally optimized suture resistant polylactic acid (PLA)/poly (є-caprolactone) (PCL) blend based engineered nanofibrous mats
Sharma, D., Saha, D., & Satapathy, B. K. (2021) · Journal of the mechanical behavior of biomedical materials/Journal of mechanical behavior of biomedical materials · doi:10.1016/j.jmbbm.2021.104331 · Cited by 38
Errors in the implementation, analysis, and reporting of randomization within obesity and nutrition research: a guide to their avoidance
Vorland, C. J., Brown, A. W., Dawson, J., Dickinson, S., Golzarri‐Arroyo, L., Hannon, B. A., Heo, M., Heymsfield, S. B., Jayawardene, W. P., Kahathuduwa, C. N., et al. (2021) · International Journal of Obesity · doi:10.1038/s41366-021-00909-z · Cited by 40
Early versus Late initiation of direct oral Anticoagulants in post-ischaemic stroke patients with atrial fibrillatioN (ELAN): Protocol for an international, multicentre, randomised-controlled, two-arm, open, assessor-blinded trial
Fischer, U., Trelle, S., Branca, M., Salanti, G., Paciaroni, M., Ferrari, C., Abend, S., Beyeler, S., Strbian, D., Thomalla, G., et al. (2022) · European Stroke Journal · doi:10.1177/23969873221106043 · Cited by 32
Identification of genomic regions associated with total and progressive sperm motility in Italian Holstein bulls
Ramírez-Díaz, J., Cenadelli, S., Bornaghi, V., Bongioni, G., Montedoro, S. M., Achilli, A., Capelli, C., Rincon, J. C., Milanesi, M., Passamonti, M. M., et al. (2022) · Journal of Dairy Science · doi:10.3168/jds.2021-21700 · Cited by 37
It is just wrong: Moral foundations and food waste
Bretter, C., Unsworth, K. L., Kaptan, G., & Russell, S. V. (2023) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2023.102021 · Cited by 42
Interpreting Randomized Controlled Trials
Msaouel, P., Lee, J., & Thall, P. F. (2023) · Cancers · doi:10.3390/cancers15194674 · Cited by 38
Framework for assessing causality of air pollution-related health effects for reviews of the National Ambient Air Quality Standards
Oesterling, E., Patel, M. M., Kirrane, E. F., Long, T. C., Brown, J. S., Cote, I., Ross, M., & Dutton, S. J. (2017) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2017.05.014 · Cited by 37
A geometric morphometric evaluation of hard and soft tissue profile changes in borderline extraction versus non-extraction patients
Kouli, A., Papagiannis, A., Konstantoni, N., Halazonetis, D. J., & Konstantonis, D. (2018) · European Journal of Orthodontics · doi:10.1093/ejo/cjy056 · Cited by 37
The summer indoor temperatures of the English housing stock: Exploring the influence of dwelling and household characteristics
Petrou, G., Symonds, P., Mavrogianni, A., Mylona, A., & Davies, M. (2019) · Building Services Engineering Research and Technology · doi:10.1177/0143624419847621 · Cited by 37
Exploring the drivers of vascular plant richness at very fine spatial scale in sub-Mediterranean limestone grasslands (Central Apennines, Italy)
Filibeck, G., Sperandii, M. G., Bazzichetto, M., Mancini, L. D., Rossini, F., & Cancellieri, L. (2019) · Biodiversity and Conservation · doi:10.1007/s10531-019-01788-7 · Cited by 38
Reporting and interpretation of results from clinical trials that did not claim a treatment difference: survey of four general medical journals
Gates, S., & Ealing, E. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024785 · Cited by 42
Non-GABA sleep medications, suvorexant as risk factors for falls: Case-control and case-crossover study
Ishibashi, Y., Nishitani, R., Shimura, A., Takeuchi, A., Touko, M., Kato, T., Chiba, S., Ashidate, K., Ishiwata, N., Ichijo, T., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0238723 · Cited by 37
Adolescent Problem Gambling in Rural Ghana: Prevalence and Gender Differentiation
Odame, S. K., Quarshie, E. N., Oti-Boadi, M., Andoh–Arthur, J., & Asante, K. O. (2020) · Journal of Gambling Studies · doi:10.1007/s10899-020-09987-6 · Cited by 39
One More Bite? Inferring Food Consumption Level of College Students Using Smartphone Sensing and Self-Reports
Meegahapola, L., Ruiz-Correa, S., Robledo-Valero, V. D. C., Hernandez-Huerfano, E. E., Alvarez-Rivera, L., Chenu-Abente, R., & Gatica-Perez, D. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3448120 · Cited by 44
This Is Not What We Ordered: Exploring Why Biased Search Result Rankings Affect User Attitudes on Debated Topics
Draws, T., Tintarev, N., Gadiraju, U., Bozzon, A., & Timmermans, B. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462851 · Cited by 51
Operationalising treatment success in aphasia rehabilitation
Breitenstein, C., Hilari, K., Menahemi-Falkov, M., Rose, M. L., Wallace, S. J., Brady, M., Hillis, A. E., Kiran, S., Szaflarski, J. P., Tippett, D. C., et al. (2022) · Aphasiology · doi:10.1080/02687038.2021.2016594 · Cited by 37
Wide-ranging approach-based feature selection for classification
Bhuyan, H. K., Saikiran, M., Tripathy, M., & Ravi, V. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-14132-z · Cited by 37
Modelling of land-use/cover change trajectories in a transboundary catchment of the Sio-Malaba-Malakisi Region in East Africa using the CLUE-s model
Chasia, S., Olang, L., & Sitoki, L. M. (2022) · Ecological Modelling · doi:10.1016/j.ecolmodel.2022.110256 · Cited by 37
Improving the utility of non-significant results for educational research: A review and recommendations
Edelsbrunner, P. A., & Thurn, C. (2023) · Educational Research Review · doi:10.1016/j.edurev.2023.100590 · Cited by 53
Finding the right power balance: Better study design and collaboration can reduce dependence on statistical power
Nakagawa, S., Lagisz, M., Yang, Y., & Drobniak, S. M. (2024) · PLoS Biology · doi:10.1371/journal.pbio.3002423 · Cited by 41
Harnessing causal forests for epidemiologic research: key considerations
Shiba, K., & Inoue, K. (2024) · American Journal of Epidemiology · doi:10.1093/aje/kwae003 · Cited by 36
Optimization and characterization of quercetin-loaded solid lipid nanoparticles for biomedical application in colorectal cancer
Mohamed, J. M. M., Ahmad, F., El‐Sherbiny, M., Mohaini, M. A. A., Venkatesan, K., Alrashdi, Y. B. A., Eldesoqui, M. B., Ibrahim, A. E., Dawood, A. F., Ibrahim, A. M., et al. (2024) · Cancer Nanotechnology · doi:10.1186/s12645-024-00249-3 · Cited by 36
Global, regional, and national burdens of Alzheimer's disease and other forms of dementia in the elderly population from 1999 to 2019: A trend analysis based on the Global Burden of Disease Study 2019
Su, M., Wang, T., Zou, C., Cao, K., & Liu, F. (2024) · Ibrain · doi:10.1002/ibra.12181 · Cited by 36
Relationship of Racial Residential Segregation to Newly Diagnosed Cases of HIV among Black Heterosexuals in US Metropolitan Areas, 2008–2015
Ibragimov, U., Beane, S., Adimora, A. A., Friedman, S. R., Williams, L. D., Tempalski, B., Stall, R. D., Wingood, G. M., Hall, H. I., Johnson, A. S., et al. (2018) · Journal of Urban Health · doi:10.1007/s11524-018-0303-1 · Cited by 34
Noncollapsibility, confounding, and sparse-data bias. Part 1: The oddities of odds
Greenland, S. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.06.007 · Cited by 36
Self-citation
Adherence to 24-h movement behavior guidelines and psychosocial functioning in young children: a longitudinal analysis
Taylor, R. W., Haszard, J. J., Healey, D. M., Meredith-Jones, K. A., Taylor, B. J., & Galland, B. C. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-021-01185-w · Cited by 40
Development and design validation of a novel network meta-analysis presentation tool for multiple outcomes: a qualitative descriptive study
Phillips, M., Sadeghirad, B., Busse, J. W., Brignardello‐Petersen, R., Cuello‐García, C. A., Nampo, F. K., Guo, Y. J., Bzovsky, S., Bannuru, R. R., Thabane, L., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-056400 · Cited by 36
The child survival impact of the Ghana Essential Health Interventions Program: A health systems strengthening plausibility trial in Northern Ghana
Bawah, A. A., Awoonor‐Williams, J. K., Asuming, P. O., Jackson, E. F., Boyer, C., Kanmiki, E. W., Achana, F. S., Akazili, J., & Phillips, J. F. (2019) · PLoS ONE · doi:10.1371/journal.pone.0218025 · Cited by 37
Techno-economic estimation of electroplating wastewater treatment using zero-valent iron nanoparticles: batch optimization, continuous feed, and scaling up studies
Hamdy, A., Mostafa, M. K., & Nasr, M. (2019) · Environmental Science and Pollution Research · doi:10.1007/s11356-019-05850-3 · Cited by 35
Green packaging purchase behaviour: a study on Malaysian consumers
Moorthy, K., Kamarudin, A. A., Xin, L., Hui, L. M., Way, L. T., Fang, P. S., & Carmen, W. (2021) · Environment Development and Sustainability · doi:10.1007/s10668-021-01302-6 · Cited by 52
How to use likelihood ratios to interpret evidence from randomized trials
Perneger, T. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.04.010 · Cited by 35
Current controversies: Null hypothesis significance testing
Sedgwick, P. M., Hammer, A., Kesmodel, U. S., & Pedersen, L. H. (2022) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1111/aogs.14366 · Cited by 35
A manifesto for reproducible science.
Munafo, M. R., Nosek, B. A., Bishop, D., Button, K. S., Chambers, C., du Sert, N. P., Simonsohn, U., Wagenmakers, E., Ware, J. J., & Ioannidis, J. P. A. (2024) · American Psychological Association eBooks · doi:10.1037/0000409-041 · Cited by 42
Compensatory Breeding in Years Following Drought in a Desert-Dwelling Cooperative Breeder
Bourne, A. R., Cunningham, S. J., Spottiswoode, C. N., & Ridley, A. R. (2020) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2020.00190 · Cited by 40
Sports Biostatistician: a critical member of all sports science and medicine teams for injury prevention
Casals, M., & Finch, C. F. (2016) · Injury Prevention · doi:10.1136/injuryprev-2016-042211 · Cited by 34
Epidemiologic Approaches for Studying Assisted Reproductive Technologies: Design, Methods, Analysis, and Interpretation
Messerlian, C., & Gaskins, A. J. (2017) · Current Epidemiology Reports · doi:10.1007/s40471-017-0105-0 · Cited by 34
Confidence Intervals for the Mean of Non-Normal Distribution: Transform or Not to Transform
Pek, J. C. X., Wong, A. C. M., & Wong, O. C. Y. (2017) · Open Journal of Statistics · doi:10.4236/ojs.2017.73029 · Cited by 34
Associations of self-reported stair climbing with all-cause and cardiovascular mortality: The Harvard Alumni Health Study
Rey-López, J. P., Stamatakis, E. A., Mackey, M., Sesso, H. D., & Lee, I.-M. M. (2019) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2019.100938 · Cited by 34
The Impact of Pre-Slaughter Stress on Beef Eating Quality
Loudon, K. M. W., Tarr, G., Lean, I. J., Polkinghorne, R., McGilchrist, P., Dunshea, F. R., Gardner, G. E., & Pethick, D. W. (2019) · Animals · doi:10.3390/ani9090612 · Cited by 35
Future floods using hydroclimatic simulations and peaks over threshold: An alternative to nonstationary analysis inferred from trend tests
Ammar, M. E., Gharib, A., Islam, Z., Davies, E., Seneka, M., & Faramarzi, M. (2019) · Advances in Water Resources · doi:10.1016/j.advwatres.2019.103463 · Cited by 34
Development of a checklist for people communicating evidence-based information about the effects of healthcare interventions: a mixed methods study
Oxman, A. D., Glenton, C., Flottorp, S. A., Lewin, S. A., Rosenbaum, S., & Fretheim, A. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-036348 · Cited by 35
The Minimum Detectable Difference (MDD) Concept for Establishing Trust in Nonsignificant Results: A Critical Review
Mair, M. M., Kattwinkel, M., Jakoby, O., & Hartig, F. (2020) · Environmental Toxicology and Chemistry · doi:10.1002/etc.4847 · Cited by 34
Nine years of online mentoring for secondary school girls in STEM: an empirical comparison of three mentoring formats
Stoeger, H., Heilemann, M., Debatin, T., Hopp, M. D. S., Schirner, S., & Ziegler, A. (2020) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14476 · Cited by 36
Long-term solid fuel use and risks of major eye diseases in China: A population-based cohort study of 486,532 adults
Chan, K. H., Yan, M., Bennett, D., Guo, Y., Chen, Y., Yang, L., Lv, J., Yu, C., Pei, P., Lu, Y., et al. (2021) · PLoS Medicine · doi:10.1371/journal.pmed.1003716 · Cited by 34
Tenets of Good Practice in Regression Analysis. A Brief Tutorial
Pisică, D., Dammers, R., Boersma, E. H., & Volovici, V. (2022) · World Neurosurgery · doi:10.1016/j.wneu.2022.02.112 · Cited by 43
Extraordinary Claims in the Literature on High-Intensity Interval Training (HIIT): I. Bonafide Scientific Revolution or a Looming Crisis of Replication and Credibility?
Panteleimon Ekkekakis, A., Swinton, P. A., & Tiller, N. B. (2023) · Sports Medicine · doi:10.1007/s40279-023-01880-7 · Cited by 39
Adverse Intrauterine Environment and Cardiac miRNA Expression
Lock, M. C., Botting, K. J., Tellam, R. L., Brooks, D. A., & Morrison, J. L. (2017) · International Journal of Molecular Sciences · doi:10.3390/ijms18122628 · Cited by 35
Does ethnic-racial identity modify the effects of racism on the social and emotional wellbeing of Aboriginal Australian children?
Macedo, D. M., Smithers, L. G., Roberts, R., Haag, D. G., Paradies, Y., & Jamieson, L. (2019) · PLoS ONE · doi:10.1371/journal.pone.0220744 · Cited by 35
Global, regional and national burden of CKD in children and adolescents from 1990 to 2019
Zhao, W., Li, X.-L., Shi, R., Zhu, Y., Wang, Z., Wang, X., Pan, H., & Wang, D. (2023) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfad269 · Cited by 33
Artificial intelligence and machine learning in environmental impact prediction for soil pollution management – case for EIA process
Anifowose, B., & Anifowose, F. (2024) · Environmental Advances · doi:10.1016/j.envadv.2024.100554 · Cited by 33
The Heuristic Value of p in Inductive Statistical Inference
Krueger, J. I., & Heck, P. R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00908 · Cited by 33
Between-litter variation in developmental studies of hormones and behavior: Inflated false positives and diminished power
Williams, D. R., Carlsson, R., & Bürkner, P. (2017) · Frontiers in Neuroendocrinology · doi:10.1016/j.yfrne.2017.08.003 · Cited by 33
The Replication Crisis in Epidemiology: Snowball, Snow Job, or Winter Solstice?
Lash, T. L., Collin, L. J., & Dyke, M. E. V. (2018) · Current Epidemiology Reports · doi:10.1007/s40471-018-0148-x · Cited by 35
Measuring conceptual understanding in randomised controlled trials: Can comparative judgement help?
Jones, I., Bisson, M., Gilmore, C. K., & Inglis, M. (2019) · British Educational Research Journal · doi:10.1002/berj.3519 · Cited by 33
Associations between large-scale climate oscillations and land surface phenology in Iran
Araghi, A., Martinez, C. J., Adamowski, J., & Olesen, J. E. (2019) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2019.107682 · Cited by 33
Interactions among global change pressures act in a non‐additive way on bumblebee individuals and colonies
Zaragoza‐Trello, C., Vilà, M., Botías, C., & Bartomeus, Í. (2020) · Functional Ecology · doi:10.1111/1365-2435.13703 · Cited by 33
New Guidelines for Null Hypothesis Significance Testing in Hypothetico-Deductive IS Research
Mertens, W., & Recker, J. (2023) · Technology, work and globalization · doi:10.1007/978-3-031-38719-7_13 · Cited by 33
A data-driven approach for scour detection around monopile-supported offshore wind turbines using Naive Bayes classification
Jawalageri, S., Ghiasi, R., Jalilvand, S., Prendergast, L. J., & Malekjafarian, A. (2024) · Marine Structures · doi:10.1016/j.marstruc.2023.103565 · Cited by 32
Impacts of illegal Artisanal and small-scale gold mining on livelihoods in cocoa farming communities: A case of Amansie West District, Ghana
Donkor, P., Siabi, E. K., Frimpong, K., Frimpong, P. T., Mensah, S. K., Vuu, C., Siabi, S. E., Nyantakyi, E. K., Agariga, F., Atta‐Darkwa, T., et al. (2024) · Resources Policy · doi:10.1016/j.resourpol.2024.104879 · Cited by 32
Beyond Newton: Why assumptions of universality are critical to cognitive science, and how to finally move past them.
Kroupin, I., Davis, H. E., & Henrich, J. (2024) · Psychological Review · doi:10.1037/rev0000480 · Cited by 39
A U-shaped association between selenium intake and cancer risk
Le, N. T., Pham, Y. T., Le, C. T.-K., Le, L. T., Le, T., Dao, H. V., Ha, T., Kuchipudi, S. V., & Luu, H. N. (2024) · Scientific Reports · doi:10.1038/s41598-024-66553-5 · Cited by 32
Sample size estimation revisited
Abt, G., Boreham, C. A., Davison, G. W., Jackson, R. C., Jobson, S., Wallace, E. S., & Williams, M. R. F. (2025) · Journal of Sports Sciences · doi:10.1080/02640414.2025.2499403 · Cited by 42
Kinetic changes during a six-week minimal footwear and gait-retraining intervention in runners
Warne, J. P., Smyth, B., Fagan, J. O., Hone, M., Richter, C., Nevill, A. M., Moran, K., & Warrington, G. D. (2016) · Journal of Sports Sciences · doi:10.1080/02640414.2016.1224916 · Cited by 32
Abnormal gait pattern emerges during curved trajectories in high-functioning Parkinsonian patients walking in line at normal speed
Turcato, A. M., Godi, M., Giardini, M., Arcolin, I., Nardone, A., Giordano, A., & Schieppati, M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197264 · Cited by 32
The oral glucose tolerance test-derived incremental glucose peak is associated with greater arterial stiffness and maladaptive arterial remodeling: The Maastricht Study
Foreman, Y. D., Brouwers, M. C. G. J., Berendschot, T. T. J. M., DONGEN, M. C. J. M. V., Eussen, S. J. P. M., van Greevenbroek, M. M. J., Henry, R. M. A., Houben, A. J. H. M., Kallen, C., Kroon, A. A., et al. (2019) · Cardiovascular Diabetology · doi:10.1186/s12933-019-0950-x · Cited by 32
Recent advancements in the treatment of metastatic clear cell renal cell carcinoma: A review of the evidence using second-generation p-values
Adashek, J. J., Genovese, G., Tannir, N. M., & Msaouel, P. (2020) · Cancer Treatment and Research Communications · doi:10.1016/j.ctarc.2020.100166 · Cited by 32
Principal component analysis based construction and evaluation of cryptocurrency index
Shah, A., Chauhan, Y., & Chaudhury, B. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113796 · Cited by 32
Reflection on modern methods: visualizing the effects of collinearity in distributed lag models
Basagaña, X., & Barrera‐Gómez, J. (2021) · International Journal of Epidemiology · doi:10.1093/ije/dyab179 · Cited by 35
Use of Confidence Intervals in Interpreting Nonstatistically Significant Results
Hawkins, A. T., & Samuels, L. R. (2021) · JAMA · doi:10.1001/jama.2021.16172 · Cited by 32

Authors: Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G.
Affiliations: University of California, Los Angeles (US)
Luxembourg Institute of Health (LU)
RTI International (US)
The University of Melbourne (AU)
University of North Carolina at Chapel Hill (US)
Stanford Medicine (US)
University of Oxford (GB)
Corresponding author: Greenland, Sander
ORCID: Greenland, Sander
Senn, Stephen J.
Rothman, Kenneth J.
Carlin, John B.
Poole, Charles
Goodman, Steven N.
Altman, Douglas G.
Venue: European Journal of Epidemiology
Publisher: Springer Science and Business Media LLC
Published: 2016-04
Volume: 31
Issue: 4
Pages: 337-350
ISSN: 0393-2990 (ISSN-L)
1573-7284
DOI: 10.1007/s10654-016-0149-3
PMC: PMC4877414
OpenAlex: W2408017125
Cited by: 3,200
References: 135
Citations by year: 2026: 325 · 2025: 454 · 2024: 407 · 2023: 290 · 2022: 348 · 2021: 392 · 2020: 330 · 2019: 270 · 2018: 201 · 2017: 148 · 2016: 33
FWCI: 220.87
Type: journal article
Language: en
Open access: hybrid
doi.org
Licence: cc-by
creativecommons.org/licenses/by/4.0 (unspecified)
Locations: European Journal of Epidemiology (publishedVersion, cc-by)
Europe PMC (PubMed Central) (publishedVersion, cc-by)
PubMed Central (publishedVersion, cc-by)
PubMed (publishedVersion)
eScholarship (California Digital Library) (submittedVersion, cc-by)
Minerva Access (University of Melbourne) (submittedVersion, cc-by)
Funders: Seventh Framework Programme (602552)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords: p-values, confidence intervals, statistical power, statistical misinterpretation, hypothesis testing, selective analysis, analysis protocol, statistical reporting guidelines, statistics education
MeSH terms: Data Interpretation, Statistical, Humans, Probability, Confidence Intervals

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks