Cited by 3,200Statistics Education and MethodologiesStatistical Methods in EpidemiologyMeta-analysis and systematic reviews

The DOI matches its Crossref record; 130 of the 135 references it cites were found in a registry or an index, and 1 are not checked yet.

Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations

Open access

Greenland, Sander, Senn, Stephen J., Rothman, Kenneth J., Carlin, John B., Poole, Charles, Goodman, Steven N., Altman, Douglas G.·2016·European Journal of Epidemiology

DOI 10.1007/s10654-016-0149-3PMC PMC4877414

Open this paper in CoChat — free account Open PDF

Abstract

Misinterpretation and abuse of statistical tests, confidence intervals, and statistical power have been decried for decades, yet remain rampant. A key problem is that there are no interpretations of these concepts that are at once simple, intuitive, correct, and foolproof. Instead, correct use and interpretation of these statistics requires an attention to detail which seems to tax the patience of working scientists. This high cognitive demand has led to an epidemic of shortcut definitions and interpretations that are simply wrong, sometimes disastrously so-and yet these misinterpretations dominate much of the scientific literature. In light of this problem, we provide definitions and a discussion of basic statistics that are more general and critical than typically found in traditional introductory expositions. Our goal is to provide a resource for instructors, researchers, and consumers of statistics whose knowledge of statistical theory and technique may be limited but who wish to avoid and spot misinterpretations. We emphasize how violation of often unstated analysis protocols (such as selecting analyses for presentation based on the P values they produce) can lead to small P values even if the declared test hypothesis is correct, and can lead to large P values even if that hypothesis is incorrect. We then provide an explanatory list of 25 misinterpretations of P values, confidence intervals, and power. We conclude with guidelines for improving statistical interpretation and reporting.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1007/s10654-016-0149-3

Cites

130 of 131 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Introduction to Meta‐Analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Introduction to Meta‐Analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
The environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,804
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Association between Water Intake, Chronic Kidney Disease, and Cardiovascular Disease: A Cross-Sectional Analysis of NHANES Data
Sontrop, J. M., Dixon, S. N., Garg, A. X., Jiménez, I. B., Dohein, O., Huang, S. S., & Clark, W. F. (2013) · American Journal of Nephrology · doi:10.1159/000350377 · Cited by 5,903
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
The earth is round (p < .05).
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Theoretical Statistics
Cox, D. R., & Hinkley, D. V. (1974) · doi:10.1007/978-1-4899-2887-0 · Cited by 3,089
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490

Flagged first, then by citations

Show all 135 references

4 of the 135 references couldn’t be matched to a known paper.

Research works printed but not linked: 12

Ashworth A. Veto on the use of null hypothesis testing and p intervals: right or wrong? Taylor & Francis Editor. 2015. Resources online, http://editorresources.taylorandfrancisgroup.com/veto-on-the-use-of-null-hypothesis-testing-and-p-intervals-right-or-wrong/ . Accessed 27 Feb 2016.
Flanagan O. Journal’s ban on null hypothesis significance testing: reactions from the statistical arena. 2015. Stats Life online, https://www.statslife.org.uk/opinion/2114-journal-s-ban-on-null-hypothesis-significance-testing-reactions-from-the-statistical-arena . Accessed 27 Feb 2016.
Cox DR. The role of significance tests (with discussion). Scand J Stat. 1977;4:49–70.
Freedman DA, Pisani R, Purves R. Statistics. 4th ed. New York: Norton; 2007.
Hogben L. Statistical theory. London: Allen and Unwin; 1957.
Ware JH, Mosteller F, Ingelfinger JA. p-Values. In: Bailar JC, Hoaglin DC, editors. Ch. 8. Medical uses of statistics. 3rd ed. Hoboken, NJ: Wiley; 2009. p. 175–94.
Gigerenzer G. Mindless statistics. J Socioecon. 2004;33:567–606.
Greenland S, Poole C. Problems in common interpretations of statistics in scientific articles, expert reports, and testimony. Jurimetrics. 2011;51:113–29.
Kaye DH. Is proof of statistical significance relevant? Wash Law Rev. 1986;61:1333–66.
Royall R. Statistical evidence. New York: Chapman and Hall; 1997.
Greenland S, O’Rourke K. Meta-analysis Ch. 33. In: Rothman KJ, Greenland S, Lash TL, editors. Modern epidemiology. 3rd ed. Philadelphia: Lippincott-Wolters-Kluwer; 2008. p. 682–5.
Sterne JAC. Meta-analysis: an updated collection from the Stata journal. College Station, TX: Stata Press; 2009.

Sorted by citations

Items 201–300 of 1,004

On the Size and Weight of Passive Components: Scaling Trends for High-Density Power Converter Designs
Brooks, N. C., Zou, J., Coday, S., Ge, T., Ellis, N. M., & Pilawa-Podgurski, R. C. N. (2024) · IEEE Transactions on Power Electronics · doi:10.1109/tpel.2024.3365658 · Cited by 63
Essential Amino Acid Supplementation Mitigates Muscle Atrophy After Total Knee Arthroplasty
Dreyer, H. C., Owen, E. C., Strycker, L. A., Smolkowski, K., Muyskens, J. B., Kirkpatrick, T. K., Christie, A. D., Kuehl, K. S., Lantz, B. A., Shah, S. N., et al. (2018) · JBJS Open Access · doi:10.2106/jbjs.oa.18.00006 · Cited by 63
Developing parallel programming and soft skills: A project based learning approach
Younis, A. A., Sunderraman, R., Metzler, M. W., & Bourgeois, A. G. (2021) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2021.07.015 · Cited by 60
Fueling opposition? Yellow vests, urban elites, and fuel taxation
Tatham, M. R., & Peters, Y. (2022) · Journal of European Public Policy · doi:10.1080/13501763.2022.2148172 · Cited by 61
Comparison of artificial neural network and logistic regression models for prediction of outcomes in trauma patients: A systematic review and meta-analysis
Hassanipour, S., Ghaem, H., Arab‐Zozani, M., Seif, M., Fararouei, M., Abdzadeh, E., Sabetian, G., & Paydar, S. (2019) · Injury · doi:10.1016/j.injury.2019.01.007 · Cited by 59
Limitations of Sa(T1) as an intensity measure when assessing non-ductile infilled RC frame structures
O’Reilly, G. J. (2021) · Bulletin of Earthquake Engineering · doi:10.1007/s10518-021-01071-7 · Cited by 58
To test or to estimate? P ‐values versus effect sizes
Dunkler, D., Haller, M. C., Oberbauer, R. W., & Heinze, G. (2019) · Transplant International · doi:10.1111/tri.13535 · Cited by 58
The multiplicity of analysis strategies jeopardizes replicability: lessons learned across disciplines
Hoffmann, S., Schönbrodt, F. D., Elsas, R., Wilson, R., Strasser, U., & Boulesteix, A. (2021) · Royal Society Open Science · doi:10.1098/rsos.201925 · Cited by 71
Detection and quantification of trends in time series of significant wave heights: An application in the Mediterranean Sea
Leo, F. D., Leo, A. D., Besio, G., & Briganti, R. (2020) · Ocean Engineering · doi:10.1016/j.oceaneng.2020.107155 · Cited by 57
Explaining littering prevention among park visitors using the Theory of Planned Behavior and Norm Activation Model
Fenitra, R. M., Laila, N., Premananto, G. C., Abbas, A., & Sedera, R. M. H. (2022) · International Journal of Geoheritage and Parks · doi:10.1016/j.ijgeop.2022.11.002 · Cited by 57
Increase in concerns about climate change following climate strikes and civil disobedience in Germany
Brehm, J., & Gruhl, H. (2024) · Nature Communications · doi:10.1038/s41467-024-46477-4 · Cited by 66
Three common misuses of P values
Kim, J., & Bang, H. (2016) · Dental Hypotheses · doi:10.4103/2155-8213.190481 · Cited by 61
Bayesian clinical trial designs
Jansen, J. O., Pallmann, P., MacLennan, G., & Campbell, M. (2017) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000001638 · Cited by 56
Standardizing statistics and data reporting in orthopaedic research
Strage, K. E., Parry, J. A., & Mauffrey, C. P. (2021) · European Journal of Orthopaedic Surgery & Traumatology · doi:10.1007/s00590-020-02843-8 · Cited by 56
Meta-analysis indicates better climate adaptation and mitigation performance of hybrid engineering-natural coastal defence measures
Huynh, L. T. M., Su, J., Wang, Q., Stringer, L. C., Switzer, A. D., & Gasparatos, A. (2024) · Nature Communications · doi:10.1038/s41467-024-46970-w · Cited by 64
A critical examination of the main premises of Traditional Chinese Medicine
Eigenschink, M., Dearing, L., Dablander, T. E., Maier, J., & Sitte, H. H. (2020) · Wiener klinische Wochenschrift · doi:10.1007/s00508-020-01625-w · Cited by 55
The replication crisis, scientific revolutions, and linguistics
Sönning, L., & Werner, V. (2021) · Linguistics · doi:10.1515/ling-2019-0045 · Cited by 64
Analysis and classification of speech sounds of children with autism spectrum disorder using acoustic features
Mohanta, A., & Mittal, V. K. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2021.101287 · Cited by 55
Hair analysis when external contamination is in question: A review of practical approach for the interpretation of results
Tsanaclis, L., Andraus, M. H., & Wicks, J. F. C. (2018) · Forensic Science International · doi:10.1016/j.forsciint.2018.01.028 · Cited by 55
Topconfects: a package for confident effect sizes in differential expression analysis provides a more biologically useful ranked gene list
Harrison, P. F., Pattison, A., Powell, D., & Beilharz, T. H. (2019) · Genome biology · doi:10.1186/s13059-019-1674-7 · Cited by 54
P -values and reproductive health: what can clinical researchers learn from the American Statistical Association?
Farland, L. V., Correia, K. F. B., Wise, L. A., Williams, P. L., Ginsburg, E. S., & Missmer, S. A. (2016) · Human Reproduction · doi:10.1093/humrep/dew192 · Cited by 59
Bayesian network analysis incorporating genetic anchors complements conventional Mendelian randomization approaches for exploratory analysis of causal relationships in complex data
Howey, R. A. J., Shin, S., Relton, C. L., Smith, G. D., & Cordell, H. J. (2020) · PLoS Genetics · doi:10.1371/journal.pgen.1008198 · Cited by 57
Do Implicit and Explicit Racial Biases Influence Autism Identification and Stigma? An Implicit Association Test Study
Obeid, R., Bisson, J. B., Cosenza, A., Harrison, A. J., James, F., Saade, S., & Gillespie‐Lynch, K. (2020) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-020-04507-2 · Cited by 60
Cross-sectional and Prospective Associations of Rest-Activity Rhythms With Metabolic Markers and Type 2 Diabetes in Older Men
Xiao, Q., Qian, J., Evans, D. S., Redline, S. S., Lane, N. E., Ancoli‐Israel, S., Scheer, F. A. J. L., & Stone, K. L. (2020) · Diabetes Care · doi:10.2337/dc20-0557 · Cited by 53
Higher Mortality in Pediatric Liver Transplant Candidates With Sarcopenia
Boster, J. M., Browne, L. P., Pan, Z., Zhou, W., Ehrlich, P. F., & Sundaram, S. S. (2021) · Liver Transplantation · doi:10.1002/lt.26027 · Cited by 54
An observational analysis of the trope “A p-value of < 0.05 was considered statistically significant” and other cut-and-paste statistical methods
White, N. M., Balasubramaniam, T., Nayak, R., & Barnett, A. G. (2022) · PLoS ONE · doi:10.1371/journal.pone.0264360 · Cited by 60
Within-participant statistics for cognitive science
Ince, R. A. A., Kay, J., & Schyns, P. G. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.05.008 · Cited by 54
Statistical techniques in power systems fault diagnostic: Classifications, challenges, and strategic recommendations
Abbasi, A. R. (2024) · Electric Power Systems Research · doi:10.1016/j.epsr.2024.111279 · Cited by 57
P values in display items are ubiquitous and almost invariably significant: A survey of top science journals
Cristea, I. A., & Ioannidis, J. P. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197440 · Cited by 56
Research Note: Significance testing and hypothesis testing: meaningless, misleading and mostly unnecessary
Herbert, R. (2019) · Journal of physiotherapy · doi:10.1016/j.jphys.2019.05.001 · Cited by 53
Generalization and Personalization of Mobile Sensing-Based Mood Inference Models
Meegahapola, L., Droz, W., Kun, P., de Götzen, A., Nutakki, C., Diwakar, S., Correa, S. R., Song, D., Xu, H., Bidoglia, M., et al. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3569483 · Cited by 67
Investigation of the properties of reactive MgO-based cements and their effect on performance
Mi, T., Yang, E., & Unluer, C. (2023) · Cement and Concrete Composites · doi:10.1016/j.cemconcomp.2023.104984 · Cited by 53
Bayesian reanalysis of null results reported in medicine: Strong yet variable evidence for the absence of treatment effects
Hoekstra, R., Monden, R., van Ravenzwaaij, D., & Wagenmakers, E. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195474 · Cited by 55
A framework for uncertainty quantification in building heat demand simulations using reduced-order grey-box energy models
Shamsi, M. H., Ali, U., Mangina, E., & O’Donnell, J. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115141 · Cited by 53
Statistical Significance Testing at CHI PLAY: Challenges and Opportunities for More Transparency
Vornhagen, J. B., Tyack, A., & Mekler, E. D. (2020) · Annual Symposium on Computer-Human Interaction in Play · doi:10.1145/3410404.3414229 · Cited by 60
The earnestness of being important: Reporting non‐significant statistical results
Visentin, D. C., Cleary, M. L., & Hunt, G. E. (2019) · Journal of Advanced Nursing · doi:10.1111/jan.14283 · Cited by 53
Early life environmental factors associated with autism spectrum disorder symptoms in children at age 2 years: A birth cohort study
Pham, C., Symeonides, C., O’Hely, M., Sly, P. D., Knibbs, L. D., Thomson, S. M., Vuillermin, P., Saffery, R., Ponsonby, A., & the Barwon Infant Study Investigator Group (2022) · Autism · doi:10.1177/13623613211068223 · Cited by 56
Modelling future land use scenarios based on farmers’ intentions and a cellular automata approach
Gomes, E., Abrantes, P. C. D. R. M., Banos, A., & Rocha, J. (2019) · Land Use Policy · doi:10.1016/j.landusepol.2019.03.027 · Cited by 52
Sputum and salivary protein biomarkers and point-of-care biosensors for the management of COPD.
Dong, T., Santos, S., Yang, Z.-C., Yang, S., & Kirkhus, N. E. (2020) · In Analysis · doi:10.1039/c9an01704f · Cited by 36
Effectiveness of psychosocial interventions for posttraumatic growth in patients with cancer: A meta-analysis of randomized controlled trials
Li, J., Peng, X., Su, Y., He, Y., Zhang, S., & Hu, X. (2020) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2020.101798 · Cited by 59
Discuss practical importance of results based on interval estimates and p-value functions, not only on point estimates and null p-values
Amrhein, V., & Greenland, S. (2022) · Journal of Information Technology · doi:10.1177/02683962221105904 · Cited by 51
Self-citation
Optimization of a variable-temperature heat pump drying process of shiitake mushrooms using response surface methodology
Zhang, L., Jiang, L., Xu, Z. C., Zhang, X. J., Fan, Y., Adnouni, M., & Zhang, C. (2022) · Renewable Energy · doi:10.1016/j.renene.2022.08.094 · Cited by 51
Putting the P -Value in its Place
Krueger, J. I., & Heck, P. R. (2019) · The American Statistician · doi:10.1080/00031305.2018.1470033 · Cited by 51
Testing the feasibility of quantifying change in agricultural soil carbon stocks through empirical sampling
Bradford, M. A., Eash, L., Polussa, A., Jevon, F. V., Kuebbing, S. E., Hammac, W. A., Rosenzweig, S. T., & Oldfield, E. E. (2023) · Geoderma · doi:10.1016/j.geoderma.2023.116719 · Cited by 56
Pubertal hormones and mental health problems in children and adolescents: a systematic review of population-based studies
Luo, D., Dashti, S. G., Sawyer, S. M., & Vijayakumar, N. (2024) · EClinicalMedicine · doi:10.1016/j.eclinm.2024.102828 · Cited by 67
The fragility of significant results underscores the need of larger randomized controlled trials in nephrology
Shochet, L. R., Kerr, P. G., & Polkinghorne, K. R. (2017) · Kidney International · doi:10.1016/j.kint.2017.05.011 · Cited by 50
Bayesian inference for algorithm ranking analysis
Calvo, B., Ceberio, J., & Lozano, J. A. (2018) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3205651.3205658 · Cited by 50
Statistical significance versus clinical relevance
van Rijn, M. H. C., Bech, A. P., Bouyer, J., & van den Brand, J. A. J. G. (2016) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfw385 · Cited by 49
Modeling Linguistic Variables With Regression Models: Addressing Non-Gaussian Distributions, Non-independent Observations, and Non-linear Predictors With Random Effects and Generalized Additive Models for Location, Scale, and Shape
Coupé, C. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00513 · Cited by 48
Early-life triclosan exposure and parent-reported behavior problems in 8-year-old children
Jackson-Browne, M. S., Papandonatos, G. D., Chen, A., Yolton, K. A., Lanphear, B. P., & Braun, J. M. (2019) · Environment International · doi:10.1016/j.envint.2019.01.021 · Cited by 50
Bayesian Interpretation of the EXCEL Trial and Other Randomized Clinical Trials of Left Main Coronary Artery Revascularization
Brophy, J. M. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2020.1647 · Cited by 49
P > .05: The incorrect interpretation of “not significant” results is a significant problem
Smith, R. J. (2020) · American Journal of Physical Anthropology · doi:10.1002/ajpa.24092 · Cited by 48
Simultaneous biodegradability enhancement and high-efficient nitrogen removal in an innovative single stage anaerobic/anoxic/aerobic hybrid airlift bioreactor (HALBR) for composting leachate treatment: Process modeling and optimization
Mirghorayshi, M., Zinatizadeh, A. A., & van Loosdrecht, M. C. M. (2020) · Chemical Engineering Journal · doi:10.1016/j.cej.2020.127019 · Cited by 49
A theoretical analysis of the value added intellectual coefficient (VAIC)
Marzo, G. (2021) · Journal of Management & Governance · doi:10.1007/s10997-021-09565-x · Cited by 48
The perceived surveillance of conversations through smart devices
Frick, N. R. J., Wilms, K. L., Brachten, F., Hetjens, T., Stieglitz, S., & Ross, B. (2021) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2021.101046 · Cited by 48
How to think clearly about the central limit theorem.
Zhang, X., Astivia, O. L. O., Kroc, E., & Zumbo, B. D. (2022) · Psychological Methods · doi:10.1037/met0000448 · Cited by 63
Application of Bayesian methods to accelerate rare disease drug development: scopes and hurdles
Kidwell, K., Roychoudhury, S., Wendelberger, B. A., Scott, J., Moroz, T., Yin, S., Majumder, M., Zhong, J., Huml, R. A., & Miller, V. (2022) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-022-02342-5 · Cited by 48
Ten quick tips for biomarker discovery and validation analyses using machine learning
Díaz‐Uriarte, R., de Lope, E. G., Giugno, R., Fröhlich, H., Nazarov, P. V., Nepomuceno-Chamorro, I. A., Rauschenberger, A., & Glaab, E. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010357 · Cited by 49
Energy consumption and carbon emission of conventional and green buildings using building information modelling (BIM)
Kusi, E., Boateng, I., & Danso, H. (2024) · International Journal of Building Pathology and Adaptation · doi:10.1108/ijbpa-09-2023-0127 · Cited by 48
Many meta-analyses of rare events in the Cochrane Database of Systematic Reviews were underpowered
Jia, P., Lin, L., Kwong, J. S., & Xu, C. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.11.017 · Cited by 47
Death Associated With Coronavirus (COVID-19) Infection in Individuals With Severe Mental Disorders in Sweden During the Early Months of the Outbreak—An Exploratory Cross-Sectional Analysis of a Population-Based Register Study
Maripuu, M., Bendix, M., Öhlund, L., Widerström, M., & Werneke, U. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.609579 · Cited by 46
The digital divide at school and at home: A comparison between schools by socioeconomic level across 47 countries
Ma, J. K. (2021) · International Journal of Comparative Sociology · doi:10.1177/00207152211023540 · Cited by 47
Ten simple rules for good research practice
Schwab, S., Janiaud, P., Dayan, M., Amrhein, V., Panczak, R., Palagi, P. M., Hemkens, L. G., Ramon, M., Rothen, N., Senn, S. J., et al. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010139 · Cited by 53
Self-citation
Effect of self-assembling peptide P11-4 on orthodontic treatment-induced carious lesions
Welk, A., Ratzmann, A., Reich, M., Krey, K., & Schwahn, C. (2020) · Scientific Reports · doi:10.1038/s41598-020-63633-0 · Cited by 47
The Emperor’s New Gepants: Are the Effects of the New Oral CGRP Antagonists Clinically Meaningful?
Tfelt‐Hansen, P. C., & Loder, E. (2018) · Headache The Journal of Head and Face Pain · doi:10.1111/head.13444 · Cited by 46
Association of Education and Intracranial Volume With Cognitive Trajectories and Mortality Rates Across the Alzheimer Disease Continuum
van Loenhoud, A. C., Groot, C., Bocancea, D. I., Barkhof, F., Teunissen, C. E., Scheltens, P., van der Flier, W. M., & Ossenkoppele, R. (2022) · Neurology · doi:10.1212/wnl.0000000000200116 · Cited by 46
Multilingual markers of depression in remotely collected speech samples: A preliminary analysis
Cummins, N., Dineley, J., Conde, P., Matcham, F., Siddi, S., Lamers, F., Carr, E., Lavelle, G., Leightley, D., White, K. M., et al. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.08.097 · Cited by 59
Statistical significance testing and p-values: Defending the indefensible? A discussion paper and position statement
Griffiths, P., & Needleman, J. (2019) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2019.07.001 · Cited by 46
Theory and practical use of Bayesian methods in interpreting clinical trial data: a narrative review
Ferreira, D., Barthoulot, M., Pottecher, J., Torp, K. D., Diemunsch, P. A., & Meyer, N. (2020) · British Journal of Anaesthesia · doi:10.1016/j.bja.2020.04.092 · Cited by 46
Single-session effects of acute intermittent hypoxia on breathing function after human spinal cord injury
Sutor, T. W., Cavka, K., Vose, A. K., Welch, J. F., Davenport, P. W., Fuller, D. D., Mitchell, G. S., & Fox, E. J. (2021) · Experimental Neurology · doi:10.1016/j.expneurol.2021.113735 · Cited by 46
Automatic procedure for selecting flood events and identifying flood characteristics from daily streamflow data
Zhang, Q., Zhang, L., She, D., Wang, S., Wang, G., & Zeng, S. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2021.105180 · Cited by 45
Evaluation of multi-task learning in deep learning-based positioning classification of mandibular third molars
Sukegawa, S., Matsuyama, T., Tanaka, F., Hara, T., Yoshii, K., Yamashita, K., Nakano, K., Takabatake, K., Kawai, H., Nagatsuka, H., et al. (2022) · Scientific Reports · doi:10.1038/s41598-021-04603-y · Cited by 47
DIY bootstrapping: Getting the nonparametric bootstrap confidence interval in SPSS for any statistics or function of statistics (when this bootstrapping is appropriate)
Cheung, S. F., Pesigan, I. J. A., & Vong, W. N. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01808-5 · Cited by 53
Exploring the role of gamification in motivating students to learn
Baah, C., Govender, I., & Subramaniam, P. R. (2023) · Cogent Education · doi:10.1080/2331186x.2023.2210045 · Cited by 90
Beyond ‘significance’: principles and practice of the Analysis of Credibility
Matthews, R. (2018) · Royal Society Open Science · doi:10.1098/rsos.171047 · Cited by 47
Effectiveness of a Mouth Care Program Provided by Nursing Home Staff vs Standard Care on Reducing Pneumonia Incidence
Zimmerman, S. I., Sloane, P. D., Ward, K., Wretman, C. J., Stearns, S. C., Poole, P., & Preisser, J. S. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.4321 · Cited by 45
Summary Plots With Adjusted Error Bars: The superb Framework With an Implementation in R
Cousineau, D., Goulet, M.-A., & Harding, B. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459211035109 · Cited by 45
Responding to Reviewers and Editors About Statistical Significance Testing
Savitz, D. A., Wise, L. A., Bond, J. C., Hatch, E. E., Ncube, C. N., Wesselink, A. K., Willis, M. D., Yland, J. J., & Rothman, K. J. (2024) · Annals of Internal Medicine · doi:10.7326/m23-2430 · Cited by 45
Self-citation
Research Techniques Made Simple: Interpreting Measures of Association in Clinical Research
Roberts, M., Ashrafzadeh, S., & Asgari, M. M. (2019) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2018.12.023 · Cited by 44
Undermining Your Case to Enhance Your Impact: A Framework for Understanding the Effects of Acts of Receptiveness in Persuasion
Hussein, M. A., & Tormala, Z. L. (2021) · Personality and Social Psychology Review · doi:10.1177/10888683211001269 · Cited by 47
A catalog of validity indices for step counting wearable technologies during treadmill walking: the CADENCE-adults study
Mora-González, J., Gould, Z. R., Moore, C. C., Aguiar, E. J., Ducharme, S. W., Schuna, J. M., Barreira, T. V., STAUDENMAYER, J. W., McAvoy, C. R., Boikova, M., et al. (2022) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-022-01350-9 · Cited by 41
Determination of sample size for various study designs in medical research: A practical primer
Bhardwaj, R., Agrawal, U., Vashist, P., & Manna, S. (2024) · Journal of Family Medicine and Primary Care · doi:10.4103/jfmpc.jfmpc_1675_23 · Cited by 56
Consequences of relying on statistical significance: Some illustrations
CALSTER, B. V., Steyerberg, E. W., Collins, P. G. S., & Smits, T. (2018) · European Journal of Clinical Investigation · doi:10.1111/eci.12912 · Cited by 47
QueryVis: Logic-based Diagrams help Users Understand Complicated SQL Queries Faster
Leventidis, A. S., Zhang, J., Dunne, C., Gatterbauer, W., Jagadish, H. V., & Riedewald, M. (2020) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3318464.3389767 · Cited by 44
Defining minimal clinically important differences in pain and disability outcomes of patients with chronic pain treated with spinal cord stimulation.
Sabourin, S., Tram, J. K., Sheldon, B. L., & Pilitsis, J. G. (2021) · Journal of Neurosurgery : Spine · doi:10.3171/2020.11.spine201431 · Cited by 39
The Eight-Item Center for Epidemiological Studies Depression Scale in the English Longitudinal Study of Aging: Longitudinal and Gender Invariance, Sum Score Models, and External Associations
Schlechter, P., Ford, T. J., & Neufeld, S. (2022) · Assessment · doi:10.1177/10731911221138930 · Cited by 43
Dog owner mental health is associated with dog behavioural problems, dog care and dog-facilitated social interaction: a prospective cohort study
Barcelos, A. M., Kargas, N., Assheton, P., Maltby, J., Hall, S. S., & Mills, D. S. (2023) · Scientific Reports · doi:10.1038/s41598-023-48731-z · Cited by 45
Gastroschisis in Europe – A Case‐malformed‐Control Study of Medication and Maternal Illness during Pregnancy as Risk Factors
Given, J. E., Loane, M. A., Garne, E., Nelen, V., Barišić, I., Randrianaivo, H., Khoshnood, B., Wiesel, A., Rißmann, A., Lynch, C., et al. (2017) · Paediatric and Perinatal Epidemiology · doi:10.1111/ppe.12401 · Cited by 43
Misconceptions, Misuses, and Misinterpretations of P Values and Significance Testing
Gagnier, J. J., & Morgenstern, H. (2017) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.16.01314 · Cited by 50
Inequities of Enrollment in Gifted Education: A Statewide Application of the 20% Equity Allowance Formula
Lamb, K. N., Boedeker, P., & Kettler, T. (2019) · Gifted Child Quarterly · doi:10.1177/0016986219830768 · Cited by 52
Effect size and statistical power in the rodent fear conditioning literature – A systematic review
Carneiro, C. F. D., Moulin, T. C., Macleod, M. R., & Amaral, O. B. (2018) · PLoS ONE · doi:10.1371/journal.pone.0196258 · Cited by 48
Bayesian performance analysis for black-box optimization benchmarking
Calvo, B., Shir, O. M., Ceberio, J., Doerr, C., Wang, H., Bäck, T., & Lozano, J. A. (2019) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3319619.3326888 · Cited by 43
Discrimination between vegetable oil and animal fat by a metabolomics approach using gas chromatography–mass spectrometry combined with chemometrics
Heidari, M., Talebpour, Z., Abdollahpour, Z., Adib, N., Ghanavi, Z., & Aboul-Enein, H. Y. (2020) · Journal of Food Science and Technology · doi:10.1007/s13197-020-04375-9 · Cited by 43
Statistical significance and its critics: practicing damaging science, or damaging scientific practice?
Mayo, D. G., & Hand, D. J. (2022) · Synthese · doi:10.1007/s11229-022-03692-0 · Cited by 48
Global burden of stroke in adolescents and young adults (aged 15–39 years) from 1990 to 2019: a comprehensive trend analysis based on the global burden of disease study 2019
Ma, Z., He, W., Zhou, Y., Mai, L., Xu, L., Li, C., & Li, M. (2024) · BMC Public Health · doi:10.1186/s12889-024-19551-1 · Cited by 42
Healthy lifestyle behavior and risk of long duration troublesome neck pain or low back pain among men and women: results from the Stockholm Public Health Cohort
Skillgate, E., Pico-Espinosa, O. J., Hallqvist, J., Bohman, T., & Holm, L. W. (2017) · Clinical Epidemiology · doi:10.2147/clep.s145264 · Cited by 42
Race/Ethnicity Differences in Trends of Marijuana, Cigarette, and Alcohol Use Among 8th, 10th, and 12th Graders in Washington State, 2004–2016
Johnson, R. M., Fleming, C. B., Cambron, C., Dean, L. T., Brighthaupt, S.-C., & Guttmannova, K. (2018) · Prevention Science · doi:10.1007/s11121-018-0899-0 · Cited by 42
Comparison of automatic procedures for selecting flood peaks over threshold based on goodness‐of‐fit tests
Durocher, M., Zadeh, S. M., Burn, D. H., & Ashkar, F. (2018) · Hydrological Processes · doi:10.1002/hyp.13223 · Cited by 42
Reducing Assaults Against Staff Using Body-Worn Cameras (BWCs) in Railway Stations
Ariel, B., Newton, M., McEwan, L., Ashbridge, G. A., Weinborn, C., & Brants, H. S. (2018) · Criminal Justice Review · doi:10.1177/0734016818814889 · Cited by 44
Sex-specific effects of blood cadmium on thyroid hormones and thyroid function status: Korean nationwide cross-sectional study
Chung, S. M., Moon, J. S., Yoon, J. S., Won, K. C., & Lee, H. W. (2019) · Journal of Trace Elements in Medicine and Biology · doi:10.1016/j.jtemb.2019.02.003 · Cited by 42

Authors: Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G.
Affiliations: University of California, Los Angeles (US)
Luxembourg Institute of Health (LU)
RTI International (US)
The University of Melbourne (AU)
University of North Carolina at Chapel Hill (US)
Stanford Medicine (US)
University of Oxford (GB)
Corresponding author: Greenland, Sander
ORCID: Greenland, Sander
Senn, Stephen J.
Rothman, Kenneth J.
Carlin, John B.
Poole, Charles
Goodman, Steven N.
Altman, Douglas G.
Venue: European Journal of Epidemiology
Publisher: Springer Science and Business Media LLC
Published: 2016-04
Volume: 31
Issue: 4
Pages: 337-350
ISSN: 0393-2990 (ISSN-L)
1573-7284
DOI: 10.1007/s10654-016-0149-3
PMC: PMC4877414
OpenAlex: W2408017125
Cited by: 3,200
References: 135
Citations by year: 2026: 325 · 2025: 454 · 2024: 407 · 2023: 290 · 2022: 348 · 2021: 392 · 2020: 330 · 2019: 270 · 2018: 201 · 2017: 148 · 2016: 33
FWCI: 220.87
Type: journal article
Language: en
Open access: hybrid
doi.org
Licence: cc-by
creativecommons.org/licenses/by/4.0 (unspecified)
Locations: European Journal of Epidemiology (publishedVersion, cc-by)
Europe PMC (PubMed Central) (publishedVersion, cc-by)
PubMed Central (publishedVersion, cc-by)
PubMed (publishedVersion)
eScholarship (California Digital Library) (submittedVersion, cc-by)
Minerva Access (University of Melbourne) (submittedVersion, cc-by)
Funders: Seventh Framework Programme (602552)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords: p-values, confidence intervals, statistical power, statistical misinterpretation, hypothesis testing, selective analysis, analysis protocol, statistical reporting guidelines, statistics education
MeSH terms: Data Interpretation, Statistical, Humans, Probability, Confidence Intervals

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks