Cited by 1,466Statistical Methods in EpidemiologyMeta-analysis and systematic reviewsStatistical Methods in Clinical Trials

The DOI matches its Crossref record; 46 of the 48 references it cites were found in a registry or an index.

Sifting the evidence---what's wrong with significance tests? Another comment on the role of statistical methods

Open access

Sterne, J. A C·2001·BMJ

DOI 10.1136/bmj.322.7280.226PMC PMC1119478

Open this paper in CoChat — free account

Abstract

The findings of medical research are often met with considerable scepticism, even when they have apparently come from studies with sound methodologies that have been subjected to appropriate statistical analysis. This is perhaps particularly the case with respect to epidemiological findings that suggest that some aspect of everyday life is bad for people. Indeed, one recent popular history, the medical journalist James Le Fanu's The Rise and Fall of Modern Medicine , went so far as to suggest that the solution to medicine's ills would be the closure of all departments of epidemiology.1 One contributory factor is that the medical literature shows a strong tendency to accentuate the positive; positive outcomes are more likely to be reported than null results.2–4 By this means alone a host of purely chance findings will be published, as by conventional reasoning examining 20 associations will produce one result that is “significant at P=0.05” by chance alone. If only positive findings are published then they may be mistakenly considered to be of importance rather than being the necessary chance results produced by the application of criteria for meaningfulness based on statistical significance. As many studies contain long questionnaires collecting information on hundreds of variables, and measure a wide range of potential outcomes, several false positive findings are virtually guaranteed. The high volume and often contradictory nature5 of medical research findings, however, is not only because of publication bias. A more fundamental problem is the widespread misunderstanding of the nature of statistical significance. #### Summary points P values, or significance levels, measure the strength of the evidence against the null hypothesis; the smaller the P value, the stronger the evidence against the null hypothesis An arbitrary division of results, into “significant” or “non-significant” according to the P value, was not the intention of the …

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1136/bmj.322.7280.226

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Statistical Methods for Research Workers
Fisher, R. A. (1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,883
Association between Water Intake, Chronic Kidney Disease, and Cardiovascular Disease: A Cross-Sectional Analysis of NHANES Data
Sontrop, J. M., Dixon, S. N., Garg, A. X., Jiménez, I. B., Dohein, O., Huang, S. S., & Clark, W. F. (2013) · American Journal of Nephrology · doi:10.1159/000350377 · Cited by 5,903
Statistical Inference
Casella, G., & Berger, R. L. (1993) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,835
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
IX. On the problem of the most efficient tests of statistical hypotheses
Neyman, J., & Pearson, E. S. (1933) · Philosophical Transactions of the Royal Society of London Series A Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1933.0009 · Cited by 2,370
Confidence intervals rather than P values: estimation rather than hypothesis testing.
Gardner, M. J., & Altman, D. G. (1986) · BMJ · doi:10.1136/bmj.292.6522.746 · Cited by 2,014
Statistics with Confidence
Smithson, M. J. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218525 · Cited by 1,871
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
The Importance of Beta, the Type II Error and Sample Size in the Design and Interpretation of the Randomized Control Trial: Survey of 71 Negative Trials
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
ON THE PROBLEM OF THE MOST EFFICIENT TESTS OF STATISTICAL HYPOTHESES
Neyman, J., & Pearson, E. S. (1967) · University of California Press eBooks · doi:10.1525/9780520339897-008 · Cited by 1,545

Flagged first, then by citations

Show all 48 references

2 of the 48 references couldn’t be matched to a known paper.

Research works printed but not linked: 5

[38]Davey Smith G. Reflections on the limits to epidemiology. J Clin Epidemiol (in press).
BMJ. 2001 Jan 27;322(7280):226–231.
1-1.Fisher RA. Statistical methods for research workers. 1st ed. Edinburgh: Oliver and Boyd; 1925. . Reprinted by Oxford University Press. [Google Scholar]
1-2.Fisher RA. Design of experiments. 1st ed. Edinburgh: Oliver and Boyd; 1935. . Reprinted by Oxford University Press. [Google Scholar]
1-4.Cox DR. Statistical significance tests. Br J Clin Pharmacol. 1982;14:325–331. doi: 10.1111/j.1365-2125.1982.tb01987.x. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI

Sorted by citations

Items 301–400 of 1,000

Formalized synthesis opportunities for ecology: systematic reviews and meta‐analyses
Lortie, C. J. (2014) · Oikos · doi:10.1111/j.1600-0706.2013.00970.x · Cited by 74
Handgrip strength, inflammatory markers, and mortality
Smith, L., Yang, L., & Hamer, M. (2019) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/sms.13433 · Cited by 72
Perfect Study, Poor Evidence: Interpretation of Biases Preceding Study Design
Ioannidis, J. P. A. (2008) · Seminars in Hematology · doi:10.1053/j.seminhematol.2008.04.010 · Cited by 72
Towards a judgement‐based statistical analysis
Gorard, S. A. C. (2005) · British Journal of Sociology of Education · doi:10.1080/01425690500376663 · Cited by 73
Randomized controlled trial of maternal omega-3 long-chain PUFA supplementation during pregnancy and early childhood development of attention, working memory, and inhibitory control
Gould, J. F., Makrides, M., Colombo, J. A., & Smithers, L. G. (2014) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.069203 · Cited by 71
Association between maternal micronutrient status, oxidative stress, and common genetic variants in antioxidant enzymes at 15 weeks׳ gestation in nulliparous women who subsequently develop preeclampsia
Mistry, H. D., Gill, C. A., Kurlak, L. O., Seed, P. T., Hesketh, J. E., Méplan, C., Schomburg, L., Chappell, L. C., Morgan, L., & Poston, L. (2014) · Free Radical Biology and Medicine · doi:10.1016/j.freeradbiomed.2014.10.580 · Cited by 71
Effect of graded fructose coingestion with maltodextrin on exogenous 14C-fructose and 13C-glucose oxidation efficiency and high-intensity cycling performance
ROWLANDS, D. S., Thorburn, M. S., Thorp, R. M., Broadbent, S., & Shi, X. (2008) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00878.2007 · Cited by 71
Fructose-maltodextrin ratio in a carbohydrate-electrolyte solution differentially affects exogenous carbohydrate oxidation rate, gut comfort, and performance
O’Brien, W. J., & ROWLANDS, D. S. (2010) · American Journal of Physiology-Gastrointestinal and Liver Physiology · doi:10.1152/ajpgi.00419.2010 · Cited by 71
Machine Learning and Radiogenomics: Lessons Learned and Future Directions
Kang, J., Rancati, T., Lee, S., Oh, J. H., Kerns, S. L., Scott, J. G., Schwartz, R. S., Kim, S. Y., & Rosenstein, B. S. (2018) · Frontiers in Oncology · doi:10.3389/fonc.2018.00228 · Cited by 74
The causes and consequences of Alzheimer's disease: phenome-wide evidence from mendelian randomization
Korologou-Linden, R., Bhatta, L., Brumpton, B. M., Howe, L. D., Millard, L. A. C., Kolaric, K., Ben-Shlomo, Y., Williams, D. M., Smith, G. D., Anderson, E. L., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-32183-6 · Cited by 71
Analysis of 2 × 2 tables of frequencies: matching test to experimental design
Ludbrook, J. (2008) · International Journal of Epidemiology · doi:10.1093/ije/dyn162 · Cited by 70
Mechanical stretch regulates TRPC expression and calcium entry in human myometrial smooth muscle cells
Dalrymple, A., Mahn, K., Poston, L., Songu‐Mize, E., & Tribe, R. M. (2007) · Molecular Human Reproduction · doi:10.1093/molehr/gal110 · Cited by 69
Polymorphisms in lncRNA HOTAIR and susceptibility to breast cancer in a Chinese population
Yan, R., Cao, J., Song, C., Chen, Y., Wu, Z., Wang, K., & Dai, L. (2015) · Cancer Epidemiology · doi:10.1016/j.canep.2015.10.025 · Cited by 69
Genetic Polymorphisms in Long Noncoding RNA H19 Are Associated With Susceptibility to Breast Cancer in Chinese Population
Xia, Z., Yan, R., Duan, F., Song, C., Wang, P., & Wang, K. (2016) · Medicine · doi:10.1097/md.0000000000002771 · Cited by 69
Translating statistical findings into plain English
Pocock, S. J., & Ware, J. H. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60499-2 · Cited by 67
The effects of merging proactive CCTV monitoring with directed police patrol: a randomized controlled trial
Piza, E. L., Caplan, J. M., Kennedy, L. W., & Gilchrist, A. M. (2015) · Journal of Experimental Criminology · doi:10.1007/s11292-014-9211-x · Cited by 88
Parental inflammatory bowel disease and autism in children
Sadik, A., Dardani, C., Pagoni, P., Havdahl, A., Stergiakouli, E., The iPSYCH Autism Spectrum Disorder Working Group, Grove, J., Khandaker, G. M., Sullivan, S. A., Zammit, S., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01845-9 · Cited by 71
Activation network mapping for integration of heterogeneous fMRI findings
Peng, S., Xu, P., Jiang, Y., & Gong, G. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01371-1 · Cited by 70
Unsaturated Fatty Acids in Mental Disorders: An Umbrella Review of Meta‐Analyses
Gao, X., Su, X., Han, X., Wen, H., Chen, C., Zhang, S., Li, W., Cai, J., Zheng, L., Ma, J., et al. (2022) · Advances in Nutrition · doi:10.1093/advances/nmac084 · Cited by 71
Strictureplasty vs resection in small bowel Crohn's disease: an evaluation of short‐term outcomes and recurrence
Reese, G., Purkayastha, S., Tilney, H. S., von Roon, A. C., Yamamoto, T., & Tekkis, P. P. (2006) · Colorectal Disease · doi:10.1111/j.1463-1318.2006.01114.x · Cited by 68
Genetically predicted education attainment in relation to somatic and mental health
Yuan, S., Xiong, Y., Michaëlsson, M., Michaëlsson, K., & Larsson, S. C. (2021) · Scientific Reports · doi:10.1038/s41598-021-83801-0 · Cited by 69
Severely increased generalized anxiety, but not COVID-19-related fear in individuals with mental illnesses: A population based cross-sectional study in Germany
Skoda, E.-M., Bäuerle, A., Schweda, A., Dörrie, N., Musche, V., Hetkamp, M., Dinse, H., Teufel, M., & Weismüller, B. (2020) · International Journal of Social Psychiatry · doi:10.1177/0020764020960773 · Cited by 66
A role for voltage‐gated, but not Ca2+‐activated, K+channels in regulating spontaneous contractile activity in myometrium from virgin and pregnant rats
Aaronson, P. I., Sarwar, U. N., Gin, S., Rockenbauch, U., Connolly, M., Tillet, A., Watson, S., Liu, B., & Tribe, R. M. (2006) · British Journal of Pharmacology · doi:10.1038/sj.bjp.0706644 · Cited by 66
Prenatal and Postnatal Milk Supplementation and Adult Insulin-like Growth Factor I: Long-term Follow-up of a Randomized Controlled Trial
Ben‐Shlomo, Y., Holly, J. M. P., McCarthy, A., Savage, P. B., Davies, D. P., & Smith, G. D. (2005) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-04-0908 · Cited by 65
Is self‐explanation worth the time? A comparison to additional practice
McEldoon, K. L., Durkin, K. L., & Rittle‐Johnson, B. (2012) · British Journal of Educational Psychology · doi:10.1111/j.2044-8279.2012.02083.x · Cited by 64
Empirical assessment suggests that existing evidence could be used more fully in designing randomized controlled trials
Goudie, A. C., Sutton, A. J., Jones, D. R., & Donald, A. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.01.022 · Cited by 63
The association between headache and Val158Met polymorphism in the catechol–O–methyltransferase gene: the HUNT Study
Hagen, K., Pettersen, E., Stovner, L. J., Skorpen, F., & Zwart, J. ‐. (2006) · The Journal of Headache and Pain · doi:10.1007/s10194-006-0281-7 · Cited by 63
Effects of Time of Day on Post‐Exercise Blood Pressure: Circadian or Sleep‐Related Influences?
Jones, H., George, K., Edwards, B., & Atkinson, G. (2008) · Chronobiology International · doi:10.1080/07420520802548044 · Cited by 63
The effect of a lifestyle intervention in obese pregnant women on gestational metabolic profiles: findings from the UK Pregnancies Better Eating and Activity Trial (UPBEAT) randomised controlled trial
Mills, H. L., Patel, N., White, S. L., Pasupathy, D., Briley, A. L., Ferreira, D. L. S., Seed, P. T., Nelson, S. M., Sattar, N. A., Tilling, K. M., et al. (2019) · BMC Medicine · doi:10.1186/s12916-018-1248-7 · Cited by 65
The Role of p -Values in Judging the Strength of Evidence and Realistic Replication Expectations
Gibson, E. W. (2020) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2020.1724560 · Cited by 68
Bite-size science and its undesired side effects
Bertamini, M., & Munafò, M. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691611429353 · Cited by 62
A Method to Constrain Genome-Scale Models with 13C Labeling Data
Martín, H. G., Kumar, V. S., Weaver, D. S., Ghosh, A., Chubukov, V., Mukhopadhyay, A., Arkin, A. P., & Keasling, J. D. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004363 · Cited by 62
The causal effects of health conditions and risk factors on social and socioeconomic outcomes: Mendelian randomization in UK Biobank
Harrison, S., Davies, A. R., Dickson, M., Tyrrell, J., Green, M. J., Katikireddi, S. V., Campbell, D., Munafo, M. R., Dixon, P., Jones, H. E., et al. (2020) · International Journal of Epidemiology · doi:10.1093/ije/dyaa114 · Cited by 63
Sex differences in systemic metabolites at four life stages: cohort study with repeated metabolomics
Bell, J. A., Ferreira, D. L. S., Fraser, A., Soares, A. G., Howe, L. D., Lawlor, D. A., Carslake, D., Smith, G. D., & O’Keeffe, L. M. (2021) · BMC Medicine · doi:10.1186/s12916-021-01929-2 · Cited by 64
The end of sleep: ‘Sleep debt’ versus biological adaptation of human sleep to waking needs
Horne, J. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.10.004 · Cited by 62
A comparison of pancreaticoduodenectomy with pylorus preserving pancreaticoduodenectomy: A meta-analysis of 2822 patients
Iqbal, N., Lovegrove, R. E., Tilney, H. S., Abraham, A., Bhattacharya, S., Tekkis, P. P., & Kocher, H. M. (2008) · European Journal of Surgical Oncology · doi:10.1016/j.ejso.2007.12.004 · Cited by 62
Modified constraint-induced movement therapy or bimanual occupational therapy following injection of Botulinum toxin-A to improve bimanual performance in young children with hemiplegic cerebral palsy: a randomised controlled trial methods paper
Hoare, B., Imms, C., Rawicki, H. B., & Carey, L. M. (2010) · BMC Neurology · doi:10.1186/1471-2377-10-58 · Cited by 62
Journals Should Publish All “Null” Results and Should Sparingly Publish “Positive” Results
Ioannidis, J. P. A. (2006) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-05-0921 · Cited by 62
Interventions to reduce ambient particulate matter air pollution and their effect on health
Burns, J., Boogaard, H., Turley, R., Pfadenhauer, L. M., van Erp, A. M., Rohwer, A. C., & Rehfuess, E. A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010919 · Cited by 66
Placing ‘Home’ and ‘Family’ in Rural Residential Mobilities
Scott, M. J., Murphy, E., & Gkartzios, M. (2017) · Sociologia Ruralis · doi:10.1111/soru.12165 · Cited by 61
Obesity and short sleep: unlikely bedfellows?
Horne, J. A. (2011) · Obesity Reviews · doi:10.1111/j.1467-789x.2010.00847.x · Cited by 63
Policies for alcohol restriction and their association with interpersonal violence: a time-series analysis of homicides in Cali, Colombia
Sanchez, A. I., Villaveces, A., Krafty, R. T., Park, T., Weiss, H. B., Fabio, A., Puyana, J. C., & Gutiérrez, M. I. (2011) · International Journal of Epidemiology · doi:10.1093/ije/dyr051 · Cited by 66
Use of Bayesian statistics in drug development: Advantages and challenges
Gupta, S. K. (2012) · International Journal of Applied and Basic Medical Research · doi:10.4103/2229-516x.96789 · Cited by 60
Novel Form of Curcumin Improves Endothelial Function in Young, Healthy Individuals: A Double-Blind Placebo Controlled Study
Oliver, J. M., Stoner, L. R., ROWLANDS, D. S., Caldwell, A. R., Sanders, E., Kreutzer, A., Mitchell, J. B., Purpura, M., & Jäger, R. (2016) · Journal of Nutrition and Metabolism · doi:10.1155/2016/1089653 · Cited by 60
Outcomes Following Laparoscopic Versus Open Repair of Incisional Hernia
Sains, P. S., Tilney, H. S., Purkayastha, S., Darzi, A. W., Athanasiou, T., Tekkis, P. P., & Heriot, A. G. (2006) · World Journal of Surgery · doi:10.1007/s00268-006-0026-4 · Cited by 59
Sleepiness as a need for sleep: When is enough, enough?
Horne, J. (2009) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.07.009 · Cited by 59
Resounding failure to replicate links between developmental language disorder and cerebral lateralisation
Wilson, A. C., & Bishop, D. (2018) · PeerJ · doi:10.7717/peerj.4217 · Cited by 59
Cardiorenal and other diabetes related outcomes with SGLT-2 inhibitors compared to GLP-1 receptor agonists in type 2 diabetes: nationwide observational study
Lugner, M., Sattar, N. A., Miftaraj, M., Ekelund, J., Franzén, S., Svensson, A., & Eliasson, B. (2021) · Cardiovascular Diabetology · doi:10.1186/s12933-021-01258-x · Cited by 60
Replication in genetic studies of complex traits
Sillanpää, M. J., & Auranen, K. J. (2004) · Annals of Human Genetics · doi:10.1046/j.1529-8817.2004.00122.x · Cited by 59
Adverse event assessment, analysis, and reporting in recent published analgesic clinical trials: ACTTION systematic review and recommendations
Smith, S. M., Wang, A. T., Katz, N. P., McDermott, M. P., Burke, L. B., Coplan, P., Gilron, I., Hertz, S. H., Lin, A. H., Rappaport, B. A., et al. (2013) · Pain · doi:10.1016/j.pain.2013.03.003 · Cited by 58
Associations among sleep disturbances, nocturnal sleep duration, daytime napping, and incident prediabetes and type 2 diabetes: the Heinz Nixdorf Recall Study
Kowall, B., Lehnich, A., Strucksberg, K.-H., Führer, D., Erbel, R., Jankovic, N., Moebus, S., Jöckel, K., & Stang, A. (2016) · Sleep Medicine · doi:10.1016/j.sleep.2015.12.017 · Cited by 62
The Fragility Index in a Cohort of Pediatric Randomized Controlled Trials
Matics, T. J., Khan, N., Jani, P., & Kane, J. M. (2017) · Journal of Clinical Medicine · doi:10.3390/jcm6080079 · Cited by 57
Power, effects, confidence, and significance: An investigation of statistical practices in nursing research
Gaskin, C. J., & Happell, B. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2013.09.014 · Cited by 57
Listen to the data when results are not significant
Hewitt, C. E., Mitchell, N., & Torgerson, D. J. (2008) · BMJ · doi:10.1136/bmj.39379.359560.ad · Cited by 57
Circulating interleukins in relation to coronary artery disease, atrial fibrillation and ischemic stroke and its subtypes: A two-sample Mendelian randomization study
Yuan, S., Lin, A., He, Q., Burgess, S., & Larsson, S. C. (2020) · International Journal of Cardiology · doi:10.1016/j.ijcard.2020.03.053 · Cited by 57
Sample Size Calculations in Acute Stroke Trials: A Systematic Review of Their Reporting, Characteristics, and Relationship With Outcome
Weaver, C. S., Leonardi-Bee, J., Bath-Hextall, F. J., & Bath, P. M. W. (2004) · Stroke · doi:10.1161/01.str.0000125010.70652.93 · Cited by 67
Comparison Between Wedge Resection and Lobectomy/Segmentectomy for Early-Stage Non-small Cell Lung Cancer: A Bayesian Meta-analysis and Systematic Review
Shi, Y., Wu, S., Ma, S., Lyu, Y., Xu, H., Deng, L., & Chen, X. (2021) · Annals of Surgical Oncology · doi:10.1245/s10434-021-10857-7 · Cited by 55
Statins in the prevention of venous thromboembolism: A meta-analysis of observational studies
Pai, M., Evans, N. S., Shah, S. J., Green, D., Cook, D., & Crowther, M. A. (2011) · Thrombosis Research · doi:10.1016/j.thromres.2011.05.012 · Cited by 56
CORP: Minimizing the chances of false positives and false negatives
Curran‐Everett, D. (2016) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00937.2016 · Cited by 54
Powering Bias and Clinically Important Treatment Effects in Randomized Trials of Critical Illness*
Abrams, D. C., Montesi, S. B., Moore, S. K., Manson, D. K., Klipper, K. M., Case, M. A., Brodie, D., & Beitler, J. R. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004568 · Cited by 51
Effect of Beta-Alanine With and Without Sodium Bicarbonate on 2,000-m Rowing Performance
Hobson, R. M., Harris, R. C., Martin, D., Smith, P., Macklin, B., Gualano, B., & Sale, C. (2013) · International Journal of Sport Nutrition and Exercise Metabolism · doi:10.1123/ijsnem.23.5.480 · Cited by 68
Stability of caregiver‐reported manual ability and gross motor function classifications of cerebral palsy
Imms, C., Carlin, J. B., & Eliasson, A. (2009) · Developmental Medicine & Child Neurology · doi:10.1111/j.1469-8749.2009.03346.x · Cited by 54
Fragility of Results in Ophthalmology Randomized Controlled Trials
Shen, C., Shamsudeen, I., Farrokhyar, F., & Sabri, K. (2017) · Ophthalmology · doi:10.1016/j.ophtha.2017.11.015 · Cited by 53
Evolution in statistics: P values, statistical significance, kayaks, and walking trees
Curran‐Everett, D. (2020) · AJP Advances in Physiology Education · doi:10.1152/advan.00054.2020 · Cited by 53
The earnestness of being important: Reporting non‐significant statistical results
Visentin, D. C., Cleary, M. L., & Hunt, G. E. (2019) · Journal of Advanced Nursing · doi:10.1111/jan.14283 · Cited by 53
The Search for Significance: A Few Peculiarities in the Distribution of P Values in Experimental Psychology Literature
Krawczyk, M. W. (2015) · PLoS ONE · doi:10.1371/journal.pone.0127872 · Cited by 56
How confidence intervals become confusion intervals
McCormack, J. P., Vandermeer, B., & Allan, G. M. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-134 · Cited by 51
Breastfeeding during infancy and neurocognitive function in adolescence: 16-year follow-up of the PROBIT cluster-randomized trial
Yang, S., Martin, R. M., Oken, E., Hameza, M., Doniger, G. M., Amit, S., Patel, R., Thompson, J., Rifas‐Shiman, S. L., Vilchuck, K., et al. (2018) · PLoS Medicine · doi:10.1371/journal.pmed.1002554 · Cited by 53
Slow Down: Behavioural and Physiological Effects of Reducing Eating Rate
Hawton, K., Ferriday, D., Rogers, P. J., Toner, P., Brooks, J. C. W., Holly, J. M. P., Biernacka, K. M., Hamilton-Shield, J. P., & Hinton, E. C. (2018) · Nutrients · doi:10.3390/nu11010050 · Cited by 58
How to review journal manuscripts
Rosenfeld, R. M. (2010) · Otolaryngology · doi:10.1016/j.otohns.2010.02.010 · Cited by 52
Dose Effect of Caffeine on Testosterone and Cortisol Responses to Resistance Exercise
Beaven, C. M., Hopkins, W. G., Hansen, K. T., Wood, M. R., Cronin, J. B., & Lowe, T. E. (2008) · International Journal of Sport Nutrition and Exercise Metabolism · doi:10.1123/ijsnem.18.2.131 · Cited by 71
An empirical comparison of heterogeneity variance estimators in 12 894 meta-analyses
Langan, D., Higgins, J. P. T., & Simmonds, M. C. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1140 · Cited by 51
Acute effects of intravenous cocaine administration on serum concentrations of ghrelin, amylin, glucagon-like peptide-1, insulin, leptin and peptide YY and relationships with cardiorespiratory and subjective responses
Bouhlal, S., Ellefsen, K. N., Sheskier, M. B., Singley, E., Pirard, S., Gorelick, D. A., Huestis, M. A., & Leggio, L. (2017) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2017.07.033 · Cited by 49
What Your Statistician Never Told You about P-Values
Blume, J. D., & Peipert, J. F. (2003) · The Journal of the American Association of Gynecologic Laparoscopists · doi:10.1016/s1074-3804(05)60143-0 · Cited by 51
Genetics of affective disorders
Johansson, C. H., Jansson, M., Linnér, L., Yuan, Q., Pedersen, N. L., Blackwood, D., Barden, N., Kelsoe, J. R., & Schalling, M. (2001) · European Neuropsychopharmacology · doi:10.1016/s0924-977x(01)00115-8 · Cited by 51
Simultaneous Modified Barium Swallow and Blue Dye Tests: A Determination of the Accuracy of Blue Dye Test Aspiration Findings
O’Neil-Pirozzi, T. M., Lisiecki, D. J., Momose, D. K. J., Connors, J. J., & Milliner, M. P. (2002) · Dysphagia · doi:10.1007/s00455-002-0081-4 · Cited by 50
Reporting of Patient-Reported Outcomes in Randomized Trials
Calvert, M., Blazeby, J. M., Altman, D. G., Revicki, D. A., Moher, D., & Brundage, M. (2017) · Cited by 50
The fragility of significant results underscores the need of larger randomized controlled trials in nephrology
Shochet, L. R., Kerr, P. G., & Polkinghorne, K. R. (2017) · Kidney International · doi:10.1016/j.kint.2017.05.011 · Cited by 50
The formal approach to quantitative causal inference in epidemiology: misguided or misrepresented?
Daniel, R., Stavola, B. L. D., & Vansteelandt, S. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw227 · Cited by 62
Smoking Stage of Change and Interest in an Emergency Department-based Intervention
Boudreaux, E. D., Baumann, B. M., Friedman, K., & Ziedonis, D. M. (2005) · Academic Emergency Medicine · doi:10.1197/j.aem.2004.09.022 · Cited by 50
Evidence from crossover trials: empirical evaluation and comparison against parallel arm trials
Lathyris, D., Trikalinos, T. A., & Ioannidis, J. P. A. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym001 · Cited by 50
Comparative clinical effectiveness and safety of tobacco cessation pharmacotherapies and electronic cigarettes: a systematic review and network meta‐analysis of randomized controlled trials
Thomas, K. H., Dalili, M. N., López-López, J. A., Keeney, E., Phillippo, D., Munafo, M. R., Stevenson, M., Caldwell, D. M., & Welton, N. J. (2021) · Addiction · doi:10.1111/add.15675 · Cited by 48
Risk Factors for Ovarian Cancer: An Umbrella Review of the Literature
Whelan, E., Kalliala, I. E. J., Semertzidou, A., Raglan, O., Bowden, S. J., Kechagias, K. S., Markozannes, G., Cividini, S., McNeish, I. A., Marchesi, J. R., et al. (2022) · Cancers · doi:10.3390/cancers14112708 · Cited by 52
Associations of device-measured physical activity across adolescence with metabolic traits: Prospective cohort study
Bell, J. A., Hamer, M., Richmond, R. C., Timpson, N. J., Carslake, D., & Smith, G. D. (2018) · PLoS Medicine · doi:10.1371/journal.pmed.1002649 · Cited by 50
Influence of Fathers' Early Parenting on the Development of Children Born Very Preterm and Full Term
McMahon, G. E., Spencer-Smith, M. M., Pace, C. C., Spittle, A. J., Stedall, P., Richardson, K., Cheong, J. L. Y., Doyle, L. W., Anderson, P. J., & Treyvaud, K. (2019) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2018.09.073 · Cited by 48
Higher versus lower fractions of inspired oxygen or targets of arterial oxygenation for adults admitted to the intensive care unit
Klitgaard, T., Schjørring, O. L., Nielsen, F. M., Meyhoff, C. S., Perner, A., Wetterslev, J., Rasmussen, B. S., & Barbateskovic, M. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012631.pub3 · Cited by 48
Impairment measures versus inflammatory RODS in GBS and CIDP : a responsiveness comparison
Vanhoutte, E. K., Draak, T. H. P., Gorson, K. C., van Nes, S. I., Hoeijmakers, J. G. J., van der Pol, W. L., Notermans, N. C., Lewis, R. A., Nobile‐Orazio, E., Léger, J., et al. (2015) · Journal of the Peripheral Nervous System · doi:10.1111/jns.12118 · Cited by 48
High Systolic Blood Pressure Is Associated With Val/Val Genotype in the Catechol-O-Methyltransferase GeneThe Nord-Trøndelag Health Study (HUNT)
Hagen, K., PETTERSEN, E., Stovner, L. J., Skorpen, F., Holmen, J., & Zwart, J. (2006) · American Journal of Hypertension · doi:10.1016/j.amjhyper.2006.05.023 · Cited by 48
Biostatistics Primer: What a Clinician Ought to Know—Prognostic and Predictive Factors
Simms, L., Barraclough, H., & Govindan, R. (2013) · Journal of Thoracic Oncology · doi:10.1097/jto.0b013e318292bdcd · Cited by 48
Trials of prostate-cancer screening are not worthwhile
Dubben, H.-H. (2009) · The Lancet Oncology · doi:10.1016/s1470-2045(09)70066-x · Cited by 48
Benthic foraminifera response and geochemical characterization of the coastal environment surrounding the polluted industrial area of Portovesme (South-Western Sardinia, Italy)
Cherchi, A., Pelo, S. D., Ibba, A., Mana, D., Buosi, C., & Floris, N. (2009) · Marine Pollution Bulletin · doi:10.1016/j.marpolbul.2009.09.016 · Cited by 48
Role of genetic mutations in folate-related enzyme genes on Male Infertility
Liu, K., Zhao, R., Shen, M., Ye, J., Xiao, L., Huang, Y., Hua, L., Wang, Z., & Li, J. (2015) · Scientific Reports · doi:10.1038/srep15548 · Cited by 52
Random Allocation in Observational Data
Smith, G. D. (2011) · Epidemiology · doi:10.1097/ede.0b013e31821d0426 · Cited by 50
Texting to Increase Adolescent Physical Activity: Feasibility Assessment
Thompson, D. I., Cantu, D., Ramirez, B., Cullen, K. W., Baranowski, T., Mendoza, J. A., Anderson, B. J., Jago, R., Rodgers, W. M., & Liu, Y. (2016) · American Journal of Health Behavior · doi:10.5993/ajhb.40.4.9 · Cited by 50
Secukinumab Versus Adalimumab for Psoriatic Arthritis: Comparative Effectiveness up to 48 Weeks Using a Matching-Adjusted Indirect Comparison
Nash, P. T., McInnes, I. B., Mease, P. J., Thom, H. H. Z., Hünger, M., Karabis, A., Gandhi, K. K., Mpofu, S., & Jugl, S. M. (2018) · Rheumatology and Therapy · doi:10.1007/s40744-018-0106-6 · Cited by 49
Power-Related Determinants of Modified Agility T-test Performance in Male Adolescent Basketball Players
Scanlan, A. T., Wen, N., Pyne, D. B., Stojanović, E., Milanović, Z., Conte, D., Vaquera, A., & Dalbo, V. J. (2019) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000003131 · Cited by 48
EEMCO Guidance for the in vivo Assessment of Biomechanical Properties of the Human Skin and Its Annexes: Revisiting Instrumentation and Test Modes
Rodrigues, L. M., Fluhr, J. W., & the EEMCO Group (2019) · Skin Pharmacology and Physiology · doi:10.1159/000504063 · Cited by 48
Psoriasis, cardiovascular risk factors and metabolic disorders: sex‐specific findings of a population‐based study
Sondermann, W., Deudjui, D. A. D., Körber, A., Slomiany, U., Brinker, T. J., Erbel, R., & Moebus, S. (2019) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.16029 · Cited by 48
Study Design in Medical Research
Röhrig, B., du Prel, J., & Blettner, M. (2009) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2009.0184 · Cited by 48
Translating statistical findings into plain English
Stang, A. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61703-7 · Cited by 48

Authors: Sterne, J. A. C.
Affiliations: University of Bristol (GB)
Corresponding author: Sterne, J. A C
ORCID: Sterne, J. A C
Venue: BMJ
Publisher: BMJ
Published: 2001-01-27
Volume: 322
Issue: 7280
Pages: 226-231
ISSN: 0959-8138 (ISSN-L)
DOI: 10.1136/bmj.322.7280.226
PMC: PMC1119478
OpenAlex: W2025651303
Cited by: 1,466
References: 48
Citations by year: 2026: 48 · 2025: 64 · 2024: 75 · 2023: 63 · 2022: 63 · 2021: 82 · 2020: 72 · 2019: 82 · 2018: 75 · 2017: 79 · 2016: 74 · 2015: 48 · 2014: 56 · 2013: 50 · 2012: 53
FWCI: 45.33
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Locations: BMJ (publishedVersion)
Europe PMC (PubMed Central) (publishedVersion)
PubMed Central (publishedVersion)
PubMed (publishedVersion)
HighWire Press Open Archive (submittedVersion)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Keywords: statistical significance, p-values, publication bias, false positives, null hypothesis, evidence evaluation
MeSH terms: Bayes Theorem, Data Interpretation, Statistical, Humans, Research Design, Statistics as Topic, History, 20th Century

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Sifting the evidence---what's wrong with significance tests? Another comment on the role of statistical methods

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks