Cited by 1,466Statistical Methods in EpidemiologyMeta-analysis and systematic reviewsStatistical Methods in Clinical Trials

The DOI matches its Crossref record; 46 of the 48 references it cites were found in a registry or an index.

Sifting the evidence---what's wrong with significance tests? Another comment on the role of statistical methods

Open access

Sterne, J. A C·2001·BMJ

DOI 10.1136/bmj.322.7280.226PMC PMC1119478

Open this paper in CoChat — free account

Abstract

The findings of medical research are often met with considerable scepticism, even when they have apparently come from studies with sound methodologies that have been subjected to appropriate statistical analysis. This is perhaps particularly the case with respect to epidemiological findings that suggest that some aspect of everyday life is bad for people. Indeed, one recent popular history, the medical journalist James Le Fanu's The Rise and Fall of Modern Medicine , went so far as to suggest that the solution to medicine's ills would be the closure of all departments of epidemiology.1 One contributory factor is that the medical literature shows a strong tendency to accentuate the positive; positive outcomes are more likely to be reported than null results.2–4 By this means alone a host of purely chance findings will be published, as by conventional reasoning examining 20 associations will produce one result that is “significant at P=0.05” by chance alone. If only positive findings are published then they may be mistakenly considered to be of importance rather than being the necessary chance results produced by the application of criteria for meaningfulness based on statistical significance. As many studies contain long questionnaires collecting information on hundreds of variables, and measure a wide range of potential outcomes, several false positive findings are virtually guaranteed. The high volume and often contradictory nature5 of medical research findings, however, is not only because of publication bias. A more fundamental problem is the widespread misunderstanding of the nature of statistical significance. #### Summary points P values, or significance levels, measure the strength of the evidence against the null hypothesis; the smaller the P value, the stronger the evidence against the null hypothesis An arbitrary division of results, into “significant” or “non-significant” according to the P value, was not the intention of the …

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1136/bmj.322.7280.226

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Statistical Methods for Research Workers
Fisher, R. A. (1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,883
Association between Water Intake, Chronic Kidney Disease, and Cardiovascular Disease: A Cross-Sectional Analysis of NHANES Data
Sontrop, J. M., Dixon, S. N., Garg, A. X., Jiménez, I. B., Dohein, O., Huang, S. S., & Clark, W. F. (2013) · American Journal of Nephrology · doi:10.1159/000350377 · Cited by 5,903
Statistical Inference
Casella, G., & Berger, R. L. (1993) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,835
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
IX. On the problem of the most efficient tests of statistical hypotheses
Neyman, J., & Pearson, E. S. (1933) · Philosophical Transactions of the Royal Society of London Series A Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1933.0009 · Cited by 2,370
Confidence intervals rather than P values: estimation rather than hypothesis testing.
Gardner, M. J., & Altman, D. G. (1986) · BMJ · doi:10.1136/bmj.292.6522.746 · Cited by 2,014
Statistics with Confidence
Smithson, M. J. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218525 · Cited by 1,871
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
The Importance of Beta, the Type II Error and Sample Size in the Design and Interpretation of the Randomized Control Trial: Survey of 71 Negative Trials
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
ON THE PROBLEM OF THE MOST EFFICIENT TESTS OF STATISTICAL HYPOTHESES
Neyman, J., & Pearson, E. S. (1967) · University of California Press eBooks · doi:10.1525/9780520339897-008 · Cited by 1,545

Show all 48 references

Research works printed but not linked: 5

[38]Davey Smith G. Reflections on the limits to epidemiology. J Clin Epidemiol (in press).
BMJ. 2001 Jan 27;322(7280):226–231.
1-1.Fisher RA. Statistical methods for research workers. 1st ed. Edinburgh: Oliver and Boyd; 1925. . Reprinted by Oxford University Press. [Google Scholar]
1-2.Fisher RA. Design of experiments. 1st ed. Edinburgh: Oliver and Boyd; 1935. . Reprinted by Oxford University Press. [Google Scholar]
1-4.Cox DR. Statistical significance tests. Br J Clin Pharmacol. 1982;14:325–331. doi: 10.1111/j.1365-2125.1982.tb01987.x. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI

Sorted by citations

Items 101–200 of 1,000

Gene–environment interaction and aetiology of cancer: what does it mean and how can we measure it?
Brennan, P. (2002) · Carcinogenesis · doi:10.1093/carcin/23.3.381 · Cited by 221
The ongoing tyranny of statistical significance testing in biomedical research
Stang, A., Poole, C., & Kuß, O. (2010) · European Journal of Epidemiology · doi:10.1007/s10654-010-9440-x · Cited by 221
Antibiotics for adults with clinically diagnosed acute rhinosinusitis: a meta-analysis of individual patient data
Young, J., Sutter, A. D., Merenstein, D., van Essen, G. A., Kaiser, L., Varonen, H., Williamson, I. G., & Bucher, H. C. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60416-x · Cited by 221
Multiple Effects of Caffeine on Simulated High-Intensity Team-Sport Performance
STUART, G. R., Hopkins, W. G., Cook, C. J., & Cairns, S. P. (2005) · Medicine & Science in Sports & Exercise · doi:10.1249/01.mss.0000177216.21847.8a · Cited by 220
Very Preterm Birth Influences Parental Mental Health and Family Outcomes Seven Years after Birth
Treyvaud, K., Lee, K. J., Doyle, L. W., & Anderson, P. J. (2014) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2013.11.001 · Cited by 213
Using Graphs Instead of Tables in Political Science
Kastellec, J., & Leoni, E. L. (2007) · Perspectives on Politics · doi:10.1017/s1537592707072209 · Cited by 218
Trends in the utilisation of psychotropic medications in Australia from 2000 to 2011
Stephenson, C. P., Karanges, E., & McGregor, I. S. (2013) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867412466595 · Cited by 217
Methods for meta-analysis in genetic association studies: a review of their potential and pitfalls
Kavvoura, F. K., & Ioannidis, J. P. A. (2007) · Human Genetics · doi:10.1007/s00439-007-0445-9 · Cited by 209
Meta-analysis of sentinel node imprint cytology in breast cancer
Tew, K., Irwig, L., Matthews, A., Crowe, P. J., & Macaskill, P. (2005) · British journal of surgery · doi:10.1002/bjs.5139 · Cited by 207
The Influence of Methodological Issues on the Results and Conclusions from Epidemiological Studies of Sports Injuries
Brooks, J. H. M., & Fuller, C. W. (2006) · Sports Medicine · doi:10.2165/00007256-200636060-00001 · Cited by 207
The effect of the serotonin transporter polymorphism (5-HTTLPR) on amygdala function: a meta-analysis
Murphy, S. E., Norbury, R., Godlewska, B. R., Cowen, P. J., Mannie, Z. M., Harmer, C. J., & Munafo, M. R. (2012) · Molecular Psychiatry · doi:10.1038/mp.2012.19 · Cited by 205
Integration of Motor Imagery and Physical Practice in Group Treatment Applied to Subjects With Parkinson’s Disease
Tamir, R., Dickstein, R., & Huberman, M. (2006) · Neurorehabilitation and neural repair · doi:10.1177/1545968306292608 · Cited by 204
Evaluating the relationship between alcohol consumption, tobacco use, and cardiovascular disease: A multivariable Mendelian randomization study
Rosoff, D. B., Smith, G. D., Mehta, N. N., Clarke, T., & Lohoff, F. W. (2020) · PLoS Medicine · doi:10.1371/journal.pmed.1003410 · Cited by 213
The role of genetic polymorphisms in periodontitis
Yoshie, H., Kobayashi, T., 田井, 秀., & Galicia, J. C. (2007) · Periodontology 2000 · doi:10.1111/j.1600-0757.2006.00164.x · Cited by 200
Statistical methodology in oral and dental research: Pitfalls and recommendations
Hannigan, A., & Lynch, C. D. (2013) · Journal of Dentistry · doi:10.1016/j.jdent.2013.02.013 · Cited by 200
Is everything we eat associated with cancer? A systematic cookbook review
Schoenfeld, J. D., & Ioannidis, J. P. A. (2012) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.112.047142 · Cited by 202
The Fragility Index in Randomized Clinical Trials as a Means of Optimizing Patient Care
Tignanelli, C. J., & Napolitano, L. (2018) · JAMA Surgery · doi:10.1001/jamasurg.2018.4318 · Cited by 186
Is the burden of overweight shifting to the poor across the globe? Time trends among women in 39 low- and middle-income countries (1991–2008)
Jones‐Smith, J. C., Gordon‐Larsen, P., Siddiqi, A., & Popkin, B. M. (2011) · International Journal of Obesity · doi:10.1038/ijo.2011.179 · Cited by 194
Counselling for Alcohol Problems (CAP), a lay counsellor-delivered brief psychological treatment for harmful drinking in men, in primary care in India: a randomised controlled trial
Nadkarni, A., Weobong, B., Weiss, H. A., McCambridge, J., Bhat, B., Katti, B., Murthy, P., King, M., McDaid, D., Park, A.-L., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(16)31590-2 · Cited by 187
Comparison of laparoscopic and open ileocecal resection for Crohn’s disease: a metaanalysis
Tilney, H. S., Constantinides, V. A., Heriot, A. G., Nicolaou, M., Athanasiou, T., Ziprin, P., Darzi, A. W., & Tekkis, P. P. (2006) · Surgical Endoscopy · doi:10.1007/s00464-005-0500-3 · Cited by 193
Geographical variation in dementia: Systematic review with meta-analysis
Russ, T. C., Batty, G. D., Hearnshaw, G. F., Fenton, C., & Starr, J. M. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys103 · Cited by 191
Questionnaires in clinical trials: guidelines for optimal design and administration
Edwards, P. J. (2010) · Trials · doi:10.1186/1745-6215-11-2 · Cited by 188
Bayesian statistical inference enhances the interpretation of contemporary randomized controlled trials
Wijeysundera, D. N., Austin, P. C., Hux, J. E., Beattie, W. S., & Laupacis, A. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.07.006 · Cited by 188
Randomized controlled trial of the Alexander Technique for idiopathic Parkinson's disease
Stallibrass, C., Sissons, P., & Chalmers, C. (2002) · Clinical Rehabilitation · doi:10.1191/0269215502cr544oa · Cited by 186
Epidemiology and Culture
Trostle, J. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511806025 · Cited by 187
Detecting implausible social network effects in acne, height, and headaches: longitudinal analysis
Cohen‐Cole, E., & Fletcher, J. M. (2008) · BMJ · doi:10.1136/bmj.a2533 · Cited by 188
Inter- and Intra-individual Variability Following Intermittent Theta Burst Stimulation: Implications for Rehabilitation and Recovery
Hinder, M. R., Goss, E. L., Fujiyama, H., Canty, A. J., Garry, M. I., Rodger, J., & Summers, J. J. (2014) · Brain stimulation · doi:10.1016/j.brs.2014.01.004 · Cited by 204
Lactobacillus fermentum (PCC®) supplementation and gastrointestinal and respiratory-tract illness symptoms: a randomised control trial in athletes
West, N. P., Pyne, D. B., Cripps, A. W., Hopkins, W. G., Eskesen, D. C., Jairath, A., Christophersen, C. T., Conlon, M. A., & Fricker, P. A. (2011) · Nutrition Journal · doi:10.1186/1475-2891-10-30 · Cited by 180
Associations Between Peer Victimization and Suicidal Ideation and Suicide Attempt During Adolescence: Results From a Prospective Population-Based Birth Cohort
Geoffroy, M., Boivin, M., Arseneault, L., Turecki, G., Vitaro, F., Brendgen, M. R., Renaud, J., Séguin, J. R., Tremblay, R. E., & Côté, S. M. (2015) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2015.11.010 · Cited by 181
Association of the5-HTTLPRgenotype and unipolar depression: a meta-analysis
Clarke, H. F., Flint, J., Attwood, A. S., & Munafo, M. R. (2010) · Psychological Medicine · doi:10.1017/s0033291710000516 · Cited by 177
Power and Error: Increased Risk of False Positive Results in Underpowered Studies
Christley, R. (2010) · The Open Epidemiology Journal · doi:10.2174/1874297101003010016 · Cited by 175
How and why studies disagree about the effects of education on health: A systematic review and meta-analysis of studies of compulsory schooling laws
Hamad, R., Elser, H. C., Tran, D. C., Rehkopf, D. H., & Goodman, S. N. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.07.016 · Cited by 185
Ensuring trial validity by data quality assurance and diversification of monitoring methods
Baigent, C., Harrell, F. E., Buyse, M., Emberson, J. R., & Altman, D. G. (2008) · Clinical Trials · doi:10.1177/1740774507087554 · Cited by 163
The Fragility of Statistically Significant Findings From Randomized Trials in Sports Surgery: A Systematic Survey
Khan, M., Evaniew, N., Gichuru, M., Habib, A., Ayeni, O., Bedi, A., Walsh, M., Devereaux, P. J., & Bhandari, M. (2017) · American Journal of Sports Medicine · doi:10.1177/0363546516674469 · Cited by 156
Similarity in transgender and cisgender children’s gender development
Gülgöz, S., Glazier, J. J., Enright, E. A., Alonso, D. J., Durwood, L., Fast, A. A., Lowe, R. S., Ji, C., Heer, J., Martin, C. L., et al. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1909367116 · Cited by 170
Associations of Body Mass and Fat Indexes With Cardiometabolic Traits
Bell, J. A., Carslake, D., O’Keeffe, L. M., Frysz, M., Howe, L. D., Hamer, M., Wade, K. H., Timpson, N. J., & Smith, G. D. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.09.066 · Cited by 164
Adiposity, metabolites, and colorectal cancer risk: Mendelian randomization study
Bull, C. J., Bell, J. A., Murphy, N., Sanderson, E. C. M., Smith, G. D., Timpson, N. J., Banbury, B. L., Albanes, D., Berndt, S. I., Bezieau, S., et al. (2020) · BMC Medicine · doi:10.1186/s12916-020-01855-9 · Cited by 174
Plasma phospholipid fatty acid composition as a biomarker of habitual dietary fat intake in an ethnically diverse cohort
Hodge, A. M., Simpson, J. A., Gibson, R. A., Sinclair, A. J., Makrides, M., O’Dea, K., English, D. R., & Giles, G. G. (2006) · Nutrition Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2006.04.005 · Cited by 164
Practical Sample Size Calculations for Surveillance and Diagnostic Investigations
Fosgate, G. T. (2009) · Journal of Veterinary Diagnostic Investigation · doi:10.1177/104063870902100102 · Cited by 162
Primary prevention for alcohol misuse in young people
FOXCROFT, D. R., Ireland, D., Lowe, G., & Breen, R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003024.pub2 · Cited by 164
Retracted
Viscosupplementation for knee osteoarthritis: systematic review and meta-analysis
Pereira, T., Jüni, P., Saadat, P., Xing, D., Yao, L., Bobos, P., Agarwal, A., Hincapié, C. A., & da Costa, B. R. (2022) · BMJ · doi:10.1136/bmj-2022-069722 · Cited by 162
Local Recurrence of Disease after Unplanned Excisions of High-grade Soft Tissue Sarcomas
Potter, B. K., Adams, S. C., Pitcher, D. J., & Temple, T. H. (2008) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-008-0529-4 · Cited by 160
Multiparameter Evidence Synthesis in Epidemiology and Medical Decision-Making: Current Approaches
Ades, A. E., & Sutton, A. J. (2005) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2005.00377.x · Cited by 157
Parent and Child Screen-Viewing Time and Home Media Environment
Jago, R., Stamatakis, E. A., Gama, A., Mourão, I., Nogueira, H. G. D. S. M., Rosado‐Marques, V., & Padez, C. M. P. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.04.012 · Cited by 159
Clinical relevance vs. statistical significance: Using neck outcomes in patients with temporomandibular disorders as an example
Armijo-Olivo, S. L., Warren, S., Fuentes, J., & Magee, D. J. (2011) · Manual Therapy · doi:10.1016/j.math.2011.05.006 · Cited by 158
Changes in player characteristics and match activities in Bledisloe Cup rugby union from 1972 to 2004
Quarrie, K. L., & Hopkins, W. G. (2007) · Journal of Sports Sciences · doi:10.1080/02640410600944659 · Cited by 156
How to Construct, Conduct and Analyze an Exercise Training Study?
Hecksteden, A., Faude, O., Meyer, T., & Donath, L. (2018) · Frontiers in Physiology · doi:10.3389/fphys.2018.01007 · Cited by 172
Belief beyond the evidence: using the proposed effect of breakfast on obesity to show 2 practices that distort scientific evidence
Brown, A. W., Bohan Brown, M. M., & Allison, D. B. (2013) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.064410 · Cited by 155
Clinical study investigating the role of lymphadenectomy, surgical castration and adjuvant hormonal treatment in endometrial stromal sarcoma
Amant, F. C., Knijf, A. D., CALSTER, B. V., Leunen, K., Neven, P., Berteloot, P., Vergote, I. B., Huffel, S. V., & Moerman, P. (2007) · British Journal of Cancer · doi:10.1038/sj.bjc.6603986 · Cited by 152
A meta-analysis of 21 178 patients undergoing open or endovascular repair of abdominal aortic aneurysm
Lovegrove, R. E., Javid, M., Magee, T. R., & Galland, R. B. (2008) · British journal of surgery · doi:10.1002/bjs.6240 · Cited by 150
Is Type 2 Diabetes Causally Associated With Cancer Risk? Evidence From a Two-Sample Mendelian Randomization Study
Yuan, S., Kar, S., Carter, P., Vithayathil, M. K., Mason, A. M., Burgess, S., & Larsson, S. C. (2020) · Diabetes · doi:10.2337/db20-0084 · Cited by 154
Radiofrequency Treatment of Turbinate Hypertrophy in Subjects Using Continuous Positive Airway Pressure: A Randomized, Double‐Blind, Placebo‐Controlled Clinical Pilot Trial
Powell, N. B., Zonato, A. I., Weaver, E. M., Li, K. K., Troell, R. J., Riley, R. W., & Guilleminault, C. (2001) · The Laryngoscope · doi:10.1097/00005537-200110000-00023 · Cited by 149
Efficacy of periodontal plastic procedures in the treatment of multiple gingival recessions
Graziani, F., Gennai, S., Roldán, S., Discepoli, N., Buti, J., Madianos, P., & Herrera, D. (2014) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.12172 · Cited by 148
Air pollution exposure, cause-specific deaths and hospitalizations in a highly polluted Italian region
Carugno, M., Consonni, D., Randi, G., Catelan, D., Grisotto, L., Bertazzi, P. A., Biggeri, A., & Baccini, M. (2016) · Environmental Research · doi:10.1016/j.envres.2016.03.003 · Cited by 148
Effect of nationwide injury prevention programme on serious spinal injuries in New Zealand rugby union: ecological study
Quarrie, K. L., Gianotti, S. M., Hopkins, W. G., & Hume, P. A. (2007) · BMJ · doi:10.1136/bmj.39185.605914.ae · Cited by 146
Sample size calculations in human electrophysiology (EEG and ERP) studies: A systematic review and recommendations for increased rigor
Larson, M. J., & Carbine, K. A. (2016) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2016.06.015 · Cited by 154
Errors of measurement for blood volume parameters: a meta-analysis
Gore, C. J., Hopkins, W. G., & Burge, C. M. (2005) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00505.2005 · Cited by 145
The risk of premalignant and malignant pathology in endometrial polyps
Bakour, S. H., Khan, K. S., & Gupta, J. K. (2002) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1034/j.1600-0412.2002.810220.x · Cited by 144
Meta‐analysis of short‐term and long‐term outcomes of J, W and S ileal reservoirs for restorative proctocolectomy
Lovegrove, R. E., Heriot, A. G., Constantinides, V. A., Tilney, H. S., Darzi, A. W., Fazio, V. W., Nicholls, R. J., & Tekkis, P. P. (2006) · Colorectal Disease · doi:10.1111/j.1463-1318.2006.01093.x · Cited by 144
Meta-analyses of Observational and Genetic Association Studies of Folate Intakes or Levels and Breast Cancer Risk
Lewis, S. J., Harbord, R. M., Harris, R., & Smith, G. D. (2006) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djj440 · Cited by 141
An Examination of the Effect of Perceived Risk on Preparedness Behavior
Bourque, L. B., Regan, R., Kelley, M. M., Wood, M. M., Kano, M., & Mileti, D. S. (2012) · Environment and Behavior · doi:10.1177/0013916512437596 · Cited by 142
Associations of Newborn Brain Magnetic Resonance Imaging with Long-Term Neurodevelopmental Impairments in Very Preterm Children
Anderson, P. J., Treyvaud, K., Neil, J. J., Cheong, J. L. Y., Hunt, R. W., Thompson, D. K., Lee, K. J., Doyle, L. W., & Inder, T. E. (2017) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2017.04.059 · Cited by 142
Multi-omic integrated networks connect DNA methylation and miRNA with skeletal muscle plasticity to chronic exercise in Type 2 diabetic obesity
ROWLANDS, D. S., Page, R., Sukala, W. R., Giri, M., Ghimbovschi, S. D., Hayat, I., Cheema, B. S., Lys, I., Leikis, M. J., Sheard, P., et al. (2014) · Physiological Genomics · doi:10.1152/physiolgenomics.00024.2014 · Cited by 144
Sustained effectiveness and cost-effectiveness of the Healthy Activity Programme, a brief psychological treatment for depression delivered by lay counsellors in primary care: 12-month follow-up of a randomised controlled trial
Weobong, B., Weiss, H. A., McDaid, D., Singla, D. R., Hollon, S. D., Nadkarni, A., Park, A.-L., Bhat, B., Katti, B., Anand, A., et al. (2017) · PLOS Medicine · doi:10.1371/journal.pmed.1002385 · Cited by 135
Inadequate statistical power to detect clinically significant differences in adverse event rates in randomized controlled trials
Tsang, R., Colley, L., & Lynd, L. D. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.08.005 · Cited by 142
Meta-analysis of colonic reservoirs versus straight coloanal anastomosis after anterior resection
Heriot, A. G., Tekkis, P. P., Constantinides, V. A., Paraskevas, P., Nicholls, R. J., Darzi, A. W., & Fazio, V. W. (2005) · British journal of surgery · doi:10.1002/bjs.5188 · Cited by 138
Re: Estimation of Bias in Nongenetic Observational Studies Using “Mendelian Triangulation” by Bautista et al.
Thomas, D. C., Lawlor, D. A., & Thompson, J. R. (2007) · Annals of Epidemiology · doi:10.1016/j.annepidem.2006.12.005 · Cited by 138
Systematic review and meta-analysis of the effect of portal triad clamping on outcome after hepatic resection
Rahbari, N. N., Wente, M. N., Schemmer, P., Diener, M. K., Hoffmann, K., Motschall, E., Schmidt, J., Weitz, J., & Büchler, M. W. (2008) · British journal of surgery · doi:10.1002/bjs.6141 · Cited by 136
Performance league tables: the NHS deserves better
Adab, P., Rouse, A., Mohammed, M. A., & Marshall, T. P. (2002) · BMJ · doi:10.1136/bmj.324.7329.95 · Cited by 137
Dissecting the genetic architecture of human personality
Munafo, M. R., & Flint, J. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.07.007 · Cited by 138
Significant and meaningful effects in sports biomechanics research
Knudson, D. (2009) · Sports Biomechanics · doi:10.1080/14763140802629966 · Cited by 146
Effects of ground and joint reaction force exercise on lumbar spine and femoral neck bone mineral density in postmenopausal women: a meta-analysis of randomized controlled trials
Kelley, G. A., Kelley, K. S., & Kohrt, W. M. (2012) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-13-177 · Cited by 135
Incidence of Type 2 Diabetes in the Randomized Multiple Risk Factor Intervention Trial
Smith, G. D., Bracha, Y., Svendsen, K. H., Neaton, J. D., Haffner, S. M., & Kuller, L. H. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-5-200503010-00006 · Cited by 135
Synthesis of observational studies should consider credibility ceilings
Salanti, G., & Ioannidis, J. P. A. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.05.014 · Cited by 108
Challenges and novel approaches for investigating molecular mediation
Richmond, R. C., Hemani, G., Tilling, K. M., Smith, G. D., & Relton, C. L. (2016) · Human Molecular Genetics · doi:10.1093/hmg/ddw197 · Cited by 133
The albatross plot: A novel graphical tool for presenting results of diversely reported studies in a systematic review
Harrison, S., Jones, H. E., Martin, R. M., Lewis, S. J., & Higgins, J. P. T. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1239 · Cited by 133
Exploiting horizontal pleiotropy to search for causal pathways within a Mendelian randomization framework
Cho, Y., Haycock, P., Sanderson, E. C. M., Gaunt, T. R., Zheng, J., Morris, A. P., Smith, G. D., & Hemani, G. (2020) · Nature Communications · doi:10.1038/s41467-020-14452-4 · Cited by 139
Randomised clinical trials in critical care: past, present and future
Granholm, A., Alhazzani, W. A., Derde, L. P. G., Angus, D. C., Zampieri, F. G., Hammond, N. E., Sweeney, R. M., Myatra, S. N., Azoulay, É., Rowan, K., et al. (2021) · Intensive Care Medicine · doi:10.1007/s00134-021-06587-9 · Cited by 136
PHYSIOTHERAPY BASED ON THE BOBATH CONCEPT FOR ADULTS WITH POST-STROKE HEMIPLEGIA: A REVIEW OF EFFECTIVENESS STUDIES
Paci, M. (2003) · Journal of Rehabilitation Medicine · doi:10.1080/16501970306106 · Cited by 131
Clinical and Laboratory Evaluation of Upper Respiratory Symptoms in Elite Athletes
Cox, A. J., Gleeson, M., Pyne, D. B., Callister, R., Hopkins, W. G., & Fricker, P. A. (2008) · Clinical Journal of Sport Medicine · doi:10.1097/jsm.0b013e318181e501 · Cited by 138
Functional Data Analysis of Running Kinematics in Chronic Achilles Tendon Injury
Donoghue, O. A., Harrison, A. J., Bargary, N., & Hayes, K. (2008) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31816c4807 · Cited by 128
How effective are family-based and institutional nutrition interventions in improving children’s diet and health? A systematic review
Black, A. P., D’Onise, K., McDermott, R. A., Vally, H., & O’Dea, K. (2017) · BMC Public Health · doi:10.1186/s12889-017-4795-5 · Cited by 147
Problems with the “omics”
Lay, J. O., Liyanage, R., Borgmann, S., & Wilkins, C. L. (2006) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2006.10.007 · Cited by 130
A proposed framework to guide evidence synthesis practice for meta-analysis with zero-events studies
Xu, C., Furuya-Kanamori, L., Zorzela, L., Lin, L., & Vohra, S. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.02.012 · Cited by 117
Evaluation of RugbySmart: A rugby union community injury prevention programme
Gianotti, S. M., Quarrie, K. L., & Hume, P. A. (2008) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2008.01.002 · Cited by 127
Influence of puberty timing on adiposity and cardiometabolic traits: A Mendelian randomisation study
Bell, J. A., Carslake, D., Wade, K. H., Richmond, R. C., Langdon, R., Vincent, E. E., Holmes, M. V., Timpson, N. J., & Smith, G. D. (2018) · PLoS Medicine · doi:10.1371/journal.pmed.1002641 · Cited by 127
Mendelian Randomization Study of PCSK9 and HMG-CoA Reductase Inhibition and Cognitive Function
Rosoff, D. B., Bell, A. S., Jung, J., Wagner, J., Mavromatis, L. A., & Lohoff, F. W. (2022) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2022.05.041 · Cited by 126
Polysubstance use, mental health and high-risk behaviours: Results from the 2012 Global Drug Survey
Morley, K. I., Lynskey, M. T., Moran, P., Borschmann, R., & WINSTOCK, A. R. (2015) · Drug and Alcohol Review · doi:10.1111/dar.12263 · Cited by 125
Trans-ethnic Mendelian-randomization study reveals causal relationships between cardiometabolic factors and chronic kidney disease
Zheng, J., Zhang, Y., Rasheed, H., Walker, V. M., Sugawara, Y., Li, J., Leng, Y., Elsworth, B., Wootton, R. E., Fang, S., et al. (2021) · International Journal of Epidemiology · doi:10.1093/ije/dyab203 · Cited by 124
Are unilateral and bilateral patellar tendinopathy distinguished by differences in anthropometry, body composition, or muscle strength in elite female basketball players?
Gaida, J. E., Cook, J. L., Bass, S. L., Austen, S., & Kiss, Z. S. (2004) · British Journal of Sports Medicine · doi:10.1136/bjsm.2003.006015 · Cited by 124
Safe oxygen saturation targeting and monitoring in preterm infants: can we avoid hypoxia and hyperoxia?
Sola, A., Golombek, S., Bueno, M. T. M., Lemus-Varela, L., Zuluaga, C., Dominguez, F., Baquero, H., Sarmiento, A. E. Y., Natta, D., Pérez, J. M. R., et al. (2014) · Acta paediatrica · doi:10.1111/apa.12692 · Cited by 128
Relationships between North Atlantic salmon, plankton, and hydroclimatic change in the Northeast Atlantic
Beaugrand, G., & Reid, P. C. (2012) · ICES Journal of Marine Science · doi:10.1093/icesjms/fss153 · Cited by 123
Prognostic value of acute hemodynamic response to i.v. propranolol in patients with cirrhosis and portal hypertension
Mura, V. L., Abraldeṣ, J. G., Raffa, S., Retto, O., Berzigotti, A., García‐Pagán, J. C., & Bosch, J. (2009) · Journal of Hepatology · doi:10.1016/j.jhep.2009.04.015 · Cited by 122
Combination of bone graft and resorbable membrane for alveolar ridge preservation: A systematic review, meta‐analysis, and trial sequential analysis
Troiano, G., Zhurakivska, K., Muzio, L. L., Laino, L., Cicciù, M., & Russo, L. L. (2017) · Journal of Periodontology · doi:10.1902/jop.2017.170241 · Cited by 121
The statistical significance of meta-analyses is frequently fragile: definition of a fragility index for meta-analyses
Atal, I., Porcher, R., Boutron, I., & Ravaud, P. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.03.012 · Cited by 121
Dexamethasone 12 mg versus 6 mg for patients with COVID-19 and severe hypoxaemia: a pre-planned, secondary Bayesian analysis of the COVID STEROID 2 trial
Munch, M. W., Myatra, S. N., Vijayaraghavan, B. K. T., Saseedharan, S., Benfield, T., Wahlin, R. R., Rasmussen, B. S., Andreasen, A. S., Poulsen, L. M., Cioccari, L., et al. (2021) · Intensive Care Medicine · doi:10.1007/s00134-021-06573-1 · Cited by 122
Family functioning, burden and parenting stress 2years after very preterm birth
Treyvaud, K., Doyle, L. W., Lee, K. J., Roberts, G., Cheong, J. L. Y., Inder, T. E., & Anderson, P. J. (2011) · Early Human Development · doi:10.1016/j.earlhumdev.2011.03.008 · Cited by 119
A prospective study of pregnancy outcome and biomarkers of oxidative stress in nulliparous obese women
Rajasingam, D., Seed, P. T., Briley, A. L., Shennan, A. H., & Poston, L. (2009) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2008.10.047 · Cited by 118
Ultrasonographic evaluation of liver surface and transient elastography in clinically doubtful cirrhosis
Berzigotti, A., Abraldeṣ, J. G., Tandon, P., Erice, E., Gilabert, R., García‐Pagán, J. C., & Bosch, J. (2010) · Journal of Hepatology · doi:10.1016/j.jhep.2009.12.031 · Cited by 117
Effects of Changes in Number of Medications and Drug Burden Index Exposure on Transitions Between Frailty States and Death: The Concord Health and Ageing in Men Project Cohort Study
Jamsen, K. M., Bell, J. S., Hilmer, S. N., Kirkpatrick, C. M. J., Ilomäki, J., Couteur, D. G. L., Blyth, F., Handelsman, D. J., Waite, L. M., Naganathan, V., et al. (2016) · Journal of the American Geriatrics Society · doi:10.1111/jgs.13877 · Cited by 117

Authors: Sterne, J. A. C.
Affiliations: University of Bristol (GB)
Corresponding author: Sterne, J. A C
ORCID: Sterne, J. A C
Venue: BMJ
Publisher: BMJ
Published: 2001-01-27
Volume: 322
Issue: 7280
Pages: 226-231
ISSN: 0959-8138 (ISSN-L)
DOI: 10.1136/bmj.322.7280.226
PMC: PMC1119478
OpenAlex: W2025651303
Cited by: 1,466
References: 48
Citations by year: 2026: 48 · 2025: 64 · 2024: 75 · 2023: 63 · 2022: 63 · 2021: 82 · 2020: 72 · 2019: 82 · 2018: 75 · 2017: 79 · 2016: 74 · 2015: 48 · 2014: 56 · 2013: 50 · 2012: 53
FWCI: 45.33
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Locations: BMJ (publishedVersion)
Europe PMC (PubMed Central) (publishedVersion)
PubMed Central (publishedVersion)
PubMed (publishedVersion)
HighWire Press Open Archive (submittedVersion)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Keywords: statistical significance, p-values, publication bias, false positives, null hypothesis, evidence evaluation
MeSH terms: Bayes Theorem, Data Interpretation, Statistical, Humans, Research Design, Statistics as Topic, History, 20th Century

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Sifting the evidence---what's wrong with significance tests? Another comment on the role of statistical methods

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks