Cited by 1,466Statistical Methods in EpidemiologyMeta-analysis and systematic reviewsStatistical Methods in Clinical Trials

The DOI matches its Crossref record; 46 of the 48 references it cites were found in a registry or an index.

Sifting the evidence---what's wrong with significance tests? Another comment on the role of statistical methods

Open access

Sterne, J. A C·2001·BMJ

DOI 10.1136/bmj.322.7280.226PMC PMC1119478

Open this paper in CoChat — free account

Abstract

The findings of medical research are often met with considerable scepticism, even when they have apparently come from studies with sound methodologies that have been subjected to appropriate statistical analysis. This is perhaps particularly the case with respect to epidemiological findings that suggest that some aspect of everyday life is bad for people. Indeed, one recent popular history, the medical journalist James Le Fanu's The Rise and Fall of Modern Medicine , went so far as to suggest that the solution to medicine's ills would be the closure of all departments of epidemiology.1 One contributory factor is that the medical literature shows a strong tendency to accentuate the positive; positive outcomes are more likely to be reported than null results.2–4 By this means alone a host of purely chance findings will be published, as by conventional reasoning examining 20 associations will produce one result that is “significant at P=0.05” by chance alone. If only positive findings are published then they may be mistakenly considered to be of importance rather than being the necessary chance results produced by the application of criteria for meaningfulness based on statistical significance. As many studies contain long questionnaires collecting information on hundreds of variables, and measure a wide range of potential outcomes, several false positive findings are virtually guaranteed. The high volume and often contradictory nature5 of medical research findings, however, is not only because of publication bias. A more fundamental problem is the widespread misunderstanding of the nature of statistical significance. #### Summary points P values, or significance levels, measure the strength of the evidence against the null hypothesis; the smaller the P value, the stronger the evidence against the null hypothesis An arbitrary division of results, into “significant” or “non-significant” according to the P value, was not the intention of the …

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1136/bmj.322.7280.226

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Statistical Methods for Research Workers
Fisher, R. A. (1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,883
Association between Water Intake, Chronic Kidney Disease, and Cardiovascular Disease: A Cross-Sectional Analysis of NHANES Data
Sontrop, J. M., Dixon, S. N., Garg, A. X., Jiménez, I. B., Dohein, O., Huang, S. S., & Clark, W. F. (2013) · American Journal of Nephrology · doi:10.1159/000350377 · Cited by 5,903
Statistical Inference
Casella, G., & Berger, R. L. (1993) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,835
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
IX. On the problem of the most efficient tests of statistical hypotheses
Neyman, J., & Pearson, E. S. (1933) · Philosophical Transactions of the Royal Society of London Series A Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1933.0009 · Cited by 2,370
Confidence intervals rather than P values: estimation rather than hypothesis testing.
Gardner, M. J., & Altman, D. G. (1986) · BMJ · doi:10.1136/bmj.292.6522.746 · Cited by 2,014
Statistics with Confidence
Smithson, M. J. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218525 · Cited by 1,871
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
The Importance of Beta, the Type II Error and Sample Size in the Design and Interpretation of the Randomized Control Trial: Survey of 71 Negative Trials
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
ON THE PROBLEM OF THE MOST EFFICIENT TESTS OF STATISTICAL HYPOTHESES
Neyman, J., & Pearson, E. S. (1967) · University of California Press eBooks · doi:10.1525/9780520339897-008 · Cited by 1,545

Show all 48 references

Research works printed but not linked: 5

[38]Davey Smith G. Reflections on the limits to epidemiology. J Clin Epidemiol (in press).
BMJ. 2001 Jan 27;322(7280):226–231.
1-1.Fisher RA. Statistical methods for research workers. 1st ed. Edinburgh: Oliver and Boyd; 1925. . Reprinted by Oxford University Press. [Google Scholar]
1-2.Fisher RA. Design of experiments. 1st ed. Edinburgh: Oliver and Boyd; 1935. . Reprinted by Oxford University Press. [Google Scholar]
1-4.Cox DR. Statistical significance tests. Br J Clin Pharmacol. 1982;14:325–331. doi: 10.1111/j.1365-2125.1982.tb01987.x. [DOI] [PMC free article] [PubMed] [Google Scholar] · DOI

Sorted by citations

Items 501–600 of 1,000

Heavy prenatal alcohol exposure and increased risk of stillbirth
O’Leary, C., Jacoby, P. A., D’Antoine, H., Bartu, A. E., & Bower, C. I. (2012) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2012.03333.x · Cited by 33
Periodontitis case definition affects the association with renal function in kidney transplant recipients
Ioannidou, E., Shaqman, M., Burleson, J., & Dongari‐Bagtzoglou, A. I. (2010) · Oral Diseases · doi:10.1111/j.1601-0825.2010.01665.x · Cited by 37
Replicability and generalizability in population psychiatric neuroimaging
Marek, S. A., & Laumann, T. O. (2024) · Neuropsychopharmacology · doi:10.1038/s41386-024-01960-w · Cited by 34
Acute Antioxidant Supplementation Improves Endurance Performance in Trained Athletes
Bentley, D. J., Dank, S., Coupland, R., Midgley, A. W., & Spence, I. (2012) · Research in Sports Medicine · doi:10.1080/15438627.2011.608050 · Cited by 32
Tutorials in clinical research: VII. Understanding comparative statistics (contrast)—part B: Application of T‐test, Mann‐Whitney U, and Chi‐Square
Neely, J. G., Hartman, J. M., Forsen, J. W., & Wallace, M. S. (2003) · The Laryngoscope · doi:10.1097/00005537-200310000-00011 · Cited by 32
The fragility of statistically significant findings from randomized trials in head and neck surgery
Noel, C. W., McMullen, C. P., Yao, C. M. K. L., Monteiro, E., Goldstein, D. P., Eskander, A. E., & de Almeida, J. R. (2018) · The Laryngoscope · doi:10.1002/lary.27183 · Cited by 32
Outcome of melanoma patients with elevated LDH treated with first-line targeted therapy or PD-1-based immune checkpoint inhibition
Knispel, S., Gassenmaier, M., Menzies, A. M., Loquai, C., Johnson, D. B., Franklin, C., Gutzmer, R., Hassel, J. C., Weishaupt, C., Eigentler, T., et al. (2021) · European Journal of Cancer · doi:10.1016/j.ejca.2021.01.034 · Cited by 32
Effects of State Coalitions to Reduce Underage DrinkingA National Evaluation
Wagenaar, A. C., Erickson, D. J., Harwood, E. M., & O’Malley, P. M. (2006) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2006.06.001 · Cited by 32
The Fragility Index in peri‐operative randomised trials that reported significant mortality effects in adults
Bertaggia, L., Redaelli, M. B., Lembo, R., Sartini, C., Cuffaro, R., Corrao, F., Zangrillo, A., Landoni, G., & Bellomo, R. (2019) · Anaesthesia · doi:10.1111/anae.14656 · Cited by 32
Psychosocial factors associated with the mental health of indigenous children living in high income countries: a systematic review
Young, C., Hanson, C., Craig, J. C., Clapham, K., & Williamson, A. (2017) · International Journal for Equity in Health · doi:10.1186/s12939-017-0652-5 · Cited by 30
Credibility of the evidence on green space and human health: an overview of meta-analyses using evidence grading approaches
Xie, Y., Fan, S., Luo, Y., Li, J., Zhang, Y., Hu, L., Qiu, H., Zhou, G., Heinrich, J., Zhao, T., et al. (2024) · EBioMedicine · doi:10.1016/j.ebiom.2024.105261 · Cited by 41
Lack of association between DRD2 and OPRM1 genotypes and adiposity
Hardman, C. A., Rogers, P. J., Timpson, N. J., & Munafo, M. R. (2013) · International Journal of Obesity · doi:10.1038/ijo.2013.144 · Cited by 31
Do aspects of social, emotional and behavioural development in the pre-school period predict later cognitive and academic attainment?
Hammer, D., Melhuish, E. C., & Howard, S. J. (2017) · Australian Journal of Education · doi:10.1177/0004944117729514 · Cited by 33
P in the right place: Revisiting the evidential value of P‐values
Lytsy, P. (2018) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12319 · Cited by 33
Beyond Calculations: A Course in Statistical Thinking
Steel, E. A., Liermann, M. C., & Guttorp, P. M. (2019) · The American Statistician · doi:10.1080/00031305.2018.1505657 · Cited by 37
What is the effect of active ingredients in dentifrice on inhibiting the regrowth of overnight plaque? A systematic review
Valkenburg, C., Slot, D. E., & van der Weijden, G. A. (2019) · International Journal of Dental Hygiene · doi:10.1111/idh.12423 · Cited by 32
What might judgment and decision making research be like if we took a Bayesian approach to hypothesis testing?
Matthews, W. J. (2011) · Judgment and Decision Making · doi:10.1017/s1930297500004265 · Cited by 31
Estimating sample size in critical care clinical trials
Scales, D. C., & Rubenfeld, G. D. (2005) · Journal of Critical Care · doi:10.1016/j.jcrc.2005.02.002 · Cited by 31
Preclinical Testing of Femoral Hip Components: An Experimental Investigation With Four Prostheses
Britton, J. R., & Prendergast, P. J. (2005) · Journal of Biomechanical Engineering · doi:10.1115/1.1992531 · Cited by 31
Environmental risk factors, protective factors, and biomarkers for postpartum depressive symptoms: an umbrella review
Kim, J. H., Kim, J. Y., Lee, S., Lee, S., Stubbs, B., Koyanagi, A., Dragioti, E., Jacob, L., Carvalho, A. F., Raduà, J., et al. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104761 · Cited by 36
Rejoinder
Greenland, S., & Poole, C. (2012) · Epidemiology · doi:10.1097/ede.0b013e3182785a49 · Cited by 33
Iron Status and Cancer Risk in UK Biobank: A Two-Sample Mendelian Randomization Study
Yuan, S., Carter, P., Vithayathil, M. K., Kar, S., Giovannucci, E. L., Mason, A. M., Burgess, S., & Larsson, S. C. (2020) · Nutrients · doi:10.3390/nu12020526 · Cited by 32
Investigating the causal nature of the relationship of subcortical brain volume with smoking and alcohol use
Logtenberg, E., Overbeek, M. F., Pasman, J. A., Abdellaoui, A., Luijten, M., van Holst, R. J., Vink, J. M., Denys, D. A. J. P., Medland, S. E., Verweij, K. J. H., et al. (2021) · The British Journal of Psychiatry · doi:10.1192/bjp.2021.81 · Cited by 29
The role of state and trait anxiety in the processing of facial expressions of emotion
Dyer, M. L., Attwood, A. S., Penton‐Voak, I. S., & Munafo, M. R. (2022) · Royal Society Open Science · doi:10.1098/rsos.210056 · Cited by 30
Assessing and visualizing fragility of clinical results with binary outcomes in R using the fragility package
Lin, L., & Chu, H. (2022) · PLoS ONE · doi:10.1371/journal.pone.0268754 · Cited by 31
Causal effects of maternal circulating amino acids on offspring birthweight: a Mendelian randomisation study
Zhao, J., Stewart, I. D., Baird, D. A., Mason, D., Wright, J., Zheng, J., Gaunt, T. R., Evans, D. M., Freathy, R. M., Langenberg, C., et al. (2023) · EBioMedicine · doi:10.1016/j.ebiom.2023.104441 · Cited by 27
Health services research in critical care using administrative data
Wunsch, H., Harrison, D. A., & Rowan, K. (2005) · Journal of Critical Care · doi:10.1016/j.jcrc.2005.08.002 · Cited by 31
Systematic review and network meta-analysis of interventions for fibromyalgia: a protocol
Busse, J. W., Ebrahim, S., Connell, G. P., Coomes, E. A., Bruno, P. A., Malik, K., Torrance, D., Ngo, T., Kirmayr, K., Avrahami, D., et al. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-18 · Cited by 30
Interpreting statistics with confidence
Bland, J. M., & Peacock, J. L. (2002) · The Obstetrician & Gynaecologist · doi:10.1576/toag.2002.4.3.176 · Cited by 30
The association of oestrogen receptor α-haplotypes with cardiovascular risk factors in the British Women's Heart and Health Study
Lawlor, D. A., Timpson, N. J., Ebrahim, S. B. J., Day, I. N. M., & Smith, G. D. (2006) · European Heart Journal · doi:10.1093/eurheartj/ehi833 · Cited by 30
A combined pre-clinical meta-analysis and randomized confirmatory trial approach to improve data validity for therapeutic target validation
Kleikers, P. W. M., Hooijmans, C. R., Göb, E., Langhauser, F., Rewell, S. S. J., Radermacher, K. A., Ritskes-Hoitinga, M. J., Howells, D. W., Kleinschnitz, C., & Schmidt, H. H. H. W. (2015) · Scientific Reports · doi:10.1038/srep13428 · Cited by 29
Clinical significance in nursing research: A discussion and descriptive analysis
Polit, D. F. (2017) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.05.002 · Cited by 33
The determinants of handwashing behaviour among internally displaced women in two camps in the Kurdistan Region of Iraq
Zangana, A., Shabila, N. P., Heath, T., & White, S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0231694 · Cited by 27
Appraising the role of circulating concentrations of micro-nutrients in epithelial ovarian cancer risk: A Mendelian randomization analysis
Guo, Y. P., Lu, Y., & Jin, H. (2020) · Scientific Reports · doi:10.1038/s41598-020-63909-5 · Cited by 29
Antidepressant Treatment in Patients Following Acute Coronary Syndromes: A Systematic Review and Bayesian Meta-Analysis
Sweda, R., Siontis, G. C. M., Nikolakopoulou, A., Windecker, S., & Pilgrim, T. (2020) · ESC Heart Failure · doi:10.1002/ehf2.12861 · Cited by 29
The Fragility of Statistical Findings in Achilles Tendon Injury Research: A Systematic Review
Parisien, R. L., Danford, N. C., Jarin, I. J., Li, X., Trofa, D. P., & Vosseller, J. T. (2021) · JAAOS Global Research and Reviews · doi:10.5435/jaaosglobal-d-21-00018 · Cited by 29
Environmental risk factors for amyotrophic lateral sclerosis: methodological issues in epidemiologic studies.
Vinceti, M., Fiore, M., Signorelli, C., Odone, A., Tesauro, M., Consonni, M., Arcolin, E., Malagoli, C., Mandrioli, J., Marmiroli, S., et al. (2012) · PubMed · Cited by 29
An encouraging assessment of methods to inform priorities for updating systematic reviews
Sutton, A. J., Donegan, S., Takwoingi, Y., Garner, P., Gamble, C. L., & Donald, A. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.04.005 · Cited by 31
Mx1, OAS1 and OAS2 polymorphisms are associated with the severity of liver disease in HIV/HCV-coinfected patients: A cross-sectional study
García–Álvarez, M., Berenguer, J., Jiménez‐Sousa, M. Á., Tenor, D. P., Aldámiz‐Echevarría, T., Tejerina, F., Díez, C., Vázquez‐Morón, S., & Resino, S. (2017) · Scientific Reports · doi:10.1038/srep41516 · Cited by 31
Impact of an asbestos cement factory on mesothelioma incidence in a community in Italy
Consonni, D., Matteis, S. D., Dallari, B., Pesatori, A. C., Riboldi, L., & Mensi, C. (2019) · Environmental Research · doi:10.1016/j.envres.2019.108968 · Cited by 29
The Ethics of Alpha: Reflections on Statistics, Evidence and Values in Medicine
Upshur, R. E. G. (2001) · Metamedicine · doi:10.1023/a:1014462116530 · Cited by 29
P-value: What is and what is not
Tanha, K., Mohammadi, N., & Janani, L. (2017) · Medical Journal of the Islamic Republic of Iran · doi:10.14196/mjiri.31.65 · Cited by 28
Quality of Life Perception, Cognitive Function, and Psychological Status in a Real-world Population of Glioblastoma Patients Treated With Radiotherapy and Temozolomide
Lombardi, G., Bergo, E., Bianco, P. D., Bellu, L., Pambuku, A., Caccese, M., Trentin, L., & Zagonel, V. (2018) · American Journal of Clinical Oncology · doi:10.1097/coc.0000000000000459 · Cited by 29
The performance of a free surface and metal-removing constructed wetland: How a young wetland becomes mature
Xu, X., Mills, G. L., Lindell, A. H., Peck, E., Korotasz, A. M., & Burgess, E. (2019) · Ecological Engineering · doi:10.1016/j.ecoleng.2019.04.020 · Cited by 28
Closer to the Truth on National Fistula Prevalence After Unilateral Complete Cleft Lip and Palate Repair? The Cleft Care UK Study
Yang, A. S., Richard, B. M., Wills, A. K., Mahmoud, O., Sandy, J. R., & Ness, A. (2019) · The Cleft Palate-Craniofacial Journal · doi:10.1177/1055665619858871 · Cited by 28
Are perioperative interventions effective in preventing chronic pain after primary total knee replacement? A systematic review
Beswick, A. D., Dennis, J. A., Gooberman‐Hill, R., Blom, A. W., & Wylde, V. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-028093 · Cited by 28
Early parenting is associated with the developing brains of children born very preterm
Treyvaud, K., Thompson, D. K., Kelly, C. E., Loh, W. Y., Inder, T. E., Cheong, J. L. Y., Doyle, L. W., & Anderson, P. J. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1811895 · Cited by 30
Physiological Demands of Competitive Sprint and Distance Performance in Elite Female Cross-Country Skiing
Carlsson, M., Carlsson, T., Wedholm, L., Nilsson, M., Malm, C., & Tonkonogi, M. (2016) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000001327 · Cited by 28
Reviewing for Clinical Orthopaedics and Related Research
Brand, R. A. (2012) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-012-2447-8 · Cited by 28
Mortgage-related issues in a crisis economy: Evidence from rural households in Ireland
Murphy, E., & Scott, M. J. (2013) · Geoforum · doi:10.1016/j.geoforum.2012.12.003 · Cited by 28
Variation in the gene coding for the M5 Muscarinic receptor (CHRM5) influences cigarette dose but is not associated with dependence to drugs of addiction: evidence from a prospective population based cohort study of young adults
Anney, R., Lotfi-Miri, M., Olsson, C. A., Reid, S., Hemphill, S. A., & Patton, G. C. (2007) · BMC Genetics · doi:10.1186/1471-2156-8-46 · Cited by 28
‘After the crash’: Life satisfaction, everyday financial practices and rural households in post Celtic Tiger Ireland
Murphy, E., & Scott, M. J. (2014) · Journal of Rural Studies · doi:10.1016/j.jrurstud.2013.12.005 · Cited by 28
Ultradian rhythmicity and induced changes in salivary testosterone
Beaven, C. M., Ingram, J. R., Gill, N. D., & Hopkins, W. G. (2010) · European Journal of Applied Physiology · doi:10.1007/s00421-010-1518-3 · Cited by 29
Do Cortical Neurons Process Luminance or Contrast to Encode Surface Properties?
Vladusich, T., Lucassen, M. P., & Cornelissen, F. W. (2005) · Journal of Neurophysiology · doi:10.1152/jn.01016.2005 · Cited by 28
Diverse convergent evidence in the genetic analysis of complex disease: coordinating omic, informatic, and experimental evidence to better identify and validate risk factors
Ciesielski, T. H., Pendergrass, S. A., White, M. J., Kodaman, N., Sobota, R. S., Huang, M., Bartlett, J., Li, J., Pan, Q., Gui, J., et al. (2014) · BioData Mining · doi:10.1186/1756-0381-7-10 · Cited by 27
Associations between Parental and Friend Social Support and Children’s Physical Activity and Time Spent outside Playing
Loucaides, C. A., & Tsangaridou, N. (2017) · International Journal of Pediatrics · doi:10.1155/2017/7582398 · Cited by 28
Risk for Suicide Among Treatment Seeking Adolescents: The Role of Positive and Negative Affect Intensity
Rojas, S. M., Leen‐Feldner, E. W., Blumenthal, H., Lewis, S. F., & Feldner, M. T. (2014) · Cognitive Therapy and Research · doi:10.1007/s10608-014-9650-8 · Cited by 30
Genomics models in radiotherapy: From mechanistic to machine learning
Kang, J., Coates, J. T. T., Strawderman, R. L., Rosenstein, B. S., & Kerns, S. L. (2020) · Medical Physics · doi:10.1002/mp.13751 · Cited by 28
A comparison of self-bias measures across cognitive domains
Amodeo, L., Wiersema, J. R., Braß, M., & Nijhof, A. D. (2021) · BMC Psychology · doi:10.1186/s40359-021-00639-x · Cited by 27
Using Mendelian randomization to explore the gateway hypothesis: possible causal effects of smoking initiation and alcohol consumption on substance use outcomes
Reed, Z. E., Wootton, R. E., & Munafo, M. R. (2021) · Addiction · doi:10.1111/add.15673 · Cited by 30
The fragility of statistical significance in distal femur fractures: systematic review of randomized controlled trials
Megafu, M. N., Mian, H. S., Megafu, E. C., Singhal, S. S., Lee, A., Cassie, R., Tornetta, P., & Parisien, R. L. (2022) · European Journal of Orthopaedic Surgery & Traumatology · doi:10.1007/s00590-022-03452-3 · Cited by 27
Ionizing radiations epidemiology does not support the LNT model
Ricci, P. F., & Tharmalingam, S. (2019) · Chemico-Biological Interactions · doi:10.1016/j.cbi.2018.11.014 · Cited by 27
Understanding Clinical Significance in Rehabilitation
Armijo-Olivo, S. L., de Castro‐Carletti, E. M., Calixtre, L. B., de Oliveira‐Souza, A. I. S., Mohamad, N., & Fuentes, J. (2021) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000001799 · Cited by 26
Influences of polymorphic variants of DRD2 and SLC6A3 genes, and their combinations on smoking in Polish population
Siemińska, A., Buczkowski, K., Jassem, E., Niedoszytko, M., & Tkacz, E. (2009) · BMC Medical Genetics · doi:10.1186/1471-2350-10-92 · Cited by 26
Organizational change and the risk of sickness absence: a longitudinal multilevel analysis of organizational unit-level change in hospitals
Grønstad, A., Kjekshus, L. E., Tjerbo, T., & Bernstrøm, V. H. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4745-2 · Cited by 28
Educational inequalities in mortality amenable to healthcare. A comparison of European healthcare systems
Rydland, H. T., Fjær, E. L., Eikemo, T. A., Huijts, T., Bambra, C. L., Wendt, C., Kulhánová, I., Martikainen, P., Dibben, C. J. L., Kalèdiené, R., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0234135 · Cited by 27
Prenatal smoking, alcohol and caffeine exposure and maternal‐reported attention deficit hyperactivity disorder symptoms in childhood: triangulation of evidence using negative control and polygenic risk score analyses
Haan, E., Sallis, H., Zuccolo, L., Labrecque, J. A., Ystrøm, E., Reichborn‐Kjennerud, T., Andreassen, O. A., Havdahl, A., & Munafo, M. R. (2021) · Addiction · doi:10.1111/add.15746 · Cited by 26
Sinus Thrombosis Should Be Treated With Anticoagulation
Stam, J. (2008) · Archives of Neurology · doi:10.1001/archneur.65.7.984 · Cited by 26
Time-to-Detection in Culture Predicts Risk of Mycobacterium tuberculosis Transmission: A Cohort Study
O’Shea, M. K., Koh, G. C. K. W., Munang, M. L., Smith, G. E., Banerjee, A., & Dedicoat, M. J. (2014) · Clinical Infectious Diseases · doi:10.1093/cid/ciu244 · Cited by 26
A systematic review and network meta-analysis of neoadjuvant therapy combined with surgery for patients with resectable esophageal squamous cell carcinoma
Huang, Y., Wang, H., Luo, G., Zhang, Y., Wang, L. J., & Li, K. (2016) · International Journal of Surgery · doi:10.1016/j.ijsu.2016.12.035 · Cited by 26
The mediating effect of work-life interference on the relationship between work-time control and depressive and musculoskeletal symptoms
Albrecht, S., Kecklund, G., & Leineweber, C. (2020) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.3887 · Cited by 26
Efficacy and safety of hepatitis B vaccine: an umbrella review of meta-analyses
Qiu, J., Zhang, S., Feng, Y., Su, X., Cai, J., Chen, S., Liu, J., Huang, S., Huang, H., Zhu, S., et al. (2023) · Expert Review of Vaccines · doi:10.1080/14760584.2023.2289566 · Cited by 28
Genetic and Lifestyle Risks for Coronary Artery Disease and Long-Term Risk of Incident Dementia Subtypes
Sittichokkananon, A., Garfield, V., & Chiesa, S. T. (2025) · Circulation · doi:10.1161/circulationaha.124.070632 · Cited by 27
Clinical severity of human infections with avian influenza A(H7N9) virus, China, 2013/14
Feng, S., Wu, J. T. K., Liu, X., Yang, P., Tsang, T. K., Jiang, H. B., Wu, P., Yang, J., Fang, V. J., Qin, Y., et al. (2014) · Eurosurveillance · doi:10.2807/1560-7917.es2014.19.49.20984 · Cited by 25
An increase in minimum metabolic rate and not activity explains field metabolic rate changes in a breeding seabird
Green, J. A., Aitken-Simpson, E. J., White, C. R., Bunce, A., Butler, P. J., & Frappell, P. B. (2013) · Journal of Experimental Biology · doi:10.1242/jeb.085092 · Cited by 25
Method parameters’ impact on mortality and variability in mouse stroke experiments: a meta-analysis
Ingberg, E., Dock, H., Theodorsson, E., Theodorsson, A., & Ström, J. (2016) · Scientific Reports · doi:10.1038/srep21086 · Cited by 20
Deficiencies of effectiveness of intervention studies in veterinary medicine: a cross-sectional survey of ten leading veterinary and medical journals
Girolamo, N. D., & Reynders, R. M. (2016) · Draw Science · doi:10.7717/peerj.1649 · Cited by 26
Evoked and event-related potentials in disorders of consciousness: A quantitative review
Kotchoubey, B. (2017) · Consciousness and Cognition · doi:10.1016/j.concog.2017.05.002 · Cited by 25
The Effect of Pre-Analytical Conditions on Blood Metabolomics in Epidemiological Studies
Ferreira, D. L. S., Maple, H. J., Goodwin, M., Brand, J. S., Yip, V., Min, J. L., Groom, A., Lawlor, D. A., & Ring, S. M. (2019) · Metabolites · doi:10.3390/metabo9040064 · Cited by 25
GLU: a software package for analysing continuously measured glucose levels in epidemiology
Millard, L. A. C., Patel, N., Tilling, K. M., Lewcock, M., Flach, P. A., & Lawlor, D. A. (2020) · International Journal of Epidemiology · doi:10.1093/ije/dyaa004 · Cited by 26
Cancer incidence in Italian contaminated sites.
Comba, P., Ricci, P., Iavarone, I., Pirastu, R., Buzzoni, C., Fusco, M., Ferretti, S., Fazzo, L., Pasetto, R., Zona, A., et al. (2014) · Annali dell Istituto Superiore di Sanità · doi:10.4415/ann_14_02_13 · Cited by 25
Genetic polymorphisms in periodontal diseases: An overview
Rajaram, V., Geetha, A., Ramakrishnan, T., & Emmadi, P. (2010) · Indian Journal of Dental Research · doi:10.4103/0970-9290.74226 · Cited by 25
Does breast cancer screening level health inequalities out? A population-based study in an Italian region
Pacelli, B., Carretta, E., Spadea, T., Caranci, N., Felice, E. D., Stivanello, E., Cavuto, S., Cisbani, L., Candela, S., Palma, R. D., et al. (2013) · European Journal of Public Health · doi:10.1093/eurpub/ckt119 · Cited by 25
BMI Change, Fitness Change and Cardiometabolic Risk Factors Among 8th Grade Youth
Jago, R., Drews, K. L., McMurray, R., Baranowski, T., Galassetti, P., Foster, G., Moe, E. L., & Buse, J. (2013) · Pediatric Exercise Science · doi:10.1123/pes.25.1.52 · Cited by 23
A Sport Fitness Index for Assessment of Sport-Related Injury Risk
Wilkerson, G., Colston, M. A., & Baker, C. (2016) · Clinical Journal of Sports Medicine · doi:10.1097/jsm.0000000000000280 · Cited by 21
Profiling Isokinetic Strength by Leg Preference and Position in Rugby Union Athletes
Brown, S. R., Brughelli, M., & Bridgeman, L. A. (2015) · International Journal of Sports Physiology and Performance · doi:10.1123/ijspp.2015-0241 · Cited by 25
Educational Attainment and Gestational Weight Gain among U.S. Mothers
Cohen, A. K., Kazi, C., Headen, I. E., Rehkopf, D. H., Hendrick, C. E., Patil, D., & Abrams, B. F. (2016) · Women s Health Issues · doi:10.1016/j.whi.2016.05.009 · Cited by 25
A Method for Effectively Comparing Gene Effects in Multiple Conditions in RNAi and Expression-Profiling Research
Zhang, X. D. (2009) · Pharmacogenomics · doi:10.2217/14622416.10.3.345 · Cited by 25
Caveats in the interpretation of the surgical literature
Guller, U. (2008) · British journal of surgery · doi:10.1002/bjs.6156 · Cited by 25
Edge integration and the perception of brightness and darkness
Vladusich, T., Lucassen, M. P., & Cornelissen, F. W. (2006) · Journal of Vision · doi:10.1167/6.10.12 · Cited by 24
Prognostic role of miR-17-92 family in human cancers: evaluation of multiple prognostic outcomes
Liu, F., Zhang, F., Li, X., Liu, Q., Liu, W., Song, P. K., Qiu, Z., Dong, Y. H., & Xiang, H. (2017) · Oncotarget · doi:10.18632/oncotarget.19096 · Cited by 24
A Growing Consensus for Change in Interpretation of Clinical Research Evidence
Wilkerson, G. B., & Denegar, C. R. (2018) · Journal of Athletic Training · doi:10.4085/1062-6050-8-17 · Cited by 24
Comparative safety and effectiveness of dabigatran vs. rivaroxaban and apixaban in patients with non-valvular atrial fibrillation: a retrospective study from a large healthcare system
Villines, T. C., Ahmad, A., Petrini, M., Tang, W., Evans, A., Rush, T. M., Thompson, D., Oh, K., & Schwartzman, E. (2018) · European Heart Journal - Cardiovascular Pharmacotherapy · doi:10.1093/ehjcvp/pvy044 · Cited by 24
Power of mental health nursing research: A statistical analysis of studies in the International Journal of Mental Health Nursing
Gaskin, C. J., & Happell, B. (2012) · International Journal of Mental Health Nursing · doi:10.1111/j.1447-0349.2012.00845.x · Cited by 24
Frequentist versus Bayesian Clinical Trials
Teira, D. (2011) · Elsevier eBooks · doi:10.1016/b978-0-444-51787-6.50010-6 · Cited by 24
Effectiveness of Interventions for Prevention of Road Traffic Injuries in Iran and Some Methodological Issues: A Systematic Review
Aghdash, S. A., Sadeghi-Bazarghani, H., Heydari, M., Rezapour, R., & Derakhshani, N. (2018) · Bulletin of Emergency and Trauma · doi:10.29252/beat-060202 · Cited by 23
Characterizing reactive hyperemia via tissue reflectance spectroscopy in response to an ischemic load across gender, age, skin pigmentation and diabetes
Sprigle, S. H., Linden, M. A., & Riordan, B. (2002) · Medical Engineering & Physics · doi:10.1016/s1350-4533(02)00149-2 · Cited by 24
The association of smoking with different eating and dietary behaviours: A cross‐sectional analysis of 80 296 United Kingdom adults
Alruwaili, A., King, J. A., Deighton, K., Kelly, B. M., Liao, Z., Innes, A., Henson, J., Yates, T., Johnson, W., Thivel, D., et al. (2024) · Addiction · doi:10.1111/add.16584 · Cited by 24
Environmental Risk Factors, Protective Factors, and Biomarkers for Allergic Rhinitis: A Systematic Umbrella Review of the Evidence
Xu, X., Liu, X., Li, J., Deng, X., Dai, T., Ji, Q., Xiong, D., & Xie, H. (2023) · Clinical Reviews in Allergy & Immunology · doi:10.1007/s12016-023-08964-2 · Cited by 29
Investigating heterogeneity of effects and associations using interaction terms
Kontopantelis, E., Sperrin, M., Mamas, M. A., & Buchan, I. E. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.09.012 · Cited by 23

Authors: Sterne, J. A. C.
Affiliations: University of Bristol (GB)
Corresponding author: Sterne, J. A C
ORCID: Sterne, J. A C
Venue: BMJ
Publisher: BMJ
Published: 2001-01-27
Volume: 322
Issue: 7280
Pages: 226-231
ISSN: 0959-8138 (ISSN-L)
DOI: 10.1136/bmj.322.7280.226
PMC: PMC1119478
OpenAlex: W2025651303
Cited by: 1,466
References: 48
Citations by year: 2026: 48 · 2025: 64 · 2024: 75 · 2023: 63 · 2022: 63 · 2021: 82 · 2020: 72 · 2019: 82 · 2018: 75 · 2017: 79 · 2016: 74 · 2015: 48 · 2014: 56 · 2013: 50 · 2012: 53
FWCI: 45.33
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Locations: BMJ (publishedVersion)
Europe PMC (PubMed Central) (publishedVersion)
PubMed Central (publishedVersion)
PubMed (publishedVersion)
HighWire Press Open Archive (submittedVersion)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Keywords: statistical significance, p-values, publication bias, false positives, null hypothesis, evidence evaluation
MeSH terms: Bayes Theorem, Data Interpretation, Statistical, Humans, Research Design, Statistics as Topic, History, 20th Century

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Sifting the evidence---what's wrong with significance tests? Another comment on the role of statistical methods

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks