Exposure-wide epidemiology: revisiting Bradford Hill: Bradford Hill criteria revisited
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Fifty years after Bradford Hill published his extremely influential criteria to offer some guides for separating causation from association, we have accumulated millions of papers and extensive data on observational research that depends on epidemiologic methods and principles. This allows us to re-examine the accumulated empirical evidence for the nine criteria, and to re-approach epidemiology through the lens of exposure-wide approaches. The lecture discusses the evolution of these exposure-wide approaches and tries to use the evidence from meta-epidemiologic assessments to reassess each of the nine criteria and whether they work well as guides for causation. I argue that of the nine criteria, experiment remains important and consistency (replication) is also very essential. Temporality also makes sense, but it is often difficult to document. Of the other six criteria, strength mostly does not work and may even have to be inversed: small and even tiny effects are more plausible than large effects; when large effects are seen, they are mostly transient and almost always represent biases and errors. There is little evidence for specificity in causation in nature. Biological gradient is often unclear how it should it modeled and thus difficult to prove. Coherence remains usually unclear how to operationalize. Finally, plausibility as well as analogy do not work well in most fields of investigation, and their invocation has been mostly detrimental, although exceptions may exist.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationThe Environment and Disease: Association or Causation?
Hill, A. B. (1965) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576505800503 · Cited by 6,974
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 3×
“1754 scientific discipline, the most ‘successful’ and appreciated studies (the ones with the largest estimated effect sizes) are simply the ones that suffer the worst net bias [22].”
BackgroundInfluentialSelf-citationContradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Self-citationGenome-wide meta-analyses identify multiple loci associated with smoking behavior
The Tobacco and Genetics Consortium (2010) · Nature Genetics · doi:10.1038/ng.571 · Cited by 1,098
How to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760 · cited 1×
“I think that we need more empirical meta-research studies [39,40] to continue to monitor evidence on these pivotal issues, because things may change in the future.”
BackgroundSelf-citation“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734
Ioannidis, J. P. A. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.081086 · Cited by 716 · cited 1×
“Compilation with systematic reviews andmeta-analysis are one option, but there are also umbrella reviews of multiple reviews [4], network meta-analyses [4], consortia-based work [5], field synopses [6], genome-wide analyses often performed by consortia with multiple meta-analyses of genome-wide analyses [7], and recen…”
MethodSelf-citationMeta-research: Evaluation and Improvement of Research Methods and Practices
Ioannidis, J. P. A., Fanelli, D., Dunne, D. D., & Goodman, S. N. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002264 · Cited by 495 · cited 1×
“I think that we need more empirical meta-research studies [39,40] to continue to monitor evidence on these pivotal issues, because things may change in the future.”
BackgroundSelf-citationThe False-positive to False-negative Ratio in Epidemiologic Studies
Ioannidis, J. P. A., Tarone, R., & McLaughlin, J. K. (2011) · Epidemiology · doi:10.1097/ede.0b013e31821b506e · Cited by 321
Self-citation
Cited by
Environmental Risk Factors for Inflammatory Bowel Diseases: An Umbrella Review of Meta-analyses
Piovani, D., Danese, S., Peyrin-Biroulet, L., Nikolopoulos, G. K., Lytras, T., & Bonovas, S. (2019) · Gastroenterology · doi:10.1053/j.gastro.2019.04.016 · Cited by 784
Lederer, D. J., Bell, S. C., Branson, R. D., Chalmers, J. D., Marshall, R., Maslove, D. M., Ost, D. E., Punjabi, N. M., Schatz, M., Smyth, A. R., et al. (2019) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201808-564ps · Cited by 715
Hearing Loss and Depression in Older Adults: A Systematic Review and Meta-analysis
Lawrence, B. J., Jayakody, D. M. P., Bennett, R. J., Eikelboom, R. H., Gasson, N., & Friedland, P. L. (2020) · The Gerontologist · doi:10.1093/geront/gnz009 · Cited by 426
Li, X., Meng, X., Timofeeva, M., Tzoulaki, I., Tsilidis, K. K., Ioannidis, P. A., Campbell, H., & Theodoratou, E. (2017) · BMJ · doi:10.1136/bmj.j2376 · Cited by 385
Outcome-Wide Longitudinal Designs for Causal Inference: A New Template for Empirical Studies
VanderWeele, T. J., Mathur, M. B., & Chen, Y. (2020) · Statistical Science · doi:10.1214/19-sts728 · Cited by 310
Rezende, L. F. M. D., Sá, T. H. D., Markozannes, G., Rey-López, J. P., Lee, I.-M., Tsilidis, K. K., Ioannidis, J. P. A., & Eluf-Neto, J. (2018) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-098391 · Cited by 276
Self-citationHarris, J., Anderson, M., Clément, C., & Nisbett, N. (2019) · IDS Bulletin · doi:10.19088/1968-2019.112 · Cited by 21
Metadata
- Authors
- Ioannidis, J. P. A.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2015-12-08
- Volume
- 35
- Issue
- 11
- Pages
- 1749-1762
- ISSN
- 0277-6715 (ISSN-L)
- OpenAlex
- W2190572731
- Cited by
- 122
- References
- 12
- FWCI
- 10.80
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.