When are observational studies as credible as randomised trials?
The DOI matches its Crossref record; 23 of the 24 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In general, strong confounding is unlikely for adverse effects that were unexpected at the time the study was conducted, for example, the link between asbestos and mesothelioma [25].”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [25]
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Statistical Methods in Cancer Research
Breslow, N. E. (1980) · Cited by 7,332
Davey Smith, G., & Ebrahim, S. (2003) · International Journal of Epidemiology · doi:10.1093/ije/dyg070 · Cited by 5,882
Statistical Methods in Cancer Research. Volume II – The Design and Analysis of Cohort Studies
Juul, S. (1989) · Scandinavian Journal of Social Medicine · doi:10.1177/140349488901700214 · Cited by 3,592
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
The design and analysis of cohort studies
Breslow, N. E., & Day, N. E. (1987) · International Agency for Research on Cancer eBooks · Cited by 1,312
Allocation concealment in randomised trials: defending against deciphering
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07750-4 · Cited by 923
Kunz, R., & Oxman, A. D. (1998) · BMJ · doi:10.1136/bmj.317.7167.1185 · Cited by 770
Jick, H., Jick, S. S., Myers, M. W., Vasilakis, C., & Gurewich, V (1995) · The Lancet · doi:10.1016/s0140-6736(95)91928-7 · Cited by 726
(1985) · Cited by 487
Evidence from randomised trials on the long-term effects of hormone replacement therapy
Beral, V., Banks, E., & Reeves, G. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11032-4 · Cited by 487
Theoretical Epidemiology: Principles of Occurrence Research in Medicine
Greenland, S. (1986) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1986.03380070135039 · Cited by 468
Causation, Statistics, and Sociology
Goldthorpe, J. H. (2001) · European Sociological Review · doi:10.1093/esr/17.1.1 · Cited by 309
The need for randomization in the study of intended effects
Miettinen, O. S. (1983) · Statistics in Medicine · doi:10.1002/sim.4780020222 · Cited by 277
Statistical Methods, Experimental Design, and Scientific Inference.
Fisher, R. A. (1991) · Biometrics · doi:10.2307/2532685 · Cited by 253
Smets, Y. F., Westendorp, R. G., van der Pijl, J. W., de Charro, F. T., Ringers, J., de Fijter, J. W., & Lemkes, H. H. (1999) · The Lancet · doi:10.1016/s0140-6736(98)07513-8 · Cited by 252
(2003) · Technometrics · doi:10.1198/tech.2003.s149 · Cited by 242
Darby, S., McGale, P., Peto, R., Granath, F., Hall, P., & Ekbom, A. (2003) · BMJ · doi:10.1136/bmj.326.7383.256 · Cited by 235
Lagaaij, E. L., Hennemann, I. P. H., Ruigrok, M., de Haan, M. W., Persijn, G. G., Termijtelen, A., Hendriks, G. F. J., Weimar, W., Claas, F. H. J., & van Rood, J. J. (1989) · New England Journal of Medicine · doi:10.1056/nejm198909143211101 · Cited by 219
CASE-CONTROL STUDIES IN THE EVALUATION OF DRUG-INDUCED ILLNESS
JICK, H., & VESSEY, M. P. (1978) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112502 · Cited by 123
Mendelian randomisation: a new spin or real progress?
Little, J., & Khoury, M. J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14396-6 · Cited by 70
Why transition from alternation to randomisation in clinical trials was made
Chalmers, I. (1999) · BMJ · doi:10.1136/bmj.319.7221.1372 · Cited by 56
Patterns of use of hormone replacement therapy in one million women in Britain, 1996–2000
(2002) · BJOG: An International Journal of Obstetrics and Gynaecology · doi:10.1016/s1470-0328(02)02914-2 · Cited by 51
Cited by
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
(2004) · Cited by 5,198
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Mendelian randomization: Using genes as instruments for making causal inferences in epidemiology
Lawlor, D. A., Harbord, R. M., Sterne, J. A. C., Timpson, N., & Davey Smith, G. (2008) · Statistics in Medicine · doi:10.1002/sim.3034 · Cited by 4,618
“The most likely explanations are confounding by lifestyle and socioeconomic factors, or by baseline health status and prescription policies, together with reverse causation and selection bias [14–17].”
Wettermark, B., Hammar, N., MichaelFored, C., Leimanis, A., Otterblad Olausson, P., Bergman, U., Persson, I., Sundström, A., Westerholm, B., & Rosén, M. (2007) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1294 · Cited by 1,887
“There are many examples of randomised clinical trials failing to confirm effects or adverse events found in observational studies.(30) Without any randomization, it is difficult to distinguish between effects of drugs and patients disease history.”
Background
Metadata
- Authors
- Vandenbroucke, J. P.
- Affiliations
- Leiden University Medical Center (NL)
- Corresponding author
- Vandenbroucke, Jan P
- ORCID
- Vandenbroucke, Jan P
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 2004-05
- Volume
- 363
- Issue
- 9422
- Pages
- 1728-1731
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2163139471
- Cited by
- 538
- References
- 24
- Citations by year
- 2026: 10 · 2025: 14 · 2024: 13 · 2023: 15 · 2022: 16 · 2021: 22 · 2020: 19 · 2019: 18 · 2018: 28 · 2017: 21 · 2016: 25 · 2015: 22 · 2014: 33 · 2013: 35 · 2012: 32
- FWCI
- 31.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- The Lancet (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- observational studies, randomized controlled trials, confounding, unmeasured confounding, sensitivity analysis, adverse drug reactions, genetic causes of disease, hormone replacement therapy, early life exposure, biomarkers
- MeSH terms
- Humans, Random Allocation, Research Design, Risk, Bias, Confounding Factors, Epidemiologic, Randomized Controlled Trials as Topic, Observation, Drug-Related Side Effects and Adverse Reactions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.