Real-world studies no substitute for RCTs in establishing efficacy
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
210 www.thelancet.com Vol 393 January 19, 2019 We live in the real world, so it is reasonable to expect that data collected from the real world should help identify effective therapies. Indeed, rapid increases in the availability of registries, electronic health records, and insurance claims, and the ability to access, process, link, and analyse data from these sources at fairly low cost lend support for calls to replace randomised controlled trials (RCTs) with so-called real-world studies to establish the efficacy of a therapy, particularly for common serious diseases with abundant, easily collected data such as diabetes. This push is driven partly by the need to show payers that therapies are working and are therefore of value when used in the real world. Other driving factors include the industry’s wish to reduce costs and time to get results, a mistaken belief that real-world data are somehow more relevant than RCT data for establishing efficacy, and the ease and speed with which registry data can be accessed and publications generated. However, even with the use of sophisticated methods to address various sources of bias, the absence of randomisation precludes protection from confounding and can lead payers and clinicians alike to erroneously infer that a therapy is beneficial or harmful. Observational data from the real world can help to identify associations between drug exposures and outcomes, and they can be used to estimate the strength of such associations. For exa…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“properly conducted trials reduce the risk of bias and increase the likelihood that results about new treatments will be trustworthy, reproducible and generalizable (2,3).”
From The devil is in the details: Reporting and transparent research practices in sports medicine and orthopedic clinical trials (2021) · cites this paper as [3]
Citations
Cites
Sensitivity analysis in observational research: Introducing the E-value
VanderWeele, T. J., & Ding, P. (2017) · Annals of Internal Medicine · doi:10.7326/m16-2607 · Cited by 6,350
Basal insulin and cardiovascular and other outcomes in dysglycemia
The ORIGIN Trial Investigators (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1203858 · Cited by 1,636
Cefalu, W. T., Kaul, S., Gerstein, H. C., Holman, R. R., Zinman, B., Skyler, J. S., Green, J. B., Buse, J. B., Inzucchi, S. E., Leiter, L. A., et al. (2018) · Diabetes Care · doi:10.2337/dci17-0057 · Cited by 363
Self-citationWhen and how can real world data analyses substitute for randomized controlled trials?
Franklin, J. M., & Schneeweiss, S. (2017) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.857 · Cited by 316
SGLT-2 Inhibitors and Cardiovascular Risk
Cavender, M. A., Norhammar, A., Birkeland, K. I., Jørgensen, M. E., Wilding, J. P., Khunti, K., Fu, A. Z., Bodegård, J., Blak, B. T., Wittbrodt, E., et al. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.01.085 · Cited by 136
Bowman, L., Mafham, M., Stevens, W., Haynes, R., Aung, T., Chen, F., Buck, G., Collins, R., & Armitage, J. (2018) · American Heart Journal · doi:10.1016/j.ahj.2017.12.006 · Cited by 106
Longato, E., Di Camillo, B., Sparacino, G., Gubian, L., Avogaro, A., & Fadini, G. P. (2020) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2020-001451 · Cited by 83
Nyström, T., Bodegård, J., Nathanson, D., Thuresson, M., Norhammar, A., & Eriksson, J. W. (2016) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2016.12.004 · Cited by 52
Rush, C. J., Campbell, R. T., Jhund, P. S., Petrie, M. C., & McMurray, J. J. V. (2018) · European Heart Journal · doi:10.1093/eurheartj/ehy407 · Cited by 48
Self-citationImproving observational studies in the era of big data
Gill, J., & Prasad, V. K. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31619-2 · Cited by 33
Research works printed but not linked: 1
- Shaywitz, 2018, Will real world performance replace RCTs as healthcare's most important standard?, Forbes
Cited by
Avoidable flaws in observational analyses: an application to statins and cancer
Dickerman, B. A., García-Albéniz, X., Logan, R. W., Denaxas, S., & Hernán, M. A. (2019) · Nature Medicine · doi:10.1038/s41591-019-0597-x · Cited by 308
Designing and undertaking randomised implementation trials: guide for researchers
Wolfenden, L., Foy, R., Presseau, J., Grimshaw, J. M., Ivers, N. M., Powell, B. J., Taljaard, M., Wiggers, J., Sutherland, R., Nathan, N., et al. (2021) · BMJ · doi:10.1136/bmj.m3721 · Cited by 270
Enhancing global access to cancer medicines
Cortes, J., Perez‐García, J. M., Llombart‐Cussac, A., Curigliano, G., El Saghir, N. S., Cardoso, F., Barrios, C. H., Wagle, S., Roman, J., Harbeck, N., et al. (2020) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21597 · Cited by 203
Should dietary guidelines recommend low red meat intake?
Leroy, F., & Cofnas, N. (2019) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2019.1657063 · Cited by 149
Sharma, A., Pagidipati, N. J., Califf, R. M., McGuire, D. K., Green, J. B., Demets, D., George, J. T., Gerstein, H. C., Hobbs, T., Holman, R. R., et al. (2020) · Circulation · doi:10.1161/circulationaha.119.041022 · Cited by 110
Self-citation
Metadata
- Authors
- Gerstein, H. C., McMurray, J., & Holman, R. R.
- Affiliations
- Population Health Research Institute (CA)
- University of Glasgow (GB)
- University of Oxford (GB)
- Corresponding author
- Gerstein, Hertzel C
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 2019-01
- Volume
- 393
- Issue
- 10168
- Pages
- 210-211
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2909633566
- Cited by
- 97
- References
- 15
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 7 · 2023: 11 · 2022: 8 · 2021: 14 · 2020: 27 · 2019: 21
- FWCI
- 13.65
- Type
- journal article
- Language
- en
- Open access
- green
- eprints.gla.ac.uk
- Licence
- cc-by-sa
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Locations
- The Lancet (publishedVersion)
- PubMed (publishedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (submittedVersion, cc-by-sa)
- Funders
- AstraZeneca
- Boehringer Ingelheim
- Bayer
- Janssen Pharmaceuticals
- GlaxoSmithKline
- Merck Sharp and Dohme
- Johnson and Johnson
- Novo Nordisk
- Pfizer
- Novartis
- Bristol-Myers Squibb
- Eli Lilly and Company
- Abbott Laboratories
- Amgen
- Merck
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Toxicology › Pharmacovigilance and Adverse Drug Reactions
- Keywords
- real-world evidence, randomized controlled trials, efficacy evidence, observational studies, real-world data, electronic health records, registry, health insurance claims, SGLT2 inhibitors, cardiovascular risk, causal inference, health policy decision-making, health technology assessment
- MeSH terms
- Humans, Research Design, Randomized Controlled Trials as Topic, Drug Approval, Pragmatic Clinical Trials as Topic, Observational Studies as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Real-world studies no substitute for RCTs in establishing efficacy. https://app.cochat.ai/papers/10.1016/s0140-6736(18)32840-x
- The paper
- Gerstein, H. C., McMurray, J., & Holman, R. R. (2019). Real-world studies no substitute for RCTs in establishing efficacy. The Lancet. https://doi.org/10.1016/s0140-6736(18)32840-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.