CoChat

Real-world studies no substitute for RCTs in establishing efficacy

Open access

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.

Abstract

210 www.thelancet.com Vol 393 January 19, 2019 We live in the real world, so it is reasonable to expect that data collected from the real world should help identify effective therapies. Indeed, rapid increases in the availability of registries, electronic health records, and insurance claims, and the ability to access, process, link, and analyse data from these sources at fairly low cost lend support for calls to replace randomised controlled trials (RCTs) with so-called real-world studies to establish the efficacy of a therapy, particularly for common serious diseases with abundant, easily collected data such as diabetes. This push is driven partly by the need to show payers that therapies are working and are therefore of value when used in the real world. Other driving factors include the industry’s wish to reduce costs and time to get results, a mistaken belief that real-world data are somehow more relevant than RCT data for establishing efficacy, and the ease and speed with which registry data can be accessed and publications generated. However, even with the use of sophisticated methods to address various sources of bias, the absence of randomisation precludes protection from confounding and can lead payers and clinicians alike to erroneously infer that a therapy is beneficial or harmful. Observational data from the real world can help to identify associations between drug exposures and outcomes, and they can be used to estimate the strength of such associations. For exa…

Overview

Integrity signals

Registry

Crossref · 10.1016/s0140-6736(18)32840-x

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 15 references

Research works printed but not linked: 1

  1. Shaywitz, 2018, Will real world performance replace RCTs as healthcare's most important standard?, Forbes

Cited by

See all 98

Metadata

Authors
Gerstein, H. C., McMurray, J., & Holman, R. R.
Affiliations
  • Population Health Research Institute (CA)
  • University of Glasgow (GB)
  • University of Oxford (GB)
Corresponding author
Gerstein, Hertzel C
Venue
The Lancet
Publisher
Elsevier BV
Published
2019-01
Volume
393
Issue
10168
Pages
210-211
ISSN
  • 0099-5355 (ISSN-L)
  • 0140-6736
OpenAlex
W2909633566
Cited by
97
References
15
Citations by year
2026: 2 · 2025: 6 · 2024: 7 · 2023: 11 · 2022: 8 · 2021: 14 · 2020: 27 · 2019: 21
FWCI
13.65
Type
journal article
Language
en
Open access
Licence
  • cc-by-sa
  • www.elsevier.com/tdm/userlicense/1.0/ (tdm)
  • www.elsevier.com/legal/tdmrep-license (tdm)
Locations
  • The Lancet (publishedVersion)
  • PubMed (publishedVersion)
  • ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (submittedVersion, cc-by-sa)
Funders
  • AstraZeneca
  • Boehringer Ingelheim
  • Bayer
  • Janssen Pharmaceuticals
  • GlaxoSmithKline
  • Merck Sharp and Dohme
  • Johnson and Johnson
  • Novo Nordisk
  • Pfizer
  • Novartis
  • Bristol-Myers Squibb
  • Eli Lilly and Company
  • Abbott Laboratories
  • Amgen
  • Merck
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Toxicology › Pharmacovigilance and Adverse Drug Reactions
Keywords
real-world evidence, randomized controlled trials, efficacy evidence, observational studies, real-world data, electronic health records, registry, health insurance claims, SGLT2 inhibitors, cardiovascular risk, causal inference, health policy decision-making, health technology assessment
MeSH terms
Humans, Research Design, Randomized Controlled Trials as Topic, Drug Approval, Pragmatic Clinical Trials as Topic, Observational Studies as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Real-world studies no substitute for RCTs in establishing efficacy. https://app.cochat.ai/papers/10.1016/s0140-6736(18)32840-x
The paper
Gerstein, H. C., McMurray, J., & Holman, R. R. (2019). Real-world studies no substitute for RCTs in establishing efficacy. The Lancet. https://doi.org/10.1016/s0140-6736(18)32840-x

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.