Series: Pragmatic trials and real world evidence: Paper 1. Introduction
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
This is the introductory paper in a series of eight papers. In this series, we integrate the theoretical design options with the practice of conducting pragmatic trials. For most new market-approved treatments, the clinical evidence is insufficient to fully guide physicians and policy makers in choosing the optimal treatment for their patients. Pragmatic trials can fill this gap, by providing evidence on the relative effectiveness of a treatment strategy in routine clinical practice, already in an early phase of development, while maintaining the strength of randomized controlled trials. Selecting the setting, study population, mode of intervention, comparator, and outcome are crucial in designing pragmatic trials. In combination with monitoring and data collection that does not change routine care, this will enable appropriate generalization to the target patient group in clinical practice. To benefit from the full potential of pragmatic trials, there is a need for guidance and tools in designing these studies while ensuring operational feasibility. This paper introduces the concept of pragmatic trial design. The complex interplay between pragmatic design options, feasibility, stakeholder acceptability, validity, precision, and generalizability will be clarified. In this way, balanced design choices can be made in pragmatic trials with an optimal chance of success in practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
External validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544 · cited 2×
“Generalizability: The process of applying findings in a particular study to a population of patients in a particular clinical setting is called generalization and the extent to which the results of a study apply to that population is called generalizability [4].”
The PRECIS-2 tool: designing trials that are fit for purpose
Loudon, K., Treweek, S., Sullivan, F., Donnan, P., Thorpe, K. E., & Zwarenstein, M. (2015) · BMJ · doi:10.1136/bmj.h2147 · Cited by 1,846
Explanatory and pragmatic attitudes in therapeutical trials
Schwartz, D., & Lellouch, J. (1967) · Journal of Chronic Diseases · doi:10.1016/0021-9681(67)90041-0 · Cited by 1,185 · cited 8×
“Pragmatic trials, as first introduced by Schwartz and Lellouch [24], offer the opportunity to combine the real-world nature of an observational study with the scientific rigor of a randomized trial and thereby give better answers to questions that are relevant to day-to-day clinical practice.”
InfluentialAssessing the Gold Standard — Lessons from the History of RCTs
Bothwell, L. E., Greene, J. A., Podolsky, S. H., & Jones, D. S. (2016) · New England Journal of Medicine · doi:10.1056/nejmms1604593 · Cited by 664
Randomized Trials or Observational Tribulations?
Pocock, S. J., & Elbourne, D. R. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422511 · Cited by 550 · cited 4×
“Both the traditional phase III RCTs and postlaunch observational studies have limitations in providing real-world evidence on the (relative) effectiveness of treatment options [5,8 e 13].”
InfluentialAnglemyer, A., Horvath, H. T., & Bero, L. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000034.pub2 · Cited by 534
Large-scale randomized evidence: Large, simple trials and overviews of trials
Peto, R., Collins, R., & Gray, R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00150-o · Cited by 365
The history and fate of the gold standard
Jones, D. S., & Podolsky, S. H. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60742-5 · Cited by 250
The “Efficacy-Effectiveness Gap”: Historical Background and Current Conceptualization
Nordon, C., Karcher, H., Groenwold, R. H. H., Ankarfeldt, M. Z., Pichler, F., Chevrou-Severac, H., Rossignol, M., Abbe, A., & Abenhaim, L. (2016) · Value in Health · doi:10.1016/j.jval.2015.09.2938 · Cited by 177
Self-citationKane, J. M., Kishimoto, T., & Correll, C. U. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.01.012 · Cited by 131
Cited by
Speich, B., von Niederhäusern, B., Schur, N., Hemkens, L. G., Fürst, T., Bhatnagar, N., Alturki, R., Agarwal, A., Kasenda, B., Pauli-Magnus, C., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.12.018 · Cited by 146
Mc Cord, K. A., Ewald, H., Agarwal, A., Glinz, D., Aghlmandi, S., Ioannidis, J. P. A., & Hemkens, L. G. (2021) · BMJ · doi:10.1136/bmj.n450 · Cited by 61
Series: Pragmatic trials and real world evidence: Paper 5. Usual care and real life comparators
Zuidgeest, M. G. P., Welsing, P. M. J., van Thiel, G. J. M. W., Ciaglia, A., Alfonso-Cristancho, R., Eckert, L., Eijkemans, M. J. C., & Egger, M. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.07.001 · Cited by 59
Self-citationon behalf of the Ethics of Pragmatic Trials project, Nicholls, S. G., Carroll, K., Zwarenstein, M., Brehaut, J. C., Weijer, C., Hey, S. P., Goldstein, C. E., Graham, I. D., Grimshaw, J. M., et al. (2019) · Trials · doi:10.1186/s13063-019-3899-x · Cited by 56
Kemmeren, L. L., van Schaik, A., Draisma, S., Kleiboer, A., Riper, H., & Smit, J. H. (2023) · Cognitive Therapy and Research · doi:10.1007/s10608-023-10363-y · Cited by 22
“This study is one of the few studies that evaluated bCBT in clinical settings under real-life conditions, which could introduce challenges (Zuidgeest et al., 2017).”
Result
Metadata
- Authors
- Zuidgeest, M. G. P., Goetz, I., Groenwold, R. H. H., Irving, E., van Thiel, G. J. M. W., & Grobbee, D. E.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2017-08
- Volume
- 88
- Pages
- 7-13
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2620066670
- Cited by
- 222
- References
- 10
- FWCI
- 14.13
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Series: Pragmatic trials and real world evidence: Paper 1. Introduction. https://app.cochat.ai/papers/10.1016/j.jclinepi.2016.12.023
- The paper
- Zuidgeest, M. G. P., Goetz, I., Groenwold, R. H. H., Irving, E., van Thiel, G. J. M. W., & Grobbee, D. E. (2017). Series: Pragmatic trials and real world evidence: Paper 1. Introduction. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2016.12.023
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.