The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Making trials matter: pragmatic and explanatory trials and the problem of applicability
Open accessAbstract
Randomised controlled trials are the best research design for decisions about the effect of different interventions but randomisation does not, of itself, promote the applicability of a trial's results to situations other than the precise one in which the trial was done. While methodologists and trialists have rightly paid great attention to internal validity, much less has been given to applicability. This narrative review is aimed at those planning to conduct trials, and those aiming to use the information in them. It is intended to help the former group make their trials more widely useful and to help the latter group make more informed decisions about the wider use of existing trials. We review the differences between the design of most randomised trials (which have an explanatory attitude) and the design of trials more able to inform decision making (which have a pragmatic attitude) and discuss approaches used to assert applicability of trial results. If we want evidence from trials to be used in clinical practice and policy, trialists should make every effort to make their trial widely applicable, which means that more trials should be pragmatic in attitude.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tissue Plasminogen Activator for Acute Ischemic Stroke
(1995) · New England Journal of Medicine · doi:10.1056/nejm199512143332401 · Cited by 11,654
Beneficial Effect of Carotid Endarterectomy in Symptomatic Patients with High-Grade Carotid Stenosis
(1991) · New England Journal of Medicine · doi:10.1056/nejm199108153250701 · Cited by 8,368
Bombardier, C., Laine, L., Reicin, A., Shapiro, D., Burgos-Vargas, R., Davis, B., Day, R., Ferraz, M. B., Hawkey, C. J., Hochberg, M. C., et al. (2000) · New England Journal of Medicine · doi:10.1056/nejm200011233432103 · Cited by 4,027
Users' guides to the medical literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.270.17.2096 · Cited by 2,970
Benardete, E. A., & Nair, A. K. (2015) · Cerebrovascular Diseases Extra · doi:10.1159/000370060 · Cited by 2,546
External validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544
Cardiovascular Events Associated with Rofecoxib in a Colorectal Adenoma Chemoprevention Trial
Bresalier, R. S., Sandler, R. S., Quan, H., Bolognese, J. A., Oxenius, B., Horgan, K., Lines, C., Riddell, R., Morton, D., Lanas, A., et al. (2005) · New England Journal of Medicine · doi:10.1056/nejmoa050493 · Cited by 2,519
Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Improving the reporting of pragmatic trials: An extension of the CONSORT statement
Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D., Moher, D., & groups, F. T. C. A. P. T. I. H. (. (2008) · BMJ · doi:10.1136/bmj.a2390 · Cited by 1,813
Self-citation
Cited by
The PRECIS-2 tool: designing trials that are fit for purpose
Loudon, K., Treweek, S., Sullivan, F., Donnan, P., Thorpe, K. E., & Zwarenstein, M. (2015) · BMJ · doi:10.1136/bmj.h2147 · Cited by 1,846
Self-citationFord, I., & Norrie, J. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1510059 · Cited by 1,405
Renfrew, M. J., McFadden, A., Bastos, M. H., Campbell, J., Channon, A. A., Cheung, N. F., Silva, D. R. A. D., Downe, S., Kennedy, H. P., Malata, A., et al. (2014) · The Lancet · doi:10.1016/s0140-6736(14)60789-3 · Cited by 1,297
A pragmatic view on pragmatic trials
Patsopoulos, N. A. (2011) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2011.13.2/npatsopoulos · Cited by 844
Early palliative care for adults with advanced cancer
Haun, M. W., Estel, S., Rücker, G., Friederich, H.-C., Villalobos, M., Thomas, M., & Hartmann, M. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011129.pub2 · Cited by 757
Metadata
- Authors
- Treweek, S., & Zwarenstein, M.
- Venue
- Trials
- Published
- 2009-06-03
- Volume
- 10
- Issue
- 1
- Pages
- 37-37
- ISSN
- 1745-6215 (ISSN-L)
- OpenAlex
- W2136892596
- Cited by
- 482
- References
- 66
- FWCI
- 16.94
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Making trials matter: pragmatic and explanatory trials and the problem of applicability. https://app.cochat.ai/papers/10.1186/1745-6215-10-37
- The paper
- Treweek, S., & Zwarenstein, M. (2009). Making trials matter: pragmatic and explanatory trials and the problem of applicability. Trials. https://doi.org/10.1186/1745-6215-10-37
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.