The role for pragmatic randomized controlled trials (pRCTs) in comparative effectiveness research
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
There is a growing appreciation that our current approach to clinical research leaves important gaps in evidence from the perspective of patients, clinicians, and payers wishing to make evidence-based clinical and health policy decisions. This has been a major driver in the rapid increase in interest in comparative effectiveness research (CER), which aims to compare the benefits, risks, and sometimes costs of alternative health-care interventions in ‘the real world’. While a broad range of experimental and nonexperimental methods will be used in conducting CER studies, many important questions are likely to require experimental approaches – that is, randomized controlled trials (RCTs). Concerns about the generalizability, feasibility, and cost of RCTs have been frequently articulated in CER method discussions. Pragmatic RCTs (or ‘pRCTs’) are intended to maintain the internal validity of RCTs while being designed and implemented in ways that would better address the demand for evidence about real-world risks and benefits for informing clinical and health policy decisions. While the level of interest and activity in conducting pRCTs is increasing, many challenges remain for their routine use. This article discusses those challenges and offers some potential ways forward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Effect of Spironolactone on Morbidity and Mortality in Patients with Severe Heart Failure
Pitt, B., Zannad, F., Remme, W. J., Cody, R., Castaigne, A., Perez, A., Palensky, J., & Wittes, J. (1999) · New England Journal of Medicine · doi:10.1056/nejm199909023411001 · Cited by 9,214
Intensive diabetes treatment and cardiovascular disease in patients with type 1 diabetes
(2005) · New England Journal of Medicine · doi:10.1056/nejmoa052187 · Cited by 5,138
Cardiovascular Events Associated with Rofecoxib in a Colorectal Adenoma Chemoprevention Trial
Bresalier, R. S., Sandler, R. S., Quan, H., Bolognese, J. A., Oxenius, B., Horgan, K., Lines, C., Riddell, R., Morton, D., Lanas, A., et al. (2005) · New England Journal of Medicine · doi:10.1056/nejmoa050493 · Cited by 2,519 · cited 1×
“Cox II inhibitors for the management of arthritis: the Vioxx Gastrointestinal Outcomes Research (VIGOR) [24] and Adenomatous Polyp Prevention on Vioxx (APPROVe) [25] trials”
MethodImproving the reporting of pragmatic trials: An extension of the CONSORT statement
Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D., Moher, D., & groups, F. T. C. A. P. T. I. H. (. (2008) · BMJ · doi:10.1136/bmj.a2390 · Cited by 1,813
Self-citationRates of hyperkalemia after publication of the Randomized Aldactone Evaluation Study
Juurlink, D. N., Mamdani, M. M., Lee, D. S., Kopp, A., Austin, P. C., Laupacis, A., & Redelmeier, D. A. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa040135 · Cited by 1,761
Explanatory and pragmatic attitudes in therapeutical trials
Schwartz, D., & Lellouch, J. (1967) · Journal of Chronic Diseases · doi:10.1016/0021-9681(67)90041-0 · Cited by 1,185 · cited 4×
“In their seminal 1967 article, Schwartz and Lellouch [18] introduced the distinction between ‘pragmatic’ and ‘explanatory’ attitudes as alternative intentions behind the design of any particular RCT.”
BackgroundInfluentialScientific evidence underlying the ACC/AHA clinical practice guidelines.
Tricoci, P. (2009) · JAMA · doi:10.1001/jama.2009.205 · Cited by 908 · cited 1×
“Up to 60% of the clinical recommendations made by the American College of Cardiology and the American Heart Association in their clinical guidelines are based on expert opinion and/or low-quality studies [1].”
BackgroundLarge-scale randomized evidence: Large, simple trials and overviews of trials
Peto, R., Collins, R., & Gray, R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00150-o · Cited by 365
Glasgow, R. E., Magid, D. J., Beck, A., Ritzwoller, D., & Estabrooks, P. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000163645.41407.09 · Cited by 308 · cited 1×
“The increasing interest in pragmatic approaches to the design of RCTs is highlighted by the increased rate of publication of articles on the related topics of pragmatic trials [7–9], practical trials [10,11], large simple trials [12,13], real-world trials [14], management trials [15], and effectiveness trials [16,17].”
BackgroundA simple and valid tool distinguished efficacy from effectiveness studies
Gartlehner, G., Hansen, R. A., Nissman, D., Lohr, K. N., & Carey, T. S. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.011 · Cited by 207
Cited by
Traumatic brain injury: integrated approaches to improve prevention, clinical care, and research
Maas, A. I. R., Menon, D. K., Adelson, P. D., Andelic, N., Bell, M. J., Belli, A., Bragge, P., Brazinova, A., Büki, A., Chesnut, R. M., et al. (2017) · The Lancet Neurology · doi:10.1016/s1474-4422(17)30371-x · Cited by 2,609
Ford, I., & Norrie, J. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1510059 · Cited by 1,405
He, Y., Guo, X., May, B. H., Zhang, A. L., Liu, Y., Lu, C., Mao, J. J., Xue, C. C., & Zhang, H. (2020) · JAMA Oncology · doi:10.1001/jamaoncol.2019.5233 · Cited by 407
Saturni, S., Bellini, F., Braido, F., Paggiaro, P., Sanduzzi, A., Scichilone, N., Santus, P. A., Morandi, L., & Papi, A. (2014) · Pulmonary Pharmacology & Therapeutics · doi:10.1016/j.pupt.2014.01.005 · Cited by 245
Douglas, P. S., Hoffmann, U., Lee, K. L., Mark, D. B., Al-Khalidi, H. R., Anstrom, K., Dolor, R. J., Kosinski, A., Krucoff, M. W., Mudrick, D. W., et al. (2014) · American Heart Journal · doi:10.1016/j.ahj.2014.03.003 · Cited by 141
Gawande, R., To, M. N., Pine, E., Griswold, T., Creedon, T. B., Brunel, A., Lozada, A., Loucks, E. B., & Schuman-Olivier, Z. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-018-4739-5 · Cited by 75
on behalf of the Ethics of Pragmatic Trials project, Nicholls, S. G., Carroll, K., Zwarenstein, M., Brehaut, J. C., Weijer, C., Hey, S. P., Goldstein, C. E., Graham, I. D., Grimshaw, J. M., et al. (2019) · Trials · doi:10.1186/s13063-019-3899-x · Cited by 56
Self-citationSülter, R. E., Ketelaar, P. E., & Lange, W.-G. (2022) · Computers & Education · doi:10.1016/j.compedu.2021.104384 · Cited by 52
Poblete, F., Barticevic, N. A., Zuzulich, M. S., Portilla, R., Castillo‐Carniglia, A., Sapag, J. C., Villarroel, L., Sena, B. F., & Galarce, M. (2017) · Addiction · doi:10.1111/add.13808 · Cited by 33
Pragmatic Comparative Effectiveness Trials and Learning Health Systems in Pain Medicine
Salmasi, V., Terkawi, A. S., & Mackey, S. C. (2023) · Anesthesiology Clinics · doi:10.1016/j.anclin.2023.03.010 · Cited by 16
Metadata
- Authors
- Chalkidou, K., Tunis, S., Whicher, D., Fowler, R., & Zwarenstein, M.
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2012-07-02
- Volume
- 9
- Issue
- 4
- Pages
- 436-446
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- OpenAlex
- W2103725571
- Cited by
- 163
- References
- 10
- FWCI
- 15.58
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.