Assessing the Gold Standard — Lessons from the History of RCTs
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Randomized, controlled trials have become the gold standard of medical knowledge. Yet their scientific and political history offers lessons about the complexity of medicine and disease and the economic and political forces shaping the production and circulation of knowledge.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Randomized clinical trials (RCT) serve as the most valid study design to inform clinical practice according to evidence-based medicine (EBM) principles.1,2”
From Integrity of randomized clinical trials: Performance of integrity tests and checklists requires assessment (2023) · cites this paper as [1]
Citations
Cites
Optimal Medical Therapy with or without PCI for Stable Coronary Disease
Boden, W. E., O'Rourke, R. A., Teo, K. K., Hartigan, P. M., Maron, D. J., Kostuk, W. J., Knudtson, M., Dada, M., Casperson, P., Harris, C. L., et al. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa070829 · Cited by 4,699
Elkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300
Zika Virus Infection in Pregnant Women in Rio de Janeiro
Brasil, P., Pereira, J. P., Moreira, M. E., Ribeiro Nogueira, R. M., Damasceno, L., Wakimoto, M., Rabello, R. S., Valderramos, S. G., Halai, U.-A., Salles, T. S., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmoa1602412 · Cited by 2,196
A Controlled Trial of Arthroscopic Surgery for Osteoarthritis of the Knee
Moseley, J. B., O'Malley, K., Petersen, N. J., Menke, T. J., Brody, B. A., Kuykendall, D. H., Hollingsworth, J. C., Ashton, C. M., & Wray, N. P. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa013259 · Cited by 2,149
Impure Science: AIDS, Activism, and the Politics of Knowledge
(1997) · Nature Medicine · doi:10.1038/nm0297-242 · Cited by 1,666
The effectiveness of psychotherapy: the Consumer Reports study
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.12.965 · Cited by 1,608
Emergence of Zaire Ebola Virus Disease in Guinea
Baize, S., Pannetier, D., Oestereich, L., Rieger, T., Koivogui, L., Magassouba, N., Soropogui, B., Sow, M. S., Keïta, S., De Clerck, H., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1404505 · Cited by 1,366
TRANSLUMINAL DILATATION OF CORONARY-ARTERY STENOSIS
Grüntzig, A. (1978) · The Lancet · doi:10.1016/s0140-6736(78)90500-7 · Cited by 1,343
Instruments, Randomization, and Learning about Development
Deaton, A. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.424 · Cited by 1,286
A review of uses of health care utilization databases for epidemiologic research on therapeutics
Schneeweiss, S., & Avorn, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.012 · Cited by 1,277
Research works printed but not linked: 3
- Podolsky SH, Jones DS, Kaptchuk TJ. From trials to trials: blinding, medicine, and honest adjudication. In: Robertson CT, Kesselheim AS, eds. Blinding as a solution to bias: strengthening biomedical science, forensic science, and law. Amsterdam: Elsevier, 2016:45-58.
- Kuo W-H. Japan and Taiwan in the wake of bio-globalization: drugs, race and standards (Ph.D. dissertation). Cambridge: Massachusetts Institute of Technology, 2005.
- Rothman DJ, 2000, New York Rev Books, 47, 60
Cited by
Evidence for Health Decision Making — Beyond Randomized, Controlled Trials
Frieden, T. R. (2017) · New England Journal of Medicine · doi:10.1056/nejmra1614394 · Cited by 770
Alipanah, N., Jarlsberg, L., Miller, C., Linh, N. N., Falzon, D., Jaramillo, E., & Nahid, P. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002595 · Cited by 503
Econometric Methods for Program Evaluation
Abadie, A., & Cattaneo, M. D. (2018) · Annual Review of Economics · doi:10.1146/annurev-economics-080217-053402 · Cited by 431
Adaptive platform trials: definition, design, conduct and reporting considerations
Coalition, T. A. P. T. (2019) · Nature Reviews Drug Discovery · doi:10.1038/s41573-019-0034-3 · Cited by 412
Lewis, C., Roberts, N. P., Gibson, S., & Bisson, J. I. (2020) · European Journal of Psychotraumatology · doi:10.1080/20008198.2019.1709709 · Cited by 382
“The methodology may have excluded some potentially high-quality sources of evidence, such as large observational studies and nonrandomized controlled effectiveness studies (Bothwell et al., 2016), which could contribute to a more accurate overall assessment of dropout.”
BackgroundInvasion and metastasis in cancer: molecular insights and therapeutic targets
Li, Y., Liu, F., Cai, Q., Deng, L., Ouyang, Q., Zhang, X. H.-F., & Zheng, J. (2025) · Signal Transduction and Targeted Therapy · doi:10.1038/s41392-025-02148-4 · Cited by 244
“604 A substantial number of clinical trials require costly infrastructure to facilitate their studies.”
Bisson, J. I., Berliner, L., Cloitre, M., Forbes, D., Jensen, T. K., Lewis, C., Monson, C. M., Olff, M., Pilling, S., Riggs, D. S., et al. (2019) · Journal of Traumatic Stress · doi:10.1002/jts.22421 · Cited by 337
Mendelian randomization for studying the effects of perturbing drug targets
Gill, D., Georgakis, M. K., Walker, V. M., Schmidt, A. F., Gkatzionis, A., Freitag, D. F., Finan, C., Hingorani, A. D., Howson, J. M. M., Burgess, S., et al. (2021) · Wellcome Open Research · doi:10.12688/wellcomeopenres.16544.2 · Cited by 133
Rugulies, R., Aust, B., Greiner, B. A., Arensman, E., Kawakami, N., LaMontagne, A. D., & Madsen, I. E. H. (2023) · The Lancet · doi:10.1016/s0140-6736(23)00869-3 · Cited by 217
Mendelian randomization for studying the effects of perturbing drug targets
Gill, D., Georgakis, M. K., Walker, V. M., Schmidt, A. F., Gkatzionis, A., Freitag, D. F., Finan, C., Hingorani, A. D., Howson, J. M. M., Burgess, S., et al. (2021) · Wellcome Open Research · doi:10.12688/wellcomeopenres.16544.1 · Cited by 266
Series: Pragmatic trials and real world evidence: Paper 1. Introduction
Zuidgeest, M. G. P., Goetz, I., Groenwold, R. H. H., Irving, E., van Thiel, G. J. M. W., & Grobbee, D. E. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.12.023 · Cited by 222
Bica, I., Alaa, A. M., Lambert, C., & van der Schaar, M. (2021) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1907 · Cited by 203
Adaptive design clinical trials: a review of the literature and ClinicalTrials.gov
Bothwell, L. E., Avorn, J., Khan, N. F., & Kesselheim, A. S. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-018320 · Cited by 196
“Yet, modern RCTs can demand substantial time and resources.(1) Adaptive designs have been developed as an alternative to traditional RCT design.”
Self-citationScheepers, R. A., Emke, H., Epstein, R. M., & Lombarts, K. M. J. M. H. (2020) · Medical Education · doi:10.1111/medu.14020 · Cited by 170
Work as a social determinant of health in high-income countries: past, present, and future
Frank, J., Mustard, C., Smith, P., Siddiqi, A., Cheng, Y., Burdorf, A., & Rugulies, R. (2023) · The Lancet · doi:10.1016/s0140-6736(23)00871-1 · Cited by 155
Gill, D., Efstathiadou, A., Cawood, K., Tzoulaki, I., & Dehghan, A. (2019) · International Journal of Epidemiology · doi:10.1093/ije/dyz200 · Cited by 162
“Randomized controlled trials (RCTs), on the other hand, are not a plausible option for studying the effects of cognition or education.(7) Whereas previous work has investigated the effect of educational attainment on cardiovascular disease risk(8,9) further disentangling the independent effects of education and cognit…”
BackgroundHeitner, J. F., Kim, R. J., Kim, H. W., Klem, I., Shah, D. J., Debs, D., Farzaneh‐Far, A., Polsani, V. R., Kim, J. J., Weinsaft, J. W., et al. (2019) · JAMA Cardiology · doi:10.1001/jamacardio.2019.0035 · Cited by 149
Acupuncture and Neural Mechanism in the Management of Low Back Pain—An Update
Lim, T.-K., Ma, Y., Berger, F., & Litscher, G. (2018) · Medicines · doi:10.3390/medicines5030063 · Cited by 155
“The double-blind placebo-controlled clinical trial is considered as the gold standard for testing or comparing the efficacy of either new or existing treatments/drugs [233].”
BackgroundContinuing to enhance the quality of case study methodology in health services research
Sibbald, S. L., Paciocco, S., Fournie, M., Asseldonk, R. V., & Scurr, T. (2021) · Healthcare Management Forum · doi:10.1177/08404704211028857 · Cited by 157
Cereda, E., Pisati, R., Rondanelli, M., & Caccialanza, R. (2022) · Nutrients · doi:10.3390/nu14071524 · Cited by 139
“PROVIDE study Bauer, 2015 [44] Verlaan, 2018 [45] Liberman, 2019 [46]”
Burcu, M., Dreyer, N. A., Franklin, J. M., Blum, M. D., Critchlow, C. W., Perfetto, E. M., & Zhou, W. (2020) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4975 · Cited by 141
“Over the past several decades, randomized clinical trials (RCTs) have been the gold standard in producing clinical evidence of efficacy of medical interventions prior to their marketing authorization.(1) But”
BackgroundWasmann, K. A. T. G. M., de Groof, E. J., Stellingwerf, M. E., D’Haens, G., Ponsioen, C. Y., Gecse, K. B., Dijkgraaf, M. G. W., Gerhards, M. F., Jansen, J. M., Pronk, A., et al. (2020) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjaa004 · Cited by 131
The value of pragmatic and observational studies in health care and public health
Barnish, M., & Turner, S. (2017) · Pragmatic and Observational Research · doi:10.2147/por.s137701 · Cited by 118
“15 It is important to note that there is evidence that well-designed observational studies do not systematically overestimate treatment effects compared to RCTs. 16 Methodological triangulation is an important concept in social science research, and especially in qualitative research.”
InfluentialLearning Counterfactual Representations for Estimating Individual Dose-Response Curves
Schwab, P., Linhardt, L., Bauer, S., Buhmann, J. M., & Karlen, W. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6014 · Cited by 194
Zhou, Q., Chen, Z.-H., Cao, Y.-H., & Peng, S. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00524-2 · Cited by 126
“Variables Levels TS (n= 37) ML (n= 17) DL (n= 11) P value Duration of study (n= 59, months, median [IQR]) 17 [8, 32] 7 [4, 19] 6 [4, 9] 0.”
Wasmann, K. A. T. G. M., Wijsman, P. C., van Dieren, S., Bemelman, W. A., & Buskens, C. J. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031151 · Cited by 135
“Karin A Wasmann http:// orcid. org/ 0000- 0003- 2295-238X rEFErEnCES”
Bojke, L., Soares, M. O., Claxton, K., Colson, A. R., Fox, A., Jackson, C. H., Janković, D., Morton, A., Sharples, L. D., & Taylor, A. L. (2021) · Health Technology Assessment · doi:10.3310/hta25370 · Cited by 142
Schwab, P., Linhardt, L., & Karlen, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00656 · Cited by 128
“ults are used to regulate the approval of treatments. However, in many settings of interest, randomised experiments are too expensive or time-consuming to execute, or not possible for ethical reasons [3, 4]. Observational data, i.e. data that has not been collected in a randomised experiment, on the other hand, is oft…”
Moyle, W., Jones, C., Murfield, J., Thalib, L., Beattie, E., Shum, D., & Draper, B. (2019) · Aging & Mental Health · doi:10.1080/13607863.2017.1421617 · Cited by 114
Precision Rehabilitation: Optimizing Function, Adding Value to Health Care
French, M. A., Roemmich, R. T., Daley, K. N., Beier, M. L., Penttinen, S., Raghavan, P., Searson, P. C., Wegener, S. T., & Celnik, P. A. (2022) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2022.01.154 · Cited by 121
Nagin, D. S., & Sampson, R. J. (2019) · Annual Review of Criminology · doi:10.1146/annurev-criminol-011518-024838 · Cited by 107
Phelan, M., Bhavsar, N., & Goldstein, B. A. (2017) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.5334/egems.243 · Cited by 96
“The gold standard data source for clinical research are clinical trials and epidemiological cohort studies.(1) Clinical trials are governed by protocols and are carefully organized to answer discrete questions.”
BackgroundSchrader, J., Hasselhorn, M., Hetfleisch, P., & Goeze, A. (2020) · Zeitschrift für Erziehungswissenschaft · doi:10.1007/s11618-020-00927-z · Cited by 111
“…da sie gelegentlich auch, wie in der Pharmaindustrie, aus vorwiegend kommerziellen Interessen für Interventionen durchgeführt werden, bei denen die Zulassung von Therapien für zahlungskräftige Kunden im Vordergrund steht, nicht ihre breite Implementierung für alle (Rothwell et al. 2016).”
BackgroundZhang, H., Huang, Z., Zou, X., & Liu, T. (2016) · Oncotarget · doi:10.18632/oncotarget.12666 · Cited by 92
“Thus, this review limited the analysis to randomized controlled trial which are the gold standard of clinical research [19], to ensure that only the highest quality data were used.”
MethodModern postural yoga as a mental health promoting tool: A systematic review
Domingues, R. B. (2018) · Complementary Therapies in Clinical Practice · doi:10.1016/j.ctcp.2018.03.002 · Cited by 98
Registry-Based Pragmatic Trials in Heart Failure: Current Experience and Future Directions
Lund, L. H., Oldgren, J., & James, S. (2017) · Current Heart Failure Reports · doi:10.1007/s11897-017-0325-0 · Cited by 89
Using electronic health records for clinical trials: Where do we stand and where can we go?
Mc Cord, K. A., & Hemkens, L. G. (2019) · Canadian Medical Association Journal · doi:10.1503/cmaj.180841 · Cited by 88
Quasi-experimental study designs series—paper 1: introduction: two historical lineages
Bärnighausen, T., Røttingen, J., Rockers, P. C., Shemilt, I., & Tugwell, P. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.02.020 · Cited by 90
Ebola vaccines, evidentiary charisma and the rise of global health emergency research
Kelly, A. H. (2018) · Economy and Society · doi:10.1080/03085147.2018.1448557 · Cited by 81
“12 For more on the methodological faith and fervour the RCT inspires see Bothwell et al. (2016).”
BackgroundClinical Use of Placebo Effects in Patients With Pain Disorders
Klinger, R., Stuhlreyer, J., Schwartz, M., Schmitz, J., & Colloca, L. (2018) · International review of neurobiology · doi:10.1016/bs.irn.2018.07.015 · Cited by 87
Boysen, W. R., Akhavan, A., Ko, J. S., Ellison, J. S., Lendvay, T. S., Huang, J. H., Garcia-Roig, M. L., Kirsch, A. J., Koh, C. J., Schulte, M. E., et al. (2018) · Journal of Pediatric Urology · doi:10.1016/j.jpurol.2018.01.020 · Cited by 79
Zhang, Y., Li, D., Zhu, Z., Chen, S., Lu, M., Cao, P., Chen, T., Li, S., Xue, S., Zhang, Y., et al. (2022) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2022.06.010 · Cited by 81
Murray, M.-I. K., Arnold, A. D., Younis, M., Varghese, S., & Zeiher, A. M. (2018) · Clinical Research in Cardiology · doi:10.1007/s00392-018-1232-4 · Cited by 74
“Lastly, although RCTs may be the ‘gold standard’ for quantifying effect estimates and minimizing bias, they may not be applicable to patients treated in general clinical practice (Bothwell et al. 2016).”
The effectiveness of interventions addressing loneliness in older persons: An umbrella review
Jarvis, M.-A., Padmanabhanunni, A., Balakrishna, Y., & Chipps, J. (2020) · International Journal of Africa Nursing Sciences · doi:10.1016/j.ijans.2019.100177 · Cited by 68
Browne, P. D., Bolte, A. C., der Vaart, I. B.-V., Claassen, E., & de Weerth, C. (2021) · Scientific Reports · doi:10.1038/s41598-021-81204-9 · Cited by 71
A Systematic Review of Interventions to Improve Healthcare Experiences and Access in Autism
Walsh, C., O'Connor, P. E., Walsh, E., & Lydon, S. (2021) · Review Journal of Autism and Developmental Disorders · doi:10.1007/s40489-021-00279-2 · Cited by 73
Economic Modeling Considerations for Rare Diseases
Pearson, I. V., Rothwell, B., Olaye, A., & Knight, C. (2018) · Value in Health · doi:10.1016/j.jval.2018.02.008 · Cited by 67
“Clinical evidence ▪ Challenges in developing randomized clinical trials, a goldstandard clinical evidence source [14], in rare diseases because of”
BackgroundInfluentialBogossian, F. E., Cant, R., Ballard, E. L., Cooper, S. J., Levett-Jones, T. L., McKenna, L., Ng, L., & Seaton, P. (2019) · Journal of Clinical Nursing · doi:10.1111/jocn.14965 · Cited by 70
Should the Randomistas (Continue to) Rule?
Ravallion, M. D. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780198865360.003.0003 · Cited by 64
Rosoff, D. B., Kaminsky, Z. A., McIntosh, A. M., Smith, G. D., & Lohoff, F. W. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-01047-2 · Cited by 68
Vashisht, R., Jung, K., Schuler, A., Banda, J. M., Park, R. W., Jin, S., Li, L., Dudley, J. T., Johnson, K. W., Shervey, M. M., et al. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.1755 · Cited by 61
A mentally healthy framework to guide employers and policy makers
Deady, M., Sanatkar, S., Tan, L., Glozier, N., Gayed, A., Petrie, K., Dalgaard, V. L., Stratton, E., LaMontagne, A. D., & Harvey, S. B. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1430540 · Cited by 68
“Difficulties in conducting trial-based research may require reassessment of the value of traditionally less methodologically rigorous means of evaluation, including high quality observational evidence (e.g., triangulation, natural experiments) (171–173).”
BackgroundNorton, W. E., Loudon, K., Chambers, D. A., & Zwarenstein, M. (2021) · Implementation Science · doi:10.1186/s13012-020-01075-y · Cited by 58
“Randomized controlled trials (RCTs), including individual-, cluster-, and stepped-wedge, are considered the “gold standard” study design for identifying effective health-related innovations [1].”
BackgroundKoenders, N., Rushton, A., Verra, M. L., Willems, P. C. P. H., Hoogeboom, T. J., & Staal, J. B. (2018) · European Spine Journal · doi:10.1007/s00586-018-5680-3 · Cited by 61
Current use and costs of electronic health records for clinical trial research: a descriptive study
Mc Cord, K. A., Ewald, H., Ladanie, A., Briel, M., Speich, B., Bucher, H. C., & Hemkens, L. G. (2019) · CMAJ Open · doi:10.9778/cmajo.20180096 · Cited by 60
“CMAJ OPEN, 7(1) E29 missing data or patients lost to follow-up was reported, but none reported on the quality of the data.”
BackgroundMethodInfluentialHindorff, L. A., Bonham, V. L., & Ohno-Machado, L. (2018) · Personalized Medicine · doi:10.2217/pme-2018-0037 · Cited by 58
Fool’s gold? Why blinded trials are not always best
Anand, Norrie, Bradley, McAuley, & Clarke (2020) · BMJ · doi:10.1136/bmj.l6228 · Cited by 58
Almuqrin, A., Hammoud, R., Terbagou, I., Tognin, S., & Mechelli, A. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-093932 · Cited by 60
Sexual health after vaginoplasty: A systematic review
Kloer, C., Parker, A. C., Blasdel, G., Kaplan, S. J., Zhao, L. C., & Bluebond‐Langner, R. (2021) · Andrology · doi:10.1111/andr.13022 · Cited by 57
Associations in Medical Research Can Be Misleading: A Clinician's Guide to Causal Inference
Karamitros, G., Grant, M. P., & Lamaris, G. A. (2025) · Journal of Surgical Research · doi:10.1016/j.jss.2025.03.043 · Cited by 62
Whitelaw, S., Thabane, L., Mamas, M. A., Reza, N., Breathett, K. K., Douglas, P. S., & Spall, H. G. C. V. (2020) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2020.08.062 · Cited by 57
Capable and credible? Challenging nutrition science
Penders, B., Wolters, A., Feskens, E. J. M., Brouns, F. J. P. H., Huber, M., Maeckelberghe, E. L. M., Navis, G. J., Ockhuizen, T., Plat, J., Sikkema, J., et al. (2017) · European Journal of Nutrition · doi:10.1007/s00394-017-1507-y · Cited by 58
Whole Systems Research Methods in Health Care: A Scoping Review
Ijaz, N., Rioux, J., Elder, C. R., & Weeks, J. (2019) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2018.0499 · Cited by 55
“, psychotherapy, surgery, and dietetics) had at the time articulated parallel concerns around the RCT’s universal applicability.(6,13) However, WSR proponents additionally pointed to a unique set of research challenges arising from paradigmatic features of TCIM ‘‘whole systems,’’ in relation to which these differ subs…”
BackgroundRandomized Control Trials in the Field of Development: A Critical Perspective
Bédécarrats, F., Guérin, I., & Roubaud, F. (2020) · doi:10.1093/oso/9780198865360.001.0001 · Cited by 88
Hofmann, M., Münster, S., & Noennig, J. R. (2019) · Journal of Geovisualization and Spatial Analysis · doi:10.1007/s41651-019-0040-3 · Cited by 59
Education and stroke: evidence from epidemiology and Mendelian randomization study
Wen, X., Wu, Q., Minjun, X., Wei-dong, L., & Lizhen, L. (2020) · Scientific Reports · doi:10.1038/s41598-020-78248-8 · Cited by 65
Decolonising global health by decolonising academic publishing
Khan, S. A. (2022) · BMJ Global Health · doi:10.1136/bmjgh-2021-007811 · Cited by 50
“33 34 The costs associated with conducting any sizeable RCT have led to over-representation of the interests of sponsors and investigators hailing from North America, Western Europe and East Asia and shifted the power of knowledge creation decisively in favour of entities from these regions.”
BackgroundInfluentialPreclinical systematic review of ginsenoside Rg1 for cognitive impairment in Alzheimer’s disease
Liang, H.-Y., Zhang, P., Zhang, X., Zheng, Y., Huang, Y., Zheng, G., & Lin, Y. (2021) · Aging · doi:10.18632/aging.202619 · Cited by 55
“Randomized controlled trials have long been regarded as the gold standard when assessing the efficacy and safety of interventions [95].”
BackgroundKeys, E., Luctkar‐Flude, M., Tyerman, J. J., Sears, K., & Woo, K. Y. (2021) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2021.01.013 · Cited by 50
Victoria Team, Bugeja, L. C., & Weller, C. D. (2018) · International Wound Journal · doi:10.1111/iwj.12950 · Cited by 49
Franken, M. G., Leeneman, B., Gheorghe, M., Groot, C. A. U., Haanen, J. B. A. G., & van Baal, P. H. M. (2019) · European Journal of Cancer · doi:10.1016/j.ejca.2019.08.032 · Cited by 51
Temporal Strategies and Firms’ Speedy Responses to COVID‐19
Ahlström, D., & Wang, L. C. (2020) · Journal of Management Studies · doi:10.1111/joms.12664 · Cited by 51
Behavioral brittleness: the case for strategic behavioral public policy
Schmidt, R., & Stenger, K. (2021) · Behavioural Public Policy · doi:10.1017/bpp.2021.16 · Cited by 52
“…a systems approach that considers existing infrastructures and systems of exchange to reduce the chances that interventions fail due to operational conflicts and limitations, inequitable execution, or inconsistent enforcement (Shore et al., 2012; Bothwell et al., 2016; Supplee & Kane, 2020).”
BackgroundReime, B., Wurmb, T. E., Kippnich, U., Shammas, L., Rashid, A., & Eder, P. A. (2018) · Methods of Information in Medicine · doi:10.1055/s-0039-1681089 · Cited by 48
Intervention Tournaments: An Overview of Concept, Design, and Implementation
Hameiri, B., & Moore‐Berg, S. L. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211058090 · Cited by 48
“For example, when developing a vaccine, there is an agreed protocol (with some variants; see e.g., Adaptive Platform Trials Coalition, 2019; Bothwell et al., 2016) that needs to be followed closely to prove a vaccine is effective and safe for use by the general public.”
BackgroundAlipour‐Haris, G., Liu, X., Acha, V., Winterstein, A. G., & Burcu, M. (2024) · Clinical and Translational Science · doi:10.1111/cts.13903 · Cited by 50
Heinskou, T. B., Maarbjerg, S., Wolfram, F., Rochat, P., Brennum, J., Olesen, J., & Bendtsen, L. (2019) · The Journal of Headache and Pain · doi:10.1186/s10194-019-0973-4 · Cited by 50
Kumar, N., Janmohamed, K., Jiang, J., Ainooson, J., Billings, A., Chen, G. Q., Chumo, F., Cueto, L. N., NIAURA, R. S., & Zhang, A. (2020) · Addictive Behaviors · doi:10.1016/j.addbeh.2020.106612 · Cited by 47
Community-led trials: Intervention co-design in a cluster randomised controlled trial
Andersson, N. (2017) · BMC Public Health · doi:10.1186/s12889-017-4288-6 · Cited by 44
“The biggest volume of health-related RCTs is undisputedly the clinical trials sponsored by the pharmaceutical industry [5], essentially to comply with legal requirements about proof of efficacy.”
BackgroundCritical Evaluation of Pharmacy Automation and Robotic Systems: A Call to Action
M. Boyd, A., & W. Chaffee, B. (2019) · Hospital Pharmacy · doi:10.1177/0018578718786942 · Cited by 39
“Although RCTs have become the standard in pharmaceutical research, the application of RCTs in other areas affecting medication use, including the incorporation of technology, has been challenging.(10) The cautious, systematic approach to drug approval contrasts sharply with the fast-paced nature of 786942 HPXXXX10.”
BackgroundMisspecification and unreliable interpretations in psychology and social science.
Vowels, M. J. (2021) · Psychological Methods · doi:10.1037/met0000429 · Cited by 49
Noor, N. M., Love, S., Isaacs, T., Kaplan, R. S., Parmar, M., & Sydes, M. R. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-055615 · Cited by 48
Evidence in Rehabilitation Medicine: Between Facts and Prejudices
Négrini, S. (2018) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000001033 · Cited by 50
Almulhim, A. N., Hartley, H., Norman, P., Caton, S. J., Doğru, O. C., & Goyder, E. (2023) · BMC Public Health · doi:10.1186/s12889-022-14874-3 · Cited by 39
“Only RCT studies were included to explore effectiveness of the interventions and minimize the risk of bias [33].”
BackgroundLu, T., Lu, C., Li, H., Xing, X., Deng, X., Li, X., Wang, Y., Niu, J., Liu, Y., & Yang, K. (2020) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2020.102433 · Cited by 39
Athletic Injury Research: Frameworks, Models and the Need for Causal Knowledge
Kalkhoven, J. T. (2024) · Sports Medicine · doi:10.1007/s40279-024-02008-1 · Cited by 44
“…from van Mechelen et al. [12] and Finch [35] with permission medicine, RCTs are commonly regarded as the ‘gold stand-ard’ for assessing causality [37], as it is widely considered that the randomisation process applied to the samples within these types of studies serves to eliminate the effects…”
BackgroundMethodExperiment’s persistent failure in education inquiry, and why it keeps failing
Thomas, G. (2020) · British Educational Research Journal · doi:10.1002/berj.3660 · Cited by 39
“A parallel of this potential to distort influence on policy is seen in research in psychiatry, where, as Bothwell et al. (2016) point out, because experiment-based inquiry is more feasible for assessing the therapeutic consequences of psychotropic drugs than it is for assessing the benefits of…”
BackgroundBarbosa, F. T., Lira, A. B., Neto, O. B. D. O., Santos, L. L., Santos, I. O., Barbosa, L. T., Ribeiro, M. V. M. R., & de Sousa‐Rodrigues, C. F. (2019) · Brazilian Journal of Anesthesiology · doi:10.1016/j.bjan.2018.11.007 · Cited by 38
Short-term clinical outcomes of a European training programme for robotic colorectal surgery
Panteleimonitis, S., Mišković, D., Bissett‐Amess, R., Figueiredo, N., Turina, M., Spinoglio, G., Heald, R. J., Parvaiz, A. C., & Collaborative, O. B. O. T. E. (2020) · Surgical Endoscopy · doi:10.1007/s00464-020-08184-1 · Cited by 38
Whitesell, N. R., Sarche, M., Keane, E., Mousseau, A. C., & Kaufman, C. E. (2018) · American Journal of Evaluation · doi:10.1177/1098214017726872 · Cited by 37
Establishing the Effectiveness of Procedural Interventions: The Limited Role of Randomized Trials
Wallis, C. J. D., Detsky, A. S., & Fan, E. (2018) · JAMA · doi:10.1001/jama.2018.16329 · Cited by 37
Adjuvant therapies in venous leg ulcer management: A scoping review
Team, V., Chandler, P. G., & Weller, C. D. (2019) · Wound Repair and Regeneration · doi:10.1111/wrr.12724 · Cited by 36
“The authors report the need to conduct comparative RCTs.71 Gohel and co-authors72 concluded early endovenous ablation of superficial venous reflux as an adjunct to compression was associated with a shorter time to VLU healing compared to compression Wound Rep Reg (2019) 27 562–590 © 2019 by the Wound Healing Society56…”
BackgroundInfluentialLin, L., Zhang, R., Huang, H., Zhu, Y., Li, Y., Dong, X., Shen, S., Wei, L., Chen, X., Christiani, D. C., et al. (2021) · Frontiers in Genetics · doi:10.3389/fgene.2021.618829 · Cited by 37
“Double-blind randomized controlled trials with perfect adherence, which use randomization allocation to avoid potential confounding, are often considered as the gold standard to infer causality (Bothwell et al., 2016).”
BackgroundWilliams, A., Lennox, L., Harris, M. J., & Antonacci, G. (2023) · Implementation Science · doi:10.1186/s13012-023-01311-1 · Cited by 40
Pharmacoepidemiology: An Overview
Sabaté, M., & Montané, E. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12227033 · Cited by 36
“The benefits or the efficacy of marketed drugs have been demonstrated through randomized clinical trials (RCT), which are widely accepted to be the gold standard in demonstrating efficacy as the use of randomization, and blinding allows us to avoid biases [3].”
BackgroundGavriilidis, P., Roberts, K. J., Askari, A., Sutcliffe, R. P., Huo, T.-L., Liu, P., Hidalgo, E. L., Compagnon, P., Lim, C., & Azoulay, D. (2017) · Journal of Hepatology · doi:10.1016/j.jhep.2017.06.028 · Cited by 37
Tutorial for performing systematic review and meta-analysis with interventional anesthesia studies
Barbosa, F. T., Lira, A. B., Neto, O. B. D. O., Santos, L. L., Santos, I. O., Barbosa, L. T., Ribeiro, M. V. M. R., & de Sousa‐Rodrigues, C. F. (2019) · Brazilian Journal of Anesthesiology (English Edition) · doi:10.1016/j.bjane.2019.03.003 · Cited by 36
Ethics of RCTs: Should Economists Care about Equipoise?
Abramowicz, M., & Szafarz, A. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198865360.003.0012 · Cited by 56
Real‐World Evidence, Public Participation, and the FDA
Schwartz, J. L. (2017) · The Hastings Center Report · doi:10.1002/hast.779 · Cited by 34
New non-validated practice: an enhanced definition of innovative practice for medicine
Mastroleo, I., & Holzer, F. (2020) · Law Innovation and Technology · doi:10.1080/17579961.2020.1815405 · Cited by 35
Metadata
- Authors
- Bothwell, L. E., Greene, J. A., Podolsky, S. H., & Jones, D. S.
- Affiliations
- Brigham and Women's Hospital (US)
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2016-06-02
- Volume
- 374
- Issue
- 22
- Pages
- 2175-2181
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2413861456
- Cited by
- 664
- References
- 54
- Citations by year
- 2026: 40 · 2025: 101 · 2024: 59 · 2023: 53 · 2022: 49 · 2021: 76 · 2020: 93 · 2019: 71 · 2018: 74 · 2017: 43 · 2016: 5
- FWCI
- 337.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › History of Science and Medicine
- Health Sciences › Medicine › Pharmacology (medical) › Historical Medical Research and Treatments
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Keywords
- randomized controlled trials, history of medicine, evidence-based medicine, scientific knowledge production, medical politics, health research funding
- MeSH terms
- Drug Industry, Female, Humans, Legislation, Drug, Pregnancy, Randomized Controlled Trials as Topic, Drug Approval, History, 20th Century, History, 21st Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.