Assessing the Gold Standard — Lessons from the History of RCTs
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Randomized, controlled trials have become the gold standard of medical knowledge. Yet their scientific and political history offers lessons about the complexity of medicine and disease and the economic and political forces shaping the production and circulation of knowledge.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Randomized clinical trials (RCT) serve as the most valid study design to inform clinical practice according to evidence-based medicine (EBM) principles.1,2”
From Integrity of randomized clinical trials: Performance of integrity tests and checklists requires assessment (2023) · cites this paper as [1]
Citations
Cites
Optimal Medical Therapy with or without PCI for Stable Coronary Disease
Boden, W. E., O'Rourke, R. A., Teo, K. K., Hartigan, P. M., Maron, D. J., Kostuk, W. J., Knudtson, M., Dada, M., Casperson, P., Harris, C. L., et al. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa070829 · Cited by 4,699
Elkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300
Zika Virus Infection in Pregnant Women in Rio de Janeiro
Brasil, P., Pereira, J. P., Moreira, M. E., Ribeiro Nogueira, R. M., Damasceno, L., Wakimoto, M., Rabello, R. S., Valderramos, S. G., Halai, U.-A., Salles, T. S., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmoa1602412 · Cited by 2,196
A Controlled Trial of Arthroscopic Surgery for Osteoarthritis of the Knee
Moseley, J. B., O'Malley, K., Petersen, N. J., Menke, T. J., Brody, B. A., Kuykendall, D. H., Hollingsworth, J. C., Ashton, C. M., & Wray, N. P. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa013259 · Cited by 2,149
Impure Science: AIDS, Activism, and the Politics of Knowledge
(1997) · Nature Medicine · doi:10.1038/nm0297-242 · Cited by 1,666
The effectiveness of psychotherapy: the Consumer Reports study
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.12.965 · Cited by 1,608
Emergence of Zaire Ebola Virus Disease in Guinea
Baize, S., Pannetier, D., Oestereich, L., Rieger, T., Koivogui, L., Magassouba, N., Soropogui, B., Sow, M. S., Keïta, S., De Clerck, H., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1404505 · Cited by 1,366
TRANSLUMINAL DILATATION OF CORONARY-ARTERY STENOSIS
Grüntzig, A. (1978) · The Lancet · doi:10.1016/s0140-6736(78)90500-7 · Cited by 1,343
Instruments, Randomization, and Learning about Development
Deaton, A. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.424 · Cited by 1,286
A review of uses of health care utilization databases for epidemiologic research on therapeutics
Schneeweiss, S., & Avorn, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.012 · Cited by 1,277
Research works printed but not linked: 3
- Podolsky SH, Jones DS, Kaptchuk TJ. From trials to trials: blinding, medicine, and honest adjudication. In: Robertson CT, Kesselheim AS, eds. Blinding as a solution to bias: strengthening biomedical science, forensic science, and law. Amsterdam: Elsevier, 2016:45-58.
- Kuo W-H. Japan and Taiwan in the wake of bio-globalization: drugs, race and standards (Ph.D. dissertation). Cambridge: Massachusetts Institute of Technology, 2005.
- Rothman DJ, 2000, New York Rev Books, 47, 60
Cited by
Items 101–200 of 698
The Changing Face of Clinical Trials in Psoriatic Arthritis
Ogdie, A., & Coates, L. C. (2017) · Current Rheumatology Reports · doi:10.1007/s11926-017-0642-z · Cited by 34
Overcoming Challenges to Evidence‐Based Policy Development in a Large, Integrated Delivery System
Frakt, A. B., Prentice, J. C., Pizer, S. D., Elwy, A. R., Garrido, M. M., Kilbourne, A. M., & Atkins, D. (2018) · Health Services Research · doi:10.1111/1475-6773.12986 · Cited by 33
Using observational data for personalized medicine when clinical trial evidence is limited
Gershman, B., Guo, D. P., & Dahabreh, I. J. (2018) · Fertility and Sterility · doi:10.1016/j.fertnstert.2018.04.005 · Cited by 35
Hayes, M. J., Kaestner, V., Mailankody, S., & Prasad, V. K. (2018) · CMAJ Open · doi:10.9778/cmajo.20170088 · Cited by 36
Rapport, F., & Braithwaite, J. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0597-4 · Cited by 34
Propensity Score Matching: A Powerful Tool for Analyzing Observational Nonrandomized Data
Badhiwala, J. H., Karmur, B. S., & Wilson, J. R. (2020) · Clinical Spine Surgery A Spine Publication · doi:10.1097/bsd.0000000000001055 · Cited by 32
“(2) The propensity score is the probability of assignment to a particular treatment conditional on observed baseline characteristics, and is typically calculated by logistic regression with treatment group as the dependent variable and relevant baseline covariates (confounders) as independent variables.”
Hernández, J. M. D. L. T., & Edelman, E. R. (2017) · Revista Española de Cardiología (English Edition) · doi:10.1016/j.rec.2017.07.008 · Cited by 34
“These trials have revolutionized medical research and improved the quality of health care by clarifying the benefits and drawbacks of countless interventions.(10) They provide the highest level of evidence to support recommendations in guidelines and are required by regulatory agencies for drug and device approval, al…”
Miranda, R., Smets, T., Schreye, R. D., Faes, K., Noortgate, N. J. V. D., Cohen, J., & den Block, L. V. (2021) · Palliative Medicine · doi:10.1177/02692163211019321 · Cited by 33
The search for scientific meaning in mindfulness research: Insights from a scoping review
Phan-Le, N. T., Brennan, L. L., & Parker, L. (2022) · PLoS ONE · doi:10.1371/journal.pone.0264924 · Cited by 33
“In medicine, the random controlled trial (RCT) remains the gold standard for evidence [22, 57] and valid experiments start with precise instruments [58].”
BackgroundBlommestein, H. M., van Beurden-Tan, C. H. Y., Franken, M. G., Groot, C. A. U., Sonneveld, P., & Zweegman, S. (2019) · Haematologica · doi:10.3324/haematol.2018.206912 · Cited by 37
“4 NCT00064038 (8-23) Benboubkher 2014 PFS 1623 Rd 73 535 25.”
Nobel Rebels in Disguise — Assessing the Rise and Rule of the Randomistas
Kvangraven, I. H. (2020) · Review of Political Economy · doi:10.1080/09538259.2020.1810886 · Cited by 35
Gill, D., Walker, V. M., Martin, R. M., Davies, N. M., & Tzoulaki, I. (2019) · International Journal of Epidemiology · doi:10.1093/ije/dyz236 · Cited by 39
RCTs in Development Economics, Their Critics and Their Evolution
Ogden, T. N. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780198865360.003.0006 · Cited by 34
Randomizing Development: Method or Madness?
Pritchett, L. H. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780198865360.003.0004 · Cited by 53
Velarde, K., Romesser, J. M., Johnson, M. R., Clegg, D. O., Efimova, O., Oostema, S. J., Scehnet, J. S., DuVall, S. L., & Huang, G. D. (2018) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2018.07.001 · Cited by 30
Davis, K. A. S., Farooq, S., Hayes, J., John, A. M., Lee, W. E., MacCabe, J. H., McIntosh, A. M., Osborn, D., Stewart, R. J., & Woelbert, E. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30298-6 · Cited by 32
“Hospital Episode Statistics in England) and national mortality statistics linked to electronic health records have shown that the treatment of people with severe mental illness with guideline-recommended psychotropics are associated with better physical health outcomes,(10,11) and can be used to compare ongoing mental…”
BackgroundFaridi, K. F., Tamez, H. E., Butala, N. M., Song, Y., Shen, C., Secemsky, E. A., Mauri, L., Curtis, J. P., Strom, J. B., & Yeh, R. W. (2021) · Circulation Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.120.006589 · Cited by 30
The Real‐World Ethics of Adaptive‐Design Clinical Trials
Bothwell, L. E., & Kesselheim, A. S. (2017) · The Hastings Center Report · doi:10.1002/hast.783 · Cited by 31
“standard method for assessing the efficacy and safety of medical therapies.(1) In an RCT, investigators randomly assign subjects to receive either a new therapy”
MethodSelf-citationMonnier, L., Colette, C., Schlienger, J.-L., Bauduceau, B., & Owens, D. R. (2019) · Diabetes & Metabolism · doi:10.1016/j.diabet.2019.01.007 · Cited by 30
Sikveland, R. O., Moser, T., Solem, M. S., & Skovholt, K. (2023) · Teaching and Teacher Education · doi:10.1016/j.tate.2023.104136 · Cited by 29
Tong, E., Wu, Q., Chen, Y., Liu, Z., Zhang, M., Zhu, Y., Wu, K., Pan, J., 潘军航, & Jiang, J. (2023) · Antibiotics · doi:10.3390/antibiotics12091389 · Cited by 29
Signs of Safety: lessons learnt from evaluations
Baginsky, M., Moriarty, J., & Manthorpe, J. (2019) · Journal of Children s Services · doi:10.1108/jcs-11-2018-0028 · Cited by 29
Should the Randomistas (Continue to) Rule?
Ravallion, M. D. (2020) · National Bureau of Economic Research · doi:10.3386/w27554 · Cited by 53
“29 Examples of the following points are found in Silverman (2009), Bothwell et al. (2016) and Frieden (2017).”
Tilden, E. L., & Snowden, J. M. (2018) · Journal of Midwifery & Women s Health · doi:10.1111/jmwh.12710 · Cited by 29
Extrapolation of Experimental Results through Analogical Reasoning from Latent Classes
van Eersel, G. G., Koppenol‐Gonzalez, G. V., & Reiss, J. (2019) · Philosophy of Science · doi:10.1086/701956 · Cited by 28
“Experimental research is often regarded as the gold standard in the human sciences (e.g., Angrist and Pischke 2010; for a review in medicine, see Bothwell et al. 2016).”
Alter-Standardizing Clinical Trials: The Gold Standard in the Crossfire
Rosemann, A. (2019) · Science as Culture · doi:10.1080/09505431.2019.1606190 · Cited by 32
“…with the conceptual basis of EBM (Timmermans and Kolker, 2004; Greenhalgh et al., 2014), its historical origins (Pope, 2003; Gelijns et al., 2005; Bothwell et al., 2016), corresponding changes for clinical research and health care practice (Mykhalovskiy andWeir, 2004; Timmermans and Mauck, 2005;…”
BackgroundIntegrating Electronic Medical Records and Claims Data for Influenza Vaccine Research
Boikos, C., Imran, M., de Lusignan, S., Ortiz, J. R., PATRIARCA, P. A., & Mansi, J. A. (2022) · Vaccines · doi:10.3390/vaccines10050727 · Cited by 28
Patient-tailored ovarian stimulation for in vitro fertilization
Fauser, B. C. J. M. (2017) · Fertility and Sterility · doi:10.1016/j.fertnstert.2017.08.016 · Cited by 28
Utilization of EHRs for clinical trials: a systematic review
Kalankesh, L. R., & Monaghesh, E. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02177-7 · Cited by 30
“Well designed and well-executed clinical trial studies provide the foundational data for evidence-based medicine [2], which are the standard for evaluating the benefits and harms of medical interventions [3].”
BackgroundReal-world studies: bridging the gap between trial-assessed efficacy and routine care
Chen, D. (2022) · Journal of Biomedical Research · doi:10.7555/jbr.36.20220040 · Cited by 27
Challenges in IBD Research: Pragmatic Clinical Research
Scott, F. I., Rubin, D. T., Kugathasan, S., Bousvaros, A., Elson, C. O., Newberry, R. D., Melmed, G., Pekow, J. R., Fleshman, J. W., Boyle, B. M., et al. (2019) · Inflammatory Bowel Diseases · doi:10.1093/ibd/izz085 · Cited by 28
Innovation and Tribulation in the History of Randomized Controlled Trials in Surgery
Bothwell, L. E., & Jones, D. S. (2019) · Annals of Surgery · doi:10.1097/sla.0000000000003631 · Cited by 26
“Long-term trial results can become obsolete before completion if surgeons have continued to refine the procedure in the meantime.(51)”
BackgroundSelf-citationFrom sandbox to pandemic: Agile reform of Canadian drug regulation
Vural, İ. E., Herder, M., & Graham, J. (2021) · Health Policy · doi:10.1016/j.healthpol.2021.04.018 · Cited by 26
Bass, G. A., Kaplan, L. J., Ryan, É. J., Cao, Y., Lane-Fall, M. B., Duffy, C. C., Vail, E. A., & Mohseni, S. (2022) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-022-02045-3 · Cited by 26
“At the same time, early twentieth century clinician-scientists laid the ethical and methodological foundations required to conduct prospective research and randomized controlled trials (RCTs) that assess outcomes after a specified intervention [7, 8].”
Education of Students with Disabilities, Science, and Randomized Controlled Trials
Odom, S. L. (2021) · Research and Practice for Persons with Severe Disabilities · doi:10.1177/15407969211032341 · Cited by 32
“…RCTs (e.g., contrasting group outcomes, blinded conditions) had been used in medical research earlier in the 1900s, numerous methodologists (e.g., Bothwell et al., 2016; Deaton, 2020) attribute the introduction of RCTs into medical research to Austin Bradford Hill in England, whose work began…”
BackgroundMethodCan Knowledge About Heterogeneity in Treatment Effects Help Us Choose Wisely?
Davidoff, F. (2016) · Annals of Internal Medicine · doi:10.7326/m16-1721 · Cited by 26
Jie, L.-J., Kleynen, M., Meijer, K., Beurskens, A., & Braun, S. (2021) · Physical Therapy · doi:10.1093/ptj/pzab017 · Cited by 25
Welsh, B. C., Podolsky, S. H., & Zane, S. N. (2022) · Journal of Experimental Criminology · doi:10.1007/s11292-022-09520-2 · Cited by 26
“The history of randomized controlled trials (RCTs) in medicine is well known (Bothwell et al., 2016; Bothwell and Podolosky, 2016; Chalmers et al., 2012).”
Self-citationChow, J. T. Y., Turkstra, T. P., Yim, E., & Jones, P. M. (2018) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-018-1109-z · Cited by 26
“In evidence-based medicine, randomized clinical trials (RCTs) are considered to provide the highest quality of evidence with the least amount of bias,(1) representing the gold standard for assessing therapeutic interventions.(2) In every study, participants are needed to provide data.”
BackgroundEnhancing the effectiveness of cybercrime prevention through policy monitoring
Dupont, B. (2019) · Journal of Crime and Justice · doi:10.1080/0735648x.2019.1691855 · Cited by 29
“Most platforms that rate the e ff ectiveness of policies use the ‘ gold standard ’ of Randomized Control Trials (RCTs) as their main criteria (Sampson 2010; Bothwell et al. 2016; Fagan and Buchanan 2016).”
MethodZhou, G., Lee, M., Atieli, H., Githure, J. I., Githeko, A. K., Kazura, J. W., & Yan, G. (2020) · Trials · doi:10.1186/s13063-020-04573-y · Cited by 25
“Given the prevalent outdoor resting behavior of mosquito vectors, will the nonpyrethroid insecticides provide added benefit and be cost-effective for malaria control? The commonly used trial design in malaria control is randomized controlled trials (RCTs) or clusterrandomized trial (CRT) [28, 34, 36–39], which is cons…”
BackgroundVerweij, E. J. T., de Vries, M. C., Oldekamp, E. J., Eggink, A. J., Oepkes, D., Slaghekke, F., Spoor, J. K. H., Deprest, J. A., Miller, J. L., Baschat, A., et al. (2021) · Prenatal Diagnosis · doi:10.1002/pd.5940 · Cited by 27
“For example, all surgical RCTs are complicated by the fact that for every case there is a countless number of confounders (such as pathological findings, surgeon's expertise and surgical approach as well as shift in the management for the condition over time) which may have an effect on the standardization the investi…”
BackgroundNutrition to Optimise Human Health—How to Obtain Physiological Substantiation?
Witkamp, R. F. (2021) · Nutrients · doi:10.3390/nu13072155 · Cited by 31
“At the same time, RCTs have also limitations which are mainly related to their limited external validity and their focus on group comparison to estimate treatment effects on population level [144].”
BackgroundReality check: Real-world evidence to support therapeutic development in hematologic malignancies
Derman, B. A., Belli, A. J., Battiwalla, M., Hamadani, M., Kansagra, A. J., Lazarus, H. M., & Wang, C.-K. (2022) · Blood Reviews · doi:10.1016/j.blre.2021.100913 · Cited by 26
Adams, S. C., McMillan, J., Salline, K., Lavery, J. A., Moskowitz, C. S., Matsoukas, K., Chen, M. M. Z., Mina, D. S., Scott, J. M., & Jones, L. W. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-048218 · Cited by 27
Liu, X., Zhuang, P., Li, Y., Wu, F. L., Wan, X., Zhang, Y., & Jiao, J. (2022) · Clinical Nutrition · doi:10.1016/j.clnu.2022.01.002 · Cited by 26
Brun-Cottan, N., McMillian, D. J., & Hastings, J. D. (2018) · Physiotherapy Theory and Practice · doi:10.1080/09593985.2018.1492656 · Cited by 26
Bukman, A. J., Teuscher, D., Meershoek, A., Renes, R. J., van Baak, M. A., & Feskens, E. J. M. (2017) · Public Health Nutrition · doi:10.1017/s1368980017001458 · Cited by 25
“However, although randomised controlled trials are highly valued, it is debateable if randomised controlled trials are the appropriate research method to evaluate complex interventions((52)).”
BackgroundIntroduction: Randomization in the Tropics Revisited, a Theme and Eleven Variations
Deaton, A. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780198865360.003.0002 · Cited by 30
Stubbs, D. J., Davies, B. M., Hutchinson, P. J., Menon, D. K., (ICENI), T. I. C. I. E. N. I., Bashford, T., Edlmann, E., Bateman, A., Braude, P., Burnstein, R., et al. (2022) · British Journal of Neurosurgery · doi:10.1080/02688697.2021.2024508 · Cited by 24
The nutritional support to prevent sarcopenia in the elderly
Giacosa, A., Barrile, G. C., Mansueto, F., & Rondanelli, M. (2024) · Frontiers in Nutrition · doi:10.3389/fnut.2024.1379814 · Cited by 27
Meta-analysis of completion lymph node dissection in sentinel lymph node-positive melanoma
Angeles, C. V., Kang, R., Shirai, K., & Wong, S. L. (2019) · British journal of surgery · doi:10.1002/bjs.11149 · Cited by 23
Boosting antibiotics performance by new formulations with deep eutectic solvents
Pedro, S. N., Gomes, A. T. P. C., Oskoei, P., Oliveira, H., Almeida, A., Freire, M. G., Silvestre, A. J. D., & Freire, C. S. R. (2022) · International Journal of Pharmaceutics · doi:10.1016/j.ijpharm.2022.121566 · Cited by 23
Paterson, H. L., & Welsh, B. C. (2023) · Aggression and Violent Behavior · doi:10.1016/j.avb.2023.101889 · Cited by 22
Application and impact of run-in studies
Fralick, M., Avorn, J., Franklin, J. M., Abdurrob, A., & Kesselheim, A. S. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-018-4344-7 · Cited by 22
“© Society of General Internal Medicine 2018 R andomized controlled trials (RCTs) remain the gold standard for assessing medication safety and efficacy.(1,2) Some RCTs include a pre-randomization run-in period, often justified as a way of preserving internal validity.”
BackgroundBianchi, C., Tettelbach, W. H., Istwan, N. B., Hubbs, B. S., Kot, K., Harris, S., & Fetterolf, D. E. (2019) · International Wound Journal · doi:10.1111/iwj.13094 · Cited by 22
“The RCT is a research methodology developed in an attempt to reduce bias and enhance the accuracy of clinical experimentation while producing generalisable, universal biomedical knowledge.(4) To that end, the RCT methodology is considered to generate the highest level of evidence.”
MethodWojcieszek, A. M., Heazell, A. E. P., Middleton, P., Ellwood, D. A., Silver, R. M., & Flenady, V. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-028735 · Cited by 24
Peart, A., Barton, C., Lewis, V. J., & Russell, G. M. (2020) · Journal of Clinical Nursing · doi:10.1111/jocn.15206 · Cited by 26
Simmonds‐Buckley, M., Bennion, M. R., Kellett, S., Millings, A., Hardy, G. E., & Moore, R. K. (2020) · Journal of Medical Internet Research · doi:10.2196/17049 · Cited by 26
“As randomized controlled trials (RCTs) are viewed as the gold standard evaluation [15], we sought to only use RCT studies to increase the quality of the meta-analysis.”
Skeen, S. J., Cain, D. N., Gamarel, K. E., Hightow‐Weidman, L., & Reback, C. J. (2021) · mHealth · doi:10.21037/mhealth-20-60 · Cited by 22
“These platforms, through government funding and accountability structures, and the involvement of university-affiliated investigators, require “gold-standard” evidence of their efficacy and effectiveness via longitudinal and resource-intensive trials (105).”
BackgroundEditors’ Introduction: Controversies around RCT in Development
Bédécarrats, F., Guérin, I., & Roubaud, F. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780198865360.003.0001 · Cited by 22
The Rhetorical Superiority of Poor Economics
Labrousse, A. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780198865360.003.0010 · Cited by 21
More Than One Way to Measure? A Casuistic Approach to Cancer Clinical Trials
Andreoletti, M. (2018) · Perspectives in biology and medicine · doi:10.1353/pbm.2018.0035 · Cited by 21
Young, I. M., Taylor, H. M., Nicholas, P. J., Mackenzie, A., Tanglay, O., Dadario, N. B., Osipowicz, K. Z., Davis, E., Doyen, S., Teo, C., et al. (2023) · Brain and Behavior · doi:10.1002/brb3.2914 · Cited by 22
“This remains the gold standard for validating a clinical hypothesis, there are some limitations to such an approach, notably that it is slow, resource-intensive, and inflexibly ties researchers to an a priori hypothesis (Bothwell et al., 2016).”
BackgroundDogs for Life: Beagles, Drugs, and Capital in the Twentieth Century
Bolman, B. (2021) · Journal of the History of Biology · doi:10.1007/s10739-021-09649-2 · Cited by 21
Randomized controlled trials and evidence-based policy: A multidisciplinary dialogue
Mowat, R., Subramanian, S. V., & Kawachi, I. I. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.05.003 · Cited by 21
Khan, K. S., Fawzy, M., & Chien, P. F. W. (2023) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.14837 · Cited by 20
Social and Scientific History of Randomized Controlled Trials
Bothwell, L. E., Kuo, W.-H., Jones, D. S., & Podolsky, S. H. (2020) · Springer eBooks · doi:10.1007/978-3-319-52677-5_196-1 · Cited by 21
Self-citationRandomized controlled trials—a critical re-appraisal
Mielke, D., & Rohde, V. (2020) · Neurosurgical Review · doi:10.1007/s10143-020-01401-4 · Cited by 22
“Despite early warnings, a cooptation of RCTs for medico-political, medico-social, medico-legal, and medico-economical decision-making can be currently perceived [2, 8].”
BackgroundJaffe, K., Nosova, E., DeBeck, K., Hayashi, K., Milloy, M., & Richardson, L. (2021) · Substance Abuse · doi:10.1080/08897077.2021.1900987 · Cited by 20
“with regard to the development of pharmacological treatments.(1) In efforts to improve RCT design and implementa-”
BackgroundTriple Therapy in COPD: Time for Adaptive Selection Trials
Suissa, S. (2021) · COPD Journal of Chronic Obstructive Pulmonary Disease · doi:10.1080/15412555.2021.1982886 · Cited by 20
“The randomized controlled trial is the quintessential scientific approach to evaluate the effectiveness of medications, particularly to obtain approval from regulatory agencies [1].”
BackgroundShorey, S., Ang, E. N. K., Chua, J. Y. X., & Goh, P. S. (2021) · Nurse Education Today · doi:10.1016/j.nedt.2021.105222 · Cited by 21
Ye, J.-C., Xiong, S., Wang, T., Li, J., Cheng, N., Tian, M., & Yang, Y. (2023) · JMIR Medical Informatics · doi:10.2196/47052 · Cited by 17
“Despite their high level of evidence, RCTs are often time consuming and expensive and may be limited by strictly standardized research settings that can hinder the generalizability of their results [4].”
Scheefhals, Z. T. M., de Vries, E. F., Molenaar, J. M., Numans, M. E., & Struijs, J. N. (2023) · International Journal of Integrated Care · doi:10.5334/ijic.7012 · Cited by 22
Carmagnola, D., Pispero, A., Pellegrini, G., Sutera, S., Henin, D., Lodi, G., Achilli, A., & Dellavia, C. P. B. (2024) · Clinical Implant Dentistry and Related Research · doi:10.1111/cid.13359 · Cited by 20
Systematic review of the quantity and quality of randomized clinical trials in pancreatic surgery
Hüttner, F. J., Capdeville, L., Pianka, F., Ulrich, A. B., Hackert, T., Büchler, M. W., Probst, P., & Diener, M. K. (2018) · British journal of surgery · doi:10.1002/bjs.11030 · Cited by 20
Woodcock, J., Ware, J. H., Miller, P. W., McMurray, J. J. V., Harrington, D. P., & Drazen, J. M. (2016) · New England Journal of Medicine · doi:10.1056/nejme1601510 · Cited by 20
Are the “Randomistas” Evaluators?
Picciotto, R. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780198865360.003.0011 · Cited by 21
‘A factory of therapy’: accountability and the monitoring of psychological therapy in IAPT
Bruun, M. K. (2023) · Anthropology and Medicine · doi:10.1080/13648470.2023.2217773 · Cited by 25
“EBM has been described as a methodological framework for assessing the effectiveness of clinical practices and interventions, with the randomised controlled trial (RCT) as the hallmark of what counts as ‘evidence’ in biomedicine (Bothwell et al. 2016; Lambert 2006).”
MethodProcedural Surgical RCTs in Daily Practice: Do Surgeons Adopt Or Is It Just a Waste of Time?
Oberkofler, C. E., Hamming, J. F., Staiger, R. D., Brosi, P., Biondo, S., Farges, O., Legemate, D. A., Morino, M., Pinna, A. D., Marques, H. P., et al. (2019) · Annals of Surgery · doi:10.1097/sla.0000000000003546 · Cited by 20
Adamo, J. E., Bienvenu, R. V., Dolz, F., Liebman, M., Nilsen, W., & Steele, S. J. (2020) · Digital Biomarkers · doi:10.1159/000505289 · Cited by 19
“For most emerging digital measures (e.g., wearables and smartphone sensors for ultrasound, continuous glucose monitoring), there is currently no gold standard (or legacy standard) for these digital health methods to validate against [27, 28].”
BackgroundInnovative highlights of clinical drug trial design
Chen, D., & Qi, E. Y. (2020) · Translational research · doi:10.1016/j.trsl.2020.05.007 · Cited by 22
“While phase I study is to define the tolerability, pharmacokinetics and adverse effects, subsequently phase II and then III studies are to examine the therapeutic efficacy in exploratory and confirmatory manners respectively.(1,2) Although RCTs historically played and are still playing a decisive role in evaluating ef…”
Li, Y., Liang, X., Li, H., & Chen, X. (2023) · International Immunopharmacology · doi:10.1016/j.intimp.2022.109657 · Cited by 20
Association between gut microbiota and seven gastrointestinal diseases: A Mendelian randomized study
Zhu, S. J., & Ding, Z. (2023) · The Journal of Gene Medicine · doi:10.1002/jgm.3623 · Cited by 19
“17,18 Mendelian randomization (MR) research, on the other hand, makes every effort to overcome these constraints.”
BackgroundKýr, M., Svobodník, A., Štěpánová, R., & Hejnová, R. (2021) · Cancers · doi:10.3390/cancers13215428 · Cited by 21
“One of the most important sources of evidence are population-based randomized clinical trials (RCTs) [5,6].”
BackgroundBrowne, P. D., Bolte, A. C., Claassen, E., & de Weerth, C. (2019) · Trials · doi:10.1186/s13063-019-3389-1 · Cited by 18
Schloss, J. M., McIntyre, E., Steel, A., Bradley, R. D., Harnett, J., Reid, R., Hawrelak, J. A., Goldenberg, J. Z., Venter, C. V. D., & Cooley, K. (2019) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2018.0403 · Cited by 19
“Commentators and critics of complementary approaches to health care repeatedly call for quality evidence that is drawn from research that employs randomized controlled trial (RCT) research designs.(3) This poses several methodological challenges for whole-system interventions such as naturopathy, general practice medi…”
BackgroundFirst-in-Human Clinical Trials — What We Can Learn from Tragic Failures
Bonini, S., & Rasi, G. (2016) · New England Journal of Medicine · doi:10.1056/nejme1609006 · Cited by 17
Jeuland, M., Orgill‐Meyer, J., Morgan, S., Hudner, D., Pucilowski, M., Wyatt, A., Shafei, M., Cajka, J., & Albert, J. (2023) · Water Resources Research · doi:10.1029/2022wr033897 · Cited by 17
Franklin, M. K., Lomas, J. R. S., & Richardson, G. A. (2020) · PharmacoEconomics · doi:10.1007/s40273-020-00907-5 · Cited by 17
“Randomisation to treatment groups is preferred as the process reduces chance and bias in resulting study estimates, but RCTs themselves have limitations [13, 14].”
BackgroundLiu, J., & Li, D. M. (2024) · Asian Journal of Criminology · doi:10.1007/s11417-024-09429-x · Cited by 23
“Historically, RCTs have been heralded as the “gold standard” in clinical trials, their design meticulously calibrated to minimize biases and errors, thereby proffering robust empirical evidence even when the intervention remains a “black box” (Bothwell et al., 2016; Torgerson et al., 2015).”
Zhang, Y., Kreif, N., Gc, V. S., & Manca, A. (2024) · Medical Decision Making · doi:10.1177/0272989x241263356 · Cited by 19
Mustafa, F. A. (2017) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12699 · Cited by 22
Open-Angle Glaucoma: Drug Development Pipeline during the Last 20 Years (1995-2015)
Vicente, A., Prud'homme, S., Ferreira, J., Pinto, L. A., & Stalmans, I. (2017) · Ophthalmic Research · doi:10.1159/000453527 · Cited by 17
Utilizing Datasets to Advance Perinatal Research
Phillippi, J. C., Neal, J. L., Carlson, N. S., Biel, F. M., Snowden, J. M., & Tilden, E. L. (2017) · Journal of Midwifery & Women s Health · doi:10.1111/jmwh.12640 · Cited by 17
Quality of surgical randomized controlled trials in hand surgery: a systematic review
Long, C., desJardins-Park, H. E., Popat, R. A., & Fox, P. M. (2018) · Journal of Hand Surgery (European Volume) · doi:10.1177/1753193418780184 · Cited by 17
“As the now well-established paradigm of evidencebased medicine (EBM) took hold in recent decades (Evidence-Based Medicine Working Group, 1992), randomized controlled trials (RCTs) rose to become the gold standard of evidence in clinical research and medical knowledge (Bothwell et al., 2016).”
BackgroundSugg, H. V. R., Richards, D. A., & Frost, J. (2016) · Trials · doi:10.1186/s13063-016-1279-3 · Cited by 18
das Nair, R., de Groot, V., & Freeman, J. A. (2019) · Multiple Sclerosis Journal · doi:10.1177/1352458519858271 · Cited by 18
Clinical research tools in pediatric oncology: challenges and opportunities
de Rojas, T., Neven, A., Towbin, A. J., Carceller, F., Bautista, F. J., Riedl, D., Sodergren, S. C., Darlington, A., Fernández‐Teijeiro, A., & Moreno, L. (2020) · Cancer and Metastasis Reviews · doi:10.1007/s10555-020-09856-z · Cited by 18
Schneider, J., Hoang, L., Kansara, Y., Cohen, A. M., & Smalheiser, N. R. (2022) · JAMIA Open · doi:10.1093/jamiaopen/ooac015 · Cited by 18
Metadata
- Authors
- Bothwell, L. E., Greene, J. A., Podolsky, S. H., & Jones, D. S.
- Affiliations
- Brigham and Women's Hospital (US)
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2016-06-02
- Volume
- 374
- Issue
- 22
- Pages
- 2175-2181
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2413861456
- Cited by
- 664
- References
- 54
- Citations by year
- 2026: 40 · 2025: 101 · 2024: 59 · 2023: 53 · 2022: 49 · 2021: 76 · 2020: 93 · 2019: 71 · 2018: 74 · 2017: 43 · 2016: 5
- FWCI
- 337.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › History of Science and Medicine
- Health Sciences › Medicine › Pharmacology (medical) › Historical Medical Research and Treatments
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Keywords
- randomized controlled trials, history of medicine, evidence-based medicine, scientific knowledge production, medical politics, health research funding
- MeSH terms
- Drug Industry, Female, Humans, Legislation, Drug, Pregnancy, Randomized Controlled Trials as Topic, Drug Approval, History, 20th Century, History, 21st Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.