The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
The Randomized Controlled Trial: gold standard, or merely standard?
Abstract
The randomized controlled trial (RCT) is not a gold standard: it is a good experimental design in some circumstances, but that's all. Potential shortcomings in the design and implementation of RCTs are often mentioned in passing, yet most researchers consider that RCTs are always superior to all other types of evidence. This paper examines the limitations of RCTs and shows that some types of evidence commonly supposed to be inferior to all RCTs are actually superior to many. This has important consequences for research methodology, for quality of care in clinical medicine, and—especially—for research funding policy. Because every study design may have problems in particular applications, studies should be evaluated by appropriate criteria, and not primarily according to the simplistic RCT/non-RCT dichotomy promoted by some prominent advocates of the evidence-based medicine movement and by the research evaluation guidelines based on its principles.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
Grading quality of evidence and strength of recommendations
(2004) · BMJ · doi:10.1136/bmj.328.7454.1490 · Cited by 8,477
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
A new system for grading recommendations in evidence based guidelines
Harbour, R., & Miller, J. (2001) · BMJ · doi:10.1136/bmj.323.7308.334 · Cited by 1,637
Why we need observational studies to evaluate the effectiveness of health care
Black, N. (1996) · BMJ · doi:10.1136/bmj.312.7040.1215 · Cited by 1,598
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Changing Order: Replication and Induction in Scientific Practice
Star, S. L., & Collins, H. M. (1988) · Technology and Culture · doi:10.2307/3105095 · Cited by 1,280
Evidence based medicine: an approach to clinical problem-solving
Rosenberg, W., & Donald, A. (1995) · BMJ · doi:10.1136/bmj.310.6987.1122 · Cited by 1,204
Criteria for evaluating evidence on public health interventions
Rychetnik, L., Frommer, M., Hawe, P., & Shiell, A. (2002) · Journal of Epidemiology and Community Health · doi:10.1136/jech.56.2.119 · Cited by 1,042
A consumer's guide to subgroup analyses
Oxman, A. D., & Guyatt, G. H. (1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-1-78 · Cited by 914
Kunz, R., & Oxman, A. D. (1998) · BMJ · doi:10.1136/bmj.317.7167.1185 · Cited by 770
Guyatt, G. H., Haynes, R. B., Jaeschke, R. Z., Cook, D. J., Green, L., Naylor, C. D., Wilson, M. C., Richardson, W. S., & for the Evidence-Based Medicine Working Group (2000) · JAMA · doi:10.1001/jama.284.10.1290 · Cited by 748
Problems in the “Evidence” of “Evidence-Based Medicine”
Feinstein, A. R., & Horwitz, R. I. (1997) · The American Journal of Medicine · doi:10.1016/s0002-9343(97)00244-1 · Cited by 653
Evidence-based healthcare: how to make health policy and management decisions
(1999) · Journal of Vascular Surgery · doi:10.1016/s0741-5214(99)70404-0 · Cited by 608
Randomized Trials or Observational Tribulations?
Pocock, S. J., & Elbourne, D. R. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422511 · Cited by 550
Evidence, hierarchies, and typologies: horses for courses: Table 1
Petticrew, M., & Roberts, H. (2003) · Journal of Epidemiology and Community Health · doi:10.1136/jech.57.7.527 · Cited by 539
Statistical Decision Theory and Related Topics V
(1994) · Springer eBooks · doi:10.1007/978-1-4612-2618-5 · Cited by 507
Guide to Clinical Preventive Services: Report of the U S Preventive Services Task Force
U.S. Preventive Services Task Force (1996) · Medical Entomology and Zoology · Cited by 446
How to use the evidence: assessment and application of scientific evidence
Glasziou, P., Irwig, L., Bain, C., & Colditz, G. A. (2000) · Cited by 395
Assessing the quality of research.
Glasziou, P., Vandenbroucke, J., & Chalmers, I. (2004) · BMJ · doi:10.1136/bmj.328.7430.39 · Cited by 391
Sackett, D. L., & Wennberg, J. E. (1997) · BMJ · doi:10.1136/bmj.315.7123.1636 · Cited by 368
Scientific Reasoning: The Bayesian Approach.
Goldstein, M., Howson, C., & Urbach, P. (1993) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982875 · Cited by 334
What Evidence in Evidence-Based Medicine?
Worrall, J. (2002) · Philosophy of Science · doi:10.1086/341855 · Cited by 305
An Additional Basic Science for Clinical Medicine: II. The Limitations of Randomized Trials
FEINSTEIN, A. R. (1983) · Annals of Internal Medicine · doi:10.7326/0003-4819-99-4-544 · Cited by 253
Using research findings in clinical practice
Straus, S. E., & Sackett, D. L. (1998) · BMJ · doi:10.1136/bmj.317.7154.339 · Cited by 209
Why Data Bases Should Not Replace Randomized Clinical Trials
Byar, D. P. (1980) · Biometrics · doi:10.2307/2529989 · Cited by 205
A quality assessment of randomized control trials of primary treatment of breast cancer.
Liberati, A., Himel, H. N., & Chalmers, T. C. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.6.942 · Cited by 195
Randomised trials, human nature, and reporting guidelines
Schulz, K. F. (1996) · The Lancet · doi:10.1016/s0140-6736(96)01201-9 · Cited by 173
Methodologic standards and contradictory results in case-control research
Horwitz, R. I., & Feinstein, A. R. (1979) · The American Journal of Medicine · doi:10.1016/0002-9343(79)91164-1 · Cited by 153
Experimentation and social interventions: a forgotten but important history
Oakley, A. (1998) · BMJ · doi:10.1136/bmj.317.7167.1239 · Cited by 150
Phillips, A. N., Grabar, S., Tassie, J.-M., Costagliola, D. G., Lundgren, J. D., & Egger, M. (1999) · AIDS · doi:10.1097/00002030-199910220-00010 · Cited by 140
Abel, U. R., & Koch, A. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00041-4 · Cited by 133
Levin, J. S., Glass, T. A., Kushi, L. H., Schuck, J. R., Steele, L., & Jonas, W. B. (1997) · Medical Care · doi:10.1097/00005650-199711000-00001 · Cited by 115
Method for evaluating research and guideline evidence
Liddle, J. (1997) · New South Wales Public Health Bulletin · doi:10.1071/nb97004 · Cited by 115
Burgess, S. (2003) · Australasian Journal of Paramedicine · doi:10.33151/ajp.1.3.194 · Cited by 104
Evaluating the health effects of social interventions
Thomson, H., Hoskins, R., Petticrew, M. P., Craig, N. J., Quinn, T., Lindsay, G., & Ogilvie, D. (2004) · BMJ · doi:10.1136/bmj.328.7434.282 · Cited by 103
Measuring effectiveness. What to expect without a randomized control group.
D’Agostino, R. B., & Russell, H. K. (1995) · PubMed · Cited by 100
Sheldon, T., Guyatt, G. H., & Haines, A. (1998) · BMJ · doi:10.1136/bmj.317.7151.139 · Cited by 96
Beware of Surrogate Outcome Measures
Gøtzsche, P. C., Liberati, A., Torri, V., & Rossetti, L. M. (1996) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300009594 · Cited by 90
New Perspectives on Socioeconomic Inequalities in Health
Mackenbach, J. P., & Howden‐Chapman, P. (2003) · Perspectives in biology and medicine · doi:10.1353/pbm.2003.0039 · Cited by 72
Measuring effects without randomized trials? Options, problems, challenges.
Moses, L. E. (1995) · PubMed · Cited by 67
‘Better than numbers…’ a gentle critique of evidence‐based medicine
Little, M. (2003) · ANZ Journal of Surgery · doi:10.1046/j.1445-1433.2002.02563.x · Cited by 62
Horwitz, R. I. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90100-7 · Cited by 60
Benefits and harms of drug treatments
Vandenbroucke, J. P. (2004) · BMJ · doi:10.1136/bmj.329.7456.2 · Cited by 53
Vandenbroucke, J. P. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00025-0 · Cited by 51
Promoting evidence‐based alternative medicine
Hensley, M., & Gibson, P. G. (1998) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.1998.tb123421.x · Cited by 50
HARLOT plc: an amalgamation of the world's two oldest professions
Sackett, D. L., & Oxman, A. D. (2003) · BMJ · doi:10.1136/bmj.327.7429.1442 · Cited by 46
(1995) · Choice Reviews Online · doi:10.5860/choice.32-4849 · Cited by 37
Randomised controlled trials in psychiatry: important but poorly accepted
Andrews, G. (1999) · BMJ · doi:10.1136/bmj.319.7209.562 · Cited by 29
Randomised controlled trials in cardiovascular medicine: past achievements, future challenges
Yusuf, S. (1999) · BMJ · doi:10.1136/bmj.319.7209.564 · Cited by 28
Evidence based medicine overviews, bulletins, guidelines, and the new consensus
West, R. (2000) · Postgraduate Medical Journal · doi:10.1136/pmj.76.897.383 · Cited by 21
Research Methods for Obtaining Primary Evidence
Jaeschke, R., & Sackett, D. L. (1989) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300008436 · Cited by 20
Pharmacoeconomics of asthma treatment
Cleland, J., Thomas, M. D., & Price, D. B. (2003) · Expert Opinion on Pharmacotherapy · doi:10.1517/14656566.4.3.311 · Cited by 14
Cited by
The updated European Consensus 2009 on the use of Botulinum toxin for children with cerebral palsy
Heinen, F., Desloovere, K., Schroeder, A. S., Berweck, S., Borggraefe, I., van Campenhout, A., Andersen, G. L., Aydin, R., Becher, J. G., Bernert, G., et al. (2010) · European Journal of Paediatric Neurology · doi:10.1016/j.ejpn.2009.09.005 · Cited by 296
Millar, N., Salager-Meyer, F., & Budgell, B. (2019) · English for Specific Purposes · doi:10.1016/j.esp.2019.02.004 · Cited by 85
From Boulder to Stockholm in 70 Years: Single Case Experimental Designs in Clinical Research
Vlaeyen, J. W. S., Wicksell, R. K., Simons, L. E., Gentili, C., De, T. K., Tate, R. L., Vohra, S., Punja, S., Linton, S. J., Sniehotta, F. F., et al. (2020) · The Psychological Record · doi:10.1007/s40732-020-00402-5 · Cited by 63
Peterson, K. M., Piazza, C. C., Ibañez, V. F., & Fisher, W. W. (2019) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.650 · Cited by 48
Byrne, E. M., Jensen, H., Thomsen, B. S., & Ramchandani, P. G. (2023) · Review of Education · doi:10.1002/rev3.3400 · Cited by 43
Metadata
- Authors
- Grossman, J., & Mackenzie, F. J.
- Venue
- Perspectives in Biology and Medicine
- Publisher
- Project MUSE
- Published
- 2005-09
- Volume
- 48
- Issue
- 4
- Pages
- 516-534
- ISSN
- 0031-5982 (ISSN-L)
- 1529-8795
- OpenAlex
- W2090037258
- Cited by
- 300
- References
- 55
- FWCI
- 11.43
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.