The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
The Continuing Unethical Conduct of Underpowered Clinical Trials
Abstract
Despite long-standing critiques of the conduct of underpowered clinical trials, the practice not only remains widespread, but also has garnered increasing support. Patients and healthy volunteers continue to participate in research that may be of limited clinical value, and authors recently have offered 2 related arguments to support the validity and value of underpowered clinical trials: that meta-analysis may "save" small studies by providing a means to combine the results with those of other similar studies to enable estimates of an intervention's efficacy, and that although small studies may not provide a good basis for testing hypotheses, they may provide valuable estimates of treatment effects using confidence intervals. In this article, we examine these arguments in light of the distinctive moral issues associated with the conduct of underpowered trials, the disclosures that are owed to potential participants in underpowered trials so they may make autonomous enrollment decisions, and the circumstances in which the prospects for future meta-analyses may justify individually underpowered trials. We conclude that underpowered trials are ethical in only 2 situations: small trials of interventions for rare diseases in which investigators document explicit plans for including their results with those of similar trials in a prospective meta-analysis, and early-phase trials in the development of drugs or devices, provided they are adequately powered for defined purposes other than randomized treatment comparisons. In both cases, investigators must inform prospective subjects that their participation may only indirectly contribute to future health care benefits.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
What Makes Clinical Research Ethical?
Emanuel, E. J. (2000) · JAMA · doi:10.1001/jama.283.20.2701 · Cited by 2,710
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
meta-analysis bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374
Defining the clinically important difference in pain outcome measures
Farrar, J. T., Portenoy, R. K., Berlin, J. A., Kinman, J. L., & Strom, B. L. (2000) · Pain · doi:10.1016/s0304-3959(00)00339-0 · Cited by 1,071
The scandal of poor medical research.
Altman, D. G. (1994) · BMJ · doi:10.1136/bmj.308.6924.283 · Cited by 897
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
A Comparison of Methotrexate with Placebo for the Maintenance of Remission in Crohn's Disease
Feagan, B. G., Fedorak, R. N., Irvine, E. J., Wild, G., Sutherland, L., Steinhart, A. H., Greenberg, G. R., Koval, J., Wong, C. J., Hopkins, M., et al. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006013422202 · Cited by 727
Statistical Problems in the Reporting of Clinical Trials
Pocock, S. J., Hughes, M. D., & Lee, R. J. (1987) · New England Journal of Medicine · doi:10.1056/nejm198708133170706 · Cited by 662
Goodman, S. N., & Berlin, J. A. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-3-199408010-00008 · Cited by 654
Statistical Power, Sample Size, and Their Reporting in Randomized Controlled Trials
Moher, D. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520020048013 · Cited by 608
Statistics and ethics in medical research: III How large a sample?
Altman, D. G. (1980) · BMJ · doi:10.1136/bmj.281.6251.1336 · Cited by 580
Are randomized clinical trials good for us (in the short term)? Evidence for a “trial effect”
Braunholtz, D. A., Edwards, S. J. L., & Lilford, R. J. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00305-x · Cited by 539
Reporting on Methods in Clinical Trials
DerSimonian, R., Charette, L. J., McPeek, B., & Mosteller, F. (1982) · New England Journal of Medicine · doi:10.1056/nejm198206033062204 · Cited by 499
Taylor, K. M., Margolese, R. G., & Soskolne, C. L. (1984) · New England Journal of Medicine · doi:10.1056/nejm198405243102106 · Cited by 407
The Promise and Problems of Meta-Analysis
Bailar, J. C. (1997) · New England Journal of Medicine · doi:10.1056/nejm199708213370810 · Cited by 402
Attitudes Toward Clinical Trials Among Patients and the Public
Cassileth, B. R. (1982) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1982.03330080050028 · Cited by 274
Recruitment experience in clinical trials: Literature summary and annotated bibliography
Hunninghake, D. B., Darby, C. A., & Probstfield, J. L. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90004-3 · Cited by 251
Scientific Value and Validity as Ethical Requirements for Research: A Proposed Explication
Freedman, B. (1987) · IRB Ethics and Human Research · doi:10.2307/3563623 · Cited by 177
Participation in a clinical trial: The patients' point of view
Mattson, M. E., Curb, J. D., & McArdle, R. (1985) · Controlled Clinical Trials · doi:10.1016/0197-2456(85)90121-7 · Cited by 168
Size and quality of randomised controlled trials in head injury: review of published studies
Dickinson, K. (2000) · BMJ · doi:10.1136/bmj.320.7245.1308 · Cited by 147
Koblin, B. A., Heagerty, P. J., Sheon, A. R., Buchbinder, S., Celum, C., Douglas, J. M., Gross, M., Marmor, M. F., Mayer, K. H., Metzger, D. S., et al. (1998) · AIDS · doi:10.1097/00002030-199807000-00015 · Cited by 139
Meta-analytic stimulus for changes in clinical trials
Harvard, T. C., & Lau, J. (1993) · Statistical Methods in Medical Research · doi:10.1177/096228029300200204 · Cited by 115
Welton, A. J., Vickers, M. R., Cooper, J. A., Meade, T. W., & Marteau, T. M. (1999) · BMJ · doi:10.1136/bmj.318.7191.1114 · Cited by 115
A Critical Evaluation of the Methodology of the Literature on Medication Compliance
Nichol, M. B., Venturini, F., & Sung, J. (1999) · Annals of Pharmacotherapy · doi:10.1345/aph.18233 · Cited by 114
Time to register randomised trials
Horton, R., & Smith, R. W. (1999) · BMJ · doi:10.1136/bmj.319.7214.865 · Cited by 108
The Role of Meta-analysis in the Regulatory Process for Foods, Drugs, and Devices
Berlin, J. A., & Colditz, G. A. (1999) · JAMA · doi:10.1001/jama.281.9.830 · Cited by 108
What Patients Say about Medical Research
Sugarman, J., KASS, N. E., Goodman, S. N., Perentesis, P., Fernandes, P., & Faden, R. (1998) · IRB Ethics and Human Research · doi:10.2307/3564262 · Cited by 104
Why “underpowered” trials are not necessarily unethical
Edwards, S., Lilford, R. J., Braunholtz, D., & Jackson, J. E. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02290-3 · Cited by 104
Who Will Enroll? Predicting Participation in a Phase II AIDS Vaccine Trial
Halpern, S. D., Metzger, D. S., Berlin, J. A., & Ubel, P. A. (2001) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/00126334-200107010-00011 · Cited by 103
Self-citationHow do AD patients and their caregivers decide whether to enroll in a clinical trial?
Karlawish, J. H., Casarett, D., Klocinski, J., & Sankar, P. L. (2001) · Neurology · doi:10.1212/wnl.56.6.789 · Cited by 88
Knottnerus, J. A., & Bouter, L. M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00276-6 · Cited by 64
Simes, R. J., & The PPP and CTT Investigators (1995) · The American Journal of Cardiology · doi:10.1016/s0002-9149(99)80482-2 · Cited by 59
Current Concepts Review - Sample Size and Statistical Power in Clinical Orthopaedic Research*
Freedman, K. B., & Bernstein, J. M. (1999) · Journal of Bone and Joint Surgery · doi:10.2106/00004623-199910000-00011 · Cited by 53
Small clinical trials: Are they all bad?
Matthews, J. N. S. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140204 · Cited by 47
Clinical Trial Participant Satisfaction: Survey of SHEP Enrollees
SCHRON, E. B., Wassertheil-Smoller, S. W., & Pressel, S. (1997) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1997.tb02962.x · Cited by 45
Clinical trials in general surgical journals: Are methods better reported?
Schumm, L. P., Fisher, J. S., Thisted, R. A., & Olak, J. (1999) · Surgery · doi:10.1016/s0039-6060(99)70286-2 · Cited by 32
NEWELL, D. J. (1978) · BMJ · doi:10.1136/bmj.2.6154.1789 · Cited by 22
Patient recruitment and enrollment
Meinert, C. L., & Tonascia, S. (1986) · Clinical Trials · doi:10.1093/acprof:oso/9780195035681.003.0014 · Cited by 9
Cited by
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
A tutorial on pilot studies: the what, why and how
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-1 · Cited by 3,384
Sample size determination and power analysis using the G*Power software
Kang, H. (2021) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2021.18.17 · Cited by 2,572
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
Metadata
- Authors
- Halpern, S. D.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2002-07-17
- Volume
- 288
- Issue
- 3
- Pages
- 358
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2017874571
- Cited by
- 547
- References
- 39
- FWCI
- 23.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.