The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Some Thoughts on Clinical Trials, Especially Problems of Multiplicity
Abstract
Problems of statistical and conceptual design of experiments are exacerbated by ethical issues in many, if not most, clinical trials. Statutory requirements of demonstrated effectiveness are far from being clearly resolved—either qualitatively or quantitatively. Ethics, bolstered by informed consent, are likely to keep us from ever learning the answer to many questions. Unbalanced boundaries, focusing-down designs, historical controls, and not-very-sequential designs are among the possible consequences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Peto, R., Pike, M. C., Armitage, P., Breslow, N. E., Cox, D. R., Howard, S. V., Mantel, N., McPherson, K., Peto, J., & Smith, P. G. (1977) · British Journal of Cancer · doi:10.1038/bjc.1977.1 · Cited by 8,285
Peto, R., Pike, M. C., Armitage, P., Breslow, N. E., Cox, D. R., Howard, S. V., Mantel, N., McPherson, K., Peto, J., & Smith, P. G. (1976) · British Journal of Cancer · doi:10.1038/bjc.1976.220 · Cited by 2,294
Repeated Significance Tests on Accumulating Data
Armitage, P., McPherson, C. K., & Rowe, B. C. (1969) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2343787 · Cited by 761
Randomized Clinical Trials: Perspectives on Some Recent Ideas
Byar, D. P., Simon, R. M., Friedewald, W. T., Schlesselman, J. J., DeMets, D. L., Ellenberg, J. H., Gail, M. H., & Ware, J. H. (1976) · New England Journal of Medicine · doi:10.1056/nejm197607082950204 · Cited by 537
Improvement by Means of Selection
Cochran, W. G. (1951) · Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability · doi:10.1525/9780520411586-034 · Cited by 269
Statistics and Ethics in Surgery and Anesthesia
Gilbert, J., McPeek, B., & Mosteller, F. C. (1977) · Science · doi:10.1126/science.333585 · Cited by 152
Repeated Significance Tests on Accumulating Data when the Null Hypothesis is not True
McPherson, C. K., & Armitage, P. (1971) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2343971 · Cited by 88
Research works printed but not linked: 3
- Tukey J. W. presented at the Birnbaum Memorial Symposium 27 May (1977).
- POCOCK, S.J., RSS NEWS & NOTES 3 9: 5 (1977).
- ROBBINS, H, SEQUENTIAL TEST FOR 2 BINOMIAL POPULATIONS, PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA 71: 4435 (1974).
Cited by
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
What's wrong with Bonferroni adjustments
Perneger, T. V. (1998) · BMJ · doi:10.1136/bmj.316.7139.1236 · Cited by 5,900
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
On the adaptive control of the false discovery rate in multiple testing with independent statistics
Benjamini, Y., & Hochberg, Y. (2000) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986025001060 · Cited by 2,015
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858
Bayesian Approaches to Clinical Trials and Health‐Care Evaluation
Spiegelhalter, D. J., Abrams, K. R., & Myles, J. P. (2003) · Wiley eBooks · doi:10.1002/0470092602 · Cited by 1,673
Do multiple outcome measures require p-value adjustment?
Feise, R. J. (2002) · BMC Medical Research Methodology · doi:10.1186/1471-2288-2-8 · Cited by 1,299
National Cooperative Crohn's Disease Study: Results of drug treatment
Summers, R. W., Switz, D. M., Sessions, J. T., Becktel, J. M., Best, W. R., Kern, F., & Singleton, J. W. (1979) · Gastroenterology · doi:10.1016/0016-5085(79)90385-8 · Cited by 1,239
Multiple comparisons: philosophies and illustrations
Curran-Everett, D. (2000) · American Journal of Physiology-Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.2000.279.1.r1 · Cited by 743
Statistical aspects of prognostic factor studies in oncology
Simon, R., & Altman, D. (1994) · British Journal of Cancer · doi:10.1038/bjc.1994.192 · Cited by 582
Loricrin and involucrin expression is down-regulated by Th2 cytokines through STAT-6
Kim, B. E., Leung, D. Y. M., Boguniewicz, M., & Howell, M. D. (2008) · Clinical Immunology · doi:10.1016/j.clim.2007.11.006 · Cited by 538
Buchwald, D., Cheney, P. R., Peterson, D. L., Henry, B., Wormsley, S. B., Geiger, A., Ablashi, D. V., Salahuddin, S. Z., Saxinger, C., Biddle, R., et al. (1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-2-103 · Cited by 384
Controlled treatment trials in the irritable bowel syndrome: A critique
Klein, K. B. (1988) · Gastroenterology · doi:10.1016/0016-5085(88)90319-8 · Cited by 383
Winkelmann, B. R., März, W., Boehm, B. O., Zotz, R., Hager, J., Hellstern, P., & Senges, J. (2001) · Pharmacogenomics · doi:10.1517/14622416.2.1.s1 · Cited by 368
Bayesian methods in health technology assessment: a review.
Spiegelhalter, Myles, Jones, & Abrams (2000) · Health Technology Assessment · doi:10.3310/hta4380 · Cited by 358
Gøtzsche, P. C. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90017-2 · Cited by 339
Exacerbated Innate Host Response to SARS-CoV in Aged Non-Human Primates
Smits, S. L., de Lang, A., van den Brand, J. M. A., Leijten, L. M., van IJcken, W. F., Eijkemans, M. J. C., van Amerongen, G., Kuiken, T., Andeweg, A. C., Osterhaus, A. D. M. E., et al. (2010) · PLoS Pathogens · doi:10.1371/journal.ppat.1000756 · Cited by 335
Why There's No Cause to Randomize
Worrall, J. (2007) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axm024 · Cited by 307
What Evidence in Evidence-Based Medicine?
Worrall, J. (2002) · Philosophy of Science · doi:10.1086/341855 · Cited by 305
Methodological challenges in the evaluation of prognostic factors in breast cancer.
Altman, D. G., & Lyman, G. H. (1998) · Breast Cancer Research and Treatment · doi:10.1023/a:1006193704132 · Cited by 271
Olson, P. A., Tkatch, T., Hernandez-Lopez, S., Ulrich, S., Ilijic, E., Mugnaini, E., Zhang, H., Bezprozvanny, I., & Surmeier, D. J. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3327-04.2005 · Cited by 269
Komaroff, A. L., Fagioli, L. R., Doolittle, T. H., Gandek, B., Gleit, M. A., Guerriero, R. T., Kornish, R. J., Ware, N. C., Ware, J. E., & Bates, D. W. (1996) · The American Journal of Medicine · doi:10.1016/s0002-9343(96)00174-x · Cited by 254
Sixty Plus Reinfarction Study Research Group (1980) · The Lancet · doi:10.1016/s0140-6736(80)92154-6 · Cited by 254
Jiang, W., Freidlin, B., & Simon, R. (2007) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djm022 · Cited by 253
Th2 Cytokines Act on S100/A11 to Downregulate Keratinocyte Differentiation
Howell, M. D., Fairchild, H. R., Kim, B. E., Bin, L., Boguniewicz, M., Redzic, J. S., Hansen, K. C., & Leung, D. Y. M. (2008) · Journal of Investigative Dermatology · doi:10.1038/jid.2008.74 · Cited by 224
CONSORT 2025 explanation and elaboration: updated guideline for reporting randomised trials
Hopewell, S., Chan, A.-W., Collins, G. S., Hróbjartsson, A., Moher, D., Schulz, K. F., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081124 · Cited by 205
Patterns of and Risk Factors for Recurrence in Women With Ovarian Endometriomas
Liu, X., Yuan, L., Shen, F., Zhu, Z., Jiang, H., & Guo, S.-W. (2007) · Obstetrics & Gynecology · doi:10.1097/01.aog.0000265215.87717.8b · Cited by 146
Current Research and Statistical Practices in Sport Science and a Need for Change
Bernards, J., Sato, K., Haff, G., & Bazyler, C. (2017) · Sports · doi:10.3390/sports5040087 · Cited by 120
Sargeant, J. M., O’connor, A. M., Gardner, I. A., Dickson, J. S., Torrence, M. E., Dohoo, C. M. P. I. R., Lefebvre, S. L., Morley, P. S., Ramirez, A., & Snedeker, K. (2010) · Journal of Food Protection · doi:10.4315/0362-028x-73.3.579 · Cited by 97
Allen, H. F., Mazzoni, C., Heptulla, R. A., Murray, M. A., Miller, N., Koenigs, L., & Reiter, E. O. (2005) · Journal of Pediatric Endocrinology and Metabolism · doi:10.1515/jpem.2005.18.8.761 · Cited by 90
Kwong, K. S., Holland, B., & Cheung, S. H. (2002) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(01)00252-x · Cited by 54
Chiu, K. C., Go, R. C. P., Aoki, M., Riggs, A. C., Tanizawa, Y., Acton, R. T., Bell, D. S. H., Goldenberg, R. L., Roseman, J. M., & Permutt, M. A. (1994) · Diabetologia · doi:10.1007/bf00428785 · Cited by 49
“The raw data (before Bonferroni correction [22] for multiple comparisons) were presented and the p values were no longer significant after adjustment for multiple comparisons.”
MethodZhang, X., Kim, B., Singh, A., Sankararaman, S., Durvasula, A., & Lohmueller, K. E. (2023) · Molecular Biology and Evolution · doi:10.1093/molbev/msad001 · Cited by 29
Breitwieser, J., & Brod, G. (2021) · Child Development · doi:10.1111/cdev.13393 · Cited by 35
Neglect of Multiplicity When Testing Families of Related Hypotheses*
Holland, B., fang, S. W., & Basu, S. (2009) · doi:10.2139/ssrn.1466343 · Cited by 13
Metadata
- Authors
- Tukey, J. W.
- Venue
- Science
- Published
- 1977-11-18
- Volume
- 198
- Issue
- 4318
- Pages
- 679-684
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2026250491
- Cited by
- 479
- References
- 7
- FWCI
- 24.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.