The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Multiplicity Considerations in Clinical Trials
Abstract
Making multiple comparisons increases the likelihood that a chance association could be interpreted as causal. A number of statistical approaches can facilitate the precise interpretation of clinical trial results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When multiple comparisons are performed (eg, multiple outcomes, time points, subpopulations, interim analyses), the risk of false positives (type 1 error) is inflated.”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [412]
In the citing paper
“Trials are often affected by multiplicity issues.411 412”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [412]
In the citing paper
“Although no standardised rules exist for dealing with multiplicity, guidance is available on key problems to consider.411 412”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [412]
In the citing paper
“Although no standardised rules exist for dealing with multiplicity, guidance is available on key problems to consider.411 412”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [412]
Citations
Cites
Dahlöf, B., Devereux, R. B., Kjeldsen, S. E., Julius, S., Beevers, G., de Faire, U., Fyhrquist, F., Ibsen, H., Kristiansson, K., Lederballe-Pedersen, O., et al. (2002) · The Lancet · doi:10.1016/s0140-6736(02)08089-3 · Cited by 5,407
Enzalutamide in Metastatic Prostate Cancer before Chemotherapy
Beer, T. M., Armstrong, A. J., Rathkopf, D. E., Loriot, Y., Sternberg, C. N., Higano, C. S., Iversen, P., Bhattacharya, S., Carles, J., Chowdhury, S., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1405095 · Cited by 3,028
Abiraterone in Metastatic Prostate Cancer without Previous Chemotherapy
Ryan, C. J., Smith, M. R., de Bono, J. S., Molina, A., Logothetis, C. J., de Souza, P., Fizazi, K., Mainwaring, P., Piulats, J. M., Ng, S., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1209096 · Cited by 2,796
Cappuzzo, F., Marchetti, A., Skokan, M. C., Rossi, E., Gajapathy, S., Felicioni, L., Grammastro, M. D., Sciarrotta, M., Buttitta, F., Incarbone, M., et al. (2009) · Journal of Clinical Oncology · doi:10.1200/jco.2008.19.1635 · Cited by 563
Extended Thromboprophylaxis with Betrixaban in Acutely Ill Medical Patients
Cohen, A. T., Harrington, R. A., Goldhaber, S. Z., Hull, R. D., Wiens, B. L., Gold, A., Hernandez, A. F., & Gibson, C. M. (2016) · New England Journal of Medicine · doi:10.1056/nejmoa1601747 · Cited by 439
Combining Multiple Comparisons and Modeling Techniques in Dose‐Response Studies
Bretz, F., Pinheiro, J. C., & Branson, M. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00344.x · Cited by 399
Tutorial in biostatistics: data‐driven subgroup identification and analysis in clinical trials
Lipkovich, I., Dmitrienko, A., & B., R. (2017) · Statistics in Medicine · doi:10.1002/sim.7064 · Cited by 291
Self-citationMultiple Testing Problems in Pharmaceutical Statistics
(2009) · Chapman & Hall/CRC eBooks · doi:10.1201/9781584889854 · Cited by 274
Meltzer, H. Y., Cucchiaro, J. B., Silva, R., Ogasa, M., Phillips, D., Xu, J., Kalali, A. H., Schweizer, E. E., Pikalov, A., & Loebel, A. D. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10060907 · Cited by 251
Multiple testing in clinical trials
Bauer, P. (1991) · Statistics in Medicine · doi:10.1002/sim.4780100609 · Cited by 241
Traditional multiplicity adjustment methods in clinical trials
Dmitrienko, A. A., & D’Agostino, R. B. (2013) · Statistics in Medicine · doi:10.1002/sim.5990 · Cited by 153
Self-citationNasrallah, H. A., Silva, R., Phillips, D., Cucchiaro, J. B., Hsu, J., Xu, J., & Loebel, A. D. (2013) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2013.01.020 · Cited by 146
Use of the false discovery rate for evaluating clinical safety data
Mehrotra, D. V., & Heyse, J. F. (2004) · Statistical Methods in Medical Research · doi:10.1191/0962280204sm363ra · Cited by 126
Offen, W., Chuang‐Stein, C., Dmitrienko, A. A., Littman, G. S., Maca, J., Meyerson, L., Muirhead, R. J., Stryszak, P., Baddy, A., Chen, K., et al. (2007) · Drug Information Journal · doi:10.1177/009286150704100105 · Cited by 122
Self-citationMethods correcting for multiple testing: operating characteristics
Brown, B. W., & Russell, K. E. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19971130)16:22 · Cited by 118
Key multiplicity issues in clinical drug development
Dmitrienko, A. A., D’Agostino, R. B., & Huque, M. F. (2012) · Statistics in Medicine · doi:10.1002/sim.5642 · Cited by 96
Self-citationUse of composite endpoints in clinical trials
Sankoh, A. J., Li, H., & D’Agostino, R. B. (2014) · Statistics in Medicine · doi:10.1002/sim.6205 · Cited by 74
Self-citationMixtures of multiple testing procedures for gatekeeping applications in clinical trials
Dmitrienko, A. A., & Tamhane, A. C. (2011) · Statistics in Medicine · doi:10.1002/sim.4008 · Cited by 61
Self-citationAddressing Multiplicity Issues of a Composite Endpoint and Its Components in Clinical Trials
Huque, M. F., Alosh, M., & Bhore, R. (2011) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2011.551327 · Cited by 48
Multiple comparisons in over‐the‐ounter drug clinical trials with both positive and placebo controls
D’Agostino, R. B., & Heeren, T. (1991) · Statistics in Medicine · doi:10.1002/sim.4780100102 · Cited by 46
Self-citationMinimum risk weights for comparing treatments in stratified binomial trials
Mehrotra, D. V., & Railkar, R. A. (2000) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(20000330)19:6 · Cited by 44
Millen, B. A., Dmitrienko, A. A., Ruberg, S. J., & Shen, L. (2012) · Drug Information Journal · doi:10.1177/0092861512454116 · Cited by 41
Self-citationA Mixture Gatekeeping Procedure Based on the Hommel Test for Clinical Trial Applications
Brechenmacher, T., Xu, J., Dmitrienko, A. A., & Tamhane, A. C. (2011) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2011.551334 · Cited by 33
Self-citationGeneral theory of mixture procedures for gatekeeping
Dmitrienko, A. A., & Tamhane, A. C. (2013) · Biometrical Journal · doi:10.1002/bimj.201100258 · Cited by 30
Self-citationStrategies for Dealing with Multiple Treatment Comparisons in Confirmatory Clinical Trials
D’Agostino, R. B., Massaro, J. M., Russell, H. K., & Cabral, H. (1993) · Drug Information Journal · doi:10.1177/009286159302700307 · Cited by 24
Self-citationMultiplicity Issues in Clinical Trials With Multiple Objectives
Huque, M. F., Dmitrienko, A. A., & D’Agostino, R. B. (2013) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2013.807749 · Cited by 24
Self-citationDmitrienko, A. A., Bretz, F., Westfall, P. H., Troendle, J. F., Wiens, B. L., Tamhane, A. C., & Hsu, J. (2009) · Chapman & Hall/CRC biostatistics series · doi:10.1201/9781584889854-c2 · Cited by 23
Self-citationGatekeeping Procedures in Clinical Trials
Dmitrienko, A. A., & Tamhane, A. C. (2009) · Chapman & Hall/CRC biostatistics series · doi:10.1201/9781584889854-c5 · Cited by 14
Self-citationClinical Trial Optimization Using R
(2017) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315120836 · Cited by 12
Discussion of “Some Controversial Multiple Testing Problems in Regulatory Applications”
Chuang‐Stein, C., Dmitrienko, A. A., & Offen, W. (2009) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400802541719 · Cited by 10
Self-citation
Cited by
Sorted by citations
First-line atezolizumab plus chemotherapy in extensive-stage small-cell lung cancer
Horn, L., Mansfield, A. S., Szczęsna, A., Havel, L., Krzakowski, M., Hochmair, M. J., Huemer, F., Losonczy, G., Johnson, M. L., Nishio, M., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1809064 · Cited by 3,586
Hernandez, A. F., Green, J. B., Janmohamed, S., D'Agostino, R. B., Granger, C. B., Jones, N. P., Leiter, L. A., Rosenberg, A. E., Sigmon, K. N., Somerville, M. C., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32261-x · Cited by 1,829
Self-citationOverall Survival with Palbociclib and Fulvestrant in Advanced Breast Cancer
Turner, N. C., Slamon, D. J., Ro, J., Bondarenko, I., Im, S.-A., Masuda, N., Colleoni, M., DeMichele, A., Loi, S., Verma, S., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1810527 · Cited by 1,276
Overall survival with ribociclib plus endocrine therapy in breast cancer
Im, S.-A., Lu, Y.-S., Bardia, A., Harbeck, N., Colleoni, M., Franke, F., Chow, L., Sohn, J., Lee, K.-S., Campos-Gomez, S., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1903765 · Cited by 1,001
Eculizumab in Aquaporin-4–Positive Neuromyelitis Optica Spectrum Disorder
Pittock, S. J., Berthele, A., Fujihara, K., Kim, H. J., Levy, M., Palace, J. A., Nakashima, I., Terzi, M., Totolyan, N. A., Viswanathan, S., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1900866 · Cited by 887
Metadata
- Authors
- Dmitrienko, A., & D’Agostino, R. B.
- Affiliations
- Boston University (US)
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2018-05-31
- Volume
- 378
- Issue
- 22
- Pages
- 2115-2122
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2806596191
- Cited by
- 140
- References
- 30
- Citations by year
- 2026: 14 · 2025: 18 · 2024: 16 · 2023: 6 · 2022: 22 · 2021: 22 · 2020: 19 · 2019: 16 · 2018: 7
- FWCI
- 2.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- multiplicity, multiple comparisons, clinical trials, statistical significance, false positives, causal inference
- MeSH terms
- Data Interpretation, Statistical, Humans, Research Design, Statistics as Topic, Causality, Clinical Trials, Phase III as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
