The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Multiplicity Considerations in Clinical Trials
Abstract
Making multiple comparisons increases the likelihood that a chance association could be interpreted as causal. A number of statistical approaches can facilitate the precise interpretation of clinical trial results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When multiple comparisons are performed (eg, multiple outcomes, time points, subpopulations, interim analyses), the risk of false positives (type 1 error) is inflated.”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [412]
In the citing paper
“Trials are often affected by multiplicity issues.411 412”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [412]
In the citing paper
“Although no standardised rules exist for dealing with multiplicity, guidance is available on key problems to consider.411 412”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [412]
In the citing paper
“Although no standardised rules exist for dealing with multiplicity, guidance is available on key problems to consider.411 412”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [412]
Citations
Cites
Dahlöf, B., Devereux, R. B., Kjeldsen, S. E., Julius, S., Beevers, G., de Faire, U., Fyhrquist, F., Ibsen, H., Kristiansson, K., Lederballe-Pedersen, O., et al. (2002) · The Lancet · doi:10.1016/s0140-6736(02)08089-3 · Cited by 5,407
Enzalutamide in Metastatic Prostate Cancer before Chemotherapy
Beer, T. M., Armstrong, A. J., Rathkopf, D. E., Loriot, Y., Sternberg, C. N., Higano, C. S., Iversen, P., Bhattacharya, S., Carles, J., Chowdhury, S., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1405095 · Cited by 3,028
Abiraterone in Metastatic Prostate Cancer without Previous Chemotherapy
Ryan, C. J., Smith, M. R., de Bono, J. S., Molina, A., Logothetis, C. J., de Souza, P., Fizazi, K., Mainwaring, P., Piulats, J. M., Ng, S., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1209096 · Cited by 2,796
Cappuzzo, F., Marchetti, A., Skokan, M. C., Rossi, E., Gajapathy, S., Felicioni, L., Grammastro, M. D., Sciarrotta, M., Buttitta, F., Incarbone, M., et al. (2009) · Journal of Clinical Oncology · doi:10.1200/jco.2008.19.1635 · Cited by 563
Extended Thromboprophylaxis with Betrixaban in Acutely Ill Medical Patients
Cohen, A. T., Harrington, R. A., Goldhaber, S. Z., Hull, R. D., Wiens, B. L., Gold, A., Hernandez, A. F., & Gibson, C. M. (2016) · New England Journal of Medicine · doi:10.1056/nejmoa1601747 · Cited by 439
Combining Multiple Comparisons and Modeling Techniques in Dose‐Response Studies
Bretz, F., Pinheiro, J. C., & Branson, M. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00344.x · Cited by 399
Tutorial in biostatistics: data‐driven subgroup identification and analysis in clinical trials
Lipkovich, I., Dmitrienko, A., & B., R. (2017) · Statistics in Medicine · doi:10.1002/sim.7064 · Cited by 291
Self-citationMultiple Testing Problems in Pharmaceutical Statistics
(2009) · Chapman & Hall/CRC eBooks · doi:10.1201/9781584889854 · Cited by 274
Meltzer, H. Y., Cucchiaro, J. B., Silva, R., Ogasa, M., Phillips, D., Xu, J., Kalali, A. H., Schweizer, E. E., Pikalov, A., & Loebel, A. D. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10060907 · Cited by 251
Multiple testing in clinical trials
Bauer, P. (1991) · Statistics in Medicine · doi:10.1002/sim.4780100609 · Cited by 241
Cited by
Sorted by citations
Items 101–139 of 139
How to find a meta-analysis you can trust
Nelson, R. L. (2019) · Techniques in Coloproctology · doi:10.1007/s10151-019-02069-9
Controlling for Multiplicity, Eligibility, and Exclusions
Salter, A. R., & Miller, J. P. (2019) · Springer eBooks · doi:10.1007/978-3-319-52677-5_210-1
Immuntherapie im Plattenepithelkarzinom des Ösophagus - ein neuer Standard?
Büttner, N., & Thimme, R. (2020) · Gastro-News · doi:10.1007/s15036-020-0270-8
Multiplicity and statistical significance
Berdine, G. G. (2020) · The Southwest Respiratory and Critical Care Chronicles · doi:10.12746/swrccc.v8i34.681
Interpreting Multiple Outcomes of Pupillary Light Reflex in Sport-Related Concussion in Adolescents
Beaulieu, W. T., & Glassman, A. R. (2020) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2020.3461
Association of Obesity with Breast Cancer
Lohmann, A. E. (2019) · TSpace (University of Toronto)
Controlling for Multiplicity, Eligibility, and Exclusions
Salter, A. R., & Miller, J. P. (2022) · Springer eBooks · doi:10.1007/978-3-319-52636-2_210
Can subgroup analyses in randomized trials guide individualized patient care?
Aronson, D. (2022) · European Journal of Heart Failure · doi:10.1002/ejhf.2710
Santos, V. P. D. A. (2023) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.23.2023.tde-26062023-101328
Pièges et mésusages en analyse de données
Supplisson, O., & Sofonea, M. T. (2023) · Anesthésie & Réanimation · doi:10.1016/j.anrea.2023.08.002
Randomised trials – additional aspects of analysis and interpretation
Hackshaw, A. K. (2024) · Wiley eBooks · doi:10.1002/9781119502678.ch7
Choi, S., Shibanuma, A., Kiriya, J., Kazembe, N., & Jimba, M. (2024) · Qeios · doi:10.32388/3xfllw
Ye, J., & Nie, L. (2024) · ICSA book series in statistics · doi:10.1007/978-3-031-60843-8_9
An efficient vaccine clinical trial: ACTG A5379 hepatitis B vaccine trial in persons with HIV
Kang, M., Marks, K., Cox, A. L., & Sherman, K. E. (2025) · Vaccine · doi:10.1016/j.vaccine.2025.127028
On multiple comparisons and competitive variables
Ciocca, M. E., Mastaï, R., & Cagide, A. M. (2025) · Archivos Argentinos de Pediatria · doi:10.5546/aap.2025-10696.eng
Considerations for results of the patient-reported outcome analyses of the TALAPRO-2 trial
de Boissieu, P., & Chevret, S. (2025) · The Lancet Oncology · doi:10.1016/s1470-2045(25)00228-1
Azmi, N. M., Jalal, M. I. A., Ashar, S. H. M., Nazri, M. I. M., Jie, Y., Ganeson, N., Augustine, J. K., & Yew, S. Q. (2025) · PLoS ONE · doi:10.1371/journal.pone.0334349
O’Brien, K. S., Arzika, A. M., Amza, A., Maliki, R., Ousmane, S., Kadri, B., Nassirou, B., Mankara, A. K., Harouna, A. N., Colby, E., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14516236
Gao, G., Gajewski, B. J., Wick, J., Beall, J., Saver, J. L., & Meinzer, C. (2022) · Figshare · doi:10.6084/m9.figshare.21009582
Feder, K. M., Rahr, H. B., Lautrup, M. D., Egebæk, H. K., Christensen, R., & Ingwersen, K. G. (2022) · Figshare · doi:10.6084/m9.figshare.20522589
Lyngbæk, M. P. P., Legaard, G. E., Bennetsen, S. L., Feineis, C. S., Rasmussen, V., Moegelberg, N., Brinkløv, C. F., Nielsen, A. B., Kofoed, K. S., Lauridsen, C. A., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14361947
Lyngbæk, M. P. P., Legaard, G. E., Bennetsen, S. L., Feineis, C. S., Rasmussen, V., Moegelberg, N., Brinkløv, C. F., Nielsen, A. B., Kofoed, K. S., Lauridsen, C. A., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14361935
Feder, K. M., Rahr, H. B., Lautrup, M. D., Egebæk, H. K., Christensen, R., & Ingwersen, K. G. (2022) · Figshare · doi:10.6084/m9.figshare.20522592
Lyngbæk, M. P. P., Legaard, G. E., Bennetsen, S. L., Feineis, C. S., Rasmussen, V., Moegelberg, N., Brinkløv, C. F., Nielsen, A. B., Kofoed, K. S., Lauridsen, C. A., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14361932
Lyngbæk, M. P. P., Legaard, G. E., Bennetsen, S. L., Feineis, C. S., Rasmussen, V., Moegelberg, N., Brinkløv, C. F., Nielsen, A. B., Kofoed, K. S., Lauridsen, C. A., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14361944
Lyngbæk, M. P. P., Legaard, G. E., Bennetsen, S. L., Feineis, C. S., Rasmussen, V., Moegelberg, N., Brinkløv, C. F., Nielsen, A. B., Kofoed, K. S., Lauridsen, C. A., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14361929
Lyngbæk, M. P. P., Legaard, G. E., Bennetsen, S. L., Feineis, C. S., Rasmussen, V., Moegelberg, N., Brinkløv, C. F., Nielsen, A. B., Kofoed, K. S., Lauridsen, C. A., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14361941
Bittar, I., GUYENARD, L., Blanchard, C., & Boussageon, R. (2026) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-025-03927-2 · Cited by 2
Smith, P. J., Blumenthal, J. A., Ingle, K., Watkins, L. L., Avorgbedor, F., Mabe, S., Kraus, W. E., Tyson, C. C., Hinderliter, A. L., & Sherwood, A. (2026) · Journal of Alzheimer s Disease · doi:10.1177/13872877251409716 · Cited by 1
Kokkali, M., & Karalis, V. D. (2026) · Biopharmaceutics & Drug Disposition · doi:10.1002/bdd.70023
Refining Normoxemia Targets in Acute Burn Care: Opportunities Beyond Supplemental Oxygen-Free Days
Tang, F., Han, C., & Liu, S. (2026) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000004950
Power calculation and sample size
Acevedo, D. C. A., & Valderrama-Molina, C. O. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-34264-6.00003-4
Lin, X., Ba, Z., Lu, D., Ma, R., Chen, M., Zhu, C., Liao, Y., Liu, Y., & Luo, X. (2026) · Journal of Affective Disorders · doi:10.1016/j.jad.2026.121947
Kokkali, M., & Karalis, V. D. (2026) · Clinical and Translational Discovery · doi:10.1002/ctd2.70180
From Signal to Certainty: Why COPD Needs More Than One Trial
Cazzola, M., Stolz, D., Sin, D. D., Matera, M. G., & Rogliani, P. (2026) · Lung · doi:10.1007/s00408-026-00914-x
Johnson, E., Hyde, A. M., Corrick, S., Isley, S., Wright, G., Ezekowitz, J. A., Zheng, Y., Lee‐Baggley, D., Spiers, J. A., Spence, J. C., et al. (2026) · PLoS Medicine · doi:10.1371/journal.pmed.1005198
Kumar, A., Mishra, M., Tiwari, M., Singh, V. P., Mukhopadhyay, R., Srivastava, A., Kumar, M., Agarwal, A. T. D., Singh, S. N., Tripathi, S., et al. (2026) · BMJ Open · doi:10.1136/bmjopen-2026-116601
Minini, P., Paux, G., & Dmitrienko, A. (2026) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2026.2741424
Self-citation
Metadata
- Authors
- Dmitrienko, A., & D’Agostino, R. B.
- Affiliations
- Boston University (US)
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2018-05-31
- Volume
- 378
- Issue
- 22
- Pages
- 2115-2122
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2806596191
- Cited by
- 140
- References
- 30
- Citations by year
- 2026: 14 · 2025: 18 · 2024: 16 · 2023: 6 · 2022: 22 · 2021: 22 · 2020: 19 · 2019: 16 · 2018: 7
- FWCI
- 2.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- multiplicity, multiple comparisons, clinical trials, statistical significance, false positives, causal inference
- MeSH terms
- Data Interpretation, Statistical, Humans, Research Design, Statistics as Topic, Causality, Clinical Trials, Phase III as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review