The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Graphical approaches for multiple comparison procedures using weighted Bonferroni, Simes, or parametric tests
Open accessAbstract
The confirmatory analysis of pre‐specified multiple hypotheses has become common in pivotal clinical trials. In the recent past multiple test procedures have been developed that reflect the relative importance of different study objectives, such as fixed sequence, fallback, and gatekeeping procedures. In addition, graphical approaches have been proposed that facilitate the visualization and communication of Bonferroni‐based closed test procedures for common multiple test problems, such as comparing several treatments with a control, assessing the benefit of a new drug for more than one endpoint, combined non‐inferiority and superiority testing, or testing a treatment at different dose levels in an overall and a subpopulation. In this paper, we focus on extended graphical approaches by dissociating the underlying weighting strategy from the employed test procedure. This allows one to first derive suitable weighting strategies that reflect the given study objectives and subsequently apply appropriate test procedures, such as weighted Bonferroni tests, weighted parametric tests accounting for the correlation between the test statistics, or weighted Simes tests. We illustrate the extended graphical approaches with several examples. In addition, we describe briefly the gMCP package in R, which implements some of the methods described in this paper.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Multiple Comparison Procedures
Hochberg, Y., & Tamhane, A. C. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316672 · Cited by 2,389
Computation of Multivariate Normal and t Probabilities
Genz, A., & Bretz, F. (2009) · Lecture Notes in Statistics · doi:10.1007/978-3-642-01689-9 · Cited by 902
Self-citation
Research works printed but not linked: 43
- 10.1002/sim.3461 · DOI
- 10.1002/sim.3896 · doi:10.1002/sim.3896
- 10.1002/sim.4780100609 · DOI · Paper page
- 10.1002/(SICI)1097-0258(19980930)17:18<2133::AID-SIM901>3.0.CO;2-2 · doi:10.1002/(sici)1097-0258(19980930)17:18<2133::aid-sim901>3.0.co;2-2
- 10.1198/016214507000000941 · DOI · Paper page
- 10.1111/1467-9469.00072 · DOI · Paper page
- 10.1198/jasa.2010.tm08127 · DOI
- 10.1002/sim.3495 · DOI · Paper page
- 10.1002/sim.3988 · DOI
- 10.1002/sim.3513 · DOI
- 10.1002/sim.2005 · DOI
- 10.1002/pst.190 · DOI
- 10.1002/sim.1526 · DOI · Paper page
- 10.1201/9781584889854 · DOI · Paper page
- 10.1002/bimj.200710464 · DOI
- 10.1002/bimj.200710449 · DOI
- 10.1002/bimj.200800113 · doi:10.1002/bimj.200800113
- 10.1080/10543406.2011.551331 · DOI
- 10.1093/biomet/75.2.383 · DOI · Paper page
- 10.1002/sim.2873 · DOI
- 10.1080/10543400802541693 · DOI
- 10.1002/bimj.200900206 · DOI
- 10.1016/j.jspi.2007.06.009 · DOI
- 10.1080/10543406.2011.551327 · DOI
- 10.2307/1390807 · DOI
- Kling Y.(2005).Issues of Multiple Hypothesis Testing in Statistical Process Control. Thesis The Neiman Library of Exact Sciences & Engineering Tel‐Aviv University.
- 10.1002/pst.468 · DOI
- 10.1002/sim.3369 · DOI
- 10.1198/jasa.2009.tm08538 · DOI
- 10.1093/biomet/63.3.655 · DOI · Paper page
- 10.1198/sbr.2010.10010 · DOI
- Maurer W., 1995, Biometrie in der Chemisch‐Pharmazeutischen Industrie, 3
- 10.1198/sbr.2010.09014 · DOI
- 10.1016/S0197-2456(97)00075-5 · DOI
- R Development Core Team, 2011, R: A Language and Environment for Statistical Computing
- 10.2202/1557-4679.1300 · DOI
- 10.2307/2283989 · DOI
- 10.1002/sim.3338 · DOI
- 10.1016/S0378-3758(01)00077-5 · DOI · Paper page
- 10.1002/(SICI)1097-0258(19980930)17:18<2107::AID-SIM910>3.0.CO;2-W · doi:10.1002/(sici)1097-0258(19980930)17:18<2107::aid-sim910>3.0.co;2-w
- Westfall P. H., 1993, Resampling‐based Multiple Testing
- 10.1002/pst.64 · DOI
- 10.1002/pst.358 · doi:10.1002/pst.358
Cited by
Gerstein, H. C., Colhoun, H. M., Dagenais, G. R., Diaz, R., Lakshmanan, M., Pais, P., Probstfield, J., Riesmeyer, J. S., Riddle, M. C., Rydén, L., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(19)31149-3 · Cited by 3,163
Donanemab in Early Symptomatic Alzheimer Disease: The TRAILBLAZER-ALZ 2 Randomized Clinical Trial
Sims, J. R., Zimmer, J. A., Evans, C. D., Lu, M., Ardayfio, P., Sparks, J., Wessels, A. M., Shcherbinin, S., Wang, H., Monkul Nery, E. S., et al. (2023) · JAMA · doi:10.1001/jama.2023.13239 · Cited by 2,932
Pratley, R., Amod, A., Hoff, S. T., Kadowaki, T., Lingvay, I., Nauck, M., Pedersen, K. B., Saugstrup, T., & Meier, J. J. (2019) · The Lancet · doi:10.1016/s0140-6736(19)31271-1 · Cited by 594
Baselga, J., Im, S.-A., Iwata, H., Cortés, J., De Laurentiis, M., Jiang, Z., Arteaga, C. L., Jonat, W., Clemons, M., Ito, Y., et al. (2017) · The Lancet Oncology · doi:10.1016/s1470-2045(17)30376-5 · Cited by 533
Two Phase 3 Trials of Baricitinib for Alopecia Areata
King, B., Ohyama, M., Kwon, O., Zlotogorski, A., Ko, J., Mesinkovska, N. A., Hordinsky, M., Dutronc, Y., Wu, W.-S., McCollam, J., et al. (2022) · New England Journal of Medicine · doi:10.1056/nejmoa2110343 · Cited by 506
Wykoff, C. C., Abreu, F., Adamis, A. P., Basu, K., Eichenbaum, D. A., Haskova, Z., Lin, H., Loewenstein, A., Mohan, S., Pearce, I. A., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(22)00018-6 · Cited by 504
Aroda, V. R., Rosenstock, J., Terauchi, Y., Altuntas, Y., Lalic, N. M., Morales Villegas, E. C., Jeppesen, O. K., Christiansen, E., Hertz, C. L., Haluzík, M., et al. (2019) · Diabetes Care · doi:10.2337/dc19-0749 · Cited by 493
“The confirmation of efficacy of oral semaglutide on change in HbA1c and in body weight both from baseline to week 26 was based on a weighted Bonferroni closed-testing strategy (17) to control the overall type 1 error for the hypotheses evaluated by the treatment policy estimand (see Supplementary Appendix 3 for detail…”
Rodbard, H. W., Rosenstock, J., Canani, L. H., Deerochanawong, C., Gumprecht, J., Lindberg, S. Ø., Lingvay, I., Søndergaard, A. L., Treppendahl, M. B., Montanya, E., et al. (2019) · Diabetes Care · doi:10.2337/dc19-0883 · Cited by 463
Rosenstock, J., Allison, D., Birkenfeld, A. L., Blicher, T. M., Deenadayalan, S., Jacobsen, J. B., Serusclat, P., Violante, R., Watada, H., Davies, M., et al. (2019) · JAMA · doi:10.1001/jama.2019.2942 · Cited by 421
Capehorn, M. S., Catarig, A.-M., Furberg, J. K., Janez, A., Price, H. C., Tadayon, S., Vergès, B., & Marre, M. (2020) · Diabetes & Metabolism · doi:10.1016/j.diabet.2019.101117 · Cited by 412
Simpson, E. L., Lacour, J. ‐., Spelman, L., Galimberti, R., Eichenfield, L. F., Bissonnette, R., King, B. A., Thyssen, J. P., Silverberg, J. I., Bieber, T., et al. (2020) · British Journal of Dermatology · doi:10.1111/bjd.18898 · Cited by 396
Zinman, B., Aroda, V. R., Buse, J. B., Cariou, B., Harris, S. B., Hoff, S. T., Pedersen, K. B., Tarp-Johansen, M. J., Araki, E., PIONEER 8 Investigators, et al. (2019) · Diabetes Care · doi:10.2337/dc19-0898 · Cited by 300
Buteau, J. P., Martin, A. J., Emmett, L., Iravani, A., Sandhu, S., Joshua, A. M., Francis, R. J., Zhang, A. Y., Scott, A. M., Lee, S.-T., et al. (2022) · The Lancet Oncology · doi:10.1016/s1470-2045(22)00605-2 · Cited by 296
Ludvik, B., Frías, J. P., Tinahones, F. J., Wainstein, J., Jiang, H., Robertson, K. E., García-Pérez, L.-E., Woodward, D. B., & Milicevic, Z. (2018) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(18)30023-8 · Cited by 266
A randomized, placebo-controlled trial of emricasan in patients with NASH and F1-F3 fibrosis
Harrison, S. A., Goodman, Z., Jabbar, A., Vemulapalli, R., Younes, Z. H., Freilich, B., Sheikh, M. Y., Schattenberg, J. M., Kayali, Z., Zivony, A., et al. (2020) · Journal of Hepatology · doi:10.1016/j.jhep.2019.11.024 · Cited by 260
MultipleTesting.com: A tool for life science researchers for multiple hypothesis testing correction
Menyhart, O., Weltz, B., & Győrffy, B. (2021) · PLOS ONE · doi:10.1371/journal.pone.0245824 · Cited by 216
Frias, J. P., Bonora, E., Nevarez Ruiz, L., Li, Y. G., Yu, Z., Milicevic, Z., Malik, R., Bethel, M. A., & Cox, D. A. (2021) · Diabetes Care · doi:10.2337/dc20-1473 · Cited by 199
McCrimmon, R. J., Catarig, A.-M., Frias, J. P., Lausvig, N. L., le Roux, C. W., Thielke, D., & Lingvay, I. (2020) · Diabetologia · doi:10.1007/s00125-019-05065-8 · Cited by 184
Asciminib in Newly Diagnosed Chronic Myeloid Leukemia
Hochhaus, A., Wang, J., Kim, D.-W., Kim, D. D. H., Mayer, J., Goh, Y.-T., le Coutre, P., Takahashi, N., Kim, I., Etienne, G., et al. (2024) · New England Journal of Medicine · doi:10.1056/nejmoa2400858 · Cited by 171
Orforglipron, an Oral Small-Molecule GLP-1 Receptor Agonist for Obesity Treatment
Wharton, S., Aronne, L. J., Stefanski, A., Alfaris, N. F., Ciudin, A., Yokote, K., Halpern, B., Shukla, A. P., Zhou, C., Macpherson, L., et al. (2025) · New England Journal of Medicine · doi:10.1056/nejmoa2511774 · Cited by 189
Aroda, V. R., Aberle, J., Bardtrum, L., Christiansen, E., Knop, F. K., Gabery, S., Pedersen, S. D., & Buse, J. B. (2023) · The Lancet · doi:10.1016/s0140-6736(23)01127-3 · Cited by 126
Brock, G., Heiselman, D., Maggi, M., Kim, S. W., Rodríguez Vallejo, J. M., Behre, H. M., McGettigan, J., Dowsett, S. A., Hayes, R. P., Knorr, J., et al. (2016) · Journal of Urology · doi:10.1016/j.juro.2015.10.083 · Cited by 109
Blevins, T., Zhang, Q., Frias, J. P., Jinnouchi, H., & Chang, A. M. (2020) · Diabetes Care · doi:10.2337/dc19-2550 · Cited by 69
Metadata
- Authors
- Bretz, F., Posch, M., Glimm, E., Klinglmueller, F., Maurer, W., & Rohmeyer, K.
- Venue
- Biometrical Journal
- Publisher
- Wiley
- Published
- 2011-08-12
- Volume
- 53
- Issue
- 6
- Pages
- 894-913
- ISSN
- 0323-3847 (ISSN-L)
- 1521-4036
- OpenAlex
- W2082925092
- Cited by
- 172
- References
- 5
- FWCI
- 6.96
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.