The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Multiple Comparisons Using R
Abstract
Adopting a unifying theme based on maximum statistics, Multiple Comparisons Using R describes the common underlying theory of multiple comparison procedures through numerous examples. It also presents a detailed description of available software implementations in R. The R packages and source code for the analyses are available at https://CRAN.R-pro
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“After applying the Bonferroni correction for evaluating multiple probabilities (Bretz et al. 2010), only the projections of areas 7A and DP to area 10 were inconsistent despite a statistically very low probability of being so.”
From A Weighted and Directed Interareal Connectivity Matrix for Macaque Cerebral Cortex (2014) · cites this paper as Bretz et al. 2010
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Simultaneous Inference in General Parametric Models
Hothorn, T., Bretz, F., & Westfall, P. H. (2008) · Biometrical Journal · doi:10.1002/bimj.200810425 · Cited by 14,265
Self-citationGentleman R: R: A language for data analysis and graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,747
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 6,097
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
Šidák, Z. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10482935 · Cited by 2,904
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Discrete sequential boundaries for clinical trials
GORDON LAN, K. K., & DEMETS, D. L. (1983) · Biometrika · doi:10.1093/biomet/70.3.659 · Cited by 2,310
Cited by
Sorted by citations
Items 901–1,000 of 1,000
Improving Trust in Research: Supporting Claims with Evidence
Wright, D. B. (2020) · Open Education Studies · doi:10.1515/edu-2020-0106 · Cited by 4
“Adjust p-values with traditional multiple comparison or false discovery rate procedures (Bretz et al., 2010) or 2.”
MethodWhat Language Disorders Reveal About the Mechanisms of Morphological Processing
Manouilidou, C., Nerantzini, M., Chiappetta, B., Mesulam, M. M., & Thompson, C. K. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.701802 · Cited by 4
“In the presence of significant effects, post hoc planned comparisons were run, and p-values were corrected for multiple comparisons using a single-step method in the multcomp package (Bretz et al., 2010) in R. Model formulas: For accuracy data, DV = accuracy (1/0), while for RT data, DV = logRT.”
MethodA Practitioner's Guide to Multiple Testing Error RatesPreprint
Rosenblatt, J. D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1304.4920 · Cited by 6
A new foreperiod effect on single-trial phase coherence. Part I: existence and relevancePreprint
Rapela, J., Westerfield, M., Townsend, J., & Makeig, S. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/072371 · Cited by 4
“This function controls for multiple comparisons by using multivariate t, or Gaussian, distributions to compute p-values associated with multiple hypothesis (Bretz et al., 2010).”
MethodSong structure and sex-specific features in the indris
Gamba, M., Valente, D., Gregorio, C. D., Zanoli, A., Randrianarison, R. M., Torti, V., & Giacoma, C. (2019) · The Journal of the Acoustical Society of America · doi:10.1121/1.5101970 · Cited by 4
“We then performed pairwise comparisons for each level of the factors with the Tukey test (multcomp in R, Bretz et al. 2010), adjusting the P-values using the Bonferroni correction.”
MethodSperm quality parameters are increased and asymmetric in house mouse hybridsPreprint
Martincová, I., Ďureje, Ľ., Baird, S. J. E., & Piálek, J. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/666511 · Cited by 4
“For post hoc comparison of pairwise differences in between inter- and intrasubspecific crosses for the selected models we utilized the glht package (Bretz et al. 2010).”
MethodMaruyama, T. E., Tsuruta, M., & Katsuki, T. (2024) · In Vitro Cellular & Developmental Biology - Plant · doi:10.1007/s11627-023-10407-8 · Cited by 3
“Post hoc analyses were performed using the R package “multicomp” (Bretz et al .”
Cavicchio, F., & Busà, M. G. (2023) · Language Interaction and Acquisition · doi:10.1075/lia.22023.cav · Cited by 4
Counting butterflies—are old-fashioned ways of recording data obsolete?
Kühn, E., Harpke, A., Schmitt, T., Settele, J., & Kühn, I. (2024) · Journal of Insect Conservation · doi:10.1007/s10841-024-00577-0 · Cited by 3
Pedruzzi, L., Maglieri, V., Oliveri, P., Francesconi, M., Riccobono, R., Bigozzi, F., Lemasson, A., & Palagi, E. (2025) · American Journal of Primatology · doi:10.1002/ajp.70049 · Cited by 3
“For pairwise comparisons involving factors with more than two levels (and for interaction factors), the emmeans package was used to perform the Tukey test (Bretz et al. 2016; Lenth 2025).”
Leplat, J., François, A., & Bousta, F. (2025) · International Biodeterioration & Biodegradation · doi:10.1016/j.ibiod.2025.106137 · Cited by 3
Dibi, W. G., Fotso, B., Brou, C. Y., Zoueu, J. T., Zézé, A., & Bosson, J. M. (2016) · Applied Physics Research · doi:10.5539/apr.v8n3p17 · Cited by 3
Szwonek, E., Maciorowski, R., Koziński, B., Smolarz, K., Sas‐Paszt, L., Bryk, H., Derkowska, E., & Estabrooks, E. (2016) · Folia Horticulturae · doi:10.1515/fhort-2016-0009 · Cited by 3
Influence of die-back syndrome on reproductive strategies within Phragmites australis populations
Cerri, M., Ferranti, F., Coppi, A., Foggi, B., Gigante, D., Lastrucci, L., Onofri, A., Venanzoni, R., Viciani, D., & Reale, L. (2018) · Plant Biosystems - An International Journal Dealing with all Aspects of Plant Biology · doi:10.1080/11263504.2018.1473302 · Cited by 3
“All of these analyses were performed using the R statistical environment (R Core Team 2015), together with the glht (Bretz et al. 2011) and lsmeans (Lenth 2016) packages.”
Blastocysts exhibit sex-specific signalling of IFNT transcription, translation and activity
Schanzenbach, C. I., Bernal-Ulloa, S. M., van der Weijden, V. A., Pfaffl, M. W., Büttner, M., Wünsch, A., & Ulbrich, S. E. (2018) · Reproduction · doi:10.1530/rep-18-0312 · Cited by 3
Morales, A., Valle, J. A., Castillo, G., Antoine, D., Avelar, E., Morales, R. L. C., Buenabad, L., & Cervantes, M. (2019) · Translational Animal Science · doi:10.1093/tas/txz143 · Cited by 3
Mielke, J., Jones, B. C., Posch, M., & König, F. (2020) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2020.1730233 · Cited by 3
Baeuerle, G., Feldhaar, H., & Otti, O. (2020) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2020.00062 · Cited by 3
“If female group or species showed a significant effect, we ran multiple comparisons to identify differences among immune defense mechanisms adjusting p-values according to Westfall (Bretz et al., 2010).”
MethodBlom, E., Bosma, E., & Heeringa, W. J. (2021) · Languages · doi:10.3390/languages6010056 · Cited by 3
“This correction is slightly less conservative than the Bonferroni correction, but more powerful (Bretz et al. 2016).”
Yamamoto, Y., Yoshino, K., & Koga, T. (2023) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-023-03340-8 · Cited by 3
Gitelman, V., Doveh, E., Korchatov, A., Elias, W., & Hakkert, S. (2023) · European Transport Research Review · doi:10.1186/s12544-023-00613-1 · Cited by 3
“Comparisons were based on the estimation of least-squares means while using a Bonferroni correction for multiple comparisons [6].”
MethodPhonetic and phonological aspects of prosodic focus marking in Canadian English
Kim, J., & Arnhold, A. (2023) · Laboratory Phonology Journal of the Association for Laboratory Phonology · doi:10.16995/labphon.9316 · Cited by 3
Springtime bird use of agricultural landscapes examined by using autonomous recording units
McGovern, J., Giese, J. C., & Moore, L. A. S. (2024) · Journal of Field Ornithology · doi:10.5751/jfo-00399-950101 · Cited by 3
Analysis of weakly correlated nodes in market network
Semenov, D., Koldanov, A. P., & Koldanov, P. A. (2024) · Computational Management Science · doi:10.1007/s10287-023-00499-3 · Cited by 3
Busi, R., Flower, K. C., Goggin, D. E., & Onofri, A. (2024) · Pest Management Science · doi:10.1002/ps.8394 · Cited by 3
Schell, V., Kervroëdan, L., Depeaux, G., Delzon, S., & Faucon, M. (2025) · Plant and Soil · doi:10.1007/s11104-025-07242-8 · Cited by 3
“The post-hoc test was performed with the glht function using the Tukey method from the Multicomp package on data from separate years (Bretz et al. 2010).”
Marzban, C., Du, X., Sandgathe, S. A., Doyle, J. D., Jin, Y., & Lederer, N. C. (2018) · Monthly Weather Review · doi:10.1175/mwr-d-17-0275.1 · Cited by 3
Sen'ko, O. V., Kodryan, M., Kuznetsova, A. V., Клименко, Л. Л., Деев, А. И., Baskakov, I. S., & Mazilina, A. N. (2018) · Mathematical Biology and Bioinformatics · doi:10.17537/2018.13.563 · Cited by 3
Hough‐Snee, N. (2020) · PeerJ · doi:10.7717/peerj.8903 · Cited by 3
Kryžanowski, Š. (2021) · South East European Journal of Architecture and Design · doi:10.3889/seejad.2021.10057 · Cited by 3
“The p-values of the effects in the models were corrected for simultaneous hypothesis testing on the basis of multivariate t-distribution using glht function from multcomp package in R program [39].”
MethodFormalizing Statistical Beliefs in Hypothesis Testing Using Program Logic
Kawamoto, Y., Sato, T., & Suenaga, K. (2021) · Principles of Knowledge Representation and Reasoning · doi:10.24963/kr.2021/39 · Cited by 3
“This is the multiple comparisons problem (Bretz, Hothorn, and Westfall 2010), arising when the combined alternative hypothesis is in disjunctive form.”
BackgroundOptimizing quinoa growth cycle duration in northeast England by varying the sowing date
Domingos, I. F. N., & Bilsborrow, P. E. (2022) · Agronomy Journal · doi:10.1002/agj2.21131 · Cited by 3
A decision theoretic approach to optimization of multiple testing procedures
Lisovskaja, V., & Burman, C. (2014) · Biometrical Journal · doi:10.1002/bimj.201300186 · Cited by 3
The Influence of Expertise on Maritime Driving Behaviour
Godwin, H. J., Hyde, S., Taunton, D. J., Calver, J., Blake, J. I. R., & Liversedge, S. P. (2013) · Applied Cognitive Psychology · doi:10.1002/acp.2925 · Cited by 3
Sei, S., Invidia, M., Giannetto, M., & Gorbi, G. (2016) · Ecotoxicology and Environmental Safety · doi:10.1016/j.ecoenv.2016.05.017 · Cited by 3
Comparing a stratified treatment strategy with the standard treatment in randomized clinical trials
Sun, H., Bretz, F., Gerke, O., & Vach, W. (2016) · Statistics in Medicine · doi:10.1002/sim.7091 · Cited by 3
Self-citationTipura, E., Pegna, A. J., de Gelder, B., & Renaud, O. (2017) · Clinical Neurophysiology · doi:10.1016/j.clinph.2017.02.009 · Cited by 3
“In support of this evolutionary trace, responses to faces and emotional faces have been observed as early as 50–90 ms and 100–130 ms respectively and lasting until 200 ms in surface (e.g. Linkenkaer-Hansena et al., 1998) as well as in intracranial ERP recordings in healthy subjects (e.g. Seeck et al., 1997; KrolakSalm…”
Pallmann, P., Ritz, C., & Hothorn, L. A. (2018) · Statistics in Medicine · doi:10.1002/sim.7610 · Cited by 3
“Simultaneous inference with the aim to control the familywise type I error rate (FWER) is well explored for simple randomised settings and easily available in major statistical software packages [2, 60].”
Semiparametric Estimation of Task-Based Dynamic Functional Connectivity on the Population Level
Kudela, M., Džemidžić, M., Oberlin, B. G., Lin, Z., Goñi, J., Kareken, D. A., & Harezlak, J. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00583 · Cited by 3
“We also compared our results with a more stringent family-wise error (FWE) rate correction (Bretz et al., 2010) with the significance level set to 0.05 (see Supplementary Materials).”
ResultInfluentialClosed testing of each group versus the others combined in a multiple group analysis
Lachin, J. M., & Bebu, I. (2019) · Clinical Trials · doi:10.1177/1740774519879932 · Cited by 3
“We employed the F test on 2 df of the joint 3-group null hypothesis as in equation (1), and the t test for the elemental hypotheses in equation (3).”
MethodGroup-specific social dynamics affect urinary oxytocin levels in Taï male chimpanzees
Anna, P., Liran, S., Tobias, D., Catherine, C., & Roman, W. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108674218.022 · Cited by 3
The fear diet: Risk, refuge, and biological control by omnivorous weed seed predators
Widick, I. V., Berl, J. L., Kaplan, I., Zollner, P. A., & Blubaugh, C. K. (2022) · Basic and Applied Ecology · doi:10.1016/j.baae.2022.09.006 · Cited by 3
Flexible Multiple Testing with the FACT AlgorithmPreprint
Dobriban, E. (2018) · arXiv (Cornell University) · Cited by 3
A liberal type I error rate for studies in precision medicinePreprint
Brannath, W., Hillner, C., & Rohmeyer, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.04766 · Cited by 3
“t-distribution is implemented in the mvtnorm-package (see Genz et al., 2017)via thepmvt()-functionandneedsthedegreesoffreedomdfandthecorrelationmatrixcorrof the test statistics as arguments(see e.g. Bretz et al., 2016). Thecorrelationmatrixcan be computedusing the contrast matrix and the design matrix of the linear mo…”
MethodAngelini, C. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-809633-8.20356-7 · Cited by 4
A Bandit-Inspired Memetic Algorithm for Quadratic Assignment Problems
Puglierin, F. (2012) · Utrecht University Repository (Utrecht University) · Cited by 3
An improved closed procedure for testing multiple hypotheses
Lu, Z. (2020) · Statistics in Medicine · doi:10.1002/sim.8692 · Cited by 2
Social tension in the aftermath of public conflicts: an ethological analysis in humans
Pallante, V., Norscia, I., & Lindegaard, M. R. (2024) · Animal Behaviour · doi:10.1016/j.anbehav.2024.10.003 · Cited by 3
Fortini, D., Chignola, R., Zanni, G., Brunazzi, A., Zamboni, A., Zoccatelli, G., Ciulu, M., Soto, D. V. S., Sanson, T., Pandolfini, T., et al. (2025) · Plant Stress · doi:10.1016/j.stress.2025.100794 · Cited by 2
Rein tension and heart rate variability in horses: an experiment on experience
Galotti, A., Eisersiö, M., Yngvesson, J., Lanatà, A., Maglieri, V., Palagi, E., & Baragli, P. (2025) · Journal of Animal Science · doi:10.1093/jas/skaf146 · Cited by 2
Lu, T., Lin, Y., & Zhong, J. (2025) · Journal of the Korean Statistical Society · doi:10.1007/s42952-025-00336-0 · Cited by 2
Yawn contagion plasticity in semiwild chimpanzees: females ‘leading’ the way at times
Loprete, A. L., Galotti, A., Francesconi, M., Maglieri, V., Davila‐Ross, M., & Palagi, E. (2025) · Animal Behaviour · doi:10.1016/j.anbehav.2025.123276 · Cited by 2
Johansson, V., Erbs, C., & Bergman, K. (2025) · Scandinavian Journal of Forest Research · doi:10.1080/02827581.2025.2530419 · Cited by 2
“For pair-wise difference between stand categories we used the “glht function” from the R package multcomp (Bretz et al., 2010).”
Buhk, A., Barckhausen, H., & Mühling, K. H. (2025) · Journal of Plant Nutrition and Soil Science · doi:10.1002/jpln.70021 · Cited by 2
Carbuccia, L., Heim, A., Barone, C., & Chevallier, C. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02293-4 · Cited by 2
Multiple Contrast Tests for Testing Dose–Response Relationships Under Order-Restricted Alternatives
Lin, D. Y., Hothorn, L. A., Djira, G. D., & Bretz, F. (2012) · Springer eBooks · doi:10.1007/978-3-642-24007-2_15 · Cited by 2
“In this section, we use the multcomp package (Bretz et al. 2010) to illustrate the analysis for the human epidermal carcinoma cell line data.”
MethodSelf-citationMedhi, P. K., & Gohain, K. (2019) · International Journal of Basic & Clinical Pharmacology · doi:10.18203/2319-2003.ijbcp20190155 · Cited by 2
da Silva, H. A., Scapim, C. A., Vivas, M., Júnior, A. T. D. A., Pinto, R. J. B., Vivas, J. M. S., Rossi, R. M., & Baleroni, A. G. (2020) · Pesquisa Agropecuária Brasileira · doi:10.1590/s1678-3921.pab2020.v55.01521 · Cited by 2
“In order to partition crops within the genotype factor, the parameters estimated within the levels of each factor were compared using the t-test for each contrast between means, where the p-value was corrected through the false discovery rate (Bretz et al., 2011).”
MethodAt-sea distribution and foraging tactics in a monomorphic tropical seabird
Keys, D. Z., Orgeret, F., Corre, M. L., Jaeger, A., & Pistorius, P. A. (2021) · Marine Biology · doi:10.1007/s00227-021-03978-w · Cited by 2
“Post-hoc pairwise comparisons were made using least square means (emmeans; Lenth and Lenth 2018), following the Bonferroni method (Bretz et al. 2016) to identify differences in behaviours.”
MethodCibils‐Stewart, X., Kliebenstein, D. J., Li, B., Giles, K. L., McCornack, B. P., & Nechols, J. R. (2021) · Environmental Entomology · doi:10.1093/ee/nvab123 · Cited by 2
Bayes Optimal Informer Sets for Early-Stage Drug Discovery
Yu, P., Ericksen, S. S., Gitter, A., & Newton, M. A. (2022) · Biometrics · doi:10.1111/biom.13637 · Cited by 2
Nonparametric Tests for Multivariate Association
Harrar, S. W., & Xu, Y. (2022) · Symmetry · doi:10.3390/sym14061112 · Cited by 2
Peña-Peña, K., & Irmler, U. (2022) · Pedobiologia · doi:10.1016/j.pedobi.2022.150839 · Cited by 2
Sows’ Responses to Piglets in Distress: An Experimental Investigation in a Natural Setting
Collarini, E., Capponcelli, L., Pierdomenico, A., Norscia, I., & Cordoni, G. (2023) · Animals · doi:10.3390/ani13142261 · Cited by 2
Giolo, M., Onofri, A., & Macolino, S. (2023) · Agronomy Journal · doi:10.1002/agj2.21430 · Cited by 2
Lessons from patch dynamics for ecology and restoration: The succulent Karoo, Sandveld example
Carrick, P. J. (2023) · Journal of Arid Environments · doi:10.1016/j.jaridenv.2023.105055 · Cited by 2
Big spenders: Large-N measures of urban regimes in Japanese municipalities
Fraser, T. (2024) · Cities · doi:10.1016/j.cities.2024.104916 · Cited by 2
Suans, M. A., Fischbein, D., & Corley, J. C. (2024) · Ecological Entomology · doi:10.1111/een.13327 · Cited by 2
“If the Cox ’ s regression model detected a significant effect of a fixed covariate, we followed a pairwise comparison Tukey analysis between levels of treatments using the glht function in the ‘ multcomp ’ package of the R software (Bretz et al., 2010).”
Neuhäuser, M., & Ruxton, G. D. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198872979.003.0005 · Cited by 2
Covarelli, L., Tini, F., Perrone, G., Magistà, D., Onofri, A., & Beccari, G. (2024) · Journal of Plant Pathology · doi:10.1007/s42161-024-01780-3 · Cited by 2
“The significance of pairwise differences (between different years, locations, farming systems and growth stages) was tested with a generalized linear contrast testing procedure, with single-step multiplicity adjustment (Bretz et al. 2011).”
Suenaga, H., Hira, T., Yoshimura, T., Oka, T., & Hira, D. (2024) · Frontiers in Microbiology · doi:10.3389/fmicb.2024.1455699 · Cited by 2
“4 The Dunnett test, which was used to compare the AUDPC of conditions BC1-BC3 against that of control group, was performed using the glht function in the package multcomp (v.1.4–25) (Bretz et al., 2010) in R.”
MethodInfluentialBessette, E., Bojko, J., Bateman, K. S., Ross, S. H., Meyling, N. V., & Williams, B. (2024) · Journal of Invertebrate Pathology · doi:10.1016/j.jip.2024.108229 · Cited by 2
Mutual gaze and facial mimicry as drivers of shared engagement in macaque play fighting
Pedruzzi, L., Facondini, G., Aere, S., Böye, M., Lemasson, A., & Palagi, E. (2025) · Animal Behaviour · doi:10.1016/j.anbehav.2025.123215 · Cited by 2
Mhlanga, B., Kalala, K., & Thierfelder, C. (2025) · Journal of Agriculture and Food Research · doi:10.1016/j.jafr.2025.102082 · Cited by 2
Goode, K., & Mitchum, M. G. (2025) · Phytopathology · doi:10.1094/phyto-04-25-0143-sc · Cited by 2
The influence of age and verb transitivity on written sentence production
Meulemans, C., Leijten, M., & Mæyer, S. D. (2022) · Clinical Linguistics & Phonetics · doi:10.1080/02699206.2022.2109992 · Cited by 2
“…variable, we ran a post-hoc test (Tukey Test function glht from package multcomp ) on that model to test the statistical significance of differences in estimated means between each category of verb transitivity with each of the other separate categories (Bretz et al., 2016; Hothorn et al., 2008).”
MethodPompe, S., Hanspach, J., Badeck, F., Klotz, S., Bruelheide, H., & Kühn, I. (2014) · Frontiers of Biogeography · doi:10.21425/f5fbg22502 · Cited by 2
“In the case of significant relationships for categorical variables, we performed post-hoc tests using the function glht (General Linear Hypotheses, package multcomp) and ran pair-wise multiple comparisons computing the contrast matrix (Bretz et al. 2010).”
MethodReed, D. K., & van de Par, S. (2015) · The Journal of the Acoustical Society of America · doi:10.1121/1.4930566 · Cited by 2
Herberich, E., Hassler, C., & Hothorn, T. (2014) · The International Journal of Biostatistics · doi:10.1515/ijb-2013-0003 · Cited by 2
Self-citationA multiple comparison procedure for hypotheses with gatekeeping structure
Luo, X., Chen, G., Ouyang, S. P., & Turnbull, B. W. (2013) · Biometrika · doi:10.1093/biomet/ass083 · Cited by 2
Robust pairwise multiple comparisons under short-tailed symmetric distributions
Balcı, S., & Akkaya, A. D. (2015) · Journal of Applied Statistics · doi:10.1080/02664763.2015.1023706 · Cited by 2
“[7] provided a variety of multiple comparison procedures by emphasizing familywise error rate controlling methods and provided discussions and analysis of many examples using R software.”
MethodDensity-distribution patterns of egg parasitoids in freshwater habitats
Harabiš, F., Šigut, M., & Dolný, A. (2013) · Acta Musei Silesiae. Scientiae Naturales · doi:10.2478/cszma-2013-0006 · Cited by 2
“Post hoc comparisons of pairwise differences b tween the number of parasitoids for each habitat type were made using the multiple comparisons of means: Tukey contrasts; Multcomp package in R (Bretz et al. 2010).”
MethodConsumer evaluation of ‘Veggycation®’, a website promoting the health benefits of vegetables
Rekhy, R., Khan, A., van Ogtrop, F., & McConchie, R. (2016) · Health Promotion Journal of Australia · doi:10.1071/he16003 · Cited by 2
Graphical approaches using a Bonferroni mixture of weighted Simes tests
Lu, K. (2016) · Statistics in Medicine · doi:10.1002/sim.6985 · Cited by 2
Yao, X., Goodale, U. M., Li, Z. L., Huang, Y., Wang, X.-Q., Cheng, F. Y., Tan, Y., Xiao, C. F., & Lan, Q. Y. (2014) · PubMed · Cited by 2
Interim Evaluation of Efficacy in Clinical Trials with Two Primary Endpoints
Hamasaki, T., Asakura, K., Evans, S. R., & Ochiai, T. (2016) · SpringerBriefs in statistics · doi:10.1007/978-4-431-55900-9_5 · Cited by 2
A new approach to address multiplicity in hypothesis testing with constraints
Li, H., & Zhou, H. (2019) · Communication in Statistics- Theory and Methods · doi:10.1080/03610926.2019.1628989 · Cited by 2
Spatiotemporally explicit model averaging for forecasting of Alaskan groundfish catch
Correia, H. (2018) · Ecology and Evolution · doi:10.1002/ece3.4488 · Cited by 2
Challenges on Multiple Endpoints in Clinical Trials: An Industry Survey in Japan
Sakamaki, K., Yoshida, S., Morita, Y., Kamiura, T., Iba, K., Ogawa, N., Suganami, H., Tsuchiya, S., & Fukimbara, S. (2019) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479019855994 · Cited by 2
Eukaryotic communities in bromeliad phytotelmata: How do they respond to altitudinal differences?
Malfatti, E., Ferreira, P. M. A., & Utz, L. R. P. (2020) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · doi:10.3390/d1209032610.3390/d12090326 · Cited by 2
Biostatistics in Clinical Trials
Marchenko, O., LaVange, L. M., & Katenka, N. (2020) · Springer eBooks · doi:10.1007/978-3-030-48555-9_1 · Cited by 2
Catalani, G. C., Camargo, R. D. S., Filho, T. M. M. M., Sousa, K. K. A., de Matos, C. A. O., Caldato, N., Nagamoto, N. S., Zanuncio, J. C., & Forti, L. C. (2021) · Entomologia Experimentalis et Applicata · doi:10.1111/eea.13133 · Cited by 2
“Each individual null hypothesis was specified by a linear combination of parameters of the elementary model, and null hypotheses were tested simultaneously (Bretz et al., 2010).”
MethodScudillio, T. T., Camargo, R. D. S., Filho, T. M. M. M., de Matos, C. A. O., Zanuncio, J. C., Sabattini, J. A., & Forti, L. C. (2023) · Scientific Reports · doi:10.1038/s41598-023-32796-x · Cited by 2
“The p value was adjusted using Tukey’s method to compare a family with four and three estimates, respectively 22 .”
MethodIntrinsic anticipatory motives in non-human primate food consumption behavior
Inkeller, J., Knakker, B., Kovács, P., Lendvai, B., & Hernádi, I. (2024) · iScience · doi:10.1016/j.isci.2024.109459 · Cited by 2
Jaki, T., & Parry, A. (2016) · Pharmaceutical Statistics · doi:10.1002/pst.1751 · Cited by 2
“In the context of confirmatory clinical trials, the guidelines on multiplicity from the European Medicines Agency [1], clearly advocate controlling the familywise error rate (FWER) in the strong sense [2].”
BackgroundTesting in nonparametric ANCOVA model based on ridit reliability functional
Chatterjee, D., & Bandyopadhyay, U. (2018) · Annals of the Institute of Statistical Mathematics · doi:10.1007/s10463-017-0643-8 · Cited by 2
A web application for the design of multi-arm clinical trials
Grayling, M. J., & Wason, J. M. S. (2020) · BMC Cancer · doi:10.1186/s12885-020-6525-0 · Cited by 9
“, [19, 20, 21] for an overview).”
Azorit, C., & Oya, A. (2020) · Archives of Oral Biology · doi:10.1016/j.archoralbio.2020.104999 · Cited by 2
Change point detection for clustered expression data
Sieg, M., Sciesielski, L. K., Kirschner, K. M., & Kruppa, J. (2022) · BMC Genomics · doi:10.1186/s12864-022-08680-9 · Cited by 2
“Many multiple contrast tests are well described in the literature as well as the application in statistical inference [22].”
BackgroundMethodAldighrir, W. M. (2013) · doi:10.33915/etd.273 · Cited by 2
Metadata
- Authors
- Bretz, F., Hothorn, T., & Westfall, P.
- Affiliations
- Texas Tech University (US)
- Venue
- Chapman & Hall/CRC eBooks
- Publisher
- Chapman and Hall/CRC
- Published
- 2016-04-19
- OpenAlex
- W396053900
- Cited by
- 1,233
- References
- 93
- Citations by year
- 2026: 20 · 2025: 57 · 2024: 96 · 2023: 70 · 2022: 97 · 2021: 146 · 2020: 99 · 2019: 133 · 2018: 98 · 2017: 89 · 2016: 78
- FWCI
- 12.36
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Chapman & Hall/CRC eBooks (publishedVersion)
- Thammasat University Digital Collections (submittedVersion)
- TU Digital Collections (Thammasat University) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- multiple comparisons, R software, statistical software implementation, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
