The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Multiple Comparisons Using R
Abstract
Adopting a unifying theme based on maximum statistics, Multiple Comparisons Using R describes the common underlying theory of multiple comparison procedures through numerous examples. It also presents a detailed description of available software implementations in R. The R packages and source code for the analyses are available at https://CRAN.R-pro
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“After applying the Bonferroni correction for evaluating multiple probabilities (Bretz et al. 2010), only the projections of areas 7A and DP to area 10 were inconsistent despite a statistically very low probability of being so.”
From A Weighted and Directed Interareal Connectivity Matrix for Macaque Cerebral Cortex (2014) · cites this paper as Bretz et al. 2010
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Simultaneous Inference in General Parametric Models
Hothorn, T., Bretz, F., & Westfall, P. H. (2008) · Biometrical Journal · doi:10.1002/bimj.200810425 · Cited by 14,265
Self-citationGentleman R: R: A language for data analysis and graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,747
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 6,097
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
Šidák, Z. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10482935 · Cited by 2,904
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Discrete sequential boundaries for clinical trials
GORDON LAN, K. K., & DEMETS, D. L. (1983) · Biometrika · doi:10.1093/biomet/70.3.659 · Cited by 2,310
Cited by
Sorted by citations
Items 801–900 of 1,000
Levels of Heterochiasmy DuringArabidopsisDevelopment as Reported by Fluorescent Tagged Lines
Saini, R., Singh, A. K., Hyde, G. J., & Baskar, R. (2020) · G3 Genes Genomes Genetics · doi:10.1534/g3.120.401296 · Cited by 6
Sirová, D., Kreidlová, V., Adamec, L., & Vrba, J. (2020) · Journal of Eukaryotic Microbiology · doi:10.1111/jeu.12812 · Cited by 6
“The hypothesis that U. reflexa traps are preferentially colonized by >T. utriculariae was tested using planned contrasts computed in the multcomp 1.4–12 package in R (Bretz et al. 2020).”
MethodInfluentialPairwise Comparisons Using Ranks in the One-Way Model
Boos, D. D., & Duan, S. (2021) · The American Statistician · doi:10.1080/00031305.2020.1860819 · Cited by 6
Quick Multiple Test Procedures and p-Value Adjustments
Gou, J. (2021) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2021.1927825 · Cited by 6
“Statistical softwares, including R (Bretz, Hothorn and Westfall 2010), SAS (Westfall et al. 2011), Stata (Newson 2010), and MATLAB (Metcalfe et al. 2019), have developed specific packages or functions to implement these multiple test procedures.”
MethodStolbovaya, A. Y., Smirnov, I. V., Pinevich, A. A., Левоновна, В. Н., Krutetskaya, I. Y., Александровна, Т. Л., Markova, K. L., Malashicheva, A., & Samoilovich, M. P. (2021) · Cell and Tissue Biology · doi:10.1134/s1990519x21060109 · Cited by 6
Ozenne, B., Budtz–Jørgensen, E., & Ebert, S. E. (2022) · Computational Statistics · doi:10.1007/s00180-022-01214-7 · Cited by 6
“It is also known to be a coherent and consonant procedure ( Bretz et al. (2011), section 2.”
BackgroundInfluentialPallmann, P., Pretorius, M., & Ritz, C. (2015) · Statistical Methods in Medical Research · doi:10.1177/0962280215603743 · Cited by 6
Theorie und Methoden multipler statistischer Vergleiche
Bartenschlager, C. C., & Krapp, M. (2015) · AStA Wirtschafts- und Sozialstatistisches Archiv · doi:10.1007/s11943-015-0166-9 · Cited by 6
Establishing RNAi in a Non-Model Organism: The Antarctic Nematode Panagrolaimus sp. DAW1
Seybold, A., Wharton, D. A., Thorne, M. A. S., & Marshall, C. J. (2016) · PLoS ONE · doi:10.1371/journal.pone.0166228 · Cited by 6
Simultaneous inference for factorial multireader diagnostic trials
Konietschke, F., Aguayo, R. R., & Staab, W. (2017) · Statistics in Medicine · doi:10.1002/sim.7507 · Cited by 6
Busi, R., Goggin, D. E., Onofri, A., Boutsalis, P., Preston, C. D., Powles, S. B., & Beckie, H. J. (2020) · Pest Management Science · doi:10.1002/ps.5993 · Cited by 6
Revisiting the acute effects of resistance exercise on motor imagery ability
Kanthack, T. F. D., Guillot, A., Blache, Y., & Rienzo, F. D. (2021) · Behavioural Brain Research · doi:10.1016/j.bbr.2021.113441 · Cited by 6
Carbonell, A., Carbonell, A., Tor, A., Carbonell, A., Tor, A., Álvarez-Berastegui, D., Carbonell, A., Tor, A., Álvarez‐Berastegui, D., Vélez-Belchi, P., et al. (2014) · Crustaceana · doi:10.1163/15685403-00003316 · Cited by 6
Is body size important? Seasonal changes in morphology in two grass-feeding Abacarus mites
Laska, A., Rector, B. G., Kuczyński, L., & Skoracka, A. (2017) · Experimental and Applied Acarology · doi:10.1007/s10493-017-0159-1 · Cited by 6
“As this procedure involves multiple comparisons, we controlled the error rate by applying a method proposed by Bretz et al. (2011).”
MethodRegister analysis in blogs: Correlation between professional sector and functional dimensions
Daems, J., Speelman, D., & Ruette, T. (2013) · Lirias · Cited by 6
Hypocognitive Mind: How Lack of Conceptual Knowledge Confines What People See and RememberPreprint
Wu, K., & Dunning, D. A. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/29ryz · Cited by 7
Tralamazza, S. M., Gluck‐Thaler, E., Feurtey, A., & Croll, D. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.09.22.559077 · Cited by 6
Change in empathic disequilibrium across childhood and associations with socioemotional difficulties
Shalev, I., Waller, R. E., Wagner, N. J., & Uzefovsky, F. (2025) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-025-02760-3 · Cited by 7
“4–25 [36] based on the mean, ± 1 standard deviation from the mean, and the cut-off of the relevant outcome (except for ICU, which does not have a clinical cut-off).”
Wang, Q., Cao, S., Jiang, J., Zhang, K., Jiang, X., Liu, T., Mu, C., & Cheng, D. (2025) · The Astrophysical Journal · doi:10.3847/1538-4357/ade2ce · Cited by 5
Daniels, B., Gräff, T., Kotschik, P., & Walter-Rohde, S. (2025) · Integrated Environmental Assessment and Management · doi:10.1093/inteam/vjaf113 · Cited by 5
Bernasconi, Z., Stirnemann, U., Xu, Y., Herger, A., Chen, R., Widrig, V., Heuberger, M., Lettieri, M., Müller, M. C., Wulff, B. B. H., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-74940-x · Cited by 5
“Three Ae. tauschii lines, TOWWC0028, TOWWC0040 and TOWWC0111, were randomly selected from the 21 lines mentioned above, and 83, 70 and 70 randomly chosen progeny of the Bgt mapping population were used for phenotyping on the three lines, respectively (Supplementary Data 2).”
Predicting the Risk of Huntington’s Disease with Multiple Longitudinal Biomarkers
Li, F., PREDICT-HD and ENROLL-HD Investigators of the Huntington Study Group, Li, K., Li, C., & Luo, S. (2019) · Journal of Huntington s Disease · doi:10.3233/jhd-190345 · Cited by 5
Hayato, A. B. E., Kume, T., & Katayama, A. (2025) · Journal of Agricultural Meteorology · doi:10.2480/agrmet.d-24-00032 · Cited by 5
Schaffhausen, C. R., & Kowalewski, T. M. (2015) · Journal of Mechanical Design · doi:10.1115/1.4031655 · Cited by 5
Effects of freezing on length and mass measurements of Atlantic cod Gadus morhua in the Baltic Sea
McQueen, K., Mion, M. M., Hilvarsson, A., Casini, M., Olesen, H. J., Hüssy, K., Radtke, K., & Krumme, U. (2019) · Journal of Fish Biology · doi:10.1111/jfb.14171 · Cited by 5
“including the variable region, pairwise differences between each region were assessed using Tukey’s multiple comparison procedure to adjust P-values for multiplicity using the multcomp package in R (Bretz et al., 2010; Hothorn et al., 2008)).”
MethodBalancing Life History Investment Decisions in Founding Ant Queens
Tragust, S., Brinker, P., Rossel, N., & Otti, O. (2020) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2020.00076 · Cited by 5
“Pairwise comparisons between factor levels of a significant predictor were performed using pairwise post-hoc tests adjusting the family-wise error rate according to the method of Westfall (package multcomp, Bretz et al., 2010).”
MethodOptimal Multiple Testing and Design in Clinical Trials
Heller, R., Krieger, A. Μ., & Rosset, S. (2022) · Biometrics · doi:10.1111/biom.13726 · Cited by 5
“As another example, when considering contrasts of means or various treatments with a common control, the test statistics have a specific dependence structure and the MTP takes the joint distribution of the test statistics into account (Bretz et al., 2010).”
BackgroundAdaptation to recent outcomes attenuates the lasting effect of initial experience on risky decisions
Kóbor, A., Kardos, Z., Takács, Á., Éltető, N., Janacsek, K., Tóth-Fáber, E., Csépe, V., & Németh, D. (2021) · Scientific Reports · doi:10.1038/s41598-021-89456-1 · Cited by 6
Simultaneous confidence tubes for comparing several multivariate linear regression models
Peng, J., Liu, W., Bretz, F., & Hayter, A. J. (2021) · Biometrical Journal · doi:10.1002/bimj.202000148 · Cited by 5
Self-citationWójcik, A., Kościelniak, P., Mazur, M., & Mathia, T. G. (2019) · Metrology and Measurement Systems · doi:10.24425/mms.2019.128357 · Cited by 5
“To achieve this, we can apply a so called Bonferroni correction [28] in order to calculate respective p-values related to both above mentioned approaches, which are:”
MethodGomes, F. D. S., Rezende, L. F. M., Schlüssel, M. M., Lawrence, M. A., Machado, P. P., & Lane, M. M. (2024) · Diabetes Care · doi:10.2337/dc23-1837 · Cited by 5
Mair, C., Matthews, L., Prada, J. M., Stefan, T., & Stear, M. J. (2015) · Parasitology · doi:10.1017/s0031182014001905 · Cited by 5
“For each response, the p -values were corrected for multiple comparisons using the methods described by Bretz et al .”
Multimodal conformity of expression between blog names and content
Vogel, C. M. (2013) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2013.6719247 · Cited by 5
MULTIPLE TESTING OF SIGN SYMMETRY FOR STOCK RETURN DISTRIBUTIONS
Koldanov, P. A., & Lozgacheva, N. N. (2016) · International Journal of Theoretical and Applied Finance · doi:10.1142/s0219024916500497 · Cited by 5
Calculating quantiles of noisy distribution functions using local linear regressions
Bornkamp, B. (2017) · Computational Statistics · doi:10.1007/s00180-017-0736-0 · Cited by 5
Invasive alien shredders clear up invasive alien leaf litter
Doherty‐Bone, T. M., Dunn, A. M., Brittain, J., & Brown, L. E. (2018) · Ecology and Evolution · doi:10.1002/ece3.4430 · Cited by 5
Johnson, T. D., Hanson, E., & Yu, A. (2019) · Entomologia Experimentalis et Applicata · doi:10.1111/eea.12781 · Cited by 5
“The test for differences between treatment means was a general linear hypothesis-multiple comparisons procedure with a Tukey honestly significant difference correction (glht multcomp package; Hothorn et al., 2008; Bretz et al., 2010).”
MethodSteinberg, K., Zimmermann, J., Meyer, S., & Schulz, C. (2019) · Aquaculture International · doi:10.1007/s10499-019-00373-7 · Cited by 5
Effect of mental calculus on the performance of complex movements
Khayat, J., Champely, S., Diab, A., Sarraj, A. R., & Fargier, P. (2019) · Human Movement Science · doi:10.1016/j.humov.2019.05.008 · Cited by 5
So, C. (2019) · International Journal of Design Creativity and Innovation · doi:10.1080/21650349.2019.1638835 · Cited by 5
de Castro, C. V., & Hoffmeister, T. S. (2020) · Ecology and Evolution · doi:10.1002/ece3.6190 · Cited by 5
Classes of Multiple Test Procedures
Dickhaus, T. (2014) · Springer eBooks · doi:10.1007/978-3-642-45182-9_3 · Cited by 5
Neuhäuser, M., Mackowiak, M., & Ruxton, G. D. (2021) · Ethology · doi:10.1111/eth.13230 · Cited by 5
Phonetic and phonological vowel reduction in Brazilian Portuguese
Oh, S. (2021) · Phonetica · doi:10.1515/phon-2021-2012 · Cited by 5
Determining Sample Sizes for Precise Contrast Analysis With Heterogeneous Variances
Jan, S., & Shieh, G. (2014) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998614523069 · Cited by 5
“Also, Brown and Forsythe’s (1974) procedure appears to require the largest sample sizes, while the method of Games and Howell (1976) tends to give the least sample sizes for the model configurations considered here.”
BackgroundMethodInfluentialTian, S., Fischer, M., Chescheir, G. M., Youssef, M. A., Cacho, J., & King, J. S. (2018) · GCB Bioenergy · doi:10.1111/gcbb.12510 · Cited by 6
“Tukey’s honestly significant difference post hoc test with Westfall’s adjustment for multiplicity (Westfall, 1997; Bretz et al., 2010) was subsequently applied on the mixed effects linear models to identify statistically significant differences in particular interactions between the fixed effects.”
MethodLevel of evidence for promising subgroup findings: The case of trends and multiple subgroups
Tanniou, J., Smid, S. C., van der Tweel, I., Teerenstra, S., & Roes, K. C. B. (2019) · Statistics in Medicine · doi:10.1002/sim.8133 · Cited by 5
Stangler, T., & Schiestl, M. (2019) · AAPS Open · doi:10.1186/s41120-019-0033-9 · Cited by 5
“Any specific application for a similarity exercise additionally requires consideration of potential multiplicity effects as typically many quality attributes are compared in parallel (Bretz et al. 2010).”
BackgroundDaniels, B., Roß‐Nickoll, M., Jänsch, S., Pieper, S., Römbke, J., Scholz‐Starke, B., & Ottermanns, R. (2021) · Environmental Toxicology and Chemistry · doi:10.1002/etc.5015 · Cited by 5
“The increase in test power is presumably also a result of the use of the closure principle, a powerful tool in multiple testing (Bretz 2011) that avoids duplicate testing of hypotheses and alpha‐inflation (Figure 2).”
MethodVergara-Torres, C. A., Díaz‐Castelazo, C., Toledo‐Hernández, V. H., & Flores‐Palacios, A. (2021) · AoB Plants · doi:10.1093/aobpla/plab024 · Cited by 5
Multiple Contrasts for Repeated Measures
Hasler, M. (2013) · The International Journal of Biostatistics · doi:10.1515/ijb-2012-0025 · Cited by 5
Pallauf, K., Günther, I., Chin, D., & Rimbach, G. H. (2020) · Nutrients · doi:10.3390/nu12030815 · Cited by 5
Lehmann, R., Bachmann, J., Karaoğlan, B., Lacker, J., Polleichtner, C., Ratte, H. T., & Ratte, M. (2017) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-017-1392-1 · Cited by 5
“The largest p value is termed the overall p value for testing H01 (Bretz et al. 2011).”
BackgroundMethodInfluentialSchacter, C. R. (2017) · Memorial University Research Repository (Memorial University) · Cited by 5
Pedruzzi, L., Galotti, A., Francesconi, M., Quartesan, A., Gamessa, S. A., Bogale, B. A., Petroni, G., Serra, V., Lemasson, A., & Palagi, E. (2025) · Global Ecology and Conservation · doi:10.1016/j.gecco.2025.e03738 · Cited by 4
Roehe, B. K., Ueberschär, B., Hasler, M., Lippemeier, S., & Schulz, C. (2025) · Aquaculture Research · doi:10.1155/are/8797421 · Cited by 4
Bergman, K., Petersen, R., Johansson, V., Westerberg, L. M., Milberg, P., & Jansson, N. (2025) · Annals of Forest Science · doi:10.1186/s13595-025-01307-5 · Cited by 4
“Pair-wise comparisons between the six forest types were based on contrasts (function “glht” in R package “multcomp”, Bretz et al. 2010).”
Sound and relatively complete belief Hoare logic for statistical hypothesis testing programs
Kawamoto, Y., Sato, T., & Suenaga, K. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.104045 · Cited by 4
Regularizing stock return covariance matrices via multiple testing of correlations
Luger, R. (2024) · Journal of Econometrics · doi:10.1016/j.jeconom.2024.105753 · Cited by 4
Parvez, I., Ahmed, S., Tasnim, N., Pervin, R., Alam, M. A., Khan, M. N., Ara, Y., Rashid, H., & Pradit, S. (2025) · Heliyon · doi:10.1016/j.heliyon.2025.e42543 · Cited by 4
Wenglein, R., Lanzrein, I., Graf, M., Salamon, J., Klarner, B., Weisser, W. W., Annighöfer, P., & Scheu, S. (2025) · Applied Soil Ecology · doi:10.1016/j.apsoil.2025.106328 · Cited by 4
Becoming Native-Like for Good or Ill: Online and Offline Processing of Case Forms in L2 Russian
Cherepovskaia, N., Reutova, E., & Slioussar, N. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.652463 · Cited by 4
Sentence comprehension test for Russian: A tool to assess syntactic competence
Chernova, D., Novozhilov, A., & Slioussar, N. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1035961 · Cited by 4
“For post hoc analyses, Tukey’s tests were conducted using the glht function from the multcomp package (Bretz et al., 2010).”
MethodA Framework to Survey a Region for Gas Leaks Using an Unmanned Aerial Vehicle
Souza, W. S. R., Hart, A. J., Fonseca, B. J. B., Tahernezhadi, M., & Christensen, L. E. (2023) · IEEE Access · doi:10.1109/access.2023.3345801 · Cited by 4
An exhaustive ADDIS principle for online FWER control
Fischer, L., Roig, M. B., & Brannath, W. (2024) · Biometrical Journal · doi:10.1002/bimj.202300237 · Cited by 4
“In order to ensure with high probability that the benchmark model constantly improves, online FWER control is required.”
BackgroundInter- and intra-observer variation in phytolith morphometry
Out, W. A., Evett, R. R., Hošková, K., Power, R. C., Ruiz-Pérez, J., Tromp, M., Vrydaghs, L., Wade, K., & Hasler, M. (2024) · Annals of Botany · doi:10.1093/aob/mcae116 · Cited by 4
Anibaba, Q. A., Dyderski, M. K., Woźniak, G., & Jagodziński, A. M. (2024) · Ecology and Evolution · doi:10.1002/ece3.70200 · Cited by 4
Spotswood, E. N., Bartolome, J. W., & Allen‐Diaz, B. (2015) · PLoS ONE · doi:10.1371/journal.pone.0133501 · Cited by 4
Multiple comparisons of treatments with skewed ordinal responses
Lu, T., Poon, W., & Cheung, S. H. (2016) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2016.07.004 · Cited by 4
Xu, C. C., Chan, R. W., Sun, H., & Zhan, X. (2017) · Journal of the mechanical behavior of biomedical materials/Journal of mechanical behavior of biomedical materials · doi:10.1016/j.jmbbm.2017.08.006 · Cited by 4
Teor de água e tempo de exposição ao tratamento térmico na germinação de sementes de caiaué
de Lima, W. A. A., Green, M., Zeviani, W. M., Lopes, R., & Rios, S. D. A. (2017) · Revista de Ciências Agrarias - Amazon Journal of Agricultural and Environmental Sciences · doi:10.4322/rca.2625 · Cited by 4
Effects of outdoor education stream classes on substrate movement and macroinvertebrate colonization
Bossley, J. P., & Smiley, P. C. (2017) · Journal of Freshwater Ecology · doi:10.1080/02705060.2017.1402826 · Cited by 4
“A Tukey Test (glht function and multcomp package, Bretz et al. 2010) was used to determine differences among means if the generalized linear model analyses indicated that a significant effect occurred.”
MethodNon-foraging tool use in European Honey-buzzards: An experimental test
Camacho, C., & Potti, J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0206843 · Cited by 4
Temporary ambiguity in whispered word recognition: a semantic priming study
Dufour, S., & Meynadier, Y. (2019) · Journal of Cognitive Psychology · doi:10.1080/20445911.2019.1573243 · Cited by 4
“The p values, when reported, were obtained using the package lmertest (Kuznetsova et al., 2016), and pairwise comparisons assessing the priming effects were done using the glht function from the multcomp package (Bretz et al., 2011) with a Bonferonni correction.”
MethodFickler, A., Staats, S., Michl, S. C., Hasler, M., Rimbach, G. H., & Schulz, C. (2018) · Lipids · doi:10.1002/lipd.12117 · Cited by 4
Sequential trials in the context of competing risks: Concepts and case study, with R and SAS code
Baayen, C., Volteau, C., Flamant, C., & Blanche, P. (2019) · Statistics in Medicine · doi:10.1002/sim.8184 · Cited by 4
Hasan, M. K., Sen, T., Yang, Y., Baten, R. A., Haut, K. G., & Hoque, M. E. (2019) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2019.8925467 · Cited by 4
ON SOME METHODOLOGICAL ASPECTS OF THE STUDY OF HUMAN INDIVIDUALITY
Kalugin, A. Y. (2019) · Вестник Южно-Уральского государственного университета. Серия: Психология · doi:10.14529/jpps190203 · Cited by 4
Arias, J. R., Bonneville, S., & Roisin, Y. (2020) · Insectes Sociaux · doi:10.1007/s00040-020-00760-x · Cited by 4
“As P-value corrections for multiple tests must be applied in such contexts to control for type I error rate (Bretz et al. 2011), P-values were adjusted using the False Discovery Rate (FDR) method (Benjamini and Hochberg 1995).”
MethodEffect of Mental Calculation and Number Comparison on a Manual-Pointing Movement.
Khayat, J., Champely, S., Diab, A., Sarraj, A. R., & Fargier, P. (2020) · Motor Control · doi:10.1123/mc.2019-0071 · Cited by 3
Johnson, T. D., Buffington, M. L., Gates, M. W., Kula, R. R., & Talamas, E. J. (2021) · Journal of Chemical Ecology · doi:10.1007/s10886-020-01238-7 · Cited by 4
“We then tookmodels with significant effects and examined the pairwise differences between the means of our treatments with the general linear hypothesis multiple comparisons procedure with a Tukey HSD correction (functions glht and cld, multcomp package; Hothorn et al. 2008; Bretz et al. 2010).”
MethodZhan, T., Cui, L., Geng, Z., Zhang, L., Gu, Y., & Chan, I. S. F. (2021) · Statistics in Medicine · doi:10.1002/sim.9104 · Cited by 4
Kim, T. T., Xu, C., & DeRubeis, R. J. (2021) · Psychotherapy Research · doi:10.1080/10503307.2021.1938731 · Cited by 4
“We also applied the general linear hypothesis test function from the “multcomp” package (Bretz et al., 2016) to this model to generate estimates and to perform pairwise tests of the average importance rating for each of the 54 pairs of symptom and pre/post combination.”
MethodPineda, M. O., Gebauer, P., Briceño, F. A., López, B. A., & Paschke, K. A. (2021) · Aquaculture Reports · doi:10.1016/j.aqrep.2021.100824 · Cited by 4
Zhan, T., Zhou, Y., Geng, Z., Gu, Y., Kang, J., Wang, L., Huang, X., & Slate, E. H. (2021) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2021.1975128 · Cited by 4
“FWER is said to be controlled at level α in the strong sense if it does not exceed α under any configuration of true and false hypotheses (Bretz et al., 2016).”
BackgroundPompe, S., Hanspach, J., Badeck, F., Klotz, S., Bruelheide, H., & Kühn, I. (2014) · Frontiers of Biogeography · doi:10.21425/f56322502 · Cited by 4
High-Flow Nasal Cannula Therapy in Patients With COVID-19: Predictive Response Factors
Raboni, S. M., Neves, V. C., Silva, R. M., Breda, G. L., Ceregato, A. C. L., Broza, T. P., de Oliveira, G., Melo-Diaz, L. L., Braga, C. B., Carraro, C. F., et al. (2022) · Respiratory Care · doi:10.4187/respcare.09764 · Cited by 4
Phenological development of barnyard grass plants originating from different geographical locations
Ņečajeva, J., Royo‐Esnal, A., Loddo, D., Jensen, P., Taab, A., Synowiec, A., Uludağ, A., Üremiş, İ., Murdoch, A. J., Bochenek, A., et al. (2022) · Agronomy Journal · doi:10.1002/agj2.21219 · Cited by 4
Regulation of Jacobaea vulgaris by varied cutting and restoration measures
Wiggering, H., Diekötter, T., & Donath, T. W. (2022) · PLoS ONE · doi:10.1371/journal.pone.0248094 · Cited by 4
The dopamine effect on sea urchin larvae depends on their age
Kalachev, A. V., & Tankovich, A. E. (2023) · Development Growth & Differentiation · doi:10.1111/dgd.12839 · Cited by 4
“All p-values were adjusted by using the single-step method that is based on multivariate t-distribution (Bretz et al., 2010).”
MethodRoller, R. (2023) · Journal of Cultural Analytics · doi:10.22148/001c.57764 · Cited by 5
Confidence bounds for threshold similarity graph in random variable network
Koldanov, P. A., Koldanov, A. P., & Semenov, D. (2023) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11642 · Cited by 4
Galletti, C., Marco, L. D., Ciodaro, F., Freni, F., Saraniti, C., Galletti, F., & Galletti, B. (2024) · Journal of Voice · doi:10.1016/j.jvoice.2023.12.013 · Cited by 4
Many-to-one comparisons after safety selection in multi-arm clinical trials
Hlavin, G., Hampson, L. V., & Koenig, F. (2017) · PLoS ONE · doi:10.1371/journal.pone.0180131 · Cited by 4
Luz, R. L., Leite, M. F. A., Zelarayán, M. L. C., Boddey, R. M., & Gehring, C. (2020) · Acta Amazonica · doi:10.1590/1809-4392201903171 · Cited by 4
“The non-parametric Marcus test is robust against violations against normality and homogeneity of variance (Bretz et al. 2016).”
MethodMaglieri, V., Riccobono, M. G., Giunchi, D., & Palagi, E. (2021) · Journal of Ethology · doi:10.1007/s10164-021-00701-6 · Cited by 7
“We performed all pairwise comparisons for the levels of the multilevel factor with the Tukey test (Bretz et al. 2010) using the R package emmeans (Length et al.”
MethodDetterbeck, A., Hofmeister, M., Haddad, D., Weber, D. L., Schmid, M. C., Hölzing, A., Zabler, S., Hofmann, E., Hiller, K., Jakob, P. M., et al. (2016) · European Journal of Orthodontics · doi:10.1093/ejo/cjw047 · Cited by 4
“Comparisons were performed using general linear hypothesis tests (14, 15).”
MethodTorres, F., Rodríguez, M. A., Lavandero, B. I., & Fuentes‐Contreras, E. (2015) · International Journal of Agriculture and Natural Resources · doi:10.4067/s0718-16202015000300008 · Cited by 4
factorplot: Improving Presentation of Simple Contrasts in Generalized Linear Models
David, A. (2013) · The R Journal · doi:10.32614/rj-2013-021 · Cited by 4
“Chapter 2 of Bretz et al. (2011) provides a brief, but informative discussion of these general concepts.”
BackgroundMethodInfluentialZhong, Y., Sagnelli, D., Topbjerg, H. B., Hasler‐Sheetal, H., Andrzejczak, O., Hooshmand, K., Gislum, R., Jiang, D., Møller, I. M., Blennow, A., et al. (2019) · Journal of Experimental Botany · doi:10.1093/jxb/erz401 · Cited by 4
“For multiple tests, P-values were adjusted to control for Type-I errors by using the multivariate T-distribution, which computed the maximum of the involved test statistics (Bretz et al., 2011).”
Method
Metadata
- Authors
- Bretz, F., Hothorn, T., & Westfall, P.
- Affiliations
- Texas Tech University (US)
- Venue
- Chapman & Hall/CRC eBooks
- Publisher
- Chapman and Hall/CRC
- Published
- 2016-04-19
- OpenAlex
- W396053900
- Cited by
- 1,233
- References
- 93
- Citations by year
- 2026: 20 · 2025: 57 · 2024: 96 · 2023: 70 · 2022: 97 · 2021: 146 · 2020: 99 · 2019: 133 · 2018: 98 · 2017: 89 · 2016: 78
- FWCI
- 12.36
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Chapman & Hall/CRC eBooks (publishedVersion)
- Thammasat University Digital Collections (submittedVersion)
- TU Digital Collections (Thammasat University) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- multiple comparisons, R software, statistical software implementation, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
