The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Multiple Comparisons Using R
Abstract
Adopting a unifying theme based on maximum statistics, Multiple Comparisons Using R describes the common underlying theory of multiple comparison procedures through numerous examples. It also presents a detailed description of available software implementations in R. The R packages and source code for the analyses are available at https://CRAN.R-pro
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“After applying the Bonferroni correction for evaluating multiple probabilities (Bretz et al. 2010), only the projections of areas 7A and DP to area 10 were inconsistent despite a statistically very low probability of being so.”
From A Weighted and Directed Interareal Connectivity Matrix for Macaque Cerebral Cortex (2014) · cites this paper as Bretz et al. 2010
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Simultaneous Inference in General Parametric Models
Hothorn, T., Bretz, F., & Westfall, P. H. (2008) · Biometrical Journal · doi:10.1002/bimj.200810425 · Cited by 14,265
Self-citationGentleman R: R: A language for data analysis and graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,747
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 6,097
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
Šidák, Z. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10482935 · Cited by 2,904
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Discrete sequential boundaries for clinical trials
GORDON LAN, K. K., & DEMETS, D. L. (1983) · Biometrika · doi:10.1093/biomet/70.3.659 · Cited by 2,310
Flagged first, then by citations
Cited by
Sorted by citations
Items 601–700 of 1,000
Measuring Synchrony in Task-Based Dialogues
Reverdy, J., & Vogel, C. M. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1604 · Cited by 11
“To explore the influence of the variables (DialogType, Speaker, Level) depending on the type of repetitions (O THER S HARED and S ELF S HARED ) we computed single-step Tukey HSD (honest significant difference) multiple comparison tests using a general linear model with a binomial error family [21].”
MethodEduardo Jaramillo, L., Duarte, C., Labra, F. A., Lagos, N. A., Peruzzo, B., da Silva, R. H. P., Velásquez, C., Manzano, M., & Melnick, D. (2018) · AMBIO · doi:10.1007/s13280-018-1071-6 · Cited by 12
Statistical significance and p-values
Parsons, N., Carey-Smith, R. L., Dritsaki, M., Griffin, X. L., Metcalfe, D., Perry, D. C., Stengel, D., & Costa, M. L. (2019) · The Bone & Joint Journal · doi:10.1302/0301-620x.101b10.bjj-2019-0890 · Cited by 11
Mind maps as primers when reading-for-learning in elementary grades? An eye tracking study
Merchie, E., Catrysse, L., & Keer, H. V. (2021) · Instructional Science · doi:10.1007/s11251-020-09529-y · Cited by 11
“The output of the mixed effects models does not provide all comparisons within conditions and therefore contrast matrices were set up, and multiple comparisons of means (Tukey contrasts with Bonferroni correction) were calculated based on these (Bretz and Westfall 2011).”
MethodBobrowski, A. B., van Dooren, H. J. C., Ogink, N. W. M., Hagenkamp-Korth, F., Hasler, M., & Hartung, E. (2021) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2021.01.006 · Cited by 11
Arif, M. A., Alınç, T., Guarino, S., Colazza, S., Cusumano, A., & Peri, E. (2021) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2021.652561 · Cited by 11
The Effects of User Comments on Science News Engagement
Williams, S., & Hsieh, G. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449106 · Cited by 11
“Because the dimensions of our experimental manipulation (difficulty, information quality, entertainment) were not fully crossed, we utilize a modified Dunnett’s test [4] for our frequentist models to compare each experimental condition to both the base comment condition and the no-comment control condition, without co…”
MethodZunguza, A., Montes, R. M., Cubillos, L. A., & Quiñones, R. A. (2022) · Frontiers in Marine Science · doi:10.3389/fmars.2022.800759 · Cited by 11
“Adjusted p-values were calculated according to the number of hypotheses tested (Bretz et al., 2011).”
MethodHecker, M., Fitzner, B., Putscher, E., Schwartz, M., Winkelmann, A., Meister, S., Dudešek, A., Koczan, D., Lorenz, P., Boxberger, N., et al. (2022) · EBioMedicine · doi:10.1016/j.ebiom.2022.104052 · Cited by 12
Petersen, S. M., & Drewa, P. B. (2014) · Restoration Ecology · doi:10.1111/rec.12102 · Cited by 11
“Post-hoc tests and planned contrasts were conducted using the glht function in the multcomp package (Hothorn et al. 2008), and p-values were adjusted using the default single-step procedure (Bretz et al. 2011).”
MethodA new approach to overcome shortcomings with multiple testing of reproduction data in ecotoxicology
Lehmann, R., Bachmann, J., Maletzki, D., Polleichtner, C., Ratte, H. T., & Ratte, M. (2015) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-015-1079-4 · Cited by 11
“2010) will be applied in combination with the closure principle described by Bretz et al. (2011). Using CAT it is possible to test a multiple hypotheses ‘‘l0 1⁄4 lj1 1⁄4 1⁄4 ljl ’’ for some fj1; .”
BackgroundMethodVsevolozhskaya, O. A., Greenwood, M., Powell, S. L., & Zaykin, D. V. (2014) · Environmental and Ecological Statistics · doi:10.1007/s10651-014-0282-7 · Cited by 11
“For a detailed discussion of these different choices see Bretz et al. (2010).”
CR1 is potentially associated with rate of decline in sporadic Alzheimer’s disease
Schmidt, C., Wolff, M., von Ahsen, N., Lange, K., Friede, T., & Zerr, I. (2014) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2014.03.015 · Cited by 12
“The influence of the SNP listed above were analyzed in the resulting model by examining a potential ‘‘allele-dose-effect’’ using the Williams trend test [9].”
MethodAndrianasolo, D. N., Davis, A. P., Razafinarivo, N. J., Hamon, S., Rakotomalala, J.-J., Sabatier, S. A., & Hamon, P. (2013) · Tree Genetics & Genomes · doi:10.1007/s11295-013-0638-4 · Cited by 11
“2.11.1 (Bretz et al. 2010, http://cran.r-project.org/).”
InfluentialNigh, G. D. (2014) · Forestry An International Journal of Forest Research · doi:10.1093/forestry/cpu009 · Cited by 11
“The Holm multiple comparison procedure (Bretz et al., 2011) was applied to get an experiment-wise significant level of a1⁄4 0.”
MethodBlack Bass and Crappie Use of Installed Habitat Structures in Table Rock Lake, Missouri
Allen, M. J., Bush, S. C., Vining, I. W., & Siepker, M. J. (2014) · North American Journal of Fisheries Management · doi:10.1080/02755947.2013.862194 · Cited by 11
“We then compared the numbers of both legal-size and total black bass for significant model terms using Tukey multiple comparisons and P-values that were adjusted accordingly (Bretz et al. 2010).”
MethodProcessing Relative Clause Extractions in Swedish
Tutunjian, D., Heinat, F., Klingvall, E., & Wiklund, A.-L. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.02118 · Cited by 11
“This approach accounts for the correlations between the parameter estimates, yielding smaller p-values than the Bonferroni test (Bretz et al., 2016).”
Motor insurance claim modelling with factor collapsing and Bayesian model averaging
Hu, S. Z., O’Hagan, A. R., & Murphy, T. B. (2018) · Stat · doi:10.1002/sta4.180 · Cited by 11
“For the former, a standard approach is pairwise comparisons within factors with Tukey’s test (Tukey, 1949; Hothorn et al., 2008; Bretz et al., 2011), which determines which levels differ from one another simultaneously; penalization-based sparsity models (Tibshirani et al., 2005; Bondell & Reich,…”
MethodThe Impact of Health Claims in Different Product Categories
Profeta, A. (2019) · Journal of International Food & Agribusiness Marketing · doi:10.1080/08974438.2019.1599753 · Cited by 11
“The results contrast with the meta-analysis of Dolgopolova and Teuber (2016) and the findings of Bech-Larsen and Grunert (2003) who both stated that the preferences for a specific health benefit are significantly lower for dairy products like yoghurt.”
ResultAllerdice, M. E. J., Snellgrove, A. N., Hecht, J. A., Hartzer, K. L., Jones, E. S., Biggerstaff, B. J., Ford, S. L., Karpathy, S. E., la Mora, J. D.-D., la Mora, D. D.-D., et al. (2020) · Experimental and Applied Acarology · doi:10.1007/s10493-020-00557-4 · Cited by 11
“Crosses were compared using differences of means (and 95% confidence intervals [95% CIs]) estimated from the regression fits and utilizing sandwich estimators of variance in multiple comparisons to account for heteroscedasticity (Bretz et al. 2011).”
MethodPagabeleguem, S., Toé, A. I., Pooda, S. H., Dera, K. M., Belem, A. S., Bélem, A. M. G., Ouédraogo, G. M. S., Ira, M., Kaboré, B. A., Percoma, L., et al. (2021) · PLoS ONE · doi:10.1371/journal.pone.0245503 · Cited by 11
Riondato, I., Gamba, M., Tan, C. L., Niu, K., Narins, P. M., Yang, Y., & Giacoma, C. (2021) · Journal of Comparative Physiology A · doi:10.1007/s00359-021-01465-7 · Cited by 10
“We used a multiple contrast package (multcomp in R) to perform all pairwise comparisons for the levels of each factor with a Tukey test (Bretz et al. 2010).”
MethodRempelos, L., Wang, J., Barański, M., Watson, A., Volakakis, N., Hadall, C., Hasanaliyeva, G., Chatzidimitriou, E., Magistrali, A., Davis, H., et al. (2022) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqac233 · Cited by 11
“Significant interactions were further investigated by comparing interaction means using Tukey contrasts in the general linear hypothesis testing “glht” function of the multcomp package in R (45).”
MethodGrundlagen der Datenanalyse mit R
Wollschläger, D. (2010) · Springer eBooks · doi:10.1007/978-3-642-12228-6 · Cited by 11
Öztürk, I., Ottosen, C., & Ritz, C. (2012) · Acta Physiologiae Plantarum · doi:10.1007/s11738-012-1157-x · Cited by 11
“The extension package ‘multcomp’ in R was used to ensure that P values were adjusted for multiplicity (Bretz et al. 2010).”
MethodCensier, F., Chavalle, S., Martin, G. S., Proft, M. D., & Bodson, B. (2015) · Pest Management Science · doi:10.1002/ps.4046 · Cited by 11
Scharinger, M., Domahs, U., Klein, E., & Domahs, F. (2016) · Brain and Language · doi:10.1016/j.bandl.2016.09.002 · Cited by 10
Sheng, S., Ling, M., Wu, F., & Li, B. (2015) · Journal of Insect Science · doi:10.1093/jisesa/iev037 · Cited by 11
“When detecting a significant interaction effect between the two factors, we analyzed effects of predation risk treatments separately for L2 and L4 hosts, using Tukey multiple comparison of parameters with the multicomp package for the R statistical environment (Bretz et al. 2010).”
MethodRenovation of grasslands with grass and white clover – Effects on yield and carbon sequestration
Loges, R., Vogeler, I., Kluß, C., Hasler, M., & Taube, F. (2024) · Soil and Tillage Research · doi:10.1016/j.still.2024.106076 · Cited by 11
Bernasconi, Z., Herger, A., del Pilar, M., Kunz, L., Müller, M. C., Stirnemann, U., Outram, M. A., Widrig, V., Neidhart, M., Isaksson, J., et al. (2026) · Nature Plants · doi:10.1038/s41477-025-02180-w · Cited by 10
Yan, P., Lu, X., Liang, G., Tang, Q., & Ding, S. (2024) · Ecological Indicators · doi:10.1016/j.ecolind.2024.111795 · Cited by 10
Reduction in forest carbon stocks by sika deer-induced stand structural alterations
Abe, H., Kume, T., & Katayama, A. (2024) · Forest Ecology and Management · doi:10.1016/j.foreco.2024.121938 · Cited by 9
Pedruzzi, L., Oliveri, P., Francesconi, M., Lemasson, A., & Palagi, E. (2024) · American Journal of Primatology · doi:10.1002/ajp.23709 · Cited by 10
Gustafsson, L., Andersson, J. D., Jonsson, F., Jönsson, M. T., Jonsson, M., Nordin, U., Strengbom, J., & Johansson, V. (2025) · Journal of Applied Ecology · doi:10.1111/1365-2664.70090 · Cited by 10
Infant handling increases grooming towards mothers in wild geladas (Theropithecus gelada)
Caselli, M., Zanoli, A., Palagi, E., & Norscia, I. (2021) · Behavioural Processes · doi:10.1016/j.beproc.2021.104501 · Cited by 10
Takagi, E. (2022) · Entomologia Experimentalis et Applicata · doi:10.1111/eea.13229 · Cited by 10
“All statistical analyses were performed using R v.4.0.5 software (R Core Team, 2016), and the ‘multcomp’ (Bretz et al., 2010) and ‘car’ (Fox & Weisberg, 2018) packages.”
MethodInfluentialBurger, T. (2023) · PROTEOMICS · doi:10.1002/pmic.202200406 · Cited by 10
Krištůfek, V., Diviš, J., Omelka, M., Kopecký, J., & Ságová‐Marečková, M. (2015) · American Journal of Potato Research · doi:10.1007/s12230-015-9456-6 · Cited by 10
“To deal with the problem of multiple comparisons when all pairs of a given factor (e.g., cultivar) are compared, we used the methods described in Bretz et al. (2010) and implemented in the package Bmultcomp^.”
MethodAttention Training in Schoolchildren Improves Attention but Fails to Enhance Fluid Intelligence
Sarzyńska‐Wawer, J., Żelechowska, D., Falkiewicz, M., & Nȩcka, E. (2017) · Studia Psychologica · doi:10.21909/sp.2017.01.730 · Cited by 10
Statistical proof? The problem of irreproducibility
Holmes, S. (2017) · Bulletin of the American Mathematical Society · doi:10.1090/bull/1597 · Cited by 9
Linguistic repetitions, task-based experience and a proxy measure of mutual understanding
Reverdy, J., & Vogel, C. M. (2017) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2017.8268278 · Cited by 10
“To explore the influence of the variables (DialogType, Speaker, Level) depending on the type of repetitions (OTHERSHARED and SELFSHARED) we computed single-step Tukey HSD (honest significant difference) multiple comparison tests using a general linear model with a binomial error family [25].”
MethodSchull, Q., Viblanc, V. A., Dobson, F. S., Robin, J., Zahn, S., Cristofari, R., Bize, P., & Criscuolo, F. (2018) · Canadian Journal of Zoology · doi:10.1139/cjz-2017-0094 · Cited by 12
“Post-hoc Tukey HSD tests were conducted using the “multcomp” R package (Bretz et al. 2010).”
MethodLow dose of uranium induces multigenerational epigenetic effects in rat kidney
Grison, S., Elmhiri, G., Gloaguen, C., Elie, C., Kereselidze, D., Tack, K., Lestaevel, P., Legendre, A., Manens, L., Benadjaoud, M. A., et al. (2018) · International Journal of Radiation Biology · doi:10.1080/09553002.2018.1493242 · Cited by 12
The effect of dose expectancies on caffeine withdrawal symptoms during tapered dose reduction
Mills, L., Boakes, R. A., & Colagiuri, B. (2018) · Journal of Psychopharmacology · doi:10.1177/0269881118817158 · Cited by 10
Western European Populations of the Ichneumonid Wasp Hyposoter didymator Belong to a Single Taxon
Frayssinet, M., Audiot, P., Cusumano, A., Pichon, A., Malm, L. E., Jouan, V., Vabre, M., Malavieille, S., Delalande, M., Osuna, E. V., et al. (2019) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2019.00020 · Cited by 10
“Post-hoc comparisons were carried out using the glht function found in the multcomp package of the R statistical software (Bretz et al., 2010).”
MethodLinguistic Repetition in Three-Party Conversations
Reverdy, J., Koutsombogera, M., & Vogel, C. M. (2019) · Smart innovation, systems and technologies · doi:10.1007/978-981-13-8950-4_32 · Cited by 10
Fast closed testing for exchangeable local tests
Dobriban, E. (2019) · Biometrika · doi:10.1093/biomet/asz082 · Cited by 11
“For broader reviews of multiple testing, see for instance Hochberg and Tamhane (1987); Goeman and Solari (2014); Bretz et al. (2016).”
BackgroundDebarnot, U., Rienzo, F. D., Daligault, S., & Schwartz, S. (2020) · Brain Topography · doi:10.1007/s10548-020-00763-8 · Cited by 11
“As post-hoc analyses, main effects and interactions were investigated using general linear hypotheses testing of planned contrasts using the multcomp package (Bretz et al. 2010).”
MethodMaïga, H., Mamaï, W., Somda, N. S. B., Wallner, T., Poda, S. B., Salvador-Herranz, G., Argilés-Herrero, R., Yamada, H., & Bouyer, J. (2020) · Insects · doi:10.3390/insects11110801 · Cited by 10
A closed max‐t test for multiple comparisons of areas under the ROC curve
Blanche, P., Dartigues, J., & Riou, J. (2020) · Biometrics · doi:10.1111/biom.13401 · Cited by 10
“Although multiple testing has been extensively discussed during the last decades (Westfall et al., 2011; Bretz et al., 2016), it has been discussed less in the context of 352 © 2020 The International Biometric Society Biometrics.”
BackgroundMethodInfluentialA Novel Method to Characterize the Pacing Profile of Elite Male 1500-m Freestyle Swimmers
McGibbon, K. E., Pyne, D. B., Heidenreich, L. E., & Pla, R. (2020) · International Journal of Sports Physiology and Performance · doi:10.1123/ijspp.2020-0375 · Cited by 10
Smemo, K. A., Petersen, S. M., Kluber, L. A., Shaw, A. N., & DeForest, J. L. (2021) · Biogeochemistry · doi:10.1007/s10533-021-00814-7 · Cited by 10
“2) package (Bretz et al. 2011).”
Identification of ultrastructural signatures of sleep and wake in the fly brain
Flores, C. C., Loschky, S. S., Marshall, W., Spano, G. M., Cenere, M. M., Tononi, G., & Cirelli, C. (2021) · SLEEP · doi:10.1093/sleep/zsab235 · Cited by 10
Lygus rugulipennis on chrysanthemum: Supplemental prey effects and an evaluation of trap plants
Woelke, J. B., Bouw, M., Cusumano, A., & Messelink, G. J. (2022) · Journal of Applied Entomology · doi:10.1111/jen.13093 · Cited by 10
Preliminary test of ultrasonically disinfection efficacy towards selected aquaculture pathogens
Namkoong, H., Schroeder, J. P., Petrick, G., & Schulz, C. (2019) · Aquaculture · doi:10.1016/j.aquaculture.2019.734592 · Cited by 10
A statistical framework for efficient out of distribution detection in deep neural networksPreprint
Haroush, M., Frostig, T., Heller, R., & Soudry, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12967 · Cited by 29
“It is formalized asH0 : X ∼ P vs 1For example, p-values enable adjusting the decision rule when more than one hypothesis is tested at a time while maintaining a certain error criterion (Chapter 2 in Bretz et al. (2016)).”
BackgroundSommer, S. G., Li, X., Rosenqvist, E., & Liu, F. (2024) · Journal of Agronomy and Crop Science · doi:10.1111/jac.12685 · Cited by 9
The curious case of rhesus macaques: despotism does not prevent third-party postconflict affiliation
Aere, S., Pedruzzi, L., Facondini, G., Böye, M., Palagi, E., & Lemasson, A. (2024) · Animal Behaviour · doi:10.1016/j.anbehav.2024.10.036 · Cited by 9
Chen, Y., Li, X., Shu, Y., Li, Z., Yang, G., Wang, J., Wu, Q., Cao, W., Li, E., Liu, Y., et al. (2026) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2026.141267 · Cited by 9
Goodale, E., Ratnayake, C. P., & Kotagama, S. W. (2013) · Behaviour · doi:10.1163/1568539x-00003123 · Cited by 9
“05) were followed by multiple comparisons, using the multcomp library in R (Bretz et al., 2010) to control the experiment-wide alpha level by the Tukey Honestly Significant Difference method.”
MethodOwens, R. J., Tahk, A. M., Wohlfarth, P. C., & Bryan, A. C. (2015) · State Politics & Policy Quarterly · doi:10.1177/1532440014567858 · Cited by 9
Bazterrica, M. C., Álvarez, M. F., Iribarne, O. O., & Botto, F. (2020) · Journal of Sea Research · doi:10.1016/j.seares.2020.101971 · Cited by 10
Peri, E., Foti, M. C., Martorana, L., Cusumano, A., & Colazza, S. (2021) · BioControl · doi:10.1007/s10526-020-10075-2 · Cited by 9
“If models detected significant differences amongst factor levels, we proceeded to pairwise comparisons to determine which differed using the glht function in the multcomp package in R (Bretz et al. 2010).”
MethodHerbivore-herbivore interactions complicate links between soil fertility and pest resistance
Blubaugh, C. K., Carpenter‐Boggs, L., Reganold, J. P., & Snyder, W. E. (2021) · Basic and Applied Ecology · doi:10.1016/j.baae.2021.02.002 · Cited by 10
Liu, X., Maleki, F., Muthukrishnan, N., Ovens, K. L., Huang, S. H., Lara, A. P., Romero-Sánchez, G. T., Bhatnagar, S., Chatterjee, A., Pusztaszeri, M. P., et al. (2021) · Cancers · doi:10.3390/cancers13153723 · Cited by 9
Tupits, I., Tamm, I., Magistrali, A., Rempelos, L., Çakmak, İ., Leifert, C., Grausgruber, H., Wilkinson, A., Butler, G., & Bilsborrow, P. E. (2021) · Crop Science · doi:10.1002/csc2.20687 · Cited by 9
The Effect of Emotional Valence on Auditory Word Recognition Memory in English as a Foreign Language
Arriagada‐Mödinger, F., & Ferreira, R. A. (2022) · Journal of Psycholinguistic Research · doi:10.1007/s10936-022-09841-3 · Cited by 9
Assessing 3D vs. 2D habitat metrics in a Mediterranean ecosystem for a wiser wildlife management
Valderrama‐Zafra, J. M., Fernández-Rodríguez, P., Oya, A., Carrasco, R., Rubio–Paramio, M. Á., Garrido, M. S., & Azorit, C. (2022) · Ecological Informatics · doi:10.1016/j.ecoinf.2022.101623 · Cited by 10
Iwasaki, Y., Mano, H., & Shinohara, N. (2023) · Environmental Advances · doi:10.1016/j.envadv.2023.100348 · Cited by 9
Guscelli, E., Noisette, F., Chabot, D., Blier, P. U., Hansen, T., Ros, M. C., Pepin, P., Skanes, K. R., & Calosi, P. (2023) · Journal of Experimental Biology · doi:10.1242/jeb.245400 · Cited by 9
Habitat edge effects alter ant-guard protection against herbivory
Evans, D. M., Turley, N. E., & Tewksbury, J. J. (2013) · Landscape Ecology · doi:10.1007/s10980-013-9917-6 · Cited by 9
“This procedure is appropriate for models with a Poisson distribution and is based on a bootstrapping method that can produce reliable estimates with zero-inflated data (Westfall and Troendle 2008; Bretz et al. 2010).”
MethodIntermediate disturbance in experimental landscapes improves persistence of beetle metapopulations
Govindan, B. N., Feng, Z., DeWoody, Y. D., & Swihart, R. K. (2014) · Ecology · doi:10.1890/14-0044.1 · Cited by 9
Giresi, M., Grubbs, R. D., Portnoy, D. S., Driggers, W. B., Jones, L. M., & Gold, J. R. (2015) · Transactions of the American Fisheries Society · doi:10.1080/00028487.2015.1069212 · Cited by 9
“We also tested whether the species-specific mean (mi) of each spatiotemporal factor was the same as the grand mean (m) for that factor across all sampling events (H0: jmi ¡mD 0 for each species i) in an analysis of variance (ANOVA) framework by using the general linear hypothesis testing (GLHT) function available in t…”
MethodMethods for comparing multiple digital PCR experiments
Burdukiewicz, M. J., Rödiger, S., Sobczyk, P., Menschikowski, M., Schierack, P., & Mackiewicz, P. (2016) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2016.06.004 · Cited by 9
Is leaf pruning the key factor to successful biological control of aphids in sweet pepper?
Brenard, N., Bosmans, L., Leirs, H., Bruyn, L. D., Sluydts, V., & Moerkens, R. (2019) · Pest Management Science · doi:10.1002/ps.5565 · Cited by 9
Haas, C., Horn, R., Gerke, H. H., Dec, D., Zuniga, F. C., & Dörner, J. (2018) · Agro Sur · doi:10.4206/agrosur.2018.v46n2-05 · Cited by 9
“Multiple contrast tests (e.g., see Bretz et al., 2011, Schaarschmidt and Vaas, 2009) were used in order to compare the several levels of the influence factors.”
MethodHsu, Y.-Y. (2019) · PLoS ONE · doi:10.1371/journal.pone.0223502 · Cited by 9
Carvalho, R. L., Anjos, D. V., Fagundes, R., Luna, P., & Ribeiro, S. P. (2021) · Austral Ecology · doi:10.1111/aec.13001 · Cited by 9
Traoré, S., Ouédraogo, P., Bayen, P., Bationo, B. A., Lee, N., Lorenz, N., & Dick, R. P. (2021) · Land Degradation and Development · doi:10.1002/ldr.3979 · Cited by 9
Using Model Averaging to Determine Suitable Risk Measure Estimates
Miljkovic, T., & Grün, B. (2021) · North American Actuarial Journal · doi:10.1080/10920277.2021.1911668 · Cited by 9
“Such an analysis is commonly used in the area of experimental design to summarize the results; see, for example, the popular book by Bretz, Hothorn, and Westfall (2016).”
MethodGiovannetti, F., Pietto, M. L., Segretin, M. S., & Lipina, S. J. (2021) · Child Neuropsychology · doi:10.1080/09297049.2021.1998406 · Cited by 11
“Finally, multiple comparisons for the Mann–Whitney U-test and the Wilcoxon signed-rank test were corrected with the Bonferroni method (Bretz et al., 2016) assuming two comparisons for experimental groups analyses and four comparisons for performance and experimental groups analyses.”
MethodRoyo‐Esnal, A., Onofri, A., Loddo, D., Ņečajeva, J., Jensen, P. K., Economou, G., Taab, A., Synowiec, A., Calha, I., Andersson, L., et al. (2022) · Weed Research · doi:10.1111/wre.12525 · Cited by 9
Reliability of maximum spanning tree identification in correlation-based market networks
Kalyagin, V. A., Koldanov, A. P., & Koldanov, P. A. (2022) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2022.127482 · Cited by 9
“FWER is the probability of at least one Type I error [8], [3], [14].”
BackgroundDelayed processing of blood samples impairs the accuracy of mRNA-based biomarkers
Wilson, C., Dias, N. W. W., Pancini, S., Mercadante, V. R. G., & Biase, F. H. (2022) · Scientific Reports · doi:10.1038/s41598-022-12178-5 · Cited by 9
“05), we used the Ζ-test [50] and the Dunnett’s 543 approach [51] for simultaneous tests for general linear hypothesis [52, 53] to compare 544 the average of the groups T(3hr, 6hr, 8hr or 24hr) with the baseline T(1hr).”
MethodOut, W. A., Hasler, M., Portillo, M., & Bagge, M. S. (2022) · Vegetation History and Archaeobotany · doi:10.1007/s00334-022-00881-2 · Cited by 9
“Based on the statistical outcomes of the model (sample means and variances), multiple comparisons were conducted (Hothorn et al. 2008; see also Bretz et al. 2011).”
Zappe, K., Kopic, A., Scheichel, A., Schier, A.-K., Schmidt, L. E., Borutzki, Y., Miedl, H., Schreiber, M., Mendrina, T., Pirker, C., et al. (2023) · Cells · doi:10.3390/cells12111462 · Cited by 9
AgroReg: main regression models in agricultural sciences implemented as an R Package
Shimizu, G. D., & Gonçalves, L. S. A. (2023) · Scientia Agricola · doi:10.1590/1678-992x-2022-0041 · Cited by 9
“In these cases, if the experiment has adequate repetitions, they can be compared by the standard error of the differences or tests of means (Hsu, 1996; Bretz et al., 2011; Piepho and Edmondson, 2018).”
MethodWu, J., Pan, H., Zhang, J., Yang, S., & Zhao, M. (2015) · Journal of Insect Conservation · doi:10.1007/s10841-015-9805-2 · Cited by 9
“To determine pairwise comparisons between sampling sites, Tukey’s HSD post hoc test with the ‘TukeyHSD’ function in the ‘Multcomp’ package of R (Bretz et al. 2010) was employed.”
MethodDunnett‐type inference in the frailty Cox model with covariates
Herberich, E., & Hothorn, T. (2011) · Statistics in Medicine · doi:10.1002/sim.4403 · Cited by 9
Self-citationAdaptive divergence in embryonic thermal plasticity among Atlantic salmon populations
Côte, J., Roussel, J., Cam, S. L., Guillaume, F., & Evanno, G. (2016) · Journal of Evolutionary Biology · doi:10.1111/jeb.12896 · Cited by 8
“We performed Tukey’s tests using the Multcomp library in R (Bretz et al., 2010) to compare pairs of populations under each treatment.”
MethodUsing expert judgments to improve chronic wasting disease risk management in Canada
Oraby, T. F., Tyshenko, M. G., Westphal, M., Darshan, S., Croteau, M. C., Aspinall, W. P., ElSaadany, S., Cashman, N. R., & Krewski, D. R. (2016) · Journal of Toxicology and Environmental Health · doi:10.1080/15287394.2016.1174005 · Cited by 9
Denson, L. S., Sampson, D. B., & Stephens, A. (2017) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-2016-0277 · Cited by 9
“The linear hypothesis tests were executed using the “multcomp” R 299 package (Bretz et al. 2011).”
MethodLeplat, J., Mangin, P., Falchetto, L., Heraud, C., Gautheron, E., & Steinberg, C. (2017) · European Journal of Plant Pathology · doi:10.1007/s10658-017-1345-z · Cited by 9
Rienzo, F. D., Barlaam, F., Daligault, S., Delpuech, C., Roy, A. C., Bertrand, O., Jerbi, K., & Schmitz, C. (2019) · Human Brain Mapping · doi:10.1002/hbm.24571 · Cited by 9
Structural stabilization of soil backfill with quicklime
Zimmermann, I., Filser, S., Mordhorst, A., Fleige, H., & Horn, R. (2019) · Journal of Plant Nutrition and Soil Science · doi:10.1002/jpln.201800511 · Cited by 9
Bouvier, A., Riou, J., Thépot, S., Galy, A. S. D., François, S., Schmidt, A., Orvain, C., Estienne, M., Villate, A., Paz, D. L., et al. (2019) · Leukemia · doi:10.1038/s41375-019-0624-4 · Cited by 9
“For multiple comparisons, p-values were adjusted using the Hochberg procedure [35, 36], which allows a control of the Family Wise Error Rate at 5% [35, 36].”
MethodEffects of a common insecticide on wetland communities with varying quality of leaf litter inputs
Stoler, A. B., Mattes, B. M., Hintz, W. D., Jones, D. K., Lind, L. A., Schuler, M. S., & Relyea, R. A. (2017) · Environmental Pollution · doi:10.1016/j.envpol.2017.04.019 · Cited by 9
Zhan, T., Hartford, A. H., Kang, J., & Offen, W. (2019) · arXiv (Cornell University) · doi:10.1080/19466315.2020.1799855 · Cited by 9
“We adopt a popular assumption that the test statistics from m hypotheses follow a multivariate normal distribution (Dmitrienko and D’Agostino Sr, 2013; Bretz et al., 2016).”
MethodSupplemental Immobilization of Handford Low-Activity Waste: Cast Stone Screening Tests
Savannah River Site (SRS), A., Westsik, J. J., USDOE, Solutions, W. R. P., Piepel, G. F., Lindberg, M., Heasler, P. G., Mercier, T. M., Russell, R., Cozzi, A. D., et al. (2013) · doi:10.2172/1179684 · Cited by 9
Organic Fertilization Improves Soil Multifunctionality in Sugarcane Agroecosystems
Delmotte, S., Brunel, C., Castanier, L., Fevrier, A., Brauman, A., & Versini, A. (2024) · Agronomy · doi:10.3390/agronomy14112475 · Cited by 8
Metadata
- Authors
- Bretz, F., Hothorn, T., & Westfall, P.
- Affiliations
- Texas Tech University (US)
- Venue
- Chapman & Hall/CRC eBooks
- Publisher
- Chapman and Hall/CRC
- Published
- 2016-04-19
- OpenAlex
- W396053900
- Cited by
- 1,233
- References
- 93
- Citations by year
- 2026: 20 · 2025: 57 · 2024: 96 · 2023: 70 · 2022: 97 · 2021: 146 · 2020: 99 · 2019: 133 · 2018: 98 · 2017: 89 · 2016: 78
- FWCI
- 12.36
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Chapman & Hall/CRC eBooks (publishedVersion)
- Thammasat University Digital Collections (submittedVersion)
- TU Digital Collections (Thammasat University) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- multiple comparisons, R software, statistical software implementation, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
