The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Multiple Comparisons Using R
Abstract
Adopting a unifying theme based on maximum statistics, Multiple Comparisons Using R describes the common underlying theory of multiple comparison procedures through numerous examples. It also presents a detailed description of available software implementations in R. The R packages and source code for the analyses are available at https://CRAN.R-pro
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“After applying the Bonferroni correction for evaluating multiple probabilities (Bretz et al. 2010), only the projections of areas 7A and DP to area 10 were inconsistent despite a statistically very low probability of being so.”
From A Weighted and Directed Interareal Connectivity Matrix for Macaque Cerebral Cortex (2014) · cites this paper as Bretz et al. 2010
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Simultaneous Inference in General Parametric Models
Hothorn, T., Bretz, F., & Westfall, P. H. (2008) · Biometrical Journal · doi:10.1002/bimj.200810425 · Cited by 13,950
Self-citationGentleman R: R: A language for data analysis and graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,747
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 6,097
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
Šidák, Z. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10482935 · Cited by 2,904
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Discrete sequential boundaries for clinical trials
GORDON LAN, K. K., & DEMETS, D. L. (1983) · Biometrika · doi:10.1093/biomet/70.3.659 · Cited by 2,310
Flagged first, then by citations
Cited by
Sorted by citations
Items 201–300 of 1,000
Lozano, Y. M., Dueñas, J. F., Zordick, C., & Rillig, M. C. (2024) · Environmental Microbiology · doi:10.1111/1462-2920.16549 · Cited by 43
Bush, A., Zou, J. F., Lipski, W. J., Kokkinos, V., & Richardson, R. M. (2024) · Cerebral Cortex · doi:10.1093/cercor/bhae186 · Cited by 41
“The lmerTest package was used for linear mixed effects models (Kuznetsova et al. 2017) and multcomp for multiple comparisons (Bretz et al. 2011).”
MethodEcotone Effects on Seagrass and Saltmarsh Habitat Use by Juvenile Nekton in a Temperate Estuary
Baillie, C. J., Fear, J. M., & Fodrie, F. J. (2014) · Estuaries and Coasts · doi:10.1007/s12237-014-9898-y · Cited by 41
“Post hoc multiple comparison analyses for fixed effects was conducted using the multcomp procedure which conducts simultaneous tests and confidence intervals for linear mixed effects models while mitigating issues associated with multiplicity by employing exact multivariate t distribution or asymptotic multivariate no…”
MethodStark, H., Nothdurft, A., Block, J., & Bauhus, J. (2014) · Forest Ecology and Management · doi:10.1016/j.foreco.2014.12.003 · Cited by 41
“In order to account for unequal samples sizes the tests were performed according to the generalized linear hypothesis using the glht function of the multcomp library in R (Hothorn et al., 2008; Bretz et al., 2010) and were based on generalized linear models.”
MethodMerten, W., Appeldoorn, R. S., Rivera, R., & Hammond, D. (2014) · Marine Biology · doi:10.1007/s00227-014-2464-0 · Cited by 43
“a multiple comparison analysis based on Tukey’s method (Bretz et al. 2011) confirmed significant differences in depth use by time of day (Table 2).”
MethodInfluentialBrosché, M., & Kangasjärvi, J. (2012) · Journal of Experimental Botany · doi:10.1093/jxb/err358 · Cited by 41
“Ion-leakage data were analysed with a linear model and computing contrasts with Bonferroni corrections implemented in R (Bretz et al., 2010).”
Thermal oxidation does not fractionate soil organic carbon with differing biological stabilities
Schiedung, M., Don, A., Wordell‐Dietrich, P., Alcántara, V., Kuner, P., & Guggenberger, G. (2016) · Journal of Plant Nutrition and Soil Science · doi:10.1002/jpln.201600172 · Cited by 42
Hägele, F. A., Büsing, F., Nas, A., Hasler, M., Müller, M. J., Blundell, J. E., & Bosy‐Westphal, A. (2019) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2019-01164 · Cited by 41
Millesi, F., Weiss, T., Mann, A., Haertinger, M., Semmler, L., Supper, P., Pils, D., Naghilou, A., & Radtke, C. (2020) · The FASEB Journal · doi:10.1096/fj.202001447r · Cited by 39
Out, W. A., & Madella, M. (2015) · Archaeological and Anthropological Sciences · doi:10.1007/s12520-015-0235-6 · Cited by 40
“To test which populations differed from each other (if relevant), multiple contrast tests (e.g. Bretz et al. 2011) were conducted to compare the mean values of the several levels of the influence factors per taxon, i.e. mean values of pairs of populations were compared.”
MethodDevinck, F., & Kenneth Knoblauch, B. (2012) · Journal of Vision · doi:10.1167/12.3.19 · Cited by 40
Baillie, C. J., & Grabowski, J. H. (2018) · Marine Ecology Progress Series · doi:10.3354/meps12830 · Cited by 40
“This approach conducts simultaneous tests and calculates confidence intervals for mixed effects models using an asymptotic multivariate normal distribution (Bretz et al. 2010).”
MethodTehel, A., Streicher, T., Tragust, S., & Paxton, R. J. (2022) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2021.2255 · Cited by 40
“Pairwise comparisons between factor levels of a significant predictor were performed using post hoc tests, adjusting the family-wise error rate according to the method of Westfall (package ‘multcomp’ [32]).”
MethodMcQuillan, H. J., Nakagawa, S., & Mercer, A. R. (2012) · Learning & Memory · doi:10.1101/lm.025353.111 · Cited by 40
“For post-hoc analyses of pairwise differences, we used Fisher’s least significant difference implemented by the R function, glht in the package, multcomp (Bretz et al. 2011).”
MethodSupplemental Immobilization of Hanford Low-Activity Waste: Cast Stone Screening Tests
Pacific Northwest National Lab. (PNNL), R., Westsik, J. J., USDOE, Piepel, G., LINDBERG, M., Heasler, P., Mercier, T., Russell, R., COZZI, A., Daniel, W. E., et al. (2013) · doi:10.2172/1126363 · Cited by 40
“The MCP procedure used is a generalization of the Tukey Honestly Significant Difference (HSD) procedure, which is discussed by Bretz et al. (2010, 2013) and Hothorn et al. (2013).”
MethodImpact of low alcohol verbal descriptors on perceived strength: An experimental study
Vasiljevic, M., Couturier, D., & Marteau, T. M. (2017) · British Journal of Health Psychology · doi:10.1111/bjhp.12273 · Cited by 39
Jin, C., Jian, J., Bourque, C. P. ‐., Zha, T., Dai, L., Yang, Y., Fu, R., Chen, Q., Liu, P., Li, X., et al. (2024) · CATENA · doi:10.1016/j.catena.2024.108118 · Cited by 43
Assessment of DNA integrity (COMET assay) in sperm cells of boron-exposed workers
Duydu, Y., Başaran, N., Üstündağ, A., DİLSİZ, S. A., Ündeğer, Ü., Ataman, O. Y., Aydos, K., Düker, Y., Ickstadt, K., Waltrup, B. S., et al. (2011) · Archives of Toxicology · doi:10.1007/s00204-011-0743-9 · Cited by 39
“For the data of the COMET assay, a Dunnett test was applied to compare with one-sided hypotheses the low, medium and high exposure group with the control group (Bretz et al. 2010).”
MethodEőry, A., Gonda, X., Láng, Z., Torzsa, P., Kalman, J. L., Kalabay, L., & Rihmer, Z. (2014) · European Journal of General Practice · doi:10.3109/13814788.2013.868431 · Cited by 39
Harrison, P. M., Gutowsky, L. F. G., Martins, E. G., Patterson, D. A., Leake, A. J., Cooke, S. J., & Power, M. J. (2013) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-2013-0183 · Cited by 39
“Post hoc multiple comparisons tests were applied using the Tukey method using the multcomp package version 1.2-13 for R (Bretz et al. 2010).”
InfluentialA scientific understanding of keystroke dynamics
Maxion, R. A., & Killourhy, K. S. (2012) · Cited by 38
Scharinger, M., Monahan, P. J., & Idsardi, W. J. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.01.003 · Cited by 39
“Post-hoc analyses were calculated using the multcomp package in R (Bretz et al., 2011) and consisted of Tukey-adjusted t-tests with ztransformed t-values.”
MethodBonciarelli, U., Onofri, A., Benincasa, P., Farneselli, M., Guiducci, M., Pannacci, E., Tosti, G., & Tei, F. (2016) · European Journal of Agronomy · doi:10.1016/j.eja.2016.02.006 · Cited by 39
Grunt to go—Vocal coordination of group movements in redfronted lemurs
Sperber, A. L., Werner, L. M., Kappeler, P. M., & Fichtel, C. (2017) · Ethology · doi:10.1111/eth.12663 · Cited by 39
Layton, C., Cameron, M. J., Shelamoff, V., Fernández, P. A., Britton, D., Hurd, C. L., Wright, J. T., & Johnson, C. R. (2019) · Limnology and Oceanography · doi:10.1002/lno.11138 · Cited by 44
“Nonorthogonality of the contrast sets required adjustment of the p-values using the single-step method (Bretz et al. 2011).”
MethodAccounting for multiple testing in the analysis of spatio-temporal environmental data
Cortés, J., Mahecha, M. D., Reichstein, M., & Brenning, A. (2020) · Environmental and Ecological Statistics · doi:10.1007/s10651-020-00446-4 · Cited by 39
“If μ1 μ2, then μ1 μ3 and μ2 μ3 cannot both be true, and so the free combination condition is not satisfied (Bretz et al. 2011).”
Formicine ants swallow their highly acidic poison for gut microbial selection and control
Tragust, S., Herrmann, C. K., Häfner, J., Braasch, R., Tilgen, C., Hoock, M., Milidakis, M. A., Gross, R., & Feldhaar, H. (2020) · eLife · doi:10.7554/elife.60287 · Cited by 38
Well-Being Reduces COVID-19 Anxiety: A Three-Wave Longitudinal Study in China
Wang, Z., Luo, S., Xu, J., Wang, Y., Yun, H., Zhan, H., Zhan, H., & Wang, Y. (2021) · Journal of Happiness Studies · doi:10.1007/s10902-021-00385-2 · Cited by 40
Using General Messages to Persuade on a Politicized Scientific Issue
Green, J., Druckman, J., Baum, M., Lazer, D., Ognyanova, K., Simonson, M. D., Lin, J., Santillana, M., & Perlis, R. (2022) · British Journal of Political Science · doi:10.1017/s0007123422000424 · Cited by 19
Ishii, Y., Hayashi, S., & Takamura, N. (2017) · PLoS ONE · doi:10.1371/journal.pone.0171133 · Cited by 38
Pheromones modulate reward responsiveness and non-associative learning in honey bees
Baracchi, D., Devaud, J., d'Ettorre, P., & Giurfa, M. (2017) · Scientific Reports · doi:10.1038/s41598-017-10113-7 · Cited by 40
Interactive effects of forest die-off and drying-rewetting cycles on C and N mineralization
Rodríguez, A., Durán, J., Rey, A., Ioanna, B., Valladares, F., Gallardo, A., & Yuste, J. C. (2018) · Geoderma · doi:10.1016/j.geoderma.2018.07.003 · Cited by 38
Slow First, Fast Later: Temporal Speed‐Up in Service Episodes of Finite Duration
Deo, S., & Jain, A. (2018) · Production and Operations Management · doi:10.1111/poms.12972 · Cited by 38
Zaharudin, N., Tullin, M., Pekmez, C. T., Sloth, J. J., Rasmussen, R. R., & Dragsted, L. O. (2020) · Clinical Nutrition · doi:10.1016/j.clnu.2020.08.027 · Cited by 38
Scaling up interactive argumentation by providing counterarguments with a chatbot
Altay, S., Schwartz, M., Hacquin, A.-S., Allard, A., Blancke, S., & Mercier, H. (2022) · Nature Human Behaviour · doi:10.1038/s41562-021-01271-w · Cited by 39
Fister, A. S., O’Neil, S. T., Shi, Z., Zhang, Y., Tyler, B. M., Guiltinan, M. J., & Maximova, S. N. (2015) · Journal of Experimental Botany · doi:10.1093/jxb/erv334 · Cited by 37
Gong, Z., Jain, A., Tran, D. D., Yi, D. H., Wu, F., Zorn, A., Ratilal, P., & Makris, N. C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0104733 · Cited by 37
“statistical test [34] applies the Tukey method [126] for simultaneous pairwise multiple comparison with the quasi-Poisson generalized linear model (GLM) and log link in the statistical programming language ‘R’ [34,127,128] to humpback whale song occurrence over non-overlapping 11-day periods within a 33-day period acr…”
MethodBergmann, P. J., Pettinelli, K., Crockett, M. E., & Schaper, E. (2017) · Journal of Experimental Biology · doi:10.1242/jeb.161109 · Cited by 37
“When the fixed effect was significant, we used pairwise generalized linear hypothesis testing with the Benjamini–Hochberg correction for our post hoc tests (Bretz et al., 2010).”
MethodBaleba, S. B. S., Torto, B., Masiga, D. K., Weldon, C. W., & Getahun, M. N. (2019) · Scientific Reports · doi:10.1038/s41598-019-40479-9 · Cited by 36
Yawn contagion in domestic pigs (Sus scrofa)
Norscia, I., Coco, E., Robino, C., Chierto, E., & Cordoni, G. (2021) · Scientific Reports · doi:10.1038/s41598-020-80545-1 · Cited by 37
The BRCT domains of ECT2 have distinct functions during cytokinesis
Schneid, S., Wolff, F., Buchner, K., Bertram, N., Baygün, S., Barbosa, P., Mangal, S., & Zanin, E. (2021) · Cell Reports · doi:10.1016/j.celrep.2021.108805 · Cited by 32
Razafinarivo, N. J., Rakotomalala, J.-J., Brown, S., Bourge, M., Hamon, S., de Kochko, A., Poncet, V., Dubreuil-Tranchant, C., Couturon, E., Guyot, R., et al. (2012) · Tree Genetics & Genomes · doi:10.1007/s11295-012-0520-9 · Cited by 37
“All statistical analyses were performed using R software 2.11.1, (Bretz et al. 2010, http://cran.r-project.org/).”
MethodInfluentialMontory, J. A., Cumillaf, J. P., Cubillos, V. M., Paschke, K. A., Urbina, M. A., & Gebauer, P. (2017) · Aquaculture · doi:10.1016/j.aquaculture.2017.12.017 · Cited by 37
“(R Development Core Team, 2016), using the packages MASS (Venables and Ripley, 2002), survival (Therneau and Grambsch, 2000) and multicomp (Bretz et al., 2016) available the CRAN repository (www.r-project.org/).”
MethodBelotti, E., Weder, N., Bufka, L., Kaldhusdal, A., Küchenhoff, H., Seibold, H., Woelfing, B., & Heurich, M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0138139 · Cited by 34
“We conducted Tukey's all-pair comparisons to investigate differences between the different lynx statuses [65].”
MethodAversive learning of odor-heat associations in ants
Desmedt, L., Baracchi, D., Devaud, J., Giurfa, M., & d’Ettorre, P. (2017) · Journal of Experimental Biology · doi:10.1242/jeb.161737 · Cited by 36
“We used Tukey’s post hoc tests to detect differences both between stimuli and between regions (glht function from R package multcomp; Bretz et al., 2011).”
MethodVariability of earthworm-induced biopores and their hydrological effectiveness in space and time
Schneider, A., Hohenbrink, T. L., Reck, A., Zangerlé, A., Schröder, B., Zehe, E., & van Schaik, L. (2018) · Pedobiologia · doi:10.1016/j.pedobi.2018.09.001 · Cited by 36
Gehman, A.-L. M., & Harley, C. D. G. (2019) · Ecosphere · doi:10.1002/ecs2.2683 · Cited by 26
Nitrogen- and phosphorus-starved Triticum aestivum show distinct belowground microbiome profiles
Pagé, A. P., Tremblay, J., Masson, L., & Greer, C. W. (2019) · PLoS ONE · doi:10.1371/journal.pone.0210538 · Cited by 36
Subcortical short‐term plasticity elicited by deep brain stimulation
Awad, M. Z., Vaden, R. J., Irwin, Z. T., Gonzalez, C. L., Black, S. D., Nakhmani, A., Jaeger, B. C., Bentley, J. N., Guthrie, B. L., & Walker, H. C. (2021) · Annals of Clinical and Translational Neurology · doi:10.1002/acn3.51275 · Cited by 36
Quantitative analysis of disfluency in children with autism spectrum disorder or language impairment
MacFarlane, H., Gorman, K., Ingham, R., Presmanes Hill, A., Papadakis, K., Kiss, G., & van Santen, J. (2017) · PLOS ONE · doi:10.1371/journal.pone.0173936 · Cited by 32
Phylogenetic context determines the role of competition in adaptive radiation
Tan, J., Slattery, M. R., Yang, X., & Jiang, L. (2016) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2016.0241 · Cited by 35
Xu, S. X., Yuan, M., Zhu, H., Yang, Y., Wang, H., Zhou, H., Xu, J., Zhang, L., & Pinheiro, J. C. (2018) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.13577 · Cited by 35
Urinary Cortisol, Aggression, Dominance and Competition in Wild, West African Male Chimpanzees
Preis, A., Samuni, L., Deschner, T., Crockford, C., & Wittig, R. M. (2019) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2019.00107 · Cited by 37
Kumar, V., Kim, K., Joseph, C., Thomas, L. C., Hong, H., & Takahashi, J. S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1107726108 · Cited by 35
Brouwer, N. L., Hale, A. N., & Kalisz, S. (2015) · AoB Plants · doi:10.1093/aobpla/plv014 · Cited by 34
“Moreover, in the other two pre-treatment years (2004 and 2005), there is no difference between dormancy estimates [see Supporting Information—Table S2].”
InfluentialTaksonomia 19. Klasyfikacja i analiza danych - teoria i zastosowania
Naukowe, P. (2012) · Cited by 34
Calhoun, D. M., Leslie, K. L., Riepe, T. B., Achatz, T. J., McDevitt‐Galles, T., Tkach, V. V., & Johnson, P. T. J. (2019) · Journal of Helminthology · doi:10.1017/s0022149x18001244 · Cited by 37
“After detecting an overall difference between fishes and amphibians, we used species identity as a fixed effect, followed by Tukey pairwise comparisons using the glht function in the multcomp package as a post-hoc analysis of which species pairs differed (Hothorn et al., 2013; Bretz et al., 2016).”
MethodChen, J., Heikkinen, J. E. P., Hobbie, E. A., Rinne‐Garmston, K. T., Penttilä, R., & Mäkipää, R. (2019) · Fungal Biology · doi:10.1016/j.funbio.2019.03.005 · Cited by 34
Pyšek, P., Čuda, J., Šmilauer, P., Skálová, H., Chumová, Z., Lambertini, C., Lučanová, M., Ryšavá, H., Trávníček, P., Šemberová, K., et al. (2020) · Ecology and Evolution · doi:10.1002/ece3.5907 · Cited by 24
Koch, M., Winkelmann, M. K., Hasler, M., Pawelzik, E., & Naumann, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-65896-z · Cited by 34
Intraguild Interactions between Two Egg Parasitoids of a True Bug in Semi-Field and Field Conditions
Peri, E., Cusumano, A., Amodeo, V., Wajnberg, É., & Colazza, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0099876 · Cited by 34
Effects of forest certification on the ecological condition of Mediterranean streams
Dias, F. S., Bugalho, M. N., Rodríguez‐González, P. M., Albuquerque, A., & Cerdeira, J. O. (2014) · Journal of Applied Ecology · doi:10.1111/1365-2664.12358 · Cited by 34
Hormonal pleiotropy helps maintain queen signal honesty in a highly eusocial wasp
Oliveira, R. C., Vollet-Neto, A., Oi, C. A., van Zweden, J. S., do Nascimento, F. S., Brent, C. S., & Wenseleers, T. (2017) · Scientific Reports · doi:10.1038/s41598-017-01794-1 · Cited by 34
Effect of feed intake level on the body temperature of pigs exposed to heat stress conditions.
Cervantes, M., Antoine, D., Valle, J. A., Vásquez, N., Camacho, R. L., Bernal, H., & Morales, A. (2018) · Journal of Thermal Biology · doi:10.1016/j.jtherbio.2018.06.010 · Cited by 40
Amft, J., Meissner, P. M., Steffen‐Heins, A., Hasler, M., Stöckmann, H., Meynier, A., Birault, L., Velasco, J., Vermoesen, A., Pérez-Portabella, I., et al. (2023) · European Journal of Lipid Science and Technology · doi:10.1002/ejlt.202300067 · Cited by 33
Overview of multiple testing methodology and recent development in clinical trials
Wang, D., Li, Y., Wang, X., Liu, X., Fu, B., Lin, Y., Larsen, L. M., & Offen, W. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.07.014 · Cited by 33
Are Multiple Contrast Tests Superior to the ANOVA?
Konietschke, F., Bösiger, S., Brunner, E., & Hothorn, L. A. (2013) · The International Journal of Biostatistics · doi:10.1515/ijb-2012-0020 · Cited by 33
Gregorio, C. D., Zanoli, A., Valente, D., Torti, V., Bonadonna, G., Randrianarison, R. M., Giacoma, C., & Gamba, M. (2018) · Current Zoology · doi:10.1093/cz/zoy058 · Cited by 33
“We used a multiple contrast package (multcomp in R) to perform pairwise comparisons for each level of the factors with the Tukey test (Bretz et al. 2010), for which we then adjusted the P-values using the Bonferroni correction.”
MethodParental care buffers against effects of ambient temperature on offspring performance in an insect
Grew, R., Ratz, T., Richardson, J., & Smiseth, P. T. (2019) · Behavioral Ecology · doi:10.1093/beheco/arz100 · Cited by 33
“In the latter case, we 209 used Bonferroni correction to adjust p-values for multiple comparisons (Bretz et al. 2010).”
MethodCognitive task analysis and workload classification
Knisely, B. M., Joyner, J. S., & Vaughn-Cooke, M. (2021) · MethodsX · doi:10.1016/j.mex.2021.101235 · Cited by 38
“Many procedures exist, such as the Tukey test and Bonferroni correction, and most statistical programming packages will have built in functions to perform them [78] .”
MethodRadical change: temporal patterns of oxidative stress during social ascent in a dominance hierarchy
Fialkowski, R. J., Aufdemberge, P. M., Wright, V., & Dijkstra, P. D. (2021) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-021-02981-x · Cited by 33
Lanzicher, T., Martinelli, V. C., Long, C. S., Favero, G. D., Puzzi, L., Borelli, M., Mestroni, L., Taylor, M. R. G., & Sbaizero, O. (2015) · Nucleus · doi:10.1080/19491034.2015.1084453 · Cited by 33
Abílio, A. P., Marrune, P., de Deus, N., Mbofana, F., Muianga, P., & Kampango, A. (2015) · Malaria Journal · doi:10.1186/s12936-015-0885-y · Cited by 35
McConnachie, L. A., Botta, D., White, C. C., Weldy, C. S., Wilkerson, H.-W., Yu, J., Dills, R. L., Yu, X., Griffith, W. C., Faustman, E. M., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064165 · Cited by 33
Thick eggshells of brood parasitic cowbirds protect their eggs and damage host eggs during laying
López, A. V., Fiorini, V. D., Ellison, K. S., & Peer, B. D. (2018) · Behavioral Ecology · doi:10.1093/beheco/ary045 · Cited by 33
“When significant differences were found, multiple comparisons (Tukey’s post hoc tests) via the glht function in the “multcomp” package (Bretz et al. 2010) with adjusted P values were performed.”
MethodDaud, N., Currie, V., Duncan, G., Farquharson, F. M., Yoshinari, T., Louis, P., & Gratz, S. W. (2020) · Toxins · doi:10.3390/toxins12100654 · Cited by 33
“We us d the single step method o correct for multiple testing which adjusts t e p-values by using the joint t-dis ribut on for the contrasts [71].”
MethodHou, X., Meng, L., Li, L., Pan, G., & Li, B. (2015) · Journal of Applied Entomology · doi:10.1111/jen.12218 · Cited by 32
“When significant effect of biochar treatments was detected using the likelihood ratio test based on the change in deviance between models, Tukey’s all pairwise comparisons were performed using the multcomp package in R (Bretz et al. 2010).”
MethodBaseline and oxidative DNA damage in marine invertebrates
Sahlmann, A., Wolf, R. L., Holth, T. F., Titelman, J., & Hylland, K. (2017) · Journal of Toxicology and Environmental Health · doi:10.1080/15287394.2017.1352179 · Cited by 32
Goodale, E., Ratnayake, C. P., & Kotagama, S. W. (2014) · Ethology · doi:10.1111/eth.12202 · Cited by 32
“Models were run in R, version 3.0.1 (R Core Team 2013), using library lme4 (Bates et al. 2011); they were followed by multiple comparisons using the library multcomp (Bretz et al. 2010), adjusting the experiment-wide p-values by the Tukey Honestly Significant Difference method.”
MethodInfluentialAnalysing censored data in agricultural research: A review with examples and software tips
Onofri, A., Piepho, H., & Kozak, M. (2018) · Annals of Applied Biology · doi:10.1111/aab.12477 · Cited by 32
The combined effects of an extreme heatwave and wildfire on tallgrass prairie vegetation
Ratajczak, Z., Churchill, A. C., Ladwig, L. M., Taylor, J. H., & Collins, S. L. (2019) · Journal of Vegetation Science · doi:10.1111/jvs.12750 · Cited by 33
Loisel, A., Isla, A., & Daufresne, M. (2019) · Journal of Thermal Biology · doi:10.1016/j.jtherbio.2019.07.029 · Cited by 34
Growing or dormant season burns: the effects of burn season on bee and plant communities
Decker, B. L., & Harmon‐Threatt, A. (2019) · Biodiversity and Conservation · doi:10.1007/s10531-019-01840-6 · Cited by 30
Linguistic laws of brevity: conformity in Indri indri
Valente, D., Gregorio, C. D., Favaro, L., Friard, O., Miaretsoa, L., Raimondi, T., Ratsimbazafy, J., Torti, V., Zanoli, A., Giacoma, C., et al. (2021) · Animal Cognition · doi:10.1007/s10071-021-01495-3 · Cited by 31
“C O R For those models containing an interaction between two or more factors, we then performed all pairwise comparisons for each level of the interactions using a multiple contrast package ( multcomp in R, Bretz et al. 2010) with a Tukey post hoc test and we reported estimate, z value, and p value.”
Herbicide resistance across the Australi an continent
Busi, R., Beckie, H. J., Bates, A., Boyes, T., Davey, C., Haskins, B., Mock, S., Newman, P., Porri, A., & Onofri, A. (2021) · Pest Management Science · doi:10.1002/ps.6554 · Cited by 31
Quantification of vascular networks in photoacoustic mesoscopy
Brown, E. L., Lefebvre, T. L., Sweeney, P. W., Stolz, B. J., Gröhl, J., Hacker, L., Huang, Z., Couturier, D., Harrington, H. A., Byrne, H. M., et al. (2022) · Photoacoustics · doi:10.1016/j.pacs.2022.100357 · Cited by 31
“Two multiplicity corrections were performed to achieve a 5% family-wise error rate for each dataset: For each outcome, a parametric multiplicity correction on the segmentation method parameters was first used [65].”
MethodBecker, D. J., Oloya, J., & Ezeamama, A. E. (2015) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0004080 · Cited by 31
“We also tested for differences between groups within each exposure variable after adjusting for the potentially inflated false-discovery rate associated with multiple comparisons using the Benjamini and Hochberg correction andmultcomp package in R [54,55].”
MethodBaccini, A., Barabesi, L., Khelfaoui, M., & Gingras, Y. (2019) · Quantitative Science Studies · doi:10.1162/qss_a_00006 · Cited by 31
“Because the three statistical tests within each discipline are obviously dependent, we also consider the Bonferroni procedure in order to control the familywise error rate (for more details, see e.g., Bretz et al., 2011).”
MethodEfficacy assessment in crop protection: a tutorial on the use of Abbott’s formula
Piepho, H., Malik, W. A., Bischoff, R., El‐Hasan, A., Scheer, C., Sedlmeier, J. E., Gerhards, R., Petschenka, G., & Voegele, R. T. (2024) · Journal of Plant Diseases and Protection · doi:10.1007/s41348-024-00968-0 · Cited by 30
“The most stringent procedures control the family-wise type I error rate (Bretz et al. 2010).”
Sopinka, N., Hinch, S. G., Healy, S. J., Harrison, P. M., & Patterson, D. A. (2015) · Animal Behaviour · doi:10.1016/j.anbehav.2015.03.011 · Cited by 30
Bashir, T., Sailer, C., Gerber, F., Loganathan, N., Bhoopalan, H., Eichenberger, C., Grossniklaus, U., & Baskar, R. (2014) · PLANT PHYSIOLOGY · doi:10.1104/pp.114.238451 · Cited by 30
“To adjust the P values for multiple testing, the R package multcomp was used with the test specification “single-step” (Bretz et al., 2010).”
MethodAn Open Benchmark Challenge for Motion Correction of Myocardial Perfusion MRI
Pontré, B. P., Cowan, B. R., DiBella, E., Kulaseharan, S., Likhite, D., Noorman, N., Tautz, L., Tustison, N. J., Wollny, G., Young, A. A., et al. (2016) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2597145 · Cited by 30
Just, N., & Sonnay, S. (2017) · Frontiers in Physiology · doi:10.3389/fphys.2017.00030 · Cited by 30
“With the conservative Bonferroni correction (Bretz et al., 2011) one would assume that all variables were independent which was not necessarily the case.”
BackgroundMethodGebauer, P., Paschke, K. A., Vera, C., Toro, J. E., Pardo, L. M., & Urbina, M. A. (2017) · Chemosphere · doi:10.1016/j.chemosphere.2017.07.108 · Cited by 30
Convergent Evolution of Elongate Forms in Craniates and of Locomotion in Elongate Squamate Reptiles
Bergmann, P. J., Mann, S., Morinaga, G., Freitas, E. S., & Siler, C. D. (2020) · Integrative and Comparative Biology · doi:10.1093/icb/icaa015 · Cited by 30
Wang, J., Hasanaliyeva, G., Wood, L., Markellou, E., Iversen, P. O., Bernhoft, A., Seal, C. J., Barański, M., Vigar, V., Ernst, L., et al. (2020) · Food Chemistry · doi:10.1016/j.foodchem.2020.127011 · Cited by 30
Additional soil organic carbon stocks in hedgerows in crop-livestock areas of western France
Viaud, V., & Künnemann, T. (2020) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2020.107174 · Cited by 33
Reduction of ammonia emissions by applying a urease inhibitor in naturally ventilated dairy barns
Bobrowski, A. B., Willink, D., Janke, D., Amon, T., Hagenkamp-Korth, F., Hasler, M., & Hartung, E. (2021) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2021.01.011 · Cited by 30
Modesto, V., Dias, E., Ilarri, M., Lopes‐Lima, M., Teixeira, A., Varandas, S. D. G. P., Castro, P., Antunes, C., & Sousa, R. (2021) · Aquatic Conservation Marine and Freshwater Ecosystems · doi:10.1002/aqc.3618 · Cited by 30
“Tukey multiple pairwise-comparisons were calculated with the glht function in the package multcomp (Bretz, Hothorn & Westfall, 2010).”
MethodOnline Harassment in Majority Contexts: Examining Harms and Remedies across Countries
Schoenebeck, S. Y., Batool, A., Do, G., Darling, S., Grill, G., Wilkinson, D., Khan, M., Toyama, K., & Ashwell, L. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581020 · Cited by 42
“We used the Benjamini–Hochberg (BH) test to correct for multiple comparisons [12].”
Method
Metadata
- Authors
- Bretz, F., Hothorn, T., & Westfall, P.
- Affiliations
- Texas Tech University (US)
- Venue
- Chapman & Hall/CRC eBooks
- Publisher
- Chapman and Hall/CRC
- Published
- 2016-04-19
- OpenAlex
- W396053900
- Cited by
- 1,233
- References
- 93
- Citations by year
- 2026: 20 · 2025: 57 · 2024: 96 · 2023: 70 · 2022: 97 · 2021: 146 · 2020: 99 · 2019: 133 · 2018: 98 · 2017: 89 · 2016: 78
- FWCI
- 12.36
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Chapman & Hall/CRC eBooks (publishedVersion)
- Thammasat University Digital Collections (submittedVersion)
- TU Digital Collections (Thammasat University) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- multiple comparisons, R software, statistical software implementation, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
