The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Multiple Comparisons Using R
Abstract
Adopting a unifying theme based on maximum statistics, Multiple Comparisons Using R describes the common underlying theory of multiple comparison procedures through numerous examples. It also presents a detailed description of available software implementations in R. The R packages and source code for the analyses are available at https://CRAN.R-pro
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“After applying the Bonferroni correction for evaluating multiple probabilities (Bretz et al. 2010), only the projections of areas 7A and DP to area 10 were inconsistent despite a statistically very low probability of being so.”
From A Weighted and Directed Interareal Connectivity Matrix for Macaque Cerebral Cortex (2014) · cites this paper as Bretz et al. 2010
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Simultaneous Inference in General Parametric Models
Hothorn, T., Bretz, F., & Westfall, P. H. (2008) · Biometrical Journal · doi:10.1002/bimj.200810425 · Cited by 13,950
Self-citationGentleman R: R: A language for data analysis and graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,747
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 6,097
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
Šidák, Z. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10482935 · Cited by 2,904
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Discrete sequential boundaries for clinical trials
GORDON LAN, K. K., & DEMETS, D. L. (1983) · Biometrika · doi:10.1093/biomet/70.3.659 · Cited by 2,310
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–200 of 1,000
Kim, H., Gabbard, J. L., Añon, A. M., & Misu, T. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2793680 · Cited by 70
“Therefore, we performed post hoc contrast tests for planned comparisons among experimental conditions with Tukey’s adjustment for multiple comparisons [43].”
MethodZhang, X. (2017) · System · doi:10.1016/j.system.2017.03.019 · Cited by 44
Choosy grazers: Influence of plant traits on forage selection by three cattle breeds
Pauler, C. M., Isselstein, J., Suter, M., Bérard, J., Braunbeck, T. A., & Schneider, M. K. (2020) · Functional Ecology · doi:10.1111/1365-2435.13542 · Cited by 69
Breeding site sampling across the Arctic by individual males of a polygynous shorebird
Kempenaers, B., & Vâlcu, M. (2017) · Nature · doi:10.1038/nature20813 · Cited by 69
Pseudoreplication: a widespread problem in primate communication research
Waller, B. M., Warmelink, L., Liebal, K., Micheletta, J., & Slocombe, K. E. (2013) · Animal Behaviour · doi:10.1016/j.anbehav.2013.05.038 · Cited by 68
Initial and Long-Term Costs of Patients Hospitalized with West Nile Virus Disease
Staples, J. E., Shankar, M. B., Sejvar, J. J., Meltzer, M. I., & Fischer, M. (2014) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.13-0206 · Cited by 68
Hintze, S., Melotti, L., Colosio, S., Bailoo, J. D., Boada-Saña, M., Würbel, H., & Murphy, E. (2018) · Scientific Reports · doi:10.1038/s41598-018-23459-3 · Cited by 65
Roger, É., Pichat, C., Torlay, L., Olivier David, A., Renard, F., Banjac, S., Attyé, A., Minotti, L., Lamalle, L., Kahane, P., et al. (2019) · Human Brain Mapping · doi:10.1002/hbm.24839 · Cited by 63
Please turn off the lights: the effectiveness of visual prompts.
Sussman, R., & Gifford, R. (2012) · Applied Ergonomics · doi:10.1016/j.apergo.2011.09.008 · Cited by 66
“Furthermore, a priori contrasts between phases (conducted using the GLHT function from the multcomp package for R, Bretz et al., 2010) demonstrated that the rates of lights off changed significantly from A1 (6%, n ¼ 4) to B1 (41%, n ¼ 119), z ¼ 6.58, p .001, from B1 to A2 (19%, n ¼ 27), z ¼…”
MethodInfluentialGouthu, S., O’Neil, S. T., Di, Y., Ansariola, M., Megraw, M. S., & Deluc, L. G. (2014) · Journal of Experimental Botany · doi:10.1093/jxb/eru329 · Cited by 65
“Patterns of the expression progress from V to PostV (up-regulated, down-regulated, or plateaued) were determined by comparing the mean expression level among berry classes at PostV with that of véraison RS berries using a two-sided contrast analysis (FDR 0.05) (Bretz et al., 2010).”
MethodInfluentialThe temporal dependence of exploration on neotic style in birds
O’Hara, M., Mioduszewska, B., von Bayern, A. M. P., Auersperg, A. M. I., Bugnyar, T., Wilkinson, A., Huber, L., & Gajdon, G. K. (2017) · Scientific Reports · doi:10.1038/s41598-017-04751-0 · Cited by 65
Gazol, A., Camarero, J. J., Colangelo, M., de Luis, M., del Castillo, E. M., & Serra‐Maluquer, X. (2019) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2019.107695 · Cited by 65
Are multiple primary outcomes analysed appropriately in randomised controlled trials? A review
Vickerstaff, V., Ambler, G., King, M., Nazareth, I., & Omar, R. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.07.016 · Cited by 65
“A summary of these methods is provided below and further details can be found elsewhere [14,15].”
MethodLongitudinal analysis of regional cerebellum volumes during normal aging
Han, S., An, Y., Carass, A., Prince, J. L., & Resnick, S. M. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117062 · Cited by 64
“Since commonly used approaches to correct for multiple comparisons, including Bonferroni and false discovery rate corrections, do not fully account for these correlations (Bretz et al., 2011), the adjusted p-values are too conservative.”
Can College Students Accurately Assess What Affects Their Learning and Development?
Bowman, N., & Seifert, T. A. (2011) · Journal of college student development · doi:10.1353/csd.2011.0042 · Cited by 67
Zhang, X., Li, B., Xu, H. Y., Wells, M., Tefsen, B., & Qin, B. (2018) · Water Research · doi:10.1016/j.watres.2018.12.023 · Cited by 64
Miyamoto, D., Marshall, W., Tononi, G., & Cirelli, C. (2021) · Nature Communications · doi:10.1038/s41467-021-23156-2 · Cited by 60
Grande, F. D., Sharma, R., Meiser, A., Rolshausen, G., Büdel, B., Mishra, B., Thines, M., Otte, J., Pfenninger, M., & Schmitt, I. (2017) · BMC Evolutionary Biology · doi:10.1186/s12862-017-0929-8 · Cited by 63
“Pairwise population comparisons were then obtained from post hoc Tukey contrasts of the respective model predictors [48].”
MethodAssessment and Reduction of the Physical Parameterization Uncertainty for Noah‐MP Land Surface Model
Gan, Y., Liang, X., Duan, Q., Chen, F., Li, J., & Zhang, Y. (2019) · Water Resources Research · doi:10.1029/2019wr024814 · Cited by 63
“To test differences in all possible pairs of means, multiple comparison procedures are often used (Bretz et al., 2010).”
MethodYing, C., Goodale, U. M., Fan, X.-L., & Gao, J. (2015) · Global Ecology and Conservation · doi:10.1016/j.gecco.2015.01.002 · Cited by 62
“We conductedmultiple comparisons to test within-treatment differences after adjusting for alpha at 0.05 (Bretz et al., 2010) using the Tukey test in the mvtnorm and multcomp packages of R.”
MethodInfluentialRodea‐Palomares, I., Makowski, M., Gonzalo, S., González-Pleiter, M., Leganés, F., & Fernández‐Piñas, F. (2015) · Chemosphere · doi:10.1016/j.chemosphere.2015.05.078 · Cited by 62
Women's Perspectives on Harm and Justice after Online Harassment
Im, J., Schoenebeck, S. Y., Iriarte, M. P., Grill, G., Wilkinson, D., Batool, A., Alharbi, R., Funwie, A., Gankhuu, T., Gilbert, É., et al. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555775 · Cited by 75
“We used the Benjamini–Hochberg (BH) test to correct for multiple comparisons [18].”
MethodEfficacy of Nasal Cannula Oxygen as a Preoxygenation Adjunct in Emergency Airway Management
Hayes‐Bradley, C., Lewis, A., Burns, B., & Miller, M. R. (2015) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2015.11.012 · Cited by 60
Perceptual drifts of real and artificial limbs in the rubber hand illusion
Fuchs, X., Riemer, M., Diers, M., Flor, H., & Trojan, J. (2016) · Scientific Reports · doi:10.1038/srep24362 · Cited by 60
Brown, N., Vanguelova, E., Parnell, S., Broadmeadow, S., & Denman, S. (2017) · Forest Ecology and Management · doi:10.1016/j.foreco.2017.10.054 · Cited by 63
Rempelos, L., Wang, J., Barański, M., Watson, A., Volakakis, N., Hoppe, H.-W., Kühn‐Velten, W. N., Hadall, C., Hasanaliyeva, G., Chatzidimitriou, E., et al. (2021) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqab308 · Cited by 58
New normative standards of conditional reasoning and the dual-source model
Singmann, H., Klauer, K. C., & Over, D. E. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00316 · Cited by 61
“In fact, posthoc analysis using the methods implemented in multcomp (Bretz et al., 2011) revealed that only for MP was the estimated effect of 0.26 reliably above zero, z = 4.21, p 0.001.”
MethodInfluentialCatrysse, L., Gijbels, D., Donche, V., Mæyer, S. D., Lesterhuis, M., & den Bossche, P. V. (2017) · British Journal of Educational Psychology · doi:10.1111/bjep.12181 · Cited by 57
Profiles of fit and misfit: a repeated weekly measures study of perceived value congruence
Vleugels, W., Tierens, H., Billsberry, J., Verbruggen, M., & Cooman, R. D. (2019) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2019.1583279 · Cited by 57
Marconi, L., & Armengot, L. (2019) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2019.106664 · Cited by 57
Iwaizumi, E., & Webb, S. (2021) · TESOL Quarterly · doi:10.1002/tesq.3035 · Cited by 56
Rebelatto, C. L. K., Senegaglia, A. C., Franck, C. L., Daga, D. R., Shigunov, P., Stimamiglio, M. A., Marsaro, D. B., Schaidt, B., Micosky, A., de Azambuja, A. P., et al. (2022) · Stem Cell Research & Therapy · doi:10.1186/s13287-022-02796-1 · Cited by 56
Chen, Y., Collins, S. L., Zhao, Y., Zhang, T., Yang, X., An, H., Hu, G., Xin, C., Zhou, J., Sheng, X., et al. (2022) · Ecology · doi:10.1002/ecy.3862 · Cited by 56
Dai, W., Jin, H., Zhang, Y., Liu, T., & Zhou, Z. (2019) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2019.107702 · Cited by 56
Bishop, J. B., Kuo, G., & Kim, B. (2020) · Journal of Phonetics · doi:10.1016/j.wocn.2020.100977 · Cited by 56
Identification of Celastramycin as a Novel Therapeutic Agent for Pulmonary Arterial Hypertension
Kurosawa, R., Satoh, K., Kikuchi, N., Kikuchi, H., Saigusa, D., Al-Mamun, M. E., Siddique, M. A. H., Omura, J., Satoh, T., Sunamura, S., et al. (2019) · Circulation Research · doi:10.1161/circresaha.119.315229 · Cited by 56
Effects of chronic gamma irradiation: a multigenerational study using Caenorhabditis elegans
Buisset-Goussen, A., Goussen, B., Della-Vedova, C., Galas, S., Adam‐Guillermin, C., & Lecomte-Pradines, C. (2014) · Journal of Environmental Radioactivity · doi:10.1016/j.jenvrad.2014.07.014 · Cited by 54
Parafoveal processing affects outgoing saccade length during the reading of Chinese.
Liu, Y., Reichle, E. D., & Li, X. (2014) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000057 · Cited by 54
Chandelier, A., Gerarts, F., Martin, G. S., Herman, M., & Delahaye, L. (2016) · Forest Pathology · doi:10.1111/efp.12258 · Cited by 54
Salvia, É., Petit, C., Champely, S., Chomette, R., Rienzo, F. D., & Collet, C. (2016) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2016.00169 · Cited by 54
“Second, we carried out multiple comparisons using the method suitable to mixed effects models from Bretz et al. (2010).”
MethodFajardo, A., Gazol, A., Mayr, C., & Camarero, J. J. (2019) · Journal of Biogeography · doi:10.1111/jbi.13580 · Cited by 54
Scavo, A., Restuccia, A., Pandino, G., Onofri, A., & Mauromicale, G. (2018) · Italian Journal of Agronomy · doi:10.4081/ija.2018.1021 · Cited by 53
“Wherever necessary, contrasts between means were performed by using the procedures outlined in Bretz et al. (2011).”
MethodGazol, A., Camarero, J. J., Sangüesa‐Barreda, G., & Vicente-Serrano, S. M. (2018) · Frontiers in Plant Science · doi:10.3389/fpls.2018.01546 · Cited by 53
“When significant interactions between calendar year and species identity were found, we performed least-squares means based on and Tukey HSD tests to assess the differences between tree species (Bretz et al., 2010).”
MethodMhlanga, B., Ercoli, L., Pellegrino, E., Onofri, A., & Thierfelder, C. (2021) · Agronomy for Sustainable Development · doi:10.1007/s13593-021-00687-y · Cited by 52
“Means were compared using a multiple comparison procedure with single-step multiplicity adjustment (Bretz et al. 2016), as implemented in the emmeans package of R (Lenth 2019).”
MethodThiel, D. J., Nagy, L., Beierkuhnlein, C., Huber, G., Jentsch, A., Konnert, M., & Kreyling, J. (2012) · Forest Ecology and Management · doi:10.1016/j.foreco.2012.01.034 · Cited by 52
McCullough, D. G., Siegert, N. W., Poland, T. M., Pierce, S. J., & Ahn, S. Z. (2011) · Environmental Entomology · doi:10.1603/en11099 · Cited by 52
“This procedure is more powerful than alternatives such as Bonferroni adjustment, TukeyÕs honestly signiÞcant difference (HSD) test, or HolmÕs test, while still providing strong control over the family-wise error rate (Bretz et al. 2010).”
MethodGardinassi, L. G., Garcia, G. R., Costa, C. H. N., Silva, V. C., & Santos, I. K. F. D. M. (2016) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0005123 · Cited by 52
Szöcs, E., & Schäfer, R. B. (2015) · Environmental Science and Pollution Research · doi:10.1007/s11356-015-4579-3 · Cited by 52
Pauler, C. M., Isselstein, J., Bérard, J., Braunbeck, T. A., & Schneider, M. K. (2020) · Frontiers in Veterinary Science · doi:10.3389/fvets.2020.00494 · Cited by 61
Diagnostic accuracy of cerebrospinal fluid biomarkers in genetic prion diseases
Schmitz, M., Villar‐Piqué, A., Hermann, P., Escaramís, G., Calero, M., Cao, C., Kruse, N., Cramm, M., Golańska, E., Sikorska, B., et al. (2021) · Brain · doi:10.1093/brain/awab350 · Cited by 50
Free vs. transcribed text for keystroke-dynamics evaluations
Killourhy, K. S., & Maxion, R. A. (2012) · doi:10.1145/2379616.2379617 · Cited by 50
“The Bonferroni adjustment is known to be very conservative [4].”
BackgroundMor, J., Dolédec, S., Acuña, V., Sabater, S., & Muñoz, I. (2019) · Environmental Pollution · doi:10.1016/j.envpol.2019.05.114 · Cited by 56
Platelets Aggregate With Neutrophils and Promote Skin Pathology in Psoriasis
Herster, F., Bittner, Z., Codrea, M. C., Archer, N. K., Heister, M., Loeffler, M. W., Heumos, S., Wegner, J., Businger, R., Schindler, M., et al. (2019) · Frontiers in Immunology · doi:10.3389/fimmu.2019.01867 · Cited by 50
“healthy donors for each cell type (20).”
MethodBody size and evolution of motion dazzle coloration in lizards
Murali, G., Kodandaramaiah, U., & Fitzpatrick, J. (2018) · Behavioral Ecology · doi:10.1093/beheco/arx128 · Cited by 27
Carbon fluxes and budgets of intensive crop rotations in two regional climates of southwest Germany
Poyda, A., Wizemann, H., Ingwersen, J., Eshonkulov, R., Högy, P., Demyan, M. S., Kremer, P., Wulfmeyer, V., & Streck, T. (2019) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2019.02.011 · Cited by 53
Impacts of invasive trees on alpha and beta diversity of temperate forest understories
Dyderski, M. K., & Jagodziński, A. M. (2020) · Biological Invasions · doi:10.1007/s10530-020-02367-6 · Cited by 49
Steininger, M. S., Hulcr, J., igut, M., & Lucky, A. (2015) · Journal of Economic Entomology · doi:10.1093/jee/tov014 · Cited by 49
Norscia, I., Zanoli, A., Gamba, M., & Palagi, E. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00442 · Cited by 49
“We used a multiple contrast package (multcomp) to perform all pairwise comparisons for each bonding levels with the Tukey test (Bretz et al., 2010).”
MethodMcMahan, M. D., Sherwood, G. D., & Grabowski, J. H. (2020) · Frontiers in Marine Science · doi:10.3389/fmars.2020.567758 · Cited by 47
“Post hoc multiple comparison tests were conducted using the glht function in the “multcomp” package, which conducts simultaneous tests and computes confidence intervals for parametric models (Hothorn et al., 2008; Bretz et al., 2010).”
MethodGlobal contribution of invertebrates to forest litter decomposition
Zeng, X., Gao, H., Wang, R., Majcher, B. M., Woon, J. S., Wenda, C., Eggleton, P., Griffiths, H. M., & Ashton, L. A. (2024) · Ecology Letters · doi:10.1111/ele.14423 · Cited by 62
Pupal cocoons affect sanitary brood care and limit fungal infections in ant colonies
Tragust, S., Ugelvig, L. V., Chapuisat, M., Heınze, J., & Cremer, S. (2013) · BMC Evolutionary Biology · doi:10.1186/1471-2148-13-225 · Cited by 48
“We used the method of Westfall to adjust the family wise error rate for posthoc multiple comparisons between treatment levels [60].”
MethodInterspecific social information use in habitat selection decisions among migrant songbirds
Szymkowiak, J., Thomson, R., & Kuczyński, L. (2017) · Behavioral Ecology · doi:10.1093/beheco/arx029 · Cited by 48
“each species, we compared contrasts between the abundance on different treatment plots, using the R package “multcomp” (Bretz et al. 2010).”
Luis, P., Vallon, L., Tran, F. H., Hugoni, M., Van, V. T., Mavingui, P., Minard, G., & Moro, C. V. (2019) · Fungal ecology · doi:10.1016/j.funeco.2019.02.004 · Cited by 48
“Multiple comparisons analyses were performed between the different countries with a Tukey's all-pair comparisons test implemented in the package multcomp (Bretz et al., 2010).”
MethodRienzo, F. D., Joassy, P., Kanthack, T. F. D., Macintyre, T. E., Debarnot, U., Blache, Y., Hautier, C. A., Collet, C., & Guillot, A. (2019) · Neuroscience · doi:10.1016/j.neuroscience.2019.08.025 · Cited by 47
“We finally investigated main effects and interactions using general linear hypotheses testing of planned contrasts from the multcomp package (Hothorn et al., 2008; Bretz et al., 2016).”
MethodStatistical Modeling of Multivariate Destructive Degradation Tests With Blocking
Sun, Q., Ye, Z., & Hong, Y. (2019) · Technometrics · doi:10.1080/00401706.2019.1668855 · Cited by 47
Acevedo, T., Fricker, G. P., Garcia, J. R., Alcaide, T. Y., Berasategui, A., Stoy, K. S., & Gerardo, N. M. (2021) · Frontiers in Microbiology · doi:10.3389/fmicb.2021.719112 · Cited by 47
“Tukey′s post-hoc tests were used to calculate differences between the groups using the R package “multcomp” (Bretz et al., 2010).”
MethodMartínez, R., Navarro‐Martín, L., Antro, M. V., Fuertes, I., Casado, M., Barata, C., & Piña, B. (2019) · Chemosphere · doi:10.1016/j.chemosphere.2019.125704 · Cited by 48
In vitro antimicrobial sperm protection by an ejaculate‐like substance
Otti, O., McTighe, A., & Reinhardt, K. (2012) · Functional Ecology · doi:10.1111/1365-2435.12025 · Cited by 47
Goodale, E. B., Kotagama, S. W., Raman, T. R. S., Sidhu, S., Goodale, U. M., Parker, S., & Chen, J. (2013) · Forest Ecology and Management · doi:10.1016/j.foreco.2013.08.022 · Cited by 46
“The final reduced model was followed by multiple comparisons, reducing the alpha level for the number of tests made by the Tukey procedure, and using the package multcomp (Bretz et al., 2010).”
MethodOn the need to adjust for multiplicity in confirmatory clinical trials with master protocols
Stallard, N., Todd, S., Parashar, D., Kimani, P., & Renfro, L. A. (2019) · Annals of Oncology · doi:10.1093/annonc/mdz038 · Cited by 46
“In a con-firmatory trial setting, our proposal is therefore to adjust for multiplicity arising from hypothesis testing in multiple subgroups in such a trial, for example using a Holm–Bonferroni correction [18], or a method allowing for overlapping subgroups [19].”
Analysis of means: a generalized approach using R
Pallmann, P., & Hothorn, L. A. (2016) · Journal of Applied Statistics · doi:10.1080/02664763.2015.1117584 · Cited by 45
“An elaborate description of multiple comparisons using R is given in [7].”
MethodProbabilistic conditional reasoning: Disentangling form and content with the dual-source model
Singmann, H., Klauer, K. C., & Beller, S. (2016) · Cognitive Psychology · doi:10.1016/j.cogpsych.2016.06.005 · Cited by 45
Yang, J., Yan, P., He, R., & Song, X. (2017) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2017.02.003 · Cited by 45
Tehel, A., Streicher, T., Tragust, S., & Paxton, R. J. (2020) · Royal Society Open Science · doi:10.1098/rsos.200480 · Cited by 48
“Pairwise comparisons between factor levels of a significant predictor were performed using pairwise post hoc tests, adjusting the family-wise error rate according to the method of Bonferroni (package multcomp, [53]).”
MethodDiel, A., & MacDorman, K. F. (2021) · Journal of Vision · doi:10.1167/jov.21.4.1 · Cited by 47
“This correction was made by the Westfall method (Bretz, Hothorn, & Westfall, 2011).”
The effects of background coloration and dark spots on the risk of predation in poison frog models
Preißler, K., & Pröhl, H. (2017) · Evolutionary Ecology · doi:10.1007/s10682-017-9903-6 · Cited by 44
“Following this, pair-wise comparisons of means (multiple comparison procedures (MCP), Bretz et al. (2011)) were conducted by using Tukey all-pair comparisons (post hoc-test) for the fixed factors (R package ‘‘multcomp’’, Hothorn et al. (2008), function ‘‘glht’’, test = univariate).”
MethodGetting more out of the zebrafish light dark transition test
Haigis, A.-C., Ottermanns, R., Schiwy, A., Hollert, H., & Legradi, J. (2022) · Chemosphere · doi:10.1016/j.chemosphere.2022.133863 · Cited by 44
Šigutová, H., Šigut, M., & Dolný, A. (2015) · Journal of Insect Conservation · doi:10.1007/s10841-015-9813-2 · Cited by 43
“For post hoc comparisons between the levels of significant explanatory variables (i.e., the number of S. depressiusculum ovipositing in each pond) we used the function glht from the package multcomp (Hothorn et al. 2008) with Tukey pairwise multiple comparisons of means (Bretz et al. 2010).”
MethodSalazar, D., Kelm, D. H., & Marquis, R. J. (2013) · Ecology · doi:10.1890/12-1172.1 · Cited by 44
Njana, M. A., Meilby, H., Eid, T., Zahabu, E. M., & Malimbwi, R. E. (2016) · Annals of Forest Science · doi:10.1007/s13595-016-0583-0 · Cited by 44
“Post hoc tests were carried out using the glht function in multcomp package (Bretz et al. 2011).”
MethodTinya, F., Kovács, B., Prättälä, A., Farkas, P. A., Aszalós, R., & Ódor, P. (2018) · European Journal of Forest Research · doi:10.1007/s10342-018-1154-8 · Cited by 44
Zerr, I., Villar‐Piqué, A., Hermann, P., Schmitz, M., Varges, D., Ferrer, I., Riggert, J., Zetterberg, H., Blennow, K., & Llorens, F. (2021) · Alzheimer s Research & Therapy · doi:10.1186/s13195-021-00815-6 · Cited by 46
“Multiple comparisons of means were performed with Tukey contrasts, available in the multcomp R package [28].”
MethodChan, A., Yang, W., Chang, F., & Kidd, E. (2017) · Journal of Child Language · doi:10.1017/s0305000917000198 · Cited by 43
Eye movements of children and adults reading in three different orthographies.
Schroeder, S., Häikiö, T., Pagán, A., Dickins, J. H., Hyönä, J., & Liversedge, S. P. (2021) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001099 · Cited by 43
“If necessary, post hoc comparisons were conducted using cell means coding and defining contrasts using the glth function in the multcomp package (Bretz et al., 2011).”
MethodLozano, Y. M., Caesaria, P. U., & Rillig, M. C. (2022) · Frontiers in Environmental Science · doi:10.3389/fenvs.2022.1017349 · Cited by 41
“After this, in the selected model, we implemented the function “glht” and the “Dunnett” test from the “multcomp” R package (Hothorn et al., 2008; Bretz et al., 2011), in order to compare each microplastic type with the control (without microplastics).”
MethodPhotodegradation modifies microplastic effects on soil properties and plant performance
Lozano, Y. M., Gordillo‐Rocha, H., Waldman, W. R., & Rillig, M. C. (2023) · Journal of Applied Ecology · doi:10.1111/1365-2664.14514 · Cited by 44
Tralamazza, S. M., Gluck‐Thaler, E., Feurtey, A., & Croll, D. (2024) · Nature Communications · doi:10.1038/s41467-024-49913-7 · Cited by 47
“Analyses of differences among genetic clusters were performed using ANOVAs with the multcomp R package v.1.4-25 144 .”
InfluentialOberle, B., Covey, K., Dunham, K. M., Hernandez, E. J., Walton, M. L., Young, D. F., & Zanne, A. E. (2017) · Ecosystems · doi:10.1007/s10021-017-0136-x · Cited by 43
Preis, A., Samuni, L., Mielke, A., Deschner, T., Crockford, C., & Wittig, R. M. (2018) · Hormones and Behavior · doi:10.1016/j.yhbeh.2018.07.009 · Cited by 42
“Post-hoc pairwise comparisons of uOT levels among target behaviors were calculated using the function glht of the R package multcomp (Bretz et al., 2016) and without an adjustment of P-values.”
Sung, S. Y., Rhee, Y. W., Lee, J. E., & Choi, J. N. (2020) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2020.1718654 · Cited by 46
Richards, T. M., Sutton, T., & Wells, R. J. D. (2020) · Frontiers in Marine Science · doi:10.3389/fmars.2020.507992 · Cited by 43
The effect of carbon dioxide on growth and metabolism in juvenile turbot Scophthalmus maximus L.
Stiller, K. T., Vanselow, K., Moran, D., Bojens, G., Voigt, W., Meyer, S., & Schulz, C. (2015) · Aquaculture · doi:10.1016/j.aquaculture.2015.04.001 · Cited by 43
Sater, H. M., Ferrão, L. F. V., Olmstead, J. W., Muńoz, P., Bai, J., Hopf, A., & Plotto, A. (2021) · Scientia Horticulturae · doi:10.1016/j.scienta.2021.110468 · Cited by 42
Legacy effect of microplastics on plant–soil feedbacks
Lozano, Y. M., & Rillig, M. C. (2022) · Frontiers in Plant Science · doi:10.3389/fpls.2022.965576 · Cited by 43
“After that, we implemented the function “glht” and the “Dunnett” test from the “multcomp” R package (Hothorn et al., 2008; Bretz et al., 2011), in order to compare the effect of the soil inoculum conditioned by microplastics with the control (soil inoculum without being conditioned by…”
MethodHorváth, C. V., Kovács, B., Tinya, F., Locatelli, J. S., Németh, C., Crecco, L., Illés, G. Z., Csépányi, P., & Ódor, P. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.162302 · Cited by 42
Cao, J. Q., Zhu, Z., Wang, H., Nichols, T. C., Lui, G. Y. L., Deng, S., Rejto, P. A., VanArsdale, T. L., Hardwick, J. S., Weinrich, S. L., et al. (2019) · Oncogene · doi:10.1038/s41388-019-0708-7 · Cited by 42
Stock, F., Bilcke, G., Decker, S. D., Osuna‐Cruz, C. M., den Berge, K. V., Vancaester, E., Veylder, L. D., Vandepoele, K., Mangelinckx, S., & Vyverman, W. (2020) · Frontiers in Microbiology · doi:10.3389/fmicb.2020.01240 · Cited by 42
“We account for the multiplicity of tests on a global 5% significance level (Bretz et al., 2011).”
MethodZhu, A., Hopkins, K. M., Friedman, R. A., Bernstock, J. D., Broustas, C. G., & Lieberman, H. B. (2020) · Carcinogenesis · doi:10.1093/carcin/bgaa088 · Cited by 42
“PCR and tumor volume data were analyzed by ANOVA (30) corrected for multiple comparisons by Westfall’s method (31).”
MethodLinear models for diallel crosses: a review with R functions
Onofri, A., Terzaroli, N., & Russi, L. (2020) · Theoretical and Applied Genetics · doi:10.1007/s00122-020-03716-8 · Cited by 41
“Linear functions of model parameters can be built by using the standard facilities in R, such as the ‘glht()’ function in the ‘multcomp’ package (Bretz et al. 2011).”
MethodRanathunge, T., Harishchandra, J., Maïga, H., Bouyer, J., Gunawardene, Y. I. N. S., & Hapugoda, M. D. (2022) · PLoS ONE · doi:10.1371/journal.pone.0265244 · Cited by 41
“Similarly, Shetty et al. (2016) [34] observed that fertility decreased after exposing male Ae . aegypti to 20–50 Gy.”
Metadata
- Authors
- Bretz, F., Hothorn, T., & Westfall, P.
- Affiliations
- Texas Tech University (US)
- Venue
- Chapman & Hall/CRC eBooks
- Publisher
- Chapman and Hall/CRC
- Published
- 2016-04-19
- OpenAlex
- W396053900
- Cited by
- 1,233
- References
- 93
- Citations by year
- 2026: 20 · 2025: 57 · 2024: 96 · 2023: 70 · 2022: 97 · 2021: 146 · 2020: 99 · 2019: 133 · 2018: 98 · 2017: 89 · 2016: 78
- FWCI
- 12.36
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Chapman & Hall/CRC eBooks (publishedVersion)
- Thammasat University Digital Collections (submittedVersion)
- TU Digital Collections (Thammasat University) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- multiple comparisons, R software, statistical software implementation, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
