The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Multiple Comparisons Using R
Abstract
Adopting a unifying theme based on maximum statistics, Multiple Comparisons Using R describes the common underlying theory of multiple comparison procedures through numerous examples. It also presents a detailed description of available software implementations in R. The R packages and source code for the analyses are available at https://CRAN.R-pro
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“After applying the Bonferroni correction for evaluating multiple probabilities (Bretz et al. 2010), only the projections of areas 7A and DP to area 10 were inconsistent despite a statistically very low probability of being so.”
From A Weighted and Directed Interareal Connectivity Matrix for Macaque Cerebral Cortex (2014) · cites this paper as Bretz et al. 2010
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Simultaneous Inference in General Parametric Models
Hothorn, T., Bretz, F., & Westfall, P. H. (2008) · Biometrical Journal · doi:10.1002/bimj.200810425 · Cited by 13,950
Self-citationGentleman R: R: A language for data analysis and graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,747
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 6,097
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
Šidák, Z. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10482935 · Cited by 2,904
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Discrete sequential boundaries for clinical trials
GORDON LAN, K. K., & DEMETS, D. L. (1983) · Biometrika · doi:10.1093/biomet/70.3.659 · Cited by 2,310
Flagged first, then by citations
Cited by
Sorted by citations
Items 301–400 of 1,000
Kaldun, B., & Otti, O. (2016) · Ecology and Evolution · doi:10.1002/ece3.2073 · Cited by 30
“2008) to identify differences among feeding regimes adjusting P values according to the method by Westfall (Bretz et al. 2010).”
InfluentialMorrison, W. R., Allen, M. E. D. K. D., & Leskey, T. (2017) · Agricultural and Forest Entomology · doi:10.1111/afe.12229 · Cited by 30
“Upon a significant result from the model, multiple comparisons were made using the R package multcomp for generalized linear models (Bretz et al., 2010).”
MethodForaging bumblebees use social cues more when the task is difficult
Baracchi, D., Vasas, V., Iqbal, S. J., & Alem, S. (2017) · Behavioral Ecology · doi:10.1093/beheco/arx143 · Cited by 30
The effect of cover plants management on soil invertebrate fauna in vineyard in Northern Italy
Sommaggio, D., Peretti, E., & Burgio, G. (2018) · BioControl · doi:10.1007/s10526-018-09907-z · Cited by 30
“The procedure suggested by Delignette-Muller and Dutang (2015) was used to choose the best distribution to be applied in the GLM: a set of possible distributions were first selected by plotting empirical data and calculating skewness and kurtosis.”
MethodInfluentialInfluence of sample size, model selection, and land use on prediction accuracy of soil properties
Safaee, S., Libohova, Z., Kladivko, E. J., Brown, A. J., Winzeler, H. E., Read, Q. D., Rahmani, S. R., & Adhikari, K. (2024) · Geoderma Regional · doi:10.1016/j.geodrs.2024.e00766 · Cited by 29
Chen, S., Lin, S., Reinsch, T., Loges, R., Hasler, M., & Taube, F. (2015) · Grass and Forage Science · doi:10.1111/gfs.12214 · Cited by 29
Kurobe, T., Lehman, P. W., Haque, M. E., Sedda, T., Lesmeister, S. A., & Teh, S. J. (2017) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2017.07.267 · Cited by 29
Poetic speech melody: A crucial link between music and language
Menninghaus, W., Wagner, V., Knoop, C., & Scharinger, M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0205980 · Cited by 22
Anxiety Behavior in Pigs (Sus scrofa) Decreases Through Affiliation and May Anticipate Threat
Norscia, I., Collarini, E., & Cordoni, G. (2021) · Frontiers in Veterinary Science · doi:10.3389/fvets.2021.630164 · Cited by 30
Speaking Anxiety Level of Gaza EFL Pre-service Teachers: Reasons and Sources
Hammad, E. A., & Ghali, E. M. A. (2015) · World Journal of English Language · doi:10.5430/wjel.v5n3p52 · Cited by 29
Modeling Dose-Response Microarray Data in Early Drug Development Experiments Using R
Lin, D. Y., Shkedy, Z., Yekutieli, D., Amaratunga, D., & Bijnens, L. (2012) · Springer eBooks · doi:10.1007/978-3-642-24007-2 · Cited by 32
Outpatient groin hernia repair: assessment of 9330 patients from the French “Club Hernie” database
Hernie”, F. “., Drissi, F., Jurczak, F., Cossa, J.-P., Gillion, J. ‐., & Baayen, C. (2017) · Hernia · doi:10.1007/s10029-017-1689-5 · Cited by 29
Inductive reasoning, food neophobia, and domain-specificity in preschoolers
Rioux, C., Leglaye, L., & Lafraire, J. (2018) · Cognitive Development · doi:10.1016/j.cogdev.2018.05.001 · Cited by 29
A simple and flexible graphical approach for adaptive group-sequential clinical trials
Sugitani, T., Bretz, F., & Maurer, W. (2014) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2014.972509 · Cited by 28
“We used the gsDesign package (Anderson, 2014) in R for the calculation of the nominal significance levels; see, for example, Bretz et al. (2011a), for more details.”
BackgroundMethodSelf-citationWater quality dynamics in an urbanizing subtropical estuary(Oso Bay, Texas)
Wetz, M. S., Hayes, K. C., Fisher, K., Price, L. M., & Sterba‐Boatwright, B. (2016) · Marine Pollution Bulletin · doi:10.1016/j.marpolbul.2016.02.013 · Cited by 29
Schull, Q., Viblanc, V. A., Stier, A., Saadaoui, H., Lefol, E., Criscuolo, F., Bize, P., & Robin, J. (2016) · Journal of Experimental Biology · doi:10.1242/jeb.145250 · Cited by 31
“Tukey HSD post hoc comparisons (‘glht’ function from the ‘multcomp’ R package; Bretz et al., 2010) were used to compare responses of PII and PIII individuals.”
MethodMi, X., Swenson, N. G., Jia, Q., Rao, M., Feng, G., Ren, H., Bebber, D. P., & Ma, K. (2016) · Scientific Reports · doi:10.1038/srep32596 · Cited by 28
Mundim, F. M., Alborn, H. T., Vieira‐Neto, E. H. M., & Bruna, E. M. (2016) · Ecology · doi:10.1002/ecy.1619 · Cited by 28
“2.4; R Core Team 2016) with package lme4 (Bates et al. 2015), nlme (Pinheiro et al. 2016), and the glht function in package multcomp (Bretz et al. 2010).”
MethodInfluentialVasiljevic, M., Couturier, D., & Marteau, T. M. (2018) · Psychology of Addictive Behaviors · doi:10.1037/adb0000376 · Cited by 30
Salazar, P. C., Navarro-Cerrillo, R. M., Grados, N., Cruz, G., Barrón, V., & Villar, R. (2019) · Plant and Soil · doi:10.1007/s11104-019-03965-7 · Cited by 27
“The Tukey test was carried using the Bglht^ function from the Bmultcomp^ package (Bretz et al. 2016).”
MethodOta, A., Takagi, E., Yasuda, M., Hashim, M., Hosaka, T., & Numata, S. (2019) · Global Ecology and Conservation · doi:10.1016/j.gecco.2019.e00772 · Cited by 28
Quaglia, M., Santinelli, M., Sulyok, M., Onofri, A., Covarelli, L., & Beccari, G. (2020) · International Journal of Food Microbiology · doi:10.1016/j.ijfoodmicro.2020.108585 · Cited by 28
Standardization of the FAO/IAEA Flight Test for Quality Control of Sterile Mosquitoes
Maïga, H., Lu, D., Mamaï, W., Somda, N. S. B., Wallner, T., Bakhoum, M. T., Bueno-Masso, O., Martina, C., Kotla, S. S., Yamada, H., et al. (2022) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2022.876675 · Cited by 28
“Differences between the levels of significant fixed factors were analyzed using post hoc Tukey’s tests (glht function in package multcomp) (Bretz et al., 2016).”
MethodScott, M. W., Wood, G., Holmes, P. S., Marshall, B., Williams, J., & Wright, D. J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0284086 · Cited by 28
Foraging strategies associated with alternative reproductive tactics in a large mammal
Corlatti, L., Bassano, B., Valencak, T. G., & Lovari, S. (2013) · Journal of Zoology · doi:10.1111/jzo.12049 · Cited by 28
Brambilla, E., Ionescu, A. C., Cazzaniga, G., Edefonti, V. C., & Gagliani, M. M. (2014) · PubMed · Cited by 28
Tenzin, J., & Hasenauer, H. (2016) · International Journal of Biodiversity Science Ecosystems Services & Management · doi:10.1080/21513732.2016.1206038 · Cited by 28
“The glm procedure with the Tukey’s multiple comparison of means test was used for post-hoc comparison of the means between the zones (Bretz et al. 2010).”
MethodMangrove expansion into temperate marshes alters habitat quality for recruiting Callinectes spp.
Johnston, C., & Caretti, O. N. (2017) · Marine Ecology Progress Series · doi:10.3354/meps12176 · Cited by 28
Zeus, V. M., Reusch, C., & Kerth, G. (2018) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-018-2516-4 · Cited by 28
“P values were computed from the regression coefficients of the observed and random networks and corrected via Holm’s Sequential Bonferroni Procedure (Holm 1979; Bretz et al. 2016) in order to avoid Alpha errors due to multiple comparisons.”
MethodSimonis, M., der Linden, L. V., Galand, B., Hiligsmann, P., & Szmalec, A. (2019) · Bilingualism Language and Cognition · doi:10.1017/s136672891900021x · Cited by 32
Reproduction and maternal care increase oxidative stress in a mouthbrooding cichlid fish
Sawecki, J., Miros, E., Border, S. E., & Dijkstra, P. D. (2019) · Behavioral Ecology · doi:10.1093/beheco/arz133 · Cited by 28
Orgeret, F., Péron, C., Enstipp, M. R., Delord, K., Weimerskirch, H., & Bost, C. (2019) · Movement Ecology · doi:10.1186/s40462-019-0175-3 · Cited by 28
Sample size determination for clinical trials with co‐primary outcomes: exponential event times
Hamasaki, T., Sugimoto, T., Evans, S. R., & Sozu, T. (2012) · Pharmaceutical Statistics · doi:10.1002/pst.1545 · Cited by 27
“This overall power (2) is referred to as ‘complete power’ [24] or ‘conjunctive power’ [25, 26].”
BackgroundDevelopment and calibration of a soil carbon inventory model for New Zealand
McNeill, S. J. E., Golubiewski, N. E., & Barringer, J. R. F. (2014) · Soil Research · doi:10.1071/sr14020 · Cited by 26
de Souza, E. B., Ferreira, F. A., & Pott, A. (2016) · Acta Botanica Brasilica · doi:10.1590/0102-33062016abb0202 · Cited by 27
Arabidopsis MLO2 is a negative regulator of sensitivity to extracellular reactive oxygen species
Cui, F., Wu, H., Safronov, O., Zhang, P., Kumar, R., Kollist, H., Salojärvi, J., Panstruga, R., & Overmyer, K. (2018) · Plant Cell & Environment · doi:10.1111/pce.13144 · Cited by 27
Can honey bees discriminate between floral-fragrance isomers?
Aguiar, J. M. R. B. V., Roselino, A. C., Sazima, M., & Giurfa, M. (2018) · Journal of Experimental Biology · doi:10.1242/jeb.180844 · Cited by 27
Bürki, A., Frossard, J., & Renaud, O. (2018) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2018.09.016 · Cited by 27
Preite, V., Stöcklin, J., Armbruster, G. F. J., & Scheepens, J. F. (2015) · Evolutionary Ecology · doi:10.1007/s10682-015-9754-y · Cited by 27
Blanchet, M.-A., Biuw, M., Hofmeyr, G. J. G., de Bruyn, P. D., Lydersen, C., & Kovacs, K. (2013) · Marine Ecology Progress Series · doi:10.3354/meps10110 · Cited by 27
“Post hoc multiple comparison tests were performed using Tukey’s pairwise comparisons (mult comp package; Bretz et al. 2010) to assess the significance of the differences between factors and the interactions among factors.”
MethodHabitat patch shape, not corridors, determines herbivory and fruit production of an annual plant
Evans, D. M., Turley, N. E., Levey, D. J., & Tewksbury, J. J. (2012) · Ecology · doi:10.1890/11-0642.1 · Cited by 27
“We assessed differences between levels of categorical factors using the multcomp package (Hothorn et al. 2010) and the Westfall procedure for assigning P values (following Westfall [1997]; Bretz et al. 2010).”
MethodDeviation test construction and power comparison for marked spatial point patterns
Myllymäki, M., Grabarnik, P., Seijo, H., & Stoyan, D. (2015) · Jukuri (Natural Resources Institute Finland (Luke)) · Cited by 27
An Avatar's worth in the metaverse workplace: Assessing predictors of avatar customization valuation
Lim, C., Ratan, R., Foxman, M., Meshi, D., Liu, H., Hales, G. E., & Lei, Y. S. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108309 · Cited by 32
“…account for the large number of participants who reported $0 on all options, we utilized the double-hurdle model (Cragg, 1971; Heilbron, 1994; Mullahy, 1986) to explore predictors of valuation of avatar customization in the workplace via the multcomp package in R (Bretz, Hothorn, & Westfall, 2016).”
MethodIsochrony as ancestral condition to call and song in a primate
Gregorio, C. D., Maiolini, M., Raimondi, T., Carugati, F., Miaretsoa, L., Valente, D., Torti, V., Giacoma, C., Ravignani, A., & Gamba, M. (2024) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.15151 · Cited by 26
Vickerstaff, V., Ambler, G., & Omar, R. Z. (2021) · Biometrical Journal · doi:10.1002/bimj.201900040 · Cited by 26
Larssen, B. C., Ho, D. K., Kraeutner, S. N., & Hodges, N. J. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.614452 · Cited by 26
“Where relevant, between group differences across Adaptation and Retention tests were followed up with Tukey’s HSD post-hoc tests, using the multcomp package in R (Bretz et al., 2016).”
MethodOne, two, three: portable sample size in agricultural research
Piepho, H., Gabriel, D., Hartung, J., Büchse, A., Grosse, M., Kurz, S., Laidig, F., Michel, V., Proctor, I., Sedlmeier, J. E., et al. (2022) · The Journal of Agricultural Science · doi:10.1017/s0021859622000466 · Cited by 26
“In case of normal data, this means using Tukey’s test rather than the t-test (Bretz et al., 2011), and sample size calculations may be adjusted accordingly (Horn and Vollandt, 1995; Hsu, 1996).”
Beyond the Screen: Do Esports Participants Really Have More Physical Health Problems?
Tang, D., Sum, R. K. W., Ma, R., & Ho, W.-K. (2023) · Sustainability · doi:10.3390/su152316391 · Cited by 26
Sample sizes for trials involving multiple correlated must‐win comparisons
Julious, S. A., & McIntyre, N. E. (2012) · Pharmaceutical Statistics · doi:10.1002/pst.515 · Cited by 26
Rapid phenotypic changes in Caenorhabditis elegans under uranium exposure
Dutilleul, M., Lemaire, L., Réale, D. J. F., Lecomte-Pradines, C., Galas, S., & Bonzom, J. (2013) · Ecotoxicology · doi:10.1007/s10646-013-1090-9 · Cited by 26
“These analyses were followed by Tukey’s all-pair comparison tests (or t test with two tailed when only two groups were compared) on treatments in models for each generation and on generations in models for each treatment (Bretz et al. 2010).”
MethodDuran, N. D., Nicholson, S. P., & Dale, R. A. C. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.07.008 · Cited by 26
Auber, A., Travers‐Trolet, M., Villanueva, M. C., & Ernande, B. (2017) · Ecosphere · doi:10.1002/ecs2.2023 · Cited by 26
Tragust, S., Feldhaar, H., Espadaler, X., & Pedersen, J. S. (2015) · Biological Invasions · doi:10.1007/s10530-015-0917-0 · Cited by 26
“Statistical significance was assessed using an Ftest for GLM and a v2-test for GLMM, and all pairwise comparisons between levels of the predictor were tested using Tukey post hoc tests adjusting the familywise error rate according to the method of Westfall (package ‘‘multcomp’’, Bretz et al. 2011).”
MethodMULTIPLE ways to correct for MULTIPLE comparisons in MULTIPLE types of studies
Hollestein, L. M., Lo, S., Leonardi‐Bee, J., Rosset, S., Shomron, N., Couturier, D., & Gran, S. (2021) · British Journal of Dermatology · doi:10.1111/bjd.20600 · Cited by 26
Jin, C., Zha, T., Bourque, C. P. ‐., Fan, Z., Zhang, W., Di, K., Jiao, Y., Ma, Q., Yuan, D., Zhao, H., et al. (2024) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2024.110318 · Cited by 25
Hypothesis Testing for Mixture Model Selection
Punzo, A., Browne, R. P., & McNicholas, P. D. (2016) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2015.1131282 · Cited by 25
“An adjusted p -value represents the nat-ural counterpart, in the multiple testing framework, of the classical p -value (see, e.g. [ 32, p. 18]).”
MethodHykel, M., Harabiš, F., & Dolný, A. (2016) · European Journal of Entomology · doi:10.14411/eje.2016.062 · Cited by 25
Bevers, C., Blanckaert, G., Keer, K. V., Fils, J., Vandewalle, E., & Stalmans, I. (2018) · Acta Ophthalmologica · doi:10.1111/aos.13940 · Cited by 25
“When the Shapiro-Wilks test indicated nonsignificant deviation from the normality, we performed multiple comparison tests for paired normally distributed data using the multcomp R package and taking the Goldmann group as reference (Bretz et al. 2011).”
MethodMagistrali, A., Vavera, R., Janovská, D., Rempelos, L., Çakmak, İ., Leifert, C., Grausgruber, H., Butler, G., Wilkinson, A., & Bilsborrow, P. E. (2020) · Field Crops Research · doi:10.1016/j.fcr.2020.107869 · Cited by 26
Goeman, J. J., & Solari, A. (2021) · The American Statistician · doi:10.1080/00031305.2021.2002188 · Cited by 25
Grieco, E., Vangi, E., Chiti, T., & Collalti, A. (2024) · Journal of Environmental Management · doi:10.1016/j.jenvman.2024.121993 · Cited by 35
Sarikhani, E., Ságová‐Marečková, M., Omelka, M., & Kopecký, J. (2016) · FEMS Microbiology Ecology · doi:10.1093/femsec/fiw206 · Cited by 25
Cold tolerance of third-instar Drosophila suzukii larvae
Jakobs, R., Ahmadi, B., Houben, S., Gariépy, T. D., & Sinclair, B. J. (2016) · Journal of Insect Physiology · doi:10.1016/j.jinsphys.2016.10.008 · Cited by 25
“We used the ghlt() function of the package multcomp in R (Bretz et al., 2011) to run a Tukey’s post hoc comparison using the treatment stage interaction.”
MethodCross-Screening in Observational Studies That Test Many Hypotheses
Zhao, Q., Small, D. S., & Rosenbaum, P. R. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1407770 · Cited by 28
Agricultural matrices affect ground ant assemblage composition inside forest fragments
Assis, D. S., dos Santos, I. A., Ramos, F. N., Barrios, K., Majer, J. D., & VILELA, E. F. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197697 · Cited by 25
Herbivorous fish rise as a destructive fishing practice falls in an Indonesian marine national park
Bejarano, S., Pardede, S., Campbell, S., Hoey, A. S., & Ferse, S. C. A. (2019) · Ecological Applications · doi:10.1002/eap.1981 · Cited by 25
Wang, J., Hasanaliyeva, G., Wood, L., Anagnostopoulos, C. J., Ampadogiannis, G., Bempelou, E. D., Kiousi, M., Markellou, E., Iversen, P. O., Seal, C. J., et al. (2020) · Food Chemistry X · doi:10.1016/j.fochx.2020.100089 · Cited by 25
Taxon‐specific response of natural enemies to different flower strip mixtures
Blümel, S., Beule, L., Bissantz, N., Kirchner, W. H., & Haberlah‐Korr, V. (2024) · Journal of Applied Ecology · doi:10.1111/1365-2664.14761 · Cited by 24
“For statistical inference of fixed effects, we used the methods suggested by Hothorn et al. ( 2008 ) and Bretz et al. ( 2010 ) for significant effects of a priori selected parameters relevant to the hypotheses implemented in the glht method for Tukey contrasts from the R-package ‘multcomp’ version…”
MethodKindergartners’ performance in two types of imaginary perspective-taking
van den Heuvel‐Panhuizen, M., Elia, I., & Robitzsch, A. (2015) · ZDM · doi:10.1007/s11858-015-0677-4 · Cited by 24
“The significance levels were adjusted for multiple testing using the Holm method (Bretz et al. 2010).”
MethodEscobar‐García, D. M., Razo, L. M. D., Sánchez-Peña, L. C., Mandeville, P. B., Campos, C. L., & Escudero‐Lourdes, C. (2012) · Archives of Toxicology · doi:10.1007/s00204-012-0802-x · Cited by 24
“If the explicative variable that resulted signiWcant was discrete, Tukey’s HSD (honestly signiWcant diVerence) test was performed using Multicomp computer package software (Bretz et al. 2011).”
MethodShin, S. H., Chung, Y., & Rosenberg, R. D. (2016) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13038 · Cited by 28
“In latter analysis, we used the Bonferroni corrections for multiple comparisons within each timing/chronicity variable and each outcome (Bretz et al., 2010).”
MethodRůžičková, J., & Veselý, M. (2017) · Entomological Science · doi:10.1111/ens.12286 · Cited by 24
“As posthoc comparisons of pairwise differences between the mean covered distances in different daytime classes we used the glht function from the “multcomp” package (Hothorn et al. 2008) with Tukey contrasts for multiple comparisons of means (Bretz et al. 2010).”
MethodMallik, A. U., & Kayes, I. (2018) · Forest Ecology and Management · doi:10.1016/j.foreco.2018.05.064 · Cited by 24
Brinker, P., Weig, A. R., Rambold, G., Feldhaar, H., & Tragust, S. (2018) · Fungal ecology · doi:10.1016/j.funeco.2018.08.007 · Cited by 24
McMahan, M. D., & Grabowski, J. H. (2019) · Ecosphere · doi:10.1002/ecs2.2867 · Cited by 26
Statistical Significance Testing for Natural Language Processing
Dror, R., Peled-Cohen, L., Shlomov, S., & Reichart, R. (2020) · Synthesis lectures on human language technologies · doi:10.2200/s00994ed1v01y202002hlt045 · Cited by 55
Nyameasem, J. K., Reinsch, T., Taube, F., Domozoro, C. Y. F., Marfo-Ahenkora, E., Emadodin, I., & Malisch, C. S. (2020) · SOIL · doi:10.5194/soil-6-523-2020 · Cited by 24
Reinsch, T., Malisch, C. S., Loges, R., & Taube, F. (2020) · Grass and Forage Science · doi:10.1111/gfs.12496 · Cited by 25
Bulgarini, G., Badra, Z., Leonardi, S., & Maistrello, L. (2020) · BioControl · doi:10.1007/s10526-020-10066-3 · Cited by 24
Fanghella, V., Ploner, M., & Tavoni, M. (2021) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2021.101709 · Cited by 24
Reversing a tyranny of cascading shoreline‐protection decisions driving coastal habitat loss
Gittman, R. K., Scyphers, S. B., Baillie, C. J., Brodmerkel, A., Grabowski, J. H., Livernois, M. C., Poray, A. K., Smith, C. S., & Fodrie, F. J. (2021) · Conservation Science and Practice · doi:10.1111/csp2.490 · Cited by 25
Kuhn, A., Hautier, L., & Martin, G. S. (2022) · PeerJ · doi:10.7717/peerj.14093 · Cited by 24
“We then computed all pairwise comparisons between the three treatments with p-value correction (Post-hoc tests), single-step method from multcomp R package, (Hothorn, Bretz & Westfall, 2008; Bretz et al., 2010) and we report the 95% confidence intervals around the values predicted by the model.”
MethodSenatore, M. T., Prodi, A., Tini, F., Balmas, V., Infantino, A., Onofri, A., Cappelletti, E., Oufensou, S., Sulyok, M., Covarelli, L., et al. (2023) · Journal of the Science of Food and Agriculture · doi:10.1002/jsfa.12526 · Cited by 24
Fish depth redistributions do not allow maintenance of abundance in a region of rapid change
Chaikin, S., & Belmaker, J. (2023) · Oikos · doi:10.1111/oik.09650 · Cited by 27
Multiplicity Issues in Clinical Trials With Multiple Objectives
Huque, M. F., Dmitrienko, A. A., & D’Agostino, R. B. (2013) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2013.807749 · Cited by 24
Šišić, A., Al‐Hatmi, A. M. S., Baćanović-Šišić, J., Ahmed, S. A., Dennenmoser, D., de Hoog, S., & Finckh, M. R. (2018) · Antonie van Leeuwenhoek · doi:10.1007/s10482-018-1068-y · Cited by 24
“determine whether biomass of inoculated treatments differed significantly from biomass of the corresponding non-inoculated controls, data were analysed with one-way analysis of variance (ANOVA) and Dunnett’s posthoc test (Bretz et al. 2011).”
MethodHanane, S., Cherkaoui, S. I., Magri, N., & Yassin, M. (2018) · Agroforestry Systems · doi:10.1007/s10457-018-0281-z · Cited by 24
Chatzopoulou, F. M., Gioula, G., Kioumis, I. P., Chatzidimitriou, D., & Exindari, M. (2018) · Medical Microbiology and Immunology · doi:10.1007/s00430-018-0567-9 · Cited by 24
“Moreover, Tukey’s Honest Significant Difference (HSD) for post-hoc test was used to fix type I errors through the glht function of multcomp package [37].”
MethodRelationship of Coefficient of Permeability, Porosity, and Air Voids in Fine-Graded HMA
Chen, S., Adhikari, S., & You, Z. (2018) · Journal of Materials in Civil Engineering · doi:10.1061/(asce)mt.1943-5533.0002573 · Cited by 24
Sen, T., Hasan, M. K., Teicher, Z., & Hoque, M. E. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3161178 · Cited by 24
Goff, N. L., Ottorini, J.-M., & Ningre, F. (2011) · Annals of Forest Science · doi:10.1007/s13595-011-0052-8 · Cited by 24
Contrasting effects of aquatic subsidies on a terrestrial trophic cascade
Graf, N., Bucher, R., Schäfer, R. B., & Entling, M. H. (2017) · Biology Letters · doi:10.1098/rsbl.2017.0129 · Cited by 23
Struck, I. J. A., Reinsch, T., Herrmann, A., Kluß, C., Loges, R., & Taube, F. (2019) · European Journal of Agronomy · doi:10.1016/j.eja.2019.04.009 · Cited by 23
Yawn contagion in bonobos: Another group, another story
Norscia, I., Caselli, M., Meo, G. D., Cordoni, G., Guéry, J., & Demuru, E. (2022) · American Journal of Primatology · doi:10.1002/ajp.23366 · Cited by 23
“For significant multinomial predictors, we performed all pairwise comparisons with the Tukey test (Bretz et al., 2010) using a multiple contrast package (multcomp).”
MethodThinning the thickets: Foraging of hardy cattle, sheep and goats in green alder shrubs
Pauler, C. M., Zehnder, T., Staudinger, M., LÜSCHER, A., Kreuzer, M., Bérard, J., & Schneider, M. K. (2022) · Journal of Applied Ecology · doi:10.1111/1365-2664.14156 · Cited by 23
Closed Testing in Pharmaceutical Research: Historical and Recent Developments
Henning, K. S. S., & Westfall, P. H. (2015) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2015.1004270 · Cited by 23
“More recently, in a specific clinical trials setting, Goeman, Solari, and Stijnen (2010) tackled the directional issue by using the partitioning principle (e.g., Bretz, Hothorn, and Westfall 2010) to test for inferiority, nonsuperiority, and equivalence simultaneously.”
BackgroundMethodSelf-citationEndemism in Mainland Regions – Case Studies
Vanderplank, S. E., Moreira‐Muñoz, A., Hobohm, C., Pils, G., Noroozi, J., Clark, V. R., Barker, N. P., Yang, W., Huang, J., Ma, K., et al. (2013) · Plant and vegetation · doi:10.1007/978-94-007-6913-7_7 · Cited by 23
“ANOVA and Tukey’s multiple comparisons (Bretz et al. 2010) were conducted to assess endemism differences in the six phylogenetic groups.”
MethodIntertidal bare mudflats subsidize subtidal production through outwelling of benthic microalgae
Yoshino, K., Tsugeki, N. K., Amano, Y., Hayami, Y., Hamaoka, H., & Omori, K. (2012) · Estuarine Coastal and Shelf Science · doi:10.1016/j.ecss.2012.05.021 · Cited by 23
Read, T. J. G., Segre, P. S., Middleton, K. M., & Altshuler, D. L. (2016) · Journal of The Royal Society Interface · doi:10.1098/rsif.2016.0110 · Cited by 23
Concatenation of ‘alert’ and ‘identity’ segments in dingoes’ alarm calls
Déaux, É. C., Allen, A. P., Clarke, J. A., & Charrier, I. (2016) · Scientific Reports · doi:10.1038/srep30556 · Cited by 23
Metadata
- Authors
- Bretz, F., Hothorn, T., & Westfall, P.
- Affiliations
- Texas Tech University (US)
- Venue
- Chapman & Hall/CRC eBooks
- Publisher
- Chapman and Hall/CRC
- Published
- 2016-04-19
- OpenAlex
- W396053900
- Cited by
- 1,233
- References
- 93
- Citations by year
- 2026: 20 · 2025: 57 · 2024: 96 · 2023: 70 · 2022: 97 · 2021: 146 · 2020: 99 · 2019: 133 · 2018: 98 · 2017: 89 · 2016: 78
- FWCI
- 12.36
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Chapman & Hall/CRC eBooks (publishedVersion)
- Thammasat University Digital Collections (submittedVersion)
- TU Digital Collections (Thammasat University) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- multiple comparisons, R software, statistical software implementation, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review