Cited by 1,233Statistical Methods in Clinical TrialsData Analysis with RStatistical Methods and Applications

The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.

Multiple Comparisons Using R

Bretz, Frank, Hothorn, Torsten, Westfall, Peter·2016·Chapman & Hall/CRC eBooks

DOI 10.1201/9781420010909

Open this paper in CoChat — free account

Abstract

Adopting a unifying theme based on maximum statistics, Multiple Comparisons Using R describes the common underlying theory of multiple comparison procedures through numerous examples. It also presents a detailed description of available software implementations in R. The R packages and source code for the analyses are available at https://CRAN.R-pro

Integrity signals

Registry

Crossref · 10.1201/9781420010909

Cites

94 of 94 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Simultaneous Inference in General Parametric Models
Hothorn, T., Bretz, F., & Westfall, P. H. (2008) · Biometrical Journal · doi:10.1002/bimj.200810425 · Cited by 13,950
Self-citation
Gentleman R: R: A language for data analysis and graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,747
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 6,097
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
Šidák, Z. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10482935 · Cited by 2,904
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Discrete sequential boundaries for clinical trials
GORDON LAN, K. K., & DEMETS, D. L. (1983) · Biometrika · doi:10.1093/biomet/70.3.659 · Cited by 2,310

Flagged first, then by citations

Show all 93 references

Sorted by citations

Items 701–800 of 1,000

Development and evaluation of innovative enteric-coated capsules for colon-specific delivery of hydrophilic biomaterials
Fülöpová, N., Brückner, K., Muselík, J., Pavloková, S., & Franc, A. (2024) · International Journal of Pharmaceutics · doi:10.1016/j.ijpharm.2024.124991 · Cited by 8
Residual feed intake and behavior of sheep: Besides being classified as 'nibblers' or ‘binge eaters', can they also be considered ‘low water drinkers' or 'binge drinkers'?
Ferreira, J. D. S., Crisóstomo, C., Marques, N. M., Corrêa, L. D. S., González, A. L., Asensio, L. A. B., Casanova‐Lugo, F., & da Costa, R. L. D. (2025) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2025.106547 · Cited by 8
Identifying priority heat-risk areas in Granada, Spain, using InVEST and landscape metrics
Silveira, C., Pistón, N., Martínez‐López, J., Alcaraz‐Segura, D., Postma, T., Torralbo, J. L., & Zamora, R. (2025) · Urban forestry & urban greening · doi:10.1016/j.ufug.2025.128794 · Cited by 8
Spatiotemporal integration of tactile patterns along and across fingers
Trojan, J., Heil, M., Maihöfner, C., Hölzl, R., Kleinböhl, D., Flor, H., & Benrath, J. (2013) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2013.10.019 · Cited by 8
Risk of major cardiovascular events according to educational level before and after the initial COVID-19 public lockdown: a nationwide study
Andersen, J., Strandberg‐Larsen, K., Gerds, T. A., Gislason, G., Torp-Pedersen, C. T., Blanche, P., Andersson, C., Køber, L., Fosbøl, E. L., Phelps, M. D., et al. (2021) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2020-215133 · Cited by 8
Case study of a rhizosphere microbiome assay on a bamboo rhizome with excessive shoots
Cui, F., Yang, Y., Ye, M., Wei, W., Huang, W., Wu, Y., Xi, J., Ye, X., Zhou, S., Hu, Z., et al. (2021) · Forestry Research · doi:10.48130/fr-2021-0010 · Cited by 8
Effect of wilting and lactic acid bacteria inoculant on in situ and in vitro determined protein value of grass silages
Rupp, C., Westreicher‐Kristen, E., & Susenbeth, A. (2021) · Animal Feed Science and Technology · doi:10.1016/j.anifeedsci.2021.115115 · Cited by 8
Testing three hypotheses of rarity among the Buprestidae species of a tropical dry forest
Reyes‐González, R., Toledo‐Hernández, V. H., Flores‐Palacios, A., Rös, M., Bueno-Villegas, J., & Corona‐López, A. M. (2021) · Ecological Entomology · doi:10.1111/een.13110 · Cited by 9
“All analyses were performed in R 3.6.1 and the only library used was multcomp (multiple comparisons methods; Bretz et al., 2010).”
MethodInfluential
Reduction in caffeine withdrawal after open-label decaffeinated coffee
Mills, L., Lee, J. C., Boakes, R. A., & Colagiuri, B. (2023) · Journal of Psychopharmacology · doi:10.1177/02698811221147152 · Cited by 7
“Contrasts were estimated using estimated marginal means, and multiple comparisons controlled for Type-1 error via the Westfall procedure (Bretz et al., 2016; Westfall & Young, 1993).”
Method
Effectiveness landscape of crop pollinator assemblages: Implications to pollination service management
Haedo, J. P., Graffigna, S., Martínez, L. C., Pérez‐Méndez, N., Torretta, J. P., & Marrero, H. J. (2023) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2023.108417 · Cited by 8
A comparative evaluation of the safety performance of bus priority route configurations
Gitelman, V., & Doveh, E. (2023) · European Transport Research Review · doi:10.1186/s12544-023-00589-y · Cited by 8
“For that, we applied least-squares means differences with a Bonferroni adjustment to control for multiple comparisons [3].”
Method
Leaf wettability is the main driver for foliar P uptake in P-deficient maize
Henningsen, J. N., Görlach, B. M., Quintero, J. M., Recena, R., Mühling, K. H., & Fernández, V. (2023) · Plant Physiology and Biochemistry · doi:10.1016/j.plaphy.2023.108170 · Cited by 8
A question of digestion: How microalgae species affects lipid and fatty acid digestibility in rainbow trout (Oncorhynchus mykiss)
Simon, A., Lippemeier, S., Mueller, J., Schlachter, M., Kaiser, F., & Schulz, C. (2024) · Aquaculture · doi:10.1016/j.aquaculture.2024.741311 · Cited by 9
Dietary Zinc Limitation Dictates Lifespan and Reproduction Trade‐Offs of Drosophila Mothers
Sarmah, S., Truong, H. T. H., McColl, G., Burke, R., Mirth, C. K., & Piper, M. D. W. (2025) · Aging Cell · doi:10.1111/acel.14498 · Cited by 8
Childhood lung function and the association with β2‐adrenergic receptor haplotypes
Torjussen, T. M., Munthe‐Kaas, M. C., Mowinckel, P., Carlsen, K., Undlien, D. E., & Carlsen, K. C. L. (2013) · Acta Paediatrica · doi:10.1111/apa.12221 · Cited by 8
“Possible gene–environment interactions were tested in logistic regression models, and correction for multiple testing in these analyses was performed by Hommels procedure (23).”
Method
The effect of hospital teaching status on outcomes in bariatric surgery
Inaba, C. S., Koh, C. Y., Sujatha-Bhaskar, S., Lee, Y., Pejcinovska, M., & Nguyen, N. T. (2017) · Surgery for Obesity and Related Diseases · doi:10.1016/j.soard.2017.07.021 · Cited by 8
Regulatory issues with multiplicity in drug approval: Principles and controversies in a changing landscape
Benda, N., & Brandt, A. (2017) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2017.1378669 · Cited by 8
“Considerable advances in methodological research resulted in a large number of choices to account for multiplicity, see, for example, Bauer (1991), Bretz et al. (2010), Dmitrienko et al. (2010), Bretz et al. (2011), Alosh et al. (2014), offering the option to make clinical development either more…”
Background
Does a higher content of fibre in the piglet diet have an influence on tail biting in growing pigs?
Naya, A., Gertz, M., Hasler, M., Beilage, E. G., & Krieter, J. (2019) · Livestock Science · doi:10.1016/j.livsci.2019.03.010 · Cited by 8
Early development and metabolic rate of the sea louse Caligus rogercresseyi under different scenarios of temperature and pCO2
Montory, J. A., Cumillaf, J. P., Gebauer, P., Urbina, M. A., Cubillos, V. M., Navarro, J. M., Marín, S. L., & Cruces, E. (2020) · Marine Environmental Research · doi:10.1016/j.marenvres.2020.105154 · Cited by 8
: An R Package for performing kernel change point detection on the running statistics of multivariate time series
Cabrieto, J., Meers, K., Schat, E., Adolf, J., Kuppens, P., Tuerlinckx, F., & Ceulemans, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01603-8 · Cited by 8
“Users can obviously use these p -values to implement alternative correction methods if they wish (for an overview see e.g., Bretz et al., 2016).”
Method
The place of S-ketamine in fibromyalgia treatment (ESKEFIB): study protocol for a prospective, single-center, double-blind, randomized, parallel-group, dose-escalation controlled trial
Javorcikova, Z., Dangoisse, M., Nikis, S., Lechat, J.-P., Gillain, A., Fils, J., & der Linden, P. V. (2021) · Trials · doi:10.1186/s13063-021-05814-4 · Cited by 8
Trends in surface elevation and accretion in a retrograding delta in coastal Mississippi, USA from 2012–2016
Pitchford, J. L., Cressman, K. A., Cherry, J. A., Russell, B. T., McIlwain, J., Archer, M. J., & Underwood, W. V. (2022) · Wetlands Ecology and Management · doi:10.1007/s11273-022-09871-7 · Cited by 8
“To compare mean rates of change for zones, we constructed 95% confidence intervals 156 using the function ‘glht’ in the R package ‘multcomp’ to adjust p-values and confidence intervals to control the 157 family-wise error rate (Hothorn et al. 2008; Bretz et al. 2010).”
Method
Plant functional traits affect competitive vigor of pasture grasses during drought and following recovery
Chieppa, J., Power, S. A., Nielsen, U. N., & Tissue, D. T. (2022) · Ecosphere · doi:10.1002/ecs2.4156 · Cited by 8
The population-wise error rate for clinical trials with overlapping populations
Brannath, W., Hillner, C., & Rohmeyer, K. (2022) · Statistical Methods in Medical Research · doi:10.1177/09622802221135249 · Cited by 8
Ants as mealybug detectors: a novel tool for monitoring Planococcus ficus infestation based on ant behaviour
Castracani, C., Giannetti, D., Spotti, F. A., Schifani, E., Ghizzoni, M., Delaiti, M., Penner, F., Leonardi, S., Mori, A., Ioriatti, C., et al. (2022) · Agricultural and Forest Entomology · doi:10.1111/afe.12547 · Cited by 8
“To compare methods (Ant vs. Leaf ) in different dates and in different treatments (Experimental vs. Control vines), an approach which corrects for multiple comparisons was used (Bretz et al., 2011), that is, the ghlt function of the mulcomp package with ad-hoc set of contrasts.”
Method
Colonization success of a tree‐killing bark beetle: Geographic variation and mismatch with host preference
Takagi, E. (2023) · Ecology and Evolution · doi:10.1002/ece3.10274 · Cited by 8
Dynamometric Indicators of Fatigue From Repeated Maximal Concentric Isokinetic Plantar Flexion Contractions Are Independent of Knee Flexion Angles and Age but Differ for Males and Females
Hébert‐Losier, K., & Holmberg, H. (2013) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0b013e3182a993a0 · Cited by 8
Data-driven sensitivity analysis to detect missing data mechanism with applications to structural equation modelling
Jamshidian, M., & Yuan, K. (2012) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2012.660486 · Cited by 8
Factors influencing the feeding response of laboratory-reared Aedes aegypti.
Phasomkusolsil, S., Pantuwatana, K., Tawong, J., Khongtak, W., Monkanna, N., Kertmanee, Y., Damdangdee, N., McCardle, P. W., & Schuster, A. L. (2014) · PubMed · Cited by 8
Determination of the lower and upper critical concentration of Methionine + Cystine in diets of juvenile turbot ( Psetta maxima )
Klatt, S. F., von Danwitz, A., Hasler, M., & Susenbeth, A. (2015) · Aquaculture · doi:10.1016/j.aquaculture.2015.10.015 · Cited by 8
Spiny Prey, Fortunate Prey. Dorsal Spines Are an Asset in Intraguild Interactions among Lady Beetles
Hautier, L., Martin, G. S., Jansen, J., Branquart, É., & Grégoire, J. (2017) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2017.00135 · Cited by 8
“All pairwise comparisons were then performed with multiplicity adjusted Pvalues based on the underlying multivariate normal distribution, thus accounting for the correlation between the tests (multcomp R package; Bretz et al., 2010).”
Method
The Association Between Persistence and Change in Early Childhood Behavioural Problems and Preschool Cognitive Outcomes
D’Souza, S., Underwood, L., Peterson, E. R., Morton, S., & Waldie, K. E. (2020) · Child Psychiatry & Human Development · doi:10.1007/s10578-019-00953-x · Cited by 9
An evaluation of methods for testing hypotheses relating to two endpoints in a single clinical trial
Su, T., Glimm, E., Whitehead, J., & Branson, M. (2012) · Pharmaceutical Statistics · doi:10.1002/pst.504 · Cited by 8
Informative Simultaneous Confidence Intervals in Hierarchical Testing
Brannath, W., & Schmidt, S. (2014) · Methods of Information in Medicine · doi:10.3414/me13-01-0140 · Cited by 8
The impact of perceived emotions on toddlers' word learning
Ma, L., Twomey, K. E., & Westermann, G. (2022) · Child Development · doi:10.1111/cdev.13799 · Cited by 7
Enzymatic Stoichiometry and Vector Characteristics Can Indicate Microbial Resource Limitation: Empirical Evidence from Experiment with Multiple Nutrient Addition
Zhai, Z., Lin, L., Li, T., Bu, Z., & Wang, M. (2025) · Ecosystems · doi:10.1007/s10021-024-00948-3 · Cited by 7
Climate change adaption of European beech forests: Silver fir admixtures drive understorey plant diversity
Bärmann, L., Kaufmann, S., & Hauck, M. (2025) · Forest Ecology and Management · doi:10.1016/j.foreco.2025.122499 · Cited by 7
Two cowpea Rubisco activase isoforms for crop thermotolerance
Gjindali, A., Page, R., Ashton, C. J., Robertson, I. H., Page, M. T., Bloemers, D., Gould, P. D., Worrall, D., Orr, D. J., & Carmo‐Silva, E. (2025) · New Phytologist · doi:10.1111/nph.70271 · Cited by 7
“Compact letter display was generated after the post hoc pairwise comparisons using packages MULTICOMP (Bretz et al ., 2016) and MULTICOMPVIEW (Graves et al ., 2019).”
Wild orangutans maintain sleep homeostasis through napping, counterbalancing socio-ecological factors that interfere with their sleep
Ashbury, A. M., Lamarque, F., Permana, A., Rahmaeti, T., Samson, D. R., Utami-Atmoko, S. S., Crofoot, M. C., & Schuppli, C. (2025) · Current Biology · doi:10.1016/j.cub.2025.05.053 · Cited by 7
The function of root mat fungal communities: Changes in response to pH and phosphorus addition
Burke, D. J., Carrino‐Kyker, S. R., Chervenak, C. F., Hoke, A. J., & Hewins, C. R. (2021) · Plants People Planet · doi:10.1002/ppp3.10193 · Cited by 7
“Tukey's tests for multiple comparisons were conducted as post- hoc tests with the function ghlt in the package multcomp (v 1.4– 2; Hothorn et al., 2008; Bretz et al., 2011).”
MethodInfluential
Nitrous Oxide Emission from Forage Plantain and Perennial Ryegrass Swards Is Affected by Belowground Resource Allocation Dynamics
Nyameasem, J. K., Halima, E. B., Malisch, C. S., Razavi, B. S., Taube, F., & Reinsch, T. (2021) · Agronomy · doi:10.3390/agronomy11101936 · Cited by 7
An Improved and Simplified Propagation System for Pollen-Free Sugi (Cryptomeria japonica) via Somatic Embryogenesis
Maruyama, T. E., Tsuruta, M., Ueno, S., Kawakami, K., Bamba, Y., & Moriguchi, Y. (2022) · Frontiers in Plant Science · doi:10.3389/fpls.2022.825340 · Cited by 7
Dimension-wise scaled normal mixtures with application to finance and biometry
Punzo, A., & Bagnato, L. (2022) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2022.105020 · Cited by 7
Impacts of land use change on native plant-butterfly interaction networks from central Mexico
Muñoz-Galicia, D., Lara, C., Castillo‐Guevara, C., Cuautle, M., & Rodríguez-Flores, C. I. (2023) · PeerJ · doi:10.7717/peerj.16205 · Cited by 9
“Post-hoc test were performed using the glht function of the package multcomp ( Bretz, Hothorn & Westfall, 2010 ).”
Method
Social play and affiliation as possible coping strategies in a group of Maremmana beef cattle
Francesconi, M., Pedruzzi, L., Bagnato, S., Goracci, J., Ripamonti, A., Mele, M. L., & Palagi, E. (2023) · Journal of Ethology · doi:10.1007/s10164-023-00801-5 · Cited by 7
Cereal leaf beetle‐associated bacteria enhance the survival of their host upon insecticide treatments and respond differently to insecticides with different modes of action
Wielkopolan, B., Szabelska‐Beręsewicz, A., Gawor, J., & Obrępalska‐Stęplowska, A. (2024) · Environmental Microbiology Reports · doi:10.1111/1758-2229.13247 · Cited by 7
“Next, the multiple comparisons procedure based on Tukey ’ s test (Bretz et al., 2010) implemented in R package multcomp (Hothorn et al., 2008) was applied to obtain the information on which levels of active substance and concentration are significantly different from each other.”
Method
Smiling underwater: Exploring playful signals and rapid mimicry in bottlenose dolphins
Maglieri, V., Vantaggio, F., Pilenga, C., Böye, M., Lemasson, A., Favaro, L., & Palagi, E. (2024) · iScience · doi:10.1016/j.isci.2024.110966 · Cited by 7
“104 Weperformedallpairwisecomparisonsforthelevelsofthemulti-levelfactorwiththe Tukey test 105 by using the R package emmeans .”
Community assembly by limited recruitment in a hypoxia-stressed soft bottom: A case study of macrobenthos in Ariake Bay
Yoshino, K., Katano, T., Ito, Y., Hamada, T., Fujii, N., & Hayami, Y. (2014) · Plankton and Benthos Research · doi:10.3800/pbr.9.57 · Cited by 7
Directional Error Rates of Closed Testing Procedures
Westfall, P. H., Bretz, F., & Tobias, R. D. (2013) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2013.818575 · Cited by 7
Self-citation
Epistemic signals and emoticons affect kudos
Vogel, C. M., & Sanchez, L. M. (2012) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2012.6422036 · Cited by 7
A pheromone trap monitoring system for the saddle gall midge, Haplodiplosis marginata (von Roser) (Diptera: Cecidomyiidae)
Censier, F., Heuskin, S., Martin, G. S., Michels, F., Fauconnier, M., Proft, M. D., Lognay, G. C., & Bodson, B. (2015) · Crop Protection · doi:10.1016/j.cropro.2015.10.024 · Cited by 7
On French listeners’ ability to use stress during spoken word processing
Michelas, A., Esteve‐Gibert, N., & Dufour, S. (2017) · Journal of Cognitive Psychology · doi:10.1080/20445911.2017.1394862 · Cited by 7
“comp package (Bretz et al., 2011) with p-values adjusted by the single step method.”
Method
Experiential Statistics Learning with RStudio: Study on Students’ Engagement
Salim, N. R., Gopal, K., & Ayub, A. F. M. (2018) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1132/1/012039 · Cited by 7
Statistical analysis of spatial segregation of points
Sadahiro, Y. (2019) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2019.04.008 · Cited by 7
Effect of forest disturbance on ant (Hymenoptera: Formicidae) diversity in a Mexican tropical dry forest canopy
Hernández‐Flores, J., Flores‐Palacios, A., Vásquez‐Bolaños, M., Toledo‐Hernández, V. H., Sotelo‐Caro, O., & Robles, M. I. R. (2020) · Insect Conservation and Diversity · doi:10.1111/icad.12466 · Cited by 7
In-situ soil greenhouse gas fluxes under different cryptogamic covers in maritime Antarctica.
Durán, J., Rodríguez, A., Fangueiro, D., & Ríos, A. D. D. L. (2021) · Science of the Total Environment · doi:10.1016/j.scitotenv.2020.144557 · Cited by 5
Investigating the chronological reduction potential of a urease inhibitor in respiration chambers
Bobrowski, A. B., Derno, M., Kuhla, B., Hagenkamp-Korth, F., Hasler, M., & Hartung, E. (2021) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2021.01.005 · Cited by 7
Fire-related cues improve germination and seedling vigor of the post-fire off-spring of Pinus radiata, a serotinous invader tree
Ripa, R. R., Franzese, J., Premoli, A. C., & Raffaele, E. (2022) · New Forests · doi:10.1007/s11056-022-09928-8 · Cited by 6
Interactions of plant‐based feeding and handling stress on the expression of selected immune markers in rainbow trout ( Oncorhynchus mykiss )
Seibel, H., Krassilnikova, K., Fichtner‐Grabowski, F., Rebl, A., Schulz, C., & Hornburg, S. C. (2022) · Aquaculture Research · doi:10.1111/are.15928 · Cited by 7
Memory accuracy, suggestibility and credibility in investigative interviews with native and non-native eyewitnesses
Raver, A., Lindholm, T., Gustafsson, P. U., & Alm, C. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1240822 · Cited by 7
“, 2017) to use Satterthwaite’s method for approximating degrees of freedom for the t-tests, and AICcmodavg (Mazerolle, 2020) for model selection using Akaike weights (see Burnham and Anderson, 2002; Wagenmakers and Farrell, 2004); the Holm correction with multcomp (Bretz et al., 2016); the intra-class correlation coef…”
Method
Shrubs versus ‘gullivers’: woody species coping with disturbance in grasslands
Hermann, J., Haug, S., Pillar, V. D., & Pfadenhauer, J. (2012) · Plant Ecology · doi:10.1007/s11258-012-0131-4 · Cited by 7
“Tukey test for all pairwise comparisons in a linear mixed model (Bretz et al. 2011).”
Method
Sequential anomaly detection in a batch with growing number of tests: Application to network intrusion detection
Miller, D. J., Koçak, F., & Kesidis, G. (2012) · Machine learning for signal processing ... · doi:10.1109/mlsp.2012.6349793 · Cited by 7
“when, for some (currently undetected) samples, they yield lower p-values (corrected for multiple testing [6]) than those yielded by the existing test cadre on all (currently undetected) samples in the batch.”
Background
An Insight in the Reproductive Biology of Therophilus javanus (Hymenoptera, Braconidae, and Agathidinae), a Potential Biological Control Agent against the Legume Pod Borer (Lepidoptera, Crambidae)
Souna, D. A., Bokonon-Ganta, A. H., Ravallec, M., Cusumano, A., Pittendrigh, B. R., Volkoff, A., & Tamò, M. (2017) · Psyche A Journal of Entomology · doi:10.1155/2017/3156534 · Cited by 7
“Multiple comparisons were carried out using the glht function of the “multcomp” package in the R software [20] to determine significant differences among the mean number of ovarioles per female (at the 0.”
Method
Optimized adaptive enrichment designs for three-arm trials: learning which subpopulations benefit from different treatments
Steingrimsson, J. A., Betz, J., Qian, T., & Rosenblum, M. (2019) · Biostatistics · doi:10.1093/biostatistics/kxz030 · Cited by 7
Factors influencing seedling emergence of three global invaders in greenhouses representing major eco‐regions of the world
Khan, M. A. S. A., Vetter, V. M. S., Reshi, Z. A., Dar, P., & Jentsch, A. (2018) · Plant Biology · doi:10.1111/plb.12710 · Cited by 7
Salinity affects growth but not thermal preference of adult mummichogs Fundulus heteroclitus
Thompson, J. S. (2019) · Journal of Fish Biology · doi:10.1111/jfb.14103 · Cited by 7
Disproportionate Changes in the CH4 Emissions of Six Water Table Levels in an Alpine Peatland
Yan, L., Zhang, X., Wu, H., Kang, E., Li, Y., Wang, J., Yan, Z., Zhang, K., & Kang, X. (2020) · Atmosphere · doi:10.3390/atmos11111165 · Cited by 7
Isolate-Dependent Differences in Clinical, Pathological, and Transcriptional Profiles followingIn VitroandIn VivoInfections with Rickettsia rickettsii
Galletti, M. F. B. M., Paddock, C. D., Hecht, J. A., Biggerstaff, B. J., Ritter, J. M., & Karpathy, S. E. (2021) · Infection and Immunity · doi:10.1128/iai.00626-20 · Cited by 7
Sample size optimization and initial allocation of the significance levels in group sequential trials with multiple endpoints
Gou, J. (2021) · Biometrical Journal · doi:10.1002/bimj.202000081 · Cited by 7
“Besides the marginal power, disjunctive power and conjunctive power discussed in Dmitrienko et al. (2009), Bretz et al. (2010), Zhang and Gou (2016) and Vickerstaff et al. (2019) can also be considered for the sample size calculation.”
Background
Predation of the crab Acanthocyclus albatrossis on seeds of the bivalve Mytilus chilensis under different environmental conditions: Importance of prey and predator size
Uzkiaga, N., Gebauer, P., Niklitschek, E. J., Montory, J. A., Paschke, K. A., Garcés, C., & Lázaro, O. D. (2022) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/j.jembe.2022.151730 · Cited by 7
Comparison of fire-produced gases from wind tunnel and small field experimental burns
Weise, D. R., Hao, W. M., Baker, S., Princevac, M., Aminfar, A., Palarea‐Albaladejo, J., Ottmar, R. D., Hudak, A. T., Restaino, J. C., & O’Brien, J. J. (2022) · International Journal of Wildland Fire · doi:10.1071/wf21141 · Cited by 7
Reducing unnecessary measurements in clinical trials with multiple primary endpoints
Sozu, T., Sugimoto, T., & Hamasaki, T. (2015) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2015.1052497 · Cited by 6
“…under the unstructured Bonferroni procedure can be written as 1 β ¼ Pr [K k¼1 Zk > zα=K H1 " # ¼ 1 Pr \K k¼1 Zk zα=K H1 " # ¼ 1 Pr \K k¼1 Z k c k H1 " # : This overall power is referred to as “minimal power” (Westfall et al., 2011) or “disjunctive power” (Senn and Bretz, 2007; Bretz et al., 2011).”
Comparative studies about fungal colonization and deoxynivalenol translocation in barley plants inoculated at the base with Fusarium graminearum, Fusarium culmorum and Fusarium pseudograminearum
Pecoraro, F., Giannini, M., Beccari, G., Covarelli, L., Filippini, G., Pisi, A., Nipoti, P., & Prodi, A. (2018) · Agricultural and Food Science · doi:10.23986/afsci.67704 · Cited by 7
Males increase their fitness by choosing large females in the common bedbug Cimex lectularius
Kaufmann, E., & Otti, O. (2018) · Animal Biology · doi:10.1163/15707563-20181033 · Cited by 7
“For those tests, the P values were adjusted to the method by Westfall (Bretz et al., 2010).”
Method
Phenological asynchrony between the fruit fly Anastrepha fraterculus and early maturing peach cultivars could contribute to pesticide use reduction
Araujo, E. S., Paiva, L. R., Alves, S. G., Bevacqua, D., Nava, D. E., Lavigne, C., & García, F. R. M. (2019) · Spanish Journal of Agricultural Research · doi:10.5424/sjar/2019171-13294 · Cited by 7
“, 2015), Multcomp (Bretz et al., 2010) and DHARMa (Hartig, 2016).”
MethodInfluential
Optimality of syntactic dependency distances
Ferrer Cancho, R., Gómez‐Rodríguez, C., Esteban Ángeles, J. L., & Alemany-Puig, L. (2022) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.1103/physreve.105.014308 · Cited by 39
Ecological and socioeconomic implications of a northern range expansion of black sea bass, Centropristis striata
McMahan (2017) · Digital Repository Service (Northeastern University) · doi:10.17760/d20260861 · Cited by 7
Support for Vladimir Putin in Russia's neighbors: Survey evidence from an endorsement experiment in six post-Soviet countries
Ο’Loughlin, J., Linke, A. M., Toal, G., & Bakke, K. M. (2023) · Political Geography · doi:10.1016/j.polgeo.2023.103014 · Cited by 6
Six factors facilitating teachers’ use of research. An experimental factorial survey of educational stakeholders perspectives
Jeune, N., Juhel, J., Dessus, P., & Atal, I. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1368565 · Cited by 6
Subtypes of brain change in aging and their associations with cognition and Alzheimer’s disease biomarkers
Capogna, E., Sørensen, Ø., Watne, L. O., Roe, J. M., Strømstad, M., Idland, A., Halaas, N. B., Blennow, K., Zetterberg, H., Walhovd, K. B., et al. (2024) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2024.12.009 · Cited by 9
“If the output was significant, we applied multiple comparisons of means, as implemented in the multcomp R-package (Westfall et al., 2010), that displayed the adjusted p-values, using a single-step method.”
The Need for Nuance in the Null Hypothesis Significance Testing Debate
Häggström, O. (2016) · Educational and Psychological Measurement · doi:10.1177/0013164416668233 · Cited by 6
Beyond the glow: proving the unity of pheromones and bioluminescent signals in glow-worm firefly courtship
Novák, M., & Jakubec, P. (2024) · Zoological Journal of the Linnean Society · doi:10.1093/zoolinnean/zlae045 · Cited by 6
Temporal variability in host availability alters the outcome of competition between two parasitoid species
Wang, H. G., Liu, T., Sun, S., Lewis, O. T., & Xi, X. (2024) · Journal of Animal Ecology · doi:10.1111/1365-2656.14191 · Cited by 6
Survival capacity of the common woodlouse Armadillidium vulgare is improved with a second infection of Salmonella enterica
Prigot‐Maurice, C., de Araujo, A. C., Durand, S., Laverré, T., Pigeault, R., Verdon, J., Bulet, P., Beltran‐Bech, S., & Braquart‐Varnier, C. (2019) · Journal of Invertebrate Pathology · doi:10.1016/j.jip.2019.107278 · Cited by 6
Effect of limited compaction on soil solution chemistry in two acidic forest ecosystems: Changes, recovery and impact of liming
Ranger, J. J., Bonnaud, P., Santenoise, P., Zeller, B., Nourrisson, G., Pelletier, M., Gelhaye, D., & Legout, A. (2021) · Forest Ecology and Management · doi:10.1016/j.foreco.2021.119538 · Cited by 6
“(cid:30) When ((cid:26)) was declared significant (p ≤ 0.05), a Tukey’s multiple comparison of means (Hothorn et al. 2008, Bretz et al. 2011) was applied to model (1) to identify for which pair of treatments the variable distribution was significantly different.”
MethodInfluential
Patterns of Exposure and Infection with Microparasites in Iberian Wild Carnivores: A Review and Meta-Analysis
Millán, J., & Becker, D. (2021) · Animals · doi:10.3390/ani11092708 · Cited by 6
Self-report questionnaires scrutinised: Do eye movements reveal individual differences in cognitive processes while completing a questionnaire?
Chauliac, M., Catrysse, L., Gijbels, D., Mæyer, S. D., & Donche, V. (2022) · International Journal of Social Research Methodology · doi:10.1080/13645579.2022.2052696 · Cited by 6
Graphogame intervention as a tool for early diagnosis of reading difficulties in Spanish-speaking children with developmental language disorder
Martínez, C., Maurits, N. M., & Maassen, B. (2022) · Child Language Teaching and Therapy · doi:10.1177/02656590221139232 · Cited by 6
“For this purpose, we used the function ‘lsmeans’ (lsmeans package; Bretz et al., 2010) for pairwise comparison, applying the Tukey test.”
Method
Faster evapotranspiration recovery compared to canopy development post clearcutting in a floodplain forest
Ghisi, T., Fischer, M., Kowalska, N., Jocher, G., Orság, M., Bláhová, M., Nieto, H., Homolová, L., Žalud, Z., & Trnka, M. (2023) · Forest Ecology and Management · doi:10.1016/j.foreco.2023.120828 · Cited by 6
Preference-performance hypothesis and host oviposition selection of Diabrotica speciosa: aboveground female avoids belowground conspecific larvae in maize
Nardi, C., Rech, C., de Oliveira, J. R. F., Peñaflor, M. F. G. V., Santos, F., & Bento, J. M. S. (2023) · Arthropod-Plant Interactions · doi:10.1007/s11829-023-09972-x · Cited by 6
Tapping into the human spinal locomotor centres with transspinal stimulation
Σκιαδόπουλος, Α., & Knikou, M. (2024) · Scientific Reports · doi:10.1038/s41598-024-56579-0 · Cited by 6
“Linear mixed-effects models followed by a generalized linear hypothesis test for planned contrasts were used to compare transspinal stimulation groups with the control group, as well as their interaction (sub-threshold vs. supra-threshold, 15 vs. 30 Hz, 15 vs. 50 Hz, 30 vs. 50 Hz) 56,57 .”
Method
The Case of Watson vs. James: Effect-Priming Studies Do Not Support Ideomotor Theory
Cox, R. F. A., & Hasselman, F. (2013) · PLoS ONE · doi:10.1371/journal.pone.0054094 · Cited by 6
“simultaneous tests for general linear hypotheses [29]) of the CE (Latency of IC trials.”
Background
Woody Species Diversity in Forest Plantations in a Mountainous Region of Beijing, China: Effects of Sampling Scale and Species Selection
Zhang, Y., Zhang, S., Ma, K., Fu, B., & Anand, M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0115038 · Cited by 6
“The Tukey test was used for all pairwise comparisons [45].”
Method
Low Ability of Great Tits to Discriminate Similarly Inconspicuous Edible and Inedible Prey
Karlíková, Z., Veselý, P., Beránková, J., & Fuchs, R. (2016) · Ethology · doi:10.1111/eth.12454 · Cited by 6
Species composition and distribution of Coleosporium species on the needles of Pinus densiflora at a semi-natural vegetation succession site in central Japan
Suzuki, H., Hirose, D., & Yamaoka, Y. (2018) · Mycoscience · doi:10.1016/j.myc.2018.04.001 · Cited by 6
Effect of trap type and height in monitoring the orange wheat blossom midge, Sitodiplosis mosellana (Géhin) (Diptera: Cecidomyiidae) and its parasitoid, Macroglenes penetrans (Kirby) (Hymenoptera: Pteromalidae)
Chavalle, S., Censier, F., Martin, G. S., & Proft, M. D. (2018) · Crop Protection · doi:10.1016/j.cropro.2018.10.010 · Cited by 6
Testing and ranking on round-robin design for data sport analytics with application to basketball
Corain, L., Arboretti, R., Ceccato, R., Ronchi, F., & Salmaso, L. (2018) · Statistical Modelling · doi:10.1177/1471082x18808630 · Cited by 6
Testing the predictive ability of house price bubbles for macroeconomic performance: A meta-analytic approach
Floro, D. (2019) · International Review of Financial Analysis · doi:10.1016/j.irfa.2018.11.019 · Cited by 6
Polycyclic Aromatic Hydrocarbons Exposure Assessment in a Refractory Brick Production
Sartorelli, P., Paolucci, V., Aprea, M. C., Cenni, A., Pedersini, P., & Barabesi, L. (2019) · Annals of Work Exposures and Health · doi:10.1093/annweh/wxz078 · Cited by 6
Habitat mosaic of gravel pit as a potential refuge for carabids: a case study from Central Europe
Růžičková, J., & Hykel, M. (2019) · Community Ecology · doi:10.1556/168.2019.20.3.1 · Cited by 6

Authors: Bretz, F., Hothorn, T., & Westfall, P.
Affiliations: Texas Tech University (US)
ORCID: Bretz, Frank
Hothorn, Torsten
Venue: Chapman & Hall/CRC eBooks
Publisher: Chapman and Hall/CRC
Published: 2016-04-19
DOI: 10.1201/9781420010909
OpenAlex: W396053900
Cited by: 1,233
References: 93
Citations by year: 2026: 20 · 2025: 57 · 2024: 96 · 2023: 70 · 2022: 97 · 2021: 146 · 2020: 99 · 2019: 133 · 2018: 98 · 2017: 89 · 2016: 78
FWCI: 12.36
Type: book
Language: en
Open access: closed
Locations: Chapman & Hall/CRC eBooks (publishedVersion)
Thammasat University Digital Collections (submittedVersion)
TU Digital Collections (Thammasat University) (submittedVersion)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Physical Sciences › Mathematics › Statistics and Probability › Data Analysis with R
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
Keywords: multiple comparisons, R software, statistical software implementation, hypothesis testing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Multiple Comparisons Using R

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks