The DOI matches its Crossref record.
Comparing Individual Means in the Analysis of Variance
Abstract
The practitioner of the analysis of variance often wants to draw as many conclusions as are reasonable about the relation of the true means for individual treatments, and a statement by the F-test (or the z-test) that they are not all alike leaves him thoroughly unsatisfied. The problem of breaking up the treatment means into distinguishable groups has not been discussed at much length, the solutions given in the various textbooks differ and, what is more important, seem solely based on intuition. After discussing the problem on a basis combining intuition with some hard, cold facts about the distributions of certain test quantities (or statistics) a simple and definite procedure is proposed for dividing treatments into distinguishable groups, and for determining that the treatments within some of these groups are different, although there is not enough evidence to say which is which. The procedure is illustrated on examples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
The preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998
Harmonization of cortical thickness measurements across scanners and sites
Fortin, J.-P., Cullen, N., Sheline, Y. I., Taylor, W. D., Aselcioglu, I., Cook, P. A., Adams, P., Cooper, C., Fava, M., McGrath, P. J., et al. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.11.024 · Cited by 1,580
Impact of views to school landscapes on recovery from stress and mental fatigue
Li, D., & Sullivan, W. C. (2016) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2015.12.015 · Cited by 706
'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions
Binns, R., Van Kleek, M., Veale, M., Lyngs, U., Zhao, J., & Shadbolt, N. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173951 · Cited by 691
“We used ANOVA tests, followed by Tukey’s post-hoc paired tests [75], to analyse the relative effects of different explanation styles within different study designs.”
MethodCan AI Help Reduce Disparities in General Medical and Mental Health Care?
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.167 · Cited by 401
Emotions and brain function are altered up to one month after a single high dose of psilocybin.
Barrett, F. S., Doss, M. K., Sepeda, N. D., Pekar, J. J., & Griffiths, R. R. (2020) · Scientific Reports · doi:10.1038/s41598-020-59282-y · Cited by 375
Senolytics reduce coronavirus-related mortality in old mice
Camell, C. D., Yousefzadeh, M. J., Zhu, Y., Prata, L. G. P. L., Huggins, M. A., Pierson, M., Zhang, L., O’Kelly, R. D., Pirtskhalava, T., Xun, P., et al. (2021) · Science · doi:10.1126/science.abe4832 · Cited by 320
A foundation model for clinician-centered drug repurposing
Huang, K., Chandak, P., Wang, Q., Havaldar, S., Vaid, A., Leskovec, J., Nadkarni, G. N., Glicksberg, B. S., Gehlenborg, N., & Zitnik, M. (2024) · Nature Medicine · doi:10.1038/s41591-024-03233-x · Cited by 249
“Participants expressed significantly more confidence in correct predictions made by TxGNN when the TxGNN Explainer was included ( t (11) = 3.64 , P 0.01, using a two-sided Tukey’s honestly significant difference (HSD) test 38 ).”
MethodInfluentialGene flow contributes to diversification of the major fungal pathogen Candida albicans
Ropars, J., Maufrais, C., Diogo, D., Marcet-Houben, M., Perin, A., Sertour, N., Mosca, K., Permal, E., Laval, G., Bouchier, C., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-04787-4 · Cited by 197
Why is my classifier discriminatory?
Chen, I., Johansson, F. D., & Sontag, D. (2018) · arXiv · doi:10.48550/arxiv.1805.12002 · Cited by 185
“To map the 95% confidence intervals, we perform pairwise comparisons of means using Tukey’s range test (Tukey, 1949) across 5-fold cross-validation.”
MethodWinkler, R., Hobert, S., Salovaara, A., Söllner, M., & Leimeister, J. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376781 · Cited by 177
Leon, A. S., Rice, T., Mandel, S., Despres, J.-P., Bergeron, J., Gagnon, J., Rao, D. C., Skinner, J. S., Wilmore, J. H., & Bouchard, C. (2000) · Metabolism · doi:10.1016/s0026-0495(00)80018-9 · Cited by 176
'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisions
(2018) · doi:10.31235/osf.io/9wqxr · Cited by 161
Sugar reduction in probiotic chocolate-flavored milk: Impact on dynamic sensory profile and liking
Oliveira, D., Antúnez, L., Giménez, A., Castura, J. C., Deliza, R., & Ares, G. (2015) · Food Research International · doi:10.1016/j.foodres.2015.05.050 · Cited by 139
QOLLTI-F: measuring family carer quality of life.
Cohen, R., Leis, A. M., Kuhl, D., Charbonneau, C., Ritvo, P., & Ashbury, F. D. (2006) · Palliative Medicine · doi:10.1177/0269216306072764 · Cited by 128
Epigenetic Regulation of the Kappa Opioid Receptor by Child Abuse
Lutz, P.-E., Gross, J. A., Dhir, S. K., Maussion, G., Yang, J., Bramoulle, A., Meaney, M. J., & Turecki, G. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.07.012 · Cited by 96
Roubroeks, J. A. Y., Smith, A. R., Smith, R. G., Pishva, E., Ibrahim, Z., Sattlecker, M., Hannon, E. J., Kłoszewska, I., Mecocci, P., Soininen, H., et al. (2020) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2020.06.023 · Cited by 82
Dichotomous evaluations in suicidal individuals.
Neuringer, C. (1961) · Journal of Consulting Psychology · doi:10.1037/h0046460 · Cited by 81
The effects of data sampling with deep learning and highly imbalanced big data
Johnson, J. M., & Khoshgoftaar, T. M. (2020) · Information Systems Frontiers · doi:10.1007/s10796-020-10022-7 · Cited by 81
The use of meta-analytic statistical significance testing
Polanin, J. R., & Pigott, T. D. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1124 · Cited by 78
Can plant phenolic compounds reduce Fusarium growth and mycotoxin production in cereals?
Schöneberg, T., Kibler, K., Sulyok, M., Musa, T., Bucheli, T. D., Mascher, F., Bertossa, M., Voegele, R. T., & Vogelgsang, S. (2018) · Food Additives & Contaminants: Part A · doi:10.1080/19440049.2018.1538570 · Cited by 67
Spinner, M. A., Aleshin, A., Santaguida, M. T., Schaffert, S. A., Zehnder, J. L., Patterson, A. S., Gekas, C., Heiser, D., & Greenberg, P. L. (2020) · Blood Advances · doi:10.1182/bloodadvances.2020001934 · Cited by 40
Jeanrenaud, A. C. S. N., Brooke, B. D., & Oliver, S. V. (2020) · Parasites & Vectors · doi:10.1186/s13071-020-3886-9 · Cited by 41
Two invariants of human-swarm interaction
Brown, D. S., Goodrich, M. A., Jung, S.-Y., & Kerman, S. C. (2015) · Journal of Human-Robot Interaction · doi:10.5898/jhri.5.1.brown · Cited by 38
A Bayesian Approach to the Correction for Multiplicity
de Jong, T. (2019) · doi:10.31234/osf.io/s56mk · Cited by 35
Chirieleison, C., & Scrucca, L. (2017) · Tourism Management Perspectives · doi:10.1016/j.tmp.2017.07.020 · Cited by 31
Brooks, L. R. K., & Mias, G. I. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00392 · Cited by 32
Rogel, A., Guez, J., Getter, N., Keha, E., Cohen, T., Amor, T., & Todder, D. (2015) · Applied Psychophysiology and Biofeedback · doi:10.1007/s10484-015-9289-6 · Cited by 29
Chen, C., Lifset, E. T., Han, Y., Roy, A., Hogarth, M., Moore, A. A., Farcas, E., & Weibel, N. (2023) · The 25th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3597638.3608378 · Cited by 25
“The Tukey’s Honestly Significant Difference (HSD) test [73] was used for conducting post-hoc test.”
MethodImmersive Virtual Reality Simulations of Bionic Vision
Kasowski, J., & Beyeler, M. (2022) · Augmented Humans 2022 · doi:10.1145/3519391.3522752 · Cited by 22
Post hoc tests following analysis of variance
Holm, K., & Christman, N. J. (1985) · Research in Nursing & Health · doi:10.1002/nur.4770080215 · Cited by 19
Teng, D., Tan, L., Cao, Q., Xia, Y., Zhang, N., Li, J., & Zhao, D. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02547-z · Cited by 18
“…conducted using emmeans 40 . p -values were adjusted for multiple comparisons using the Tukey method; when probing group differences within each level of response correctness, the Tukey adjustment was applied separately within each correctness stratum (three pairwise comparisons per stratum) 41 .”
Healthy memory aging - the benefits of regular daily activities increase with age
Krakovska, O., Christie, G. J., Farzan, F., Sixsmith, A., Ester, M., & Moreno, S. (2021) · Aging · doi:10.18632/aging.203753 · Cited by 13
Protein Interaction Energy Landscapes are Shaped by Functional and also Non-functional Partners
Schweke, H., Mucchielli, M.-H., Sacquin-Mora, S., Bei, W., & Lopes, A. (2020) · Journal of Molecular Biology · doi:10.1016/j.jmb.2019.12.047 · Cited by 15
Shealy, T., Klotz, L., Weber, E. U., Johnson, E. J., & Bell, R. G. (2019) · Journal of Management in Engineering · doi:10.1061/(asce)me.1943-5479.0000692 · Cited by 11
UISGPT: Automated Mobile UI Design Smell Detection with Large Language Models
Yang, B., & Li, S. (2024) · Electronics · doi:10.3390/electronics13163127 · Cited by 10
Parker, L., Loper, A. J., Carter, C. W., Hayes, J., & Karakas, A. (2026) · Computers and Education Open · doi:10.1016/j.caeo.2025.100329 · Cited by 10
Freemium Pricing: Evidence from a Large-scale Field Experiment
Runge, J., Wagner, S., & Claussen, J. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2888471 · Cited by 9
The Impact of Gender and Organizational Position on Faith-Work Integration
Daniels, D., Ecklund, E. H., Thomson, R. A., & Kalinowski, B. (2022) · Journal of Management, Spirituality & Religion · doi:10.51327/bihn6411 · Cited by 7
The Effect of Alpha-Cyclodextrin on Postprandial Glucose Excursions: a Systematic Meta-Analysis
Wittkowski, K. M. (2022) · Cureus · doi:10.7759/cureus.31160 · Cited by 3
Metadata
- Authors
- Tukey, J. W.
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1949-06
- Volume
- 5
- Issue
- 2
- Pages
- 99
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W2318802957
- Cited by
- 4,246
- References
- 0
- FWCI
- 19.58
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
