The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Comparisons of Treatments After an Analysis of Variance in Ecology
Open accessAbstract
The statistical literature on tests to compare treatments after the analysis of variance is reviewed, and the use of these tests in ecology is examined. Monte Carlo simulations on normal and lognormal data indicate that many of the tests commonly used are inappropriate or inefficient. Particular tests are recommended for unplanned multiple comparisons on the basis of controlling experimentwise type I error rate and providing maximum power. These include tests for parametric and nonparametric cases, equal and unequal sample sizes, homogeneous and heterogeneous variances, non—independent means (repeated measures or adjusted means), and comparing treatments to a control. Formulae and a worked example are provided. The problem of violations of assumptions, especially variance heterogeneity, was investigated using simulations, and particular strategies are recommended. The advantages and use of planned comparisons in ecology are discussed, and the philosophy of hypothesis testing with unplanned multiple comparisons is considered in relation to confidence intervals and statistical estimation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
The Art of Computer Programming
Knuth, D. E. (1968) · Cited by 16,337
Barr, A. J. (1979) · Medical Entomology and Zoology · Cited by 7,198
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 6,094
Nonparametric Statistical Methods
(1999) · Technometrics · doi:10.1080/00401706.1999.10485954 · Cited by 6,090
Multiple Comparisons Using Rank Sums
Dunn, O. J. (1964) · Technometrics · doi:10.1080/00401706.1964.10490181 · Cited by 5,085
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
A Note on the Generation of Random Normal Deviates
Box, G. E. P., & Muller, M. E. (1958) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706645 · Cited by 3,401
Robust Tests for the Equality of Variances
Brown, M. B., & Forsythe, A. B. (1974) · Journal of the American Statistical Association · doi:10.1080/01621459.1974.10482955 · Cited by 3,216
Extension of Multiple Range Tests to Group Means with Unequal Numbers of Replications
Kramer, C. Y. (1956) · Biometrics · doi:10.2307/3001469 · Cited by 3,146
Statistical Tables for Biological, Agricultural and Medical Research.
Reed, L. J., Fisher, R. A., & Yates, F. (1944) · Journal of the American Statistical Association · doi:10.2307/2280633 · Cited by 2,998
Mcgill, R., Tukey, J. W., & Larsen, W. A. (1978) · The American Statistician · doi:10.1080/00031305.1978.10479236 · Cited by 2,490
Graphical Methods for Data Analysis.
Healy, M. J. R., Chambers, J. M., Cleveland, W. S., Kleiner, B., & Tukey, P. A. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981587 · Cited by 2,315
Multiple Comparison Procedures
(2013) · An Introduction to Statistical Concepts · doi:10.4324/9780203137819-17 · Cited by 2,109
A Primer of Multivariate Statistics
Strauss, D. J., & Harris, R. J. (1975) · Biometrics · doi:10.2307/2529445 · Cited by 1,975
Understanding robust and exploratory data analysis
Hoaglin, D. C., Mosteller, F. C., & Tukey, J. W. (1983) · Wiley eBooks · Cited by 1,906
Distribution-Free Statistical Tests
Bell, C. B. (1970) · Technometrics · doi:10.1080/00401706.1970.10488744 · Cited by 1,695
THE SIGNIFICANCE OF THE DIFFERENCE BETWEEN TWO MEANS WHEN THE POPULATION VARIANCES ARE UNEQUAL
WELCH, B. L. (1938) · Biometrika · doi:10.1093/biomet/29.3-4.350 · Cited by 1,640
The Advanced Theory of Statistics.
Kendall, M. G., & Stuart, A. (1968) · The Statistician · doi:10.2307/2986781 · Cited by 1,581
Box, G. E. P. (1954) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728786 · Cited by 1,513
NON-NORMALITY AND TESTS ON VARIANCES
BOX, G. E. P. (1953) · Biometrika · doi:10.1093/biomet/40.3-4.318 · Cited by 1,302
(1981) · Cited by 1,275
Contrast Analysis: Focused Comparisons in the Analysis of Variance.
Levin, J. R., Rosenthal, R., & Rosnow, R. L. (1987) · Journal of the American Statistical Association · doi:10.2307/2289419 · Cited by 1,251
Klockars, A., & Sax, G. (1986) · Sage eBooks · doi:10.4135/9781412985185 · Cited by 1,013
Pairwise Multiple Comparison Procedures with Unequal N’s and/or Variances: A Monte Carlo Study
Games, P. A., & Howell, J. F. (1976) · Journal of Educational Statistics · doi:10.3102/10769986001002113 · Cited by 924
The effects of violations of assumptions underlying the t test.
Boneau, C. A. (1960) · Psychological Bulletin · doi:10.1037/h0041412 · Cited by 790
The Comparison of Several Dose Levels with a Zero Dose Control
Williams, D. A. (1972) · Biometrics · doi:10.2307/2556164 · Cited by 752
A Bayes Rule for the Symmetric Multiple Comparisons Problem
Waller, R. A., & Duncan, D. B. (1969) · Journal of the American Statistical Association · doi:10.1080/01621459.1969.10501073 · Cited by 723
An Evaluation of Ten Pairwise Multiple Comparison Procedures by Monte Carlo Methods
Carmer, S. G., & Swanson, M. R. (1973) · Journal of the American Statistical Association · doi:10.1080/01621459.1973.10481335 · Cited by 692
The Small Sample Behavior of Some Statistics Which Test the Equality of Several Means
Brown, M. B., & Forsythe, A. B. (1974) · Technometrics · doi:10.1080/00401706.1974.10489158 · Cited by 663
Consequences of violating the independence assumption in analysis of variance.
Kenny, D. A., & Judd, C. M. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.99.3.422 · Cited by 616
NEWMAN, D. (1939) · Biometrika · doi:10.1093/biomet/31.1-2.20 · Cited by 567
Statistical Principles in Experimental Design, 2nd Edition.
Marascuilo, L. A., & Winer, B. J. (1973) · Journal of the American Statistical Association · doi:10.2307/2284115 · Cited by 548
Pairwise Multiple Comparisons in the Unequal Variance Case
Dunnett, C. W. (1980) · Journal of the American Statistical Association · doi:10.1080/01621459.1980.10477552 · Cited by 485
Multiple comparison in psychological research.
Ryan, T. A. (1959) · Psychological Bulletin · doi:10.1037/h0042478 · Cited by 414
A Proof of the Conjecture that the Tukey-Kramer Multiple Comparisons Procedure is Conservative
Hayter, A. J. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346392 · Cited by 390
A Study of the Powers of Several Methods of Multiple Comparisons
Einot, I., & Gabriel, K. R. (1975) · Journal of the American Statistical Association · doi:10.1080/01621459.1975.10482474 · Cited by 340
Robust Rank Procedures for the Behrens-Fisher Problem
Fligner, M. A., & Policello, G. E. (1981) · Journal of the American Statistical Association · doi:10.1080/01621459.1981.10477623 · Cited by 331
An Extension of the T-Method of Multiple Comparison to Include the Cases with Unequal Sample Sizes
Spjøtvoll, E., & Stoline, M. R. (1973) · Journal of the American Statistical Association · doi:10.1080/01621459.1973.10481458 · Cited by 291
A Biometrics Invited Paper. A Review of Response Surface Methodology from a Biometric Viewpoint
Mead, R., & Pike, D. J. (1975) · Biometrics · doi:10.2307/2529809 · Cited by 283
Stoline, M. R. (1981) · The American Statistician · doi:10.1080/00031305.1981.10479331 · Cited by 280
Pairwise multiple comparison procedures: A review.
Jaccard, J. J., Becker, M. A., & Wood, G. (1984) · Psychological Bulletin · doi:10.1037//0033-2909.96.3.589 · Cited by 271
A Comparison of Procedures for Multiple Comparisons of Means with Unequal Variances
Tamhane, A. C. (1979) · Journal of the American Statistical Association · doi:10.1080/01621459.1979.10482541 · Cited by 240
Stepwise Multiple Comparison Procedures
Welsch, R. E. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10480614 · Cited by 218
The Religion of Statistics as Practiced in Medical Journals
Salsburg, D. S. (1985) · The American Statistician · doi:10.1080/00031305.1985.10479435 · Cited by 197
(2012) · SpringerReference · doi:10.1007/springerreference_205326 · Cited by 194
A Bayesian Approach to Multiple Comparisons
Duncan, D. B. (1965) · Technometrics · doi:10.1080/00401706.1965.10490249 · Cited by 190
A Simple Method of Multiple Comparisons of Means
Gabriel, K. R. (1978) · Journal of the American Statistical Association · doi:10.1080/01621459.1978.10480084 · Cited by 187
Some generalizations of the T-method in simultaneous inference
Hochberg, Y. (1974) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(74)90015-3 · Cited by 179
Pairwise Multiple Comparisons in Repeated Measures Designs
Maxwell, S. E. (1980) · Journal of Educational Statistics · doi:10.2307/1164969 · Cited by 176
Kohr, R. L., & Games, P. A. (1974) · The Journal of Experimental Education · doi:10.1080/00220973.1974.10806305 · Cited by 146
The Present State of Multiple Comparison Methods
O'Neill, R. G., & Wetherill, G. B. (1971) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1971.tb00874.x · Cited by 146
Applied Statistics: Analysis of Variance and Regression.
Dunn, O. J., & Clark, V. A. (1988) · Biometrics · doi:10.2307/2531930 · Cited by 145
Ury, H. K. (1976) · Technometrics · doi:10.2307/1267921 · Cited by 143
Petrinovich, L. F., & Hardyck, C. D. (1969) · Psychological Bulletin · doi:10.1037/h0026861 · Cited by 139
Rogan, J. C., & Keselman, H. J. (1977) · American Educational Research Journal · doi:10.3102/00028312014004493 · Cited by 110
Robustness of the Two-Sample T-Test
Posten, H. O. (1984) · Springer eBooks · doi:10.1007/978-94-009-6528-7_23 · Cited by 102
THE DISTRIBUTION OF THE VARIANCE RATIO IN RANDOM SAMPLES OF ANY SIZE DRAWN FROM NON-NORMAL UNIVERSES
GAYEN, A. K. (1950) · Biometrika · doi:10.1093/biomet/37.3-4.236 · Cited by 101
Boik, R. J. (1987) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1987.tb00865.x · Cited by 99
The approximate randomization test as an alternative to the F test in analysis of variance
Still, A. W., & White, A. P. (1981) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1981.tb00634.x · Cited by 96
Probabilities of the Type I Errors of the Welch Tests for the Behrens-Fisher Problem
Wang, Y. Y. (1971) · Journal of the American Statistical Association · doi:10.1080/01621459.1971.10482315 · Cited by 89
A Common Situation Conducive to Bizarre Distribution Shapes
Bradley, J. V. (1977) · The American Statistician · doi:10.1080/00031305.1977.10479224 · Cited by 88
Multiple-comparison Procedures: A Dissenting View
PERRY, J. N. (1986) · Journal of Economic Entomology · doi:10.1093/jee/79.5.1149 · Cited by 81
Robustness properties of nonorthogonal analysis of variance.
Milligan, G. W., Wong, D., & Thompson, P. A. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.3.464 · Cited by 78
Keselman, H. J., & Rogan, J. C. (1978) · Journal of the American Statistical Association · doi:10.1080/01621459.1978.10479996 · Cited by 76
Closure of the Newman-Keuls Multiple Comparisons Procedure
Begun, J. M., & Gabriel, K. R. (1981) · Journal of the American Statistical Association · doi:10.1080/01621459.1981.10477635 · Cited by 74
A Nonparametric Test for Interaction in Factorial Experiments
Patel, K. M., & Hoel, D. G. (1973) · Journal of the American Statistical Association · doi:10.1080/01621459.1973.10481394 · Cited by 59
Short-Cut Multiple Comparisons for Balanced Single and Double Classifications: Part 1, Results
Kurtz, T., Link, R. F., Tukey, J. W., & Wallace, D. L. (1965) · Technometrics · doi:10.1080/00401706.1965.10490245 · Cited by 53
Comparison of Means: An F Test Followed by a Modified Multiple Range Procedure
Shaffer, J. P. (1979) · Journal of Educational Statistics · doi:10.2307/1165063 · Cited by 48
Power of the Analysis of Variance of Independent Groups on Non-Normal and Normally Transformed Data
Games, P. A., & Lucas, P. A. (1966) · Educational and Psychological Measurement · doi:10.1177/001316446602600205 · Cited by 38
Statistical Hypothesis Testing in Biology: A Contradiction in Terms
Jones, D., & Matloff, N. (1986) · Journal of Economic Entomology · doi:10.1093/jee/79.5.1156 · Cited by 34
Levy, K. J. (1978) · Journal of Statistical Computation and Simulation · doi:10.1080/00949657808810247 · Cited by 30
Rivest, L. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478248 · Cited by 19
Adaptive t Tests for Multiple Comparisons
Duncan, D. B., & Brant, L. J. (1983) · Biometrics · doi:10.2307/2531112 · Cited by 13
Dependence ofFRatios Sharing a Common Denominator Mean Square
Hurlburt, R. T., & Spiegel, D. K. (1976) · The American Statistician · doi:10.1080/00031305.1976.10479144 · Cited by 12
Testing Complex a Priori Contrasts on Means from Independent Samples
Kohr, R. L., & Games, P. A. (1977) · Journal of Educational Statistics · doi:10.2307/1164994 · Cited by 12
A Simulation Study of the Powers of Three Multiple Comparison Statistics
Morley, C. L. (1982) · Australian Journal of Statistics · doi:10.1111/j.1467-842x.1982.tb00825.x · Cited by 10
Cited by
A new method for non-parametric multivariate analysis of variance
Anderson, M. J. (2001) · Austral Ecology · doi:10.1111/j.1442-9993.2001.01070.pp.x · Cited by 13,828
An extreme climatic event alters marine ecosystem structure in a global biodiversity hotspot
Wernberg, T., Smale, D. A., Tuya, F., Thomsen, M. S., Langlois, T. J., de Bettignies, T., Bennett, S., & Rousseaux, C. S. (2013) · Nature Climate Change · doi:10.1038/nclimate1627 · Cited by 1,304
Mechanisms of Primary Succession Following Deglaciation at Glacier Bay, Alaska
Chapin, F. S., Walker, L. R., Fastie, C. L., & Sharman, L. C. (1994) · Ecological Monographs · doi:10.2307/2937039 · Cited by 1,091
Modulation of leaf economic traits and trait relationships by climate
Wright, I. J., Reich, P. B., Cornelissen, J. H. C., Falster, D. S., Groom, P. K., Hikosaka, K., Lee, W., Lusk, C. H., Niinemets, Ü., Oleksyn, J., et al. (2005) · Global Ecology and Biogeography · doi:10.1111/j.1466-822x.2005.00172.x · Cited by 867
Tolerance of riverine plants to flooding and exposure indicated by water regime
Blanch, S. J., Ganf, G. G., & Walker, K. F. (1999) · Regulated Rivers: Research & Management · doi:10.1002/(sici)1099-1646(199901/06)15:1/3<43::aid-rrr535>3.0.co;2-q · Cited by 825
Metadata
- Authors
- Day, R. W., & Quinn, G. P.
- Venue
- Ecological Monographs
- Publisher
- Wiley
- Published
- 1989-12
- Volume
- 59
- Issue
- 4
- Pages
- 433-463
- ISSN
- 0012-9615 (ISSN-L)
- 1557-7015
- OpenAlex
- W2001594506
- Cited by
- 1,986
- References
- 78
- FWCI
- 52.84
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.