Pseudoreplication and the Design of Ecological Field Experiments
The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
Pseudoreplication is defined as the use of inferential statistics to test for treatment effects with data from experiments where either treatments are not replicated (though samples may be) or replicates are not statistically independent. In ANOVA terminology, it is the testing for treatment effects with an error term inappropriate to the hypothesis being considered. Scrutiny of 176 experimental studies published between 1960 and the present revealed that pseudoreplication occurred in 27% of them, or 48% of all such studies that applied inferential statistics. The incidence of pseudoreplication is especially high in studies of marine benthos and small mammals. The critical features of controlled experimentation are reviewed. Nondemonic intrusion is defined as the impingement of chance events on an experiment in progress. As a safeguard against both it and preexisting gradients, interspersion of treatments is argued to be an obligatory feature of good design. Especially in small experiments, adequate interspersion can sometimes be assured only by dispensing with strict randomization procedures. Comprehension of this conflict between interspersion and randomization is aided by distinguishing pre—layout (or conventional) and layout—specific alpha (probability of type I error). Suggestions are offered to statisticians and editors of ecological journals as to how ecologists' understanding of experimental design and statistics might be improved.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“The tautological structure of the Kauffman and Cummings model invalidates Ripple et al.'s analysis because applying it violates the scientific principle that conclusions must be supported by evidence that is independent of the data used to generate them (Hurlbert 1984; Nakagawa & Parker 2015).”
From Flawed analysis invalidates claim of a strong Yellowstone trophic cascade after wolf reintroduction: A comment on Ripple et al. (2025) (2025) · cites this paper as Hurlbert 1984
In the citing paper
“A reason for this small number is that many studies incorporated experimental designs that suffered from pseudoreplication [79].”
From Land use change to bioenergy: A meta-analysis of soil carbon and GHG emissions (2015) · cites this paper as [79]
In the citing paper
“Pseudoreplication leads to a biased and incorrect inference, and it should be carefully considered (Hurlbert, 1984).”
From Acoustic indices as proxies for biodiversity: a meta‐analysis (2022) · cites this paper as Hurlbert, 1984
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Principles and procedures of statistics: McGraw-Hill Book Company, Inc. New York Toronto London.
Steel, R., & Torrie, J. H. (1960) · Cited by 4,633
Food Webs: Linkage, Interaction Strength and Community Infrastructure
Paine, R. T. (1980) · The Journal of Animal Ecology · doi:10.2307/4220 · Cited by 1,824
Sampling Design and Statistical Methods for Environmental Biologists
Green, R. H. (1979) · Andalas University Repository (Andalas University) · Cited by 1,550
Biogeochemistry of a forested ecosystem
(2014) · Choice Reviews Online · doi:10.5860/choice.51-6175 · Cited by 1,550
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Paine, R. T. (1974) · Oecologia · doi:10.1007/bf00345739 · Cited by 1,403
(1981) · Cited by 1,275
Likens, G. E., Bormann, F. H., Johnson, N. M., Fisher, D. W., & Pierce, R. S. (1970) · Ecological Monographs · doi:10.2307/1942440 · Cited by 1,204
(1958) · Medical Entomology and Zoology · Cited by 1,059
Eutrophication and Recovery in Experimental Lakes: Implications for Lake Management
Schindler, D. W. (1974) · Science · doi:10.1126/science.184.4139.897 · Cited by 1,041 · cited 1×
“As examples of first-rate “optimal impact studies” may be cited the Hubbard Brook deforestation experiment (e.g., Likens et al. 1970, 1977) and the Canadian whole-lake fertilization experiments (e.g., Schindler et al. 197 1, Schindler 1974).”
BackgroundThe Arrangement of Field Experiments
Fisher, R. A. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_8 · Cited by 964
The Importance of Predation by Crabs and Fishes on Benthic Infauna in Chesapeake Bay
Virnstein, R. W. (1977) · Ecology · doi:10.2307/1935076 · Cited by 477 · cited 1×
“§ Harger (197 1: two cages), Menge (1972) Haven (1973) Paine (1974, 1980: Katharina Acmea experiments), Young et al. (1976) Peterson (1977) Vimstein (1977) Bell and Coull (1978) Reise (1978: part), Rogers (1979: part), Vance (1979) Bell (1980) Hixon (1980) Holland et al. (1980) Lubchenco (1980)…”
Sampling Methods for Censuses and Surveys.
Deming, W. E., & Yates, F. (1949) · Journal of the American Statistical Association · doi:10.2307/2279916 · Cited by 441
Studies in crop variation. II. The manurial response of different potato varieties
Fisher, R. A., & Mackenzie, W. A. (1923) · The Journal of Agricultural Science · doi:10.1017/s0021859600003592 · Cited by 413
Algal Zonation in the New England Rocky Intertidal Community: An Experimental Analysis
Lubchenco, J. (1980) · Ecology · doi:10.2307/1935192 · Cited by 410 · cited 1×
“Many of the experiments reported in this symposium volume did not employ replicated treatments and, in at least three instances (Maki 1980, Manuel and Minshall 1980, Rodgers et al. 1980), pseudoreplication was committed.”
BackgroundAn Experimental Study of Dispersal in the California Ground Squirrel
Dobson, F. S. (1979) · Ecology · doi:10.2307/1936957 · Cited by 399
Niche Shifts in Sunfishes: Experimental Evidence and Significance
Werner, E. E., & Hall, D. J. (1976) · Science · doi:10.1126/science.1246626 · Cited by 338
Microcosms in Ecological Research.
Swift, M. J., & Giesy, J. P. (1983) · The Journal of Ecology · doi:10.2307/2259615 · Cited by 308
Experimental Acidification of a Stream in the Hubbard Brook Experimental Forest, New Hampshire
Hall, R. J., Likens, G. E., Fiance, S. B., & Hendrey, G. R. (1980) · Ecology · doi:10.2307/1936765 · Cited by 299 · cited 1×
““), Vossbrink et al. (1979) Hall et al. (1980) Rausher and Feeny (1980). ad hoc efforts to achieve good interspersion had produced a marked degree of regularity in the experimental layout.”
BackgroundThe Role of Microhabitat in Structuring Desert Rodent Communities
Price, M. V. (1978) · Ecology · doi:10.2307/1938543 · Cited by 287
R. A. Fisher, the Life of a Scientist
Box, J. F. (1978) · Medical Entomology and Zoology · Cited by 224
Impacts of mosquitofish (Gambusia affinis) predation on plankton communities
Hurlbert, S. H., & Mulla, M. S. (1981) · Hydrobiologia · doi:10.1007/bf02187157 · Cited by 224
Self-citationDesert Granivore Foraging and Its Impact on Seed Densities and Distributions
Reichman, O. J. (1979) · Ecology · doi:10.2307/1936954 · Cited by 215
Competitive organization of the soft-bottom macrobenthic communities of southern California lagoons
Peterson, C. H. (1977) · Marine Biology · doi:10.1007/bf00396928 · Cited by 214
Field evidence that shrimp predation regulates meiofauna
Bell, S. S., & Coull, B. C. (1978) · Oecologia · doi:10.1007/bf00344727 · Cited by 209
Experiments on epibenthic predation in the Wadden Sea
Reise, K. (1978) · Helgoländer Wissenschaftliche Meeresuntersuchungen · doi:10.1007/bf02296991 · Cited by 205
Schindler, D. W., Armstrong, F. A. J., Holmgren, S. K., & Brunskill, G. J. (1971) · Journal of the Fisheries Research Board of Canada · doi:10.1139/f71-261 · Cited by 202
Experimental Designs, Second Edition.
W., W. A., Cochran, W. G., & Cox, G. M. (1958) · Journal of the American Statistical Association · doi:10.2307/2282583 · Cited by 193
Hurlbert, S. H., Mulla, M. S., & Willson, H. R. (1972) · Ecological Monographs · doi:10.2307/1942211 · Cited by 191 · cited 1×
“We have employed this approach in studies of the effects of an insecticide (Hurlbert et al. 1972) and of fish on plankton populations (Hurlbert and Mulla 198 1).”
MethodSelf-citationOn the Foundations of Statistical Inference: Discussion
Savage, L. J., Barnard, G., Cornfield, J., Bross, I., Box, G. E. P., Good, I. J., Lindley, D. V., Clunies-Ross, C. W., Pratt, J. W., Levene, H., et al. (1962) · Journal of the American Statistical Association · doi:10.2307/2281641 · Cited by 183
Effects of the Spawning Migration of the Alewife, Alosa Pseudoharengus, on Freshwater Ecosystems
Durbin, A. G., Nixon, S. W., & Oviatt, C. A. (1979) · Ecology · doi:10.2307/1936461 · Cited by 180
The response of meiofauna to sediment disturbance
Sherman, K. M., & Coull, B. C. (1980) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(80)90091-x · Cited by 179 · cited 2×
“…Haven (1973) Paine (1974, 1980: Katharina Acmea experiments), Young et al. (1976) Peterson (1977) Vimstein (1977) Bell and Coull (1978) Reise (1978: part), Rogers (1979: part), Vance (1979) Bell (1980) Hixon (1980) Holland et al. (1980) Lubchenco (1980) Markowitz (1980) Sherman and Coull (1980).”
BackgroundZooplankton grazing and phytoplankton species richness: Field tests of the predation hypothesis1
McCauley, E., & Briand, F. (1979) · Limnology and Oceanography · doi:10.4319/lo.1979.24.2.0243 · Cited by 175
The Validity of Comparative Experiments
Anscombe, F. J. (1948) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2984159 · Cited by 175 · cited 5×
“Treatments replicated? No Not Yes Yes Inferential statistics applied? No Yes No Yes . . . . . . . . . . . . . . . . . . . . Freshwater plankton Marine benthos Small mammals Other topics 48 (42) 57 (49) 24 (21) 47 (46) 14 13 1 6 5+(10%) 185 (32%) 1 2 (50%) 137 (28%) 15 15 2 9 14 11 9 19 Totals 176(156) 34 48 (27%) . .…”
BackgroundInfluentialPollution Studies with Marine Plankton
Davies, A. G. (1979) · Advances in Marine Biology · doi:10.1016/s0065-2881(08)60408-3 · Cited by 174
Competition for Food between Two Intertidal Starfish Species and its Effect on Body Size and Feeding
Menge, B. A. (1972) · Ecology · doi:10.2307/1934777 · Cited by 168
Competitive Interactions between California Reef Fishes of the Genus Embiotoca
Hixon, M. A. (1980) · Ecology · doi:10.2307/1936761 · Cited by 168
The effect of shading on coral reef structure and function
Rogers, C. S. (1979) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(79)90136-9 · Cited by 162 · cited 1×
“…veneer of rigor by the erroneous application of inferential statistics (e.g., Barrett 1968, Spitz 1968, Malone 1969, Young et al. 1976, Waloff and Richards 1977, Buzas 1978, Bell and Coull 1978, Rogers 1979, Vance 1979, Holland et al. 1980, Sherman and Coull 1980, Spencer and Barrett 1980).”
BackgroundThe Effects of an Acute Insecticide Stress on a Semi‐Enclosed Grassland Ecosystem
Barrett, G. W. (1968) · Ecology · doi:10.2307/1934487 · Cited by 159 · cited 6×
“To assess the frequency of pseudoreplication in the literature, I examined the experimental designs and statistical analyses of 156 papers reporting the results of manipulative ecological field experiments. These papers represent all the field experiments reported in recent issues of selected journals (Ecology 1979, 1…”
BackgroundMethodInfluentialAbiotic and Biotic Factors in Litter Decomposition in a Sermiarid Grassland
Vossbrinck, C. R., Coleman, D. C., & Woolley, T. A. (1979) · Ecology · doi:10.2307/1937654 · Cited by 158 · cited 1×
“Vossbrinck et al. (1979) Rausher and Feeny (1980) and Warwick et al. (1982) provide three examples.”
BackgroundRausher, M. D., & Feeny, P. (1980) · Ecology · doi:10.2307/1936760 · Cited by 156 · cited 2×
“Vossbrinck et al. (1979) Rausher and Feeny (1980) and Warwick et al. (1982) provide three examples.”
BackgroundAppraising Variability in Population Studies
Eberhardt, L. L. (1978) · Journal of Wildlife Management · doi:10.2307/3800260 · Cited by 153
Meiofauna‐Macrofauna Interactions in a High Salt Marsh Habitat
Bell, S. S. (1980) · Ecological Monographs · doi:10.2307/1942654 · Cited by 150 · cited 6×
“But while I here offer neither anonymity nor blanket admiration, let me state an obvious fact-the quality of an investigation depends on more than good experimental design, so good experimental design by itself is no guarantee of the value of a study. This review does not evaluate the overall quality ofany ofthe works…”
BackgroundInfluentialQuantitative ecology and impact assessment
Eberhardt, L. L. (1976) · Journal of Environmental Management · Cited by 144
Fisher, the life of a scientist.
Morton, N. E. (1979) · Europe PMC (PubMed Central) · Cited by 143
The Effect of Insect Fauna on Growth Mortality and Natality of Broom, Sarothamnus scoparius
Waloff, N., & Richards, O. W. (1977) · Journal of Applied Ecology · doi:10.2307/2402810 · Cited by 142
Species densities of macrobenthos associated with seagrass: A field experimental study of prédation
Buzas, M. A., Young, D. K., & Young, M. W. (1976) · Smithsonian Digital Repository (Smithsonian Institution) · Cited by 131
Slocum, C. (1980) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(80)90095-7 · Cited by 127 · cited 2×
“not doing so (Slocum 1980); shading represents unused portion of study areas.”
BackgroundPRIMARY PRODUCTION IN LABORATORY STREAMS 1,2
Mclntire, C., Garrison, R. L., Phinney, H. K., & Warren, C. E. (1964) · Limnology and Oceanography · doi:10.4319/lo.1964.9.1.0092 · Cited by 126
Influence of predation on infaunal abundance in Upper Chesapeake Bay, USA
Holland, A. F., Mountford, N. K., Hiegel, M. H., Kaumeyer, K. R., & Mihursky, J. A. (1980) · Marine Biology · doi:10.1007/bf00390739 · Cited by 125 · cited 2×
“…Haven (1973) Paine (1974, 1980: Katharina Acmea experiments), Young et al. (1976) Peterson (1977) Vimstein (1977) Bell and Coull (1978) Reise (1978: part), Rogers (1979: part), Vance (1979) Bell (1980) Hixon (1980) Holland et al. (1980) Lubchenco (1980) Markowitz (1980) Sherman and Coull (1980).”
BackgroundCommunity and Population Level Responses to Fertilization in an Old‐Field Ecosystem
Bakelaar, R. G., & Odum, E. P. (1978) · Ecology · doi:10.2307/1938767 · Cited by 124 · cited 2×
“Recent examples are found in Hurlbert et al. (197 l), Cameron (1977), Grant et al. (1977), Virnstein (1977), Bakelaar and Odum (1978), and Bell (1980).”
BackgroundSecondary effects of pesticides on aquatic ecosystems
Hurlbert, S. H. (1975) · Springer eBooks · doi:10.1007/978-1-4613-9391-7_3 · Cited by 123 · cited 3×
“and (5) to suggest ways in which editors quickly can (Hurlbert 1975) improve matters.”
BackgroundInfluentialSelf-citationAn Experimental Analysis of Dispersal in Fluctuating Vole Populations: Demographic Parameters
Gaines, M. S., Vivas, A. M., & Baker, C. L. (1979) · Ecology · doi:10.2307/1936617 · Cited by 117 · cited 2×
“…(1968) Cameron (1977: part), Grant et al. (1977) Price (1978: competitive density), Abramsky et al. (1979) Crowner and Barrett (1979) Dobson (1979) Gaines et al. (1979) Holbrook (1979) Reichman (1979) Spencer and Barrett (1980) Munger and Brown (198 1: matched pairs test). ll Gilderhus (1966)…”
BackgroundMethodEffects of Grazing by the Sea Urchin, Centrostephanus Coronatus, on Prey Community Composition
Vance, R. R. (1979) · Ecology · doi:10.2307/1936074 · Cited by 117 · cited 2×
“…Haven (1973) Paine (1974, 1980: Katharina Acmea experiments), Young et al. (1976) Peterson (1977) Vimstein (1977) Bell and Coull (1978) Reise (1978: part), Rogers (1979: part), Vance (1979) Bell (1980) Hixon (1980) Holland et al. (1980) Lubchenco (1980) Markowitz (1980) Sherman and Coull (1980).”
BackgroundA Preliminary Study of Seed Predation in Desert and Montane Habitats
Brown, J. H., Grover, J. J., Davidson, D. W., & Lieberman, G. A. (1975) · Ecology · doi:10.2307/1936310 · Cited by 113
COMPARISON BETWEEN BALANCED AND RANDOM ARRANGEMENTS OF FIELD PLOTS
STUDENT (1938) · Biometrika · doi:10.1093/biomet/29.3-4.363 · Cited by 107
Competition for Food Between the Intertidal Gastropods Acmaea Scabra and Acmaea Digitalis
Haven, S. B. (1973) · Ecology · doi:10.2307/1934383 · Cited by 99 · cited 1×
“§ Harger (197 1: two cages), Menge (1972) Haven (1973) Paine (1974, 1980: Katharina Acmea experiments), Young et al. (1976) Peterson (1977) Vimstein (1977) Bell and Coull (1978) Reise (1978: part), Rogers (1979: part), Vance (1979) Bell (1980) Hixon (1980) Holland et al. (1980) Lubchenco (1980)…”
Community structure and functional role of small mammals in ecosystems
Hayward, G., & Phillipson, J. (1979) · Springer eBooks · doi:10.1007/978-94-009-5772-5_4 · Cited by 97 · cited 1×
“…reported in the volume edited by Kerfoot (1980), and those listed in the bibliographies of several recent papers and reviews (Connell 1974, Hurlbert 1975, Chew 1978, Hayne 1978, Hayward and Phillipson 1979, Paine 1980, Peterson 1980, Vimstein 1980, Hurlbert and Mulla 198 1, Munger and Brown 198 1).”
BackgroundStructural Characteristics of Benthic Algal Communities in Laboratory Streams
McIntire, C. D. (1968) · Ecology · doi:10.2307/1934118 · Cited by 95 · cited 2×
“(1964) likewise made no mention of the need for replication and failed to replicate treatments in a later experiment (McIntire 1968).”
BackgroundSome Effects of Sublethal Concentrations of Sodium Arsenite on Bluegills and the Aquatic Environment
Gilderhus, P. A. (1966) · Transactions of the American Fisheries Society · doi:10.1577/1548-8659(1966)95[289:seosco]2.0.co;2 · Cited by 94 · cited 1×
“…Dobson (1979) Gaines et al. (1979) Holbrook (1979) Reichman (1979) Spencer and Barrett (1980) Munger and Brown (198 1: matched pairs test). ll Gilderhus (1966) Clarke and Grant (1968) Cope et al. (1969) Malone (1969) Hurlbert et al. (197 1: ducks), Werner and Hall (1976) Bakelaar and Odum…”
BackgroundCompetition in Desert Rodents: An Experiment with Semipermeable Exclosures
Munger, J. C., & Brown, J. H. (1981) · Science · doi:10.1126/science.211.4481.510 · Cited by 88
An Experimental Study of the Role of Spiders as Predators in a Forest Litter Community. Part 1
Clarke, R. D., & Grant, P. R. (1968) · Ecology · doi:10.2307/1934499 · Cited by 86 · cited 2×
“…Gaines et al. (1979) Holbrook (1979) Reichman (1979) Spencer and Barrett (1980) Munger and Brown (198 1: matched pairs test). ll Gilderhus (1966) Clarke and Grant (1968) Cope et al. (1969) Malone (1969) Hurlbert et al. (197 1: ducks), Werner and Hall (1976) Bakelaar and Odum (1978) Durbin et…”
BackgroundON TESTING VARIETIES OF CEREALS
Student (1923) · Biometrika · doi:10.2307/2331868 · Cited by 82 · cited 1×
“The classic example is the design yielded by the “half drill strip” method of planting grain in two-variety trials (Gossett 1923, Neyman and Pearson 1937).”
MethodYATES, F. (1939) · Biometrika · doi:10.1093/biomet/30.3-4.440 · Cited by 80 · cited 2×
“…designs is that “Biases may be introduced into treatment means, owing to the pattern of the systematic arrangement coinciding with some fertility pattern in the field, and this bias may persist over whole groups of experiments owing to the arrangement being the same in all” (Yates 1939:442).”
BackgroundExperiments with Radiophosphorus Tracer in Aquarium Microcosms
WHITTAKER, R. H. (1961) · Ecological Monographs · doi:10.2307/1950753 · Cited by 80
Influence of Supplemental Food on Local Populations of Peromyscus leucopus
Hansen, L. P., & Batzli, G. O. (1979) · Journal of Mammalogy · doi:10.2307/1379805 · Cited by 77
Competition among Small Mammals in Experimentally Perturbed Areas of the Shortgrass Prairie
Abramsky, Z., Dyer, M. I., & Harrison, P. D. (1979) · Ecology · doi:10.2307/1936073 · Cited by 76 · cited 3×
“Examples of temporal pseudoreplication may be found in Cowell (1965), Clarke and Grant (1968), Thomas and Seibert (1977), Abramsky et al. (1979), McCauley and Briand (1979), and Hixon (1 980).”
BackgroundOrnitholimnology: Effects of grazing by the Andean flamingo ( Phoenicoparrus andinus )
Hurlbert, S. H., & Chang, C. C. Y. (1983) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.80.15.4766 · Cited by 76 · cited 1×
“An example where a systematic design seemed definitely preferable to a randomized one concerns an experiment on the effects of flamingo grazing on lacustrine microbenthos (Hurlbert and Chang 1983).”
BackgroundSelf-citationForaminifera as Prey for Benthic Deposit Feeders: Results of Predator Exclusion Experiments
Buzas, M. A. (1978) · Smithsonian Digital Repository (Smithsonian Institution) · Cited by 73
Dynamics of Cadmium-Stressed Plankton Communities
Marshall, J. S., & Mellinger, D. L. (1980) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/f80-054 · Cited by 68
Vertebrate Pollination and the Maintenance of Dioecism in Freycinetia
Cox, P. A. (1982) · The American Naturalist · doi:10.1086/283970 · Cited by 67
Biological Effects and Persistence of Dursban® in Freshwater Ponds12
Hurlbert, S. H., Mulla, M. S., Keith, J. O., Westlake, W. E., & DüSch, M. E. (1970) · Journal of Economic Entomology · doi:10.1093/jee/63.1.43 · Cited by 63
Self-citationHolbrook, S. J. (1979) · Ecology · doi:10.2307/1936613 · Cited by 62 · cited 1×
“…part), Grant et al. (1977) Price (1978: competitive density), Abramsky et al. (1979) Crowner and Barrett (1979) Dobson (1979) Gaines et al. (1979) Holbrook (1979) Reichman (1979) Spencer and Barrett (1980) Munger and Brown (198 1: matched pairs test). ll Gilderhus (1966) Clarke and Grant (1968)…”
BackgroundCameron, G. N. (1977) · Journal of Mammalogy · doi:10.2307/1379997 · Cited by 61 · cited 2×
“Recent examples are found in Hurlbert et al. (197 l), Cameron (1977), Grant et al. (1977), Virnstein (1977), Bakelaar and Odum (1978), and Bell (1980).”
BackgroundMethodJoule, J., & Cameron, G. N. (1975) · Journal of Mammalogy · doi:10.2307/1379368 · Cited by 56 · cited 1×
“…198 1, 1982); (II) test of effects on dispersal of removing from unfenced field plots one (S, R), both (SR), or neither (C) of two rodent species (Joule and Cameron 1975); (III) test to compare effects on algae, of removing grazers (R) vs. not doing so (Slocum 1980); shading represents unused…”
BackgroundRandomization and Experimentation
Youden, W. J. (1972) · Technometrics · doi:10.1080/00401706.1972.10488879 · Cited by 54 · cited 1×
“In a talk in 1956, Youden (1972) described a “constrained randomization” procedure in which exact knowledge of c+= is retained by rejecting both highly segregated and highly interspersed layouts.”
MethodClark, R. W. (1975) · Medical Entomology and Zoology · Cited by 50
Statistics in Agricultural Research
Wishart, J. (1934) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.2307/2983596 · Cited by 44
Fisher and the Analysis of Variance
Cochran, W. G. (1980) · Lecture notes in statistics · doi:10.1007/978-1-4612-6079-0_4 · Cited by 43 · cited 1×
“The story is well told by his daughter (Box 1978: 11 O-l 12) and Cochran ( 1980).”
BackgroundThe arrangement of field experiments and the statistical reduction of the results
Fisher, R., & Wishart, J. (1930) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · doi:10.23637/rothamsted.8v20y · Cited by 42
Faunistic control of Enteromorpha blooms: A field experiment
Warwick, R. M., Davey, J. T., Gee, J. M. W., & George, C. L. (1981) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(81)90005-8 · Cited by 40
Vance, R. R., & Schmitt, R. J. (1979) · Oecologia · doi:10.1007/bf00346391 · Cited by 39
Grice, G. D., Reeve, M. R., Koeller, P., & Menzel, D. W. (1977) · Helgoland Marine Research · doi:10.1007/bf02207830 · Cited by 38
Microcosm studies on estuarine waters. I. The replicability of microcosms.
Abbott, W. (1966) · PubMed · Cited by 34
Predator influence on shore-level size gradients in Tegula funebralis (A. Adams)
Markowitz, D. V. (1980) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(80)90065-9 · Cited by 33 · cited 1×
“…Haven (1973) Paine (1974, 1980: Katharina Acmea experiments), Young et al. (1976) Peterson (1977) Vimstein (1977) Bell and Coull (1978) Reise (1978: part), Rogers (1979: part), Vance (1979) Bell (1980) Hixon (1980) Holland et al. (1980) Lubchenco (1980) Markowitz (1980) Sherman and Coull (1980).”
BackgroundA TEST OF THE SUPPOSED PRECISION OF SYSTEMATIC ARRANGEMENTS
BARBACKI, S., & Fisher, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02138.x · Cited by 33 · cited 2×
“His hard-nosed rejection of any departure from strict randomization procedures, and of systematic designs in particular (Barbacki and Fisher 1936, Fisher 1971:64-65, 76-80), was an attitude that was passed on to his followers and that has set the tone of the literature on the topic.”
BackgroundEffects of Fire on the Small Mammal Component of an Experimental Grassland Community
Crowner, A. W., & Barrett, G. W. (1979) · Journal of Mammalogy · doi:10.2307/1380195 · Cited by 33
Effects of Diazinon Contamination on an Old-field Ecosystem
Malone, C. R. (1969) · The American Midland Naturalist · doi:10.2307/2423815 · Cited by 33 · cited 2×
“…(1979) Spencer and Barrett (1980) Munger and Brown (198 1: matched pairs test). ll Gilderhus (1966) Clarke and Grant (1968) Cope et al. (1969) Malone (1969) Hurlbert et al. (197 1: ducks), Werner and Hall (1976) Bakelaar and Odum (1978) Durbin et al. (1979: litter respiration), McCauley and…”
BackgroundEffects of Dichlobenil on Two Fishpond Environments
Cope, O. B., McCraren, J. P., & Eller, L. L. (1969) · Weed Science · doi:10.1017/s0043174500031222 · Cited by 28 · cited 1×
“…Holbrook (1979) Reichman (1979) Spencer and Barrett (1980) Munger and Brown (198 1: matched pairs test). ll Gilderhus (1966) Clarke and Grant (1968) Cope et al. (1969) Malone (1969) Hurlbert et al. (197 1: ducks), Werner and Hall (1976) Bakelaar and Odum (1978) Durbin et al. (1979: litter…”
BackgroundEffects on Sevin on Arthropods in an Agricultural and an Old‐Field Plant Community
Suttman, C. E., & Barrett, G. W. (1979) · Ecology · doi:10.2307/1936083 · Cited by 25
Zooplankton abundance and diversity in Central Florida grass carp ponds
Fry, D. L., & Osborne, J. A. (1980) · Hydrobiologia · doi:10.1007/bf00019700 · Cited by 17
Neyman, J., & Pearson, E. S. (1938) · Biometrika · doi:10.1093/biomet/29.3-4.380 · Cited by 16
Giguère, L. A. (1979) · Canadian Journal of Zoology · doi:10.1139/z79-137 · Cited by 16
Meadow Vole Population Response to Vegetational Changes Resulting from 2,4-D Application
Spencer, S. R., & Barrett, G. W. (1980) · The American Midland Naturalist · doi:10.2307/2425036 · Cited by 15 · cited 2×
“…veneer of rigor by the erroneous application of inferential statistics (e.g., Barrett 1968, Spitz 1968, Malone 1969, Young et al. 1976, Waloff and Richards 1977, Buzas 1978, Bell and Coull 1978, Rogers 1979, Vance 1979, Holland et al. 1980, Sherman and Coull 1980, Spencer and Barrett 1980).”
BackgroundJones, B. R., & Moyle, J. B. (1963) · Transactions of the American Fisheries Society · doi:10.1577/1548-8659(1963)92[211:popaar]2.0.co;2 · Cited by 13 · cited 1×
“‡ Jones and Moyle (1963) Cowell (1965) Giguere (1979: clutch size), Fry and Osborne (1980) Marshall and Mellinger (1980: ELA experiment).”
BackgroundThe Effects of Sodium Arsenite and Silvex on the Plankton Populations in Farm Ponds
Cowell, B. C. (1965) · Transactions of the American Fisheries Society · doi:10.1577/1548-8659(1965)94[371:teosaa]2.0.co;2 · Cited by 10
Microcosm studies on estuarine waters. II. The effects of single doses of nitrate and phosphate.
Abbott, W. (1967) · PubMed · Cited by 9
Spitz, F. (1968) · La Terre et La Vie Revue d Histoire naturelle · doi:10.3406/revec.1968.4526 · Cited by 9 · cited 4×
“…from unreplicated treatments are given an unmerited veneer of rigor by the erroneous application of inferential statistics (e.g., Barrett 1968, Spitz 1968, Malone 1969, Young et al. 1976, Waloff and Richards 1977, Buzas 1978, Bell and Coull 1978, Rogers 1979, Vance 1979, Holland et al. 1980,…”
BackgroundInfluential
Cited by
A new method for non-parametric multivariate analysis of variance
Anderson, M. J. (2001) · Austral Ecology · doi:10.1111/j.1442-9993.2001.01070.pp.x · Cited by 13,828
“…that the developments in experimental design for ecology that require multifactorial ANOVA, in order to, for example, avoid pseudo-replication (Hurlbert 1984), test for generality (Beck 1997) or test for environmental impact (e.g. Green 1979, 1993; Underwood 1993; Glasby 1997), should be…”
BackgroundA protocol for data exploration to avoid common statistical problems: Data exploration
Zuur, A. F., Ieno, E. N., & Elphick, C. S. (2010) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2009.00001.x · Cited by 8,228
“A crucial assumption of most statistical techniques is that observations are independent of one another (Hurlbert 1984), meaning that information from any one observation should not provide information on another after the effects of other variables have been accounted for.”
BackgroundLebreton, J.-D., Burnham, K. P., Clobert, J., & Anderson, D. R. (1992) · Ecological Monographs · doi:10.2307/2937171 · Cited by 4,517
“When only one site is used there is a danger of committing pseudoreplication (Hurlbert 1984).”
BackgroundF. Dormann, C., M. McPherson, J., B. Araújo, M., Bivand, R., Bolliger, J., Carl, G., G. Davies, R., Hirzel, A., Jetz, W., Daniel Kissling, W., et al. (2007) · Ecography · doi:10.1111/j.2007.0906-7590.05171.x · Cited by 3,433
Legendre, P., & Anderson, M. J. (1999) · Ecological Monographs · doi:10.1890/0012-9615(1999)069[0001:dbratm]2.0.co;2 · Cited by 2,695
“The use of structured experiments for testing hypotheses is essential to the science of ecology (Connell 1972, Hurlbert 1984, Underwood 1990, 1997).”
Background
Metadata
- Authors
- Hurlbert, S. H.
- Corresponding author
- Hurlbert, Stuart H.
- Venue
- Ecological Monographs
- Publisher
- Wiley
- Published
- 1984-06
- Volume
- 54
- Issue
- 2
- Pages
- 187-211
- ISSN
- 0012-9615 (ISSN-L)
- 1557-7015
- OpenAlex
- W2139156166
- Cited by
- 8,377
- References
- 102
- Citations by year
- 2026: 283 · 2025: 212 · 2024: 155 · 2023: 167 · 2022: 164 · 2021: 212 · 2020: 221 · 2019: 233 · 2018: 231 · 2017: 226 · 2016: 266 · 2015: 279 · 2014: 296 · 2013: 280 · 2012: 254
- FWCI
- 120.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ecological Monographs (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- pseudoreplication, experimental design, randomization, type I error, marine benthos, small mammals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.