Pseudoreplication and the Design of Ecological Field Experiments
The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
Pseudoreplication is defined as the use of inferential statistics to test for treatment effects with data from experiments where either treatments are not replicated (though samples may be) or replicates are not statistically independent. In ANOVA terminology, it is the testing for treatment effects with an error term inappropriate to the hypothesis being considered. Scrutiny of 176 experimental studies published between 1960 and the present revealed that pseudoreplication occurred in 27% of them, or 48% of all such studies that applied inferential statistics. The incidence of pseudoreplication is especially high in studies of marine benthos and small mammals. The critical features of controlled experimentation are reviewed. Nondemonic intrusion is defined as the impingement of chance events on an experiment in progress. As a safeguard against both it and preexisting gradients, interspersion of treatments is argued to be an obligatory feature of good design. Especially in small experiments, adequate interspersion can sometimes be assured only by dispensing with strict randomization procedures. Comprehension of this conflict between interspersion and randomization is aided by distinguishing pre—layout (or conventional) and layout—specific alpha (probability of type I error). Suggestions are offered to statisticians and editors of ecological journals as to how ecologists' understanding of experimental design and statistics might be improved.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“The tautological structure of the Kauffman and Cummings model invalidates Ripple et al.'s analysis because applying it violates the scientific principle that conclusions must be supported by evidence that is independent of the data used to generate them (Hurlbert 1984; Nakagawa & Parker 2015).”
From Flawed analysis invalidates claim of a strong Yellowstone trophic cascade after wolf reintroduction: A comment on Ripple et al. (2025) (2025) · cites this paper as Hurlbert 1984
In the citing paper
“A reason for this small number is that many studies incorporated experimental designs that suffered from pseudoreplication [79].”
From Land use change to bioenergy: A meta-analysis of soil carbon and GHG emissions (2015) · cites this paper as [79]
In the citing paper
“Pseudoreplication leads to a biased and incorrect inference, and it should be carefully considered (Hurlbert, 1984).”
From Acoustic indices as proxies for biodiversity: a meta‐analysis (2022) · cites this paper as Hurlbert, 1984
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Principles and procedures of statistics: McGraw-Hill Book Company, Inc. New York Toronto London.
Steel, R., & Torrie, J. H. (1960) · Cited by 4,633
Food Webs: Linkage, Interaction Strength and Community Infrastructure
Paine, R. T. (1980) · The Journal of Animal Ecology · doi:10.2307/4220 · Cited by 1,824
Sampling Design and Statistical Methods for Environmental Biologists
Green, R. H. (1979) · Andalas University Repository (Andalas University) · Cited by 1,550
Biogeochemistry of a forested ecosystem
(2014) · Choice Reviews Online · doi:10.5860/choice.51-6175 · Cited by 1,550
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Paine, R. T. (1974) · Oecologia · doi:10.1007/bf00345739 · Cited by 1,403
Cited by
Items 301–400 of 1,029
Powell, R. A., & Proulx, G. (2003) · ILAR Journal · doi:10.1093/ilar.44.4.259 · Cited by 228
Sack, L., & Grubb, P. J. (2002) · Oecologia · doi:10.1007/s00442-002-0873-0 · Cited by 231
“Because individual irradiance treatments were applied with the shade towers, each seedling is a true replicate (see Hurlbert 1984 ).”
BackgroundMethodSilva, P. G. D., & Hernández, M. I. M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126112 · Cited by 232
“With this larger spacing between baited traps, we are not trying to use the traps as “true replicates” (see [34, 73]).”
BackgroundUse of operative temperature and standard operative temperature models in thermal biology
Dzialowski, E. M. (2005) · Journal of Thermal Biology · doi:10.1016/j.jtherbio.2005.01.005 · Cited by 230
“However, the study could have been improved by using more than one mount for each age class, as the multiple measurements on a single mount represent pseudoreplication (Hurlbert , 1984).”
BackgroundEffects of experimentally induced cyanobacterial blooms on crustacean zooplankton communities
Ghadouani, A., Pinel‐Alloul, B., & Prepas, E. E. (2003) · Freshwater Biology · doi:10.1046/j.1365-2427.2003.01010.x · Cited by 229
“units and hence are not truly independent (Hurlbert, 1984).”
BackgroundRoss, D. J., Tate, K. R., Scott, N. A., & Feltham, C. W. (1999) · Soil Biology and Biochemistry · doi:10.1016/s0038-0717(98)00180-1 · Cited by 226
Osunkoya, O. O., Ash, J. E., Hopkins, M. S., & Graham, A. W. (1994) · The Journal of Ecology · doi:10.2307/2261394 · Cited by 236
Climate change causes rapid changes in the distribution and site abundance of birds in winter
MACLEAN, I. M. D., AUSTIN, G. E., REHFISCH, M. M., BLEW, J., CROWE, O., DELANY, S., DEVOS, K., DECEUNINCK, B., GÜNTHER, K., LAURSEN, K., et al. (2008) · Global Change Biology · doi:10.1111/j.1365-2486.2008.01666.x · Cited by 224
“Firstly, because count data are pseudo-replicated (Hurlbert, 1984) insofar as counts conducted within a particular region or site through time are all responding to some environmental factor unrelated to climate in a similar manner.”
BackgroundCHACOFF, N. P., & AIZEN, M. A. (2006) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2005.01116.x · Cited by 228
“Thus, the four plantations included in this study were considered true replicates ( Hulbert 1984 ).”
BackgroundOceanographic habitats of two sympatric North Pacific albatrosses during the breeding season
Hyrenbach, K., Fernández, P., & Anderson, D. (2002) · Marine Ecology Progress Series · doi:10.3354/meps233283 · Cited by 228
“Therefore, statistical analyses that include every telemetry location along a foraging trip may falsely reject the null hypothesis (Type I error) due to inflated sample sizes (i.e. pseudoreplication; Hurlbert 1984).”
BackgroundForm, A. U., & Riebesell, U. (2012) · Global Change Biology · doi:10.1111/j.1365-2486.2011.02583.x · Cited by 225
“In terms of sta- tistics, the single coral branches in the aquaria of the whole CRS have to be regarded as pseudoreplicates sensu Hurlbert (1984) making statistical comparisons between the replicates problematic.”
BackgroundBLOCKING FACTORS AND HYPOTHESIS TESTS IN ECOLOGY: IS YOUR STATISTICS TEXT WRONG?
Newman, J. A., Bergelson, J., & Grafen, A. (1997) · Ecology · doi:10.1890/0012-9658(1997)078[1312:bfahti]2.0.co;2 · Cited by 225
Kreyling, J., Schweiger, A. H., Bahn, M., Ineson, P., Migliavacca, M., Morel‐Journel, T., Christiansen, J. R., Schtickzelle, N., & Larsen, K. S. (2018) · Ecology Letters · doi:10.1111/ele.13134 · Cited by 222
“Interspersion and replication are basic principles to deal with such random or spatially structured variation (Hurlbert 1984).”
BackgroundInfluentialLoud calls as indicators of dominance in male baboons (Papio cynocephalus ursinus)
Kitchen, D. M., Seyfarth, R. M., Fischer, J., & Cheney, D. L. (2003) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-003-0588-1 · Cited by 226
García, D., Zamora, R., Gómez, J. M., Jordano, P., & Hódar, J. A. (2000) · Journal of Ecology · doi:10.1046/j.1365-2745.2000.00459.x · Cited by 225
“As latitude was expressed in whole degrees, in order to avoid pseudoreplication we used the mean value of the dependent variables as a sample unit in the regression model for those populations sharing the same latitude degree (Hulbert 1984).”
MethodPoor evidence-base for assessment of windfarm impacts on birds
STEWART, G. B., PULLIN, A. S., & COLES, C. F. (2007) · Environmental Conservation · doi:10.1017/s0376892907003554 · Cited by 222
“Windfarm grand means, sample sizes and variance were used to generate effect sizes to avoid pseudoreplication (Hurlbert 1984).”
MethodClimate‐induced changes in the small mammal communities of the Northern Great Lakes Region
MYERS, P., LUNDRIGAN, B. L., HOFFMAN, S. M. G., HARAMINAC, A. P., & SETO, S. H. (2009) · Global Change Biology · doi:10.1111/j.1365-2486.2009.01846.x · Cited by 220
“Including them would have strongly biased the analyses in the direction of conditions at those sites, and for inferences concerning regional community composition, would represent a form of pseudoreplication (Hurlbert, 1984).”
BackgroundRochefort, L., Vitt, D. H., & Bayley, S. E. (1990) · Ecology · doi:10.2307/1937607 · Cited by 221
Sampling Insect Populations for the Purpose of IPM Decision Making
Binns, M. R., & Nyrop, J. P. (1992) · Annual Review of Entomology · doi:10.1146/annurev.en.37.010192.002235 · Cited by 215
Potential Carbon Losses From Peat Profiles: Effects of Temperature, Drought Cycles, and Fire
Hogg, E. H., Lieffers, V. J., & Wein, R. W. (1992) · Ecological Applications · doi:10.2307/1941863 · Cited by 222
“For practical reasons (i.e., a limited number of growth chambers) the experimental design used did not achieve true replication with respect o temperature treatments (Hurlbert 1985).”
MethodCurrent opportunities and challenges in microbial metagenome analysis--a bioinformatic perspective
Teeling, H., & Glockner, F. O. (2012) · Briefings in Bioinformatics · doi:10.1093/bib/bbs039 · Cited by 222
“Part of this can be addressed by pseudo-replication [29], such as sub-sample analysis and comparison of samples within time series [30], and by independent assessments of methodological reproducibility using representative test data sets.”
BackgroundMate Choice in Experimentally Parasitized Rock Doves: Lousy Males Lose
CLAYTON, D. H. (1990) · American Zoologist · doi:10.1093/icb/30.2.251 · Cited by 221
“4) (Hurlbert, 1984).”
(2000) · Cited by 220
Carter, J. L., & Resh, V. H. (2001) · Journal of the North American Benthological Society · doi:10.2307/1468095 · Cited by 222
“…exceeded a single riffle–pool sequence were longer than we expected and likely reflected attempts to avoid the atypical patterns possible if only a single habitat was examined from a single riffle–pool sequence, a topic that has been discussed as part of the pseudoreplication issue (Hurlbert 1984).”
BackgroundBuisson, L., Blanc, L., & Grenouillet, G. (2008) · Ecology of Freshwater Fish · doi:10.1111/j.1600-0633.2007.00276.x · Cited by 216
“Thus the repetition of each site could lead to underestimation of standard errors and consequently, to an increase of the chance of detecting statistically significant results by inflated Type I error rate (Hurlbert 1984; Millar & Anderson 2004).”
BackgroundSIMPLICITY AND COMPLEXITY IN ECOLOGICAL DATA ANALYSIS
Murtaugh, P. A. (2007) · Ecology · doi:10.1890/0012-9658(2007)88[56:sacied]2.0.co;2 · Cited by 220
“Of course, statistical rigor should not be sacrificed in the quest for directness; there are many examples of simple analyses that are misleading or incorrect (e.g., see Hurlbert 1984).”
BackgroundKeystone effects of an alien top-predator stem extinctions of native mammals
Letnic, M., Koch, F., Gordon, C., Crowther, M. S., & Dickman, C. R. (2009) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2009.0574 · Cited by 219
“Thus, our treatments were spatially segregated such that, in a strictly statistical sense, our experimental design does not allow inferences concerning the effect of dingoes (Hurlbert 1984).”
BackgroundImpact of pasture, agriculture and crop-livestock systems on soil C stocks in Brazil
Carvalho, J. L. N., Raucci, G. S., Cerri, C. E. P., Bernoux, M., Feigl, B. J., Wruck, F. J., & Cerri, C. C. (2010) · Soil and Tillage Research · doi:10.1016/j.still.2010.07.011 · Cited by 220
Physiological Controls Over Seedling Growth in Primary Succession on an Alaskan Floodplain
Walker, L. R., & Chapin, F. S. (1986) · Ecology · doi:10.2307/1939082 · Cited by 222
Paine, R. T., Castillo, J. C., & Cancino, J. (1985) · The American Naturalist · doi:10.1086/284371 · Cited by 218
Interactions Between Predation Risk and Competition: A Field Study of Kangaroo Rats and Snakes
Bouskila, A. (1995) · Ecology · doi:10.2307/1940639 · Cited by 221
Thor, P., & Dupont, S. (2015) · Global Change Biology · doi:10.1111/gcb.12815 · Cited by 219
“For these tests, the experimental units were the random samples of five females from each population (Hurlbert, 1984).”
MethodDiversity in planktonic communities: An experimental test of the intermediate disturbance hypothesis
Flöder, S., & Sommer, U. (1999) · Limnology and Oceanography · doi:10.4319/lo.1999.44.4.1114 · Cited by 217
“Different treatments were randomly arranged at the pontoons (Hurlbert 1984).”
MethodExperimental EvolutionConcepts, Methods, and Applications of Selection Experiments
Garland, T., & Rose, M. R. (2009) · University of California Press eBooks · doi:10.1525/california/9780520247666.001.0001 · Cited by 213
The analysis of stress in natural populations
UNDERWOOD, A. J. (1989) · Biological Journal of the Linnean Society · doi:10.1111/j.1095-8312.1989.tb02005.x · Cited by 220
Holl, K. D., Zahawi, R. A., Cole, R. J., Ostertag, R., & Cordell, S. (2011) · Restoration Ecology · doi:10.1111/j.1526-100x.2010.00674.x · Cited by 217
“…differences are a common result of the few studies conducted at several sites (Calvo-Alvarado et al. 2007; Wishnie et al. 2007) and highlight the need to replicate at multiple sites to draw general ecological conclusions and make restoration recommendations (Hurlbert 1984; Hayes & Holl 2003).”
BackgroundPeay, K. G., Kennedy, P. G., Davies, S. J., Tan, S., & Bruns, T. D. (2010) · New Phytologist · doi:10.1111/j.1469-8137.2009.03075.x · Cited by 214
Swaddle, J. P., & Witter, M. S. (1997) · Canadian Journal of Zoology · doi:10.1139/z97-136 · Cited by 217
Negative fire feedback in a transitional forest of southeastern Amazonia
BALCH, J. K., NEPSTAD, D. C., BRANDO, P. M., CURRAN, L. M., PORTELA, O., De CARVALHO, O., & LEFEBVRE, P. (2008) · Global Change Biology · doi:10.1111/j.1365-2486.2008.01655.x · Cited by 216
“Key advantages of our planned burns, however, are that we were able to conduct intensive pre-, during-, and postfire measures and compare with an unburned control, following well-established procedures for large experimental manipulations without true replication (Hurlbert, 1984).”
BackgroundInfluentialConservation Value of Roadside Prairie Restoration to Butterfly Communities
Ries, L., Debinski, D. M., & Wieland, M. L. (2001) · Conservation Biology · doi:10.1046/j.1523-1739.2001.015002401.x · Cited by 216
“This procedure eliminated the problem of pseudoreplication (Hurlbert 1984).”
BackgroundMurchie, K. J., Hair, K. P. E., Pullen, C. E., Redpath, T. D., Stephens, H. R., & Cooke, S. J. (2008) · River Research and Applications · doi:10.1002/rra.1058 · Cited by 215
“Experimental controls are important because biological systems are prone to variability (Hurlbert, 1984).”
BackgroundSONIC DETERRENTS IN ANIMAL DAMAGE CONTROL: A REVIEW OF DEVICE TESTS AND EFFECTIVENESS
Bomford, M., & O'Brien, P. H. (1990) · Cited by 213
Shaver, G. R., & Chapin, F. S. (1995) · Ecography · doi:10.1111/j.1600-0587.1995.tb00129.x · Cited by 215
“treatments? By replicating the same experiment in different sites we can, for the first time, generalize about the nature and extent of nutrient limitation in wet and moist tundras rather than being forced to restrict our conclusions to a particular study site (Hurlbert 1984).”
BackgroundEffects of Moose Movement and Habitat Use on GPS Collar Performance
Moen, R., Pastor, J., Cohen, Y., & Schwartz, C. C. (1996) · The Journal of Wildlife Management · doi:10.2307/3802085 · Cited by 214
Bioacoustics of Fishes of the Family Sciaenidae (Croakers and Drums)
Ramcharitar, J., Gannon, D. P., & Popper, A. N. (2006) · Transactions of the American Fisheries Society · doi:10.1577/t05-207.1 · Cited by 210
“However, these results should be viewed with caution because (1) the experimental stimulus included biological sounds other than those of dolphin whistles, meaning that it is unclear which sound elicited the response; (2) the experimental design suffered from pseudoreplication ( Hurlbert 1984 ); and (3) the investigat…”
ResultTwo‐Stage Life Histories in Fish: The Interaction Between Juvenile Competition and Adult Performance
Osenberg, C. W., Mittelbach, G. G., & Wainwright, P. C. (1992) · Ecology · doi:10.2307/1938737 · Cited by 213
“In any such unreplicated comparison, one must be cautious in assigning causality to an observed pattern (Hurlbert 1984).”
BackgroundRecovery of wild large herbivores following livestock decline in a tropical Indian wildlife reserve
MADHUSUDAN, M. D. (2004) · Journal of Applied Ecology · doi:10.1111/j.0021-8901.2004.00950.x · Cited by 211
Marine subsidies have multiple effects on coastal food webs
Spiller, D. A., Piovia-Scott, J., Wright, A. N., Yang, L. H., Takimoto, G., Schoener, T. W., & Iwata, T. (2010) · Ecology · doi:10.1890/09-0715.1 · Cited by 211
“Confirmed identifications of buttonwood herbivores are Coleoptera (Chrysomelidae, Chaetocnema brunnescens, Metachroma felis, Crytocephalus sp.; Curculionidae, Artipus floridanus; Elateridae, Conoderus sp.) and Lepidoptera (Noctuidae, Collomena filifera; Psychidae, Biopsyche sp.; Gelechiidae, unidentified species); lea…”
BackgroundMethodInfluentialCommunities contain closely related species during ecosystem disturbance
Helmus, M. R., Keller, W. (., Paterson, M. J., Yan, N. D., Cannon, C. H., & Rusak, J. A. (2010) · Ecology Letters · doi:10.1111/j.1461-0248.2009.01411.x · Cited by 208
Using diatoms to assess the biological condition of large rivers in Idaho (U.S.A.)
Fore, L. S., & Grafe, C. (2002) · Freshwater Biology · doi:10.1046/j.1365-2427.2002.00948.x · Cited by 211
“Statistical testing assumes independence because correlation and significance can be inflated when values are similar as a result of physical proximity rather than the independent factors being tested ( Hurlbert, 1984; Dunham & Vinyard, 1997).”
BackgroundPlasticity and acclimation to light in tropical Moraceae of different sucessional positions
Strauss-Debenedetti, S., & Bazzaz, F. A. (1991) · Oecologia · doi:10.1007/bf00634595 · Cited by 214
Community—And Ecosystem-Level Changes in a Species-Rich Tallgrass Prairie Restoration
Camill, P., McKone, M. J., Sturges, S. T., Severud, W. J., Ellis, E., Limmer, J., Martin, C. B., Navratil, R. T., Purdie, A. J., Sandel, B. S., et al. (2004) · Ecological Applications · doi:10.1890/03-5273 · Cited by 210
Soil chemical properties affect the reaction of forest soil bacteria to drought and rewetting stress
Chodak, M., Gołębiewski, M., Morawska-Płoskonka, J., Kuduk, K., & Niklińska, M. (2015) · Annals of Microbiology · doi:10.1007/s13213-014-1002-0 · Cited by 210
“In order to avoid a pseudoreplication problem (Hurlbert 1984), the sampling sites were located in two regions and at large distances from each other.”
BackgroundImpacts of climate change on surface ozone and intercontinental ozone pollution: A multi‐model study
Doherty, R. M., Wild, O., Shindell, D. T., Zeng, G., MacKenzie, I. A., Collins, W. J., Fiore, A. M., Stevenson, D. S., Dentener, F. J., Schultz, M. G., et al. (2013) · Journal of Geophysical Research: Atmospheres · doi:10.1002/jgrd.50266 · Cited by 209
Browne, M. A., Chapman, M. G., Thompson, R. C., Amaral Zettler, L. A., Jambeck, J., & Mallos, N. J. (2015) · Environmental Science & Technology · doi:10.1021/es5060572 · Cited by 204
Strack, M., Waddington, J. M., Rochefort, L., & Tuittila, E. ‐. (2006) · Journal of Geophysical Research: Biogeosciences · doi:10.1029/2005jg000145 · Cited by 200
“The overall design was pseudoreplicated (one control site and one drained site [Hurlbert, 1984]) but as it was not materially feasible to replicate this at the ecosystem level, precaution was taken in the interpretation of the data.”
BackgroundThe Influence of Landscape Structure on Female Roe Deer Home-range Size
Saïd, S., & Servanty, S. (2005) · Landscape Ecology · doi:10.1007/s10980-005-7518-8 · Cited by 211
“Individual roe deer were included as a random factor, to take repeated measures of individuals and intra-individual variance into account (Little et al. 1991) and to avoid pseudoreplication (Hurlbert 1984).”
BackgroundFOREST RESPONSE TO CATASTROPHIC WIND: RESULTS FROM AN EXPERIMENTAL HURRICANE
Cooper-Ellis, S., Foster, D. R., Carlton, G., & Lezberg, A. (1999) · Ecology · doi:10.1890/0012-9658(1999)080[2683:frtcwr]2.0.co;2 · Cited by 204
Odonates as biological indicators of grazing effects on Canadian prairie wetlands
Lee Foote, A., & Rice Hornung, C. L. (2005) · Ecological Entomology · doi:10.1111/j.0307-6946.2005.00701.x · Cited by 204
“> 1 km) to be considered statistically independent relative to dispersal distances (Hurlbert, 1984).”
BackgroundYen, P. P. W., Sydeman, W. J., & Hyrenbach, K. D. (2004) · Journal of Marine Systems · doi:10.1016/j.jmarsys.2003.09.015 · Cited by 201
“The lack of sample independence enhances the likelihood of falsely rejecting the null hypothesis (type I error), thus finding spurious significant habitat relationships when there are none (Hurlbert, 1984).”
BackgroundThe effect of natural disturbances on forest biodiversity: an ecological synthesis
Viljur, M., Abella, S. R., Adámek, M., Alencar, J. B. R., Barber, N. A., Beudert, B., Burkle, L. A., Cagnolo, L., Campos, B. R., Chao, A., et al. (2022) · Biological Reviews · doi:10.1111/brv.12876 · Cited by 196
“To ensure valid effect sizes, we assessed the quality of designs and excluded studies with pseudoreplication, i.e. studies where disturbed and undisturbed plots were not spatially interspersed (Hurlbert, 1984; Halme et al ., 2010).”
Kelrick, M. I., MacMahon, J. A., Parmenter, R. R., & Sisson, D. V. (1986) · Oecologia · doi:10.1007/bf01036734 · Cited by 209
“This paper presents results of a mensurative (sensu Hurlbert 1984 ) field study of granivory in which a variety of seeds of indigenous plants (="native seeds") were provided to shrub-steppe rodents, birds and ants in order to determine granivore seed preferences.”
BackgroundTemporal Patterns in Bacterial Communities in Three Temperate Lakes of Different Trophic Status
Yannarell, A. C., Kent, A. D., Lauster, G. H., Kratz, T. K., & Triplett, E. W. (2003) · Microbial Ecology · doi:10.1007/s00248-003-1008-9 · Cited by 206
“Because replicate samples in 2001 had a high degree of similarity, the inclusion of both replicates in ANOSIM analyses would have biased the results, as these would more properly be considered ‘‘pseudoreplicates’’ [27] for ANOSIM.”
ResultUncertainty in surface-fire history: the case of ponderosa pine forests in the western United States
Baker, W. L., & Ehle, D. (2001) · Canadian Journal of Forest Research · doi:10.1139/cjfr-31-7-1205 · Cited by 204
Application of repeated measures designs in environmental impact and monitoring studies
GREEN, R. H. (1993) · Australian Journal of Ecology · doi:10.1111/j.1442-9993.1993.tb00436.x · Cited by 211
Spruce budworm outbreaks in eastern Quebec over the last 450 years
Boulanger, Y., & Arseneault, D. (2004) · Canadian Journal of Forest Research · doi:10.1139/x03-269 · Cited by 206
“To avoid pseudoreplication (Hurlbert 1984), ring widths measured along two cores from the same piece of wood were averaged to produce a mean raw chronology .”
MethodHabitat structural complexity mediates food web dynamics in a freshwater macrophyte community
Warfe, D. M., & Barmuta, L. A. (2006) · Oecologia · doi:10.1007/s00442-006-0505-1 · Cited by 199
“Our experimental design was used to distinguish the response of the community composition at the time of treatment application from the treatment response itself (Hurlbert 1984; Walters et al. 1988).”
MethodCryer, M., Peirson, G., & Townsend, C. R. (1986) · Limnology and Oceanography · doi:10.4319/lo.1986.31.5.1022 · Cited by 201
NIINEMETS, Ü., KULL, O., & TENHUNEN, J. D. (2004) · Plant, Cell & Environment · doi:10.1111/j.1365-3040.2003.01143.x · Cited by 201
“Thus, our experimental design investigates the natural variation in foliar variables rather than uses statistics to separate artificial treatment effects (Hurlbert 1984).”
BackgroundVariable Functional Responses of a Marine Predator in Dissimilar Homogeneous Microhabitats
Lipcius, R. N., & Hines, A. H. (1986) · Ecology · doi:10.2307/1938692 · Cited by 202
INTERACTIONS OF AN INSECTICIDE, HERBICIDE, AND NATURAL STRESSORS IN AMPHIBIAN COMMUNITY MESOCOSMS
Boone, M. D., & James, S. M. (2003) · Ecological Applications · doi:10.1890/1051-0761(2003)013[0829:ioaiha]2.0.co;2 · Cited by 202
Members of soil bacterial communities sensitive to tillage and crop rotation
Yin, C., Jones, K. L., Peterson, D. E., Garrett, K. A., Hulbert, S. H., & Paulitz, T. C. (2010) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2010.08.006 · Cited by 201
“However, the experimental designwas suboptimal in the sense that the rotation treatment was in effect included without ‘true’ replication (Hurlbert, 1984).”
BackgroundWood, D. M., & del Moral, R. (1987) · Ecology · doi:10.2307/1938349 · Cited by 200
Deer Facilitate Invasive Plant Success in a Pennsylvania Forest Understory
Knight, T. M., Dunn, J. L., Smith, L. A., Davis, J., & Kalisz, S. (2009) · Natural Areas Journal · doi:10.3375/043.029.0202 · Cited by 200
Jamil, T., Ozinga, W. A., Kleyer, M., & ter Braak, C. J. F. (2013) · Journal of Vegetation Science · doi:10.1111/j.1654-1103.2012.12036.x · Cited by 201
“Their methods assume that species records within sites are independent (Hosmer et al. 2000), thus commits pseudo-replication (Crawley 2002, Hurlbert 1984).”
McCoy, R. C., Taylor, R. W., Blauwkamp, T. A., Kelley, J. L., Kertesz, M., Pushkarev, D., Petrov, D. A., & Fiston-Lavier, A.-S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0106689 · Cited by 200
“This grouping factor also accounts for pseudo-replication arising due to multiple copies of TEs within families (Hurlbert, 1984).”
BackgroundAnalysis of Short Time Series: Correcting for Autocorrelation
Bence, J. R. (1995) · Ecology · doi:10.2307/1941218 · Cited by 199
Design of Playback Experiments: The Thornbridge Hall NATO ARW Consensus
McGregor, P. K., Catchpole, C. K., Dabelsteen, T., Falls, J. B., Fusani, L., Gerhardt, H. C., Gilbert, F., Horn, A. G., Klump, G. M., Kroodsma, D. E., et al. (1992) · Playback and Studies of Animal Communication · doi:10.1007/978-1-4757-6203-7_1 · Cited by 191
Analysis of Variance and Covariance: How to Choose and Construct Models for the Life Sciences
Doncaster, C., & Davey, A. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511611377 · Cited by 158
Changes in Kenyan coral reef community structure and function due to exploitation
McClanahan, T. R., & Muthiga, N. A. (1988) · Hydrobiologia · doi:10.1007/bf00008136 · Cited by 198
A genetic analysis of breeding success in the cooperative meerkat (Suricata suricatta)
Griffin, A. S. (2003) · Behavioral Ecology · doi:10.1093/beheco/arg040 · Cited by 202
“This results in pseudoreplication because members of the same group are not independent (Hurlbert, 1984).”
BackgroundThe spatial extent and relative influence of landscape-level factors on wintering bird populations
Pearson, S. M. (1993) · Landscape Ecology · doi:10.1007/bf00129863 · Cited by 202
“Experiments suffering from pseudoreplication (Hurlbert 1984) provide only equivocal results.”
ResultEffect of boat noise on the behaviour of bluefin tuna Thunnus thynnus in the Mediterranean Sea
Sarà, G., Dean, J., DAmato, D., Buscaino, G., Oliveri, A., Genovese, S., Ferro, S., Buffa, G., Martire, M., & Mazzola, S. (2007) · Marine Ecology Progress Series · doi:10.3354/meps331243 · Cited by 196
“We were aware that the design carried the risk of pseudo-replication (sessions which are not independent; Hurlbert 1984), but establishing 2 measurement sessions in 2 d for the same school allowed us to further test whether tuna changed their behaviour due to their semi-captive conditions.”
BackgroundLong-Term Effects of River Regulation on River Margin Vegetation
Nilsson, C., Ekblad, A., Gardfjell, M., & Carlberg, B. (1991) · The Journal of Applied Ecology · doi:10.2307/2404220 · Cited by 201
“Such a study, in which one observes a snapshot of an old system, but not the trajectory that leads to it, is called a natural snapshot experiment (Diamond 1986), a comparative mensurative experiment (Hurlbert 1984), or a comparative study (Keddy 1989).”
BackgroundFEMINELLA, J. W., POWER, M. E., & RESH, V. H. (1989) · Freshwater Biology · doi:10.1111/j.1365-2427.1989.tb01117.x · Cited by 201
The abundance of salamanders in forest stands with different histories of disturbance
Harvey Pough, F., Smith, E. M., Rhodes, D. H., & Collazo, A. (1987) · Forest Ecology and Management · doi:10.1016/0378-1127(87)90146-0 · Cited by 197
“The use of inferential statistics may constitute 'pseudoreplication' when the experimental units of interest (in this case forest stands) are not replicated (Hurlbert, 1984) .”
BackgroundMethodPHENOTYPIC PLASTICITY IN BODY SIZES AND SEXUAL SIZE DIMORPHISM IN EUROPEAN GRASS SNAKES
Madsen, T., & Shine, R. (1993) · Evolution · doi:10.1111/j.1558-5646.1993.tb01222.x · Cited by 201
“Because we are comparing only two populations, our analysis of these experimental data is technically for a "location effect" rather than a treatment effect (Hurlbert, 1984).”
BackgroundResultFletcher, W. J. (1987) · Ecological Monographs · doi:10.2307/1942640 · Cited by 197
Sack, L. (2004) · Oikos · doi:10.1111/j.0030-1299.2004.13184.x · Cited by 195
“All seedlings were grown in the two sides of a single shade-tunnel, thus pseudoreplicating the irradiance treatments (Hurlbert 1984).”
BackgroundA quantitative analysis to objectively appraise drought indicators and model drought impacts
Bachmair, S., Svensson, C., Hannaford, J., Barker, L. J., & Stahl, K. (2016) · Hydrology and Earth System Sciences · doi:10.5194/hess-20-2589-2016 · Cited by 191
Selenium increases seed production in Brassica
Lyons, G. H., Genc, Y., Soole, K., Stangoulis, J. C. R., Liu, F., & Graham, R. D. (2009) · Plant and Soil · doi:10.1007/s11104-008-9818-7 · Cited by 196
“Although the growth conditions were similar between the growth rooms, having the two Se treatments in two separate growth rooms resulted in pseudoreplication ( Hurlbert 1984 ), making it impossible to perform proper statistical analysis of the data.”
BackgroundSampling to differentiate between pulse and press perturbations
Glasby, T. M., & Underwood, A. J. (1996) · Environmental Monitoring and Assessment · doi:10.1007/bf00414371 · Cited by 200
Effects of T-cell-mediated immune response on avian oxidative stress
Costantini, D., & Dell'Omo, G. (2006) · Comparative Biochemistry and Physiology Part A: Molecular & Integrative Physiology · doi:10.1016/j.cbpa.2006.06.002 · Cited by 196
Lusseau, D. (2003) · Marine Ecology Progress Series · doi:10.3354/meps257267 · Cited by 196
“These mean dive intervals were subsequently used in 268 Lusseau: Bottlenose dolphins avoid tour boats analyses instead of the samples of raw dive intervals, which are dependent time series, to avoid pseudoreplication (Hurlbert 1984).”
MethodCarrara, J. E., Walter, C. A., Hawkins, J. S., Peterjohn, W. T., Averill, C., & Brzostek, E. R. (2018) · Global Change Biology · doi:10.1111/gcb.14081 · Cited by 195
“While whole-watershed fertilization at the Fernow results in a pseudoreplicated experimental design (Hurlbert, 1984), we conclude that the effects we measured are driven by N fertilization, rather than pre-existing differences between these adjacent watersheds, for four main reasons.”
BackgroundWhen is a correlation between non‐independent variables “spurious”?
Brett, M. T. (2004) · Oikos · doi:10.1111/j.0030-1299.2004.12777.x · Cited by 198
Kitchen, D. M. (2004) · Animal Behaviour · doi:10.1016/j.anbehav.2003.03.007 · Cited by 196
“However, to avoid pseudoreplication (Hurlbert 1984), I used the meanmale response in each ‘odds’ condition.”
MethodLarge‐Scale Perturbations: Opportunities for Innovation
Carpenter, S. R. (1990) · Ecology · doi:10.2307/1938617 · Cited by 195
Response of peatland carbon dioxide and methane fluxes to a water table drawdown experiment
Strack, M., & Waddington, J. M. (2007) · Global Biogeochemical Cycles · doi:10.1029/2006gb002715 · Cited by 187
“The overall design was pseudoreplicated (one control site and one experimental site; [Hurlbert, 1984]) because it was not feasible to replicate the water table drawdown at the ecosystem level.”
Background
Metadata
- Authors
- Hurlbert, S. H.
- Corresponding author
- Hurlbert, Stuart H.
- Venue
- Ecological Monographs
- Publisher
- Wiley
- Published
- 1984-06
- Volume
- 54
- Issue
- 2
- Pages
- 187-211
- ISSN
- 0012-9615 (ISSN-L)
- 1557-7015
- OpenAlex
- W2139156166
- Cited by
- 8,377
- References
- 102
- Citations by year
- 2026: 283 · 2025: 212 · 2024: 155 · 2023: 167 · 2022: 164 · 2021: 212 · 2020: 221 · 2019: 233 · 2018: 231 · 2017: 226 · 2016: 266 · 2015: 279 · 2014: 296 · 2013: 280 · 2012: 254
- FWCI
- 120.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ecological Monographs (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- pseudoreplication, experimental design, randomization, type I error, marine benthos, small mammals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.