Pseudoreplication and the Design of Ecological Field Experiments
The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
Pseudoreplication is defined as the use of inferential statistics to test for treatment effects with data from experiments where either treatments are not replicated (though samples may be) or replicates are not statistically independent. In ANOVA terminology, it is the testing for treatment effects with an error term inappropriate to the hypothesis being considered. Scrutiny of 176 experimental studies published between 1960 and the present revealed that pseudoreplication occurred in 27% of them, or 48% of all such studies that applied inferential statistics. The incidence of pseudoreplication is especially high in studies of marine benthos and small mammals. The critical features of controlled experimentation are reviewed. Nondemonic intrusion is defined as the impingement of chance events on an experiment in progress. As a safeguard against both it and preexisting gradients, interspersion of treatments is argued to be an obligatory feature of good design. Especially in small experiments, adequate interspersion can sometimes be assured only by dispensing with strict randomization procedures. Comprehension of this conflict between interspersion and randomization is aided by distinguishing pre—layout (or conventional) and layout—specific alpha (probability of type I error). Suggestions are offered to statisticians and editors of ecological journals as to how ecologists' understanding of experimental design and statistics might be improved.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“The tautological structure of the Kauffman and Cummings model invalidates Ripple et al.'s analysis because applying it violates the scientific principle that conclusions must be supported by evidence that is independent of the data used to generate them (Hurlbert 1984; Nakagawa & Parker 2015).”
From Flawed analysis invalidates claim of a strong Yellowstone trophic cascade after wolf reintroduction: A comment on Ripple et al. (2025) (2025) · cites this paper as Hurlbert 1984
In the citing paper
“A reason for this small number is that many studies incorporated experimental designs that suffered from pseudoreplication [79].”
From Land use change to bioenergy: A meta-analysis of soil carbon and GHG emissions (2015) · cites this paper as [79]
In the citing paper
“Pseudoreplication leads to a biased and incorrect inference, and it should be carefully considered (Hurlbert, 1984).”
From Acoustic indices as proxies for biodiversity: a meta‐analysis (2022) · cites this paper as Hurlbert, 1984
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Principles and procedures of statistics: McGraw-Hill Book Company, Inc. New York Toronto London.
Steel, R., & Torrie, J. H. (1960) · Cited by 4,633
Food Webs: Linkage, Interaction Strength and Community Infrastructure
Paine, R. T. (1980) · The Journal of Animal Ecology · doi:10.2307/4220 · Cited by 1,824
Sampling Design and Statistical Methods for Environmental Biologists
Green, R. H. (1979) · Andalas University Repository (Andalas University) · Cited by 1,550
Biogeochemistry of a forested ecosystem
(2014) · Choice Reviews Online · doi:10.5860/choice.51-6175 · Cited by 1,550
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Paine, R. T. (1974) · Oecologia · doi:10.1007/bf00345739 · Cited by 1,403
Cited by
Items 101–200 of 1,029
Helfield, J. M., & Naiman, R. J. (2001) · Ecology · doi:10.1890/0012-9658(2001)082[2403:eosdno]2.0.co;2 · Cited by 458
Regulation of Structure in Complex Systems: Experimental Temporary Pond Communities
Wilbur, H. M. (1987) · Ecology · doi:10.2307/1939227 · Cited by 457
Competitive Displacement Among Insects and Arachnids
Reitz, S. R., & Trumble, J. T. (2002) · Annual Review of Entomology · doi:10.1146/annurev.ento.47.091201.145227 · Cited by 451
“The historic nature of displacement means that underlying mechanisms may never be established with confidence (79), and therefore alternative explanations are possible for these cases.”
BackgroundMuff, S., Signer, J., & Fieberg, J. (2020) · Journal of Animal Ecology · doi:10.1111/1365-2656.13087 · Cited by 454
STRESS TOLERANCE AND COMPETITIVE-RESPONSE ABILITY DETERMINE THE OUTCOME OF BIOTIC INTERACTIONS
Liancourt, P., Callaway, R. M., & Michalet, R. (2005) · Ecology · doi:10.1890/04-1398 · Cited by 456
Parent lithology, surface–groundwater exchange, and nitrate retention in headwater streams
Valett, H. M., Morrice, J. A., Dahm, C. N., & Campana, M. E. (1996) · Limnology and Oceanography · doi:10.4319/lo.1996.41.2.0333 · Cited by 449
“Replicate basin types were not established and statistical inferences among catchments do not attempt to assess the influence of parent lithology (::ee Hurlbert 1984).”
BackgroundUNDERWOOD, A. J. (1993) · Australian Journal of Ecology · doi:10.1111/j.1442-9993.1993.tb00437.x · Cited by 444
Detecting and avoiding likely false‐positive findings – a practical guide
Forstmeier, W., Wagenmakers, E., & Parker, T. H. (2017) · Biological Reviews · doi:10.1111/brv.12315 · Cited by 436
Kotze, D. J., Brandmayr, P., Casale, A., Dauffy-Richard, E., Dekoninck, W., Koivula, M., Lovei, G., Mossakowski, D., Noordijk, J., Paarmann, W., et al. (2011) · ZooKeys · doi:10.3897/zookeys.100.1523 · Cited by 432
Assessing environmental conditions in rivers and streams with diatoms
Stevenson, R. J., Pan, Y., & van Dam, H. (2010) · The Diatoms · doi:10.1017/cbo9780511763175.005 · Cited by 412
A decade of climate change experiments on marine organisms: procedures, patterns and problems
Wernberg, T., Smale, D. A., & Thomsen, M. S. (2012) · Global Change Biology · doi:10.1111/j.1365-2486.2012.02656.x · Cited by 428
“Still, experimental venue, selection of treatment levels, assignment to experimental units and the distribution of replicates among treatments (i.e. experimental design) have fundamental implications for the inferences that can be drawn from any experiment (Hurlbert, 1984; Underwood, 1997).”
BackgroundResultInfluentialThe Habitat Concept in Ornithology: Theory and Applications
Block, W. M., & Brennan, L. A. (1993) · Current Ornithology · doi:10.1007/978-1-4757-9912-5_2 · Cited by 426
The Role of Predation in Age‐ and Size‐Related Habitat Use by Stream Fishes
Schlosser, I. J. (1987) · Ecology · doi:10.2307/1938470 · Cited by 430
Suggested experimental designs for song playbacks
Kroodsma, D. E. (1989) · Animal Behaviour · doi:10.1016/0003-3472(89)90039-0 · Cited by 422
“The related concepts of pseudoreplication (Hurlbert 1984), external validity (e .g .”
BackgroundButtigieg, P. L., & Ramette, A. (2014) · FEMS Microbiology Ecology · doi:10.1111/1574-6941.12437 · Cited by 425
“Similar debate also surrounds aspects of experimental and sampling design, such as the issue (or, as some contend, non-issue) of pseudoreplication in ecological investigations (Hurlbert 1984; Oksanen 2001, 2004; Schank & Koehnle 2009; Cottenie & De Meester 2003; Hurlbert 2004, 2009; Coss 2009; Koehnle & Schank 2009; P…”
BackgroundBortolus, A. (2008) · AMBIO: A Journal of the Human Environment · doi:10.1579/0044-7447(2008)37[114:ecitbs]2.0.co;2 · Cited by 416
“The gradual success of a manipulative experimental approach (1) gained popularity because descriptive observations and data correlation alone could not explain causal processes.”
BackgroundBioremediation of an Experimental Oil Spill on the Shoreline of Delaware Bay
Venosa, A. D., Suidan, M. T., Wrenn, B. A., Strohmeier, K. L., Haines, J. R., Eberhart, B. L., King, D., & Holder, E. (1996) · Environmental Science & Technology · doi:10.1021/es950754r · Cited by 413
ZOOPLANKTON METACOMMUNITY STRUCTURE: REGIONAL VS. LOCAL PROCESSES IN HIGHLY INTERCONNECTED PONDS
Cottenie, K., Michels, E., Nuytten, N., & De Meester, L. (2003) · Ecology · doi:10.1890/0012-9658(2003)084[0991:zmsrvl]2.0.co;2 · Cited by 403
“However, the associated P values (and the common 5% significance level) should be mainly viewed as the strength of the observational evidence for a certain process to occur (Hurlbert 1984).”
BackgroundEffects of Fire Regime and Habitat on Tree Dynamics in North Florida Longleaf Pine Savannas
Glitzenstein, J. S., Platt, W. J., & Streng, D. R. (1995) · Ecological Monographs · doi:10.2307/2963498 · Cited by 403
HEAVY METALS STRUCTURE BENTHIC COMMUNITIES IN COLORADO MOUNTAIN STREAMS
Clements, W. H., Carlisle, D. M., Lazorchak, J. M., & Johnson, P. C. (2000) · Ecological Applications · doi:10.1890/1051-0761(2000)010[0626:hmsbci]2.0.co;2 · Cited by 396
Dolphin-watching tour boats change bottlenose dolphin (Tursiops truncatus) behaviour
Constantine, R., Brunton, D. H., & Dennis, T. (2004) · Biological Conservation · doi:10.1016/j.biocon.2003.12.009 · Cited by 392
“To avoid potential confounding factors (Hurlbert, 1984) due to temporal changes in the dolphins’ habitat use (Constantine, 1995, 2002), each season was analysed separately.”
MethodGrazing vs. mowing: A meta-analysis of biodiversity benefits for grassland management
Tälle, M., Deák, B., Poschlod, P., Valkó, O., Westerberg, L., & Milberg, P. (2016) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2016.02.008 · Cited by 387
“Pseudoreplication can result in false detection of treatment effects or can obscure the true effects due to the underestimation of the influence of spatial variation (Hurlbert, 1984; Heffner et al., 1996).”
The role of taste in food selection by freshwater zooplankton
DeMott, W. R. (1986) · Oecologia · doi:10.1007/bf00377053 · Cited by 392
Seed Dispersal by Fruit-Eating Birds and Mammals
HOWE, H. F. (1986) · Seed Dispersal · doi:10.1016/b978-0-12-511900-9.50009-7 · Cited by 395
Pseudoreplication in playback experiments, revisited a decade later
Kroodsma, D. E., Byers, B. E., Goodale, E., Johnson, S., & Liu, W.-C. (2001) · Animal Behaviour · doi:10.1006/anbe.2000.1676 · Cited by 386
“A decade ago, the most commonly used experimental designs involved ‘simple pseudoreplication’ (Hurlbert 1984), in which only a single exemplar from a class of stimuli was used to test hypotheses about the class itself (e.g. using only a1 and b1 to ask questions about Class A and Class B; see Table 1). In papers review…”
BackgroundMethodInfluentialInteraction of Disturbances in Tallgrass Prairie: A Field Experiment
Collins, S. L. (1987) · Ecology · doi:10.2307/1939208 · Cited by 394
Spatial variation in soft-sediment benthos
Morrisey, D., Howitt, L., Underwood, A., & Stark, J. (1992) · Marine Ecology Progress Series · doi:10.3354/meps081197 · Cited by 386
“The within-location variation has not been adequately estimated by the replicate samples, preventing valid comparisons among locations (the data are 'pseudoreplicated': Hurlbert 1984).”
BackgroundRusso, D., & Jones, G. (2002) · Journal of Zoology · doi:10.1017/s0952836902001231 · Cited by 385
“Each site was visited only once to avoid pseudo-replication (Hurlbert, 1984).”
BackgroundSexual Segregation in Ungulates: New Directions for Research
Main, M. B., Weckerly, F. W., & Bleich, V. C. (1996) · Journal of Mammalogy · doi:10.2307/1382821 · Cited by 384
Rothermel, B. B., & Semlitsch, R. D. (2002) · Conservation Biology · doi:10.1046/j.1523-1739.2002.01085.x · Cited by 383
“Each run was a true replicate, whereas using individual-based data in analyses could have been considered pseudoreplication because of the possibility of nonindependence among individuals within the same run (Hurlbert 1984).”
MethodThe problem of pseudoreplication in neuroscientific studies: is it affecting your analysis?
Lazic, S. E. (2010) · BMC Neuroscience · doi:10.1186/1471-2202-11-5 · Cited by 381
“A natural question to ask is “how common is pseudoreplication in the neuroscience literature?” Hurlbert found that almost 50% of studies that used inferential statistics had some type of pseudoreplication [3].”
BackgroundMethodInfluentialThe effects of owl predation on the foraging behavior of heteromyid rodents
Brown, J. S., Kotler, B. P., Smith, R. J., & Wirtz, W. O. (1988) · Oecologia · doi:10.1007/bf00377036 · Cited by 387
Use of Chamber Systems to Measure Trace Gas Fluxes
Hutchinson, G. L., & Livingston, G. P. (1993) · ASA Special Publications · doi:10.2134/asaspecpub55.c4 · Cited by 361
Aquatic Insects and Trace Metals: Bioavailability, Bioaccumulation, and Toxicity
Hare, L. (1992) · Critical Reviews in Toxicology · doi:10.3109/10408449209146312 · Cited by 378
Willis, T., Millar, R., & Babcock, R. (2000) · Marine Ecology Progress Series · doi:10.3354/meps198249 · Cited by 378
Arlinghaus, R., Mehner, T., & Cowx, I. G. (2002) · Fish and Fisheries · doi:10.1046/j.1467-2979.2002.00102.x · Cited by 381
“However, formal scienti¢c experiments with adequate replication and control (Hurlbert 1984; McAllister and Peterman 1992) are needed to evaluate fully the (ecological) e¡ects of regulations in fresh waters (Nordwall et al. 2000), and to reduce the degree of arbitrariness in inland ¢sheries…”
Vegetation Dynamics in Amazonian Treefall Gaps
Uhl, C., Clark, K., Dezzeo, N., & Maquirino, P. (1988) · Ecology · doi:10.2307/1941024 · Cited by 379
Alves, L. F., Vieira, S. A., Scaranello, M. A., Camargo, P. B., Santos, F. A. M., Joly, C. A., & Martinelli, L. A. (2010) · Forest Ecology and Management · doi:10.1016/j.foreco.2010.05.023 · Cited by 369
“…was split into four 50 × 50 m (0.25 ha) sub-plots (the minimal sample size for tropical forest inventories; e.g., Chave et al., 2004, 2008) that although pseudo-replicated (sensu Hurlbert, 1984), allowed us to perform consistent analyses across the elevational gradient including this forest type.”
ResultInfluentialBoulton, A., & Boon, P. (1991) · Australian Journal of Marine and Freshwater Research · doi:10.1071/mf9910001 · Cited by 374
Brando, P. M., Nepstad, D. C., Davidson, E. A., Trumbore, S. E., Ray, D., & Camargo, P. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.0031 · Cited by 365
“Please see Hurlbert (1984) for more information on largescale unreplicated experiments.”
BackgroundKoivula, M. (2011) · ZooKeys · doi:10.3897/zookeys.100.1533 · Cited by 366
Accounting for spatial pattern when modeling organism‐environment interactions
Keitt, T. H., Bjørnstad, O. N., Dixon, P. M., & Citron‐Pousty, S. (2002) · Ecography · doi:10.1034/j.1600-0587.2002.250509.x · Cited by 369
“Two decades ago, Hurlbert (1984) made an extremely important reminder about how randomization and manipulations provide the only ‘‘true path’’ to causal inference in ecology.”
HOW GRAZING AND SOIL QUALITY AFFECT NATIVE AND EXOTIC PLANT DIVERSITY IN ROCKY MOUNTAIN GRASSLANDS
Stohlgren, T. J., Schell, L. D., & Vanden Heuvel, B. (1999) · Ecological Applications · doi:10.1890/1051-0761(1999)009[0045:hgasqa]2.0.co;2 · Cited by 369
A practical solution to pseudoreplication bias in single-cell studies
Zimmerman, K. D., Espeland, M. A., & Langefeld, C. D. (2021) · Nature Communications · doi:10.1038/s41467-021-21038-1 · Cited by 356
The Effect of Larval Density on Adult Demographic Traits in Ambystoma Opacum
Scott, D. E. (1994) · Ecology · doi:10.2307/1937462 · Cited by 368
Freeze–thaw regime effects on carbon and nitrogen dynamics in sub-arctic heath tundra mesocosms
Grogan, P., Michelsen, A., Ambus, P., & Jonasson, S. (2004) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2003.12.007 · Cited by 361
“Since the freezing regimes were achieved using a single modified growth chamber for each treatment, pseudoreplication (Hurlbert, 1984) precludes direct tests of differences between the regimes.”
DAVIDSON, E. A., NEPSTAD, D. C., ISHIDA, F. Y., & BRANDO, P. M. (2008) · Global Change Biology · doi:10.1111/j.1365-2486.2008.01694.x · Cited by 361
“Hence, the treatment design follows the methodology for unreplicated large-scale ecosystem manipulation experiments (Hurlbert, 1984).”
MethodLinear and generalized linear mixed models
Bolker, B. M. (2015) · Ecological Statistics · doi:10.1093/acprof:oso/9780199672547.003.0014 · Cited by 339
The Ecology of Bird Introductions
Duncan, R. P., Blackburn, T. M., & Sol, D. (2003) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev.ecolsys.34.011802.132353 · Cited by 361
Quinn, J. M., Cooper, A. B., Davies‐Colley, R. J., Rutherford, J. C., & Williamson, R. B. (1997) · New Zealand Journal of Marine and Freshwater Research · doi:10.1080/00288330.1997.9516791 · Cited by 361
RELATING RESOURCES TO A PROBABILISTIC MEASURE OF SPACE USE: FOREST FRAGMENTS AND STELLER'S JAYS
Marzluff, J. M., Millspaugh, J. J., Hurvitz, P., & Handcock, M. S. (2004) · Ecology · doi:10.1890/03-0114 · Cited by 359
“However, we can begin to understand the spatial extent of the used area by investigating resource use at multiple scales (Johnson 1980, Marzluff et al. 1997).”
Assessing Habitat Selection when Availability Changes
Arthur, S. M., Manly, B. F. J., McDonald, L. L., & Garner, G. W. (1996) · Ecology · doi:10.2307/2265671 · Cited by 360
Factors influencing white-tailed deer activity patterns and habitat use.
Beier, P., & McCullough, D. R. (1990) · Wildlife Monographs · Cited by 459
Interactions between Stream Herbivores and Periphyton: A Quantitative Analysis of past Experiments
Feminella, J. W., & Hawkins, C. P. (1995) · Journal of the North American Benthological Society · doi:10.2307/1467536 · Cited by 355
Medema, W., McIntosh, B. S., & Jeffrey, P. J. (2008) · Ecology and Society · doi:10.5751/es-02611-130229 · Cited by 350
Schuur, E. A., & Matson, P. A. (2001) · Oecologia · doi:10.1007/s004420100671 · Cited by 354
Swaisgood, R. R., & Shepherdson, D. J. (2005) · Zoo Biology · doi:10.1002/zoo.20066 · Cited by 347
“This design reduces confounding variables only if the subjects within each treatment are independent of one another, i.e., not belonging to the same social group or all housed at the same location [Hurlbert, 1984].”
BackgroundSpake, R., Lasseur, R., Crouzat, E., Bullock, J. M., Lavorel, S., Parks, K. E., Schaafsma, M., Bennett, E. M., Maes, J., Mulligan, M., et al. (2017) · Global Environmental Change · doi:10.1016/j.gloenvcha.2017.08.004 · Cited by 352
“…Requirement 3: Utilize a wider range of statistical and modelling approaches 616 While statistical techniques cannot compensate for poor study design (e.g. Hurlbert 1984), taking 617 advantage of the best statistical approaches will maximize the inferential strength of a given study 618 design.”
BackgroundComparing Spatial Pattern in Unaltered Old‐Growth and Disturbed Forest Landscapes
Mladenoff, D. J., White, M. A., Pastor, J., & Crow, T. R. (1993) · Ecological Applications · doi:10.2307/1941832 · Cited by 354
THE ROLE OF STRESS IN THE MORTALITY OF MIDWESTERN OAKS AS INDICATED BY GROWTH PRIOR TO DEATH
Pedersen, B. S. (1998) · Ecology · doi:10.1890/0012-9658(1998)079[0079:trosit]2.0.co;2 · Cited by 345
Autocorrelation of Location Estimates and the Analysis of Radiotracking Data
Otis, D. L., & White, G. C. (1999) · The Journal of Wildlife Management · doi:10.2307/3802819 · Cited by 349
Nykänen, H., & Koricheva, J. (2004) · Oikos · doi:10.1111/j.0030-1299.2004.12768.x · Cited by 350
Lambrechts, M. M., Adriaensen, F., Ardia, D. R., Artemyev, A. V., Atiénzar, F., Bańbura, J., Barba, E., Bouvier, J.-C., camprodon, J., Cooper, C. B., et al. (2010) · Acta Ornithologica · doi:10.3161/000164510x516047 · Cited by 340
Anderson, M. J., & Cribble, N. A. (1998) · Australian Journal of Ecology · doi:10.1111/j.1442-9993.1998.tb00713.x · Cited by 340
Determinants of human–elephant conflict in a land‐use mosaic
Hoare, R. E. (1999) · Journal of Applied Ecology · doi:10.1046/j.1365-2664.1999.00437.x · Cited by 333
McClure, C. J. W., Ware, H. E., Carlisle, J., Kaltenecker, G., & Barber, J. R. (2013) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2013.2290 · Cited by 344
“That our point count locations were subsamples of the control and experimental sites might complicate the generalization of our results to other sites [53].”
ResultBiological Responses of a Tundra River to Fertilization
Peterson, B. J., Deegan, L., Helfrich, J., Hobbie, J. E., Hullar, M., Moller, B., Ford, T. E., Hershey, A., Hiltner, A., Kipphut, G., et al. (1993) · Ecology · doi:10.2307/1940794 · Cited by 335
Davies, G. M., & Gray, A. (2015) · Ecology and Evolution · doi:10.1002/ece3.1782 · Cited by 333
“3 Nearly 70% of respondents had read Hurlbert (1984).”
BackgroundInfluentialHow the news media activate public expression and influence national agendas
King, G., Schneer, B., & White, A. (2017) · Science · doi:10.1126/science.aao1100 · Cited by 333
Block, W. M., Franklin, A. B., Ward, J. P., Ganey, J. L., & White, G. C. (2001) · Restoration Ecology · doi:10.1046/j.1526-100x.2001.009003293.x · Cited by 336
A baited underwater video system for the determination of relative density of carnivorous reef fish
Willis, T. J., & Babcock, R. C. (2000) · Marine and Freshwater Research · doi:10.1071/mf00010 · Cited by 336
Inferring Multiple Causality: The Limitations of Path Analysis
Petraitis, P. S., Dunham, A. E., & Niewiarowski, P. H. (1996) · Functional Ecology · doi:10.2307/2389934 · Cited by 333
“Although we were not looking for it, we found two clear cases of what Hurlbert (1984) calls temporal pseudoreplication. Johnson et al. (1991) stated they had 64 observations, but in fact used eight mesocosms and sampled each one eight times.”
BackgroundTop predators as biodiversity regulators: the dingo Canis lupus dingo as a case study
Letnic, M., Ritchie, E. G., & Dickman, C. R. (2012) · Biological Reviews · doi:10.1111/j.1469-185x.2011.00203.x · Cited by 331
“They can thus be considered pseudoreplicated (Hurlbert, 1984) or confounded (Letnic et al.”
BackgroundAlmagro, M., López, J., Querejeta, J. I., & Martínez-Mena, M. (2009) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2008.12.021 · Cited by 332
Dynamics of Nitrogen Competition Between Successional Grasses
Tilman, D., & Wedin, D. (1991) · Ecology · doi:10.2307/1940604 · Cited by 332
Nitrogen Limitation in a Sonoran Desert Stream
Grimm, N. B., & Fisher, S. G. (1986) · Journal of the North American Benthological Society · doi:10.2307/1467743 · Cited by 332
Andrews, J. A., & Schlesinger, W. H. (2001) · Global Biogeochemical Cycles · doi:10.1029/2000gb001278 · Cited by 324
Discriminant function analysis with nonindependent data: consequences and an alternative
Mundry, R., & Sommer, C. (2007) · Animal Behaviour · doi:10.1016/j.anbehav.2006.12.028 · Cited by 330
Validation of COI metabarcoding primers for terrestrial arthropods
Elbrecht, V., Braukmann, T. W. A., Ivanova, N. V., Prosser, S. W. J., Hajibabaei, M., Wright, M., Zakharov, E. V., Hebert, P. D. N., & Steinke, D. (2019) · PeerJ · doi:10.7717/peerj.7745 · Cited by 330
PREDATOR-INDUCED SHELL DIMORPHISM IN THE ACORN BARNACLE CHTHAMALUS ANISOPOMA
Lively, C. M. (1986) · Evolution · doi:10.1111/j.1558-5646.1986.tb00466.x · Cited by 326
Spatially explicit models for inference about density in unmarked or partially marked populations
Chandler, R. B., & Royle, J. A. (2013) · The Annals of Applied Statistics · doi:10.1214/12-aoas610 · Cited by 280
“note that sample locations in count-based studies are typically not organized close together in space because conventional wisdom and standard practice dictate that independence of sample units is necessary (Hurlbert, 1984).”
BackgroundThe reference condition: predicting benchmarks for ecological and water-quality assessments
Hawkins, C. P., Olson, J. R., & Hill, R. A. (2010) · Journal of the North American Benthological Society · doi:10.1899/09-092.1 · Cited by 319
“If used in such tests, the replicate samples taken within a site represent pseudoreplicates (sensu Hurlbert 1984), and their use in a t-test (or similar test) would inflate the likelihood of observing a statistically significant difference in means.”
MethodGrowth of bacterioplankton and consumption of dissolved organic carbon in the Sargasso Sea
Carlson, C., & Ducklow, H. (1996) · Aquatic Microbial Ecology · doi:10.3354/ame010069 · Cited by 320
“Due to logistical constraints only 1 culture could be grown for each treatment within an experiment leading to problems associated with pseudoreplication (Hulbert 1984).”
BackgroundWilson, A. E., Sarnelle, O., & Tillmanns, A. R. (2006) · Limnology and Oceanography · doi:10.4319/lo.2006.51.4.1915 · Cited by 320
“Repeated use of the same species or genotype is an obvious source of nonindependence in metaanalysis (Gurevitch and Hedges 1999) and may limit the domain of relevance of our synthesis in much the same way that pseudoreplication affects the interpretation of an individual experiment (Hurlbert 1984).”
BackgroundMurtaugh, P. A. (2014) · Ecology · doi:10.1890/13-0590.1 · Cited by 317
“In my opinion, it would benefit the science if more time and effort were spent on designing effective studies with adequate replication (Hurlbert 1984), and less on advocacy for particular tools to be used in summarizing the data.”
BackgroundGlobal Warming and Soil Microclimate: Results from a Meadow‐Warming Experiment
Harte, J., Torn, M. S., Chang, F.-R., Feifarek, B., Kinzig, A. P., Shaw, R., & Shen, K. (1995) · Ecological Applications · doi:10.2307/1942058 · Cited by 321
Fractal geometry: a tool for describing spatial patterns of plant communities
Palmer, M. W. (1988) · Vegetatio · doi:10.1007/bf00044631 · Cited by 318
“Spatial dependence is a form of pseudoreplication (Hurlbert 1984; Malanson 1985), and it violates an important assumption of statistics: that replicates are independent.”
BackgroundMORRICE, J. A., VALETT, H. M., DAHM, C. N., & CAMPANA, M. E. (1997) · Hydrological Processes · doi:10.1002/(sici)1099-1085(19970315)11:3<253::aid-hyp439>3.0.co;2-j · Cited by 313
MODELLING THE IMPACT OF LAND USE CHANGE ON WATER QUALITY IN AGRICULTURAL CATCHMENTS
JOHNES, P. J., & HEATHWAITE, A. L. (1997) · Hydrological Processes · doi:10.1002/(sici)1099-1085(19970315)11:3<269::aid-hyp442>3.0.co;2-k · Cited by 209
Songs of the city: noise-dependent spectral plasticity in the acoustic phenotype of urban birds
Slabbekoorn, H. (2013) · Animal Behaviour · doi:10.1016/j.anbehav.2013.01.021 · Cited by 311
Defining the Core Microbiome in Corals’ Microbial Soup
Hernandez-Agreda, A., Gates, R. D., & Ainsworth, T. D. (2017) · Trends in Microbiology · doi:10.1016/j.tim.2016.11.003 · Cited by 309
“Replicates need to be random and independent [84]; for example, to be considered individuals and different biological units, coral colonies should be similarly sized, disparate, and randomly selected for similar reef environments.”
BackgroundPredator‐specific landscapes of fear and resource distribution: effects on spatial range use
Willems, E. P., & Hill, R. A. (2009) · Ecology · doi:10.1890/08-0765.1 · Cited by 311
“If uncontrolled for, it may lead to pseudoreplication (Hurlbert 1984), overestimation of effective sample size, inflated significance values (Clifford et al. 1989), and even a systematic bias toward certain explanatory variables (Lennon 2000, but see Diniz-Filho et al. 2003, Hawkins et al. 2007).”
BackgroundMethodTeaching nature of science within a controversial topic: Integrated versus nonintegrated
Khishfe, R., & Lederman, N. (2006) · Journal of Research in Science Teaching · doi:10.1002/tea.20137 · Cited by 300
“Although it is easy to find research reports that incorrectly use the student as the unit of analysis in such cases, which artificially inflates the sample size, the research and statistics literature is rich in discussions of the inappropriateness of using the student as the unit of analysis in studies sampling intac…”
BackgroundBruelheide, H., Nadrowski, K., Assmann, T., Bauhus, J., Both, S., Buscot, F., Chen, X., Ding, B., Durka, W., Erfmeier, A., et al. (2014) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12126 · Cited by 306
“Blocking is also used to avoid accidental clumping of similar treatments that may occur in completely randomized designs (Hurlbert 1984).”
MethodDe Marco, P., & Coelho, F. M. (2004) · Biodiversity & Conservation · doi:10.1023/b:bioc.0000019402.51193.e8 · Cited by 301
Life after logging: reconciling wildlife conservation and production forestry in Indonesian Borneo
E., M., D., S., R., N., D., A., B., R., D., I., T., S., A., L., I., R., A., W., et al. (2005) · Center for International Forestry Research (CIFOR) eBooks · doi:10.17528/cifor/001663 · Cited by 296
Swihart, R. K., Gehring, T. M., Kolozsvary, M. B., & Nupp, T. E. (2003) · Diversity and Distributions · doi:10.1046/j.1472-4642.2003.00158.x · Cited by 301
“doreplication (Hurlbert, 1984), we located scent stations randomly within spatial elements with the constraint that stations were ≥ 200 m apart.”
MethodAnderson, M. J., & Millar, R. B. (2004) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/j.jembe.2003.12.011 · Cited by 298
Individual recognition in wild bottlenose dolphins: a field test using playback experiments
SAYIGH, L. S., TYACK, P. L., WELLS, R. S., SOLOW, A. R., SCOTT, M. D., & IRVINE, A. B. (1999) · Animal Behaviour · doi:10.1006/anbe.1998.0961 · Cited by 297
“Thus, this paired playback design also eliminated problems associated with pseudoreplication (Hurlbert 1984; Catchpole 1989; Kroodsma 1989a, b; Searcy 1989).”
BackgroundStatistical challenges in null model analysis
Gotelli, N. J., & Ulrich, W. (2012) · Oikos · doi:10.1111/j.1600-0706.2011.20301.x · Cited by 298
“Repetition of structure might pose a problem in pseudoreplicated sampling designs (Hurlbert 1984) in which all contiguous sampling plots (or sites in a gridded macroecology map) are used to generate a matrix for pattern analysis.”
Background
Metadata
- Authors
- Hurlbert, S. H.
- Corresponding author
- Hurlbert, Stuart H.
- Venue
- Ecological Monographs
- Publisher
- Wiley
- Published
- 1984-06
- Volume
- 54
- Issue
- 2
- Pages
- 187-211
- ISSN
- 0012-9615 (ISSN-L)
- 1557-7015
- OpenAlex
- W2139156166
- Cited by
- 8,377
- References
- 102
- Citations by year
- 2026: 283 · 2025: 212 · 2024: 155 · 2023: 167 · 2022: 164 · 2021: 212 · 2020: 221 · 2019: 233 · 2018: 231 · 2017: 226 · 2016: 266 · 2015: 279 · 2014: 296 · 2013: 280 · 2012: 254
- FWCI
- 120.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ecological Monographs (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- pseudoreplication, experimental design, randomization, type I error, marine benthos, small mammals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.