Pseudoreplication and the Design of Ecological Field Experiments
The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
Pseudoreplication is defined as the use of inferential statistics to test for treatment effects with data from experiments where either treatments are not replicated (though samples may be) or replicates are not statistically independent. In ANOVA terminology, it is the testing for treatment effects with an error term inappropriate to the hypothesis being considered. Scrutiny of 176 experimental studies published between 1960 and the present revealed that pseudoreplication occurred in 27% of them, or 48% of all such studies that applied inferential statistics. The incidence of pseudoreplication is especially high in studies of marine benthos and small mammals. The critical features of controlled experimentation are reviewed. Nondemonic intrusion is defined as the impingement of chance events on an experiment in progress. As a safeguard against both it and preexisting gradients, interspersion of treatments is argued to be an obligatory feature of good design. Especially in small experiments, adequate interspersion can sometimes be assured only by dispensing with strict randomization procedures. Comprehension of this conflict between interspersion and randomization is aided by distinguishing pre—layout (or conventional) and layout—specific alpha (probability of type I error). Suggestions are offered to statisticians and editors of ecological journals as to how ecologists' understanding of experimental design and statistics might be improved.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“The tautological structure of the Kauffman and Cummings model invalidates Ripple et al.'s analysis because applying it violates the scientific principle that conclusions must be supported by evidence that is independent of the data used to generate them (Hurlbert 1984; Nakagawa & Parker 2015).”
From Flawed analysis invalidates claim of a strong Yellowstone trophic cascade after wolf reintroduction: A comment on Ripple et al. (2025) (2025) · cites this paper as Hurlbert 1984
In the citing paper
“A reason for this small number is that many studies incorporated experimental designs that suffered from pseudoreplication [79].”
From Land use change to bioenergy: A meta-analysis of soil carbon and GHG emissions (2015) · cites this paper as [79]
In the citing paper
“Pseudoreplication leads to a biased and incorrect inference, and it should be carefully considered (Hurlbert, 1984).”
From Acoustic indices as proxies for biodiversity: a meta‐analysis (2022) · cites this paper as Hurlbert, 1984
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Principles and procedures of statistics: McGraw-Hill Book Company, Inc. New York Toronto London.
Steel, R., & Torrie, J. H. (1960) · Cited by 4,633
Food Webs: Linkage, Interaction Strength and Community Infrastructure
Paine, R. T. (1980) · The Journal of Animal Ecology · doi:10.2307/4220 · Cited by 1,824
Sampling Design and Statistical Methods for Environmental Biologists
Green, R. H. (1979) · Andalas University Repository (Andalas University) · Cited by 1,550
Biogeochemistry of a forested ecosystem
(2014) · Choice Reviews Online · doi:10.5860/choice.51-6175 · Cited by 1,550
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Paine, R. T. (1974) · Oecologia · doi:10.1007/bf00345739 · Cited by 1,403
Cited by
Items 201–300 of 1,029
ADAPTATION BY A PARASITIC TREMATODE TO LOCAL POPULATIONS OF ITS SNAIL HOST
Lively, C. M. (1989) · Evolution · doi:10.1111/j.1558-5646.1989.tb02616.x · Cited by 294
Davidson, E. A., Ishida, F. Y., & Nepstad, D. C. (2004) · Global Change Biology · doi:10.1111/j.1365-2486.2004.00762.x · Cited by 293
Remedies for pseudoreplication
Millar, R. B., & Anderson, M. J. (2004) · Fisheries Research · doi:10.1016/j.fishres.2004.08.016 · Cited by 292
“Indeed, in the terminology of Hurlbert (1984) , this is an example of sacrificial pseudoreplication.”
BackgroundWhat exactly is ‘N’ in cell culture and animal experiments?
Lazic, S. E., Clarke-Williams, C. J., & Munafò, M. R. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2005282 · Cited by 291
“The second type is replication that does not increase the sample size and is called pseudoreplication [3].”
BackgroundChoi, K.-H., & Dobbs, F. C. (1999) · Journal of Microbiological Methods · doi:10.1016/s0167-7012(99)00034-2 · Cited by 292
Wipfli, M. S., Hudson, J., & Caouette, J. (1998) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-55-6-1503 · Cited by 293
“We caution that an upstream–downstream comparison within one stream (Margaret Creek) is pseudoreplication (Hurlbert 1984) and does not provide a means of separating treatment factors (carcasses, no carcasses) from other variables (e.”
BackgroundTropical Wet Forest Treefall Gaps and Distributions of Understory Birds and Plants
Levey, D. J. (1988) · Ecology · doi:10.2307/1941263 · Cited by 296
Castilla, J. C., Durán, L. R., & Duran, L. R. (1985) · Oikos · doi:10.2307/3565575 · Cited by 291
Hypothesis Testing in Ecology: Psychological Aspects and the Importance of Theory Maturation
Loehle, C. (1987) · The Quarterly Review of Biology · doi:10.1086/415619 · Cited by 288
“Advocates of hypothesis testing are calling for increased rigor (Holling, 1978; Hurlbert, 1984; Quinn and Dunham, 1983; Reckhow and * Present address: Savannah River Laboratory, Bldg. 773-42A, E. I. du Pont de Nemours & Company, Aiken, South Carolina 29808 USA.”
BackgroundAlve, E., & Bernhard, J. (1995) · Marine Ecology Progress Series · doi:10.3354/meps116137 · Cited by 287
Pseudoreplication: a sine qua non for regional ecology
Hargrove, W. W., & Pickering, J. (1992) · Landscape Ecology · doi:10.1007/bf00129703 · Cited by 287
“Restricting the experiment to a few sites which can be sampled within a short period, on the other hand, is spatial pseudoreplication, since the inference space willbe larger than the area covered by replicates (Hurlbert 1984).”
BackgroundInfluentialPerspectives in Ecological Theory
(1989) · Princeton University Press eBooks · doi:10.1515/9781400860180 · Cited by 281
“Empiricists need to let theorists know what is "doable," and theorists should familiarize themselves with how empirical work is done and with the difficulties of experimental ecology (e.g., Piatt 1964; Quinn and Dunham 1983; Hurlbert 1984).”
BackgroundThe diets of British bats (Chiroptera)
VAUGHAN, N. (1997) · Mammal Review · doi:10.1111/j.1365-2907.1997.tb00373.x · Cited by 282
An experimentalist's challenge: when artifacts of intervention interact with treatments
Peterson, C., & Black, R. (1994) · Marine Ecology Progress Series · doi:10.3354/meps111289 · Cited by 283
Habitat-dependent population regulation and community structure
Morris, D. W. (1988) · Evolutionary Ecology · doi:10.1007/bf02214286 · Cited by 283
“My replicated density estimates are pseudoreplicates ( Hurlbert, 1984 ) in the sense that they are estimates of population density in three habitat patches at Point Pelee.”
BackgroundKUNZ, T. H., ARNETT, E. B., COOPER, B. M., ERICKSON, W. P., LARKIN, R. P., MABEE, T., MORRISON, M. L., STRICKLAND, M. D., & SZEWCZAK, J. M. (2007) · The Journal of Wildlife Management · doi:10.2193/2007-270 · Cited by 280
Effects of Timber Harvesting on Southern Appalachian Salamanders
Petranka, J. W., Eldridge, M. E., & Haley, K. E. (1993) · Conservation Biology · doi:10.1046/j.1523-1739.1993.07020363.x · Cited by 282
DO SIMILAR COMMUNITIES DEVELOP IN SIMILAR SITES? A TEST WITH ZOOPLANKTON STRUCTURE AND FUNCTION
Jenkins, D. G., & Buikema, A. L. (1998) · Ecological Monographs · doi:10.1890/0012-9615(1998)068[0421:dscdis]2.0.co;2 · Cited by 286
“Two net samples were collected at each station, and all net samples were pooled to provide one sample per pond (Hurlbert 1984).”
MethodInfluentialThe role of prediction in limnology1
Peters, R. H. (1986) · Limnology and Oceanography · doi:10.4319/lo.1986.31.5.1143 · Cited by 283
Hadley, A. S., & Betts, M. G. (2012) · Biological Reviews · doi:10.1111/j.1469-185x.2011.00205.x · Cited by 275
“We considered a study to have examined independent effects of habitat loss and habitat fragmentation if the authors (1) controlled for habitat amount statistically, or (2) applied mensurative or manipulative experiments (sensu Hurlbert, 1984).”
BackgroundMethodAREA REQUIREMENTS OF GRASSLAND BIRDS: A REGIONAL PERSPECTIVE
Johnson, D. H., & Igl, L. D. (2001) · The Auk · doi:10.1642/0004-8038(2001)118[0024:arogba]2.0.co;2 · Cited by 248
Diversity and Temporal Change in the Effective Pollinators of Asclepias Tuberosa
Fishbein, M., & Venable, D. L. (1996) · Ecology · doi:10.2307/2265576 · Cited by 275
Kaltz, O., & Bell, G. (2002) · Evolution · doi:10.1111/j.0014-3820.2002.tb00188.x · Cited by 276
QUANTIFYING PHYLOGENETICALLY STRUCTURED ENVIRONMENTAL VARIATION
Desdevises, Y., Legendre, P., Azouzi, L., & Morand, S. (2003) · Evolution · doi:10.1111/j.0014-3820.2003.tb01508.x · Cited by 277
“From a statistical standpoint, if one wants to know if the variation of trait X explains that of trait Y, then the phylogenetic dependence (autocorrelation) among the observations must be controlled for, using an appropriate comparative method, to avoid pseudoreplication (Hurlbert 1984).”
MethodAcoustic indices as proxies for biodiversity: a meta‐analysis
Alcocer, I., Lima, H., Sugai, L. S. M., & Llusia, D. (2022) · Biological Reviews · doi:10.1111/brv.12890 · Cited by 273
“Pseudoreplication leads to a biased and incorrect inference, and it should be carefully considered (Hurlbert, 1984).”
BackgroundRandomized Intervention Analysis and the Interpretation of Whole‐Ecosystem Experiments
Carpenter, S. R., Frost, T. M., Heisey, D., & Kratz, T. K. (1989) · Ecology · doi:10.2307/1941382 · Cited by 274
GPS radiotelemetry error and bias in mountainous terrain
D’Eon, R. G., Serrouya, R., Smith, G., & Kochanny, C. O. (2002) · Cited by 273
Response of Stream Invertebrates to a Global‐Warming Thermal Regime: An Ecosystem‐Level Manipulation
Hogg, I. D., & Williams, D. D. (1996) · Ecology · doi:10.2307/2265617 · Cited by 270
Species‐richness patterns of vascular plants along seven altitudinal transects in Norway
Grytnes, J. A. (2003) · Ecography · doi:10.1034/j.1600-0587.2003.03358.x · Cited by 277
The EthoVision video tracking system—A tool for behavioral phenotyping of transgenic mice
Spink, A. J., Tegelenbosch, R. A. J., Buma, M. O. S., & Noldus, L. P. J. J. (2001) · Physiology & Behavior · doi:10.1016/s0031-9384(01)00530-3 · Cited by 270
“In contrast to manual observation, video tracking carries out pattern analysis on a video image of the observed animals to extract quantitative measurements of the animals’ behavior (for more details about how this works, see below).”
BackgroundRaimondi, P. T. (1990) · Ecological Monographs · doi:10.2307/1943059 · Cited by 275
RESH, V. H., NORRIS, R. H., & BARBOUR, M. T. (1995) · Australian Journal of Ecology · doi:10.1111/j.1442-9993.1995.tb00525.x · Cited by 273
Topography, energy and the global distribution of bird species richness
Davies, R. G., Orme, C. D. L., Storch, D., Olson, V. A., Thomas, G. H., Ross, S. G., Ding, T.-S., Rasmussen, P. C., Bennett, P. M., Owens, I. P. F., et al. (2007) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2006.0061 · Cited by 272
“In particular, the last of them is an all but ubiquitous property of the landscape-scale habitat patches and gradients from which macroecological samples are drawn, and is equivalent to pseudoreplication in which environmental treatments are spatially segregated across an experimental grid ( Hurlbert 1984; Legendre 19…”
BackgroundGlobal predictors of language endangerment and the future of linguistic diversity
Bromham, L., Dinnage, R., Skirgård, H., Ritchie, A., Cardillo, M., Meakins, F., Greenhill, S., & Hua, X. (2021) · Nature Ecology & Evolution · doi:10.1038/s41559-021-01604-y · Cited by 267
Assessing Effects of Unreplicated Perturbations: No Simple Solutions
Stewart-Oaten, A., Bence, J. R., & Osenberg, C. W. (1992) · Ecology · doi:10.2307/1940685 · Cited by 269
Ferrier-Pag�s, C., Witting, J., Tambutt�, E., & Sebens, K. P. (2003) · Coral Reefs · doi:10.1007/s00338-003-0312-7 · Cited by 263
“Microcolonies in this experiment could be considered as pseudo-replicates (Hurlbert 1984; Heffner et al. 1996), since only one tank was used for each treatment.”
BackgroundCommunity-wide effects of marine reserves in the Mediterranean Sea
Guidetti, P., & Sala, E. (2007) · Marine Ecology Progress Series · doi:10.3354/meps335043 · Cited by 267
Bryant, J. P., Clausen, T. P., Reichardt, P. B., McCarthy, M. C., & Werner, R. A. (1987) · Oecologia · doi:10.1007/bf00379408 · Cited by 267
“To avoid pseudoreplication ( Hurlbert 1984 ) when analyzing the effects of N fertilization upon pupal weights, we used the mean pupal weight of larvae reared on an individual tree as one replicate in T-tests.”
MethodBiodiversity and resilience of arthropod communities after fire disturbance in temperate forests
Moretti, M., Duelli, P., & Obrist, M. K. (2006) · Oecologia · doi:10.1007/s00442-006-0450-z · Cited by 258
“All analyses were conducted treating the 22 sites as independent replicates (Hurlbert 1984), after checking for non-significant spatial autocorrelation of each functional group (multivariate Mantel correlogram).”
MethodRegrowth and Palatability of Acacia Shoots Following Pruning by African Savanna Browsers
DuToit, J. T., Bryant, J. P., & Frisby, K. (1990) · Ecology · doi:10.2307/1940255 · Cited by 268
Impact of Forest Fragmentation on Understory Plant Species Richness in Amazonia
Benítez‐Malvido, J., & Martínez‐Ramos, M. (2003) · Conservation Biology · doi:10.1046/j.1523-1739.2003.01120.x · Cited by 263
“Because each fragment was not replicated, to assess seedling density differences among fragments and address pseudoreplication (Hurlbert 1984), we obtained a single density value per fragment.”
MethodSpecialization, Speciation, and RadiationThe Evolutionary Biology of Herbivorous Insects
Tilmon, K. (2008) · University of California Press eBooks · doi:10.1525/california/9780520251328.001.0001 · Cited by 177
Winter management of Californian rice fields for waterbirds
Elphick, C. S., & Oring, L. W. (1998) · Journal of Applied Ecology · doi:10.1046/j.1365-2664.1998.00274.x · Cited by 261
Effects of an invading coccinellid on native coccinellids in an agricultural landscape
Elliott, N., Kieckhefer, R., & Kauffman, W. (1996) · Oecologia · doi:10.1007/bf00330017 · Cited by 261
“Causality cannot be demonstrated solely from statistical analysis of data obtained from unreplicated long-term monitoring studies ( Hurlbert 1984 ).”
BackgroundPringle, C. M. (1990) · Ecology · doi:10.2307/1937362 · Cited by 261
Choosy reef fish select cleaner fish that provide high-quality service
Bshary, R., & Schäffer, D. (2002) · Animal Behaviour · doi:10.1006/anbe.2001.1923 · Cited by 242
“Nevertheless, there is some potential for pseudoreplication ( Hurlbert 1984 ) in our data set, and we address this issue in the statistics section.”
BackgroundDingemanse, N. J., Van der Plas, F., Wright, J., Réale, D., Schrama, M., Roff, D. A., Van der Zee, E., & Barber, I. (2009) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2008.1555 · Cited by 260
“once to avoid pseudoreplication (Hurlbert 1984), and any variation in the behaviour of different stimulus fish was thus”
BackgroundNonindependence and sensitivity analyses in ecological and evolutionary meta‐analyses
Noble, D. W. A., Lagisz, M., O'dea, R. E., & Nakagawa, S. (2017) · Molecular Ecology · doi:10.1111/mec.14031 · Cited by 267
“Correlated data require careful consideration during a meta-analysis to avoid ‘pseudoreplication’ (Hurlburt 1984) and ill-informed inferences (Gurevitch & Hedges 1999; Nakagawa & Santos 2012).”
MethodSystems biology: experimental design
Kreutz, C., & Timmer, J. (2009) · The FEBS Journal · doi:10.1111/j.1742-4658.2008.06843.x · Cited by 257
“Appropriate replication and its pitfalls are discussed elsewhere [35,40, 41 ].”
BackgroundSchroth, G., D’Angelo, S. A., Teixeira, W. G., Haag, D., & Lieberei, R. (2002) · Forest Ecology and Management · doi:10.1016/s0378-1127(01)00537-0 · Cited by 257
Decomposition and nutrient release from logging residues after clear-cutting of mixed boreal forest
Palviainen, M., Finér, L., Kurka, A.-M., Mannerkoski, H., Piirainen, S., & Starr, M. (2004) · Plant and Soil · doi:10.1023/b:plso.0000047718.34805.fb · Cited by 255
Analyzing the Effects of Accidental Environmental Impacts: Approaches and Assumptions
Wiens, J. A., & Parker, K. R. (1995) · Ecological Applications · doi:10.2307/2269355 · Cited by 260
Grazing and Ecosystem Carbon Storage in the North American Great Plains
Derner, J. D., Boutton, T. W., & Briske, D. D. (2006) · Plant and Soil · doi:10.1007/s11104-005-2554-3 · Cited by 254
Wahle, R. A., & Steneck, R. S. (1992) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(92)90077-n · Cited by 255
Refuges, Biological Disturbance, and Rocky Subtidal Community Structure in New England
Witman, J. D. (1985) · Ecological Monographs · doi:10.2307/2937130 · Cited by 256
The Importance of Replication in Wildlife Research
Johnson, D. H. (2002) · The Journal of Wildlife Management · doi:10.2307/3802926 · Cited by 256
Thomas, S. C., & Winner, W. E. (2002) · Tree Physiology · doi:10.1093/treephys/22.2-3.117 · Cited by 254
“Frequently, comparisons have been made based on a relatively small number of individual mature trees, and often a single canopy site has been compared to a single site with experimental or natural populations of saplings, raising the specter of pseudo-replication (Hurlbert 1984).”
BackgroundPalacios, S., & Zimmerman, R. (2007) · Marine Ecology Progress Series · doi:10.3354/meps07084 · Cited by 253
“…CO2(aq) × Light treatment were used to calculate mean values without error estimates to avoid pseudo- Absolute growth Total leaf area ×100 New leaf area per shoot Number of days from hole punch to measure 4 Palacios & Zimmerman: Response of eelgrass to CO2 enrichment replication (Hurlburt 1984).”
MethodWillis, T. J., Millar, R. B., & Babcock, R. C. (2003) · Journal of Applied Ecology · doi:10.1046/j.1365-2664.2003.00775.x · Cited by 254
“A true before-after-control-impact (BACI) design (Hurlbert 1984; Stewart-Oaten, Murdoch & Parker 1986; Underwood 1994) could not be implemented because of the absence of comparable data prior to reserve establishment, so the three reserves and their environs were surveyed four times at 6-monthly intervals in an attemp…”
MethodFunctional Equivalency Trajectories of the Restored Gog‐Le‐Hi‐Te Estuarine Wetland
Simenstad, C. A., & Thom, R. M. (1996) · Ecological Applications · doi:10.2307/2269551 · Cited by 253
Ecological Experimentation: Strengths and Conceptual Problems
Tilman, D. (1989) · Long-Term Studies in Ecology · doi:10.1007/978-1-4615-7358-6_6 · Cited by 253
The Influence of Predatory Decapods, Refuge, and Microhabitat Selection on Seagrass Communities
Leber, K. M. (1985) · Ecology · doi:10.2307/2937391 · Cited by 255
Experiments in ecology and management: Their logics, functions and interpretations
UNDERWOOD, A. J. (1990) · Australian Journal of Ecology · doi:10.1111/j.1442-9993.1990.tb01464.x · Cited by 254
Spatiotemporal exploratory models for broad‐scale survey data
Fink, D., Hochachka, W. M., Zuckerberg, B., Winkler, D. W., Shaby, B., Munson, M. A., Hooker, G., Riedewald, M., Sheldon, D., & Kelling, S. (2010) · Ecological Applications · doi:10.1890/09-1340.1 · Cited by 252
“The importance of accounting for spatial (Lichstein et al. 2002, Royle et al. 2002, Banerjee et al. 2004, Latimer et al. 2006) and temporal correlation (Hurlbert 1984) has been broadly recognized.”
BackgroundBryant, J. P., Heitkonig, I., Kuropat, P., & Owen-Smith, N. (1991) · The American Naturalist · doi:10.1086/285145 · Cited by 251
Altering turbine speed reduces bat mortality at wind‐energy facilities
Arnett, E. B., Huso, M. M., Schirmacher, M. R., & Hayes, J. P. (2011) · Frontiers in Ecology and the Environment · doi:10.1890/100103 · Cited by 244
“Hurlbert SH. 1984.”
Elemental composition of otoliths as a stock delineator in fishes
Thresher, R. E. (1999) · Fisheries Research · doi:10.1016/s0165-7836(99)00072-7 · Cited by 249
Quantifying physiological influences on otolith microchemistry
Sturrock, A. M., Hunter, E., Milton, J. A., EIMF, Johnson, R. C., Waring, C. P., & Trueman, C. N. (2015) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12381 · Cited by 248
“Here, we describe a long-term, mensurative (sensu Hurlbert 1984) experiment to identify the main controls on otolith microchemistry in European plaice (Pleuronectes platessa L.).”
BackgroundA critical evaluation of augmentative biological control
Collier, T., & Van Steenwyk, R. (2004) · Biological Control · doi:10.1016/j.biocontrol.2004.05.001 · Cited by 248
“Unfortunately, a number of studies misused statistics by “pseudoreplicating”; that is they inappropriately used sampling units, e.g., leaves or plants, as experimental and statistical replicates instead of the truly independent experimental units, e.g., plots (Hurlbert 1984).”
BackgroundRAIN FOREST CANOPY COVER, RESOURCE AVAILABILITY, AND LIFE HISTORY EVOLUTION IN GUPPIES
Grether, G. F., Millie, D. F., Bryant, M. J., Reznick, D. N., & Mayea, W. (2001) · Ecology · doi:10.1890/0012-9658(2001)082[1546:rfccra]2.0.co;2 · Cited by 256
“We treated pools as sampling units, by reducing the data to pool means before analysis or by including a pool(stream) term in the model, as opposed to using individual fish or periphyton samples as sampling units, to avoid pseudoreplication (Hurlbert 1984).”
MethodDeMelo, R., France, R., & McQueen, D. J. (1992) · Limnology and Oceanography · doi:10.4319/lo.1992.37.1.0192 · Cited by 250
Controls of nitrogen limitation in tallgrass prairie
Seastedt, T. R., Briggs, J. M., & Gibson, D. J. (1991) · Oecologia · doi:10.1007/bf00323782 · Cited by 251
Lazic, S. E., & Essioux, L. (2013) · BMC Neuroscience · doi:10.1186/1471-2202-14-37 · Cited by 237
“animals are nested within litters) and avoids artificially inflating the sample size (also known as pseudoreplication [12, 15]).”
BackgroundExperimental Studies of Caribbean Seagrass Bed Development
Williams, S. L. (1990) · Ecological Monographs · doi:10.2307/1943015 · Cited by 246
Predator-induced behaviour shifts and natural selection in field-experimental lizard populations
Losos, J. B., Schoener, T. W., & Spiller, D. A. (2004) · Nature · doi:10.1038/nature03039 · Cited by 250
“To ensure that the islands in the two treatments exhibited a similar range of characteristic”
BackgroundExperimental design in ocean acidification research: problems and solutions
Cornwall, C. E., & Hurd, C. L. (2016) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsv118 · Cited by 242
“…that determines whether there is an effect of time or space (such as tank identity) on responses then removing this factor from the analysis if there is no effect is also inappropriate according to Hurlbert (1984), i.e. sacrificial pseudoreplication (Hurlbert, 1984; Hurlbert and White, 1993).”
BackgroundMethodInfluentialSpider diversity in cereal fields: comparing factors at local, landscape and regional scales
Clough, Y., Kruess, A., Kleijn, D., & Tscharntke, T. (2005) · Journal of Biogeography · doi:10.1111/j.1365-2699.2005.01367.x · Cited by 247
WHOLE-SYSTEM NUTRIENT ENRICHMENT INCREASES SECONDARY PRODUCTION IN A DETRITUS-BASED ECOSYSTEM
Cross, W. F., Wallace, J. B., Rosemond, A. D., & Eggert, S. L. (2006) · Ecology · doi:10.1890/0012-9658(2006)87[1556:wneisp]2.0.co;2 · Cited by 245
“…watershed area, slope, elevation, discharge, temperature, and pH; see Lugthart and Wallace [1992] for more detail), but differ since July 2000 in their concentrations of dissolved N and P as a result of our experimental nutrient enrichment of C54 (see Methods: Experimental enrichment, below).”
BackgroundPower analysis for generalized linear mixed models in ecology and evolution
Johnson, P. C. D., Barry, S. J. E., Ferguson, H. M., & Müller, P. (2015) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12306 · Cited by 243
“EE researchers are generally alert to the impact of non-independence and overdispersion on inference, as evidenced by the widespread awareness of pseu- doreplication (Hurlbert 1984) and the popularity of GLMMs (Bolker et al. 2009).”
BackgroundThe impact of introduced brown and rainbow trout on native fish: the case of Australasia
Crowl, T. A., Townsend, C. R., & Mcintosh, A. R. (1992) · Reviews in Fish Biology and Fisheries · doi:10.1007/bf00045038 · Cited by 242
“While this study provides the best direct evidence of trout effects that we know of, caution is needed in interpreting the results because of the lack of true replication (sensu Hurlbert, 1984 ).”
BackgroundThe Self‐Thinning Rule: Dead or Alive?
Lonsdale, W. M. (1990) · Ecology · doi:10.2307/1938275 · Cited by 242
Permeability of ancient forest edges for weedy plant species invasion
Honnay, O., Verheyen, K., & Hermy, M. (2002) · Forest Ecology and Management · doi:10.1016/s0378-1127(01)00490-x · Cited by 241
A rapid ontogenetic shift in the diet of juvenile yellowfin tuna from Hawaii
Graham, B. S., Grubbs, D., Holland, K., & Popp, B. N. (2006) · Marine Biology · doi:10.1007/s00227-006-0360-y · Cited by 241
“when prey items are pooled across stomachs (Hurlbert 1984).”
BackgroundArchitectural vs. biological effects of a habitat-altering, exotic mussel, Musculista senhousia
Crooks, J. A., & Khim, H. S. (1999) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/s0022-0981(99)00041-6 · Cited by 242
Hurd, C. L., Hepburn, C. D., Currie, K. I., Raven, J. A., & Hunter, K. A. (2009) · Journal of Phycology · doi:10.1111/j.1529-8817.2009.00768.x · Cited by 239
Assessing the Environmental Impacts of Beach Nourishment
PETERSON, C. H., & BISHOP, M. J. (2005) · BioScience · doi:10.1641/0006-3568(2005)055[0887:ateiob]2.0.co;2 · Cited by 224
Substrate limitations to microbial activity in taiga forest floors
Vance, E. D., & Chapin III, F. S. (2001) · Soil Biology and Biochemistry · doi:10.1016/s0038-0717(00)00127-9 · Cited by 239
“These stands were interspersed along ®ve ridges throughout the experimental forest, allowing us to generalize results for these forest types to the region without pseudo-replication (Hurlbert, 1984).”
BackgroundTemporal Habitat Partitioning and Spatial Use of Coyotes and Red Foxes in East-Central Illinois
Gosselink, T. E., Deelen, T. R. V., Warner, R. E., & Joselyn, M. G. (2003) · The Journal of Wildlife Management · doi:10.2307/3803065 · Cited by 237
Variability in abundance of algae and invertebrates at different spatial scales on rocky sea shores
Benedetti-Cecchi, L. (2001) · Marine Ecology Progress Series · doi:10.3354/meps215079 · Cited by 236
“Detecting differences among strata in these analyses requires proper estimation of natural variability within strata to avoid problems of spatial confounding (Hurlbert 1984).”
BackgroundLONG-TERM RESPONSES OF THE KUPARUK RIVER ECOSYSTEM TO PHOSPHORUS FERTILIZATION
Slavik, K., Peterson, B. J., Deegan, L. A., Bowden, W. B., Hershey, A. E., & Hobbie, J. E. (2004) · Ecology · doi:10.1890/02-4039 · Cited by 235
“…design and interpretation of whole-ecosystem experiments has been problematic because replicate ecosystems are sometimes unavailable or replication is not logistically possible and because pretreatment samples are not always available (Hurlbert 1984, Carpenter 1989, Stewart-Oaten and Bence 2001).”
BackgroundPereira, R., Zweede, J., Asner, G. P., & Keller, M. (2002) · Forest Ecology and Management · doi:10.1016/s0378-1127(01)00732-0 · Cited by 234
“Our design is admittedly pseudo-replicated (sensu Hurlbert, 1984).”
Subtidal Coexistence: Storms, Grazing, Mutualism, and the Zonation of Kelps and Mussels
Witman, J. D. (1987) · Ecological Monographs · doi:10.2307/1942623 · Cited by 237
“Itwas not practical to intersperse the replicates of the two treatments (Hurlbert 1984) because sea urchins are highly motile and would reinvade the removal quadrats from the grazed control quadrats if they were near each other.”
BackgroundSpatial Heterogeneity and the Design of Ecological Field Experiments
Dutilleul, P. (1993) · Ecology · doi:10.2307/1939923 · Cited by 240
Selective feeding behaviour of key free-living protists: avenues for continued study
Montagnes, D., Barbosa, A., Boenigk, J., Davidson, K., Jürgens, K., Macek, M., Parry, J., Roberts, E., & imek, K. (2008) · Aquatic Microbial Ecology · doi:10.3354/ame01229 · Cited by 233
Cattle Grazing Impacts on Annual Forbs and Vegetation Composition of Mesic Grasslands in California
HAYES, G. F., & HOLL, K. D. (2003) · Conservation Biology · doi:10.1111/j.1523-1739.2003.00281.x · Cited by 234
“Studies at localized sites are important to tease out site-specific differences, which our results mask, but results are often misleading when they are generalized beyond their geographic sample extent (Hurlbert 1984).”
ResultDOWNES, B. J., LAKE, P. S., & SCHREIBER, E. S. G. (1993) · Freshwater Biology · doi:10.1111/j.1365-2427.1993.tb00793.x · Cited by 233
Götmark, F., & Andersson, M. (2020) · BMC Public Health · doi:10.1186/s12889-020-8331-7 · Cited by 230
DECIDUOUS-FOREST BIRD COMMUNITIES IN A FRAGMENTED LANDSCAPE DOMINATED BY EXOTIC PINE PLANTATIONS
Estades, C. F., & Temple, S. A. (1999) · Ecological Applications · doi:10.1890/1051-0761(1999)009[0573:dfbcia]2.0.co;2 · Cited by 233
Pernet, F., Barret, J., Le Gall, P., Corporeau, C., Dégremont, L., Lagarde, F., Pépin, J., & Keck, N. (2012) · Aquaculture Environment Interactions · doi:10.3354/aei00041 · Cited by 231
“Although samples are ‘pseudo - replicates’ (Hurlbert 1984), chi-square tests were conducted using individual measurements to maximise the number of observations for obtaining a valid test.”
MethodORGANIC CARBON SUPPLY AND METABOLISM IN A SHALLOW GROUNDWATER ECOSYSTEM
Baker, M. A., Valett, H. M., & Dahm, C. N. (2000) · Ecology · doi:10.1890/0012-9658(2000)081[3133:ocsami]2.0.co;2 · Cited by 230
“All measurements made on the three microcosms buried in single locations were averaged to avoid pseudoreplication (sensu Hurlbert 1984) when performing statistical analyses to test for location and time effects.”
Method
Metadata
- Authors
- Hurlbert, S. H.
- Corresponding author
- Hurlbert, Stuart H.
- Venue
- Ecological Monographs
- Publisher
- Wiley
- Published
- 1984-06
- Volume
- 54
- Issue
- 2
- Pages
- 187-211
- ISSN
- 0012-9615 (ISSN-L)
- 1557-7015
- OpenAlex
- W2139156166
- Cited by
- 8,377
- References
- 102
- Citations by year
- 2026: 283 · 2025: 212 · 2024: 155 · 2023: 167 · 2022: 164 · 2021: 212 · 2020: 221 · 2019: 233 · 2018: 231 · 2017: 226 · 2016: 266 · 2015: 279 · 2014: 296 · 2013: 280 · 2012: 254
- FWCI
- 120.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ecological Monographs (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- pseudoreplication, experimental design, randomization, type I error, marine benthos, small mammals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.