Pseudoreplication and the Design of Ecological Field Experiments
The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
Pseudoreplication is defined as the use of inferential statistics to test for treatment effects with data from experiments where either treatments are not replicated (though samples may be) or replicates are not statistically independent. In ANOVA terminology, it is the testing for treatment effects with an error term inappropriate to the hypothesis being considered. Scrutiny of 176 experimental studies published between 1960 and the present revealed that pseudoreplication occurred in 27% of them, or 48% of all such studies that applied inferential statistics. The incidence of pseudoreplication is especially high in studies of marine benthos and small mammals. The critical features of controlled experimentation are reviewed. Nondemonic intrusion is defined as the impingement of chance events on an experiment in progress. As a safeguard against both it and preexisting gradients, interspersion of treatments is argued to be an obligatory feature of good design. Especially in small experiments, adequate interspersion can sometimes be assured only by dispensing with strict randomization procedures. Comprehension of this conflict between interspersion and randomization is aided by distinguishing pre—layout (or conventional) and layout—specific alpha (probability of type I error). Suggestions are offered to statisticians and editors of ecological journals as to how ecologists' understanding of experimental design and statistics might be improved.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“The tautological structure of the Kauffman and Cummings model invalidates Ripple et al.'s analysis because applying it violates the scientific principle that conclusions must be supported by evidence that is independent of the data used to generate them (Hurlbert 1984; Nakagawa & Parker 2015).”
From Flawed analysis invalidates claim of a strong Yellowstone trophic cascade after wolf reintroduction: A comment on Ripple et al. (2025) (2025) · cites this paper as Hurlbert 1984
In the citing paper
“A reason for this small number is that many studies incorporated experimental designs that suffered from pseudoreplication [79].”
From Land use change to bioenergy: A meta-analysis of soil carbon and GHG emissions (2015) · cites this paper as [79]
In the citing paper
“Pseudoreplication leads to a biased and incorrect inference, and it should be carefully considered (Hurlbert, 1984).”
From Acoustic indices as proxies for biodiversity: a meta‐analysis (2022) · cites this paper as Hurlbert, 1984
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Principles and procedures of statistics: McGraw-Hill Book Company, Inc. New York Toronto London.
Steel, R., & Torrie, J. H. (1960) · Cited by 4,633
Food Webs: Linkage, Interaction Strength and Community Infrastructure
Paine, R. T. (1980) · The Journal of Animal Ecology · doi:10.2307/4220 · Cited by 1,824
Sampling Design and Statistical Methods for Environmental Biologists
Green, R. H. (1979) · Andalas University Repository (Andalas University) · Cited by 1,550
Biogeochemistry of a forested ecosystem
(2014) · Choice Reviews Online · doi:10.5860/choice.51-6175 · Cited by 1,550
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Paine, R. T. (1974) · Oecologia · doi:10.1007/bf00345739 · Cited by 1,403
Cited by
A new method for non-parametric multivariate analysis of variance
Anderson, M. J. (2001) · Austral Ecology · doi:10.1111/j.1442-9993.2001.01070.pp.x · Cited by 13,828
“…that the developments in experimental design for ecology that require multifactorial ANOVA, in order to, for example, avoid pseudo-replication (Hurlbert 1984), test for generality (Beck 1997) or test for environmental impact (e.g. Green 1979, 1993; Underwood 1993; Glasby 1997), should be…”
BackgroundA protocol for data exploration to avoid common statistical problems: Data exploration
Zuur, A. F., Ieno, E. N., & Elphick, C. S. (2010) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2009.00001.x · Cited by 8,228
“A crucial assumption of most statistical techniques is that observations are independent of one another (Hurlbert 1984), meaning that information from any one observation should not provide information on another after the effects of other variables have been accounted for.”
BackgroundLebreton, J.-D., Burnham, K. P., Clobert, J., & Anderson, D. R. (1992) · Ecological Monographs · doi:10.2307/2937171 · Cited by 4,517
“When only one site is used there is a danger of committing pseudoreplication (Hurlbert 1984).”
BackgroundF. Dormann, C., M. McPherson, J., B. Araújo, M., Bivand, R., Bolliger, J., Carl, G., G. Davies, R., Hirzel, A., Jetz, W., Daniel Kissling, W., et al. (2007) · Ecography · doi:10.1111/j.2007.0906-7590.05171.x · Cited by 3,433
Legendre, P., & Anderson, M. J. (1999) · Ecological Monographs · doi:10.1890/0012-9615(1999)069[0001:dbratm]2.0.co;2 · Cited by 2,695
“The use of structured experiments for testing hypotheses is essential to the science of ecology (Connell 1972, Hurlbert 1984, Underwood 1990, 1997).”
BackgroundReporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000411 · Cited by 2,677
“It underestimates the true variability in a study, which can lead to false positives and invalidate the analysis and resulting conclusions [26,27].”
BackgroundA Method for Assessing Hydrologic Alteration within Ecosystems
Richter, B. D., Baumgartner, J. V., Powell, J., & Braun, D. P. (1996) · Conservation Biology · doi:10.1046/j.1523-1739.1996.10041163.x · Cited by 2,463
“The assessment of impacts to natural systems often poses difficult statistical problems, however, because the perturbation of interest cannot be replicated or randomly assigned to experimental units (Carpenter 1989; Carpenter et al. 1989; Hurlbert 1984; Stewart-Oaten et al. 1986).”
BackgroundFluorescence spectroscopy and multi-way techniques. PARAFAC
Murphy, K. R., Stedmon, C. A., Graeber, D., & Bro, R. (2013) · Analytical Methods · doi:10.1039/c3ay41160e · Cited by 2,060
Ecological Impacts of Deer Overabundance
Côté, S. D., Rooney, T. P., Tremblay, J.-P., Dussault, C., & Waller, D. M. (2004) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev.ecolsys.35.021103.105725 · Cited by 2,079
Compositional Analysis of Habitat Use From Animal Radio‐Tracking Data
Aebischer, N. J., Robertson, P. A., & Kenward, R. E. (1993) · Ecology · doi:10.2307/1940062 · Cited by 1,909
Hidden treatments in ecological experiments: re-evaluating the ecosystem function of biodiversity
Huston, M. A. (1997) · Oecologia · doi:10.1007/s004420050180 · Cited by 1,772
“Adequate and appropriate replication is a concern in any experimental design, but a type of false replication, called pseudo-replication, was identified as a particular problem in ecological experiments (Hurlbert 1984).”
BackgroundGenetic variation across species’ geographical ranges: the central–marginal hypothesis and beyond
ECKERT, C. G., SAMIS, K. E., & LOUGHEED, S. C. (2008) · Molecular Ecology · doi:10.1111/j.1365-294x.2007.03659.x · Cited by 1,671
“eplication (Hurlbert 1984) makes it difficult to associate”
BackgroundSpatial Analysis: A Guide for Ecologists
Fortin, M.-J., & Dale, M. R. T. (2005) · doi:10.1017/cbo9780511542039 · Cited by 991
How much water does a river need?
RICHTER, B., BAUMGARTNER, J., WIGINGTON, R., & BRAUN, D. (1997) · Freshwater Biology · doi:10.1046/j.1365-2427.1997.00153.x · Cited by 1,601
Analyzing mixing systems using a new generation of Bayesian tracer mixing models
Stock, B. C., Jackson, A. L., Ward, E. J., Parnell, A. C., Phillips, D. L., & Semmens, B. X. (2018) · PeerJ · doi:10.7717/peerj.5096 · Cited by 1,524
The Role of Disturbance in Stream Ecology
Resh, V. H., Brown, A. V., Covich, A. P., Gurtz, M. E., Li, H. W., Minshall, G. W., Reice, S. R., Sheldon, A. L., Wallace, J. B., & Wissmar, R. C. (1988) · Journal of the North American Benthological Society · doi:10.2307/1467300 · Cited by 1,586
Beta diversity as the variance of community data: dissimilarity coefficients and partitioning
Legendre, P., & De Cáceres, M. (2013) · Ecology Letters · doi:10.1111/ele.12141 · Cited by 1,522
A meta‐analysis of biotic resistance to exotic plant invasions
Levine, J. M., Adler, P. B., & Yelenik, S. G. (2004) · Ecology Letters · doi:10.1111/j.1461-0248.2004.00657.x · Cited by 1,499
Permutation tests for univariate or multivariate analysis of variance and regression
Anderson, M. J. (2001) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-58-3-626 · Cited by 1,495
“(The important issue of pseudo replication in observational (mensurative) or experimental ecological field studies (Hurlbert 1984) is not treated in this simplified example.”
BackgroundHECKY, R. E., & KILHAM, P. (1988) · Limnology and Oceanography · doi:10.4319/lo.1988.33.4_part_2.0796 · Cited by 1,447
Pyšek, P., Jarošík, V., Hulme, P. E., Pergl, J., Hejda, M., Schaffner, U., & Vilà, M. (2012) · Global Change Biology · doi:10.1111/j.1365-2486.2011.02636.x · Cited by 1,447
“These approaches prevented pseudoreplication (Hurlbert, 1984) as they ensured that we did not treat different cases from a single study and multiple cases of the same invasive species in the dataset as independent data points.”
BackgroundEnvironmental Impact Assessment: "Pseudoreplication" in Time?
Stewart-Oaten, A., Murdoch, W. W., & Parker, K. R. (1986) · Ecology · doi:10.2307/1939815 · Cited by 1,331
(2012) · Developments in Environmental Modelling · doi:10.1016/b978-0-444-53868-0.50018-6 · Cited by 1,320
Ecological models and data in R
Bolker, B. M. (2008) · doi:10.2307/j.ctvcm4g37 · Cited by 1,297
“…randomization, control, independence, and replication in setting up experiments, the idea of statistical power, and the concept of pseudoreplication (Hurlbert, 1984; Hargrove and Pickering, 1992; Heffner et al., 1996; Oksanen, 2001) — are essential tools for any working ecologist (whether…”
BackgroundWhat does research reproducibility mean?
Goodman, S. N., Fanelli, D., & Ioannidis, J. P. A. (2016) · Science Translational Medicine · doi:10.1126/scitranslmed.aaf5027 · Cited by 1,293
On Beyond BACI: Sampling Designs that Might Reliably Detect Environmental Disturbances
Underwood, A. J. (1994) · Ecological Applications · doi:10.2307/1942110 · Cited by 1,233
HARRIS, S., CRESSWELL, W. J., FORDE, P. G., TREWHELLA, W. J., WOOLLARD, T., & WRAY, S. (1990) · Mammal Review · doi:10.1111/j.1365-2907.1990.tb00106.x · Cited by 1,179
Do Habitat Corridors Provide Connectivity?
Beier, P., & Noss, R. F. (1998) · Conservation Biology · doi:10.1111/j.1523-1739.1998.98036.x · Cited by 523
“Such a rigorous experiment may be unnecessary (cf. Hurlbert 1984), however.”
BackgroundCoastal eutrophication as a driver of salt marsh loss
Deegan, L. A., Johnson, D. S., Warren, R. S., Peterson, B. J., Fleeger, J. W., Fagherazzi, S., & Wollheim, W. M. (2012) · Nature · doi:10.1038/nature11533 · Cited by 1,075
Mechanisms of Primary Succession Following Deglaciation at Glacier Bay, Alaska
Chapin, F. S., Walker, L. R., Fastie, C. L., & Sharman, L. C. (1994) · Ecological Monographs · doi:10.2307/2937039 · Cited by 1,091
Spatial autocorrelation and red herrings in geographical ecology
Diniz‐Filho, J. A. F., Bini, L. M., & Hawkins, B. A. (2003) · Global Ecology and Biogeography · doi:10.1046/j.1466-822x.2003.00322.x · Cited by 1,065
“In the case of low turnover (large geographical range sizes relative to cell sizes), adjacent cells are pseudo-replicated units in space ( sensu Hurlbert, 1984) and correlation or regression analyses between species richness and this environmental factor should be, in principle, tested with a reduced number of degrees…”
BackgroundInfluentialVALLADARES, F., SANCHEZ‐GOMEZ, D., & ZAVALA, M. A. (2006) · Journal of Ecology · doi:10.1111/j.1365-2745.2006.01176.x · Cited by 1,029
“This in turn, alleviates problems of pseudoreplication (Hurlbert 1984).”
BackgroundBeyond BACI: the detection of environmental impacts on populations in the real, but variable, world
Underwood, A. J. (1992) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(92)90094-q · Cited by 1,001
The selection, testing and application of terrestrial insects as bioindicators
McGEOGH, M. A. (1998) · Biological Reviews · doi:10.1111/j.1469-185x.1997.tb00029.x · Cited by 728
“H, S. J. (1984). Pseudoreplication and the design of ecological field experiments.”
Temperature and Plant Species Control Over Litter Decomposition in Alaskan Tundra
Hobbie, S. E. (1996) · Ecological Monographs · doi:10.2307/2963492 · Cited by 969
Comparison of methods to account for autocorrelation in correlation analyses of fish data
Pyper, B. J., & Peterman, R. M. (1998) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-55-9-2127 · Cited by 835
Monitoring bird populations by point counts
Ralph, C. J., Sauer, J. R., & Droege, S. (1995) · doi:10.2737/psw-gtr-149 · Cited by 839
A Meta-Analysis of Competition in Field Experiments
Gurevitch, J., Morrow, L. L., Wallace, A., & Walsh, J. S. (1992) · The American Naturalist · doi:10.1086/285428 · Cited by 865
Use and misuse of landscape indices
Li, H., & Wu, J. (2004) · Landscape Ecology · doi:10.1023/b:land.0000030441.15628.d6 · Cited by 851
“Pseudoreplication has been recognized as an obstacle to large-scale experiment and analysis Hurlbert 1984; Hargrove and Pickering 1992; but see Oksanen 2001.”
BackgroundInfluentialBasin-wide variations in Amazon forest structure and function are mediated by both soils and climate
Quesada, C. A., Phillips, O. L., Schwarz, M., Czimczik, C. I., Baker, T. R., Patiño, S., Fyllas, N. M., Hodnett, M. G., Herrera, R., Almeida, S., et al. (2012) · Biogeosciences · doi:10.5194/bg-9-2203-2012 · Cited by 834
“In an approach weighted much more towards the already selected environmental predictors, SEVM-3 can be viewed as an OLS affiliated procedure which corrects for spatial autocorrelation in residuals such as might be expected if closely aligned sites had similar properties, this non-independence of observations effective…”
BackgroundA protocol for conducting and presenting results of regression‐type analyses
Zuur, A. F., & Ieno, E. N. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12577 · Cited by 834
“Hurlbert (1984) discussed the lack of statistical independence of replicates (pseudoreplication) in ecological field experiments.”
BackgroundApplication of random effects to the study of resource selection by animals
GILLIES, C. S., HEBBLEWHITE, M., NIELSEN, S. E., KRAWCHUK, M. A., ALDRIDGE, C. L., FRAIR, J. L., SAHER, D. J., STEVENS, C. E., & JERDE, C. L. (2006) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2006.01106.x · Cited by 812
“This unobserved heterogeneity within levels could produce pseudoreplicated samples (Hurlbert 1984) that lack independence, even after controlling for”
BackgroundMethodSea Otters and Kelp Forests in Alaska: Generality and Variation in a Community Ecological Paradigm
Estes, J. A., & Duggins, D. O. (1995) · Ecological Monographs · doi:10.2307/2937159 · Cited by 798
Statistical Power Analysis can Improve Fisheries Research and Management
Peterman, R. M. (1990) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/f90-001 · Cited by 796
Forest Fragmentation, Pollination, and Plant Reproduction in a Chaco Dry Forest, Argentina
Aizen, M. A., & Feinsinger, P. (1994) · Ecology · doi:10.2307/1939538 · Cited by 785
Wardle, D. A., & Ghani, A. (1995) · Soil Biology and Biochemistry · doi:10.1016/0038-0717(95)00093-t · Cited by 776
MARINE RESERVES ARE NECESSARY BUT NOT SUFFICIENT FOR MARINE CONSERVATION
Allison, G. W., Lubchenco, J., & Carr, M. H. (1998) · Ecological Applications · doi:10.1890/1051-0761(1998)8[s79:mranbn]2.0.co;2 · Cited by 672
Comparative evaluation of experimental approaches to the study of habitat fragmentation effects
McGarigal, K., & Cushman, S. A. (2002) · Ecological Applications · doi:10.1890/1051-0761(2002)012[0335:ceoeat]2.0.co;2 · Cited by 731
“The defining feature of a manipulative experiment is that the different experimental units receive different treatments imposed by the experimenter and that the assignment of treatments to experimental units is, or can be, randomized (Hurlbert 1984).”
BackgroundInfluentialData Analysis in Community and Landscape Ecology.
Green, R. H., Jongman, R. H. G., Braak, C. J. F., & Tongeren, O. F. R. V. (1990) · Biometrics · doi:10.2307/2531665 · Cited by 731
Goldberg, D. E., & Barton, A. M. (1992) · The American Naturalist · doi:10.1086/285357 · Cited by 747
“Hurlbert (1984) and Underwood (1986) provide excellent reviews of these aspects of field experiments in ecology.”
BackgroundThe Keystone Species Concept: Variation in Interaction Strength in a Rocky Intertidal Habitat
Menge, B. A., Berlow, E. L., Blanchette, C. A., Navarrete, S. A., & Yamada, S. B. (1994) · Ecological Monographs · doi:10.2307/2937163 · Cited by 728
SuperPlots: Communicating reproducibility and variability in cell biology
Lord, S. J., Velle, K. B., Mullins, R. D., & Fritz-Laylin, L. K. (2020) · Journal of Cell Biology · doi:10.1083/jcb.202001064 · Cited by 718
““pseudoreplication” (Hurlbert 1984).”
Why Not to Do Two-Species Comparative Studies: Limitations on Inferring Adaptation
Garland, T., & Adolph, S. C. (1994) · Physiological Zoology · doi:10.1086/physzool.67.4.30163866 · Cited by 719
Global negative effects of nitrogen deposition on soil microbes
Zhang, T., Chen, H. Y. H., & Ruan, H. (2018) · The ISME Journal · doi:10.1038/s41396-018-0096-y · Cited by 707
Back to the basics of anti-predatory vigilance: the group-size effect
Lima, S. L. (1995) · Animal Behaviour · doi:10.1016/0003-3472(95)80149-9 · Cited by 712
Guckert, J. B., Antworth, C. P., Nichols, P. D., & White, D. C. S. (1985) · FEMS Microbiology Letters · doi:10.1016/0378-1097(85)90016-3 · Cited by 690
Underwood, A. (1991) · Marine and Freshwater Research · doi:10.1071/mf9910569 · Cited by 670
“The data are 'pseudoreplicated' (Hurlbert 1984); any change in numbers may be due to any number of causes (including that identified as a disturbance by man).”
BackgroundEffects of incorporating spatial autocorrelation into the analysis of species distribution data
Dormann, C. F. (2007) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2006.00279.x · Cited by 658
“The statistical point thus is unambiguous (Griffith & Lagona, 1998): the statistical analysis of spatial data needs to incorporate spatial autocorrelation to avoid the pitfalls of spatial pseudoreplication ( Hurlbert, 1984; Legendre, 1993), similar to a nested experiment requiring a mixed-model analysis to be structur…”
BackgroundShifting roles of heterotrophy and autotrophy in coral energetics under varying turbidity
Anthony, K. R. N., & Fabricius, K. E. (2000) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/s0022-0981(00)00237-9 · Cited by 663
“Measured growth data: tissue, lipids and skeleton Effects of shading and SPM concentration on rates of tissue growth, lipid storage and skeletal growth were tested for each species separately using two-way ANOVAs based on means for each tank within a treatment, the latter to avoid pseudoreplication (Hurlbert, 1984).”
MethodBehavioural syndromes differ predictably between 12 populations of three‐spined stickleback
DINGEMANSE, N. J., WRIGHT, J., KAZEM, A. J. N., THOMAS, D. K., HICKLING, R., & DAWNAY, N. (2007) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2007.01284.x · Cited by 659
“While subject behaviour in both types of live interaction may depend in part upon that of the stimulus fish, in our case each stimulus fish was used only once to avoid pseudoreplication (Hurlbert 1984) – hence, 1131 Evolution of behavioural syndromes © 2007 The Authors.”
BackgroundLinear models and linear mixed effects models in R with linguistic applications
Winter, B. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1308.5499 · Cited by 460
“Unfortunately, violations of the independence assumption are quite frequent in many branches of science – so much in fact, that there’s a whole literature associated with this violation, starting from Hurlbert (1984) for ecology, Freeberg and Lucas (2009) for psychology, Lazic (2010) for neuroscience and my own small…”
Elser, J. J., Marzolf, E. R., & Goldman, C. R. (1990) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/f90-165 · Cited by 657
Partitioning Herbivory and Its Effects on Coral Reef Algal Communities
Carpenter, R. C. (1986) · Ecological Monographs · doi:10.2307/1942551 · Cited by 649
Reynoldson, T. B., Norris, R. H., Resh, V. H., Day, K. E., & Rosenberg, D. M. (1997) · Journal of the North American Benthological Society · doi:10.2307/1468175 · Cited by 641
Putz, F. E., Zuidema, P. A., Synnott, T., Peña‐Claros, M., Pinard, M. A., Sheil, D., Vanclay, J. K., Sist, P., Gourlet‐Fleury, S., Griscom, B., et al. (2012) · Conservation Letters · doi:10.1111/j.1755-263x.2012.00242.x · Cited by 620
Wilson, D. S. (1992) · Ecology · doi:10.2307/1941449 · Cited by 627
Study Designs and Tests for Comparing Resource Use and Availability II
THOMAS, D. L., & TAYLOR, E. J. (2006) · Journal of Wildlife Management · doi:10.2193/0022-541x(2006)70[324:sdatfc]2.0.co;2 · Cited by 625
“…across animals for analysis, inferences should be scrutinized with respect to the number of animals involved, the numbers of relocations made for each animal, and the temporal dependency among relocations because this constitutes a form of pseudo replication (Hurlbert 1984, Marzluff et al. 2004).”
BackgroundControl of a Desert-Grassland Transition by a Keystone Rodent Guild
Brown, J. H., & Heske, E. J. (1990) · Science · doi:10.1126/science.250.4988.1705 · Cited by 623
Regression analysis of spatial data
Beale, C. M., Lennon, J. J., Yearsley, J. M., Brewer, M. J., & Elston, D. A. (2010) · Ecology Letters · doi:10.1111/j.1461-0248.2009.01422.x · Cited by 602
Similarity-based testing for community pattern: the two-way layout with no replication
Clarke, K. R., & Warwick, R. M. (1994) · Marine Biology · doi:10.1007/bf00699231 · Cited by 588
“It has been common historically, however, for repeated measurements to be in the form of pseudo-replicate s ( Hurlbert 1984 ), which might take the form of analyses of sub-cores of single cores in Example 1, or spatially contiguous samples (thus unrepresentative of the site area) for each site/time combination in Exam…”
BackgroundA synthesis of experimental work on parasite local adaptation
Greischar, M. A., & Koskella, B. (2007) · Ecology Letters · doi:10.1111/j.1461-0248.2007.01028.x · Cited by 571
Meta-analysis: synthesizing research findings in ecology and evolution
Arnqvist, G., & Wooster, D. (1995) · Trends in Ecology & Evolution · doi:10.1016/s0169-5347(00)89073-4 · Cited by 570
West, N. E. (1990) · Advances in Ecological Research · doi:10.1016/s0065-2504(08)60055-0 · Cited by 571
Wilson, D. S., Coleman, K., Clark, A. B., & Biederman, L. (1993) · Journal of Comparative Psychology · doi:10.1037/0735-7036.107.3.250 · Cited by 564
Logic of experiments in ecology: is pseudoreplication a pseudoissue?
Oksanen, L. (2001) · Oikos · doi:10.1034/j.1600-0706.2001.11311.x · Cited by 569
“The current attitude of ecologists to experimental work is dominated by the paper of Hurlbert (1984), emphasizing the need of genuine replication.”
BackgroundMethodInfluentialReporting animal research: Explanation and Elaboration for the ARRIVE guidelines 2019
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/703355 · Cited by 559
“This may invalidate the analysis and resulting conclusions [21, 22] (see also item 7 – Statistical methods).”
MethodPATTERNS OF NATURAL SELECTION ON SIZE AT METAMORPHOSIS IN WATER FROGS
Altwegg, R., & Reyer, H.-U. (2003) · Evolution · doi:10.1111/j.0014-3820.2003.tb00298.x · Cited by 523
“Our analysis is biased towards finding effects of the larval treatments on terrestrial performance that are in fact spurious (Hurlbert 1984).”
Eliminating autocorrelation reduces biological relevance of home range estimates
DE Solla, S. R., Bonduriansky, R., & Brooks, R. J. (1999) · Journal of Animal Ecology · doi:10.1046/j.1365-2656.1999.00279.x · Cited by 550
“endre 1993; Lombardi & Hurlbert 1996) and prohibits us from knowing the actual o value (Hurlbert 1984).”
BackgroundInfluentialWardle, D. A., Bonner, K. I., Barker, G. M., Yeates, G. W., Nicholson, K. S., Bardgett, R. D., Watson, R. N., & Ghani, A. (1999) · Ecological Monographs · doi:10.1890/0012-9615(1999)069[0535:pripgv]2.0.co;2 · Cited by 537
Multivariate Analysis of Ecological Data Using CANOCO
(2005) · Bulletin of the Ecological Society of America · doi:10.1890/0012-9623(2005)86[201:maoedu]2.0.co;2 · Cited by 536
Schönfeld, J., Alve, E., Geslin, E., Jorissen, F., Korsun, S., & Spezzaferri, S. (2012) · Marine Micropaleontology · doi:10.1016/j.marmicro.2012.06.001 · Cited by 533
“Therefore, to characterise spatial heterogeneity at the same scale of tens of metres to kilometres as macrobenthos surveys do, and to avoid pseudoreplication (Hurlbert, 1984), foraminiferal replicate samples should preferentially come from separate deployments.”
BackgroundHarvey, B. P., Gwynn‐Jones, D., & Moore, P. J. (2013) · Ecology and Evolution · doi:10.1002/ece3.516 · Cited by 515
Interactions between increasing CO2 concentration and temperature on plant growth
MORISON, J. I. L., & LAWLOR, D. W. (1999) · Plant, Cell & Environment · doi:10.1046/j.1365-3040.1999.00443.x · Cited by 509
RAIN FOREST FRAGMENTATION AND THE STRUCTURE OF AMAZONIAN LIANA COMMUNITIES
Laurance, W. F., Pérez-Salicrup, D., Delamônica, P., Fearnside, P. M., D'Angelo, S., Jerozolinski, A., Pohl, L., & Lovejoy, T. E. (2001) · Ecology · doi:10.1890/0012-9658(2001)082[0105:rffats]2.0.co;2 · Cited by 468
“Because the samples were intended to assess fine-scale variation within these particular fragments, concerns about pseudoreplication (Hurlbert 1984) are irrelevant, but the reader should be aware that the results may not be typical of other Amazonian fragments.”
BackgroundZVEREVA, E. L., & KOZLOV, M. V. (2006) · Global Change Biology · doi:10.1111/j.1365-2486.2005.01086.x · Cited by 509
“Although the statistical validity of the analyses can be seriously compromised by pseudoreplication, nonreplicated studies may still provide valuable information on the magnitude of the effects (Hurlbert, 1984).”
BackgroundResultPlant Traits and Resource Reduction For Five Grasses Growing on a Nitrogen Gradient
Tilman, D., & Wedin, D. (1991) · Ecology · doi:10.2307/2937208 · Cited by 497
Driscoll, D. A., Lindenmayer, D. B., Bennett, A. F., Bode, M., Bradstock, R. A., Cary, G. J., Clarke, M. F., Dexter, N., Fensham, R., Friend, G., et al. (2010) · Biological Conservation · doi:10.1016/j.biocon.2010.05.026 · Cited by 497
Pardini, R., de Souza, S. M., Braga-Neto, R., & Metzger, J. P. (2005) · Biological Conservation · doi:10.1016/j.biocon.2005.01.033 · Cited by 497
“1) and prevent initial or inherent variability among samples to invalidate results (Hurlbert, 1984), we systematically selected sites in fragments and randomly spaced out sites in the continuous landscape.”
BackgroundScales of spatial patterns of distribution of intertidal invertebrates
Underwood, A. J., & Chapman, M. G. (1996) · Oecologia · doi:10.1007/bf00327905 · Cited by 487
“Replicate sites are then necessary to represent adequately a shore (Underwood 1981a; Hurlbert 1984).”
BackgroundAn introduction to Bayesian inference for ecological research and environmental decision-making
Ellison, A. M. (1996) · Ecological Applications · doi:10.2307/2269588 · Cited by 482
“W ithin e x p er im en ts , true random ization is diff i cult, rep lication is o f ten sm all , m is identif ied (Hurlbert 1984) , or by virtue o f c ircu m sta n ce , n on ex is ten t (e .g .”
BackgroundMETA-ANALYSIS OF COD–SHRIMP INTERACTIONS REVEALS TOP-DOWN CONTROL IN OCEANIC FOOD WEBS
Worm, B., & Myers, R. A. (2003) · Ecology · doi:10.1890/0012-9658(2003)084[0162:maocsi]2.0.co;2 · Cited by 482
“This problem is similar to spatial pseudoreplication because it violates the assumption of independence among observations (Hurlbert 1984).”
BackgroundEcology of Mast‐Fruiting in Three Species of North American Deciduous Oaks
Sork, V. L., Bramble, J., & Sexton, O. (1993) · Ecology · doi:10.2307/1939313 · Cited by 488
Top‐Down and Bottom‐Up Control of Stream Periphyton: Effects of Nutrients and Herbivores
Rosemond, A. D., Mulholland, P. J., & Elwood, J. W. (1993) · Ecology · doi:10.2307/1940495 · Cited by 483
The Role of Herbivorous Fishes in the Organization of a Caribbean Reef Community
Lewis, S. M. (1986) · Ecological Monographs · doi:10.2307/2937073 · Cited by 482
Belsky, A. J. (1992) · Journal of Vegetation Science · doi:10.2307/3235679 · Cited by 484
“The effects of grazing, therefore, were calculated using within-block variability as the source of error, and interpretations of the results are inferences external to the statistical analyses (Hurlbert 1984).”
MethodPredation of wildlife by domestic cats Felis catus in Great Britain
WOODS, M., MCDONALD, R. A., & HARRIS, S. (2003) · Mammal Review · doi:10.1046/j.1365-2907.2003.00017.x · Cited by 469
“This was in order to avoid possible pseudoreplication (Hurlbert, 1984) arising from similar conditions being applied to several cats living in one household.”
MethodA hierarchical set of models for species response analysis
Huisman, J., Olff, H., & Fresco, L. F. M. (1993) · Journal of Vegetation Science · doi:10.2307/3235732 · Cited by 473
“To account for the different numbers of plots per field and to exclude pseudoreplication (Hurlbert 1984), the mean % cover per field was used as the dependent variable, and age (years without ferti-”
MethodFemale house finches prefer colourful males: sexual selection for a condition-dependent trait
Hill, G. E. (1990) · Animal Behaviour · doi:10.1016/s0003-3472(05)80537-8 · Cited by 479
The Interaction between Competition and Predation: A Meta‐analysis of Field Experiments
Gurevitch, J., Morrison, J. A., & Hedges, L. V. (2000) · The American Naturalist · doi:10.1086/303337 · Cited by 465
“While the limitations of ecological field experiments are well known (e.g., Hurlbert 1984; Hairston 1989; Scheiner 1993; Huston 1997; Underwood 1997), in most cases they provide the only means by which we can test hypotheses regarding the existence and strength of forces that are proposed by theory…”
BackgroundObservations in ecology: you can’t make progress on processes without understanding the patterns
Underwood, A. J., Chapman, M. G., & Connell, S. D. (2000) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/s0022-0981(00)00181-7 · Cited by 463
“Examples of areas of ecology that routinely depend on observations and so-called mensurative experiments (Hurlbert, 1984) are considered.”
BackgroundInfluential
Metadata
- Authors
- Hurlbert, S. H.
- Corresponding author
- Hurlbert, Stuart H.
- Venue
- Ecological Monographs
- Publisher
- Wiley
- Published
- 1984-06
- Volume
- 54
- Issue
- 2
- Pages
- 187-211
- ISSN
- 0012-9615 (ISSN-L)
- 1557-7015
- OpenAlex
- W2139156166
- Cited by
- 8,377
- References
- 102
- Citations by year
- 2026: 283 · 2025: 212 · 2024: 155 · 2023: 167 · 2022: 164 · 2021: 212 · 2020: 221 · 2019: 233 · 2018: 231 · 2017: 226 · 2016: 266 · 2015: 279 · 2014: 296 · 2013: 280 · 2012: 254
- FWCI
- 120.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ecological Monographs (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- pseudoreplication, experimental design, randomization, type I error, marine benthos, small mammals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.