Pseudoreplication and the Design of Ecological Field Experiments
The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
Pseudoreplication is defined as the use of inferential statistics to test for treatment effects with data from experiments where either treatments are not replicated (though samples may be) or replicates are not statistically independent. In ANOVA terminology, it is the testing for treatment effects with an error term inappropriate to the hypothesis being considered. Scrutiny of 176 experimental studies published between 1960 and the present revealed that pseudoreplication occurred in 27% of them, or 48% of all such studies that applied inferential statistics. The incidence of pseudoreplication is especially high in studies of marine benthos and small mammals. The critical features of controlled experimentation are reviewed. Nondemonic intrusion is defined as the impingement of chance events on an experiment in progress. As a safeguard against both it and preexisting gradients, interspersion of treatments is argued to be an obligatory feature of good design. Especially in small experiments, adequate interspersion can sometimes be assured only by dispensing with strict randomization procedures. Comprehension of this conflict between interspersion and randomization is aided by distinguishing pre—layout (or conventional) and layout—specific alpha (probability of type I error). Suggestions are offered to statisticians and editors of ecological journals as to how ecologists' understanding of experimental design and statistics might be improved.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“The tautological structure of the Kauffman and Cummings model invalidates Ripple et al.'s analysis because applying it violates the scientific principle that conclusions must be supported by evidence that is independent of the data used to generate them (Hurlbert 1984; Nakagawa & Parker 2015).”
From Flawed analysis invalidates claim of a strong Yellowstone trophic cascade after wolf reintroduction: A comment on Ripple et al. (2025) (2025) · cites this paper as Hurlbert 1984
In the citing paper
“A reason for this small number is that many studies incorporated experimental designs that suffered from pseudoreplication [79].”
From Land use change to bioenergy: A meta-analysis of soil carbon and GHG emissions (2015) · cites this paper as [79]
In the citing paper
“Pseudoreplication leads to a biased and incorrect inference, and it should be carefully considered (Hurlbert, 1984).”
From Acoustic indices as proxies for biodiversity: a meta‐analysis (2022) · cites this paper as Hurlbert, 1984
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Principles and procedures of statistics: McGraw-Hill Book Company, Inc. New York Toronto London.
Steel, R., & Torrie, J. H. (1960) · Cited by 4,633
Food Webs: Linkage, Interaction Strength and Community Infrastructure
Paine, R. T. (1980) · The Journal of Animal Ecology · doi:10.2307/4220 · Cited by 1,824
Sampling Design and Statistical Methods for Environmental Biologists
Green, R. H. (1979) · Andalas University Repository (Andalas University) · Cited by 1,550
Biogeochemistry of a forested ecosystem
(2014) · Choice Reviews Online · doi:10.5860/choice.51-6175 · Cited by 1,550
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Paine, R. T. (1974) · Oecologia · doi:10.1007/bf00345739 · Cited by 1,403
Cited by
Items 901–1,000 of 1,029
Quantifying Fitness and Gene Stability in Microorganisms
Lenski, R. E. (1991) · Elsevier eBooks · doi:10.1016/b978-0-409-90199-3.50015-2 · Cited by 112
Plant Community Diversity, Herbivore Movement, and an Insect‐Transmitted Disease of Maize
Power, A. G. (1987) · Ecology · doi:10.2307/1939858 · Cited by 112
Reproductive costs of Chaoborus-induced polymorphism in Daphnia pulex
Havel, J. E., & Dodson, S. I. (1987) · Hydrobiologia · doi:10.1007/bf00008708 · Cited by 112
“Since individuals living together in jars are not independent statistical units (they are segregated in isolation; design B-3 in Hurlbert, 1984 ), individuals were not considered as replicates in the present study.”
BackgroundChodak, M., & Niklińska, M. (2010) · Biology and Fertility of Soils · doi:10.1007/s00374-010-0462-z · Cited by 111
“Experimental design The experimental design used in our study includes pseudoreplication as all the sampling sites were located within one area (Hurlbert 1984).”
MethodAsbeck, T., Pyttel, P., Frey, J., & Bauhus, J. (2018) · Forest Ecology and Management · doi:10.1016/j.foreco.2018.09.043 · Cited by 111
“Since both the predictor and the response variable were aggregated and applied at the plot (or group) level, autocorrelation between trees does not need to be considered in the models (Hurlbert, 1984).”
BackgroundDescamps, S., Boutin, S. A., Berteaux, D., & Gaillard, J. (2008) · Oikos · doi:10.1111/j.0030-1299.2008.16545.x · Cited by 142
“9, Littell et al. 1996) with individual identity included as a random effect to take into account this non-independence in our data set and to avoid pseudo-replication problems (Hurlbert 1984).”
BackgroundViiri, H., Annila, E., Kitunen, V., & Niemelä, P. (2001) · Trees · doi:10.1007/s004680000082 · Cited by 121
“Thus, our experimental design was pseudoreplicated ( Hurlbert 1984 ); this is taken into account in the interpretation of results, where fertilization treatments are compared with the control, not with each other.”
MethodKroodsma, D. E. (1990) · Animal Behaviour · doi:10.1016/s0003-3472(05)80180-0 · Cited by 113
“Hurlbert (1984), for example, discusses general problems of pseudoreplication in which data collected are not statistically appropriate for testing the intended hypothesis.”
BackgroundKiehl, K., Thormann, A., & Pfadenhauer, J. (2006) · Restoration Ecology · doi:10.1111/j.1526-100x.2006.00115.x · Cited by 111
Humle, T., Snowdon, C. T., & Matsuzawa, T. (2009) · Animal Cognition · doi:10.1007/s10071-009-0272-6 · Cited by 122
“In addition , we considered only a single average data point for each mother with multiple oVspring for each age class consid - ered to avoid issues of pseudo - replication ( Hurlbert 1984 ) .”
Lavoie, M., Starr, G., Mack, M. C., Martin, T. A., & Gholz, H. L. (2010) · Natural Areas Journal · doi:10.3375/043.030.0109 · Cited by 112
CARRY-OVER EFFECTS OF WATER AND NUTRIENT SUPPLY ON WATER USE OFPINUS TAEDA
Ewers, B. E., Ram Oren, G., Albaugh, T. J., & Dougherty, P. M. (1999) · Ecological Applications · doi:10.1890/1051-0761(1999)009[0513:coeowa]2.0.co;2 · Cited by 111
“…based on sap flow measurements have used individual plants clustered within a treatment plot as replicates; this, in fact, represents pseudoreplication, much the same as individual plants in a growth chamber or a greenhouse, and may cause erroneous conclusions (Evans et al. 1984, Hurlbert 1984).”
BackgroundPersson, L. (1987) · Oikos · doi:10.2307/3565850 · Cited by 111
Interactions Between the Amphipod Corophium Volutator and Macroalgal Mats on Estuarine Mudflats
Raffaelli, D., Limia, J. M., Hull, S., & Pont, S. (1991) · Journal of the Marine Biological Association of the United Kingdom · doi:10.1017/s0025315400053558 · Cited by 111
“Each of these treatments was replicated four times and allocated to plots in a way that ensured complete spatial dispersion of treatments (Hurlbert, 1984). The experiment ran for eight weeks. Samples were then taken for macrofauna (4 cores, 45-cm(2) cross-sectional area to a depth of 15 cm), silt and organic carbon co…”
BackgroundMethodInfluentialZald, H. S. J., Gray, A. N., North, M., & Kern, R. A. (2008) · Forest Ecology and Management · doi:10.1016/j.foreco.2008.04.022 · Cited by 110
“We believe plots, because they were individually lit, are replicates of burn conditions, rather than pseudoreplicates (sensu Hurlbert, 1984), however, determining what qualifies as an independent sample within a burn perimeter is the subject of ongoing debate (Bataineh et al., 2007).”
BackgroundDoes a top‐predator provide an endangered rodent with refuge from an invasive mesopredator?
Letnic, M., Crowther, M. S., & Koch, F. (2009) · Animal Conservation · doi:10.1111/j.1469-1795.2009.00250.x · Cited by 110
“Thus our treatments were spatially segregated and in a strictly statistical sense our experimental design does not allow inferences concerning the effect of dingoes (Hurlbert, 1984).”
BackgroundSequencing platform and library preparation choices impact viral metagenomes
Solonenko, S. A., Ignacio‐Espinoza, J. C., Alberti, A., Cruaud, C., Hallam, S., Konstantinidis, K., Tyson, G. W., Wincker, P., & Sullivan, M. B. (2013) · BMC Genomics · doi:10.1186/1471-2164-14-320 · Cited by 122
“Discussion Replication is fundamental to rigorous experimental design [25], but it is only now becoming financially possible for metagenomic studies [26,27].”
Replication in field ecology: Identifying challenges and proposing solutions
Filazzola, A., & Cahill, J. F. (2021) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13657 · Cited by 137
“…by recording multiple feeding events within a feeding bout Pseudo- replication Treating experimental units as independent when they are not (sensu Hurlbert, 1984) Applying fertilizer to a large plot and then treating subplots as independent replicates Sample replication Conducting the same…”
BackgroundEffects of pollution on reproductive behaviour of fishes
JONES, J. C., & Reynolds, J. D. (1997) · Reviews in Fish Biology and Fisheries · doi:10.1023/a:1018456315671 · Cited by 113
“First, many of the studies were done before biologists were fully aware of the problems of nonindependence of samples within treatments (‘pseudoreplication’, Hurlbert, 1984 ).”
BackgroundInfluentialPérez‐Ruzafa, Á., Marcos, C., Pérez-Ruzafa, I. M., Barcala, E., Hegazi, M. I., & Quispe-Becerra, J. I. (2007) · Estuarine Coastal and Shelf Science · doi:10.1016/j.ecss.2007.04.030 · Cited by 116
“Furthermore, replicates must be selected at the appropriate scale to avoid ''pseudoreplication'' sensu Hulbert (1984) or ''confounding'' sensu Underwood (1997).”
Pons, P., Lambert, B., Rigolot, É., & Prodon, R. (2003) · Biodiversity and Conservation · doi:10.1023/a:1024191814560 · Cited by 110
“Year was used as an indicator variable to account for the use of two dates for each cover type without committing temporal pseudoreplication (Hurlbert 1984).”
MethodFagan, W. F., & Hurd, L. E. (1994) · Ecology · doi:10.2307/1941607 · Cited by 110
Ehrenfeld, J. G., & Schneider, J. P. (1991) · Journal of Applied Ecology · doi:10.2307/2404562 · Cited by 110
Lipcius, R. N., Stockhausen, W. T., Eggleston, D. B., Marshall, L., & Hickey, B. (1998) · Marine and Freshwater Research · doi:10.1071/mf97194 · Cited by 110
Statistical guide to data analysis of avian monitoring programs
Nur, N., Jones, S. L., & Geupel, G. R. (2013) · Cited by 110
Misinterpretations of results in weed research through inappropriate use of statistics
Cousens, R. D. (1988) · Weed Research · doi:10.1111/j.1365-3180.1988.tb00805.x · Cited by 110
Ierodiaconou, D. A., Schimel, A. C. G., Kennedy, D. M., Monk, J., Gaylard, G., Young, M. A., Diesing, M., & Rattray, A. (2018) · Marine Geophysical Research · doi:10.1007/s11001-017-9338-z · Cited by 120
Poulsen, J. R., Clark, C. J., & Palmer, T. M. (2013) · Biological Conservation · doi:10.1016/j.biocon.2013.03.021 · Cited by 125
A Simple Population Estimate Based on Simulation for Capture-Recapture and Capture-Resight Data
Minta, S. C., & Mangel, M. (1989) · Ecology · doi:10.2307/1938108 · Cited by 109
Triploid Oysters in the Chesapeake Bay: Comparison of Diploid and Triploid Crassostrea virginica
Dégremont, L., Garcia, C., Frank-Lawale, A. S., & Allen, S. K. (2012) · Journal of Shellfish Research · doi:10.2983/035.031.0103 · Cited by 109
Larivière, S., Messier, F., Larivière, S., & Messier, F. (1998) · Oikos · doi:10.2307/3546541 · Cited by 109
Long-term inducible resistance in birch foliage: triggering cues and efficacy on a defoliator
Haukioja, E., Suomela, J., & Neuvonen, S. (1985) · Oecologia · doi:10.1007/bf00378910 · Cited by 109
“some potential pitfalls in their design or analysis (e.g. pseudoreplication; Hurlbert 1984).”
BackgroundThe influence of dominant shrubs, fire, and time since fire on soil seed banks in mixed chaparral
Zammit, C. A., & Zedler, P. H. (1988) · Vegetatio · doi:10.1007/bf00045632 · Cited by 109
“We recognize that ANOVA results do not distinguish between effects due to stands being burned in different fire-years and stands being in different places (Hurlbert 1984).”
ResultMeasures of precision for dissimilarity‐based multivariate analysis of ecological communities
Anderson, M. J., & Santana‐Garcon, J. (2014) · Ecology Letters · doi:10.1111/ele.12385 · Cited by 123
“Researchers designing manipulative experiments or embarking on mensurative sampling designs ( sensu Hurlbert 1984) may well ask the essential question: How many replicate sampling units are needed to get reasonably precise measures of multivariate variability for purposes of testing relevant null…”
A new method for non-parametric multivariate analysis of variance
Anderson, M. J. (2008) · Austral Ecology · doi:10.1111/j.1442-9993.2001.tb00081.x · Cited by 187
Successional changes of Collembola and soil microbiota during forest rotation
Chauvat, M., Zaitsev, A. S., & Wolters, V. (2003) · Oecologia · doi:10.1007/s00442-003-1310-8 · Cited by 108
“(e.g. Hurlbert 1984 ) has lead to ‘unwarranted stigmatization of a reasonable way to test predictions referring to large-scale systems’.”
BackgroundDynamics of carbon, biomass, and structure in two Amazonian forests
Pyle, E. H., Santoni, G. W., Nascimento, H. E. M., Hutyra, L. R., Vieira, S. A., Curran, D. J., van Haren, J. L. M., SALESKA, S. R., Chow, V. Y., Carmago, P. B., et al. (2008) · Journal of Geophysical Research Atmospheres · doi:10.1029/2007jg000592 · Cited by 118
“We used 1ha subplots as the unit of replication because they are larger than canopy gaps and thus avoid underestimating sample variance due to psuedoreplication [Hurlbert, 1984].”
MethodRoles of experimental marine ecology in coastal management and conservation
Castilla, J. C. (2000) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/s0022-0981(00)00177-5 · Cited by 140
“The scheme for management in that example is based on a long-term monitoring program and it appears to contain some of the components of a research program (Underwood, 1990; Hurlbert, 1994; but see Parma and Deriso, 1990).”
BackgroundCushman, J. H., & Addicott, J. F. (1989) · Oecologia · doi:10.1007/bf00384310 · Cited by 108
“Due to methodological constraints, our 1984 and 1986 ant-exclusion experiments involve pseudo-replication (sensu Hurlbert 1984), since all experimental "replicates" were subjected to the same manipulation.”
MethodStatistical guidelines forApis melliferaresearch
Pirk, C. W. W., de Miranda, J. R., Kramer, M., Murray, T. E., Nazzi, F., Dave Shutler, A., van der Steen, J. J. M., & van Dooremalen, C. (2013) · Journal of Apicultural Research · doi:10.3896/ibra.1.52.4.13 · Cited by 131
Ogoma, S. B., Ngonyani, H., Simfukwe, E. T., Mseka, A., Moore, J., & Killeen, G. F. (2012) · Parasites & Vectors · doi:10.1186/1756-3305-5-54 · Cited by 107
“However, these observations relate to a single, un-replicated prototype specimen of this particular device [21] so more intensive, well replicated studies in both semi-field systems and full field settings will be required in order to establish these results and characterize the properties of such devices.”
BackgroundThe Temporal Scale of Variance in Limnetic Primary Production
Carpenter, S. R., & Kitchell, J. F. (1987) · The American Naturalist · doi:10.1086/284646 · Cited by 108
Gilliam, F. S., Yurish, B. M., & Adams, M. B. (2001) · Canadian Journal of Forest Research · doi:10.1139/cjfr-31-10-1768 · Cited by 108
“Data analyses The statistical design of this study is an example of simple pseudoreplication, a common problem among watershed ecosystem studies, with each watershed representing an experimental condition with a sample size of one (Hurlbert 1984); thus, our data should be interpreted with that in mind.”
MethodA QUANTITATIVE‐GENETIC ANALYSIS OF LARVAL LIFE‐HISTORY TRAITS IN HYLA CRUCIFER
Travis, J., Emerson, S. B., & Blouin, M. S. (1987) · Evolution · doi:10.1111/j.1558-5646.1987.tb05777.x · Cited by 117
Polla, V. N. L., & Barrett, G. W. (1993) · Landscape Ecology · doi:10.1007/bf00129865 · Cited by 108
“1; Hurlbert 1984).”
MethodPeterman, W. E., CRAWFORD, J. A., & Semlitsch, R. D. (2007) · Freshwater Biology · doi:10.1111/j.1365-2427.2007.01900.x · Cited by 121
“Only original capture data were used in these analyses to avoid pseudoreplication ( Hurlbert, 1984 ) to prevent possible bias associated with some individuals being caught repeatedly.”
MethodBeyond Weber's Law: A Second Look at Ranking Visualizations of Correlation
Kay, M., & Heer, J. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467671 · Cited by 122
Michereff, M. F. F., Laumann, R. A., Borges, M., Michereff‐Filho, M., Diniz, I. R., Neto, A. L. F., & Blassioli‐Moraes, M. C. (2011) · Journal of Chemical Ecology · doi:10.1007/s10886-011-9917-4 · Cited by 107
“Since the volatile sampling was carried out on the same plant at several time points, repeated measures analysis of variance was used to avoid the problem of pseudoreplication during the times analyzed (Hurlbert, 1984; Green, 1993).”
MethodWynberg, R., & Branch, G. M. (1994) · Journal of Marine Research · doi:10.1357/0022240943077019 · Cited by 109
“Methodological inadequacies related to pseudoreplication (Hurlbert, 1984; Stewart-Oaten and Murdoch, 1986) are contained within this experimental design.”
Sampling and Statistical Methods for Behavioral Ecologists
Bart, J. R., Fligner, M. A., & Notz, W. I. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511612572 · Cited by 107
Goebel, P. C., & Hix, D. M. (1996) · Forest Ecology and Management · doi:10.1016/0378-1127(96)03772-3 · Cited by 109
Air pollution and forest health: toward new monitoring concepts
Percy, K. E., & Ferretti, M. P. (2004) · Environmental Pollution · doi:10.1016/j.envpol.2003.10.034 · Cited by 107
Hendrickson, J., & Briske, D. D. (1997) · Oecologia · doi:10.1007/s004420050199 · Cited by 107
“Lack of replication prevented a statistical comparison between communities with contrasting grazing histories (Hurlbert 1984).”
BackgroundArnett, E. B., Hein, C. D., Schirmacher, M. R., Huso, M., & Szewczak, J. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065794 · Cited by 131
“…bat fatality per turbine at control and treatment turbines, during the treatment phase and the period immediately preceding it (pre-treatment phase) was analyzed using a BACI approach [26,30,31], employing ANOVA repeated measures with the turbine as the experimental unit, repeatedly measured twice.”
MethodMorgan, J. W. (1997) · Journal of Applied Ecology · doi:10.2307/2404907 · Cited by 107
Lajtha, K. (1987) · Biogeochemistry · doi:10.1007/bf02187370 · Cited by 107
“In order to avoid problems of temporal pseudoreplication through the repeated measurement of the same individuals over time ( Hurlbert 1984 ), the GLM procedure was modified to perform a profile analysis of variance (Simms & Burdick, in press) for comparing nutrient concentrations and nutrient reabsorption over time.”
MethodPredation and Moose Population Dynamics: A Critique
Boutin, S. (1992) · The Journal of Wildlife Management · doi:10.2307/3808799 · Cited by 108
Heneghan, L., Coleman, D. C., Zou, X., Crossley, D. A., & Haines, B. L. (1998) · Applied Soil Ecology · doi:10.1016/s0929-1393(98)00050-x · Cited by 106
Some problems and practicalities in design and interpretation of samples of microplastic waste
Underwood, A. J., Chapman, M. G., & Browne, M. A. (2017) · Analytical Methods · doi:10.1039/c6ay02641a · Cited by 106
Metabolic cost of calcification in bivalve larvae under experimental ocean acidification
Frieder, C. A., Applebaum, S. L., Pan, T.-C., Hedgecock, D., & Manahan, D. T. (2016) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsw213 · Cited by 119
“This is a common design for measurements of small animals in culture vessels (Hurlbert, 1984; Cornwall and Hurd, 2016).”
BackgroundBiggs, R., Biggs, H. C., Dunne, T. T., Govender, N., & Potgieter, A. L. F. (2003) · Koedoe · doi:10.4102/koedoe.v46i1.35 · Cited by 108
“A very common mistake in ecological field experiments (Hurlbert 1984; Crawley 1993).”
BackgroundHUNT, M. G., Rasmussen, S., Newton, P. C. D., PARSONS, A. J., & NEWMAN, J. A. (2005) · Plant Cell & Environment · doi:10.1111/j.1365-3040.2005.01367.x · Cited by 108
HIERARCHICAL ANALYSIS OF SPECIES DISTRIBUTIONS AND ABUNDANCE ACROSS ENVIRONMENTAL GRADIENTS
Diez, J. M., & Pulliam, H. R. (2007) · Ecology · doi:10.1890/07-0047.1 · Cited by 109
“Photo credits: Robert Warren (Goodyera) and Scott Eustis (Tipularia). related problem of pseudoreplication (Hurlbert 1984), or must lose information by averaging over lower levels.”
BackgroundThe Effects of Seaweed Secondary Metabolites on Biofouling
da Gama, B. A. P., Pereira, R. C., Carvalho, A. G. V., Coutinho, R., & Yoneshigue‐Valentin, Y. (2002) · Biofouling · doi:10.1080/08927010290017680 · Cited by 106
Increased Juvenile Salmonid Growth by Whole-River Fertilization
Johnston, N. T., Perrin, C. J., Slaney, P. A., & Ward, B. R. (1990) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/f90-099 · Cited by 106
Habitat Shifts by Mule Deer: The Influence of Cattle Grazing
Loft, E. R., Menke, J. W., & Kie, J. G. (1991) · Journal of Wildlife Management · doi:10.2307/3809236 · Cited by 106
Gillespie, R. G. (1993) · Trends in Ecology & Evolution · doi:10.1016/0169-5347(93)90231-d · Cited by 106
Frampton, G. K., Whaley, P., Bennett, M. G., Bilotta, G. S., Dorne, J. L. C. M., Eales, J. F., James, K. L., Kohl, C., Land, M., Livoreil, B., et al. (2022) · Environmental Evidence · doi:10.1186/s13750-022-00264-0 · Cited by 122
“miscalculation of sample sizes, means, or variances, including pseudoreplication [67]); (iii) errors in applied inferential statistics (including flawed null hypothesis testing, estimation, or coding); (iv) use of inappropriate statistical tests or violation of assumptions required by tests (e.”
Vadas, R. L., Hughes, R. M., Bae, Y. J., Baek, M. J., Gonzáles, O. C. B., Callisto, M., de Carvalho, D. R., Chen, K., Ferreira, M. T., Fierro, P., et al. (2022) · Water Biology and Security · doi:10.1016/j.watbs.2022.100054 · Cited by 107
“Similarly, metrics that are based on neighboring sites on the same stream or in the same lake suffer from autocorrelation or pseudoreplication (Griffith, 1987; Hurlbert, 1984; Hurlbert and Lombardi, 2015; Vadas, 1998; Whittier et al., 2002).”
BackgroundTime-matched grooming in female primates? New analyses from two species
Manson, J. H., Navarrete, C. D., Silk, J. B., & Perry, S. (2004) · Animal Behaviour · doi:10.1016/j.anbehav.2003.05.009 · Cited by 108
“Barrett et al. (1999) sought to solve the problem presented by the contribution by each dyad of multiple grooming bouts to the data set (‘pseudoreplication’, Hurlbert 1984; the ‘pooling fallacy’, Machlis et al. 1985) by randomly choosing one reciprocated grooming bout in each direction for each femaleefemale dyad, and…”
BackgroundMarten Populations in Uncut and Logged Boreal Forests in Ontario
Thompson, I. D. (1994) · Journal of Wildlife Management · doi:10.2307/3809391 · Cited by 105
Effects of predator removal on vertebrate prey populations: birds of prey and small mammals
Norrdahl, K., & Korpim�ki, E. (1995) · Oecologia · doi:10.1007/bf00329086 · Cited by 105
Vondracek, B., Wurtsbaugh, W. A., & Cech, J. J. (1988) · Environmental Biology of Fishes · doi:10.1007/bf02984442 · Cited by 105
“We realize the potential problem with the interpretation of our results ( Hurlbert 1984 ).”
ResultClements, G. R., Ng, P. K. L., Lu, X., Ambu, S. P., Schilthuizen, M., & Bradshaw, C. J. A. (2008) · Biological Conservation · doi:10.1016/j.biocon.2008.08.011 · Cited by 119
“Due to the patchy distribution of land snails and small plot sizes, systematic sampling was adopted for higher spatial interspersion ( Hurlbert 1984; Cameron and Pokryszko, 2005).”
MethodGilliam, F. S. (2002) · Forest Ecology and Management · doi:10.1016/s0378-1127(01)00545-x · Cited by 107
Root growth and carbohydrate responses in bearing citrus trees following partial canopy removal
Eissenstat, D. M., & Duncan, L. W. (1992) · Tree Physiology · doi:10.1093/treephys/10.3.245 · Cited by 105
Wilson, W. H. (1989) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(89)90129-9 · Cited by 105
Comparisons between experimentally- and atmospherically-acidified lakes during stress and recovery
Schindler, D. W., Frost, T. M., Mills, K. H., Chang, P. S. S., Davies, I. J., Findlay, L., Malley, D. F., Shearer, J. A., Turner, M. A., Garrison, P. J., et al. (1990) · Proceedings of the Royal Society of Edinburgh Section B Biological Sciences · doi:10.1017/s0269727000005352 · Cited by 105
Pseudoreplication in Tropical Forests and the Resulting Effects on Biodiversity Conservation
RAMAGE, B. S., SHEIL, D., SALIM, H. M. W., FLETCHER, C., MUSTAFA, N. A., LURUTHUSAMAY, J. C., HARRISON, R. D., BUTOD, E., DZULKIPLY, A. D., KASSIM, A. R., et al. (2013) · Conservation Biology · doi:10.1111/cobi.12004 · Cited by 107
“Simple pseudoreplication occurs when multiple samples from a single contiguous treatment unit are analyzed as if they were independent replicates and the results are then used to infer treatment effects (Hurlbert 1984).”
BackgroundActive dispersal of oribatid mites into young soils
Lehmitz, R., Russell, D. J., Hohberg, K., Christian, A., & Xylander, W. E. R. (2012) · Applied Soil Ecology · doi:10.1016/j.apsoil.2011.12.003 · Cited by 104
“Although this design seems to be pseudoreplicated since all bare plots were situated on one location only (Hurlbert, 1984), the experiment is conducted in a spatial scale relevant for the prediction to be tested (Oksanen, 2001).”
BackgroundFernandes, P. M., Luz, A. L., & Loureiro, C. (2010) · Forest Ecology and Management · doi:10.1016/j.foreco.2010.06.008 · Cited by 124
Goetsch, C., Wigg, J., Royo, A. A., Ristau, T., & Carson, W. P. (2011) · The Journal of the Torrey Botanical Society · doi:10.3159/torrey-d-11-00013.1 · Cited by 108
“Because the exclosure was not replicated our analyses were necessarily based on the 29, 1 m2 plots within each site (pseudoreplicates sensu Hurlbert 1984), thus our results need to be interpreted in light of this caveat.”
ResultPrendergast‐Miller, M. T., de Menezes, A. B., Macdonald, L. M., Toscas, P., Bissett, A. B., Baker, G. H., Farrell, M., Richardson, A. E., Wark, T., & Thrall, P. H. (2017) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2017.01.027 · Cited by 112
“There is a lot of debate on how to deal with pseudoreplication (e.g. Davies 281 and Gray, 2015; Hurlbert, 1984; Millar and Anderson, 2004) which we account for below in the 282 analyses.”
BackgroundForest-to-agriculture conversion in Amazon drives soil microbial communities and N-cycle
Merloti, L. F., Mendes, L. W., Pedrinho, A., de Souza, L. F., Ferrari, B. M., & Tsai, S. M. (2019) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2019.107567 · Cited by 113
Permeability of Roads to Movement of Scrubland Lizards and Small Mammals
Brehme, C. S., Tracey, J. A., McClenaghan, L. R., & Fisher, R. N. (2013) · Conservation Biology · doi:10.1111/cobi.12081 · Cited by 104
“We tracked the movement of most individuals only one time to avoid problems with pseudoreplication (Hurlbert 1984).”
BackgroundWaldrop, T. A., & Brose, P. H. (1999) · Forest Ecology and Management · doi:10.1016/s0378-1127(98)00422-8 · Cited by 104
“Results of ANOVA tests are provided as descriptive statistics (Hurlbert, 1984) for this single prescribed fire.”
MethodDebenay, J.-P., Guiral, D., & Parra, M. (2002) · Estuarine Coastal and Shelf Science · doi:10.1006/ecss.2001.0906 · Cited by 104
Bisoniana 105. Food eaten by the free-living European bison in Białowieża Forest
Gębczyńska, Z., Gębczyński, M., & Martynowicz, E. (1991) · ACTA THERIOLOGICA · doi:10.4098/at.arch.91-32 · Cited by 104
Accounting for Multilevel Data Structures in Fisheries Data using Mixed Models
Wagner, T., Hayes, D. B., & Bremigan, M. T. (2006) · Fisheries · doi:10.1577/1548-8446(2006)31[180:afmdsi]2.0.co;2 · Cited by 104
Villanueva, R., Nozais, C., & von Boletzky, S. (1997) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/s0022-0981(96)02670-6 · Cited by 104
Hill, M. S. (1996) · Marine Biology · doi:10.1007/bf00349246 · Cited by 104
“To avoid pseudoreplication ( Hurlbert 1984 ), an average boring rate standardized to both initial and final area of contact was calculated for samples within each experimental unit.”
BackgroundMethodInfluentialThe role of epibenthic crustacean predators in an estuarine food web
Raffaelli, D., Conacher, A., McLachlan, H., & Emes, C. (1989) · Estuarine Coastal and Shelf Science · doi:10.1016/0272-7714(89)90062-0 · Cited by 106
Scoles, R., & Gribel, R. (2011) · Human Ecology · doi:10.1007/s10745-011-9412-0 · Cited by 103
“As a consequence, the 25 plots in Trombetas and the 10 plots at Capanã Grande cannot be considered as independent replications used in classical experimentation; they must instead be technically classified as ‘spatial pseudo-replications’ (Hurlbert 1984).”
BackgroundDirect seeding of mass-cultured coral larvae is not an effective option for reef rehabilitation
Edwards, A. J., Guest, J. R., Heyward, A. J., Villanueva, R., Baria, M. V., Bollozos, I., & Golbuu, Y. (2014) · Marine Ecology Progress Series · doi:10.3354/meps11171 · Cited by 103
Münzbergová, Z., Hadincová, V., Skálová, H., & Vandvik, V. (2017) · Journal of Ecology · doi:10.1111/1365-2745.12762 · Cited by 123
“The conclusions of Hurlbert (1984) on pseudoreplication in growth chamber experiments have, however, been extensively criticized (e.g. Oksanen 2001; Johnson et al. 2016).”
BackgroundThe scientific principles underlying the monitoring of the environmental impacts of aquaculture
Fernandes, Eleftheriou, Ackefors, Eleftheriou, Ervik, Sanchez-Mata, Scanlon, White, Cochrane, Pearson, et al. (2001) · Journal of Applied Ichthyology · doi:10.1046/j.1439-0426.2001.00315.x · Cited by 103
“In addition, considerations of pseudoreplication need to be taken into account; that is, samples used in statistical testing must consist of truly replicated data (for details see Hurlbert 1984; Zar 1996; Karakassis et al. 1998).”
BackgroundVerdonschot, P. F. M., & ter Braak, C. J. F. (1994) · Hydrobiologia · doi:10.1007/bf00142333 · Cited by 103
“This was criticized by Hurlbert (1984) as pseudoreplication.”
BackgroundFamily values: costs and benefits of communal nesting in the moorhen
McRae, S. B. (1996) · Animal Behaviour · doi:10.1006/anbe.1996.0169 · Cited by 103
“To avoid pseudoreplication (Hurlbert 1984), I used the means for each group per nest attempt in a given year for each of the parameters.”
MethodCzerny, A. B., & Dunton, K. H. (1995) · Estuaries · doi:10.2307/1352324 · Cited by 103
Sherry, T. W., & Holmes, R. T. (1988) · The Auk · doi:10.2307/4087501 · Cited by 103
Metadata
- Authors
- Hurlbert, S. H.
- Corresponding author
- Hurlbert, Stuart H.
- Venue
- Ecological Monographs
- Publisher
- Wiley
- Published
- 1984-06
- Volume
- 54
- Issue
- 2
- Pages
- 187-211
- ISSN
- 0012-9615 (ISSN-L)
- 1557-7015
- OpenAlex
- W2139156166
- Cited by
- 8,377
- References
- 102
- Citations by year
- 2026: 283 · 2025: 212 · 2024: 155 · 2023: 167 · 2022: 164 · 2021: 212 · 2020: 221 · 2019: 233 · 2018: 231 · 2017: 226 · 2016: 266 · 2015: 279 · 2014: 296 · 2013: 280 · 2012: 254
- FWCI
- 120.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ecological Monographs (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- pseudoreplication, experimental design, randomization, type I error, marine benthos, small mammals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.