Pseudoreplication and the Design of Ecological Field Experiments
The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
Pseudoreplication is defined as the use of inferential statistics to test for treatment effects with data from experiments where either treatments are not replicated (though samples may be) or replicates are not statistically independent. In ANOVA terminology, it is the testing for treatment effects with an error term inappropriate to the hypothesis being considered. Scrutiny of 176 experimental studies published between 1960 and the present revealed that pseudoreplication occurred in 27% of them, or 48% of all such studies that applied inferential statistics. The incidence of pseudoreplication is especially high in studies of marine benthos and small mammals. The critical features of controlled experimentation are reviewed. Nondemonic intrusion is defined as the impingement of chance events on an experiment in progress. As a safeguard against both it and preexisting gradients, interspersion of treatments is argued to be an obligatory feature of good design. Especially in small experiments, adequate interspersion can sometimes be assured only by dispensing with strict randomization procedures. Comprehension of this conflict between interspersion and randomization is aided by distinguishing pre—layout (or conventional) and layout—specific alpha (probability of type I error). Suggestions are offered to statisticians and editors of ecological journals as to how ecologists' understanding of experimental design and statistics might be improved.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“The tautological structure of the Kauffman and Cummings model invalidates Ripple et al.'s analysis because applying it violates the scientific principle that conclusions must be supported by evidence that is independent of the data used to generate them (Hurlbert 1984; Nakagawa & Parker 2015).”
From Flawed analysis invalidates claim of a strong Yellowstone trophic cascade after wolf reintroduction: A comment on Ripple et al. (2025) (2025) · cites this paper as Hurlbert 1984
In the citing paper
“A reason for this small number is that many studies incorporated experimental designs that suffered from pseudoreplication [79].”
From Land use change to bioenergy: A meta-analysis of soil carbon and GHG emissions (2015) · cites this paper as [79]
In the citing paper
“Pseudoreplication leads to a biased and incorrect inference, and it should be carefully considered (Hurlbert, 1984).”
From Acoustic indices as proxies for biodiversity: a meta‐analysis (2022) · cites this paper as Hurlbert, 1984
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Principles and procedures of statistics: McGraw-Hill Book Company, Inc. New York Toronto London.
Steel, R., & Torrie, J. H. (1960) · Cited by 4,633
Food Webs: Linkage, Interaction Strength and Community Infrastructure
Paine, R. T. (1980) · The Journal of Animal Ecology · doi:10.2307/4220 · Cited by 1,824
Sampling Design and Statistical Methods for Environmental Biologists
Green, R. H. (1979) · Andalas University Repository (Andalas University) · Cited by 1,550
Biogeochemistry of a forested ecosystem
(2014) · Choice Reviews Online · doi:10.5860/choice.51-6175 · Cited by 1,550
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Paine, R. T. (1974) · Oecologia · doi:10.1007/bf00345739 · Cited by 1,403
Cited by
Items 601–700 of 1,029
Gleason, D. F. (1993) · Limnology and Oceanography · doi:10.4319/lo.1993.38.7.1452 · Cited by 149
Underwater methods for study of salmonids in the Intermountain West
Thurow, R. F. (1994) · doi:10.2737/int-gtr-307 · Cited by 148
“The reader is urged to review texts on the subject and papers by Hurlbert (1984), McAllister and Peterman (1992), and Romesburg (1981).”
BackgroundINTERFERENCE COMPETITION BETWEEN INTRODUCED BLACK RATS AND ENDEMIC GALÁPAGOS RICE RATS
Harris, D. B., & Macdonald, D. W. (2007) · Ecology · doi:10.1890/06-1701.1 · Cited by 148
Gannon, D. P., Barros, N. B., Nowacek, D. P., Read, A. J., Waples, D. M., & Wells, R. S. (2005) · Animal Behaviour · doi:10.1016/j.anbehav.2004.06.020 · Cited by 147
“To avoid pseudoreplication (Hurlbert 1984; Kroodsma et al. 2001), each individual dolphin in the experiment was exposed to just a single exemplar of each stimulus class.”
Fausch, K. D. (1998) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-55-s1-218 · Cited by 162
Assessing Why Two Introduced Conyza Differ in Their Ability to Invade Mediterranean Old Fields
Thébaud, C., Finzi, A. C., Affre, L., Debussche, M., & Escarré, J. (1996) · Ecology · doi:10.2307/2265502 · Cited by 147
Hanson, P. J., Todd, D. E., & Amthor, J. S. (2001) · Tree Physiology · doi:10.1093/treephys/21.6.345 · Cited by 147
“Nevertheless, dealing with the issue of pseudoreplication in our sampling design is critical (Hurlbert 1984).”
BackgroundECOSYSTEM-SCALE IMPACTS OF DEFORESTATION AND LAND USE IN A HUMID TROPICAL REGION OF MEXICO
Hughes, R. F., Kauffman, J. B., & Jaramillo, V. J. (2000) · Ecological Applications · doi:10.1890/1051-0761(2000)010[0515:esioda]2.0.co;2 · Cited by 163
Predation by ground beetles and wolf spiders on herbivorous insects in a maize crop
Lang, A., Filser, J., & Henschel, J. R. (1999) · Agriculture Ecosystems & Environment · doi:10.1016/s0167-8809(98)00186-8 · Cited by 153
SEX-RATIO ADJUSTMENT WHEN RELATIVES INTERACT: A TEST OF CONSTRAINTS ON ADAPTATION
West, S. A., Shuker, D. M., & Sheldon, B. C. (2005) · Evolution · doi:10.1111/j.0014-3820.2005.tb01772.x · Cited by 149
“Kuno, E. 1962.”
BackgroundInfluentialAlpine Seedling Establishment: The Influence of Disturbance Type
Chambers, J. C., MacMahon, J. A., & Brown, R. W. (1990) · Ecology · doi:10.2307/1938270 · Cited by 147
Statistics For Correlated Data: Phylogenies, Space, And Time
Ives, A. R., & Zhu, J. (2006) · Ecological Applications · doi:10.1890/04-0702 · Cited by 147
“3 E-mail: arives@wisc.edu 1984).”
SPIVAK, A. C., VANNI, M. J., & METTE, E. M. (2011) · Freshwater Biology · doi:10.1111/j.1365-2427.2010.02495.x · Cited by 144
“While experiments conducted at the ecosystem scale may be most realistic (Carpenter et al., 1995; Pace et al., 2004), such experiments suffer from limitations including low replication and reduced experimental control (Hurlbert, 1984; Drenner & Mazumder, 1999).”
BackgroundPseudoreplication is a pseudoproblem.
Schank, J. C., & Koehnle, T. J. (2009) · Journal of Comparative Psychology · doi:10.1037/a0013579 · Cited by 148
“The third, more reactionary method employed to deal with this problem involves specification of rigorous criteria for the wholesale acceptance or rejection of a multitude of seemingly benign experimental designs (e.g., Cronbach, 1976; Hurlbert, 1984).”
BackgroundMethodInfluentialLouzao, M., Hyrenbach, K. D., Arcos, J. M., Abelló, P., de Sola, L. G., & Oró, D. (2006) · Ecological Applications · doi:10.1890/1051-0761(2006)016[1683:ohoaem]2.0.co;2 · Cited by 180
Tsuji, Y., Hanya, G., & Grueter, C. C. (2013) · Primates · doi:10.1007/s10329-013-0359-1 · Cited by 152
“If data were obtained from the same site but reported in different years or by different researchers, we calculated the average value for the site to avoid pseudoreplication (Hurlbert 1984).”
BackgroundDoes Aversive Conditioning Reduce Human—Black Bear Conflict?
Mazur, R. (2009) · Journal of Wildlife Management · doi:10.2193/2008-163 · Cited by 146
“To minimize pseudo-replication (Hurlbert 1984), and to avoid potential effects of bears habituating (i.e., muting their response) to treatments, we included only the first trial of each treatment on each known bear.”
BackgroundRecovery of deep Posidonia oceanica meadows degraded by trawling
Correa, J. M. G., Bayle-Sempere, J. T., Sánchez‐Lizaso, J. L., Valle, C., Sánchez‐Jerez, P., & Ruiz, J. M. (2005) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/j.jembe.2004.12.032 · Cited by 177
Lichtenstein, G., & Sealy, S. G. (1998) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1998.0289 · Cited by 146
“(e) Statistical methods To avoid pseudoreplication (Hurlbert 1984), we analysed only mean values for each index of begging intensity from each chick, so that each nest contributed one data point per chick to the analysis.”
Andreassen, H. P., & Ims, R. A. (2001) · Ecology · doi:10.1890/0012-9658(2001)082[2911:dipvpr]2.0.co;2 · Cited by 169
Greenwood, J. L., Rosemond, A. D., Wallace, J. B., Cross, W. F., & Weyers, H. S. (2006) · Oecologia · doi:10.1007/s00442-006-0609-7 · Cited by 167
“Statistical analyses Since only one reference and one experimental stream were used, this experiment was not strictly replicated, violating assumptions of inferential statistics (Hurlbert 1984).”
MethodResource Limitation in a Stream Community: Phosphorus Enrichment Effects on Periphyton and Grazers
Hart, D. D., & Robinson, C. T. (1990) · Ecology · doi:10.2307/1938286 · Cited by 147
Proximate Limits to Seed Production in a Herbaceous Perennial Legume, Lathyrus Vernus
Ehrlén, J. (1992) · Ecology · doi:10.2307/1940033 · Cited by 146
A REAPPRAISAL OF BATEMAN'S CLASSIC STUDY OF INTRASEXUAL SELECTION
Snyder, B. F., & Gowaty, P. A. (2007) · Evolution · doi:10.1111/j.1558-5646.2007.00212.x · Cited by 145
Mas, A. H., & Dietsch, T. V. (2004) · Ecological Applications · doi:10.1890/02-5225 · Cited by 176
“While pseudoreplication is an important consideration in field studies (Hurlbert 1984), particularly in human-managed landscapes, valuable insights can still be gained from small studies when combined with additional work (Oksanen 2001).”
BackgroundThe Potential for Intracoastal Transfer of Non-indigenous Species in the Ballast Water of Ships
Lavoie, D., Smith, L. D., & Ruiz, G. M. (1999) · Estuarine Coastal and Shelf Science · doi:10.1006/ecss.1999.0467 · Cited by 175
Biomass and Nitrogen Responses to Grazing of Upland Steppe on Yellowstone's Northern Winter Range
Coughenour, M. B. (1991) · The Journal of Applied Ecology · doi:10.2307/2404114 · Cited by 146
Trade-offs in foraging success and predation risk with spatial position in colonial spiders
Rayor, L. S., & Uetz, G. W. (1990) · Behavioral Ecology and Sociobiology · doi:10.1007/bf00168449 · Cited by 144
“cation (Hurlbert 1984), which violates the randomness and independence assumptions of ANOVA.”
BackgroundBaldocchi, D., Ma, S., Rambal, S., Misson, L., Ourcival, J., Limousin, J., Pereira, J. S., & Papale, D. (2009) · Ecological Applications · doi:10.1890/08-2047.1 · Cited by 146
“Pseudo-replication can be avoided: ‘‘. . . replicate samples or measurements are dispersed in space (or time) in a manner appropriate to the specific hypothesis being tested is the most critical aspect of the design of a mensuration experiment’’ (Hurlbert 1984:189–190).”
BackgroundFood supply controls the body condition of a migrant bird wintering in the tropics
Brown, D. R., & Sherry, T. W. (2006) · Oecologia · doi:10.1007/s00442-006-0418-z · Cited by 144
Ball, J. P., Danell, K., & Sunesson, P. (2000) · Journal of Applied Ecology · doi:10.1046/j.1365-2664.2000.00487.x · Cited by 145
Review of negative effects of introduced rodents on small mammals on islands
Harris, D. B. (2008) · Biological Invasions · doi:10.1007/s10530-008-9393-0 · Cited by 157
“Removal Experiment— using a balanced, ‘‘randomized block’’ design ( Hurlbert 1984 ).”
Granadeiro, J. P., Nunes, M., SILVA, M. C. D. L. D., & Furness, R. W. (1998) · Animal Behaviour · doi:10.1006/anbe.1998.0827 · Cited by 144
Effects of Flooding and Drought on the Anatomy of Paspalum dilatatum
Vasellati, V. (2001) · Annals of Botany · doi:10.1006/anbo.2001.1469 · Cited by 144
“Many of these responses seem to be mediated by the accumulation of ethylene under hypoxia (Jackson and Drew, 1984; Blom and Voesenek, 1996; Drew, 1997).”
BackgroundPower analysis and practical strategies for environmental monitoring
Green, R. H. (1989) · Environmental Research · doi:10.1016/s0013-9351(89)80058-1 · Cited by 146
Benedetti‐Cecchi, L. (2000) · Ecological Monographs · doi:10.1890/0012-9615(2000)070[0045:pdaiid]2.0.co;2 · Cited by 149
SPACE-USE RESPONSES TO HABITAT FRAGMENTATION AND CONNECTIVITY IN THE ROOT VOLEMICROTUS OECONOMUS
Andreassen, H. P., Hertzberg, K., & Ims, R. A. (1998) · Ecology · doi:10.1890/0012-9658(1998)079[1223:surthf]2.0.co;2 · Cited by 143
Knoll, L. B., Vanni, M. J., & Renwick, W. H. (2003) · Limnology and Oceanography · doi:10.4319/lo.2003.48.2.0608 · Cited by 146
Pelagic–benthic coupling in the western Barents Sea: Processes and time scales
Renaud, P. E., Morata, N., Carroll, M. L., Denisenko, S. G., & Reigstad, M. (2008) · Deep Sea Research Part II Topical Studies in Oceanography · doi:10.1016/j.dsr2.2008.05.017 · Cited by 142
“While subcoring may be viewed as pseudoreplication (Hurlburt, 1984), our analyses indicated that variance in respiration rates and chemical composition among subcores from the same box core deployment was not significantly different from the variance among cores from different deployments at the…”
BackgroundCrabtree, R. L., Potter, C. S., Mullen, R., SHELDON, J. W., Huang, S., Harmsen, J., Rodman, A. W., & Jean, C. (2009) · Remote Sensing of Environment · doi:10.1016/j.rse.2008.12.014 · Cited by 142
Patterns of elephant damage to vegetation in northern Botswana
Ben-Shahar, R. (1993) · Biological Conservation · doi:10.1016/0006-3207(93)90057-8 · Cited by 142
Chu, H., & Grogan, P. (2009) · Plant and Soil · doi:10.1007/s11104-009-0167-y · Cited by 147
“…collected from four well separated patches across the landscape (300–3,000 m apart) for each vegetation-type and some of these patches were from different toposequences (or valleys), thereby avoiding pseudo-replication (Hurlbert 1984) and making our conclusions more robust at the landscape scale.”
BackgroundReichardt, P. B., Chapin, F. S., Bryant, J. P., Mattes, B. R., & Clausen, T. P. (1991) · Oecologia · doi:10.1007/bf00317585 · Cited by 142
“Thus, our experimental design was pseudoreplicated (Hurlbert 1984).”
MethodSoundscape orientation: a new field in need of sound investigation
Slabbekoorn, H., & Bouton, N. (2008) · Animal Behaviour · doi:10.1016/j.anbehav.2008.06.010 · Cited by 141
McCracken, G. F., Gillam, E. H., Westbrook, J. K., Lee, Y., Jensen, M. L., & Balsley, B. B. (2007) · Integrative and Comparative Biology · doi:10.1093/icb/icn033 · Cited by 141
“Pseudoreplication is often an issue in biological research ( Hurlbert 1984 ).”
BackgroundField Measurements for Forest Carbon Monitoring
Hoover, C. M. (2008) · Springer eBooks · doi:10.1007/978-1-4020-8506-2 · Cited by 145
Thompson, I. D., Davidson, I. J., O'Donnell, S., & Brazeau, F. (1989) · Canadian Journal of Zoology · doi:10.1139/z89-258 · Cited by 141
Chlorophyll Variability, Nutrient Input, and Grazing: Evidence from Whole‐ Lake Experiments
Carpenter, S. R., Kitchell, J. F., Cottingham, K. L., Schindler, D. E., Christense, D. L., Post, D. M., & Voichick, N. (1996) · Ecology · doi:10.2307/2265497 · Cited by 144
Menge, B. A., Lubchenco, J., Ashkenas, L. R., & Ramsey, F. L. (1986) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(86)90164-4 · Cited by 143
An experimental test of the ideal despotic distribution
Calsbeek, R. G., & Sinervo, B. (2002) · Journal of Animal Ecology · doi:10.1046/j.1365-2656.2002.00619.x · Cited by 141
“We avoid the problem of pseudoreplication (Hurlbert 1984) by estimating changes in territory size on replicate plots between dyads of males where social and biotic agents of selection are manipulated.”
MethodRatcliffe, J. M., & Dawson, J. W. (2003) · Animal Behaviour · doi:10.1006/anbe.2003.2297 · Cited by 147
“We analysed one sequence per bat per situation to avoid pseudoreplication (Hurlbert 1984).”
Land use change effects on ecosystem carbon balance: From agricultural to hybrid poplar plantation
Arevalo, C. B. M., Bhatti, J. S., Chang, S. X., & Sidders, D. (2011) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2011.03.013 · Cited by 140
Autret, B., Mary, B., Chenu, C., Balabane, M., Girardin, C., Bertrand, M., Grandeau, G., & Beaudoin, N. (2016) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2016.07.008 · Cited by 165
“This choice resulted from the weakness of the experimental design, which forces us to be conservative with our results as explained by Hurlbert (1984).”
ResultEffects of disturbance patterns and deadwood on the microclimate in European beech forests
Thom, D., Sommerfeld, A., Sebald, J., Hagge, J., Müller, J. C., & Seidl, R. (2020) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2020.108066 · Cited by 157
Cohen, M. J., Shepherd, K. D., & Walsh, M. (2004) · Geoderma · doi:10.1016/j.geoderma.2004.05.003 · Cited by 156
Interactions among stream fishes: predator-induced habitat shifts and larval survival
Harvey, B. C. (1991) · Oecologia · doi:10.1007/bf00323776 · Cited by 140
Effects of logging on carbon dynamics of a jack pine forest in Saskatchewan, Canada
Howard, E. A., Gower, S. T., Foley, J. A., & Kucharik, C. J. (2004) · Global Change Biology · doi:10.1111/j.1529-8817.2003.00804.x · Cited by 158
“Inference should only be drawn for these five stands comprising the chronosequence, since the stands themselves are unreplicated, and not necessarily representative of all clear-cut jack pine stands of similar ages (sensu Hurlbert, 1984 ).”
BackgroundHeffner, R. A., Butler, M. J., & Reilly, C. K. (1996) · Ecology · doi:10.2307/2265754 · Cited by 139
Golluscio, R. Á., Austin, A. T., Martínez, G. C. G., González-Polo, M., Sala, O. E., & Jackson, R. B. (2009) · Ecosystems · doi:10.1007/s10021-009-9252-6 · Cited by 161
“This experimental design has five true replications for the three levels of grazing intensity (total = 15 experimental units), an important advantage over some studies using grazing exclosures, which are often pseudoreplicated (Hurlbert 1984).”
BackgroundQuasi-experimental methods enable stronger inferences from observational data in ecology
Butsic, V., Lewis, D. J., Radeloff, V. C., Baumann, M., & Kuemmerle, T. (2017) · Basic and Applied Ecology · doi:10.1016/j.baae.2017.01.005 · Cited by 167
Causes and consequences of variation in offspring body mass: meta‐analyses in birds and mammals
Ronget, V., Gaillard, J., Coulson, T. N., Garratt, M., Gueyffier, F., Lega, J., & Lemaître, J. (2017) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.12329 · Cited by 162
“survival–offspring mass relationship at birth and at weaning), the earliest relationship was retained to avoid pseudo-replication due to repeated measures of the same individuals (Hurlbert, 1984).”
BackgroundHeske, E., Brown, J. H., & Guo, Q. (1993) · Oecologia · doi:10.1007/bf00317436 · Cited by 139
Nitrogen cycling in two riparian forest soils under different geomorphic conditions
Pinay, G., Ruffinoni, C., & Fabre, A. (1995) · Biogeochemistry · doi:10.1007/bf02181038 · Cited by 165
“In order to avoid the risk of pseudoreplication (Hurlbert 1984) four sampling sites were chosen randomly each month in each riparian forest to constitute the 4 replicates on which soil in situ incubations and analyses were performed.”
BackgroundMasero, J. A. (2003) · Biodiversity and Conservation · doi:10.1023/a:1023021320448 · Cited by 139
“To minimise the risk of pseudo-replication ( Hulbert 1984 ), each new bird selected for observation was at least 10–20 m from the previous one.”
Schlosser, I. J. (1988) · Oikos · doi:10.2307/3565979 · Cited by 139
“Chubs were used only once to avoid pseudo-replication (Hurlbert 1984).”
MethodReplication and Treatment Strength in Whole‐Lake Experiments
Carpenter, S. R. (1989) · Ecology · doi:10.2307/1937550 · Cited by 139
Top‐Down Cascade from a Bitrophic Predator in an Old‐Field Community
Moran, M. D., Rooney, T. P., & Hurd, L. E. (1996) · Ecology · doi:10.2307/2265715 · Cited by 142
Scale in the Design and Interpretation of Aquatic Community Research
Frost, T. M., Deangelis, D. L., Bartell, S. M., Hall, D. J., & Hurlbert, S. H. (1988) · Springer eBooks · doi:10.1007/978-1-4612-3838-6_14 · Cited by 153
Self-citationHassler, S. K., Zimmermann, B., van Breugel, M., Hall, J. S., & Elsenbeer, H. (2010) · Forest Ecology and Management · doi:10.1016/j.foreco.2010.06.031 · Cited by 153
Rostkowski, P., Horwood, J. M., Shears, J. A., Lange, A., Oladapo, F. O., Besselink, H. T., Tyler, C. R., & Hill, E. M. (2011) · Environmental Science & Technology · doi:10.1021/es202966c · Cited by 159
Fundamentals of Experimental Design: Guidelines for Designing Successful Experiments
Casler, M. D. (2013) · Agronomy Journal · doi:10.2134/agronj2013.0114 · Cited by 138
“Hurlbert (1984) coined the term pseudoreplication for this situation in which experimental treatments are replicated but at a scale that is not sufficient to provide a valid scientific interpretation of the results, i.e., complete confounding of treatments with experimental units (Fig.”
BackgroundCrop-pasture rotation: A strategy to reduce soil greenhouse gas emissions in the Brazilian Cerrado
Carvalho, J. L. N., Raucci, G. S., Frazão, L. A., Cerri, C. E. P., Bernoux, M., & Cerri, C. C. (2013) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2013.11.014 · Cited by 178
Müller, J. C., Bußler, H., & Kneib, T. (2007) · Journal of Insect Conservation · doi:10.1007/s10841-006-9065-2 · Cited by 138
“However, one of the key assumptions of generalised linear models, the independence of the observations, is difficult to prove with data collected by traps with a minimum distance apart of 100 m (Hurlbert 1984).”
BackgroundMcClanahan, T. R., Nugues, M. M., & Mwachireya, S. (1994) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(94)90007-8 · Cited by 138
Blair, J. M., & Crossley, D. A. (1988) · Journal of Applied Ecology · doi:10.2307/2403854 · Cited by 138
“However, because only one watershed was clearcut, reliance on inferential statistics to imply treatment effects at the watershed level would be inappropriate (Hurlbert 1984).”
BackgroundSUSCEPTIBILITY OF SALT MARSHES TO NUTRIENT ENRICHMENT AND PREDATOR REMOVAL
Deegan, L. A., Bowen, J. L., Drake, D. C., Fleeger, J. W., Friedrichs, C. T., Galván, K. A., Hobbie, J. E., HOPKINSON, C. S., Johnson, D. S., Johnson, J. M., et al. (2007) · Ecological Applications · doi:10.1890/06-0452.1 · Cited by 139
“While subject to the limitations of pseudoreplication (Hurlbert 1984) and small sample size, large-scale manipulative studies provide a realistic environment for examining effects and processes that occur at an ecosystem-scale.”
BackgroundBushmeat Hunting Alters Recruitment of Large‐seeded Plant Species in Central Africa
Vanthomme, H., Bellé, B., & Forget, P. (2010) · Biotropica · doi:10.1111/j.1744-7429.2010.00630.x · Cited by 137
“The central caveat of such a protocol is that, due to field constraints and lack of replication of hunted and non-hunted treatment at the landscape level, this study at two sites is subject to pseudo-replication (Hurlbert 1984).”
BackgroundSex-specific reaction norms to intraspecific larval competition in the mosquito Aedes aegypti
Bedhomme, S., Agnew, P., Sidobre, C., & Michalakis, Y. (2003) · Journal of Evolutionary Biology · doi:10.1046/j.1420-9101.2003.00576.x · Cited by 137
“To avoid pseudoreplication (Hurlbert, 1984), we randomly chose one individual per replicate for density 2 and 3 treatments.”
MethodFidélis, A., Appezzato‐da‐Glória, B., Pillar, V. D., & Pfadenhauer, J. (2014) · Flora · doi:10.1016/j.flora.2013.12.003 · Cited by 156
“herefore, we chose these areas representing the different disturbnce regimes, but we are aware of the problems associated with seudo-replication (Hurlbert, 1984).”
BackgroundMethodSöthe, C., Dalponte, M., de Almeida, C. M., Schimalski, M. B., Lima, C. L., Liesenberg, V., Miyoshi, G. T., & Tommaselli, A. M. G. (2019) · Remote Sensing · doi:10.3390/rs11111338 · Cited by 141
“This procedure also aimed at balancing the sample datasets and not incurring in a pseudoreplication case [83], in which a great number of small pixels could be considered ‘pseudoreplicas’.”
MethodEffects of the mussel Mytilus edulis L. on the invertebrate fauna of sediments
Ragnarsson, S. Á., & Raffaelli, D. G. (1999) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/s0022-0981(99)00063-5 · Cited by 137
“An alternating pattern of control and treatment plots was preferred to one where plots were allocated treatments at random, because of the high chance of spatial segregation of treatments with only five replicates (Hurlbert, 1984).”
BackgroundMethodPhelan, B. A., Goldberg, R., Bejda, A. J., Pereira, J. J., Hagan, S. M., Clark, P., Studholme, A. L., Calabrese, A., & Able, K. W. (2000) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/s0022-0981(99)00184-7 · Cited by 155
“Mean G (x G cage ) in each cage was calculated to ensure statistical independence (Hurlbert, 1984) and since the number of fish recovered from a cage varied, a Wilcoxon signed-rank test was first conducted to determine if growth was related to the density of fish in a cage.”
MethodChaloner, D. T., Martin, K. M., Wipfli, M. S., Ostrom, P. H., & Lamberti, G. A. (2002) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/f02-084 · Cited by 136
“Although within-stream comparisons for Cedar Creek constitutes pseudoreplication ( Hurlbert 1984 ) because treatments were not replicated, this approach enabled us to evaluate if patterns in isotopic values found in natural streams corresponded to those in artificial streams.”
BackgroundPérez‐Ruzafa, Á., García‐Charton, J. A., Barcala, E., & Marcos, C. (2005) · Marine Pollution Bulletin · doi:10.1016/j.marpolbul.2005.09.014 · Cited by 140
Descamps, S., Boutin, S. A., Berteaux, D., McAdam, A. G., & Gaillard, J. (2007) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2007.01340.x · Cited by 160
“This allowed us to account for pseudoreplication (sensu Hurlbert 1984 ) generated by repeated observations of breeding success for a given female in different years.”
BackgroundCoggan, N. V., Hayward, M. W., & Gibb, H. (2018) · Journal of Animal Ecology · doi:10.1111/1365-2656.12819 · Cited by 153
Reintroducing bison results in long-running and resilient increases in grassland diversity
Ratajczak, Z., Collins, S. L., Blair, J. M., Koerner, S. E., Louthan, A. M., Smith, M. D., Taylor, J. H., & Nippert, J. B. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2210433119 · Cited by 166
“64) we necessarily have some degree of pseudoreplication (65).”
BackgroundInfluence of within-field and landscape factors on aphid predator populations in wheat
Elliott, N. C., Kieckhefer, R. W., Lee, J.-H., & French, B. W. (1999) · Landscape Ecology · doi:10.1023/a:1008002528345 · Cited by 135
“…desire to sample as many sites as possible each year and yet accomplish the sampling in a short time period in order to minimize the effects of seasonal variation on aphid and predator populations in fields, which if not controlled, could have resulted in temporal pseudoreplication (Hurlbert 1984).”
BackgroundMethodPucheta, E., Bonamici, I., Cabido, M., & Díaz, S. M. (2004) · Austral Ecology · doi:10.1111/j.1442-9993.2004.01337.x · Cited by 135
“Although this does not solve the statistical problem of a lack of true replicates (Hurlbert 1984; but see Oksanen 2001), the similarity between sites increases the likelihood that significant differences are a result of the long-term protection from grazing.”
Effect of land‐use heterogeneity on carabid communities at the landscape scale
Vanbergen, A. J., Woodcock, B. A., Watt, A. D., & Niemelä, J. K. (2005) · Ecography · doi:10.1111/j.0906-7590.2005.03991.x · Cited by 135
Metlen, K. L., & Fiedler, C. E. (2005) · Forest Ecology and Management · doi:10.1016/j.foreco.2005.10.037 · Cited by 158
“All sampling areas (plots, subplots, and quadrats) were selected in a stratified random fashion to ensure dispersion (Hurlbert, 1984).”
MethodTen Suggestions to Strengthen the Science of Ecology
BELOVSKY, G. E., BOTKIN, D. B., CROWL, T. A., CUMMINS, K. W., FRANKLIN, J. F., HUNTER, M. L., JOERN, A., LINDENMAYER, D. B., MacMAHON, J. A., MARGULES, C. R., et al. (2004) · BioScience · doi:10.1641/0006-3568(2004)054[0345:tststs]2.0.co;2 · Cited by 133
“This is different from the issue of adequate replication in an experimental design to address problems of statistical power, of type I versus type II error, and of pseudoreplication (Hurlbert 1984, Heffner et al. 1996).”
BackgroundNest Predation and Differential Insular Extinction among Selected Forest Birds of Central Panama
Sieving, K. E. (1992) · Ecology · doi:10.2307/1941477 · Cited by 140
Mixed Models Offer No Freedom from Degrees of Freedom
Arnqvist, G. (2020) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2019.12.004 · Cited by 135
Chen, C. Y., Borsuk, M. E., Buggé, D. M., Hollweg, T. A., Balcom, P. H., Ward, D. M., Williams, J. J., & Mason, R. P. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089305 · Cited by 149
“Tests of significance were conducted using sites, rather than individuals, as independent observations to avoid pseudoreplication [60].”
MethodDeterministic control on community assembly peaks at intermediate levels of disturbance
Lepori, F., & Malmqvist, B. (2008) · Oikos · doi:10.1111/j.1600-0706.2008.16989.x · Cited by 154
“Because the streams were part of a group of four stable (undisturbed) sites closely clustered in space, we removed them from the analysis to prevent potentially confounding effects of temperature and to improve the spatial interspersion of the categories ( Hurlbert 1984 ).”
MethodSex differences in giraffe foraging behavior at two spatial scales
Ginnett, T. F., & Demment, M. W. (1997) · Oecologia · doi:10.1007/s004420050162 · Cited by 137
“Prior to analysis, all replicate observations on identifiable individuals were averaged to provide a single value per individual and avoid pseudoreplication (Hurlbert 1984).”
MethodVermeirssen, E. L. M., Körner, O., Schönenberger, R., Suter, M. J. ‐., & Burkhardt‐Holm, P. (2005) · Environmental Science & Technology · doi:10.1021/es050818q · Cited by 167
Underwood, A. J. (1996) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/s0022-0981(96)02637-8 · Cited by 148
Hall, B., Louis, V. S., Rolfhus, K., Bodaly, R. A., Beaty, K., Paterson, M., & Cherewyk, K. A. P. (2005) · Ecosystems · doi:10.1007/s10021-003-0094-3 · Cited by 134
“Unpublished data: J. Venkiteswaran and S. Schiff, University of Waterloo, Waterloo, ON. Where forest floor exists. Matthews and others (2005) 250 B.”
BackgroundMethodInfluential
Metadata
- Authors
- Hurlbert, S. H.
- Corresponding author
- Hurlbert, Stuart H.
- Venue
- Ecological Monographs
- Publisher
- Wiley
- Published
- 1984-06
- Volume
- 54
- Issue
- 2
- Pages
- 187-211
- ISSN
- 0012-9615 (ISSN-L)
- 1557-7015
- OpenAlex
- W2139156166
- Cited by
- 8,377
- References
- 102
- Citations by year
- 2026: 283 · 2025: 212 · 2024: 155 · 2023: 167 · 2022: 164 · 2021: 212 · 2020: 221 · 2019: 233 · 2018: 231 · 2017: 226 · 2016: 266 · 2015: 279 · 2014: 296 · 2013: 280 · 2012: 254
- FWCI
- 120.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ecological Monographs (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- pseudoreplication, experimental design, randomization, type I error, marine benthos, small mammals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.