Pseudoreplication and the Design of Ecological Field Experiments
The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
Pseudoreplication is defined as the use of inferential statistics to test for treatment effects with data from experiments where either treatments are not replicated (though samples may be) or replicates are not statistically independent. In ANOVA terminology, it is the testing for treatment effects with an error term inappropriate to the hypothesis being considered. Scrutiny of 176 experimental studies published between 1960 and the present revealed that pseudoreplication occurred in 27% of them, or 48% of all such studies that applied inferential statistics. The incidence of pseudoreplication is especially high in studies of marine benthos and small mammals. The critical features of controlled experimentation are reviewed. Nondemonic intrusion is defined as the impingement of chance events on an experiment in progress. As a safeguard against both it and preexisting gradients, interspersion of treatments is argued to be an obligatory feature of good design. Especially in small experiments, adequate interspersion can sometimes be assured only by dispensing with strict randomization procedures. Comprehension of this conflict between interspersion and randomization is aided by distinguishing pre—layout (or conventional) and layout—specific alpha (probability of type I error). Suggestions are offered to statisticians and editors of ecological journals as to how ecologists' understanding of experimental design and statistics might be improved.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“The tautological structure of the Kauffman and Cummings model invalidates Ripple et al.'s analysis because applying it violates the scientific principle that conclusions must be supported by evidence that is independent of the data used to generate them (Hurlbert 1984; Nakagawa & Parker 2015).”
From Flawed analysis invalidates claim of a strong Yellowstone trophic cascade after wolf reintroduction: A comment on Ripple et al. (2025) (2025) · cites this paper as Hurlbert 1984
In the citing paper
“A reason for this small number is that many studies incorporated experimental designs that suffered from pseudoreplication [79].”
From Land use change to bioenergy: A meta-analysis of soil carbon and GHG emissions (2015) · cites this paper as [79]
In the citing paper
“Pseudoreplication leads to a biased and incorrect inference, and it should be carefully considered (Hurlbert, 1984).”
From Acoustic indices as proxies for biodiversity: a meta‐analysis (2022) · cites this paper as Hurlbert, 1984
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Principles and procedures of statistics: McGraw-Hill Book Company, Inc. New York Toronto London.
Steel, R., & Torrie, J. H. (1960) · Cited by 4,633
Food Webs: Linkage, Interaction Strength and Community Infrastructure
Paine, R. T. (1980) · The Journal of Animal Ecology · doi:10.2307/4220 · Cited by 1,824
Sampling Design and Statistical Methods for Environmental Biologists
Green, R. H. (1979) · Andalas University Repository (Andalas University) · Cited by 1,550
Biogeochemistry of a forested ecosystem
(2014) · Choice Reviews Online · doi:10.5860/choice.51-6175 · Cited by 1,550
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Paine, R. T. (1974) · Oecologia · doi:10.1007/bf00345739 · Cited by 1,403
Cited by
Items 401–500 of 1,029
UNDERSTORY SPECIES PATTERNS AND DIVERSITY IN OLD-GROWTH AND MANAGED NORTHERN HARDWOOD FORESTS
Scheller, R. M., & Mladenoff, D. J. (2002) · Ecological Applications · doi:10.1890/1051-0761(2002)012[1329:uspadi]2.0.co;2 · Cited by 194
Linking forest edge structure to edge function: mediation of herbivore damage
Cadenasso, M. L., & Pickett, S. T. A. (2000) · Journal of Ecology · doi:10.1046/j.1365-2745.2000.00423.x · Cited by 193
“The data were temporally pseudoreplicated (Hurlbert 1984), and were not therefore subjected to analysis.”
MethodBoeckli, L., Brenning, A., Gruber, S., & Noetzli, J. (2012) · The Cryosphere · doi:10.5194/tc-6-125-2012 · Cited by 191
“We adopt this conservative approach by assuming that averaging over N finer-scale grid cells does not reduce the uncertainty var ε in the statistical model ground temperature at the aggregate scale ( Hurlbert, 1984).”
MethodAshton, P. M. S., & Berlyn, G. P. (1994) · American Journal of Botany · doi:10.1002/j.1537-2197.1994.tb15489.x · Cited by 178
Effects of Larval Density in Ambystoma Opacum: An Experiment Large‐Scale Field Enclosures
Scott, D. E. (1990) · Ecology · doi:10.2307/1940269 · Cited by 197
CARBON CYCLING AND SOIL CARBON STORAGE IN MESIC TO WET HAWAIIAN MONTANE FORESTS
Schuur, E. A. G., Chadwick, O. A., & Matson, P. A. (2001) · Ecology · doi:10.1890/0012-9658(2001)082[3182:ccascs]2.0.co;2 · Cited by 182
Scale effects and extrapolation in ecological experiments
Englund, G., & Cooper, S. D. (2003) · Advances in Ecological Research · doi:10.1016/s0065-2504(03)33011-9 · Cited by 193
Yannarell, A. C., & Triplett, E. W. (2004) · Applied and Environmental Microbiology · doi:10.1128/aem.70.1.214-223.2004 · Cited by 192
“For higher levels of investigation, patchiness could lead to a problem equivalent to pseudoreplication (5, 15).”
BackgroundBurdens of evidence and the benefits of marine reserves: putting Descartes before des horse?
Willis, T. J., Millar, R. B., Babcock, R. C., & Tolimieri, N. (2003) · Environmental Conservation · doi:10.1017/s0376892903000092 · Cited by 194
“Detection of recovery of fish density in marine reserves often suffers from lack of rigour in the design of field surveys (Hurlbert 1984; Stewart-Oaten et al. 1986; Underwood 1990, 1993).”
BackgroundComparison of species composition between different grassland management treatments after 25 years
Moog, D., Poschlod, P., Kahmen, S., & Schreiber, K. ‐. (2002) · Applied Vegetation Science · doi:10.1111/j.1654-109x.2002.tb00539.x · Cited by 194
Retention and Transport of Nutrients in a Third-Order Stream: Channel Processes
Triska, F. J., Kennedy, V. C., Avanzino, R. J., Zellweger, G. W., & Bencala, K. E. (1989) · Ecology · doi:10.2307/1938119 · Cited by 191
Density Dependence in the Common Lizard: Demographic Consequences of a Density Manipulation
Massot, M., Clobert, J., Pilorge, T., Lecomte, J., & Barbault, R. (1992) · Ecology · doi:10.2307/1940026 · Cited by 197
“…invest difyerently in their reproduction than females in site D. DISCUSSION General cotiiments Replications of ecological experiments in natural conditions are often lacking (Hurlbert 1984), mainly because the necessary investment in money and effort places them out of reach for many ecologists.”
BackgroundMethodNestling American robins compete with siblings by begging
Smith, H. G., & Montgomerie, R. (1991) · Behavioral Ecology and Sociobiology · doi:10.1007/bf00163989 · Cited by 191
“To avoid pseudoreplication (Hurlbert 1984), we analyzed only mean values for each index of begging intensity from each nest.”
MethodThe Vineyard Yeast Microbiome, a Mixed Model Microbial Map
Setati, M. E., Jacobson, D., Andong, U.-C., & Bauer, F. (2012) · PLoS ONE · doi:10.1371/journal.pone.0052609 · Cited by 191
“Nonetheless, pseudoreplication effects [37] from the sampling points within each vineyard are a possibility that we needed to address in order to ensure that environmental conditions [that have nothing to do with farming practice] present in each vineyard are not driving the selection of species.”
BackgroundBall, J. P., Nordengren, C., & Wallin, K. (2001) · Wildlife Biology · doi:10.2981/wlb.2001.007 · Cited by 192
“Statistical analysis We used the means of individual summer or winter ranges and we used a given moose in only a single year to avoid pseudoreplication ( Hurlbert 1984 ) so the unit of independence is the individual moose winter or summer range.”
MethodSeed bank versus seed rain in the regeneration of a tropical pioneer tree
Alvarez-Buylla, E. R., & Martínez-Ramos, M. (1990) · Oecologia · doi:10.1007/bf00329755 · Cited by 201
Impact of Annual Average Daily Traffic on Highway Runoff Pollutant Concentrations
Kayhanian, M., Singh, A., Suverkropp, C., & Borroum, S. (2003) · Journal of Environmental Engineering · doi:10.1061/(asce)0733-9372(2003)129:11(975 · Cited by 191
Trait interactions help explain plant invasion success in the German flora
Küster, E. C., Kühn, I., Bruelheide, H., & Klotz, S. (2008) · Journal of Ecology · doi:10.1111/j.1365-2745.2008.01406.x · Cited by 194
“An over-estimation of the statistical degrees of freedom due to non-independence in data results in pseudoreplication ( Hurlbert 1984 ).”
BackgroundA future for models and data in environmental science
Clark, J. S., & Gelfand, A. E. (2006) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2006.03.016 · Cited by 193
“Efforts to shoehorn relevant observations into a rigid framework have contributed to debates on classical hypothesis testing [13,14], the importance of controlled experiments [15], pseudoreplication [ 16 ] and the expanding application of Bayesian inference [17].”
BackgroundINDUCTION OF OVERCOMPENSATION IN THE FIELD GENTIAN,GENTIANELLA CAMPESTRIS
Lennartsson, T., Nilsson, P., & Tuomi, J. (1998) · Ecology · doi:10.1890/0012-9658(1998)079[1061:iooitf]2.0.co;2 · Cited by 182
Prolonged prey suppression by carnivores ? predator-removal experiments
Newsome, A. E., Parer, I., & Catling, P. C. (1989) · Oecologia · doi:10.1007/bf00378734 · Cited by 190
Impact Assessment Using the Before-After-Control-Impact (BACI) Model: Concerns and Comments
Smith, E. P., Orvos, D. R., & Cairns Jr., J. (1993) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/f93-072 · Cited by 179
The predominantly facultative nature of epibiosis: experimental and observational evidence
Wahl, M., & Mark, O. (1999) · Marine Ecology Progress Series · doi:10.3354/meps187059 · Cited by 189
“In an attempt to ensure independence of replicates, the distance between artificial substrata was always greater then 3 times their lengths (Hurlbert 1984).”
BackgroundColonization constraints during primary succession on coastal Lake Michigan sand dunes
Lichter, J. (2000) · Journal of Ecology · doi:10.1046/j.1365-2745.2000.00503.x · Cited by 191
“Although this design clearly represents pseudoreplication (Hurlburt 1984), the uniqueness of the chronosequence and logistical realities prevented inclusion of additional sites for true replication.”
BackgroundPalardy, J. E., Rodrigues, L. J., & Grottoli, A. G. (2008) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/j.jembe.2008.09.015 · Cited by 189
“Thus, although strictly non-independent in analysis (Hurlbert, 1984), enclosing bleached and non-bleached samples in the same chamber reduced experimental error.”
BackgroundEffects of increasing winter rearing habitat on abundance of salmonids in two coastal Oregon streams
Solazzi, M. F., Nickelson, T. E., Johnson, S. L., & Rodgers, J. D. (2000) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-57-5-906 · Cited by 190
“This approach has been referred to as a BACI (before–after– control–impact) design by Stewart-Oaten et al. (1986), who recommended it to address the problem of pseudoreplication often encountered in ecological impact studies (Hurlbert 1984).”
BackgroundPredator manipulation experiments: impacts on populations of terrestrial vertebrate prey
Salo, P., Banks, P. B., Dickman, C. R., & Korpimäki, E. (2010) · Ecological Monographs · doi:10.1890/09-1260.1 · Cited by 189
The design and analysis of field studies to estimate catch‐and‐release mortality
POLLOCK, K. H., & PINE, W. E. (2007) · Fisheries Management and Ecology · doi:10.1111/j.1365-2400.2007.00532.x · Cited by 188
Andersen, A. N., & Patel, A. D. (1994) · Oecologia · doi:10.1007/bf00326085 · Cited by 194
Making smart conservation decisions
Possingham, H. P., Andelman, S., Noon, B., Trombulak, S. C., & Pulliam, H. R. (2001) · Cited by 187
Kosola, K. R., Dickmann, D. I., Paul, E. A., & Parry, D. (2001) · Oecologia · doi:10.1007/s004420100694 · Cited by 186
Dutilleul, P., & Legendre, P. (1993) · Oikos · doi:10.2307/3545210 · Cited by 188
Effects of coastal development on nearshore estuarine nekton communities
Bilkovic, D., & Roggero, M. (2008) · Marine Ecology Progress Series · doi:10.3354/meps07279 · Cited by 187
“Replicates were averaged for each date and location to avoid pseudoreplication at the habitat level (sensu Hurlbert 1984).”
Ecological transitions indicated by foraminiferal assemblages in paralic environments
Debenay, J.-P., & Guillou, J.-J. (2002) · Estuaries · doi:10.1007/bf02692208 · Cited by 184
New taxonomy and niche partitioning on coral reefs: jack of all trades or master of some?
Knowlton, N., & Jackson, J. B. C. (1994) · Trends in Ecology & Evolution · doi:10.1016/0169-5347(94)90224-0 · Cited by 186
Physical Environmental Factors Contributing to Recurring Hypoxia in the New York Bight
Swanson, R. L., & Parker, C. A. (1988) · Transactions of the American Fisheries Society · doi:10.1577/1548-8659(1988)117<0336:eosffo>2.3.co;2 · Cited by 24
Adaptive Management in Habitat Conservation Plans
Wilhere, G. F. (2002) · Conservation Biology · doi:10.1046/j.1523-1739.2002.00350.x · Cited by 186
Trophic diversity of the otter (Lutra lutra L.) in temperate and Mediterranean freshwater habitats
Clavero, M., Prenda, J., & Delibes, M. (2003) · Journal of Biogeography · doi:10.1046/j.1365-2699.2003.00865.x · Cited by 184
“Usually, results from several places or streams from the same area were pooled to avoid pseudoreplication (Hulbert, 1984).”
BackgroundValiela, I., Geist, M., McClelland, J., & Tomasky, G. (2000) · Biogeochemistry · doi:10.1023/a:1006345024374 · Cited by 186
Microbial communities, activity and biomass
Parkinson, D., & Coleman, D. C. (1991) · Agriculture, Ecosystems & Environment · doi:10.1016/0167-8809(91)90090-k · Cited by 184
“Similarly, careful consideration must be given to experimental design and sampling strategies, taking into account such problems as pseudoreplication (Hurlbert, 1984).”
BackgroundFrederick, P., & Jayasena, N. (2011) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2010.2189 · Cited by 184
Smokorowski, K. E., & Randall, R. G. (2017) · FACETS · doi:10.1139/facets-2016-0058 · Cited by 183
Pre‐ And Post‐Settlement Determinants of Estuarine Dungeness Crab Recruitment
Eggleston, D. B., & Armstrong, D. A. (1995) · Ecological Monographs · doi:10.2307/2937137 · Cited by 181
Tuomisto, H., & Ruokolainen, K. (1994) · Journal of Vegetation Science · doi:10.2307/3235634 · Cited by 186
Are mangroves nursery habitat for transient fishes and decapods?
Sheridan, P., & Hays, C. (2003) · Wetlands · doi:10.1672/19-20 · Cited by 184
“Estimates of growth, survival, and movement success need to employ appropriate mensurative or manipulative experiments (Hurlbert 1984).”
BackgroundLazic, S. E., & Essioux, L. (2016) · Cited by 182
Lean, I. J., Lucy, M. C., McNamara, J. P., Bradford, B. J., Block, E., Thomson, J. M., Morton, J. M., Celi, P., Rabiee, A. R., Santos, J. E. P., et al. (2016) · Journal of Dairy Science · doi:10.3168/jds.2015-9445 · Cited by 181
“units of analysis within an experimental unit (Hurlbert, 1984; St-Pierre, 2007).”
BackgroundRodolfo-Metalpa, R., Martin, S., Ferrier-Pagès, C., & Gattuso, J.-P. (2010) · Biogeosciences · doi:10.5194/bg-7-289-2010 · Cited by 183
Soto, D., & Norambuena, F. (2004) · Journal of Applied Ichthyology · doi:10.1111/j.1439-0426.2004.00602.x · Cited by 183
Temporal variation in soft-sediment benthos
Morrisey, D. J., Underwood, A. J., Howitt, L., & Stark, J. S. (1992) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(92)90177-c · Cited by 181
The energetic costs of fighting in the house cricket, Acheta domesticus L
Hack, M. A. (1997) · Behavioral Ecology · doi:10.1093/beheco/8.1.28 · Cited by 185
Correlates of oxidative stress in wild kestrel nestlings (Falco tinnunculus)
Costantini, D., Casagrande, S., De Filippis, S., Brambilla, G., Fanfani, A., Tagliavini, J., & Dell’Omo, G. (2006) · Journal of Comparative Physiology B · doi:10.1007/s00360-005-0055-6 · Cited by 180
“The nest was included as a random factor to avoid pseudoreplication (Hurlbert 1984) because there were several chicks per nest (in all analyses the chick was considered as the unit) and they could not be considered independent of each other.”
BackgroundMethodMarubini, F., Ferrier–Pages, C., & Cuif, J. (2003) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.2002.2212 · Cited by 181
“experimental design, therefore, avoided pseudoreplication (Hurlbert 1984).”
Effect of Spatial Arrangement of Habitat Patches on Local Population Size
Fahrig, L., & Paloheimo, J. (1988) · Ecology · doi:10.2307/1940445 · Cited by 182
Safford, H. D., Schmidt, D. A., & Carlson, C. H. (2009) · Forest Ecology and Management · doi:10.1016/j.foreco.2009.05.024 · Cited by 180
Predation Risk Influences the Use of Foraging Sites by Tits
Suhonen, J. (1993) · Ecology · doi:10.2307/1940490 · Cited by 183
Tests of Density‐Dependent Habitat Selection in a Patchy Environment
Morris, D. W. (1987) · Ecological Monographs · doi:10.2307/2937087 · Cited by 181
Lesser, M. P., Cullen, J. J., & Neale, P. J. (1994) · Journal of Phycology · doi:10.1111/j.0022-3646.1994.00183.x · Cited by 179
Sinervo, B., Bleay, C., & Adamopoulou, C. (2001) · Evolution · doi:10.1111/j.0014-3820.2001.tb01320.x · Cited by 177
“Studying selection on individuals would result in pseudoreplication (Hulbert 1984; Sinervo et al. 2000b; Svensson and Sinervo 2000).”
BackgroundArthur, M. A., Paratley, R. D., & Blankenship, B. A. (1998) · Journal of the Torrey Botanical Society · doi:10.2307/2997220 · Cited by 179
Land use change to bioenergy: A meta-analysis of soil carbon and GHG emissions
Harris, Z. M., Spake, R., & Taylor, G. (2015) · Biomass and Bioenergy · doi:10.1016/j.biombioe.2015.05.008 · Cited by 176
“A reason for this small number is that many studies incorporated experimental designs that suffered from pseudoreplication [79].”
Cornwall, C. E., Hepburn, C. D., Pritchard, D., Currie, K. I., McGraw, C. M., Hunter, K. A., & Hurd, C. L. (2012) · Journal of Phycology · doi:10.1111/j.1529-8817.2011.01085.x · Cited by 176
“The three seawater treatments used in this study were ambient seawater pH 7.9 and seawater reduced to pH 7.5 either using CO2 gas or HCl. Seawater pH was modified independently for each replicate to avoid any artifacts due to tank effects (Hulbert 1984).”
MethodInfluentialGardiner, T., Hill, J., & Chesmore, D. (2005) · Journal of Insect Conservation · doi:10.1007/s10841-005-2854-1 · Cited by 176
“questionable on the grounds of pseudo-replication (Hurlbert 1984) but there are few datasets (Clarke et al.”
BackgroundBrownscombe, J. W., Lédée, E. J. I., Raby, G. D., Struthers, D. P., Gutowsky, L. F. G., Nguyen, V. M., Young, N., Stokesbury, M. J. W., Holbrook, C. M., Brenden, T. O., et al. (2019) · Reviews in Fish Biology and Fisheries · doi:10.1007/s11160-019-09560-4 · Cited by 176
“The lack of independence between successive observations in telemetry data or in the derived behavior or fates of tagged fish can give rise to pseudo-replication if treated as independent observations in analyses (Hurlbert 1984; Roberts et al. 2017).”
BackgroundIDENTIFICATION OF BRITISH BAT SPECIES BY MULTIVARIATE ANALYSIS OF ECHOLOCATION CALL PARAMETERS
VAUGHAN, N., JONES, G., & HARRIS, S. (1997) · Bioacoustics · doi:10.1080/09524622.1997.9753331 · Cited by 176
Playback experiments: design and analysis
McGregor, P. K. (2000) · Acta ethologica · doi:10.1007/s102110000023 · Cited by 174
“This point is made strongly by Hurlbert (1984) (who stimulated much of the pseudoreplication debate), but it has been largely ignored, overshadowed by the pseudoreplication issue.”
BackgroundZimmerman, R. C., Reguzzoni, J. L., & Alberte, R. S. (1995) · Aquatic Botany · doi:10.1016/0304-3770(95)00472-c · Cited by 175
The influence of structural clutter on activity patterns of insectivorous bats
Brigham, R. M., Grindal, S. D., Firman, M. C., & Morissette, J. L. (1997) · Canadian Journal of Zoology · doi:10.1139/z97-017 · Cited by 176
RESEARCH AND MANAGEMENT VIEWPOINT: WHY COMPENSATING WILDLIFE DAMAGES MAY BE BAD FOR CONSERVATION
BULTE, E. H., & RONDEAU, D. (2005) · Journal of Wildlife Management · doi:10.2193/0022-541x(2005)069<0014:wcwdmb>2.0.co;2 · Cited by 242
Responses of plants in polar regions to UVB exposure: a meta‐analysis
NEWSHAM, K. K., & ROBINSON, S. A. (2009) · Global Change Biology · doi:10.1111/j.1365-2486.2009.01944.x · Cited by 175
“As in previous meta-analyses (e.g. Searles et al ., 2001), we noted effects of data from apparently pseudoreplicated (Hurlbert, 1984) studies on the weighted analyses, with these data having anomalously large effects on the analyses because of the extra weight given to them, as a result of the…”
BackgroundComparative accuracy and efficiency of six coral community survey methods
Leujak, W., & Ormond, R. F. G. (2007) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/j.jembe.2007.06.028 · Cited by 174
Amazon Rain Forest Succession: Stochasticity or Land-Use Legacy?
Mesquita, R. D. C. G., Massoca, P. E. D. S., Jakovac, C. C., Bentos, T. V., & Williamson, G. B. (2015) · BioScience · doi:10.1093/biosci/biv108 · Cited by 175
BIOGEOCHEMICAL AND METABOLIC RESPONSES TO THE FLOOD PULSE IN A SEMIARID FLOODPLAIN
Valett, H. M., Baker, M. A., Morrice, J. A., Crawford, C. S., Molles, M. C., Dahm, C. N., Moyer, D. L., Thibault, J. R., & Ellis, L. M. (2005) · Ecology · doi:10.1890/03-4091 · Cited by 172
Improving generalized regression analysis for the spatial prediction of forest communities
Maggini, R., Lehmann, A., Zimmermann, N. E., & Guisan, A. (2006) · Journal of Biogeography · doi:10.1111/j.1365-2699.2006.01465.x · Cited by 176
“When spatial autocorrelation is found in model residuals, statistics with exaggerated type I error are produced (detection of patterns that do not exist) as a result of pseudoreplication (Hurlbert, 1984; Legendre et al., 2002; Hampe, 2004).”
BackgroundTop‐Down Effects in a Tritrophic System: Parasitoids Enhance Plant Fitness
GÓmez, J. M., & Zamora, R. (1994) · Ecology · doi:10.2307/1939426 · Cited by 176
Long-term and spillover effects of a marine protected area on an exploited fish community
Stobart, B., Warwick, R., González, C., Mallol, S., Díaz, D., Reñones, O., & Goñi, R. (2009) · Marine Ecology Progress Series · doi:10.3354/meps08007 · Cited by 174
“Strictly speaking, samples taken within the CIMR for comparison with other locations are ‘pseudoreplicates’ (Hurlbert 1984).”
BackgroundFoster, M. S. (1990) · Hydrobiologia · doi:10.1007/bf00006225 · Cited by 178
“Hurlbert (1984), Underwood & Denley (1984), Underwood (1986a), and Underwood and Fairweather (1986) have suggested that diffi-”
Clements, W. H. (2004) · Ecological Applications · doi:10.1890/03-5009 · Cited by 173
WHY DOES TAIL LOSS INCREASE A LIZARD'S LATER VULNERABILITY TO SNAKE PREDATORS?
Downes, S., & Shine, R. (2001) · Ecology · doi:10.1890/0012-9658(2001)082[1293:wdtlia]2.0.co;2 · Cited by 173
“We used large numbers of individual predators to avoid pseudoreplication (Hurlbert 1984), only female lizards were used to minimize aggressive interactions among prey (Kaiser and Mushinsky 1985), and tailed skinks had the tips of their tails removed to control for possible stress associated with…”
MethodSARR, D. A. (2002) · Environmental Management · doi:10.1007/s00267-002-2608-8 · Cited by 173
Brickhill, M. J., Lee, S. Y., & Connolly, R. M. (2005) · Journal of Fish Biology · doi:10.1111/j.0022-1112.2005.00915.x · Cited by 170
“Lack of true replication is a common problem in the design of ecological field experiments (Hulbert, 1984).”
BackgroundCrow, T. R., Buckley, D. S., Nauertz, E. A., & Zasada, J. C. (2002) · Forest Science · doi:10.1093/forestscience/48.1.129 · Cited by 172
Application of the Hierarchical Bootstrap to Multi-Level Data in Neuroscience
Saravanan, V., Berman, G. J., & Sober, S. J. (2019) · doi:10.1101/819334 · Cited by 170
“While pseudoreplication was first extensively reported on in ecological studies [5, 48], it has since been identified as a common problem in other fields, including neuroscience [6].”
BackgroundResultCoral Energy Reserves and Calcification in a High-CO2 World at Two Temperatures
Schoepf, V., Grottoli, A. G., Warner, M. E., Cai, W.-J., Melman, T. F., Hoadley, K. D., Pettay, D. T., Hu, X., Li, Q., Xu, H., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0075049 · Cited by 168
“While this is, strictly speaking, a pseudo-replicated design [53], the disadvantages of this design are outweighed by the advantages of being able to simultaneously manipulate six combinations of temperature and pH.”
BackgroundEstablishment patterns of exotic birds are constrained by non‐random patterns in introduction
Blackburn, T. M., & Duncan, R. P. (2001) · Journal of Biogeography · doi:10.1046/j.1365-2699.2001.00597.x · Cited by 172
“This is an example of pseudoreplication (Hurlbert, 1984; McArdle, 1996): outcomes at one level of replication (individual introduction events) are correlated because they are clustered into higher level units (species or locations in this case).”
BackgroundCommunity Changes Associated with the Spread of an Introduced Seagrass, Zostera Japonica
Posey, M. H. (1988) · Ecology · doi:10.2307/1941252 · Cited by 170
GLASBY, T. M. (1997) · Australian Journal of Ecology · doi:10.1111/j.1442-9993.1997.tb00696.x · Cited by 171
Combining plant and animal traits to assess community functional responses to disturbance
Moretti, M., & Legg, C. (2009) · Ecography · doi:10.1111/j.1600-0587.2008.05524.x · Cited by 170
BROWSING LAWNS? RESPONSES OF ACACIA NIGRESCENS TO UNGULATE BROWSING IN AN AFRICAN SAVANNA
Fornara, D. A., & Toit, J. T. D. (2007) · Ecology · doi:10.1890/0012-9658(2007)88[200:blroan]2.0.co;2 · Cited by 174
Interpolation of animal tracking data in a fluid environment
Tremblay, Y., Shaffer, S. A., Fowler, S. L., Kuhn, C. E., McDonald, B. I., Weise, M. J., Bost, C.-A., Weimerskirch, H., Crocker, D. E., Goebel, M. E., et al. (2006) · Journal of Experimental Biology · doi:10.1242/jeb.01970 · Cited by 167
Advances and Limitations of Disease Biogeography Using Ecological Niche Modeling
Escobar, L. E., & Craft, M. E. (2016) · Frontiers in Microbiology · doi:10.3389/fmicb.2016.01174 · Cited by 171
Norris, R. H., & Hawkins, C. P. (2000) · Hydrobiologia · doi:10.1023/a:1004176507184 · Cited by 170
“We believe this situation has had a fortuitous outcome in view of criticisms made by Eberhardt (1963, 1976) and made prominent by Hurlbert (1984).”
ResultDispersal, Boundary Processes, and Trophic‐Level Interactions in Streams Adjacent to Beaver Ponds
Schlosser, I. J. (1995) · Ecology · doi:10.2307/1939356 · Cited by 170
Composition and Population Responses of an African Savanna Grassland to Rainfall and Grazing
O'Connor, T. G. (1994) · The Journal of Applied Ecology · doi:10.2307/2404608 · Cited by 174
Temporal Changes in C and N Stocks of Restored Prairie: Implications for C Sequestration Strategies
Matamala, R., Jastrow, J. D., Miller, R. M., & Garten, C. T. (2008) · Ecological Applications · doi:10.1890/07-1609.1 · Cited by 167
Vos, P., Meelis, E., & Ter Keurs, W. J. (2000) · Environmental Monitoring and Assessment · doi:10.1023/a:1006139412372 · Cited by 166
Effects of Flooding On Root and Shoot Production of Bald Cypress in Large Experimental Enclosures
Megonigal, J. P., & Day, F. P. (1992) · Ecology · doi:10.2307/1940668 · Cited by 167
Effects of Forest Disturbance on Particulate Organic Matter Budgets of Small Streams
Webster, J. R., Golladay, S. W., Benfield, E. F., D'Angelo, D. J., & Peters, G. T. (1990) · Journal of the North American Benthological Society · doi:10.2307/1467446 · Cited by 169
Azarbad, H., Niklińska, M., Laskowski, R., van Straalen, N. M., van Gestel, C. A. M., Zhou, J., He, Z., Wen, C., & Röling, W. F. M. (2015) · FEMS Microbiology Ecology · doi:10.1093/femsec/fiu003 · Cited by 164
“Studies along a gradient allow for better control over confounding non-pollution related factors, compared to more traditional approaches that contrast polluted vs unpolluted sites or comprise random sampling within an area exposed to a single pollution source (Hurlbert 1984).”
Background
Metadata
- Authors
- Hurlbert, S. H.
- Corresponding author
- Hurlbert, Stuart H.
- Venue
- Ecological Monographs
- Publisher
- Wiley
- Published
- 1984-06
- Volume
- 54
- Issue
- 2
- Pages
- 187-211
- ISSN
- 0012-9615 (ISSN-L)
- 1557-7015
- OpenAlex
- W2139156166
- Cited by
- 8,377
- References
- 102
- Citations by year
- 2026: 283 · 2025: 212 · 2024: 155 · 2023: 167 · 2022: 164 · 2021: 212 · 2020: 221 · 2019: 233 · 2018: 231 · 2017: 226 · 2016: 266 · 2015: 279 · 2014: 296 · 2013: 280 · 2012: 254
- FWCI
- 120.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ecological Monographs (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- pseudoreplication, experimental design, randomization, type I error, marine benthos, small mammals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.