Pseudoreplication and the Design of Ecological Field Experiments
The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
Pseudoreplication is defined as the use of inferential statistics to test for treatment effects with data from experiments where either treatments are not replicated (though samples may be) or replicates are not statistically independent. In ANOVA terminology, it is the testing for treatment effects with an error term inappropriate to the hypothesis being considered. Scrutiny of 176 experimental studies published between 1960 and the present revealed that pseudoreplication occurred in 27% of them, or 48% of all such studies that applied inferential statistics. The incidence of pseudoreplication is especially high in studies of marine benthos and small mammals. The critical features of controlled experimentation are reviewed. Nondemonic intrusion is defined as the impingement of chance events on an experiment in progress. As a safeguard against both it and preexisting gradients, interspersion of treatments is argued to be an obligatory feature of good design. Especially in small experiments, adequate interspersion can sometimes be assured only by dispensing with strict randomization procedures. Comprehension of this conflict between interspersion and randomization is aided by distinguishing pre—layout (or conventional) and layout—specific alpha (probability of type I error). Suggestions are offered to statisticians and editors of ecological journals as to how ecologists' understanding of experimental design and statistics might be improved.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [50]
In the citing paper
“The tautological structure of the Kauffman and Cummings model invalidates Ripple et al.'s analysis because applying it violates the scientific principle that conclusions must be supported by evidence that is independent of the data used to generate them (Hurlbert 1984; Nakagawa & Parker 2015).”
From Flawed analysis invalidates claim of a strong Yellowstone trophic cascade after wolf reintroduction: A comment on Ripple et al. (2025) (2025) · cites this paper as Hurlbert 1984
In the citing paper
“A reason for this small number is that many studies incorporated experimental designs that suffered from pseudoreplication [79].”
From Land use change to bioenergy: A meta-analysis of soil carbon and GHG emissions (2015) · cites this paper as [79]
In the citing paper
“Pseudoreplication leads to a biased and incorrect inference, and it should be carefully considered (Hurlbert, 1984).”
From Acoustic indices as proxies for biodiversity: a meta‐analysis (2022) · cites this paper as Hurlbert, 1984
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Principles and procedures of statistics: McGraw-Hill Book Company, Inc. New York Toronto London.
Steel, R., & Torrie, J. H. (1960) · Cited by 4,633
Food Webs: Linkage, Interaction Strength and Community Infrastructure
Paine, R. T. (1980) · The Journal of Animal Ecology · doi:10.2307/4220 · Cited by 1,824
Sampling Design and Statistical Methods for Environmental Biologists
Green, R. H. (1979) · Andalas University Repository (Andalas University) · Cited by 1,550
Biogeochemistry of a forested ecosystem
(2014) · Choice Reviews Online · doi:10.5860/choice.51-6175 · Cited by 1,550
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Paine, R. T. (1974) · Oecologia · doi:10.1007/bf00345739 · Cited by 1,403
Cited by
Items 501–600 of 1,029
Global-Scale Structure of the Eelgrass Microbiome
Fahimipour, A. K., Kardish, M. R., Lang, J. M., Green, J. L., Eisen, J. A., & Stachowicz, J. J. (2017) · Applied and Environmental Microbiology · doi:10.1128/aem.03391-16 · Cited by 167
Fine‐scale post‐fire dynamics in southern Brazilian subtropical grassland
Overbeck, G. E., Müller, S. C., Pillar, V. D., & Pfadenhauer, J. (2005) · Journal of Vegetation Science · doi:10.1111/j.1654-1103.2005.tb02408.x · Cited by 166
Response of a weed community to nitrogen fertilization: a multivariate analysis
Pyšek, P., & Lepš, J. (1991) · Journal of Vegetation Science · doi:10.2307/3235956 · Cited by 167
“As it was not possible to influence the design of the fertilizer experiment, the quadrats are not true replications (they are pseudo-replications sensu Hurlbert (1984).”
BackgroundPelagic C:N:P Stoichiometry in a Eutrophied Lake: Responses to a Whole-Lake Food-Web Manipulation
Elser, J. J., Sterner, R. W., Galford, A. E., Chrzanowski, T. H., Findlay, D. L., Mills, K. H., Paterson, M. J., Stainton, M. P., & Schindler, D. W. (2000) · Ecosystems · doi:10.1007/s100210000027 · Cited by 170
“Strategies for statistical analysis of whole-lake experiments are diverse and subject to considerable discussion (Hurlbert 1984; Carpenter and others 1989).”
BackgroundMethodInfluentialAVIAN HABITAT SELECTION AND PRAIRIE WETLAND DYNAMICS: A 10-YEAR EXPERIMENT
Murkin, H. R., Murkin, E. J., & Ball, J. P. (1997) · Ecological Applications · doi:10.1890/1051-0761(1997)007[1144:ahsapw]2.0.co;2 · Cited by 170
Fausch, K. D., Nakano, S., & Ishigaki, K. (1994) · Oecologia · doi:10.1007/bf00317124 · Cited by 165
Challenges and opportunities in integrating ecological knowledge across scales
Hobbs, N. T. (2003) · Forest Ecology and Management · doi:10.1016/s0378-1127(03)00135-x · Cited by 167
Rossatto, D. R., de Carvalho Ramos Silva, L., Villalobos-Vega, R., Sternberg, L. D. S. L., & Franco, A. C. (2012) · Environmental and Experimental Botany · doi:10.1016/j.envexpbot.2011.11.025 · Cited by 168
Incorporating Landscape Attributes into Models for Migratory Grassland Bird Conservation
Bakker, K. K., Naugle, D. E., & Higgins, K. F. (2002) · Conservation Biology · doi:10.1046/j.1523-1739.2002.01328.x · Cited by 169
“We used equal-area sampling (i.e., one transect per patch regardless of grassland area) to avoid issues of passive sampling (Connor & McCoy 1979; Vickery et al. 1994; Horn et al. 2000) and the potential for pseudoreplication (Hurlbert 1984).”
MethodFunction of pipistrelle social calls: field data and a playback experiment
Barlow, K. E., & Jones, G. (1997) · Animal Behaviour · doi:10.1006/anbe.1996.0398 · Cited by 165
“We used each social call at only one playback site, to avoid pseudoreplication (Hurlbert 1984; McGregor 1992).”
MethodPalik, B. J., Mitchell, R. J., Houseal, G., & Pederson, N. (1997) · Canadian Journal of Forest Research · doi:10.1139/cjfr-27-9-1458 · Cited by 165
Response of Early‐ and Late‐Flowering Plants to Fire Season in Experimental Prairies
Howe, H. F. (1994) · Ecological Applications · doi:10.2307/1942122 · Cited by 166
INVITED PAPER: INFORMATION THEORY IN WILDLIFE SCIENCE: CRITIQUE AND VIEWPOINT
GUTHERY, F. S., BRENNAN, L. A., PETERSON, M. J., & LUSK, J. J. (2005) · Journal of Wildlife Management · doi:10.2193/0022-541x(2005)069[0457:itiwsc]2.0.co;2 · Cited by 164
Fan, Z., Lin, S., Zhang, X., Jiang, Z., Yang, K., Jian, D., Chen, Y., Li, J., Chen, Q., & Wang, J. (2014) · Agricultural Water Management · doi:10.1016/j.agwat.2014.05.010 · Cited by 161
Scales of association: hierarchical linear models and the measurement of ecological systems
McMahon, S. M., & Diez, J. M. (2007) · Ecology Letters · doi:10.1111/j.1461-0248.2007.01036.x · Cited by 166
“Because the response variable Y is associated not only with the individual i observations, but is nested within the j groups, the residuals are correlated and cannot be assumed to be independent [to assume so would constitute pseudo-replication (Hurlbert 1984)].”
BackgroundExploring the link between drought indicators and impacts
Bachmair, S., Kohn, I., & Stahl, K. (2015) · Natural Hazards and Earth System Sciences · doi:10.5194/nhess-15-1381-2015 · Cited by 160
McCarty, L. S., Dixon, D. G., MacKay, D., Smith, A. D., & Ozburn, G. W. (1992) · Environmental Toxicology and Chemistry · doi:10.1002/etc.5620110705 · Cited by 165
King, R. S., & Richardson, C. J. (2003) · Environmental Management · doi:10.1007/s00267-002-0036-4 · Cited by 164
“Because each station had unique TP and macroinvertebrate data associated with it and spatial autocorrelation among stations was minimal (King and Richardson, in press), stations could validly be considered independent observations (Hurlbert 1984).”
BackgroundEffects of the SW Atlantic burrowing crab Chasmagnathus granulata on a Spartina salt marsh
Bortolus, A., & Iribarne, O. (1999) · Marine Ecology Progress Series · doi:10.3354/meps178079 · Cited by 164
“However, to make global conclusions and inferences (i.e. beyond SW Atlantic salt marshes), large scale experiments are needed (Hulbert 1984).”
BackgroundMorgan, J. W., & Lunt, I. D. (1999) · Biological Conservation · doi:10.1016/s0006-3207(98)00112-8 · Cited by 163
“The design of this study clearly represents a case of pseudoreplication (Hurlbert, 1984); whilst there was replication of plots within each of the ®re history treatments (each >10 ha in size), there was no replication of the treatments (®re histories) themselves.”
MethodPasher, J., Mitchell, S. W., King, D. J., Fahrig, L., Smith, A. C., & Lindsay, K. E. (2013) · Landscape Ecology · doi:10.1007/s10980-013-9852-6 · Cited by 159
“…apply a ‘‘pseudo-experimental’’ approach (Brennan et al. 2002; Fahrig et al. 2011; Eigenbrod et al. 2011, also called ‘‘mensurative experiments’’ sensu Hurlbert 1984): ‘‘experimental’’ because the ultimate goal is to control potentially confounding factors and select statistically independent…”
Sensitivity of CO2 Exchange of Fen Ecosystem Components to Water Level Variation
Riutta, T., Laine, J., & Tuittila, E.-S. (2007) · Ecosystems · doi:10.1007/s10021-007-9046-7 · Cited by 160
The role of a spiny plant refuge in structuring grazed shortgrass steppe plant communities
Rebollo, S., Milchunas, D. G., Noy‐Meir, I., & Chapman, P. L. (2002) · Oikos · doi:10.1034/j.1600-0706.2002.980106.x · Cited by 165
“Quadrat responses were averaged within each combination of cacti (inside and outside cactus clump), grazing (grazed and ungrazed) and site (pastures) in order to avoid pseudoreplication (Hurlbert 1984).”
BackgroundDO ALTERNATE STABLE COMMUNITY STATES EXIST IN THE GULF OF MAINE ROCKY INTERTIDAL ZONE?
Bertness, M. D., Trussell, G. C., Ewanchuk, P. J., & Silliman, B. R. (2002) · Ecology · doi:10.1890/0012-9658(2002)083[3434:dascse]2.0.co;2 · Cited by 163
Lydersen, J. M., North, M. P., & Collins, B. M. (2014) · Forest Ecology and Management · doi:10.1016/j.foreco.2014.06.005 · Cited by 161
“In an effort to minimize pseudoreplication (Hurlbert, 1984), plots were separated by changes in slope, aspect and intervening fuel conditions to significantly reduce spatial autocorrelation in fire effects on forest structure (van Mantgem and Schwilk, 2009; Webster and Halpern, 2010).”
MethodDung beetles (Coleoptera: Scarabaeidae) can improve soil hydrological properties
Brown, J., Scholtz, C. H., Janeau, J.-L., Grellier, S., & Podwojewski, P. (2010) · Applied Soil Ecology · doi:10.1016/j.apsoil.2010.05.010 · Cited by 162
Lotze, H. K., Worm, B., & Sommer, U. (2000) · Oikos · doi:10.1034/j.1600-0706.2000.890106.x · Cited by 162
Ecological heterogeneity and the evaluation of the effects of marine reserves
Charton, J. A. G., & Ruzafa, Á. P. (1999) · Fisheries Research · doi:10.1016/s0165-7836(99)00043-0 · Cited by 164
A simple function for full‐subsets multiple regression in ecology with R
Fisher, R., Wilson, S. K., Sin, T. M., Lee, A. C., & Langlois, T. J. (2018) · Ecology and Evolution · doi:10.1002/ece3.4134 · Cited by 162
“However, a problem with studies of established NTRs is that evidence based on a negative relationship between predator and prey densities (Hurlbert, 1984; Underwood, Chapman, & Connell, 2000) may be confounded by other covariates also influencing the structure of the soft- sediment community (e.g.,…”
BackgroundEffect of texture and tree species on microbial properties of mine soils
Chodak, M., & Niklińska, M. (2010) · Applied Soil Ecology · doi:10.1016/j.apsoil.2010.08.002 · Cited by 160
Koike, T., Kitao, M., Maruyama, Y., Mori, S., & Lei, T. T. (2001) · Tree Physiology · doi:10.1093/treephys/21.12-13.951 · Cited by 160
Di Bitetti, M. (2003) · Behaviour · doi:10.1163/156853903322149441 · Cited by 159
“In the latter case the playback was produced with calls that came from different feeding or foraging bouts, thus avoiding pseudo-replication (Hurlbert, 1984; Kroodsma, 1989; McGregor et al., 1992).”
BackgroundNon-host volatiles mediate associational resistance to the pine processionary moth
Jactel, H., Birgersson, G., Andersson, S., & Schlyter, F. (2011) · Oecologia · doi:10.1007/s00442-011-1918-z · Cited by 159
“data points without pseudo-replication ( Hurlbert 1984 ).”
BackgroundMethodInfluentialMetcalfe, D. B., Meir, P., Aragão, L. E. O. C., Lobo‐do‐Vale, R., Galbraith, D., Fisher, R. A., Chaves, M. M., Maroco, J. P., da Costa, A. C. L., de Almeida, S. S., et al. (2010) · New Phytologist · doi:10.1111/j.1469-8137.2010.03319.x · Cited by 158
“The lack of treatment replication precluded fully comparative statistical analysis (Hurlbert, 1984, 2004), but 95% confidence intervals were calculated around means as an indication of the reliability of the observed mean differences at a plot scale.”
BackgroundGuckert, J. B., Carr, G. J., Johnson, T. D., Hamm, B. G., Davidson, D. H., & Kumagai, Y. (1996) · Journal of Microbiological Methods · doi:10.1016/s0167-7012(96)00948-7 · Cited by 159
DIVERSITY, BIOMASS, AND ECOSYSTEM PROCESSES IN THE MARINE BENTHOS
Bolam, S. G., Fernandes, T. F., & Huxham, M. (2002) · Ecological Monographs · doi:10.1890/0012-9615(2002)072[0599:dbaepi]2.0.co;2 · Cited by 207
“Macrofaunal samples were taken by three randomly positioned cores (6 3 6 cm, 6-cm depth), which were then pooled to avoid pseudoreplication (Hurlbert 1984).”
MethodHow do embryos assess risk? Vibrational cues in predator-induced hatching of red-eyed treefrogs
Warkentin, K. M. (2005) · Animal Behaviour · doi:10.1016/j.anbehav.2004.09.019 · Cited by 167
“For snakes, to avoid pseudoreplication (Hurlbert 1984;Wiley 2003), I first calculated the values for each attack, then averaged these across the two or three attacks by each individual.”
Carmel, Y., & Kadmon, R. (1999) · Plant Ecology · doi:10.1023/a:1009872306093 · Cited by 162
“Therefore, the data are, to some degree, pseudoreplications (Hurlbert 1984).”
BackgroundHow Important are Environmental Maternal Effects in Plants? A Study with Centaurea Maculosa
Weiner, J., Martinez, S., Muller-Scharer, H., Stoll, P., & Schmid, B. (1997) · The Journal of Ecology · doi:10.2307/2960645 · Cited by 162
Atehnkeng, J., Ojiambo, P. S., Cotty, P. J., & Bandyopadhyay, R. (2014) · Biological Control · doi:10.1016/j.biocontrol.2014.02.009 · Cited by 176
“Control plots were located at least 1 km away from the treated plots and both segregation (Hurlbert, 1984) and each subplot was considered as a pseudoreplication (Hurlbert, 1984).”
BackgroundMethodResultInfluentialThe phosphorus‐rich signature of fire in the soil–plant system: a global meta‐analysis
Butler, O. M., Elser, J. J., Lewis, T., Mackey, B., & Chen, C. (2018) · Ecology Letters · doi:10.1111/ele.12896 · Cited by 158
Methods in Comparative Plant Population Ecology
Gibson, D. J. (2014) · doi:10.1093/acprof:oso/9780199671465.001.0001 · Cited by 161
Large-scale Flow Experiments for Managing River Systems
Konrad, C. P., Olden, J. D., Lytle, D. A., Melis, T. S., Schmidt, J. C., Bray, E. N., Freeman, M. C., Gido, K. B., Hemphill, N. P., Kennard, M. J., et al. (2011) · BioScience · doi:10.1525/bio.2011.61.12.5 · Cited by 157
“Flow manipulations face challenges in meeting these and other experimental-design requirements common to largescale ecological experiments (Hurlbert 1984, Carpenter 1989).”
BackgroundA minimalist approach to the effects of density‐dependent competition on insect life‐history traits
Agnew, P., Hide, M., Sidobre, C., & Michalakis, Y. (2002) · Ecological Entomology · doi:10.1046/j.1365-2311.2002.00430.x · Cited by 161
Fowler-Walker, M. J., Wernberg, T., & Connell, S. D. (2005) · Marine Biology · doi:10.1007/s00227-005-0125-z · Cited by 189
“Present address: T. Wernberg Centre for Ecosystem Management, Edith Cowan University, Joondalup, 6027 WA, Australia Marine Biology (2006) 148: 755–767 DOI 10.1007/s00227-005-0125-z therefore, are attributed to an effect of exposure without identifying the contribution of intrinsic spatial variation (i.e. pseudoreplica…”
BackgroundInfluentialNative Invasions, Homogenization, and the Mismeasure of Integrity of Fish Assemblages
Scott, M. C., & Helfman, G. S. (2001) · Fisheries · doi:10.1577/1548-8446(2001)026<0006:nihatm>2.0.co;2 · Cited by 326
Spatial and Temporal Variation in Soil and Vegetation Impacts on Campsites
Marion, J. L., & Cole, D. N. (1996) · Ecological Applications · doi:10.2307/2269388 · Cited by 161
“STUDY METHODS We conducted three interrelated studies, combining mensurative, comparative mensurative, and manipulative experiments (sensu Hurlbert 1984).”
MethodNielsen, S. E., Boyce, M. S., Stenhouse, G. B., & Munro, R. (2002) · Cited by 157
RESPONSES OF UNDERSTORY RAIN FOREST BIRDS TO ROAD EDGES IN CENTRAL AMAZONIA
Laurance, S. G. W. (2004) · Ecological Applications · doi:10.1890/03-5194 · Cited by 159
Spatial Heterogeneity Regulates Plant-Pollinator Networks across Multiple Landscape Scales
Moreira, E. F., Boscolo, D., & Viana, B. F. (2015) · PLOS ONE · doi:10.1371/journal.pone.0123628 · Cited by 161
“spatially alternating them with different values of the factors mentioned above and also avoiding bias due to differences in the age of landscape changes [25].”
BackgroundDu, W., & Ji, X. (2003) · Journal of Thermal Biology · doi:10.1016/s0306-4565(03)00003-2 · Cited by 156
Structural equation modeling: building and evaluating causal models
Grace, J. B., Scheiner, S. M., & Schoolmaster, Jr. (2015) · Ecological Statistics · doi:10.1093/acprof:oso/9780199672547.003.0009 · Cited by 153
Claereboudt, M. R., Bureau, D., Côté, J., & Himmelman, J. H. (1994) · Aquaculture · doi:10.1016/0044-8486(94)90268-2 · Cited by 158
Cuthill, I. C. (2000) · Behavioral Ecology · doi:10.1093/beheco/11.2.189 · Cited by 161
“There were two reasons for this: for the birds’ welfare (a day with several sequences of nonavailability of the feeder could lead to a real danger of starvation), and also to ensure that predictability of food availability (the desired manipulation) was not confounded with total duration of food availability (see Hurl…”
BackgroundForest Health Assessment and Monitoring – Issues for Consideration
Ferretti, M. P. (1997) · Environmental Monitoring and Assessment · doi:10.1023/a:1005748702893 · Cited by 156
“The sampling strategy is closely related to the assessment question and to the main problem that any monitoring program has to face: the distinction between real directional trends (‘signals’) to random elements (‘noise’) (Eberhardt and Thomas, 1991; Hurlbert, 1984; Palmer, 1993).”
BackgroundMultiple Effects of Introduced Mammalian Herbivores in a Temperate Forest
Vázquez, D. P. (2002) · Biological Invasions · doi:10.1023/a:1020522923905 · Cited by 160
Constraints on host choice: why do parasitic birds rarely exploit some common potential hosts?
Grim, T., Samaš, P., Moskát, C., Kleven, O., Honza, M., Moksnes, A., Røskaft, E., & Stokke, B. G. (2011) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2010.01798.x · Cited by 167
Mapping fire-induced vegetation depletion in the Peloncillo Mountains, Arizona and New Mexico
Rogan, J., & Yool, S. R. (2001) · International Journal of Remote Sensing · doi:10.1080/01431160152558279 · Cited by 158
“This technique promoted eld sampling eYciency while reducing the potential of pseudoreplication (Hurlbert 1984).”
MethodEFFECTS OF LARVAL DENSITY ON POSTMETAMORPHIC SPADEFOOT TOADS ( SPEA HAMMONDII )
Morey, S. R., & Reznick, D. N. (2001) · Ecology · doi:10.1890/0012-9658(2001)082[0510:eoldop]2.0.co;2 · Cited by 176
Sustainability and range management in the Patagonian steppes
Golluscio, R. Á., Deregibus, V. A., & Paruelo, J. M. (1998) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 155
Heath, R. T., Fahnenstiel, G. L., Gardner, W. S., Cavaletto, J. F., & Hwang, S. (1995) · Journal of Great Lakes Research · doi:10.1016/s0380-1330(95)71062-0 · Cited by 154
“It should also be noted that common sense, biological knowledge, and intuition were applied to the task of appraising whether differences were due to treatment effects ( Hurlbert 1984 ).”
MethodGustafsson, L., & Eriksson, I. (1995) · The Journal of Applied Ecology · doi:10.2307/2405107 · Cited by 160
“It would be most interesting to make a similar study but with a different sampling design, preferably with many sites and a few aspen trees at each site, in order to avoid dependence between samples and to also avoid pseudoreplication (Hurlbert 1984).”
BackgroundShelter scaling regulates survival of juvenile Caribbean spiny lobster Panulirus argus
Eggleston, D. B., Lipcius, R. N., Miller, D. L., & Coba-Cetina, L. (1990) · Marine Ecology Progress Series · doi:10.3354/meps062079 · Cited by 154
Effects of Meadow Vole Population Density on Tree Seedling Survival in Oil Fields
Ostfeld, R. S., & Canham, C. D. (1993) · Ecology · doi:10.2307/1939937 · Cited by 157
FLOWER-TO-SEEDLING CONSEQUENCES OF DIFFERENT POLLINATION REGIMES IN AN INSECT-POLLINATED SHRUB
Herrera, C. M. (2000) · Ecology · doi:10.1890/0012-9658(2000)081[0015:ftscod]2.0.co;2 · Cited by 154
Bell, J. D., & Westoby, M. (1986) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/0022-0981(86)90109-7 · Cited by 155
Vilizzi, L., Tarkan, A. S., & Copp, G. H. (2015) · Reviews in Fisheries Science & Aquaculture · doi:10.1080/23308249.2015.1051214 · Cited by 177
“Notably, laboratory and field experiments have also been referred to as “manipulative,” and natural experiments as “mensurative” (Hurlbert, 1984).”
BackgroundPhysiological influences can outweigh environmental signals in otolith microchemistry research
Sturrock, A. M., Trueman, C. N., Milton, J. A., Waring, C., Cooper, M. J., & Hunter, E. (2014) · Marine Ecology Progress Series · doi:10.3354/meps10699 · Cited by 184
“It is important to acknowledge the limitations of ‘mensurative experiments’ (Hurlbert 1984) such as these, where attempts to reproduce natural conditions yield inherent complexity.”
BackgroundRegional Study of No‐Till Effects on Carbon Sequestration in the Midwestern United States
Christopher, S. F., Lal, R., & Mishra, U. (2009) · Soil Science Society of America Journal · doi:10.2136/sssaj2007.0336 · Cited by 154
Bella, V. D., Bazzanti, M., & Chiarotti, F. (2005) · Aquatic Conservation Marine and Freshwater Ecosystems · doi:10.1002/aqc.743 · Cited by 153
Persson, L. (1987) · Oecologia · doi:10.1007/bf00377504 · Cited by 177
“This suggests that the observed differences between treatments, although unreplicated in each habitat, were real treatment effects and not a result of nontreatment factors (Hurlbert 1984).”
BackgroundMethodTatar, M., Carey, J. R., & Vaupel, J. W. (1993) · Evolution · doi:10.1111/j.1558-5646.1993.tb02156.x · Cited by 155
Tillage effects on soil organic carbon storage and dynamics in Corn Belt of Ohio USA
Mishra, U., Ussiri, D. A. N., & Lal, R. (2010) · Soil and Tillage Research · doi:10.1016/j.still.2010.02.005 · Cited by 176
Early forest dynamics in stand-replacing fire patches in the northern Sierra Nevada, California, USA
Collins, B. M., & Roller, G. B. (2013) · Landscape Ecology · doi:10.1007/s10980-013-9923-8 · Cited by 169
“The fact that there are multiple plots within individual patches, and multiple patches within individual fires implies possible violation of the assumption that samples are independent, hence pseudoreplication (Hurlbert 1984).”
BackgroundSoil greenhouse gas fluxes from vinasse application in Brazilian sugarcane areas
Oliveira, B. S., Carvalho, J. L. N., Cerri, C. E. P., Cerri, C. C., & Feigl, B. J. (2013) · Geoderma · doi:10.1016/j.geoderma.2013.02.005 · Cited by 178
A Lesson in the Limitations of Field Experiments: Shrubsteppe Birds and Habitat Alteration
Wiens, J. A., Rotenberry, J. T., & Horne, B. V. (1986) · Ecology · doi:10.2307/1938579 · Cited by 173
Analysis of brood sex ratios: implications of offspring clustering
Krackow, S., & Tkadlec, E. (2001) · Behavioral Ecology and Sociobiology · doi:10.1007/s002650100366 · Cited by 154
“Here, we draw attention to the fact that, almost unnoticed by behavioral ecologists, a well-known statistical error has been reintroduced with these methods when analyzing clustered sex ratios, viz., pseudoreplication ( Hurlbert 1984 ).”
BackgroundAssortative mating by size: A meta-analysis of mating patterns in water striders
Arnqvist, G., Rowe, L., Krupa, J. J., & Sih, A. (1996) · Evolutionary Ecology · doi:10.1007/bf01237684 · Cited by 154
“Schmidt, 1990; Cooper and Hedges, 1994; Arnqvist and Wooster, 1995), much as in conventional statistics ( Hurlbert, 1984 ).”
BackgroundIndirect Effects of Predation in a Freshwater, Benthic Food Chain
Brönmark, C., Klosiewski, S. P., & Stein, R. A. (1992) · Ecology · doi:10.2307/1940018 · Cited by 172
Carpenter, S. R. (1998) · Springer eBooks · doi:10.1007/978-1-4612-1724-4_12 · Cited by 175
Gomes, D. G. E. (2022) · PeerJ · doi:10.7717/peerj.12794 · Cited by 189
Taft, O. W., Colwell, M. A., Isola, C. R., & Safran, R. J. (2002) · Journal of Applied Ecology · doi:10.1046/j.1365-2664.2002.00763.x · Cited by 155
“To control for nonindependence of successive surveys (Hurlbert 1984),”
BackgroundKeller, M., Varner, R. K., Dias, J. D., Silva, H., Crill, P., de Oliveira, R. C., & Asner, G. P. (2005) · Earth Interactions · doi:10.1175/ei125.1 · Cited by 166
“For soil effects or logging stratum effects within a focal site, the samples may be considered pseu-doreplicates (Hurlbert 1984) and we caution that conclusions based upon the statistical tests should not be extended beyond the narrow range of the study sites.”
BackgroundLafferty, K. (1993) · Marine Ecology Progress Series · doi:10.3354/meps096229 · Cited by 151
Timescale of Perennial Grass Recovery in Desertified Arid Grasslands Following Livestock Removal
Valone, T. J., Meyer, M. D., Brown, J. H., & Chew, R. M. (2002) · Conservation Biology · doi:10.1046/j.1523-1739.2002.01045.x · Cited by 151
“Ideally, we would identify many similar sites that have excluded grazing for the same number of years (Hurlbert 1984).”
BackgroundLajmanovích, R. C., Attademo, A. M., Peltzer, P. M., Junges, C. M., & Cabagna, M. (2010) · Archives of Environmental Contamination and Toxicology · doi:10.1007/s00244-010-9578-2 · Cited by 180
“In all experiments, replicates were tested for differences using ANOVA (Hurlbert 1984).”
MethodInsect Sampling in Forest Ecosystems
(2005) · Wiley eBooks · doi:10.1002/9780470750513 · Cited by 150
Impacts of Pastoralists on Woodlands in South Turkana, Kenya: Livestock‐ Mediated Tree Recruitment
Reid, R. S., & Ellis, J. E. (1995) · Ecological Applications · doi:10.2307/2269349 · Cited by 150
Fish Trophic Guilds and the Stucture of a Tropical Stream: Weak Direct vs. Strong Indirect Effects
Flecker, A. S. (1992) · Ecology · doi:10.2307/1940169 · Cited by 152
Rapid Cycling of Organic Nitrogen in Taiga Forest Ecosystems
Kielland, K., McFarland, J. W., Ruess, R. W., & Olson, K. (2007) · Ecosystems · doi:10.1007/s10021-007-9037-8 · Cited by 154
“Each of the five successional stages was replicated three times to avoid pseudoreplication (Hurlburt 1984).”
BackgroundDesigning studies of predation risk for improved inference in carnivore-ungulate systems
Prugh, L. R., Sivy, K. J., Mahoney, P. J., Ganz, T. R., Ditmer, M. A., van de Kerk, M., Gilbert, S. L., & Montgomery, R. A. (2019) · Biological Conservation · doi:10.1016/j.biocon.2019.02.011 · Cited by 165
“…basic principles of the scientific method, such as the importance of testing hypotheses that are falsifiable (Platt, 1964), as well as basic principles of study design, such as the importance of replication, randomization, and avoidance of pseudoreplication (Hurlbert, 1984; Morrison et al., 2008).”
MethodNatural Enemies and Plant Water Relations Influence the Distribution of an Armored Scale Insect
Hanks, L. M., & Denno, R. F. (1993) · Ecology · doi:10.2307/1940478 · Cited by 149
A TEST OF TOP-DOWN AND BOTTOM-UP CONTROL IN A DETRITUS-BASED FOOD WEB
Rosemond, A. D., Pringle, C. M., Ramírez, A., & Paul, M. J. (2001) · Ecology · doi:10.1890/0012-9658(2001)082[2279:atotda]2.0.co;2 · Cited by 171
On misinterpretations of pseudoreplication and related matters: a reply to Oksanen
Hurlbert, S. H. (2004) · Oikos · doi:10.1111/j.0030-1299.2004.12752.x · Cited by 149
“Valid tests for treatment effects in absence of treatment replication: special cases There is a simple error in Hurlbert (1984) to which it is time to confess.”
BackgroundMethodResultInfluentialSelf-citationMethods of human body odor sampling: The effect of freezing
Lenochova, P., Roberts, S. C., & Havlicek, J. (2008) · Chemical Senses · doi:10.1093/chemse/bjn067 · Cited by 148
“Although the number of freeze–thaw cycles that samples were exposed to were not described, they state that the T-shirts were stored in freezer in between the days of evaluation. Rikowski and Grammer (1999), in their study on correlations between odor and facial attractiveness, also used their frozen samples twice.”
BackgroundSchäfer, R. B., Kefford, B. J., Metzeling, L., Liess, M., Burgert, S., Marchant, L. C., Pettigrove, V. J., Goonan, P., & Nugegoda, D. (2011) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2011.01.053 · Cited by 156
“05), also to avoid temporal pseudoreplication (Hurlbert, 1984).”
Why are there more arboreal ant species in primary than in secondary tropical forests?
Klimeš, P., Idigel, C., Rimandai, M., Fayle, T. M., Janda, M., Weiblen, G. D., & Novotný, V. (2012) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2012.02002.x · Cited by 148
“The logistical demands of the whole-forest survey, comprising all trees within 0Æ32ha plots, did not allow for plot replication, that is, our data used for the comparison between primary and secondary forest are pseudoreplicated (Hurlbert 1984).”
Goymann, W., East, M. L., Wachter, B., Höner, O. P., Möstl, E., Van't Holf, T. J., & Hofer, H. (2001) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.2001.1828 · Cited by 149
Influence of topography and GPS fix interval on GPS collar performance
Cain, J. W., Krausman, P. R., Jansen, B. D., & Morgart, J. R. (2005) · Wildlife Society Bulletin · doi:10.2193/0091-7648(2005)33[926:iotagf]2.0.co;2 · Cited by 148
Kromp, B. (1989) · Agriculture Ecosystems & Environment · doi:10.1016/0167-8809(89)90089-3 · Cited by 148
Metadata
- Authors
- Hurlbert, S. H.
- Corresponding author
- Hurlbert, Stuart H.
- Venue
- Ecological Monographs
- Publisher
- Wiley
- Published
- 1984-06
- Volume
- 54
- Issue
- 2
- Pages
- 187-211
- ISSN
- 0012-9615 (ISSN-L)
- 1557-7015
- OpenAlex
- W2139156166
- Cited by
- 8,377
- References
- 102
- Citations by year
- 2026: 283 · 2025: 212 · 2024: 155 · 2023: 167 · 2022: 164 · 2021: 212 · 2020: 221 · 2019: 233 · 2018: 231 · 2017: 226 · 2016: 266 · 2015: 279 · 2014: 296 · 2013: 280 · 2012: 254
- FWCI
- 120.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ecological Monographs (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- pseudoreplication, experimental design, randomization, type I error, marine benthos, small mammals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.