On misinterpretations of pseudoreplication and related matters: a reply to Oksanen
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Pseudoreplication has become a widely accepted label for a certain class of statistical error common in the literature of ecology as well as of other fields. A wide‐ranging critique by L. Oksanen recently published in this journal criticizes the term and concept and concludes it to be a “pseudoissue,” one reflecting an intellectual disease, “a totally outdated epistemology” known as “inductionism.” The present article addresses some of Oksanen's complaints. His critique is based on a misconception of pseudoreplication, reflects unawareness of most of the literature on the topic, and mistakenly argues that the seriousness of the error is a function of whether an experiment is conducted in an inductive or deductive spirit. Oksanen's advocacy of using resources available for large scale ecology more for large numbers of experiments with unreplicated treatments than for fewer experiments with modest replication of treatments is unrealistic. It is based on an overly optimistic view of the ability of a meta‐analysis to compensate for deficiencies, such as very noisy estimates of treatment effects, of the individual studies that are fed into it. A definition is offered of the term manipulative experiment, since adequate ones are lacking in the literature. Attention is called to the fact that for certain types of manipulative experiments lacking treatment replication, there are valid ways to test for treatment effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Experimental Design and Data Analysis for Biologists
Quinn, G. P., & Keough, M. J. (2002) · doi:10.1017/cbo9780511806384 · Cited by 10,674 · cited 1×
“…sacrificial pseudoreplication may actually be on the rise: there are now at least three books (Hairston 1989:33ff, Underwood 1997:268ff, Quinn and Keough 2002:260ff) that, in their discussions of ''pooling'', essentially recommend sacrificial pseudoreplication when tests for…”
BackgroundPseudoreplication and the Design of Ecological Field Experiments
Hurlbert, S. H. (1984) · Ecological Monographs · doi:10.2307/1942661 · Cited by 8,377 · cited 15×
“Valid tests for treatment effects in absence of treatment replication: special cases There is a simple error in Hurlbert (1984) to which it is time to confess.”
BackgroundMethodResultInfluentialSelf-citationHeffner, R. A., Butler, M. J., & Reilly, C. K. (1996) · Ecology · doi:10.2307/2265754 · Cited by 139
Cited by
A decade of climate change experiments on marine organisms: procedures, patterns and problems
Wernberg, T., Smale, D. A., & Thomsen, M. S. (2012) · Global Change Biology · doi:10.1111/j.1365-2486.2012.02656.x · Cited by 428
Buttigieg, P. L., & Ramette, A. (2014) · FEMS Microbiology Ecology · doi:10.1111/1574-6941.12437 · Cited by 425
da Costa, A. C. L., Galbraith, D., Almeida, S., Portela, B. T. T., da Costa, M., de Athaydes Silva Junior, J., Braga, A. P., de Gonçalves, P. H. L., de Oliveira, A. A., Fisher, R., et al. (2010) · New Phytologist · doi:10.1111/j.1469-8137.2010.03309.x · Cited by 363
Davies, G. M., & Gray, A. (2015) · Ecology and Evolution · doi:10.1002/ece3.1782 · Cited by 333
“As Hurlbert (2004) points out, there are a variety of statistical approaches to deal with the issue, but it can also be mitigated by appropriately framed hypotheses, an appreciation of the limits of statistical inference and appropriate caution in the interpretation of the results of statistical…”
BackgroundPseudoreplication is (still) a problem.
Freeberg, T. M., & Lucas, J. R. (2009) · Journal of Comparative Psychology · doi:10.1037/a0017031 · Cited by 37
Metadata
- Authors
- Hurlbert, S. H.
- Venue
- Oikos
- Publisher
- Wiley
- Published
- 2004-02-16
- Volume
- 104
- Issue
- 3
- Pages
- 591-597
- ISSN
- 0030-1299 (ISSN-L)
- 1600-0706
- OpenAlex
- W2126034947
- Cited by
- 149
- References
- 3
- FWCI
- 6.16
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: On misinterpretations of pseudoreplication and related matters: a reply to Oksanen. https://app.cochat.ai/papers/10.1111/j.0030-1299.2004.12752.x
- The paper
- Hurlbert, S. H. (2004). On misinterpretations of pseudoreplication and related matters: a reply to Oksanen. Oikos. https://doi.org/10.1111/j.0030-1299.2004.12752.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.