The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Assessing Effects of Unreplicated Perturbations: No Simple Solutions
Abstract
We address the task of determining the effects, on mean population density or other parameters, of an unreplicated perturbation, such as arises in environmental assessments and some ecosystem—level experiments. Our context is the Before—After—Control—Impact—Pairs design (BACIP): on several dates Before and After the perturbation, samples are collected simultaneously at both the Impact site and a nearby "Control." One approach is to test whether the mean of the Impact—Control difference has changed from Before to After the perturbation. If a conventional test is used, checks of its assumptions are an important and messy part of the analysis, since BACIP data do not necessarily satisfy them. It has been suggested that these checks are not needed for randomization tests, because they are insensitive to some of these assumptions and can be adjusted to allow for others. A major aim of this paper is to refute this suggestion: there is no panacea for the difficult and messy technical problems in the analysis of data from assessments or unreplicated experiments. We compare the randomization t test with the standard t test and the modified (Welch—Satterthwaite—Aspin) t test, which allows for unequal variances. We conclude that the randomization t test is less likely to yield valid inferences than is the Welch t test, because it requires identical distributions for small sample sizes and either equal variances or equal sample sizes for larger ones. The formal requirement of Normality is not crucial to the Welch t test. Both parametric and randomization tests require that time and location effects be additive and the Impact—Control differences on different dates be independent. These assumptions should be tested; if they are seriously wrong, alternative analyses are needed. This will often require a long time series of data. Finally, for assessing the importance of a perturbation, the P value of a hypothesis test is rarely as useful as an estimate of the size of the effect. Especially if effect size varies with time and conditions, flexible estimation methods with approximate answers are preferable to formally exact P values.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An introduction to probability theory and its applications
(1958) · Journal of the Franklin Institute · doi:10.1016/0016-0032(58)90688-4 · Cited by 29,269
An Analysis of Transformations
Box, G. E. P., & Cox, D. R. (1964) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1964.tb00553.x · Cited by 15,052
Pseudoreplication and the Design of Ecological Field Experiments
Hurlbert, S. H. (1984) · Ecological Monographs · doi:10.2307/1942661 · Cited by 8,377
On a measure of lack of fit in time series models
LJUNG, G. M., & BOX, G. E. P. (1978) · Biometrika · doi:10.1093/biomet/65.2.297 · Cited by 6,668
TESTING FOR SERIAL CORRELATION IN LEAST SQUARES REGRESSION. II
DURBIN, J., & WATSON, G. S. (1951) · Biometrika · doi:10.1093/biomet/38.1-2.159 · Cited by 3,619
Cascading Trophic Interactions and Lake Productivity
Carpenter, S. R., Kitchell, J. F., & Hodgson, J. R. (1985) · BioScience · doi:10.2307/1309989 · Cited by 2,646
Intervention Analysis with Applications to Economic and Environmental Problems
Box, G. E. P., & Tiao, G. C. (1975) · Journal of the American Statistical Association · doi:10.1080/01621459.1975.10480264 · Cited by 2,383
Glass, G. V., Peckham, P. D., & Sanders, J. R. (1972) · Review of Educational Research · doi:10.3102/00346543042003237 · Cited by 1,826
Box, G. E. P. (1954) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728786 · Cited by 1,513
Environmental Impact Assessment: "Pseudoreplication" in Time?
Stewart-Oaten, A., Murdoch, W. W., & Parker, K. R. (1986) · Ecology · doi:10.2307/1939815 · Cited by 1,331
Self-citation
Cited by
A Method for Assessing Hydrologic Alteration within Ecosystems
Richter, B. D., Baumgartner, J. V., Powell, J., & Braun, D. P. (1996) · Conservation Biology · doi:10.1046/j.1523-1739.1996.10041163.x · Cited by 2,463
Fundamentals of Microbial Community Resistance and Resilience
Shade, A., Peter, H., Allison, S. D., Baho, D. L., Berga, M., Bürgmann, H., Huber, D. H., Langenheder, S., Lennon, J. T., Martiny, J. B. H., et al. (2012) · Frontiers in Microbiology · doi:10.3389/fmicb.2012.00417 · Cited by 1,726
How much water does a river need?
RICHTER, B., BAUMGARTNER, J., WIGINGTON, R., & BRAUN, D. (1997) · Freshwater Biology · doi:10.1046/j.1365-2427.1997.00153.x · Cited by 1,601
Modelling and Quantitative Methods in Fisheries
Haddon, M. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/9781439894170 · Cited by 1,040
Defining and measuring river health
Karr, J. R. (1999) · Freshwater Biology · doi:10.1046/j.1365-2427.1999.00427.x · Cited by 675
MARINE RESERVES ARE NECESSARY BUT NOT SUFFICIENT FOR MARINE CONSERVATION
Allison, G. W., Lubchenco, J., & Carr, M. H. (1998) · Ecological Applications · doi:10.1890/1051-0761(1998)8[s79:mranbn]2.0.co;2 · Cited by 672
Logic of experiments in ecology: is pseudoreplication a pseudoissue?
Oksanen, L. (2001) · Oikos · doi:10.1034/j.1600-0706.2001.11311.x · Cited by 569
Environmental parasitology: What can parasites tell us about human impacts on the environment?
Lafferty, K. D. (1997) · Parasitology Today · doi:10.1016/s0169-4758(97)01072-7 · Cited by 496
Why most conservation monitoring is, but need not be, a waste of time
Legg, C. J., & Nagy, L. (2006) · Journal of Environmental Management · doi:10.1016/j.jenvman.2005.04.016 · Cited by 483
Resampling Methods for Computation-Intensive Data Analysis in Ecology and Evolution
Crowley, P. (1992) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.ecolsys.23.1.405 · Cited by 417
RIPARIAN VEGETATION RESPONSE TO ALTERED DISTURBANCE AND STRESS REGIMES
Shafroth, P. B., Stromberg, J. C., & Patten, D. T. (2002) · Ecological Applications · doi:10.1890/1051-0761(2002)012[0107:rvrtad]2.0.co;2 · Cited by 416
Assessing Invertebrate Responses to Human Activities: Evaluating Alternative Approaches
Fore, L. S., Karr, J. R., & Wisseman, R. W. (1996) · Journal of the North American Benthological Society · doi:10.2307/1467949 · Cited by 410
TEMPORAL AND SPATIAL VARIATION IN ENVIRONMENTAL IMPACT ASSESSMENT
Stewart-Oaten, A., & Bence, J. R. (2001) · Ecological Monographs · doi:10.1890/0012-9615(2001)071[0305:tasvie]2.0.co;2 · Cited by 355
Self-citationBlock, W. M., Franklin, A. B., Ward, J. P., Ganey, J. L., & White, G. C. (2001) · Restoration Ecology · doi:10.1046/j.1526-100x.2001.009003293.x · Cited by 336
Analyzing the Effects of Accidental Environmental Impacts: Approaches and Assumptions
Wiens, J. A., & Parker, K. R. (1995) · Ecological Applications · doi:10.2307/2269355 · Cited by 260
Direct and Indirect Responses of a Freshwater Food Web to a Potent Synthetic Oestrogen
Kidd, K. A., Paterson, M. J., Rennie, M. D., Podemski, C. L., Findlay, D. L., Blanchfield, P. J., & Liber, K. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0578 · Cited by 189
Detection of environmental impacts: natural variability, effect size, and power analysis
Osenberg, C. W., Schmitt, R. J., Holbrook, S. J., Abu-Saba, K. E., & Flegal, A. R. (1994) · Ecological Applications · doi:10.2307/1942111 · Cited by 182
Self-citationPine, W. E., Johnson, F. A., Frederick, P. C., & Coggins, L. G. (2022) · Marine and Coastal Fisheries · doi:10.1002/mcf2.10192 · Cited by 16
Moore, J. F., & Pine III, W. E. (2021) · PeerJ · doi:10.7717/peerj.11378 · Cited by 5
Metadata
- Authors
- Stewart-Oaten, A., Bence, J. R., & Osenberg, C. W.
- Venue
- Ecology
- Publisher
- Wiley
- Published
- 1992-08
- Volume
- 73
- Issue
- 4
- Pages
- 1396-1404
- ISSN
- 0012-9658 (ISSN-L)
- 1939-9170
- OpenAlex
- W2126549349
- Cited by
- 269
- References
- 44
- FWCI
- 8.54
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.