The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Why do we still use stepwise modelling in ecology and behaviour?
Open accessAbstract
Summary: The biases and shortcomings of stepwise multiple regression are well established within the statistical literature. However, an examination of papers published in 2004 by three leading ecological and behavioural journals suggested that the use of this technique remains widespread: of 65 papers in which a multiple regression approach was used, 57% of studies used a stepwise procedure. The principal drawbacks of stepwise multiple regression include bias in parameter estimation, inconsistencies among model selection algorithms, an inherent (but often overlooked) problem of multiple hypothesis testing, and an inappropriate focus or reliance on a single best model. We discuss each of these issues with examples. We use a worked example of data on yellowhammer distribution collected over 4 years to highlight the pitfalls of stepwise regression. We show that stepwise regression allows models containing significant predictors to be obtained from each year's data. In spite of the significance of the selected models, they vary substantially between years and suggest patterns that are at odds with those determined by analysing the full, 4‐year data set. An information theoretic (IT) analysis of the yellowhammer data set illustrates why the varying outcomes of stepwise analyses arise. In particular, the IT approach identifies large numbers of competing models that could describe the data equally well, showing that no one model should be relied upon for inference.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,737
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Hahn, G. J., Draper, N., & Smith, H. (1982) · Technometrics · doi:10.2307/1267833 · Cited by 5,773
Model Selection and Multimodel Inference
(2003) · Technometrics · doi:10.1198/tech.2003.s146 · Cited by 5,449
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.
Tufte, E. R., Cohen, J., & Cohen, P. (1979) · Journal of the American Statistical Association · doi:10.2307/2286442 · Cited by 5,180
Generalized Linear Models (2nd ed.).
Therneau, T. M., McCullagh, P., & Nelder, J. A. (1993) · Journal of the American Statistical Association · doi:10.2307/2290358 · Cited by 4,907
Model Selection and Inference: A Practical Information-Theoretic Approach
Strawderman, R. L., Burnham, K. P., & Anderson, D. R. (2000) · Journal of the American Statistical Association · doi:10.2307/2669574 · Cited by 4,194
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Model selection in ecology and evolution
Johnson, J. B., & Omland, K. S. (2004) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2003.10.013 · Cited by 3,838
Burnham, K. P., & Anderson, D. R. (1998) · doi:10.1007/978-1-4757-2917-7 · Cited by 3,387
Applied Regression Analysis (2nd ed).
de Carvalho, J. F., Draper, N. R., & Smith, H. (1981) · Journal of the American Statistical Association · doi:10.2307/2287608 · Cited by 3,044
Null Hypothesis Testing: Problems, Prevalence, and an Alternative
Anderson, D. R., Burnham, K. P., & Thompson, W. L. (2000) · The Journal of Wildlife Management · doi:10.2307/3803199 · Cited by 1,930
Generalized Linear Models, 2nd Edn.
Cheek, P. J., McCullagh, P., & Nelder, J. A. (1990) · Applied Statistics · doi:10.2307/2347392 · Cited by 1,512
The Insignificance of Statistical Significance Testing
Johnson, D. H. (1999) · The Journal of Wildlife Management · doi:10.2307/3802789 · Cited by 1,104
Applied Multiple Regression/Correlation Analysis for the Behavioural Sciences.
Goldstein, H., Cohen, J., & Cohen, P. (1976) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344367 · Cited by 1,036
The case against statistical significance testing
Carver, R. (1978) · Harvard Educational Review · doi:10.17763/haer.48.3.t490261645281841 · Cited by 931
Derksen, S., & Keselman, H. J. (1992) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1992.tb00992.x · Cited by 771
(2002) · Cited by 603
New paradigms for modelling species distributions?
Rushton, S. P., Ormerod, S. J., & Kerby, G. (2004) · Journal of Applied Ecology · doi:10.1111/j.0021-8901.2004.00903.x · Cited by 585
Modern Statistics for the Life Sciences
Sissons, S. (2003) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1111/1467-9884.00369_10 · Cited by 565
Stepwise Selection in Small Data Sets A Simulation Study of Bias in Logistic Regression Analysis
Steyerberg, E. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00103-1 · Cited by 495
Johnson, C. J., Seip, D. R., & Boyce, M. S. (2004) · Journal of Applied Ecology · doi:10.1111/j.0021-8901.2004.00899.x · Cited by 375
Information theory and hypothesis testing: a call for pluralism
STEPHENS, P. A., BUSKIRK, S. W., HAYWARD, G. D., & MARTÍNEZ DEL RIO, C. (2005) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2005.01002.x · Cited by 360
Self-citationThe Impact of Model Selection on Inference in Linear Regression
Hurvich, C. M., & Tsai, C. (1990) · The American Statistician · doi:10.1080/00031305.1990.10475722 · Cited by 298
The Use of Bayesian Model Averaging to Better Represent Uncertainty in Ecological Models
WINTLE, B. A., McCARTHY, M. A., VOLINSKY, C. T., & KAVANAGH, R. P. (2003) · Conservation Biology · doi:10.1111/j.1523-1739.2003.00614.x · Cited by 286
WHITTINGHAM, M. J., SWETNAM, R. D., WILSON, J. D., CHAMBERLAIN, D. E., & FRECKLETON, R. P. (2005) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2005.01007.x · Cited by 183
Self-citationHabitat associations and breeding success of yellowhammers on lowland farmland
Bradbury, R. B., Kyrkos, A., Morris, A. J., Clark, S. C., Perkins, A. J., & Wilson, J. D. (2000) · Journal of Applied Ecology · doi:10.1046/j.1365-2664.2000.00552.x · Cited by 179
Self-citationRules of thumb for judging ecological theories
Ginzburg, L. R., & Jensen, C. X. J. (2004) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2003.11.004 · Cited by 167
INVITED PAPER: INFORMATION THEORY IN WILDLIFE SCIENCE: CRITIQUE AND VIEWPOINT
GUTHERY, F. S., BRENNAN, L. A., PETERSON, M. J., & LUSK, J. J. (2005) · Journal of Wildlife Management · doi:10.2193/0022-541x(2005)069[0457:itiwsc]2.0.co;2 · Cited by 164
Problem Solving: A Statistician's Guide.
Kafandaris, S. P., & Chatfield, C. (1996) · Journal of the Operational Research Society · doi:10.2307/3010293 · Cited by 141
Tests of significance in stepwise regression.
Wilkinson, L. (1979) · Psychological Bulletin · doi:10.1037//0033-2909.86.1.168 · Cited by 139
Chatfield, C. (1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b15238 · Cited by 103
LARGE-SCALE SPATIAL GRADIENTS IN HERBIVORE POPULATION DYNAMICS
Post, E. (2005) · Ecology · doi:10.1890/04-0823 · Cited by 75
Cited by
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910
Species Distribution Models: Ecological Explanation and Prediction Across Space and Time
Elith, J., & Leathwick, J. R. (2009) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev.ecolsys.110308.120159 · Cited by 6,707
A working guide to boosted regression trees
Elith, J., Leathwick, J. R., & Hastie, T. (2008) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2008.01390.x · Cited by 6,484
Burnham, K. P., Anderson, D. R., & Huyvaert, K. P. (2011) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-010-1029-6 · Cited by 4,104
Effect size, confidence interval and statistical significance: a practical guide for biologists
Nakagawa, S., & Cuthill, I. C. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00027.x · Cited by 3,835
Metadata
- Authors
- WHITTINGHAM, M. J., STEPHENS, P. A., BRADBURY, R. B., & FRECKLETON, R. P.
- Venue
- Journal of Animal Ecology
- Publisher
- Wiley
- Published
- 2006-07-21
- Volume
- 75
- Issue
- 5
- Pages
- 1182-1189
- ISSN
- 0021-8790 (ISSN-L)
- 1365-2656
- OpenAlex
- W1599304806
- Cited by
- 1,520
- References
- 37
- FWCI
- 53.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.