The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
A practical guide to selecting models for exploration, inference, and prediction in ecology
Open accessAbstract
Selecting among competing statistical models is a core challenge in science. However, the many possible approaches and techniques for model selection, and the conflicting recommendations for their use, can be confusing. We contend that much confusion surrounding statistical model selection results from failing to first clearly specify the purpose of the analysis. We argue that there are three distinct goals for statistical modeling in ecology: data exploration, inference, and prediction. Once the modeling goal is clearly articulated, an appropriate model selection procedure is easier to identify. We review model selection approaches and highlight their strengths and weaknesses relative to each of the three modeling goals. We then present examples of modeling for exploration, inference, and prediction using a time series of butterfly population counts. These show how a model selection approach flows naturally from the modeling goal, leading to different models selected for different purposes, even with exactly the same data set. This review illustrates best practices for ecologists and should serve as a reminder that statistical recipes cannot substitute for critical thinking or for the use of independent data to test hypotheses and validate predictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
The Unified Neutral Theory of Biodiversity and Biogeography
Jetschke, G. (2002) · Ecology · doi:10.1890/0012-9658(2002)083[1771:tuntob]2.0.co;2 · Cited by 6,993
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
(2015) · doi:10.1007/s11222-016-9696-4 · Cited by 5,611
Model Selection and Multimodel Inference
(2003) · Technometrics · doi:10.1198/tech.2003.s146 · Cited by 5,449
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118
Cross‐validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure
Roberts, D. R., Bahn, V., Ciuti, S., Boyce, M. S., Elith, J., Guillera‐Arroita, G., Hauenstein, S., Lahoz‐Monfort, J. J., Schröder, B., Thuiller, W., et al. (2017) · Ecography · doi:10.1111/ecog.02881 · Cited by 3,689
An Introduction to Statistical Learning: with Applications in R
James, G. M., Witten, D., Hastie, T. J., & Tibshirani, R. J. (2018) · doi:10.25334/q4ht55 · Cited by 2,912
Shmueli, G. (2010) · Statistical Science · doi:10.1214/10-sts330 · Cited by 2,517
Meinshausen, N., & Bühlmann, P. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00740.x · Cited by 2,215
Understanding predictive information criteria for Bayesian models
Gelman, A., Hwang, J., & Vehtari, A. (2014) · Statistics and Computing · doi:10.1007/s11222-013-9416-2 · Cited by 2,104
Machine Learning: An Applied Econometric Approach
Mullainathan, S., & Spiess, J. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.87 · Cited by 1,989
Statistical Rethinking: A Bayesian Course with Examples in R and Stan
McElreath, R. (2020) · doi:10.1201/9780429029608 · Cited by 1,959
Sohil, F., Sohali, M. U., & Shabbir, J. (2022) · Statistical Theory and Related Fields · doi:10.1080/24754269.2021.1980261 · Cited by 1,624
An outline of the dynamics of animal populations.
Nicholson, A. (1954) · Australian Journal of Zoology · doi:10.1071/zo9540009 · Cited by 1,318
(1998) · Springer Texts in Statistics · doi:10.1007/b98890 · Cited by 1,069
Statistical Rethinking: A Bayesian Course with Examples in R and Stan
McElreath, R. L. (2015) · Helmholtz Centre for Ocean Research Kiel (GEOMAR) · Cited by 996
Ecological Forecasts: An Emerging Imperative
Clark, J. S., Carpenter, S. R., Barber, M., Collins, S., Dobson, A., Foley, J. A., Lodge, D. M., Pascual, M., Pielke, R., Pizer, W., et al. (2001) · Science · doi:10.1126/science.293.5530.657 · Cited by 913
A guide to Bayesian model selection for ecologists
Hooten, M. B., & Hobbs, N. T. (2015) · Ecological Monographs · doi:10.1890/14-0661.1 · Cited by 891
Neutral theory and relative species abundance in ecology
Volkov, I., Banavar, J. R., Hubbell, S. P., & Maritan, A. (2003) · Nature · doi:10.1038/nature01883 · Cited by 840
A Widely Applicable Bayesian Information Criterion
Watanabe, S. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1208.6338 · Cited by 719
Grassland productivity limited by multiple nutrients
Fay, P. A., Prober, S. M., Harpole, W. S., Knops, J. M. H., Bakker, J. D., Borer, E. T., Lind, E. M., MacDougall, A. S., Seabloom, E. W., Wragg, P. D., et al. (2015) · Nature Plants · doi:10.1038/nplants.2015.80 · Cited by 624
Self-citationIterative near-term ecological forecasting: Needs, opportunities, and challenges
Dietze, M. C., Fox, A., Beck-Johnson, L. M., Betancourt, J. L., Hooten, M. B., Jarnevich, C. S., Keitt, T. H., Kenney, M. A., Laney, C. M., Larsen, L. G., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710231115 · Cited by 604
Self-citationPenalized regression, standard errors, and Bayesian lassos
Casella, G., Ghosh, M., Gill, J., & Kyung, M. (2010) · Bayesian Analysis · doi:10.1214/10-ba607 · Cited by 567
A significance test for the lasso
Lockhart, R., Taylor, J., Tibshirani, R. J., & Tibshirani, R. (2014) · The Annals of Statistics · doi:10.1214/13-aos1175 · Cited by 541
Finding generality in ecology: a model for globally distributed experiments
Borer, E. T., Harpole, W. S., Adler, P. B., Lind, E. M., Orrock, J. L., Seabloom, E. W., & Smith, M. D. (2014) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12125 · Cited by 508
Self-citationLindley, D. V. (2000) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1111/1467-9884.00238 · Cited by 431
Adding Spatially-Correlated Errors Can Mess Up the Fixed Effect You Love
Hodges, J. S., & Reich, B. J. (2010) · The American Statistician · doi:10.1198/tast.2010.10052 · Cited by 419
Statistical learning and selective inference
Taylor, J., & Tibshirani, R. J. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1507583112 · Cited by 398
MODEL WEIGHTS AND THE FOUNDATIONS OF MULTIMODEL INFERENCE
Link, W. A., & Barker, R. J. (2006) · Ecology · doi:10.1890/0012-9658(2006)87[2626:mwatfo]2.0.co;2 · Cited by 398
A lasso for hierarchical interactions
Bien, J., Taylor, J., & Tibshirani, R. (2013) · The Annals of Statistics · doi:10.1214/13-aos1096 · Cited by 359
The ecological forecast horizon, and examples of its uses and determinants
Petchey, O. L., Pontarp, M., Massie, T. M., Kéfi, S., Ozgul, A., Weilenmann, M., Palamara, G. M., Altermatt, F., Matthews, B., Levine, J. M., et al. (2015) · Ecology Letters · doi:10.1111/ele.12443 · Cited by 348
Veloz, S. D., Williams, J. W., Blois, J. L., He, F., Otto‐Bliesner, B., & Liu, Z. (2012) · Global Change Biology · doi:10.1111/j.1365-2486.2011.02635.x · Cited by 331
Density dependence explains tree species abundance and diversity in tropical forests
Volkov, I., Banavar, J. R., He, F., Hubbell, S. P., & Maritan, A. (2005) · Nature · doi:10.1038/nature04030 · Cited by 329
Identifying the best climatic predictors in ecology and evolution
van de Pol, M., Bailey, L. D., McLean, N., Rijsdijk, L., Lawson, C. R., & Brouwer, L. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12590 · Cited by 303
Radchuk, V., Turlure, C., & Schtickzelle, N. (2013) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2012.02029.x · Cited by 248
The priority of prediction in ecological understanding
Houlahan, J. E., McKinney, S. T., Anderson, T. M., & McGill, B. J. (2017) · Oikos · doi:10.1111/oik.03726 · Cited by 237
Contrasting relationships between precipitation and species richness in space and time
Adler, P. B., & Levine, J. M. (2007) · Oikos · doi:10.1111/j.0030-1299.2007.15327.x · Cited by 229
Self-citationclimwin: An R Toolbox for Climate Window Analysis
Bailey, L. D., & van de Pol, M. (2016) · PLOS ONE · doi:10.1371/journal.pone.0167980 · Cited by 207
Waves of Larch Budmoth Outbreaks in the European Alps
Bjørnstad, O. N., Peltonen, M., Liebhold, A. M., & Baltensweiler, W. (2002) · Science · doi:10.1126/science.1075182 · Cited by 206
Bayesian Measures of Model Complexity and Fit
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00353 · Cited by 151
Sequential Selection Procedures and False Discovery Rate Control
G’Sell, M., Wager, S., Chouldechova, A., & Tibshirani, R. J. (2015) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12122 · Cited by 150
Climate influences the demography of three dominant sagebrush steppe plants
Dalgleish, H. J., Koons, D. N., Hooten, M. B., Moffet, C. A., & Adler, P. B. (2010) · Ecology · doi:10.1890/10-0780.1 · Cited by 126
Self-citationWhen mechanism matters: Bayesian forecasting using models of ecological diffusion
Hefley, T. J., Hooten, M. B., Russell, R. E., Walsh, D. P., & Powell, J. A. (2017) · Ecology Letters · doi:10.1111/ele.12763 · Cited by 102
Efficient Leave-One-Out Cross-Validation and WAIC for Bayesian Models [R package loo version 2.4.1]
Vehtari, A., Gabry, J., Magnusson, M., Yao, Y., Bürkner, P., Paananen, T., & Gelman, A. (2020) · Cited by 83
Forecasting biodiversity in breeding birds using best practices
Harris, D. J., Taylor, S. D., & White, E. P. (2018) · PeerJ · doi:10.7717/peerj.4278 · Cited by 78
Resolving misaligned spatial data with integrated species distribution models
Pacifici, K., Reich, B. J., Miller, D. A. W., & Pease, B. S. (2019) · Ecology · doi:10.1002/ecy.2709 · Cited by 76
Linking demography with drivers: climate and competition
Teller, B. J., Adler, P. B., Edwards, C. B., Hooker, G., & Ellner, S. P. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12486 · Cited by 70
Self-citationDo we need demographic data to forecast plant population dynamics?
Tredennick, A. T., Hooten, M. B., & Adler, P. B. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12686 · Cited by 61
Self-citationInference After Model Selection
Shen, X., Huang, H., & Ye, J. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000001097 · Cited by 58
P values, hypothesis testing, and model selection: it's déjà vu all over again1
Ellison, A. M., Gotelli, N. J., Inouye, B. D., & Strong, D. R. (2014) · Ecology · doi:10.1890/13-1911.1 · Cited by 41
Gerber, B. D., Kendall, W. L., Hooten, M. B., Dubovsky, J. A., & Drewien, R. C. (2015) · Journal of Animal Ecology · doi:10.1111/1365-2656.12370 · Cited by 39
The Bayesian Group Lasso for Confounded Spatial Data
Hefley, T. J., Hooten, M. B., Hanks, E. M., Russell, R. E., & Walsh, D. P. (2017) · Journal of Agricultural Biological and Environmental Statistics · doi:10.1007/s13253-016-0274-1 · Cited by 37
Iterating on a single model is a viable alternative to multimodel inference
Hoef, J. M. V., & Boveng, P. L. (2015) · Journal of Wildlife Management · doi:10.1002/jwmg.891 · Cited by 35
Transferability of predictive models of coral reef fish species richness
Sequeira, A. M. M., Mellin, C., Lozano‐Montes, H., Vanderklift, M. A., Babcock, R. C., Haywood, M. D. E., Meeuwig, J. J., & Caley, M. J. (2015) · Journal of Applied Ecology · doi:10.1111/1365-2664.12578 · Cited by 31
Cited by
Lai, J., Zou, Y., Zhang, J., & Peres‐Neto, P. R. (2022) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13800 · Cited by 1,264
Rewriting results sections in the language of evidence
Muff, S., Nilsen, E. B., O’Hara, R. B., & Nater, C. R. (2022) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2021.10.009 · Cited by 636
Cross validation for model selection: A review with examples from ecology
Yates, L. A., Aandahl, Z., Richards, S. A., & Brook, B. W. (2023) · Ecological Monographs · doi:10.1002/ecm.1557 · Cited by 459
Metadata
- Authors
- Tredennick, A. T., Hooker, G., Ellner, S. P., & Adler, P. B.
- Venue
- Ecology
- Publisher
- Wiley
- Published
- 2021-05-04
- Volume
- 102
- Issue
- 6
- Pages
- e03336-e03336
- ISSN
- 0012-9658 (ISSN-L)
- 1939-9170
- OpenAlex
- W3134372267
- Cited by
- 474
- References
- 64
- FWCI
- 48.47
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.