The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
A guide to Bayesian model selection for ecologists
Abstract
The steady upward trend in the use of model selection and Bayesian methods in ecological research has made it clear that both approaches to inference are important for modern analysis of models and data. However, in teaching Bayesian methods and in working with our research colleagues, we have noticed a general dissatisfaction with the available literature on Bayesian model selection and multimodel inference. Students and researchers new to Bayesian methods quickly find that the published advice on model selection is often preferential in its treatment of options for analysis, frequently advocating one particular method above others. The recent appearance of many articles and textbooks on Bayesian modeling has provided welcome background on relevant approaches to model selection in the Bayesian framework, but most of these are either very narrowly focused in scope or inaccessible to ecologists. Moreover, the methodological details of Bayesian model selection approaches are spread thinly throughout the literature, appearing in journals from many different fields. Our aim with this guide is to condense the large body of literature on Bayesian approaches to model selection and multimodel inference and present it specifically for quantitative ecologists as neutrally as possible. We also bring to light a few important and fundamental concepts relating directly to model selection that seem to have gone unnoticed in the ecological literature. Throughout, we provide only a minimal discussion of philosophy, preferring instead to examine the breadth of approaches as well as their practical advantages and disadvantages. This guide serves as a reference for ecologists using Bayesian methods, so that they can better understand their options and can make an informed choice that is best aligned with their goals for inference.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
Sampling-based approaches to calculating marginal densities
Gelfand, A. E., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10476213 · Cited by 6,606
Pattern Recognition and Neural Networks
Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,459
Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
GREEN, P. J. (1995) · Biometrika · doi:10.1093/biomet/82.4.711 · Cited by 5,930
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
Model Selection and Multimodel Inference
(2003) · Technometrics · doi:10.1198/tech.2003.s146 · Cited by 5,449
ESTIMATING SITE OCCUPANCY RATES WHEN DETECTION PROBABILITIES ARE LESS THAN ONE
MacKenzie, D. I., Nichols, J. D., Lachman, G. B., Droege, S., Andrew Royle, J., & Langtimm, C. A. (2002) · Ecology · doi:10.1890/0012-9658(2002)083[2248:esorwd]2.0.co;2 · Cited by 4,481
Ziegel, E. R., Lehmann, E. L., & Casella, G. (1999) · Technometrics · doi:10.2307/1270597 · Cited by 4,203
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118 · cited 2×
“Hoeting et al. (1999) provided a good summary of methods for approximating model weights that have a formal justification.”
BackgroundMethodModel selection in ecology and evolution
Johnson, J. B., & Omland, K. S. (2004) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2003.10.013 · Cited by 3,838
Bayesian Analysis of Binary and Polychotomous Response Data
Albert, J. H., & Chib, S. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476321 · Cited by 3,167
Park, T., & Casella, G. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000337 · Cited by 2,934
Variable Selection via Gibbs Sampling
George, E. I., & McCulloch, R. E. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476353 · Cited by 2,828
CONFRONTING MULTICOLLINEARITY IN ECOLOGICAL MULTIPLE REGRESSION
Graham, M. H. (2003) · Ecology · doi:10.1890/02-3114 · Cited by 2,536
Watanabe, S. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1004.2316 · Cited by 2,226
Bernardo, J. M., & Smith, A. F. M. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316870 · Cited by 2,178
Understanding predictive information criteria for Bayesian models
Gelman, A., Hwang, J., & Vehtari, A. (2014) · Statistics and Computing · doi:10.1007/s11222-013-9416-2 · Cited by 2,104
Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
Diciccio, T. J., Kass, R. E., Raftery, A., & Wasserman, L. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474045 · Cited by 1,943
ESTIMATING SITE OCCUPANCY, COLONIZATION, AND LOCAL EXTINCTION WHEN A SPECIES IS DETECTED IMPERFECTLY
MacKenzie, D. I., Nichols, J. D., Hines, J. E., Knutson, M. G., & Franklin, A. B. (2003) · Ecology · doi:10.1890/02-3090 · Cited by 1,741
(1998) · Springer Texts in Statistics · doi:10.1007/b98854 · Cited by 1,719
Subset Selection in Regression
(2003) · Technometrics · doi:10.1198/tech.2003.s144 · Cited by 1,463
Ecological Models and Data in R
Bolker, B. M. (2008) · Princeton University Press eBooks · doi:10.1515/9781400840908 · Cited by 1,411
A Primer of Ecological Statistics
Gotelli, N. J., & Ellison, A. M. (2004) · Cited by 1,312
Ecological models and data in R
Bolker, B. M. (2008) · doi:10.2307/j.ctvcm4g37 · Cited by 1,297 · cited 1×
“Gotelli and Ellison (2012) and Bolker (2008) provide excellent background on contemporary ecological statistics, and from a Bayesian perspective see Clark (2007), Royle and Dorazio (2008), Link and Barker (2010), and Hobbs and Hooten (in press).”
BackgroundAn asymptotic equivalence of choice of model by cross validation and Akaike's criterion
Stone, M. (1977) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1977.tb01603.x · Cited by 1,286
Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
Madigan, D., & Raftery, A. E. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476894 · Cited by 1,205 · cited 2×
“Furthermore, BMA performed on a set of models M yields better inference about g than any one of the models alone (Madigan and Raftery 1994), thus we have a compelling reason to use it.”
MethodMaking and Evaluating Point Forecasts
Gneiting, T. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.r10138 · Cited by 1,154
Bayesian Model Choice Via Markov Chain Monte Carlo Methods
Carlin, B. P., & Chib, S. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02042.x · Cited by 989
Zero tolerance ecology: improving ecological inference by modelling the source of zero observations
Martin, T. G., Wintle, B. A., Rhodes, J. R., Kuhnert, P. M., Field, S. A., Low‐Choy, S. J., Tyre, A. J., & Possingham, H. P. (2005) · Ecology Letters · doi:10.1111/j.1461-0248.2005.00826.x · Cited by 935
Subset Selection in Regression
Miller, A. (2002) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420035933 · Cited by 929
Predictive Inference: An Introduction
Geisser, S. (1993) · Springer eBooks · doi:10.1007/978-1-4899-4467-2 · Cited by 917
Deviance information criteria for missing data models
Celeux, G., Forbes, F., Robert, C. P., & Titterington, D. M. (2006) · Bayesian Analysis · doi:10.1214/06-ba122 · Cited by 896
Why environmental scientists are becoming Bayesians
Clark, J. S. (2005) · Ecology Letters · doi:10.1111/j.1461-0248.2004.00702.x · Cited by 862
Philosophy and the practice of Bayesian statistics
Gelman, A., & Shalizi, C. R. (2013) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2011.02037.x · Cited by 825 · cited 1×
“…arguments pertaining to model selection and multimodel inference we refer the interested reader to several excellent sources, including Gelman and Shalizi (2012) and J. M. Ver Hoef and P. L. Boveng (unpublished manuscript), who discuss when and why one should use model selection…”
BackgroundA review of Bayesian variable selection methods: what, how and which
O'Hara, R. B., & Sillanpää, M. J. (2009) · Bayesian Analysis · doi:10.1214/09-ba403 · Cited by 771
Model choice: a minimum posterior predictive loss approach
Gelfand, A. (1998) · Biometrika · doi:10.1093/biomet/85.1.1 · Cited by 724
A Widely Applicable Bayesian Information Criterion
Watanabe, S. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1208.6338 · Cited by 719
Philosophy and the practice of Bayesian statistics
Gelman, A., & Shalizi, C. R. (2010) · Cited by 709
Nordhausen, K. (2009) · International Statistical Review · doi:10.1111/j.1751-5823.2009.00095_18.x · Cited by 637
Tanner, M. A. (1996) · Springer Series in Statistics · doi:10.1007/978-1-4612-4024-2 · Cited by 630
MTW, & Tanner, M. A. (1997) · Journal of the American Statistical Association · doi:10.2307/2965746 · Cited by 608
(2017) · Routledge eBooks · doi:10.1201/9780203742310 · Cited by 568
Expected Information as Expected Utility
Bernardo, J. M. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344689 · Cited by 568
Penalized regression, standard errors, and Bayesian lassos
Casella, G., Ghosh, M., Gill, J., & Kyung, M. (2010) · Bayesian Analysis · doi:10.1214/10-ba607 · Cited by 567
Cressie, N., Calder, C. A., Clark, J. S., Hoef, J. M. V., & Wikle, C. K. (2009) · Ecological Applications · doi:10.1890/07-0744.1 · Cited by 541
Bayesian data analysis, third edition
Gelman, A., Carlin, J. B., Stern, H., Dunson, D., Vehtari, A., & Rubin, D. (2013) · Cited by 488
VARIABLE SELECTION IN REGRESSION MODELS
Rao, M. S., & M.Venkataramanaih, M. S. (2013) · International Journal of Research in Commerce, IT and Management · Cited by 473
Predictive Model Assessment for Count Data
Czado, C., Gneiting, T., & Held, L. (2009) · Biometrics · doi:10.1111/j.1541-0420.2009.01191.x · Cited by 464
On Bayesian model and variable selection using MCMC
Dellaportas, P., Forster, J. J., & Ntzoufras, I. (2002) · Statistics and Computing · doi:10.1023/a:1013164120801 · Cited by 448
Explaining Variational Approximations
Ormerod, J. T., & Wand, M. P. (2010) · The American Statistician · doi:10.1198/tast.2010.09058 · Cited by 401
MODEL WEIGHTS AND THE FOUNDATIONS OF MULTIMODEL INFERENCE
Link, W. A., & Barker, R. J. (2006) · Ecology · doi:10.1890/0012-9658(2006)87[2626:mwatfo]2.0.co;2 · Cited by 398
Penalized loss functions for Bayesian model comparison
Plummer, M. (2008) · Biostatistics · doi:10.1093/biostatistics/kxm049 · Cited by 392
Hierarchical Modeling and Inference in Ecology
(2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374097-7.x0001-4 · Cited by 364
Laud, P. W., & Ibrahim, J. G. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02028.x · Cited by 350
A survey of Bayesian predictive methods for model assessment, selection and comparison
Vehtari, A., & Ojanen, J. (2012) · Statistics Surveys · doi:10.1214/12-ss102 · Cited by 348
Bayesian Inference: With Ecological Applications
Link, W. A., & Barker, R. (2009) · Cited by 334
Occupancy Estimation and Modeling
Peterson, J. T., & Mordecai, R. S. (2006) · The Auk · doi:10.1093/auk/123.4.1201 · Cited by 293
Bayes Factors for Linear and Log‐Linear Models with Vague Prior Information
Spiegelhalter, D. J., & Smith, A. F. M. (1982) · Journal of the Royal Statistical Society: Series B (Methodological) · doi:10.1111/j.2517-6161.1982.tb01217.x · Cited by 289
On the Relationship Between Markov chain Monte Carlo Methods for Model Uncertainty
Godsill, S. J. (2001) · Journal of Computational and Graphical Statistics · doi:10.1198/10618600152627924 · Cited by 281
Occupancy Estimation and Modeling
(2018) · Elsevier eBooks · doi:10.1016/c2012-0-01164-7 · Cited by 281
Models for Ecological Data: An Introduction
Clark, J. S. (2007) · Princeton University Press eBooks · doi:10.1515/9780691220123 · Cited by 277
Models for Ecological Data: An Introduction
Clark, J. S. (2007) · Cited by 205
Posterior and Cross-validatory Predictive Checks: A Comparison of MCMC and INLA
Held, L., Schrödle, B., & Rue, H. (2010) · Statistical Modelling and Regression Structures · doi:10.1007/978-3-7908-2413-1_6 · Cited by 204
The Conditional Predictive Ordinate for the Normal Distribution
Pettit, L. I. (1990) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1990.tb01780.x · Cited by 199
Spatial occupancy models for large data sets
Johnson, D. S., Conn, P. B., Hooten, M. B., Ray, J. C., & Pond, B. A. (2013) · Ecology · doi:10.1890/12-0564.1 · Cited by 170
Self-citationIntroduction to WinBUGS for Ecologists
(2010) · Elsevier eBooks · doi:10.1016/c2009-0-30639-x · Cited by 170
Monitoring programs need to take into account imperfect species detectability
Kéry, M., & Schmid, H. (2004) · Basic and Applied Ecology · doi:10.1078/1439-1791-00194 · Cited by 151
Bayesian Measures of Model Complexity and Fit
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00353 · Cited by 151
Prediction via Orthogonalized Model Mixing
Clyde, M., Desimone, H., & Parmigiani, G. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476989 · Cited by 145
Models for inference in dynamic metacommunity systems
Dorazio, R. M., Kéry, M., Royle, J. A., & Plattner, M. (2010) · Ecology · doi:10.1890/09-1033.1 · Cited by 123
Consistent High-Dimensional Bayesian Variable Selection via Penalized Credible Regions
Bondell, H. D., & Reich, B. J. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.716344 · Cited by 119
Model choice using reversible jump Markov chain Monte Carlo
Hastie, D. I., & Green, P. J. (2012) · Statistica Neerlandica · doi:10.1111/j.1467-9574.2012.00516.x · Cited by 116
Hidden Dangers of Specifying Noninformative Priors
Seaman, J. W., Seaman, J. W., & Stamey, J. D. (2012) · The American Statistician · doi:10.1080/00031305.2012.695938 · Cited by 89
Theory of Probability Harold Jeffreys (Third edition, 447 + ix pp., Oxford Univ. Press, 84s.)
Good, I. J. (1962) · Geophysical Journal International · doi:10.1093/gji.6.4.555 · Cited by 86
Hooten, M. B., Larsen, D. R., & Wikle, C. K. (2003) · Landscape Ecology · doi:10.1023/a:1026001008598 · Cited by 76
Self-citationGhosh, J., & Clyde, M. A. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm10518 · Cited by 61
Garrard, G. E., Mccarthy, M. A., Vesk, P. A., Radford, J. Q., & Bennett, A. F. (2011) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2011.01891.x · Cited by 59
Predictive likelihood for Bayesian model selection and averaging
Ando, T., & Tsay, R. S. (2009) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2009.08.001 · Cited by 58
Assessing First-Order Emulator Inference for Physical Parameters in Nonlinear Mechanistic Models
Hooten, M. B., Leeds, W. B., Fiechter, J., & Wikle, C. K. (2011) · Journal of Agricultural Biological and Environmental Statistics · doi:10.1007/s13253-011-0073-7 · Cited by 54
Self-citationA Gibbs sampler for Bayesian analysis of site‐occupancy data
Dorazio, R. M., & Taylor‐Rodríguez, D. (2012) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2012.00237.x · Cited by 32
Learning hierarchical models: advice for the rest of us
Bolker, B. M. (2009) · Ecological Applications · doi:10.1890/08-0639.1 · Cited by 29
Bayesian Multimodel Inference for Geostatistical Regression Models
Johnson, D. S., & Hoeting, J. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025677 · Cited by 13
Cited by
Zoonotic host diversity increases in human-dominated ecosystems
Gibb, R., Redding, D. W., Chin, K. Q., Donnelly, C. A., Blackburn, T. M., Newbold, T., & Jones, K. E. (2020) · Nature · doi:10.1038/s41586-020-2562-8 · Cited by 880
Thermal biology of mosquito‐borne disease
Mordecai, E. A., Caldwell, J. M., Grossman, M. K., Lippi, C. A., Johnson, L. R., Neira, M., Rohr, J. R., Ryan, S. J., Savage, V., Shocket, M. S., et al. (2019) · Ecology Letters · doi:10.1111/ele.13335 · Cited by 746
Fish reproductive-energy output increases disproportionately with body size
Barneche, D. R., Robertson, D. R., White, C. R., & Marshall, D. J. (2018) · Science · doi:10.1126/science.aao6868 · Cited by 643
Iterative near-term ecological forecasting: Needs, opportunities, and challenges
Dietze, M. C., Fox, A., Beck-Johnson, L. M., Betancourt, J. L., Hooten, M. B., Jarnevich, C. S., Keitt, T. H., Kenney, M. A., Laney, C. M., Larsen, L. G., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710231115 · Cited by 604
Self-citationStudds, C. E., Kendall, B. E., Murray, N. J., Wilson, H. B., Rogers, D. I., Clemens, R. S., Gosbell, K., Hassell, C. J., Jessop, R., Melville, D. S., et al. (2017) · Nature Communications · doi:10.1038/ncomms14895 · Cited by 564
Metadata
- Authors
- Hooten, M. B., & Hobbs, N. T.
- Venue
- Ecological Monographs
- Publisher
- Wiley
- Published
- 2015-02
- Volume
- 85
- Issue
- 1
- Pages
- 3-28
- ISSN
- 0012-9615 (ISSN-L)
- 1557-7015
- OpenAlex
- W2048776980
- Cited by
- 891
- References
- 87
- FWCI
- 64.27
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.