The DOI matches its Crossref record; 162 of the 162 references it cites were found in a registry or an index.
A survey of Bayesian predictive methods for model assessment, selection and comparison
Open accessAbstract
To date, several methods exist in the statistical literature for model assessment, which purport themselves specifically as Bayesian predictive methods. The decision theoretic assumptions on which these methods are based are not always clearly stated in the original articles, however. The aim of this survey is to provide a unified review of Bayesian predictive model assessment and selection methods, and of methods closely related to them. We review the various assumptions that are made in this context and discuss the connections between different approaches, with an emphasis on how each method approximates the expected utility of using a Bayesian model for the purpose of predicting future data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Cross validatory choice and assessment of statistical predictions
Stone, M. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00994.x · Cited by 10,881
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
Regression and time series model selection in small samples
HURVICH, C. M., & TSAI, C.-L. (1989) · Biometrika · doi:10.1093/biomet/76.2.297 · Cited by 6,586
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
ANew Look at the Statistical Model Identification
AKAlKE, H. (2011) · Cited by 4,177
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118 · cited 1×
“…alternative models {Mk}Kk=1 and a corresponding prior p(Mk) on that set have been specified, one can integrate over the models and thereby arrive at the Bayesian model averaging (BMA) (e.g. Hoeting et al., 1999) predictive distribution pBMA(ỹ|x̃, D) = K∑ k=1 p(ỹ|x̃, D,Mk)p(Mk|D), (4) where p(Mk”
BackgroundApproximate Statistical Tests for Comparing Supervised Classification Learning Algorithms
Dietterich, T. G. (1998) · Neural Computation · doi:10.1162/089976698300017197 · Cited by 3,840
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
A survey of cross-validation procedures for model selection
Arlot, S., & Célisse, A. (2010) · LillOA (Université de Lille (University Of Lille)) · Cited by 3,669
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522
Burnham, K. P., & Anderson, D. R. (1998) · doi:10.1007/978-1-4757-2917-7 · Cited by 3,387
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_38 · Cited by 3,028
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
Variable Selection via Gibbs Sampling
George, E. I., & McCulloch, R. E. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476353 · Cited by 2,828
The Predictive Sample Reuse Method with Applications
Geisser, S. (1975) · Journal of the American Statistical Association · doi:10.1080/01621459.1975.10479865 · Cited by 2,748 · cited 4×
“Vlachos and Gelfand (2003) estimate calibration by replicating datasets of size n from the posterior predictive distribution of the model M . In case of pairwise model selection, they replicate datasets from both models and plot the two different summary statistic distributions obtained. They present their method only…”
InfluentialMonte Carlo Strategies in Scientific Computing
Liu, J. S. (2004) · Springer Series in Statistics · doi:10.1007/978-0-387-76371-2 · Cited by 2,690
Bias in error estimation when using cross-validation for model selection
Varma, S., & Simon, R. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-91 · Cited by 2,485 · cited 2×
“Even if the procedure is based on an approach giving unbiased expected utility estimates for any particular model, the data-fitted model selection procedure causes the expected utility estimate of the selected model to be biased (see, for example, Stone, 1974; Rencher and Pun, 1980; Reunanen, 2003; Vehtari and Lampine…”
Watanabe, S. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1004.2316 · Cited by 2,226
Bernardo, J. M., & Smith, A. F. M. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316870 · Cited by 2,178
Applied Statistical Decision Theory
Lindley, D. V., Raiffa, H., & Schlaifer, R. (1962) · Econometrica · doi:10.2307/1909900 · Cited by 2,172
Accurate Approximations for Posterior Moments and Marginal Densities
Tierney, L., & Kadane, J. B. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478240 · Cited by 2,129
Bayes and Empirical Bayes Methods for Data Analysis
(2001) · Technometrics · doi:10.1198/tech.2001.s608 · Cited by 2,098
POSTERIOR PREDICTIVE ASSESSMENT OF MODEL FITNESS VIA REALIZED DISCREPANCIES
Gelman, A., Meng, X., & Stern, H. S. (1996) · Cited by 1,945
Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
Diciccio, T. J., Kass, R. E., Raftery, A., & Wasserman, L. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474045 · Cited by 1,943
(2010) · doi:10.5555/1756006.1859921 · Cited by 1,924
Linear Model Selection by Cross-validation
Shao, J. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476299 · Cited by 1,790
Probabilistic Forecasts, Calibration and Sharpness
Gneiting, T., Balabdaoui, F., & Raftery, A. E. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00587.x · Cited by 1,783
Bayesian Data Analysis, 2nd edn
Brix, A. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2004.00347_4.x · Cited by 1,767
Improving predictive inference under covariate shift by weighting the log-likelihood function
Shimodaira, H. (2000) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(00)00115-4 · Cited by 1,678
Bayesian Inference in Econometric Models Using Monte Carlo Integration
Geweke, J. (1989) · Econometrica · doi:10.2307/1913710 · Cited by 1,563
Approximate Bayesian Inference with the Weighted Likelihood Bootstrap
Newton, M. A., & Raftery, A. E. (1994) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1994.tb01956.x · Cited by 1,487
Estimation of prediction error by using K-fold cross-validation
Fushiki, T. (2011) · Statistics and Computing · doi:10.1007/s11222-009-9153-8 · Cited by 1,470
Bayesian Variable Selection in Linear Regression
Mitchell, T. J., & Beauchamp, J. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478694 · Cited by 1,424
Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician
Rubin, D. B. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346785 · Cited by 1,343
An asymptotic equivalence of choice of model by cross validation and Akaike's criterion
Stone, M. (1977) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1977.tb01603.x · Cited by 1,286
Covariate Shift Adaptation by Importance Weighted Cross Validation
Sugiyama, M., Krauledat, M., & Müller, K. (2007) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · doi:10.5555/1314498.1390324 · Cited by 1,226
Bayesian Model Choice: Asymptotics and Exact Calculations
Gelfand, A. E., & Dey, D. K. (1994) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1994.tb01996.x · Cited by 1,209
Making and Evaluating Point Forecasts
Gneiting, T. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.r10138 · Cited by 1,154
Rubin, D. B. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345338 · Cited by 1,153
Sequential Imputations and Bayesian Missing Data Problems
Kong, A., Liu, J. S., & Wong, W. H. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476469 · Cited by 1,060
Inference for the Generalization Error
Nadeau, C., & Bengio, Y. (2003) · Machine Learning · doi:10.1023/a:1024068626366 · Cited by 1,026
The Intrinsic Bayes Factor for Model Selection and Prediction
Berger, J. O., & Pericchi, L. R. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476668 · Cited by 1,007
A Predictive Approach to Model Selection
Geisser, S., & Eddy, W. F. (1979) · Journal of the American Statistical Association · doi:10.1080/01621459.1979.10481632 · Cited by 988
Good, I. J. (1952) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1952.tb00104.x · Cited by 976
Sampling and Bayes' Inference in Scientific Modelling and Robustness
Box, G. E. P. (1980) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2982063 · Cited by 924
Monte Carlo Methods in Bayesian Computation
Chen, M.-H., Shao, Q.-M., & Ibrahim, J. G. (2000) · Springer Series in Statistics · doi:10.1007/978-1-4612-1276-8 · Cited by 911
Deviance information criteria for missing data models
Celeux, G., Forbes, F., Robert, C. P., & Titterington, D. M. (2006) · Bayesian Analysis · doi:10.1214/06-ba122 · Cited by 896
Optimal predictive model selection
Barbieri, M. M., & Berger, J. O. (2004) · The Annals of Statistics · doi:10.1214/009053604000000238 · Cited by 812
Posterior Predictive $p$-Values
Meng, X.-L. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325622 · Cited by 785
Model choice: a minimum posterior predictive loss approach
Gelfand, A. (1998) · Biometrika · doi:10.1093/biomet/85.1.1 · Cited by 724
Cross-Validatory Choice and Assessment of Statistical Predictions (With Discussion)
Stone, M. (1976) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1976.tb01573.x · Cited by 686
Fractional Bayes Factors for Model Comparison
O'Hagan, A. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02017.x · Cited by 671
Model Determination using Predictive Distributions with Implementation via Sampling-Based Methods
Gelfand, A. E., Dey, D. K., & Chang, H. (1992) · Bayesian Statistics 4 · doi:10.1093/oso/9780198522669.003.0009 · Cited by 656
Murata, N., Yoshizawa, S., & Amari, S. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.329683 · Cited by 645
(1) OPTIMAL PREDICTIVE MODEL SELECTION 1
Barbieri, M. M., Sapienza, U. D. R. “., & Berger, J. O. (2002) · Cited by 640
BURMAN, P. (1989) · Biometrika · doi:10.1093/biomet/76.3.503 · Cited by 634
A Bayesian extension of the minimum AIC procedure of autoregressive model fitting
AKAIKE, H. (1979) · Biometrika · doi:10.1093/biomet/66.2.237 · Cited by 629
Yang, Y. (2005) · Biometrika · doi:10.1093/biomet/92.4.937 · Cited by 605
Expected Information as Expected Utility
Bernardo, J. M. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344689 · Cited by 568
Inference for the Generalization ErrorPreprint
Bengio, Y., & Nadeau, C. (1999) · RePEc: Research Papers in Economics · Cited by 485
Game theory, maximum entropy, minimum discrepancy and robust Bayesian decision theory
Grünwald, P. D., & Dawid, A. P. (2004) · The Annals of Statistics · doi:10.1214/009053604000000553 · Cited by 454
Moody, J. E. (1991) · Cited by 437
Penalized loss functions for Bayesian model comparison
Plummer, M. (2008) · Biostatistics · doi:10.1093/biostatistics/kxm049 · Cited by 392
Information Criteria for Discriminating Among Alternative Regression Models
Sawa, T. (1978) · Econometrica · doi:10.2307/1913828 · Cited by 391
Multivariate Bayesian Variable Selection and Prediction
Brown, P. J., Vannucci, M., & Fearn, T. (1998) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00144 · Cited by 369
Aitkin, M. (1991) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1991.tb01812.x · Cited by 354
Laud, P. W., & Ibrahim, J. G. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02028.x · Cited by 350
P Values for Composite Null Models
Bayarri, M. J., & Berger, J. O. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474309 · Cited by 335
Vehtari, A. (2002) · Journal of the Royal Statistical Society Series B (Methodological) · Cited by 333
Self-citationMinimal Penalties for Gaussian Model Selection
Birgé, L., & Massart, P. (2007) · Probability Theory and Related Fields · doi:10.1007/s00440-006-0011-8 · Cited by 299
Approximations for Binary Gaussian Process Classification
Nickisch, H., & Rasmussen, C. E. (2008) · Cited by 298
On the Development of Reference Priors*
Berger, J. O., & Bernardo, J. M. (1992) · Bayesian Statistics 4 · doi:10.1093/oso/9780198522669.003.0003 · Cited by 287
Bias of the corrected AIC criterion for underfitted regression and time series models
HURVICH, C. M., & TSAI, C.-L. (1991) · Biometrika · doi:10.1093/biomet/78.3.499 · Cited by 285
Estimating the Integrated Likelihood via Posterior Simulation Using the Harmonic Mean Identity
Raftery, A. E., Newton, M. A., Satagopan, J. M., & Krivitsky, P. N. (2007) · Bayesian Statistics 8 · doi:10.1093/oso/9780199214655.003.0015 · Cited by 284
Tutorial on Variational Approximation Methods
Jaakkola, T. S. (2001) · Advanced Mean Field Methods · doi:10.7551/mitpress/1100.003.0014 · Cited by 269
Discussion: Performance of Bayesian Model Averaging
Raftery, A. E., & Zheng, Y. (2003) · Journal of the American Statistical Association · doi:10.1198/016214503000000891 · Cited by 252
Ando, T. (2007) · Biometrika · doi:10.1093/biomet/asm017 · Cited by 241
The Choice of Variables in Multiple Regression
Lindley, D. V. (1968) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1968.tb01505.x · Cited by 232
Bernardo, J. M. (2005) · Handbook of statistics · doi:10.1016/s0169-7161(05)25002-2 · Cited by 227
Inflation of R 2 in Best Subset Regression
Rencher, A. C., & Pun, F. C. (1980) · Technometrics · doi:10.1080/00401706.1980.10486100 · Cited by 211
Gaussian Processes for Classification: Mean-Field Algorithms
Opper, M., & Winther, O. (2000) · Neural Computation · doi:10.1162/089976600300014881 · Cited by 209
The Use of the Concept of a Future Observation in Goodness-Of-Fit Problems
Guttman, I. (1967) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1967.tb00676.x · Cited by 206
Overfitting in making comparisons between variable selection methods
ReunanenJuha (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944978 · Cited by 205
Posterior and Cross-validatory Predictive Checks: A Comparison of MCMC and INLA
Held, L., Schrödle, B., & Rue, H. (2010) · Statistical Modelling and Regression Structures · doi:10.1007/978-3-7908-2413-1_6 · Cited by 204
A cross-validatory method for dependent data
BURMAN, P., CHOW, E., & NOLAN, D. (1994) · Biometrika · doi:10.1093/biomet/81.2.351 · Cited by 202
Bayesian Model Assessment and Comparison Using Cross-Validation Predictive Densities
Vehtari, A., & Lampinen, J. (2002) · Neural Computation · doi:10.1162/08997660260293292 · Cited by 196
Self-citationMcCulloch, R. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478793 · Cited by 192
Model determination using sampling-based methods
(1995) · Markov Chain Monte Carlo in Practice · doi:10.1201/b14835-14 · Cited by 191
Algebraic Geometry and Statistical Learning Theory
Watanabe, S. (2009) · doi:10.1017/cbo9780511800474 · Cited by 183
Estimating the evidence – a review
Friel, N., & Wyse, J. (2012) · Statistica Neerlandica · doi:10.1111/j.1467-9574.2011.00515.x · Cited by 178
Asymptotic Distribution of P Values in Composite Null Models
Robins, J. M., van der Vaart, A., & Ventura, V. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474310 · Cited by 176
Posterior predictive model checks for disease mapping models
Stern, H. S., & Cressie, N. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20000915/30)19:17/18<2377::aid-sim576>3.0.co;2-1 · Cited by 171
Consistency of cross validation for comparing regression procedures
Yang, Y. (2007) · The Annals of Statistics · doi:10.1214/009053607000000514 · Cited by 166
Bayes Model Averaging with Selection of Regressors
Brown, P. J., Vannucci, M., & Fearn, T. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00348 · Cited by 165
Statistical Aspects of Model Selection
Shibata, R. (1989) · Springer eBooks · doi:10.1007/978-3-642-75007-6_5 · Cited by 158
Predictive Approaches for Choosing Hyperparameters in Gaussian Processes
Sundararajan, S., & Keerthi, S. S. (2001) · Neural Computation · doi:10.1162/08997660151134343 · Cited by 154
Bayesian Measures of Model Complexity and Fit
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00353 · Cited by 151
A Large Sample Study of the Bayesian Bootstrap
Lo, A. Y. (1987) · The Annals of Statistics · doi:10.1214/aos/1176350271 · Cited by 149
Ghahramani, Z., & Rasmussen, C. E. (2002) · neural information processing systems · Cited by 147
Bayesian Hypothesis Testing: A Reference Approach
Bernardo, J. M., & Rueda, R. (2002) · International Statistical Review · doi:10.1111/j.1751-5823.2002.tb00175.x · Cited by 137
Input-dependent estimation of generalization error under covariate shift
Sugiyama, M., & Müller, K. (2005) · Statistics & Risk Modeling · doi:10.1524/stnd.2005.23.4.249 · Cited by 131
A bias correction for the minimum error rate in cross-validation
Tibshirani, R. J., & Tibshirani, R. J. (2009) · The Annals of Applied Statistics · doi:10.1214/08-aoas224 · Cited by 99
A Predictive Model Selection Criterion
Martini, A. S., & Spezzaferri, F. (1984) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1984.tb01302.x · Cited by 96
A Predictive Approach to the Analysis of Designed Experiments
Ibrahim, J. G., & Laud, P. W. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476472 · Cited by 95
Model choice in generalised linear models: a Bayesian approach via Kullback-Leibler projections
Goutis, C. (1998) · Biometrika · doi:10.1093/biomet/85.1.29 · Cited by 94
A comparison of the information and posterior probability criteria for model selection
Chow, G. C. (1981) · Journal of Econometrics · doi:10.1016/0304-4076(81)90073-7 · Cited by 93
Cross-validation in nonparametric regression with outliersPreprint
Leung, H.-Y. (n.d.) · Cited by 87
Improved Sampling‐Importance Resampling and Reduced Bias Importance Sampling
Skare, Ø., Bølviken, E., & Holden, L. (2003) · Scandinavian Journal of Statistics · doi:10.1111/1467-9469.00360 · Cited by 81
Cross-validation in nonparametric regression with outliers
Leung, D. H. Y. (2005) · The Annals of Statistics · doi:10.1214/009053605000000499 · Cited by 79
Zhu, L., & Carlin, B. P. (2000) · Statistics in Medicine · Cited by 79
Criterion-based methods for Bayesian model assessment
Ibrahim, J. G., Chen, M. H., & Sinha, D. (2001) · Cited by 79
Gaussian process regression with Student-t likelihood
Vanhatalo, J. P., Jylänki, P., & Vehtari, A. (2009) · Cited by 77
Self-citationBrown, P. J. (1999) · Biometrika · doi:10.1093/biomet/86.3.635 · Cited by 75
Computational methods for Bayesian model choice
Robert, C. P., Wraith, D., Goggans, P. M., & Chan, C.-Y. (2009) · AIP conference proceedings · doi:10.1063/1.3275622 · Cited by 68
Intrinsic credible regions: An objective Bayesian approach to interval estimation
Bernardo, J. M. (2005) · Test · doi:10.1007/bf02595408 · Cited by 64
Variable selection in qualitative models via an entropic explanatory power
Dupuis, J. A., & Robert, C. P. (2002) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(02)00286-0 · Cited by 63
Nested Hypothesis Testing: The Bayesian Reference Criterion
Bernardo, J. M. (1999) · doi:10.1093/oso/9780198504856.003.0005 · Cited by 62
Robert, C. P. (1996) · Theory and Decision · doi:10.1007/bf00133173 · Cited by 61
Inference After Model Selection
Shen, X., Huang, H., & Ye, J. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000001097 · Cited by 58
Predictive likelihood for Bayesian model selection and averaging
Ando, T., & Tsay, R. S. (2009) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2009.08.001 · Cited by 58
On the use of cross-validation to assess performance in multivariate prediction
Jonathan, P., Krzanowski, W. J., & McCarthy, W. V. (2000) · Statistics and Computing · doi:10.1023/a:1008987426876 · Cited by 57
Approximate inference for disease mapping with sparse Gaussian processes
Vanhatalo, J. P., Pietiläinen, V., & Vehtari, A. (2010) · Statistics in Medicine · doi:10.1002/sim.3895 · Cited by 56
Self-citationAssessing Relevance Determination Methods Using DELVE
Neal, R. M. (1998) · Cited by 55
On the Variability of Case-Deletion Importance Sampling Weights in the Bayesian Linear Model
Peruggia, M. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10473617 · Cited by 51
Miyamoto, J. M. (1999) · Journal of Mathematical Psychology · doi:10.1006/jmps.1999.1256 · Cited by 49
Importance sampling methods for Bayesian discrimination between embedded modelsPreprint
Marin, J., & Robert, C. P. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0910.2325 · Cited by 48
Approximate inference for the loss-calibrated Bayesian
Lacoste-Julien, S., Huszár, F., & Ghahramani, Z. (2011) · Cited by 45
Bayesian nonparametric model selection and model testing
Karabatsos, G. (2005) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2005.07.003 · Cited by 44
Predictive Variable Selection in Generalized Linear Models
Meyer, M. C., & Laud, P. W. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618654 · Cited by 38
Bayesian criterion based model assessment for categorical data
Chen, M. (2004) · Biometrika · doi:10.1093/biomet/91.1.45 · Cited by 33
Draper, D., & Fouskakis, D. (2000) · Journal of Global Optimization · doi:10.1023/a:1026504402220 · Cited by 31
An efficient computational approach for prior sensitivity analysis and cross‐validation
Bornn, L., Arnaud Doucet, B., & Gottardo, R. (2010) · Canadian Journal of Statistics · doi:10.1002/cjs.10045 · Cited by 26
Statistical Decision Problems and Bayesian Nonparametric Methods
Gutiérrez‐Peña, E., & Walker, S. G. (2006) · International Statistical Review · doi:10.1111/j.1751-5823.2005.tb00151.x · Cited by 25
DATA‐DEPENDENT ESTIMATION OF PREDICTION FUNCTIONS
Burman, P. J., & Nolan, D. (1992) · Journal of Time Series Analysis · doi:10.1111/j.1467-9892.1992.tb00102.x · Cited by 24
Bayesian projection approaches to variable selection in generalized linear models
Nott, D. J., & Leng, C. (2010) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2010.01.036 · Cited by 24
Case-deletion importance sampling estimators: Central limit theorems and related results
Epifani, I., MacEachern, S. N., & Peruggia, M. (2008) · Electronic Journal of Statistics · doi:10.1214/08-ejs259 · Cited by 23
Information Criteria for Choice of Regression Models: A Comment
Leamer, E. E. (1979) · Econometrica · doi:10.2307/1914197 · Cited by 23
A decision theoretical approach to wavelet regression on curves with a high number of regressors
Vannucci, M., Brown, P. J., & Fearn, T. (2002) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(02)00333-6 · Cited by 23
Case-deletion importance sampling estimators: Central limit theorems and related results
Epifani, I., MacEachern, S. N., & Peruggia, M. (2005) · Cited by 23
A Bayesian Approach to Selecting Covariates for Prediction
Marriott, J. M., Spencer, N. M., & Pettitt, A. N. (2001) · Scandinavian Journal of Statistics · doi:10.1111/1467-9469.00225 · Cited by 17
Tran, M., Nott, D. J., & Leng, C. (2011) · Statistics and Computing · doi:10.1007/s11222-011-9279-3 · Cited by 15
A generalized predictive criterion for model selection
Trottini, M., & Spezzaferri, F. (2002) · Canadian Journal of Statistics · doi:10.2307/3315866 · Cited by 15
Gaussian Process Regression with a Student-t LikelihoodPreprint
Jylänki, P., Vanhatalo, J. P., & Vehtari, A. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1106.4431 · Cited by 15
Self-citationImportance re-sampling {MCMC} for cross-validation in inverse problems
Bhattacharya, S., & Haslett, J. (2007) · Bayesian Analysis · doi:10.1214/07-ba217 · Cited by 14
A Bayesian alternative to parametric hypothesis testing
Rueda, R. (1992) · Test · doi:10.1007/bf02562662 · Cited by 13
Model selection via predictive explanatory power
Vehtari, A., & Lampinen, J. (2004) · Cited by 9
Self-citationPredictive Variable Selection for the Multivariate Linear Model
Ibrahim, J. G., & Chen, M. (1997) · Biometrics · doi:10.2307/2533950 · Cited by 9
Bayesian Model Learning Based on Predictive Entropy
Corander, J., & Marttinen, P. (2006) · Journal of Logic Language and Information · doi:10.1007/s10849-005-9004-8 · Cited by 2
On a bayesian criterion for choosing predictive sub-models in linear regression
Young, A. S. (1987) · Metrika · doi:10.1007/bf02613164 · Cited by 2
Cited by
(2015) · doi:10.1007/s11222-016-9696-4 · Cited by 5,611
Self-citationUnderstanding predictive information criteria for Bayesian models
Gelman, A., Hwang, J., & Vehtari, A. (2014) · Statistics and Computing · doi:10.1007/s11222-013-9416-2 · Cited by 2,104
“There are extensions of AIC which have an adjustment related to the effective number of parameters (see Vehtari and Ojanen, 2012, section 5.5, and references therein) but these are seldom used due to stability problems and computational difficulties, issues that have motivated the construction of the…”
BackgroundMethodInfluentialSelf-citationBayesian statistics and modelling
van de Schoot, R., Depaoli, S., King, R., Kramer, B., Märtens, K., Tadesse, M. G., Vannucci, M., Gelman, A., Veen, D., Willemsen, J., et al. (2021) · Nature Reviews Methods Primers · doi:10.1038/s43586-020-00001-2 · Cited by 1,176
Programming With Models: Writing Statistical Algorithms for General Model Structures With NIMBLE
de Valpine, P., Turek, D., Paciorek, C. J., Anderson-Bergman, C., Lang, D. T., & Bodik, R. (2017) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2016.1172487 · Cited by 998
A guide to Bayesian model selection for ecologists
Hooten, M. B., & Hobbs, N. T. (2015) · Ecological Monographs · doi:10.1890/14-0661.1 · Cited by 891
Metadata
- Authors
- Vehtari, A., & Ojanen, J.
- Venue
- Statistics Surveys
- Publisher
- Institute of Mathematical Statistics
- Published
- 2012-01-01
- Volume
- 6
- Issue
- none
- Pages
- 142-228
- ISSN
- 1935-7516 (ISSN-L)
- OpenAlex
- W2016219233
- Cited by
- 348
- References
- 162
- FWCI
- 9.29
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.