The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Penalising Model Component Complexity: A Principled, Practical Approach to Constructing Priors
Open accessAbstract
In this paper, we introduce a new concept for constructing prior distributions. We exploit the natural nested structure inherent to many model components, which defines the model component to be a flexible extension of a base model. Proper priors are defined to penalise the complexity induced by deviating from the simpler base model and are formulated after the input of a user-defined scaling parameter for that model component, both in the univariate and the multivariate case. These priors are invariant to reparameterisations, have a natural connection to Jeffreys’ priors, are designed to support Occam’s razor and seem to have excellent robustness properties, all which are highly desirable and allow us to use this approach to define default prior distributions. Through examples and theoretical results, we demonstrate the appropriateness of this approach and how it can be applied in various situations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Rue, H., Martino, S., & Chopin, N. (2009) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2008.00700.x · Cited by 5,279
Self-citationBayesian calibration of computer models
Kennedy, M. C., & O'Hagan, A. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00294 · Cited by 4,222
Bayesian image restoration, with two applications in spatial statistics
Besag, J., York, J., & Molli�, A. (1991) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf00116466 · Cited by 4,205
Gelman, A. (2006) · Bayesian Analysis · doi:10.1214/06-ba117a · Cited by 4,050 · cited 11×
“Contrary to this, Gelman (2006), Gelman et al. (2008) argue that, when setting priors on the standard deviation of a normal distribution, heavy tails are necessary for robustness (O’Hagan and Pericchi, 2012). Unfortunately, this theory is only developed for inferring location-scale families or natural parameters in ex…”
BackgroundInfluentialThe Statistical Analysis of Compositional Data
Aitchison, J. (1982) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1982.tb01195.x · Cited by 3,405
Hastie, T., & Tibshirani, R. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat03141 · Cited by 3,156
Park, T., & Casella, G. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000337 · Cited by 2,934
Variable Selection via Gibbs Sampling
George, E. I., & McCulloch, R. E. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476353 · Cited by 2,828
Estimation of the Mean of a Multivariate Normal Distribution
Stein, C. M. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345632 · Cited by 2,729
Lindgren, F., Rue, H., & Lindström, J. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.00777.x · Cited by 2,708
Self-citationSelf, S. G., & Liang, K.-Y. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478472 · Cited by 2,661
An invariant form for the prior probability in estimation problems
Jeffreys, H. (1946) · Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences · doi:10.1098/rspa.1946.0056 · Cited by 2,323
Functions of Matrices: Theory and Computation
Higham, N. J. (2008) · doi:10.1137/1.9780898717778 · Cited by 2,113
The BUGS project: evolution, critique and future directions
Lunn, D., Spiegelhalter, D., Thomas, A., & Best, N. (2009) · Statistics in Medicine · doi:10.1002/sim.3680 · Cited by 1,876
Rue, H., & Held, L. (2005) · Chapman & Hall/CRC eBooks · doi:10.1201/9780203492024 · Cited by 1,823
Self-citationA weakly informative default prior distribution for logistic and other regression models
Gelman, A., Jakulin, A., Pittau, M. G., & Su, Y.-S. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas191 · Cited by 1,790
The horseshoe estimator for sparse signals
Carvalho, C. M., Polson, N. G., & Scott, J. G. (2010) · Biometrika · doi:10.1093/biomet/asq017 · Cited by 1,381
Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician
Rubin, D. B. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346785 · Cited by 1,343
The Selection of Prior Distributions by Formal Rules
Kass, R. E., & Wasserman, L. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10477003 · Cited by 1,308
A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
Kass, R. E., & Wasserman, L. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476592 · Cited by 1,253
Reference Posterior Distributions for Bayesian Inference
Bernardo, J. M. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01066.x · Cited by 1,095
Spike and slab variable selection: Frequentist and Bayesian strategies
Ishwaran, H., & Rao, J. S. (2005) · The Annals of Statistics · doi:10.1214/009053604000001147 · Cited by 1,033
Generalized Additive Models: Some Applications
Hastie, T., & Tibshirani, R. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478440 · Cited by 870
Analysis of multivariate probit models
Chib, S. (1998) · Biometrika · doi:10.1093/biomet/85.2.347 · Cited by 834
The case for objective Bayesian analysis
Berger, J. (2006) · Bayesian Analysis · doi:10.1214/06-ba115 · Cited by 728
Convergence rates of posterior distributions
Ghosal, S., Ghosh, J. K., & van der Vaart, A. W. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218228 · Cited by 665
Bayesian computing with INLA: New features
Martins, T. G., Simpson, D., Lindgren, F., & Rue, H. (2013) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2013.04.014 · Cited by 604
Self-citationA comparison of Bayesian and likelihood-based methods for fitting multilevel models
Browne, W. J., & Draper, D. (2006) · Bayesian Analysis · doi:10.1214/06-ba117 · Cited by 603
An intuitive Bayesian spatial model for disease mapping that accounts for scaling
Riebler, A., Sørbye, S. H., Simpson, D., & Rue, H. (2016) · Statistical Methods in Medical Research · doi:10.1177/0962280216660421 · Cited by 511
Self-citationBayesian treatment of the independent student-t linear model
Geweke, J. (1993) · Journal of Applied Econometrics · doi:10.1002/jae.3950080504 · Cited by 508
On the Half-Cauchy Prior for a Global Scale Parameter
Polson, N. G., & Scott, J. G. (2012) · Bayesian Analysis · doi:10.1214/12-ba730 · Cited by 454
Dirichlet–Laplace Priors for Optimal Shrinkage
Bhattacharya, A., Pati, D., Pillai, N. S., & Dunson, D. B. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2014.960967 · Cited by 413
Generalized Additive Models; Some Applications
Hastie, T., & Tibshirani, R. (1985) · Lecture Notes in Statistics · doi:10.1007/978-1-4615-7070-7_8 · Cited by 407
The formal definition of reference priors
Berger, J. O., Bernardo, J. M., & Sun, D. (2009) · The Annals of Statistics · doi:10.1214/07-aos587 · Cited by 399
Disease mapping and spatial regression with count data
Wakefield, J. (2007) · Biostatistics · doi:10.1093/biostatistics/kxl008 · Cited by 367
(2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511802478 · Cited by 358
Bayesian estimates of disease maps: How important are priors?
Bernardinelli, L., Clayton, D., & Montomoli, C. (1995) · Statistics in Medicine · doi:10.1002/sim.4780142111 · Cited by 290
Jones, M. C., & Pewsey, A. (2009) · Biometrika · doi:10.1093/biomet/asp053 · Cited by 286
Bayesian inference for generalized linear mixed models
Fong, Y., Rue, H., & Wakefield, J. (2010) · Biostatistics · doi:10.1093/biostatistics/kxp053 · Cited by 284
Self-citationOn the use of Non-Local Prior Densities in Bayesian Hypothesis Tests
Johnson, V. E., & Rossell, D. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2009.00730.x · Cited by 279
Bayesian linear regression with sparse priors
Castillo, I., Schmidt-Hieber, J., & van der Vaart, A. (2015) · The Annals of Statistics · doi:10.1214/15-aos1334 · Cited by 277
Deely, J. J., & Lindley, D. V. (1981) · Journal of the American Statistical Association · doi:10.1080/01621459.1981.10477731 · Cited by 250
Statistical Methods in Spatial Epidemiology
Lawson, A. B. (2006) · Wiley Series in Probability and Statistics · doi:10.1002/9780470035771 · Cited by 249
Stochastic model specification search for Gaussian and partial non-Gaussian state space models
Frühwirth-Schnatter, S., & Wagner, H. (2010) · Journal of Econometrics · doi:10.1016/j.jeconom.2009.07.003 · Cited by 221
Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequences
Castillo, I., & van der Vaart, A. (2012) · The Annals of Statistics · doi:10.1214/12-aos1029 · Cited by 217
Subjective Bayesian Analysis: Principles and Practice
Goldstein, M. (2006) · Bayesian Analysis · doi:10.1214/06-ba116 · Cited by 214
Approximate Bayesian inference for hierarchical Gaussian Markov random field models
Rue, H., & Martino, S. (2007) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2006.07.016 · Cited by 214
Self-citationScaling intrinsic Gaussian Markov random field priors in spatial modelling
Sørbye, S. H., & Rue, H. (2013) · Spatial Statistics · doi:10.1016/j.spasta.2013.06.004 · Cited by 198
Self-citationGustafson, P. (2005) · Statistical Science · doi:10.1214/088342305000000098 · Cited by 188
Bayesian approaches to disease mapping
Wakefield, J. C., Best, N. G., & Waller, L. (2001) · Spatial Epidemiology · doi:10.1093/acprof:oso/9780198515326.003.0007 · Cited by 188
Algebraic Geometry and Statistical Learning Theory
Watanabe, S. (2009) · doi:10.1017/cbo9780511800474 · Cited by 183
Harold Jeffreys’s Theory of Probability Revisited
Robert, C. P., Chopin, N., & Rousseau, J. (2009) · Statistical Science · doi:10.1214/09-sts284 · Cited by 170
On the Use of Cauchy Prior Distributions for Bayesian Logistic Regression
Ghosh, J., Li, Y., & Mitra, R. (2018) · Bayesian Analysis · doi:10.1214/17-ba1051 · Cited by 161
Sensitivity analysis in Bayesian generalized linear mixed models for binary data
Roos, M., & Held, L. (2011) · Bayesian Analysis · doi:10.1214/11-ba609 · Cited by 159
Berger, J. O., Bernardo, J. M., & Sun, D. (2015) · Bayesian Analysis · doi:10.1214/14-ba915 · Cited by 136
Modeling Spatial Variation in Leukemia Survival Data
Henderson, R., Shimakura, S. E., & Gorst, D. W. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618753 · Cited by 128
Bayesian Analysis of Measurement Error Models Using Integrated Nested Laplace Approximations
Muff, S., Riebler, A., Held, L., Rue, H., & Saner, P. (2014) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/rssc.12069 · Cited by 121
Self-citationOn the Second‐Order Random Walk Model for Irregular Locations
Lindgren, F., & Rue, H. (2008) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2008.00610.x · Cited by 100
Self-citationRichly Parameterized Linear Models: Additive, Time Series, and Spatial Models Using Random Effects
Hodges, J. S. (2013) · CERN Document Server (European Organization for Nuclear Research) · Cited by 98
Geodesic Monte Carlo on Embedded Manifolds
Byrne, S., & Girolami, M. (2013) · Scandinavian Journal of Statistics · doi:10.1111/sjos.12036 · Cited by 87
Spatial Aggregation and the Ecological Fallacy
Wakefield, J. C., & Lyons, H. M. (2010) · Chapman & Hall/CRC interdisciplinary statistics series/Interdisciplinary statistics · doi:10.1201/9781420072884-c30 · Cited by 87
Waller, L. A., & Carlin, B. P. (2010) · Chapman & Hall/CRC interdisciplinary statistics series/Interdisciplinary statistics · doi:10.1201/9781420072884-c14 · Cited by 84
Sensitivity Analysis for Bayesian Hierarchical ModelsPreprint
Roos, M., Martins, T. G., Held, L., & Rue, H. (2015) · Bayesian Analysis · doi:10.1214/14-ba909 · Cited by 76
Self-citationA Bayesian Approach to Robust Binary Nonparametric Regression
Wood, S. A., & Kohn, R. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10474102 · Cited by 66
Integrated Objective Bayesian Estimation and Hypothesis Testing
Bernardo, J. M. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199694587.003.0001 · Cited by 65
Bayesian heavy-tailed models and conflict resolution: A review
O’Hagan, A., & Pericchi, L. R. (2012) · Brazilian Journal of Probability and Statistics · doi:10.1214/11-bjps164 · Cited by 56
Efficient Bayesian Inference for Multivariate Probit Models With Sparse Inverse Correlation Matrices
Talhouk, A., Arnaud Doucet, B., & Murphy, K. (2012) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2012.679239 · Cited by 52
Bayesian Variable Selection for Random Intercept Modeling of Gaussian and Non‐Gaussian Data
Frühwirth‐Schnatter, S., & Wagner, H. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199694587.003.0006 · Cited by 51
Compatibility of Prior Specifications Across Linear Models
Consonni, G., & Veronese, P. (2008) · Statistical Science · doi:10.1214/08-sts258 · Cited by 48
Bayesian bivariate meta‐analysis of diagnostic test studies with interpretable priors
Guo, J., Riebler, A., & Rue, H. (2017) · Statistics in Medicine · doi:10.1002/sim.7313 · Cited by 48
Self-citationTesting hypotheses via a mixture estimation modelPreprint
Kamary, K., Mengersen, K. L., Robert, C. P., & Rousseau, J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.2044 · Cited by 47
Weak Informativity and the Information in One Prior Relative to Another
Evans, M., & Jang, G. H. (2011) · Statistical Science · doi:10.1214/11-sts357 · Cited by 46
Generalization of Jeffreys Divergence-Based Priors for Bayesian Hypothesis Testing
Bayarri, M. J., & García‐Donato, G. (2008) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2008.00667.x · Cited by 46
The Bernstein–von Mises theorem and nonregular models
Bochkina, N. A., & Green, P. J. (2014) · The Annals of Statistics · doi:10.1214/14-aos1239 · Cited by 40
Reich, B. J., & Hodges, J. S. (2008) · Biometrics · doi:10.1111/j.1541-0420.2007.00956.x · Cited by 33
Non‐Parametric Ecological Regression and Spatial Variation
Natário, I., & Knorr‐Held, L. (2003) · Biometrical Journal · doi:10.1002/bimj.200390041 · Cited by 31
Partitioning Degrees of Freedom in Hierarchical and Other Richly Parameterized Models
Cui, Y., Hodges, J. S., Kong, X., & Carlin, B. P. (2010) · Technometrics · doi:10.1198/tech.2009.08161 · Cited by 17
Measuring the complexity of generalized linear hierarchical models
Lu, H., Hodges, J. S., & Carlin, B. P. (2007) · Canadian Journal of Statistics · doi:10.1002/cjs.5550350108 · Cited by 15
Re-considering the variance parameterization in multiple precision models
Carlin, B. P., He, Y., & Hodges, J. S. (2007) · Bayesian Analysis · doi:10.1214/07-ba221 · Cited by 13
Simultaneous Credible Bands for Latent Gaussian Models
Sørbye, S. H., & Rue, H. (2011) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2011.00741.x · Cited by 12
Self-citationPoint estimates for variance-structure parameters in Bayesian analysis of hierarchical models
He, Y. L., & Hodges, J. S. (2007) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2007.08.021 · Cited by 9
Cited by
Meta-analysis reveals declines in terrestrial but increases in freshwater insect abundances
van Klink, R., Bowler, D. E., Gongalsky, K. B., Swengel, A. B., Gentile, A., & Chase, J. M. (2020) · Science · doi:10.1126/science.aax9931 · Cited by 1,172
Visualization in Bayesian Workflow
Gabry, J., Simpson, D., Vehtari, A., Betancourt, M., & Gelman, A. (2019) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12378 · Cited by 1,122
Self-citationBayesian Computing with INLA: A Review
Rue, H., Riebler, A., Sørbye, S. H., Illian, J. B., Simpson, D. P., & Lindgren, F. K. (2017) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-060116-054045 · Cited by 737
Self-citationThe Prior Can Often Only Be Understood in the Context of the Likelihood
Gelman, A., Simpson, D., & Betancourt, M. (2017) · Entropy · doi:10.3390/e19100555 · Cited by 454
Self-citationMuff, S., Signer, J., & Fieberg, J. (2020) · Journal of Animal Ecology · doi:10.1111/1365-2656.13087 · Cited by 454
Metadata
- Authors
- Simpson, D., Rue, H., Riebler, A., Martins, T. G., & Sørbye, S. H.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2017-02-01
- Volume
- 32
- Issue
- 1
- Pages
- 1-28
- ISSN
- 0883-4237 (ISSN-L)
- OpenAlex
- W1487139063
- Cited by
- 1,085
- References
- 83
- FWCI
- 56.16
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.