The DOI matches its OpenAlex record; 27 of the 27 references it cites were found in a registry or an index.
Bayesian Model Averaging for Linear Regression Models
Abstract
We consider the problem of accounting for model uncertainty in linear regression models. Conditioning on a single selected model ignores model uncertainty, and thus leads to the underestimation of uncertainty when making inferences about quantities of interest. A Bayesian solution to this problem involves averaging over all possible models (i.e., combinations of predictors) when making inferences about quantities of interest. This approach is often not practical. In this article we offer two alternative approaches. First, we describe an ad hoc procedure, “Occam's window,” which indicates a small set of models over which a model average can be computed. Second, we describe a Markov chain Monte Carlo approach that directly approximates the exact solution. In the presence of model uncertainty, both of these model averaging procedures provide better predictive performance than any single model that might reasonably have been selected. In the extreme case where there are many candidate predictors but no relationship between any of them and the response, standard variable selection procedures often choose some subset of variables that yields a high R 2 and a highly significant overall F value. In this situation, Occam's window usually indicates the null model (or a small number of models including the null model) as the only one (or ones) to be considered thus largely resolving the problem of selecting significant models when there is no signal in the data. Software to implement our methods is available from StatLib.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Hahn, G. J., Draper, N., & Smith, H. (1982) · Technometrics · doi:10.2307/1267833 · Cited by 5,773
Applied Linear Statistical Models.
Lorenz, F., Neter, J., Wasserman, W., & Kutner, M. H. (1986) · Journal of the American Statistical Association · doi:10.2307/2289108 · Cited by 5,565
Variable Selection via Gibbs Sampling
George, E. I., & McCulloch, R. E. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476353 · Cited by 2,828
Participation in Illegitimate Activities: A Theoretical and Empirical Investigation
Ehrlich, I. (1973) · Journal of Political Economy · doi:10.1086/260058 · Cited by 2,492
Crime and Punishment: An Economic Approach
Becker, G. S. (2004) · Economic Analysis of the Law · doi:10.1002/9780470752135.ch25 · Cited by 1,852
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods
Smith, A. F. M., & Roberts, G. O. (1993) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1993.tb01466.x · Cited by 1,713
Osborn, J. F., Mosteller, F., & Tukey, J. W. (1978) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344493 · Cited by 1,446
Chatfield, C., & Weisberg, S. (1986) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981572 · Cited by 1,365
Research works printed but not linked: 30
- 10.1086/259394 · DOI · Paper page
- 10.1177/0193841X8000400201 · DOI
- Breiman , L. 1968 . Probability , Reading , MA : Addison-Wesley .
- 10.1080/01621459.1992.10475276 · DOI · Paper page
- 10.2307/1403680 · DOI · Paper page
- Cox , D. R. and Snell , E. J. 1982 . Applied Statistics: Principles and Examples , New York : Chapman and Hall .
- Chung , K. L. 1967 . Markov Chains with Stationary Transition Probabilities, , 2nd ed. , Berlin : Springer-Verlag .
- 10.1111/j.2517-6161.1995.tb02015.x · DOI · Paper page
- Freedman , D. A. , Navidi , W. C. and Peters , S. C. 1986 . “On the Impact of Variable Selection in Fitting Regression Equations,” . In On Model Uncertainty and Its Statistical Implications , Edited by: Dijkstra , T. K. 1 – 16 . Berlin : Springer-Verlag .
- Geisser , S. 1980 . Discussion of “Sampling and Bayes’ Inference in Scientific Modelling and Robustness” by G. E. P. Box . Journal of the Royal Statistical Society , 143 : 416 – 417 . Ser. A
- 10.1111/j.2517-6161.1952.tb00104.x · DOI · Paper page
- Hamilton , L. C. 1993 . Statistics With Stata 3 , Belmont , CA : Duxbury Press .
- 10.2307/2529336 · DOI · Paper page
- 10.1214/ss/1177013224 · DOI
- Hoeting , J. A. , Raftery , A. E. and Madigan , D. 1995 . “Simultaneous Variable and Transformation Selection in Linear Regression,” , Colorado State University, Dept. of Statistics . Technical Report 9506
- 10.1016/0167-9473(95)00053-4 · DOI
- Jeffreys , H. 1961 . Theory of Probability, , 3rd ed. , London : Oxford University Press .
- 10.1080/01621459.1995.10476572 · DOI · Paper page
- Leamer , E. E. 1978 . Specification Searches , New York : Wiley .
- Linhart , H. and Zucchini , W. 1986 . Model Selection , New York : Wiley .
- 10.1080/01621459.1994.10476894 · DOI · Paper page
- 10.2307/2981576 · DOI
- 10.1007/978-1-4899-2939-6 · DOI · Paper page
- 10.1080/01621459.1988.10478694 · DOI · Paper page
- Raftery , A. E. 1988 . “Approximate Bayes Factors for Generalized Linear Models,” , University of Washington, Dept. of Statistics . Technical Report 121
- 10.1093/biomet/83.2.251 · DOI · Paper page
- 10.1002/sim.4780100506 · DOI · Paper page
- 10.1086/259646 · DOI · Paper page
- Taft , D. R. and England , R. W. 1964 . Criminology, , 4th ed. , New York : Macmillan .
- Vandaele , W. 1978 . “Participation in Illegitimate Activities; Ehrlich Revisited,” . In Deterrence and Incapacitation , Edited by: Blumstein , A. , Cohen , J. and Nagin , D. 270 – 335 . Washington , D.C. : National Academy of Sciences Press .
Cited by
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118
Self-citationBenchmark priors for Bayesian model averaging
Fernández, C., Ley, E., & Steel, M. F. J. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(00)00076-2 · Cited by 1,030
Hansen, B. E. (2007) · Econometrica · doi:10.1111/j.1468-0262.2007.00785.x · Cited by 837
Model Selection and the Principle of Minimum Description Length
Hansen, M. H., & Yu, B. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753168398 · Cited by 788
Constructing Probability Boxes and Dempster-Shafer Structures
FERSON, S., KREINOVICK, V., GINZBURG, L., & SENTZ, F. (2003) · doi:10.2172/809606 · Cited by 740
Estimating Animal Abundance: Review III
Schwarz, C. J., & Seber, G. A. F. (1999) · Statistical Science · doi:10.1214/ss/1009212521 · Cited by 519
Raftery, A. E., Kárný, M., & Ettler, P. (2010) · Technometrics · doi:10.1198/tech.2009.08104 · Cited by 452
Self-citationDeterminants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (BACE) Approach
Doppelhofer, G., Miller, R., & Sala-i-Martin, X. (2000) · National Bureau of Economic Research · doi:10.3386/w7750 · Cited by 437
von Toussaint, U. (2011) · Reviews of Modern Physics · doi:10.1103/revmodphys.83.943 · Cited by 422
The Practical Implementation of Bayesian Model Selection
Chipman, H., George, E. I., & McCulloch, R. E. (2001) · Institute of Mathematical Statistics Lecture Notes - Monograph Series · doi:10.1214/lnms/1215540964 · Cited by 416
Objective Bayesian Methods for Model Selection: Introduction and Comparison
Berger, J. O., & Pericchi, L. R. (2001) · Institute of Mathematical Statistics Lecture Notes - Monograph Series · doi:10.1214/lnms/1215540968 · Cited by 355
Determinants of Foreign Direct Investment
Blonigen, B., & Piger, J. (2011) · National Bureau of Economic Research · doi:10.3386/w16704 · Cited by 355
A comparison of two model averaging techniques with an application to growth empirics
Magnus, J. R., Powell, O., & Prüfer, P. (2010) · Journal of Econometrics · doi:10.1016/j.jeconom.2009.07.004 · Cited by 355
Eicher, T. S., Papageorgiou, C., & Raftery, A. E. (2011) · Journal of Applied Econometrics · doi:10.1002/jae.1112 · Cited by 331
Self-citationClyde, M., & George, E. I. (2004) · Statistical Science · doi:10.1214/088342304000000035 · Cited by 329
Stock Return Predictability: A Bayesian Model Selection Perspective
Cremers, K. J. M. (2002) · Review of Financial Studies · doi:10.1093/rfs/15.4.1223 · Cited by 311
Guan, Y., & Stephens, M. (2011) · The Annals of Applied Statistics · doi:10.1214/11-aoas455 · Cited by 302
Comparison of Bayesian predictive methods for model selection
Piironen, J., & Vehtari, A. (2017) · Statistics and Computing · doi:10.1007/s11222-016-9649-y · Cited by 294
On the Relationship Between Markov chain Monte Carlo Methods for Model Uncertainty
Godsill, S. J. (2001) · Journal of Computational and Graphical Statistics · doi:10.1198/10618600152627924 · Cited by 281
Markov Chain Monte Carlo Methods for Computing Bayes Factors: A Comparative Review
Han, C., & Carlin, B. P. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753208780 · Cited by 275
Mapping epistemic uncertainties and vague concepts in predictions of species distribution
Elith, J., Burgman, M. A., & Regan, H. M. (2002) · Ecological Modelling · doi:10.1016/s0304-3800(02)00202-8 · Cited by 273
Bayesian uncertainty analysis with applications to turbulence modeling
Cheung, S. H., Oliver, T. A., Prudencio, E. E., Prudhomme, S., & Moser, R. D. (2011) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2010.09.013 · Cited by 267
Bayesian model averaging in EEG/MEG imaging
Trujillo-Barreto, N. J., Aubert-Vázquez, E., & Valdés-Sosa, P. A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.11.008 · Cited by 262
Discussion: Performance of Bayesian Model Averaging
Raftery, A. E., & Zheng, Y. (2003) · Journal of the American Statistical Association · doi:10.1198/016214503000000891 · Cited by 252
Self-citationBayesian Adaptive Sampling for Variable Selection and Model Averaging
Clyde, M. A., Ghosh, J., & Littman, M. L. (2011) · Journal of Computational and Graphical Statistics · doi:10.1198/jcgs.2010.09049 · Cited by 247
Bayesian Model Averaging in Proportional Hazard Models: Assessing the Risk of a Stroke
Volinsky, C. T., Madigan, D., Raftery, A. E., & Kronmal, R. A. (1997) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/1467-9876.00082 · Cited by 226
Self-citation
Metadata
- Authors
- Raftery, A. E., Madigan, D., & Hoeting, J. A.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 1997-03
- Volume
- 92
- Issue
- 437
- Pages
- 179-191
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W4229849994
- Cited by
- 294
- References
- 27
- FWCI
- 4.70
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.