The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Bayesian Model Averaging: A Systematic Review and Conceptual Classification
Open accessAbstract
Summary: Bayesian model averaging (BMA) provides a coherent and systematic mechanism for accounting for model uncertainty. It can be regarded as an direct application of Bayesian inference to the problem of model selection, combined estimation and prediction. BMA produces a straightforward model choice criterion and less risky predictions. However, the application of BMA is not always straightforward, leading to diverse assumptions and situational choices on its different aspects. Despite the widespread application of BMA in the literature, there were not many accounts of these differences and trends besides a few landmark revisions in the late 1990s and early 2000s, therefore not accounting for advancements made in the last decades. In this work, we present an account of these developments through a careful content analysis of 820 articles in BMA published between 1996 and 2016. We also develop a conceptual classification scheme to better describe this vast literature, understand its trends and future directions and provide guidance for the researcher interested in both the application and development of the methodology. The results of the classification scheme and content review are then used to discuss the present and future of the BMA literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Prediction of Total Genetic Value Using Genome-Wide Dense Marker Maps
Meuwissen, T. H. E., Hayes, B. J., & Goddard, M. E. (2001) · Genetics · doi:10.1093/genetics/157.4.1819 · Cited by 7,917
Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
GREEN, P. J. (1995) · Biometrika · doi:10.1093/biomet/82.4.711 · Cited by 5,930
JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling
Plummer, M. (2003) · Cited by 4,720
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118 · cited 4×
“We also noticed that following the landmark reviews of Hoeting et al. (1999) and Wasserman (2000), there were no comprehensive reviews of the developments and applications of BMA in the last 15 years, which does not account for the developments in Bayesian inference brought by the Markov Chain…”
BackgroundMethodInfluentialVariable Selection via Gibbs Sampling
George, E. I., & McCulloch, R. E. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476353 · Cited by 2,828
POSTERIOR PREDICTIVE ASSESSMENT OF MODEL FITNESS VIA REALIZED DISCREPANCIES
Gelman, A., Meng, X., & Stern, H. S. (1996) · Cited by 1,945
Using Bayesian model averaging to calibrate forecast ensembles.
Raftery, A. E., Gneiting, T., Balabdaoui, F., & Polakowski, M. (2005) · Monthly Weather Review · doi:10.1175/mwr2906.1 · Cited by 1,915
Marginal Likelihood from the Gibbs Output
Chib, S. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476635 · Cited by 1,905
On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion)
Richardson, S., & Green, P. J. (1997) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00095 · Cited by 1,898
Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700
Approximate Bayesian Inference with the Weighted Likelihood Bootstrap
Newton, M. A., & Raftery, A. E. (1994) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1994.tb01956.x · Cited by 1,487
Bayesian Model Choice: Asymptotics and Exact Calculations
Gelfand, A. E., & Dey, D. K. (1994) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1994.tb01996.x · Cited by 1,209
Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
Madigan, D., & Raftery, A. E. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476894 · Cited by 1,205 · cited 1×
“…et al. (1999), Wasserman (2000) and Geweke (1999) and some computational tools implementing the results by Raftery (1996), Volinsky et al. (1997), Madigan and Raftery (1994) and Madigan et al. (1995) led to a popularization of BMA resulting in a growth in publications in the 2000 − 2005 time…”
MethodBayesian Graphical Models for Discrete Data
Madigan, D., York, J., & Allard, D. (1995) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403615 · Cited by 1,090
Benchmark priors for Bayesian model averaging
Fernández, C., Ley, E., & Steel, M. F. J. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(00)00076-2 · Cited by 1,030
Bayesian Model Selection and Model Averaging
Wasserman, L. (2000) · Journal of Mathematical Psychology · doi:10.1006/jmps.1999.1278 · Cited by 986
Using simulation methods for bayesian econometric models: inference, development,and communication
Geweke, J. (1999) · Econometric Reviews · doi:10.1080/07474939908800428 · Cited by 958
Simulating normalizing constants: from importance sampling to bridge sampling to path sampling
Gelman, A., & Meng, X.-L. (1998) · Statistical Science · doi:10.1214/ss/1028905934 · Cited by 951
Model uncertainty in cross‐country growth regressions
Fernández, C., Ley, E., & Steel, M. F. J. (2001) · Journal of Applied Econometrics · doi:10.1002/jae.623 · Cited by 891
Variational free energy and the Laplace approximation
Friston, K., Mattout, J., Trujillo-Barreto, N., Ashburner, J., & Penny, W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.08.035 · Cited by 880
Friedman, N., & Koller, D. (2003) · Machine Learning · doi:10.1023/a:1020249912095 · Cited by 811
Comparing families of dynamic causal models
Penny, W. D., Stephan, K. E., Daunizeau, J., Rosa, M. J., Friston, K. J., Schofield, T. M., & Leff, A. P. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000709 · Cited by 688
Approximate Bayes factors and accounting for model uncertainty in generalised linear models
Raftery, A. (1996) · Biometrika · doi:10.1093/biomet/83.2.251 · Cited by 633
Regressions by Leaps and Bounds
Furnival, G. M., & Wilson, R. W. (1974) · Technometrics · doi:10.1080/00401706.1974.10489231 · Cited by 625
Yeung, K. Y., Bumgarner, R. E., & Raftery, A. E. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti319 · Cited by 544
The impact of genetic relationship information on genomic breeding values in German Holstein cattle
Habier, D., Tetens, J., Seefried, F.-R., Lichtner, P., & Thaller, G. (2010) · Genetics Selection Evolution · doi:10.1186/1297-9686-42-5 · Cited by 455
Raftery, A. E., Kárný, M., & Ettler, P. (2010) · Technometrics · doi:10.1198/tech.2009.08104 · Cited by 452
Methods and Criteria for Model Selection
Kadane, J. B., & Lazar, N. A. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000269 · Cited by 429
Eicher, T. S., Papageorgiou, C., & Raftery, A. E. (2011) · Journal of Applied Econometrics · doi:10.1002/jae.1112 · Cited by 331
Clyde, M., & George, E. I. (2004) · Statistical Science · doi:10.1214/088342304000000035 · Cited by 329
Guan, Y., & Stephens, M. (2011) · The Annals of Applied Statistics · doi:10.1214/11-aoas455 · Cited by 302
The Use of Bayesian Model Averaging to Better Represent Uncertainty in Ecological Models
WINTLE, B. A., McCARTHY, M. A., VOLINSKY, C. T., & KAVANAGH, R. P. (2003) · Conservation Biology · doi:10.1111/j.1523-1739.2003.00614.x · Cited by 286
Bayesian infinite mixture model based clustering of gene expression profiles
Medvedovic, M., & Sivaganesan, S. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.9.1194 · Cited by 281
Kizilkaya, K., Fernando, R. L., & Garrick, D. J. (2010) · Journal of Animal Science · doi:10.2527/jas.2009-2064 · Cited by 260
Bayesian Model Averaging in Proportional Hazard Models: Assessing the Risk of a Stroke
Volinsky, C. T., Madigan, D., Raftery, A. E., & Kronmal, R. A. (1997) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/1467-9876.00082 · Cited by 226
Estimating the evidence – a review
Friel, N., & Wyse, J. (2012) · Statistica Neerlandica · doi:10.1111/j.1467-9574.2011.00515.x · Cited by 178
Silvestro, D., Zizka, G., & Schulte, K. (2014) · Evolution · doi:10.1111/evo.12236 · Cited by 173
Bayesian Model Averaging Continual Reassessment Method in Phase I Clinical Trials
Yin, G., & Yuan, Y. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap08425 · Cited by 168
Bayes Model Averaging with Selection of Regressors
Brown, P. J., Vannucci, M., & Fearn, T. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00348 · Cited by 165
Roberts, H. V. (1965) · Journal of the American Statistical Association · doi:10.1080/01621459.1965.10480774 · Cited by 137
The derivation of diagnostic markers of chronic myeloid leukemia progression from microarray data.
Oehler, V., Yeung, K., Choi, Y. E., Bumgarner, R. E., Raftery, A., & Radich, J. (2009) · Blood · doi:10.1182/blood-2009-03-212969 · Cited by 115
Present and future evidence for evolving dark energy
Liddle, A. R., Mukherjee, P., Parkinson, D., & Wang, Y. (2006) · Physical review. D. Particles, fields, gravitation, and cosmology/Physical review. D. Particles and fields · doi:10.1103/physrevd.74.123506 · Cited by 104
Morales, K. H., Ibrahim, J. G., Chen, C., & RYAN, L. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000000961 · Cited by 90
Wu, C., & Drummond, A. J. (2011) · Genetics · doi:10.1534/genetics.110.125260 · Cited by 84
Phelan, S., Liu, T., Gorin, A. A., Lowe, M. R., Hogan, J. W., Fava, J. L., & Wing, R. R. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9135-2 · Cited by 83
Model Averaging for Prediction with Discrete Bayesian Networks
Dash, D. H., & Cooper, G. F. (2004) · doi:10.5555/1005332.1044699 · Cited by 82
On the Bayesian analysis of population size
King, R. (2001) · Biometrika · doi:10.1093/biomet/88.2.317 · Cited by 80
Bayesian Modeling of Complex Metabolic Pathways
Conti, D. V., Cortessis, V. K., Molitor, J., & Thomas, D. C. (2003) · Human Heredity · doi:10.1159/000073736 · Cited by 77
Finding good predictors for inflation: a Bayesian model averaging approach
Jacobson, T., & Karlsson, S. (2004) · Journal of Forecasting · doi:10.1002/for.924 · Cited by 75
Bayesian Variable and Transformation Selection in Linear Regression
Hoeting, J. A., Raftery, A. E., & Madigan, D. (2002) · Journal of Computational and Graphical Statistics · doi:10.1198/106186002501 · Cited by 72
Bayesian variable and model selection methods for genetic association studies
Fridley, B. L. (2008) · Genetic Epidemiology · doi:10.1002/gepi.20353 · Cited by 68
Predicting Bird Species Distributions in Reconstructed Landscapes
Thomson, J. R., Nally, R. M., Fleishman, E., & HORROCKS, G. (2007) · Conservation Biology · doi:10.1111/j.1523-1739.2007.00687.x · Cited by 64
Annest, A., Bumgarner, R. E., Raftery, A. E., & Yeung, K. Y. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-72 · Cited by 63
Boddhireddy, P., Kelly, M., Northcutt, S. L., Prayaga, K. C., Rumph, J. M., & DeNise, S. K. (2014) · Journal of Animal Science · doi:10.2527/jas.2013-6757 · Cited by 58
Hedge fund pricing and model uncertainty
Vrontos, S. D., Vrontos, I. D., & Giamouridis, D. (2007) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2007.05.011 · Cited by 50
Uncertainty of the Liberal Peace
Goenner, C. F. (2004) · Journal of Peace Research · doi:10.1177/0022343304045977 · Cited by 50
Learning patient-specific predictive models from clinical data
Visweswaran, S., Angus, D. C., Hsieh, M., Weissfeld, L. A., Yealy, D. M., & Cooper, G. F. (2010) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2010.04.009 · Cited by 47
Option pricing under model and parameter uncertainty using predictive densities
Bunnin, F. O., Guo, Y., & Ren, Y. (2002) · Statistics and Computing · doi:10.1023/a:1013116204872 · Cited by 44
SELECTION OF WEIGHTS FOR WEIGHTED MODEL AVERAGING
Garthwaite, P. H., & Mubwandarikwa, E. (2010) · Australian & New Zealand Journal of Statistics · doi:10.1111/j.1467-842x.2010.00589.x · Cited by 36
Accounting for Model Uncertainty in Prediction of Chlorophyll a in Lake Okeechobee
Lamon, E. C., & Clyde, M. A. (2000) · Journal of Agricultural Biological and Environmental Statistics · doi:10.2307/1400456 · Cited by 36
Incorporating stakeholders' knowledge to stock assessment: Central Baltic herring
Mäntyniemi, S., Haapasaari, P., Kuikka, S., Parmanne, R., Lehtiniemi, M., & Kaitaranta, J. (2013) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-2012-0316 · Cited by 36
Swartz, M., Peterson, C. B., Lupo, P., Wu, X.-F., Forman, M., Spitz, M., Hernandez, L., Vannucci, M., & Shete, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0053475 · Cited by 36
TAN Classifiers Based on Decomposable Distributions
Cerquides, J., & de Mántaras, R. L. (2005) · Machine Learning · doi:10.1007/s10994-005-0470-7 · Cited by 33
Bayesian model averaging in astrophysics: a review
Parkinson, D., & Liddle, A. R. (2013) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11179 · Cited by 29
Bayesian subset selection for threshold autoregressive moving-average models
Chen, C. W. S., Liu, F.-C., & Gerlach, R. (2010) · Computational Statistics · doi:10.1007/s00180-010-0198-0 · Cited by 26
Capture–Recapture Estimation Using Finite Mixtures of Arbitrary Dimension
Arnold, R., Hayakawa, Y., & Yip, P. S. F. (2009) · Biometrics · doi:10.1111/j.1541-0420.2009.01289.x · Cited by 20
Bayesian variable selection for probit mixed models applied to gene selection
Baragatti, M. (2011) · Bayesian Analysis · doi:10.1214/11-ba607 · Cited by 20
Automated covariate selection and Bayesian model averaging in population PK/PD models
Lunn, D. J. (2007) · Journal of Pharmacokinetics and Pharmacodynamics · doi:10.1007/s10928-007-9077-x · Cited by 16
Assessment of two approximation methods for computing posterior model probabilities
Boone, E. L., Ye, K., & Smith, E. P. (2004) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2004.01.005 · Cited by 15
An Early Warning Model for Predicting Credit Booms Using Macroeconomic Aggregates
Guarín-López, A., González, A., Skandalis, D., et al. (2014) · Ensayos sobre Política Económica · doi:10.1016/s0120-4483(14)70020-x · Cited by 13
Understanding the cell phone effect on vehicle fatalities: a Bayesian view
Blattenberger, G., Fowles, R., Loeb, P. D., et al. (2011) · Applied Economics · doi:10.1080/00036846.2011.554379 · Cited by 10
Discrimination and Mortgage Lending in Boston: The Effects of Model Uncertainty
Goenner, C. F. (2008) · The Journal of Real Estate Finance and Economics · doi:10.1007/s11146-008-9154-y · Cited by 8
Bayesian hierarchical regression models for detecting QTLs in plant experiments
Boone, E. L., Simmons, S. J., Bao, H., & Stapleton, A. E. (2008) · Journal of Applied Statistics · doi:10.1080/02664760802005910 · Cited by 7
Ranyimbo, A. O., & Held, L. (2005) · Statistics in Medicine · doi:10.1002/sim.2311 · Cited by 6
Cited by
Schumacher, A. E., Kyu, H. H., Aali, A., Abbafati, C., Abbas, J., Abbasgholizadeh, R., Abbasi, M. A., Abbasian, M., Abd ElHafeez, S., Abdelmasseh, M., et al. (2024) · The Lancet · doi:10.1016/s0140-6736(24)00476-8 · Cited by 1,045
A Conceptual Introduction to Bayesian Model Averaging
Hinne, M., Gronau, Q. F., van den Bergh, D., & Wagenmakers, E.-J. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919898657 · Cited by 318
Model Averaging and Its Use in Economics
Steel, M. F. J. (2020) · Journal of Economic Literature · doi:10.1257/jel.20191385 · Cited by 321
Improving astronaut cancer risk assessment from space radiation with an ensemble model framework
Simonsen, L. C., & Slaba, T. C. (2021) · Life Sciences in Space Research · doi:10.1016/j.lssr.2021.07.002 · Cited by 36
Metadata
- Authors
- Fragoso, T. M., Bertoli, W., & Louzada, F.
- Venue
- International Statistical Review
- Publisher
- Wiley
- Published
- 2017-12-20
- Volume
- 86
- Issue
- 1
- Pages
- 1-28
- ISSN
- 0306-7734 (ISSN-L)
- 1751-5823
- OpenAlex
- W2281805729
- Cited by
- 284
- References
- 77
- FWCI
- 3.04
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.