The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Scalable Variational Inference for Bayesian Variable Selection in Regression, and Its Accuracy in Genetic Association Studies
Open accessAbstract
The Bayesian approach to variable selection in regression is a powerful tool for tackling many scientific problems. Inference for variable selection models is usually implemented using Markov chain Monte Carlo (MCMC). Because MCMC can impose a high computational cost in studies with a large number of variables, we assess an alternative to MCMC based on a simple variational approximation. Our aim is to retain useful features of Bayesian variable selection at a reduced cost. Using simulations designed to mimic genetic association studies, we show that this simple variational approximation yields posterior inferences in some settings that closely match exact values. In less restrictive (and more realistic) conditions, we show that posterior probabilities of inclusion for individual variables are often incorrect, but variational estimates of other useful quantities|including posterior distributions of the hyperparameters|are remarkably accurate. We illustrate how these results guide the use of variational inference for a genome-wide association study with thousands of samples and hundreds of thousands of variables.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls
The Wellcome Trust Case Control Consortium, Management Committee, Burton, P. R., Clayton, D. G., Cardon, L. R., Craddock, N., Deloukas, P., Duncanson, A., Kwiatkowski, D. P., McCarthy, M. I., et al. (2007) · Nature · doi:10.1038/nature05911 · Cited by 9,442
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
A second generation human haplotype map of over 3.1 million SNPs
The International HapMap Consortium (2007) · Nature · doi:10.1038/nature06258 · Cited by 4,438
Understanding the Metropolis-Hastings Algorithm
Chib, S., & Greenberg, E. (1995) · The American Statistician · doi:10.1080/00031305.1995.10476177 · Cited by 4,145
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
Regression Shrinkage and Selection via The Lasso: A Retrospective
Tibshirani, R. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.00771.x · Cited by 3,589
Bayesian Analysis of Binary and Polychotomous Response Data
Albert, J. H., & Chib, S. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476321 · Cited by 3,167
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
Park, T., & Casella, G. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000337 · Cited by 2,934
Variable Selection via Gibbs Sampling
George, E. I., & McCulloch, R. E. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476353 · Cited by 2,828
The Wellcome Trust Case Control Consortium, U.K.
Mossman, K. (2008) · Scientific American · doi:10.1038/scientificamerican0108-42a · Cited by 2,684
Genome-wide association defines more than 30 distinct susceptibility loci for Crohn's disease
the NIDDK IBD Genetics Consortium, Barrett, J. C., the Belgian-French IBD Consortium, the Wellcome Trust Case Control Consortium, Hansoul, S., Nicolae, D. L., Cho, J. H., Duerr, R. H., Rioux, J. D., Brant, S. R., et al. (2008) · Nature Genetics · doi:10.1038/ng.175 · Cited by 2,593
Franke, A., McGovern, D. P. B., Barrett, J. C., Wang, K., Radford-Smith, G. L., Ahmad, T., Lees, C. W., Balschun, T., Lee, J., Roberts, R., et al. (2010) · Nature Genetics · doi:10.1038/ng.717 · Cited by 2,520
An introduction to MCMC for machine learning.
Andrieu, C., de Freitas, N., Doucet, A., & Jordan, M. I. (2003) · Machine Learning · doi:10.1023/a:1020281327116 · Cited by 2,451
Accurate Approximations for Posterior Moments and Marginal Densities
Tierney, L., & Kadane, J. B. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478240 · Cited by 2,129
Bayesian Model Averaging for Linear Regression Models
Raftery, A. E., Hoeting, J. A., & Madigan, D. (1997) · Cited by 1,746
Bayesian Variable Selection in Linear Regression
Mitchell, T. J., & Beauchamp, J. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478694 · Cited by 1,424
Bayesian Model Averaging for Linear Regression Models
Raftery, A. E., Madigan, D., & Hoeting, J. A. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10473615 · Cited by 1,287
(1997) · Cited by 1,193
Mixtures of g Priors for Bayesian Variable Selection
Liang, F., Paulo, R., Molina, G., Clyde, M. A., & Berger, J. O. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000001337 · Cited by 1,089
The genetics and immunopathogenesis of inflammatory bowel disease
Cho, J. H. (2008) · Nature Reviews Immunology · doi:10.1038/nri2340 · Cited by 940
On assessing prior distributions and Bayesian regression analysis with g-prior distributions
Zellner, A. (1986) · Medical Entomology and Zoology · Cited by 886
Genome-wide association analysis by lasso penalized logistic regression
Wu, T. T., Chen, Y. F., Hastie, T., Sobel, E., & Lange, K. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp041 · Cited by 785 · cited 1×
“The Lasso (Tibshirani 1996) and related penalized regression methods (Tibshirani 2011) that compute a posterior mode can more easily handle large variable selection problems, and in fact they have been applied to genome-wide association studies (He and Lin 2011; Hoggart et al. 2008; Wu et al. 2009).”
MethodA review of Bayesian variable selection methods: what, how and which
O'Hara, R. B., & Sillanpää, M. J. (2009) · Bayesian Analysis · doi:10.1214/09-ba403 · Cited by 771
Bayesian parameter estimation via variational methods
Jaakkola, T. S., & Jordan, M. I. (2000) · Statistics and Computing · doi:10.1023/a:1008932416310 · Cited by 603
Yeung, K. Y., Bumgarner, R. E., & Raftery, A. E. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti319 · Cited by 544
Imputation-Based Analysis of Association Studies: Candidate Regions and Quantitative Traits
Servin, B., & Stephens, M. (2007) · PLoS Genetics · doi:10.1371/journal.pgen.0030114 · Cited by 515
Self-citationAttias, H. (1999) · Neural Computation · doi:10.1162/089976699300016458 · Cited by 504
Bayesian statistical methods for genetic association studies
Stephens, M., & Balding, D. J. (2009) · Nature Reviews Genetics · doi:10.1038/nrg2615 · Cited by 468
Self-citationInference with normal-gamma prior distributions in regression problems
Brown, P. J., & Griffin, J. E. (2010) · Bayesian Analysis · doi:10.1214/10-ba507 · Cited by 462
On Bayesian model and variable selection using MCMC
Dellaportas, P., Forster, J. J., & Ntzoufras, I. (2002) · Statistics and Computing · doi:10.1023/a:1013164120801 · Cited by 448
p-Values for High-Dimensional Regression
Meinshausen, N., Meier, L., & Bühlmann, P. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.tm08647 · Cited by 442
The Practical Implementation of Bayesian Model Selection
Chipman, H., George, E. I., & McCulloch, R. E. (2001) · Institute of Mathematical Statistics Lecture Notes - Monograph Series · doi:10.1214/lnms/1215540964 · Cited by 416
Explaining Variational Approximations
Ormerod, J. T., & Wand, M. P. (2010) · The American Statistician · doi:10.1198/tast.2010.09058 · Cited by 401
Parameter Expansion for Data Augmentation
Liu, J. S., & Wu, Y. N. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473879 · Cited by 356
Trans-dimensional Markov chain Monte Carlo
Green, P. J. (2003) · Highly Structured Stochastic Systems · doi:10.1093/oso/9780198510550.003.0017 · Cited by 329
Clyde, M., & George, E. I. (2004) · Statistical Science · doi:10.1214/088342304000000035 · Cited by 329
Simultaneous Analysis of All SNPs in Genome-Wide and Re-Sequencing Association Studies
Hoggart, C. J., Whittaker, J. C., De Iorio, M., & Balding, D. J. (2008) · PLoS Genetics · doi:10.1371/journal.pgen.1000130 · Cited by 321 · cited 1×
“The Lasso (Tibshirani 1996) and related penalized regression methods (Tibshirani 2011) that compute a posterior mode can more easily handle large variable selection problems, and in fact they have been applied to genome-wide association studies (He and Lin 2011; Hoggart et al. 2008; Wu et al. 2009).”
MethodGuan, Y., & Stephens, M. (2011) · The Annals of Applied Statistics · doi:10.1214/11-aoas455 · Cited by 302
Self-citationBayesian Adaptive Sampling for Variable Selection and Model Averaging
Clyde, M. A., Ghosh, J., & Littman, M. L. (2011) · Journal of Computational and Graphical Statistics · doi:10.1198/jcgs.2010.09049 · Cited by 247
New links to the pathogenesis of Crohn disease provided by genome-wide association scans
Mathew, C. G. (2008) · Nature Reviews Genetics · doi:10.1038/nrg2203 · Cited by 203
Evolutionary stochastic search for Bayesian model exploration
Bottolo, L., & Richardson, S. (2010) · Bayesian Analysis · doi:10.1214/10-ba523 · Cited by 175
A variable selection method for genome-wide association studies
He, Q., & Lin, D. Y. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq600 · Cited by 154
Two problems with variational expectation maximisation for time series models
Turner, R. E., & Sahani, M. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511984679.006 · Cited by 153
A variational Bayes algorithm for fast and accurate multiple locus genome-wide association analysis
Logsdon, B. A., Hoffman, G. E., & Mezey, J. G. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-58 · Cited by 132
Approximate Expectation Maximization
Heskes, T., Zoeter, O. R., & Wiegerinck, W. (2003) · Radboud Repository (Radboud University) · Cited by 20
Grid based variational approximations
Ormerod, J. T. (2010) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2010.04.024 · Cited by 12
Cited by
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1285773 · Cited by 3,811
Efficient Bayesian mixed-model analysis increases association power in large cohorts
Loh, P.-R., Tucker, G., Bulik-Sullivan, B. K., Vilhjálmsson, B. J., Finucane, H. K., Salem, R. M., Chasman, D. I., Ridker, P. M., Neale, B. M., Berger, B., et al. (2015) · Nature Genetics · doi:10.1038/ng.3190 · Cited by 1,507
fastSTRUCTURE: Variational Inference of Population Structure in Large SNP Data Sets
Raj, A., Stephens, M., & Pritchard, J. K. (2014) · Genetics · doi:10.1534/genetics.114.164350 · Cited by 1,714
Self-citationModeling Linkage Disequilibrium Increases Accuracy of Polygenic Risk Scores
Vilhjálmsson, B. J., Yang, J., Finucane, H. K., Gusev, A., Lindström, S., Ripke, S., Genovese, G., Loh, P.-R., Bhatia, G., Do, R., et al. (2015) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2015.09.001 · Cited by 1,303
Computationally efficient whole-genome regression for quantitative and binary traits
Mbatchou, J., Barnard, L., Backman, J., Marcketta, A., Kosmicki, J. A., Ziyatdinov, A., Benner, C., O’Dushlaine, C., Barber, M., Boutkov, B., et al. (2021) · Nature Genetics · doi:10.1038/s41588-021-00870-7 · Cited by 1,502
Metadata
- Authors
- Carbonetto, P., & Stephens, M.
- Venue
- Bayesian Analysis
- Publisher
- Institute of Mathematical Statistics
- Published
- 2012-03-01
- Volume
- 7
- Issue
- 1
- Pages
- 73-108
- ISSN
- 1931-6690 (ISSN-L)
- 1936-0975
- OpenAlex
- W1483883706
- Cited by
- 261
- References
- 52
- FWCI
- 13.48
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.