The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Explaining Variational Approximations
Open accessAbstract
Variational approximations facilitate approximate inference for the parameters in complex statistical models and provide fast, deterministic alternatives to Monte Carlo methods. However, much of the contemporary literature on variational approximations is in Computer Science rather than Statistics, and uses terminology, notation, and examples from the former field. In this article we explain variational approximation in statistical terms. In particular, we illustrate the ideas of variational approximation using examples that are familiar to statisticians.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
nlme : Linear and nonlinear mixed effects models
DebRoy, S. (2006) · Medical Entomology and Zoology · Cited by 10,009
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278
The EM Algorithm and Extensions
Kushary, D. (1998) · Technometrics · doi:10.1080/00401706.1998.10485534 · Cited by 5,417
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
Bayesian Analysis of Binary and Polychotomous Response Data
Albert, J. H., & Chib, S. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476321 · Cited by 3,167
Generalized, Linear, and Mixed Models
McCulloch, C. E., & Searle, S. R. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471722073 · Cited by 2,994
Casella, G., & George, E. I. (1992) · The American Statistician · doi:10.1080/00031305.1992.10475878 · Cited by 2,364
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.2307/2291091 · Cited by 2,312
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2008) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000001 · Cited by 1,820
GAUSSIAN PROCESSES FOR MACHINE LEARNING
SEEGER, M. (2004) · International Journal of Neural Systems · doi:10.1142/s0129065704001899 · Cited by 1,488
(2018) · Physics Subject Headings (PhySH) · doi:10.29172/0660b3fe-654b-49c9-a7fa-79f18efe2aa0 · Cited by 882
Casella, G., & George, E. I. (1992) · The American Statistician · doi:10.2307/2685208 · Cited by 863
(2005) · Edinburgh Research Explorer (University of Edinburgh) · doi:10.5555/1046920.1088695 · Cited by 650
Bayesian parameter estimation via variational methods
Jaakkola, T. S., & Jordan, M. I. (2000) · Statistics and Computing · doi:10.1023/a:1008932416310 · Cited by 603
Jordan, M. I. (2004) · Statistical Science · doi:10.1214/088342304000000026 · Cited by 420
Variational Bayesian Multinomial Probit Regression with Gaussian Process Priors
Girolami, M., & Rogers, S. (2006) · Neural Computation · doi:10.1162/neco.2006.18.8.1790 · Cited by 195
Variational approximations in Bayesian model selection for finite mixture distributions
McGrory, C. A., & Titterington, D. M. (2007) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2006.07.020 · Cited by 169
Bayesian Methods for Neural Networks and Related Models
Titterington, D. M. (2004) · Statistical Science · doi:10.1214/088342304000000099 · Cited by 162 · cited 4×
“The expositions by Jordan (2004) and Titterington (2004) provide access to some of the literature on variational approximation accuracy.”
BackgroundInfluentialTitterington, D. M., & Wang, B. Y. (2006) · Bayesian Analysis · doi:10.1214/06-ba121 · Cited by 121
Seeger, M. (1999) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 104
Mean-field variational approximate Bayesian inference for latent variable models
Consonni, G., & Marin, J. (2006) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2006.10.028 · Cited by 89
A variational Bayesian mixture modelling framework for cluster analysis of gene-expression data
Teschendorff, A. E., Wang, Y., Barbosa‐Morais, N. L., Brenton, J. D., & Caldas, C. (2005) · Computer applications in the biosciences · doi:10.1093/bioinformatics/bti466 · Cited by 86
Ensemble Learning for Multi-Layer Networks
Barber, D., & Bishop, C. (1997) · Cited by 71
Variational Bayes for estimating the parameters of a hidden Potts model
McGrory, C. A., Titterington, D. M., Reeves, R., & Pettitt, A. N. (2008) · Statistics and Computing · doi:10.1007/s11222-008-9095-6 · Cited by 68
Unsupervised Variational Bayesian Learning of Nonlinear Models
Honkela, A., & Harri Valpola, B. (2004) · Cited by 51
Hall, P., Humphreys, K., & Titterington, D. M. (2002) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/1467-9868.00350 · Cited by 24
Grid based variational approximations
Ormerod, J. T. (2010) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2010.04.024 · Cited by 12
Self-citationImportance sampling as a variational approximation
Nott, D. J., Li, J., & Fielding, M. (2011) · Statistics & Probability Letters · doi:10.1016/j.spl.2011.02.028 · Cited by 2
Cited by
A guide to Bayesian model selection for ecologists
Hooten, M. B., & Hobbs, N. T. (2015) · Ecological Monographs · doi:10.1890/14-0661.1 · Cited by 891
So Many Variables: Joint Modeling in Community Ecology
Warton, D. I., Blanchet, F. G., O’Hara, R. B., Ovaskainen, O., Taskinen, S., Walker, S. C., & Hui, F. K. C. (2015) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2015.09.007 · Cited by 854
A Review of Modern Computational Algorithms for Bayesian Optimal Design
Ryan, E. G., Drovandi, C. C., McGree, J. M., & Pettitt, A. N. (2016) · International Statistical Review · doi:10.1111/insr.12107 · Cited by 312
Carbonetto, P., & Stephens, M. (2012) · Bayesian Analysis · doi:10.1214/12-ba703 · Cited by 261
Metadata
- Authors
- Ormerod, J. T., & Wand, M. P.
- Venue
- The American Statistician
- Publisher
- Informa UK Limited
- Published
- 2010-05
- Volume
- 64
- Issue
- 2
- Pages
- 140-153
- ISSN
- 0003-1305 (ISSN-L)
- 1537-2731
- OpenAlex
- W2059424427
- Cited by
- 401
- References
- 32
- FWCI
- 18.05
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.