The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Variational inference for Dirichlet process mixtures
Open accessAbstract
Dirichlet process (DP) mixture models are the cornerstone of nonparametric Bayesian statistics, and the development of Monte-Carlo Markov chain (MCMC) sampling methods for DP mixtures has enabled the application of nonparametric Bayesian methods to a variety of practical data analysis problems. However, MCMC sampling can be prohibitively slow, and it is important to explore alternatives. One class of alternatives is provided by variational methods, a class of deterministic algorithms that convert inference problems into optimization problems (Opper and Saad 2001; Wainwright and Jordan 2003). Thus far, variational methods have mainly been explored in the parametric setting, in particular within the formalism of the exponential family (Attias 2000; Ghahramani and Beal 2001; Blei et al. 2003). In this paper, we present a variational inference algorithm for DP mixtures. We present experiments that compare the algorithm to Gibbs sampling algorithms for DP mixtures of Gaussians and present an application to a large-scale image analysis problem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Bertsekas, D. P. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600425 · Cited by 11,726
Monte Carlo Statistical Methods
Kim, H. (2000) · Technometrics · doi:10.1080/00401706.2000.10485722 · Cited by 5,508
A Bayesian Analysis of Some Nonparametric Problems
Ferguson, T. S. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342360 · Cited by 4,697
Lohrli, A. (1985) · Notes and Queries · doi:10.1093/notesj/32.3.377-a · Cited by 4,352
Monte Carlo Statistical Methods
Robert, C. P., & Casella, G. (2004) · Springer Texts in Statistics · doi:10.1007/978-1-4757-4145-2 · Cited by 4,271
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
Self-citationGraphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
Self-citationMarkov Chain Sampling Methods for Dirichlet Process Mixture Models
Neal, R. M. (2000) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2000.10474879 · Cited by 2,288
Bayesian Density Estimation and Inference Using Mixtures
Escobar, M. D., & West, M. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476550 · Cited by 2,255
Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems
Antoniak, C. E. (1974) · The Annals of Statistics · doi:10.1214/aos/1176342871 · Cited by 1,972
(2003) · Cited by 1,680
A Constructive Definition of Dirichlet Priors
Sethuraman, J. (1991) · doi:10.21236/ada238689 · Cited by 1,572
Gibbs Sampling Methods for Stick-Breaking Priors
Ishwaran, H., & James, L. F. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750332758 · Cited by 1,511
Ferguson Distributions Via Polya Urn Schemes
Blackwell, D., & MacQueen, J. B. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342372 · Cited by 1,329
Automatic image annotation and retrieval using cross-media relevance models
Jeon, J., Lavrenko, V., & Manmatha, R. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860459 · Cited by 1,139
Monte Carlo Statistical Methods (Springer Texts in Statistics)
Robert, C. P., & Casella, G. (2005) · Springer eBooks · Cited by 1,002
A Variational Baysian Framework for Graphical Models
Attias, H. T. (1999) · neural information processing systems · Cited by 689
Raftery, A. E., & Lewis, S. M. (1992) · Statistical Science · doi:10.1214/ss/1177011143 · Cited by 530
Jordan, M. I. (2004) · Statistical Science · doi:10.1214/088342304000000026 · Cited by 420
Self-citationEstimating normal means with a conjugate style dirichlet process prior
Maceachern, S. N. (1994) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610919408813196 · Cited by 407
Fundamentals of Statistical Exponential Families
Brown, L. D. (1987) · Cited by 386
Advanced mean field methods: theory and practice
Opper, M., & Saad, D. (2001) · Cited by 385
Advanced Mean Field Methods: Theory and Practice
(2001) · The MIT Press eBooks · doi:10.7551/mitpress/1100.001.0001 · Cited by 336
Propagation Algorithms for Variational Bayesian Learning
Ghahramani, Z., & Beal, M. J. (2000) · Cited by 283
Gelfand, A. E., & Kottas, A. (2002) · Journal of Computational and Graphical Statistics · doi:10.1198/106186002760180518 · Cited by 131
Computational Methods for Mixture of Dirichlet Process Models
MacEachern, S. N. (1998) · Lecture notes in statistics · doi:10.1007/978-1-4612-1732-9_2 · Cited by 96
VIBES: A Variational Inference Engine for Bayesian Networks
Bishop, C., Spiegelhalter, D. J., & Winn, J. M. (2002) · neural information processing systems · Cited by 81
Variational Approximations between Mean Field Theory and the Junction Tree AlgorithmPreprint
Wiegerinck, W. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3901 · Cited by 74
Research works printed but not linked: 3
- Barnard, K., P. Duygulu, N. de Freitas, D. Forsyth, D. Blei, and M. Jordan. 2003. Matching words and pictures. Journal of Machine Learning Research 3: 1107–1135.
- Connor, R. and J. Mosimann. 1969. Concepts of independence for proportions with a generalization of the Dirichlet distribution. Journal of the American Statistical Association 64(325): 194–206. · doi:10.1080/01621459.1969.10500963
- Xing, E., M. Jordan, and S. Russell. 2003. A generalized mean field algorithm for variational inference in exponential families. In Proceedings of the 19th Annual Conference on Uncertainty in Artificial Intelligence (UAI-03), eds. C. Meek and U. Kjærulff, 583–591. San Francisco, CA: Morgan Kaufmann Publishers.
Cited by
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1285773 · Cited by 3,811
Self-citationText as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
Self-citationStochastic variational inference
Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. W. (2013) · Journal of Machine Learning Research · doi:10.5555/2567709.2502622 · Cited by 1,333
Self-citationA correlated topic model of Science
Blei, D. M., & Lafferty, J. (2018) · doi:10.1184/r1/6587330.v1 · Cited by 1,088
Self-citation
Metadata
- Authors
- Blei, D. M., & Jordan, M. I.
- Venue
- Bayesian Analysis
- Publisher
- Institute of Mathematical Statistics
- Published
- 2006-03-01
- Volume
- 1
- Issue
- 1
- Pages
- 121-143
- ISSN
- 1931-6690 (ISSN-L)
- 1936-0975
- OpenAlex
- W2127498532
- Cited by
- 1,438
- References
- 30
- FWCI
- 27.94
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.