The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Variational inference for Dirichlet process mixtures
Open accessAbstract
Dirichlet process (DP) mixture models are the cornerstone of nonparametric Bayesian statistics, and the development of Monte-Carlo Markov chain (MCMC) sampling methods for DP mixtures has enabled the application of nonparametric Bayesian methods to a variety of practical data analysis problems. However, MCMC sampling can be prohibitively slow, and it is important to explore alternatives. One class of alternatives is provided by variational methods, a class of deterministic algorithms that convert inference problems into optimization problems (Opper and Saad 2001; Wainwright and Jordan 2003). Thus far, variational methods have mainly been explored in the parametric setting, in particular within the formalism of the exponential family (Attias 2000; Ghahramani and Beal 2001; Blei et al. 2003). In this paper, we present a variational inference algorithm for DP mixtures. We present experiments that compare the algorithm to Gibbs sampling algorithms for DP mixtures of Gaussians and present an application to a large-scale image analysis problem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Bertsekas, D. P. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600425 · Cited by 11,726
Monte Carlo Statistical Methods
Kim, H. (2000) · Technometrics · doi:10.1080/00401706.2000.10485722 · Cited by 5,508
A Bayesian Analysis of Some Nonparametric Problems
Ferguson, T. S. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342360 · Cited by 4,697
Lohrli, A. (1985) · Notes and Queries · doi:10.1093/notesj/32.3.377-a · Cited by 4,352
Monte Carlo Statistical Methods
Robert, C. P., & Casella, G. (2004) · Springer Texts in Statistics · doi:10.1007/978-1-4757-4145-2 · Cited by 4,271
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
Self-citationGraphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
Self-citationMarkov Chain Sampling Methods for Dirichlet Process Mixture Models
Neal, R. M. (2000) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2000.10474879 · Cited by 2,288
Research works printed but not linked: 3
- Barnard, K., P. Duygulu, N. de Freitas, D. Forsyth, D. Blei, and M. Jordan. 2003. Matching words and pictures. Journal of Machine Learning Research 3: 1107–1135.
- Connor, R. and J. Mosimann. 1969. Concepts of independence for proportions with a generalization of the Dirichlet distribution. Journal of the American Statistical Association 64(325): 194–206. · doi:10.1080/01621459.1969.10500963
- Xing, E., M. Jordan, and S. Russell. 2003. A generalized mean field algorithm for variational inference in exponential families. In Proceedings of the 19th Annual Conference on Uncertainty in Artificial Intelligence (UAI-03), eds. C. Meek and U. Kjærulff, 583–591. San Francisco, CA: Morgan Kaufmann Publishers.
Cited by
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1285773 · Cited by 3,811
Self-citationText as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
Self-citationStochastic variational inference
Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. W. (2013) · Journal of Machine Learning Research · doi:10.5555/2567709.2502622 · Cited by 1,333
Self-citationA correlated topic model of Science
Blei, D. M., & Lafferty, J. (2018) · doi:10.1184/r1/6587330.v1 · Cited by 1,088
Self-citationA correlated topic model of Science
Blei, D. M., & Lafferty, J. D. (2007) · The Annals of Applied Statistics · doi:10.1214/07-aoas114 · Cited by 953
Self-citationVisualization and analysis of single-cell RNA-seq data by kernel-based similarity learning
Wang, B., Zhu, J., Pierson, E., Ramazzotti, D., & Batzoglou, S. (2017) · Nature Methods · doi:10.1038/nmeth.4207 · Cited by 706
The nested chinese restaurant process and bayesian nonparametric inference of topic hierarchies
Blei, D. M., Griffiths, T. L., & Jordan, M. I. (2010) · Journal of the ACM · doi:10.1145/1667053.1667056 · Cited by 646
Self-citationAggarwal, C. C. (2015) · Data Mining · doi:10.1007/978-3-319-14142-8_13 · Cited by 606
A tutorial on Bayesian nonparametric models
Gershman, S. J., & Blei, D. M. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2011.08.004 · Cited by 605
Self-citationFundamentals of Nonparametric Bayesian Inference
Ghosal, S., & van der Vaart, A. (2017) · Cambridge University Press eBooks · doi:10.1017/9781139029834 · Cited by 590
A Latent Variable Model for Geographic Lexical Variation
Eisenstein, J., O'Connor, B., Smith, N. A., & Xing, E. P. (2018) · Figshare · doi:10.1184/r1/6475412 · Cited by 584
Grimmer, J. (2010) · Political Analysis · doi:10.1093/pan/mpp034 · Cited by 550
Modelling uncertainty in deep learning for camera relocalization
Kendall, A., & Cipolla, R. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487679 · Cited by 548
“However we found that all of these methods produced poorer localization uncertainty than fitting a single unimodal Gaussian to the data.”
MethodAutomatic differentiation variational inference
Kucukelbir, A., Tran, D., Ranganath, R., Gelman, A., & Blei, D. M. (2016) · arXiv · doi:10.48550/arxiv.1603.00788 · Cited by 515
Simultaneously Discovering and Quantifying Risk Types from Textual Risk Disclosures
Bao, Y., & Datta, A. (2014) · Management Science · doi:10.1287/mnsc.2014.1930 · Cited by 488
Semi-Supervised Deep Learning Using Pseudo Labels for Hyperspectral Image Classification
Wu, H., & Prasad, S. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2772836 · Cited by 463
A comparative evaluation of outlier detection algorithms: Experiments and analyses
Domingues, R., Filippone, M., Michiardi, P., & Zouaoui, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.09.037 · Cited by 452
Unsupervised Learning Methods for Molecular Simulation Data
Glielmo, A., Husic, B. E., Rodriguez, A., Clementi, C., Noé, F., & Laio, A. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.0c01195 · Cited by 402
Full-Text or Abstract? Examining Topic Coherence Scores Using Latent Dirichlet Allocation
Syed, S., & Spruit, M. (2017) · 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2017.61 · Cited by 400
Fast hierarchical Bayesian analysis of population structure
Tonkin-Hill, G., Lees, J. A., Bentley, S. D., Frost, S. D. W., & Corander, J. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz361 · Cited by 346
Blei, D., Carin, L., & Dunson, D. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.938079 · Cited by 335
Self-citationThe Indian Buffet Process: An Introduction and Review
Griffiths, T. L., & Ghahramani, Z. (2011) · doi:10.5555/1953048.2021039 · Cited by 325
Rodríguez, A., Dunson, D. B., & Gelfand, A. E. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000553 · Cited by 294
Time series forecasting for nonlinear and non-stationary processes: a review and comparative study
Cheng, C., Sa-Ngasoongsong, A., Beyca, O., Le, T., Yang, H., Kong, Z. (., & Bukkapatnam, S. T. S. (2015) · IIE Transactions · doi:10.1080/0740817x.2014.999180 · Cited by 287
Variational Bayesian Inference with Stochastic Search
Paisley, J. W., Blei, D. M., & Jordan, M. I. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6430 · Cited by 275
Self-citationRevisiting k-means: New Algorithms via Bayesian Nonparametrics
Kulis, B., & Jordan, M. I. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1111.0352 · Cited by 262
Self-citationHierarchical relational models for document networks
Chang, J., & Blei, D. M. (2010) · The Annals of Applied Statistics · doi:10.1214/09-aoas309 · Cited by 255
Self-citationAn organelle-specific protein landscape identifies novel diseases and molecular mechanisms
Boldt, K., van Reeuwijk, J., Lu, Q., Koutroumpas, K., Nguyen, T.-M. T., Texier, Y., van Beersum, S. E. C., Horn, N., Willer, J. R., Mans, D. A., et al. (2016) · Nature Communications · doi:10.1038/ncomms11491 · Cited by 240
General purpose computer-assisted clustering and conceptualization
Grimmer, J., & King, G. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1018067108 · Cited by 179
Sun, S., & Xu, X. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2093575 · Cited by 137
Context-aware experience sampling reveals the scale of variation in affective experience
Hoemann, K., Khan, Z., Feldman, M. J., Nielson, C., Devlin, M., Dy, J., Barrett, L. F., Wormwood, J. B., & Quigley, K. S. (2020) · Scientific Reports · doi:10.1038/s41598-020-69180-y · Cited by 124
Machine learning for high-dimensional dynamic stochastic economies
Scheidegger, S., & Bilionis, I. (2019) · Journal of Computational Science · doi:10.1016/j.jocs.2019.03.004 · Cited by 72
An Information-Theoretic Perspective on Intrinsic Motivation in Reinforcement Learning: A Survey
Aubret, A., Matignon, L., & Hassas, S. (2023) · Entropy · doi:10.3390/e25020327 · Cited by 52
Curiosity-Driven Experience Prioritization via Density Estimation
Zhao, R., & Tresp, V. (2019) · arXiv · doi:10.48550/arxiv.1902.08039 · Cited by 47
Hoemann, K., Khan, Z., Kamona, N., Dy, J., Barrett, L. F., & Quigley, K. S. (2021) · Psychophysiology · doi:10.1111/psyp.13818 · Cited by 40
Soundscapes predict species occurrence in tropical forests
Sethi, S. S., Ewers, R. M., Jones, N. S., Sleutel, J., Shabrani, A., Zulkifli, N., & Picinali, L. (2022) · Oikos · doi:10.1111/oik.08525 · Cited by 34
Emergent communication through Metropolis-Hastings naming game with deep generative models
Taniguchi, T., Yoshida, Y., Matsui, Y., Le Hoang, N., Taniguchi, A., & Hagiwara, Y. (2023) · Advanced Robotics · doi:10.1080/01691864.2023.2260856 · Cited by 33
Dirichlet process mixture models for unsupervised clustering of symptoms in Parkinson's disease
White, N., Johnson, H., Silburn, P., & Mengersen, K. (2012) · Journal of Applied Statistics · doi:10.1080/02664763.2012.710897 · Cited by 9
Using Dirichlet Marked Hawkes Processes for Insider Threat Detection
Zheng, P., Yuan, S., & Wu, X. (2022) · Digital Threats: Research and Practice · doi:10.1145/3457908 · Cited by 6
Improving Environment Novelty Quantification for Effective Unsupervised Environment Design
Teoh, J., Li, W., & Varakantham, P. (2025) · arXiv
“Future work could also investigate more advanced density models, such as Variational Gaussian Mixture Models [11], Deep Gaussian Mixture Models [55], or Normalizing Flow Models [44].”
Improving Environment Novelty Quantification for Effective Unsupervised Environment Design
Teoh, J., Li, W., & Varakantham, P. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-4300
Metadata
- Authors
- Blei, D. M., & Jordan, M. I.
- Venue
- Bayesian Analysis
- Publisher
- Institute of Mathematical Statistics
- Published
- 2006-03-01
- Volume
- 1
- Issue
- 1
- Pages
- 121-143
- ISSN
- 1931-6690 (ISSN-L)
- 1936-0975
- OpenAlex
- W2127498532
- Cited by
- 1,438
- References
- 30
- FWCI
- 27.94
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.