The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
A tutorial on Bayesian nonparametric models
Abstract
A key problem in statistical modeling is model selection, that is, how to choose a model at an appropriate level of complexity. This problem appears in many settings, most prominently in choosing the number of clustersinmixturemodelsorthenumberoffactorsinfactoranalysis.Inthistutorial,wedescribeBayesian nonparametric methods, a class of methods that side-steps this issue by allowing the data to determine the complexity of the model. This tutorial is a high-level introduction to Bayesian nonparametric methods and contains several examples of their application.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
LIII. On lines and planes of closest fit to systems of points in space
Pearson, K. (1901) · The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 11,934
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
McLachlan, G., & Peel, D. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471721182 · Cited by 10,991
"General Intelligence," Objectively Determined and Measured
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412107 · Cited by 6,207
A Bayesian Analysis of Some Nonparametric Problems
Ferguson, T. S. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342360 · Cited by 4,697
A First Course in Factor Analysis
Comrey, A. L., & Lee, H. B. (2013) · doi:10.4324/9781315827506 · Cited by 4,546
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
(1996) · Choice Reviews Online · doi:10.5860/choice.34-2458 · Cited by 3,732
A First Course in Factor Analysis
Price, B. (1993) · Technometrics · doi:10.1080/00401706.1993.10485363 · Cited by 3,512
Pattern recognition and machine learning
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5091 · Cited by 2,650
(2007) · Encyclopedia of Measurement and Statistics · doi:10.4135/9781412952644.n300 · Cited by 2,578
An introduction to MCMC for machine learning.
Andrieu, C., de Freitas, N., Doucet, A., & Jordan, M. I. (2003) · Machine Learning · doi:10.1023/a:1020281327116 · Cited by 2,451
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.2307/2291091 · Cited by 2,312
Markov Chain Sampling Methods for Dirichlet Process Mixture Models
Neal, R. M. (2000) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2000.10474879 · Cited by 2,288
Bayesian Density Estimation and Inference Using Mixtures
Escobar, M. D., & West, M. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476550 · Cited by 2,255
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
Self-citation(1986) · Cited by 2,022
Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems
Antoniak, C. E. (1974) · The Annals of Statistics · doi:10.1214/aos/1176342871 · Cited by 1,972
Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
Diciccio, T. J., Kass, R. E., Raftery, A., & Wasserman, L. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474045 · Cited by 1,943
Kane, M. J., Hambrick, D. Z., Tuholski, S. W., Wilhelm, O., Payne, T. W., & Engle, R. W. (2004) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.133.2.189 · Cited by 1,679
The Minimum Description Length Principle
Grünwald, P. D. (2007) · doi:10.7551/mitpress/4643.001.0001 · Cited by 1,644
A Constructive Definition of Dirichlet Priors
Sethuraman, J. (1991) · doi:10.21236/ada238689 · Cited by 1,572
Horst, P. (1948) · Psychological Bulletin · doi:10.1037/h0052785 · Cited by 1,545
Gibbs Sampling Methods for Stick-Breaking Priors
Ishwaran, H., & James, L. F. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750332758 · Cited by 1,511
Modeling Response Times for Two-Choice Decisions
Ratcliff, R., & Rouder, J. N. (1998) · Psychological Science · doi:10.1111/1467-9280.00067 · Cited by 1,478
Variational inference for Dirichlet process mixtures
Blei, D. M., & Jordan, M. I. (2006) · Bayesian Analysis · doi:10.1214/06-ba104 · Cited by 1,438
Self-citationBayesian Variable Selection in Linear Regression
Mitchell, T. J., & Beauchamp, J. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478694 · Cited by 1,424
Exchangeability and related topics
Aldous, D. J. (1985) · Lecture Notes in Mathematics · doi:10.1007/bfb0099421 · Cited by 1,345
An Overview of Analytic Rotation in Exploratory Factor Analysis
Browne, M. W. (2001) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3601_05 · Cited by 1,140
The adaptive nature of human categorization.
Anderson, J. R. (1991) · Psychological Review · doi:10.1037/0033-295x.98.3.409 · Cited by 1,069
The Infinite Gaussian Mixture Model
Rasmussen, C. E. (1999) · Cited by 1,057
Spike and slab variable selection: Frequentist and Bayesian strategies
Ishwaran, H., & Rao, J. S. (2005) · The Annals of Statistics · doi:10.1214/009053604000001147 · Cited by 1,033
Model selection and model averaging
Claeskens, G., & Hjort, N. L. (2008) · Cited by 872
Ratcliff, R., & Tuerlinckx, F. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196302 · Cited by 838
A Variational Baysian Framework for Graphical Models
Attias, H. T. (1999) · neural information processing systems · Cited by 689
Thurstone, L. L. (1931) · Psychological Review · doi:10.1037/h0069792 · Cited by 571
Model Selection and Model Averaging
Ginestet, C. E. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2009.00614_5.x · Cited by 553
Learning systems of concepts with an infinite relational model
Kemp, C., Tenenbaum, J. B., Griffiths, T. L., Yamada, T., & Ueda, N. (2006) · Cited by 550
The Infinite Hidden Markov Model
Beal, M. J., Ghahramani, Z., & Rasmussen, C. E. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0079 · Cited by 481
A Split-Merge Markov chain Monte Carlo Procedure for the Dirichlet Process Mixture Model
Jain, S., & Neal, R. M. (2004) · Journal of Computational and Graphical Statistics · doi:10.1198/1061860043001 · Cited by 451
Nonparametric Latent Feature Models for Link Prediction
Miller, K. T., Jordan, M. I., & Griffiths, T. L. (2009) · neural information processing systems · Cited by 432
A Bayesian framework for word segmentation: Exploring the effects of context
Goldwater, S., Griffiths, T. L., & Johnson, M. (2009) · Cognition · doi:10.1016/j.cognition.2009.03.008 · Cited by 431
Context, learning, and extinction
Gershman, S. J., Blei, D. M., & Niv, Y. (2010) · Psychological Review · doi:10.1037/a0017808 · Cited by 386 · cited 2×
“A number of recent authors have extended this work (Griffiths et al., 2007; Heller et al., 2009; Sanborn et al., 2010) and applied it to other domains, such as classical conditioning (Gershman et al., 2010).”
Self-citationInfinite Mixtures of Gaussian Process Experts
Rasmussen, C. E., & Ghahramani, Z. (2001) · Cited by 377
Rational approximations to rational models: alternative algorithms for category learning
Sanborn, A. N., Griffiths, T. L., & Navarro, D. J. (2010) · Psychological Review · doi:10.1037/a0020511 · Cited by 369
Bayesian Nonparametric Spatial Modeling With Dirichlet Process Mixing
Gelfand, A. E., Kottas, A., & MacEachern, S. N. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000002078 · Cited by 350
Hierarchical Beta Processes and the Indian Buffet Process
Thibaux, R., & Jordan, M. I. (2007) · UC Berkeley · Cited by 349
Distance Dependent Chinese Restaurant ProcessesPreprint
Blei, D. M., & Frazier, P. I. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0910.1022 · Cited by 330
Self-citationThe Indian Buffet Process: An Introduction and Review
Griffiths, T. L., & Ghahramani, Z. (2011) · doi:10.5555/1953048.2021039 · Cited by 325
How cognitive modeling can benefit from hierarchical Bayesian models
Lee, M. D. (2011) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2010.08.013 · Cited by 307
Funzione caratteristica di un fenomeno aleatorio
de Finetti, B. (1929) · Dialnet (Universidad de la Rioja) · Cited by 275
Exact and approximate sum representations for the Dirichlet process
Ishwaran, H., & Zarepour, M. (2002) · Canadian Journal of Statistics · doi:10.2307/3315951 · Cited by 272
Adaptor Grammars: A Framework for Specifying Compositional Nonparametric Bayesian Models
Johnson, M., Griffiths, T. L., & Goldwater, S. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0085 · Cited by 268
Nonparametric factor analysis with beta process priors
Paisley, J., & Carin, L. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553474 · Cited by 263
Simen, P., Contreras, D., Buck, C., Hu, P., Holmes, P., & Cohen, J. D. (2009) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/a0016926 · Cited by 218
Nonlinear Models Using Dirichlet Process Mixtures
Shahbaba, B., & Neal, R. M. (2007) · arXiv (Cornell University) · doi:10.48550/arxiv.math/0703292 · Cited by 216
Nonparametric Bayesian Learning of Switching Linear Dynamical Systems
Fox, E. B., Sudderth, E. B., Jordan, M. I., & Willsky, A. S. (2008) · ScholarlyCommons (University of Pennsylvania) · Cited by 177
Infinite Latent Feature Models and the Indian Buffet Process
Griffiths, T., & Ghahramani, Z. (2005) · Cambridge University Engineering Department Publications Database · Cited by 176
Generalized Spatial Dirichlet Process Models
Duan, J. A., Guindani, M., & Gelfand, A. E. (2007) · Biometrika · doi:10.1093/biomet/asm071 · Cited by 175
Prior sensitivity in theory testing: An apologia for the Bayes factor
Vanpaemel, W. (2010) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2010.07.003 · Cited by 164
The Infinite PCFG Using Hierarchical Dirichlet Processes
Liang, P., Petrov, S., Jordan, M. I., & Klein, D. (2007) · Cited by 160
Shared Segmentation of Natural Scenes Using Dependent Pitman-Yor Processes
Sudderth, E. B., & Jordan, M. I. (2008) · Cited by 153
Modeling individual differences using Dirichlet processes
Navarro, D., Griffiths, T. L., Mark Steyvers, B., & Lee, M. D. (2006) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2005.11.006 · Cited by 151
Neal, R. M. (1992) · Springer eBooks · doi:10.1007/978-94-017-2219-3_14 · Cited by 146
Dirichlet Process Mixtures of Generalized Linear Models
Hannah, L. A., Blei, D. M., & Powell, W. B. (2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2021061 · Cited by 144
Self-citationNonparametric Bayesian sparse factor models with application to gene expression modeling
Knowles, D. A., & Ghahramani, Z. (2011) · The Annals of Applied Statistics · doi:10.1214/10-aoas435 · Cited by 132
Sharing Features among Dynamical Systems with Beta Processes
Fox, E. B., Sudderth, E. B., Jordan, M. I., & Willsky, A. S. (2010) · Cited by 132
Gelfand, A. E., & Kottas, A. (2002) · Journal of Computational and Graphical Statistics · doi:10.1198/106186002760180518 · Cited by 131
An Alternative Infinite Mixture Of Gaussian Process Experts
Meeds, E., & Osindero, S. (2005) · Cited by 110
Particle filters for mixture models with an unknown number of components
Fearnhead, P. (2003) · Statistics and Computing · doi:10.1023/b:stco.0000009418.04621.cd · Cited by 107
EZ does it! Extensions of the EZ-diffusion model
Wagenmakers, E., van der Maas, H. L. J., Dolan, C. V., & Grasman, R. P. P. P. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.6.1229 · Cited by 105
A probabilistic model of theory formation
Kemp, C., Tenenbaum, J. B., Niyogi, S. A., & Griffiths, T. L. (2009) · Cognition · doi:10.1016/j.cognition.2009.09.003 · Cited by 97
Unifying rational models of categorization via the hierarchical Dirichlet process
Griffiths, T. L., Canini, K. R., Sanborn, A. N., & Navarro, D. (2009) · Warwick Research Archive Portal (University of Warwick) · doi:10.31234/osf.io/ketw3 · Cited by 81
Nonlinear Models Using Dirichlet Process Mixtures
ShahbabaBabak, & NealRadford (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1755846 · Cited by 75
Hidden Markov Models With Stick-Breaking Priors
Paisley, J. W., & Carin, L. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2024987 · Cited by 59
Latent Features in Similarity Judgments: A Nonparametric Bayesian Approach
Navarro, D., & Griffiths, T. L. (2008) · Neural Computation · doi:10.1162/neco.2008.04-07-504 · Cited by 58
The Phylogenetic Indian Buffet Process: A Non-Exchangeable Nonparametric Prior for Latent FeaturesPreprint
Miller, K. T., Griffiths, T. L., & Jordan, M. I. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.3279 · Cited by 43
Analyzing human feature learning as nonparametric Bayesian inference
Griffiths, T. L., & Austerweil, J. L. (2008) · neural information processing systems · Cited by 26
Wagenmakers, E., & Waldorp, L. (2006) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2005.01.005 · Cited by 22
Hierarchical learning of dimensional biases in human categorization
Heller, K., Sanborn, A. N., & Chater, N. (2009) · neural information processing systems · doi:10.82444/warw.33600499 · Cited by 18
Cited by
Deep Unsupervised Learning using Nonequilibrium Thermodynamics
Sohl-Dickstein, J., Weiss, E. A., Maheswaranathan, N., & Ganguli, S. (2015) · arXiv · doi:10.48550/arxiv.1503.03585 · Cited by 2,637
A tutorial on Gaussian process regression: modelling, exploring, and exploiting functions
Schulz, E., Speekenbrink, M., & Krause, A. (2018) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2018.03.001 · Cited by 1,735
A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
Li, Q., Wen, Z., Wu, Z., Hu, S., Wang, N., Li, Y., Liu, X., & He, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3124599 · Cited by 1,407
Stochastic variational inference
Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. W. (2013) · Journal of Machine Learning Research · doi:10.5555/2567709.2502622 · Cited by 1,333
Self-citationRecent Advances in Open Set Recognition: A Survey
Geng, C., Huang, S.-J., & Chen, S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2981604 · Cited by 1,006
Metadata
- Authors
- Gershman, S. J., & Blei, D. M.
- Venue
- Journal of Mathematical Psychology
- Publisher
- Elsevier BV
- Published
- 2012-02
- Volume
- 56
- Issue
- 1
- Pages
- 1-12
- ISSN
- 0022-2496 (ISSN-L)
- OpenAlex
- W2115870554
- Cited by
- 605
- References
- 83
- FWCI
- 19.22
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.