The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Hierarchical Bayesian nonparametric models with applications
Abstract
Hierarchical modeling is a fundamental concept in Bayesian statistics. The basic idea is that parameters are endowed with distributions which may themselves introduce new parameters, and this construction recurses. In this review we discuss the role of hierarchical modeling in Bayesian nonparametrics, focusing on models in which the infinite-dimensional parameters are treated hierarchically. For example, we consider a model in which the base measure for a Dirichlet process is itself treated as a draw from another Dirichlet process. This yields a natural recursion that we refer to as a hierarchical Dirichlet process. We also discuss hierarchies based on the Pitman–Yor process and on completely random processes. We demonstrate the value of these hierarchical constructions in a wide range of practical applications, in problems in computational biology, computer vision and natural language processing. Introduction Hierarchical modeling is a fundamental concept in Bayesian statistics. The basic idea is that parameters are endowed with distributions which may themselves introduce new parameters, and this construction recurses. A common motif in hierarchical modeling is that of the conditionally independent hierarchy, in which a set of parameters are coupled by making their distributions depend on a shared underlying parameter. These distributions are often taken to be identical, based on an assertion of exchangeability and an appeal to de Finetti's theorem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Inference of Population Structure Using Multilocus Genotype Data
Pritchard, J. K., Stephens, M., & Donnelly, P. (2000) · Genetics · doi:10.1093/genetics/155.2.945 · Cited by 33,908
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“Hidden Markov Models with Infinite State Spaces Hidden Markov models (HMMs) are widely used to model sequential data and time series data (Rabiner, 1989).”
MethodBlei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Self-citationIntroduction to Modern Information Retrieval
Salton, G., & McGill, M. J. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 11,392
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
A New Statistical Method for Haplotype Reconstruction from Population Data
Stephens, M., Smith, N. J., & Donnelly, P. (2001) · The American Journal of Human Genetics · doi:10.1086/319501 · Cited by 7,493
Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Introduction to modern information retrieval
Dillon, M. (1983) · Information Processing & Management · doi:10.1016/0306-4573(83)90062-6 · Cited by 5,909
A Bayesian Analysis of Some Nonparametric Problems
Ferguson, T. S. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342360 · Cited by 4,697
A Bayesian Hierarchical Model for Learning Natural Scene Categories
Li, F.-F., & Perona, P. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.16 · Cited by 3,613
Markov Chain Sampling Methods for Dirichlet Process Mixture Models
Neal, R. M. (2000) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2000.10474879 · Cited by 2,288
Robertson, S. E., Walker, S., Jones, S., Hancock‐Beaulieu, M., & Gatford, M. (1994) · Text REtrieval Conference · Cited by 2,212
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
Self-citationAn empirical study of smoothing techniques for language modeling
Chen, S. F., & Goodman, J. (1999) · Computer Speech & Language · doi:10.1006/csla.1999.0128 · Cited by 2,066
Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems
Antoniak, C. E. (1974) · The Annals of Statistics · doi:10.1214/aos/1176342871 · Cited by 1,972
A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition
RABINER, L. R. (1990) · Readings in Speech Recognition · doi:10.1016/b978-0-08-051584-7.50027-9 · Cited by 1,869
Introduction to Statistical Relational Learning
(2007) · doi:10.7551/mitpress/7432.001.0001 · Cited by 1,643
A Constructive Definition of Dirichlet Priors
Sethuraman, J. (1991) · doi:10.21236/ada238689 · Cited by 1,572
Gibbs Sampling Methods for Stick-Breaking Priors
Ishwaran, H., & James, L. F. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750332758 · Cited by 1,511
The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator
Pitman, J., & Yor, M. (1997) · The Annals of Probability · doi:10.1214/aop/1024404422 · Cited by 1,202
Slice SamplingPreprint
Neal, R. M. (2000) · arXiv (Cornell University) · Cited by 1,160
Combinatorial Stochastic Processes
(2006) · Lecture Notes in Mathematics · doi:10.1007/b11601500 · Cited by 935
Hierarchical Topic Models and the Nested Chinese Restaurant Process
Griffiths, T. L., Jordan, M. I., Tenenbaum, J. B., & Blei, D. M. (2003) · Cited by 912
Self-citation(2024) · On Bilinguals and Bilingualism · doi:10.1017/9781009210409.006 · Cited by 800
Bayesian Methods for Hidden Markov Models: Recursive Computing in the 21st Century
Scott, S. L. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479464 · Cited by 517
A hierarchical Bayesian language model based on Pitman-Yor processes
Teh, Y. W. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220299 · Cited by 489
Self-citationThe Infinite Hidden Markov Model
Beal, M. J., Ghahramani, Z., & Rasmussen, C. E. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0079 · Cited by 481
Hierarchical Beta Processes and the Indian Buffet Process
Thibaux, R., & Jordan, M. I. (2007) · UC Berkeley · Cited by 422
Self-citationSampling the Dirichlet Mixture Model with Slices
Walker, S. G. (2007) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610910601096262 · Cited by 420
Size-biased sampling of Poisson point processes and excursions
Perman, M., Pitman, J., & Yor, M. (1992) · Probability Theory and Related Fields · doi:10.1007/bf01205234 · Cited by 328
Contextual dependencies in unsupervised word segmentation
Goldwater, S., Griffiths, T. L., & Johnson, M. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220260 · Cited by 305
Multiscale recursive estimation, data fusion, and regularization
Chou, K. C., Willsky, A. S., & Benveniste, A. (1994) · IEEE Transactions on Automatic Control · doi:10.1109/9.280746 · Cited by 281
A hierarchical Dirichlet language model
MacKay, D. J. C., & Peto, L. C. B. (1995) · Natural Language Engineering · doi:10.1017/s1351324900000218 · Cited by 274
Adaptor Grammars: A Framework for Specifying Compositional Nonparametric Bayesian Models
Johnson, M., Griffiths, T. L., & Goldwater, S. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0085 · Cited by 268
An HDP-HMM for systems with state persistence
Fox, E. B., Sudderth, E. B., Jordan, M. I., & Willsky, A. S. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390196 · Cited by 259
Self-citationBeam sampling for the infinite hidden Markov model
Van Gael, J., Saatci, Y., Teh, Y. W., & Ghahramani, Z. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390293 · Cited by 216
Self-citationThe ICSI RT07s Speaker Diarization System
Wooters, C., & Huijbregts, M. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-68585-2_47 · Cited by 201
Shared Segmentation of Natural Scenes Using Dependent Pitman-Yor Processes
Sudderth, E. B., & Jordan, M. I. (2008) · neural information processing systems · Cited by 187
Self-citationGeneralized Spatial Dirichlet Process Models
Duan, J. A., Guindani, M., & Gelfand, A. E. (2007) · Biometrika · doi:10.1093/biomet/asm071 · Cited by 175
Describing Visual Scenes Using Transformed Objects and Parts
Sudderth, E. B., Torralba, A., Freeman, W. T., & Willsky, A. S. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0069-5 · Cited by 164
The Infinite PCFG Using Hierarchical Dirichlet Processes
Liang, P., Petrov, S., Jordan, M. I., & Klein, D. (2007) · Cited by 160
Self-citationCollapsed Variational Inference for HDP
Teh, Y. W., Kurihara, K., & Welling, M. (2007) · Cited by 142
Self-citationLearning Multiscale Representations of Natural Scenes Using Dirichlet Processes
Kivinen, J., Sudderth, E. B., & Jordan, M. I. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4408870 · Cited by 73
Self-citationFinkel, J. R., Grenager, T., & Manning, C. D. (2007) · Cited by 56
Bayesian Haplotype Inference via the Dirichlet Process
Xing, E. P., Jordan, M. I., & Sharan, R. (2007) · Journal of Computational Biology · doi:10.1089/cmb.2006.0102 · Cited by 46
Self-citationA choice model with infinitely many latent features
Görür, D., Jäkel, F., & Rasmussen, C. E. (2006) · International Conference on Machine Learning · doi:10.1145/1143844.1143890 · Cited by 44
Bayesian multi-population haplotype inference via a hierarchical dirichlet process mixture
Xing, E. P., Sohn, K.-A., Jordan, M. I., & Teh, Y. (2006) · International Conference on Machine Learning · doi:10.1145/1143844.1143976 · Cited by 35
Self-citationTOMLINSON, G. A. (1998) · Library and Archives Canada (Government of Canada) · Cited by 32
Hierarchical Dirichlet Processes with Random Effects
Kim, S., & Smyth, P. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0092 · Cited by 31
CHU, W., Ghahramani, Z., Krause, R., & Wild, D. L. (2005) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789812701626_0022 · Cited by 25
Probabilistic Document Modelling
Cowans, P. J. (2006) · Cited by 21
Information retrieval using hierarchical dirichlet processes
Cowans, P. J. (2004) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1008992.1009122 · Cited by 19
Hidden Markov Dirichlet Process: Modeling Genetic Recombination in Open Ancestral Space
Sohn, K.-A., & Xing, E. P. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0168 · Cited by 14
Cited by
Stier, S., Bleier, A., Lietz, H., & Strohmaier, M. (2018) · Political Communication · doi:10.1080/10584609.2017.1334728 · Cited by 566
Mathematical Foundations of Infinite-Dimensional Statistical Models
Giné, E., & Nickl, R. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781107337862 · Cited by 402
(2014) · doi:10.1145/2635868.2635901 · Cited by 159
Symbol emergence in robotics: a survey
Taniguchi, T., Nagai, T., Nakamura, T., Iwahashi, N., Ogata, T., & Asoh, H. (2016) · Advanced Robotics · doi:10.1080/01691864.2016.1164622 · Cited by 150
Metadata
- Authors
- Teh, Y. W., & Jordan, M. I.
- Venue
- Bayesian Nonparametrics
- Publisher
- Cambridge University Press
- Published
- 2010-04-12
- Pages
- 158-207
- OpenAlex
- W166614460
- Cited by
- 319
- References
- 54
- FWCI
- 33.65
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.