The DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index.
The nested chinese restaurant process and bayesian nonparametric inference of topic hierarchies
Open accessAbstract
We present the nested Chinese restaurant process (nCRP), a stochastic process that assigns probability distributions to ensembles of infinitely deep, infinitely branching trees. We show how this stochastic process can be used as a prior distribution in a Bayesian nonparametric model of document collections. Specifically, we present an application to information retrieval in which documents are modeled as paths down a random tree, and the preferential attachment dynamics of the nCRP leads to clustering of documents according to sharing of topics at multiple levels of abstraction. Given a corpus of documents, a posterior inference algorithm finds an approximation to a posterior distribution over trees, topics and allocations of words to levels of the tree. We demonstrate this algorithm on collections of scientific abstracts from several journals. This model exemplifies a recent trend in statistical machine learning—the use of Bayesian nonparametric methods to infer distributions on flexible data structures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Emergence of Scaling in Random Networks
Barabási, A.-L., & Albert, R. (1999) · Science · doi:10.1126/science.286.5439.509 · Cited by 36,135
Inference of Population Structure Using Multilocus Genotype Data
Pritchard, J. K., Stephens, M., & Donnelly, P. (2000) · Genetics · doi:10.1093/genetics/155.2.945 · Cited by 33,908
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Statistical mechanics of complex networks
Albert, R., & Barabási, A.-L. (2002) · Reviews of Modern Physics · doi:10.1103/revmodphys.74.47 · Cited by 20,471
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Sampling-based approaches to calculating marginal densities
Gelfand, A. E., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10476213 · Cited by 6,606
PE, & Billingsley, P. (1996) · Journal of the American Statistical Association · doi:10.2307/2291440 · Cited by 6,481
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
Self-citationMonte Carlo Statistical Methods
Kim, H. (2000) · Technometrics · doi:10.1080/00401706.2000.10485722 · Cited by 5,508
A Bayesian Analysis of Some Nonparametric Problems
Ferguson, T. S. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342360 · Cited by 4,697
Monte Carlo Statistical Methods
Robert, C. P., & Casella, G. (2004) · Springer Texts in Statistics · doi:10.1007/978-1-4757-4145-2 · Cited by 4,271
Probabilistic Latent Semantic Indexing
Hofmann, T. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130370 · Cited by 3,988
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
A Bayesian Hierarchical Model for Learning Natural Scene Categories
Li, F.-F., & Perona, P. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.16 · Cited by 3,613
A Probabilistic Theory of Pattern Recognition
Devroye, L., Györfi, L., & Lugosi, G. (1996) · Stochastic Modelling and Applied Probability · doi:10.1007/978-1-4612-0711-5 · Cited by 3,274
Lauritzen, S. L. (1996) · doi:10.1093/oso/9780198522195.001.0001 · Cited by 2,976
Statistical Analysis of Finite Mixture Distributions.
Lindsay, B. G., Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1987) · Journal of the American Statistical Association · doi:10.2307/2289504 · Cited by 2,905
Blei, D. M., & Lafferty, J. D. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143859 · Cited by 2,386
Self-citationMarkov Chain Sampling Methods for Dirichlet Process Mixture Models
Neal, R. M. (2000) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2000.10474879 · Cited by 2,288
Bayesian Density Estimation and Inference Using Mixtures
Escobar, M. D., & West, M. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476550 · Cited by 2,255
Bernardo, J. M., & Smith, A. F. M. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316870 · Cited by 2,178
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
Self-citationMixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems
Antoniak, C. E. (1974) · The Annals of Statistics · doi:10.1214/aos/1176342871 · Cited by 1,972
Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
Diciccio, T. J., Kass, R. E., Raftery, A., & Wasserman, L. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474045 · Cited by 1,943
A new approach to the maximum-flow problem
Goldberg, A. V., & Tarjan, R. E. (1988) · Journal of the ACM · doi:10.1145/48014.61051 · Cited by 1,882
A Constructive Definition of Dirichlet Priors
Sethuraman, J. (1991) · doi:10.21236/ada238689 · Cited by 1,572
Variational inference for Dirichlet process mixtures
Blei, D. M., & Jordan, M. I. (2006) · Bayesian Analysis · doi:10.1214/06-ba104 · Cited by 1,438
Self-citationExchangeability and related topics
Aldous, D. J. (1985) · Lecture Notes in Mathematics · doi:10.1007/bfb0099421 · Cited by 1,345
Ferguson Distributions Via Polya Urn Schemes
Blackwell, D., & MacQueen, J. B. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342372 · Cited by 1,329
The author-topic model for authors and documents
Rosen‐Zvi, M., Griffiths, T. L., Steyvers, M., & Smyth, P. (2004) · Uncertainty in Artificial Intelligence · doi:10.5555/1036843.1036902 · Cited by 1,280
Self-citationA correlated topic model of Science
Blei, D. M., & Lafferty, J. (2018) · doi:10.1184/r1/6587330.v1 · Cited by 1,088
Self-citationWeb document clustering: a feasibility demonstration
Zamir, O., & Etzioni, O. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.290956 · Cited by 1,055
Blei, D. M., & Jordan, M. I. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860460 · Cited by 1,054
Self-citationSteyvers, M., & Griffiths, T. (2015) · Handbook of Latent Semantic Analysis · doi:10.4324/9780203936399.ch21 · Cited by 1,011
Self-citationMonte Carlo Statistical Methods (Springer Texts in Statistics)
Robert, C. P., & Casella, G. (2005) · Springer eBooks · Cited by 1,002
A correlated topic model of Science
Blei, D. M., & Lafferty, J. D. (2007) · The Annals of Applied Statistics · doi:10.1214/07-aoas114 · Cited by 953
Self-citationCombinatorial Stochastic Processes
(2006) · Lecture Notes in Mathematics · doi:10.1007/b11601500 · Cited by 935
Hierarchical Topic Models and the Nested Chinese Restaurant Process
Griffiths, T. L., Jordan, M. I., Tenenbaum, J. B., & Blei, D. M. (2003) · Cited by 912
Self-citationOrganization of growing random networks
Krapivsky, P. L., & Redner, S. (2001) · Physical Review E · doi:10.1103/physreve.63.066123 · Cited by 871
Fast and effective text mining using linear-time document clustering
Larsen, B., & Aone, C. (1999) · Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/312129.312186 · Cited by 857
Hierarchically Classifying Documents Using Very Few Words
Koller, D., & Sahami, M. (1997) · Cited by 854
Hierarchical classification of Web content
Dumais, S., & Chen, H. (2000) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/345508.345593 · Cited by 810
Mixed membership stochastic blockmodels
Airoldi, E. M., Blei, D. M., Fienberg, S. E., & Xing, E. P. (2007) · arXiv (Cornell University) · doi:10.48550/arxiv.0705.4485 · Cited by 781
Self-citationBradley, R. C., & Billingsley, P. (1987) · Journal of the American Statistical Association · doi:10.2307/2288811 · Cited by 774
The Collapsed Gibbs Sampler in Bayesian Computations with Applications to a Gene Regulation Problem
Liu, J. S. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476829 · Cited by 641
Deriving concept hierarchies from text
Sanderson, M., & Croft, B. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312679 · Cited by 612
(1968) · PMLA/Publications of the Modern Language Association of America · doi:10.1632/s0030812900035720 · Cited by 590
Estimating Mixture of Dirichlet Process Models
Maceachern, S. N., & Müller, P. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474772 · Cited by 576
Learning Concept Hierarchies from Text Corpora using Formal Concept Analysis
Cimiano, P., Hotho, A., & Staab, S. (2005) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1648 · Cited by 522
Hierarchical Beta Processes and the Indian Buffet Process
Thibaux, R., & Jordan, M. I. (2007) · UC Berkeley · Cited by 422
Self-citationJordan, M. I. (2004) · Statistical Science · doi:10.1214/088342304000000026 · Cited by 420
Self-citation(2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511802478 · Cited by 358
Bayesian hierarchical clustering
Heller, K. A., & Ghahramani, Z. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102389 · Cited by 357
Contextual dependencies in unsupervised word segmentation
Goldwater, S., Griffiths, T. L., & Johnson, M. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220260 · Cited by 305
Self-citationRodríguez, A., Dunson, D. B., & Gelfand, A. E. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000553 · Cited by 294
Adaptor Grammars: A Framework for Specifying Compositional Nonparametric Bayesian Models
Johnson, M., Griffiths, T. L., & Goldwater, S. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0085 · Cited by 268
Self-citationModeling User Rating Profiles For Collaborative Filtering
Marlin, B. M. (2003) · Cited by 265
Unsupervised prediction of citation influences
Dietz, L., Bickel, S., & Scheffer, T. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273526 · Cited by 233
Chakrabarti, S., Dom, B., Agrawal, R., & Raghavan, P. (1998) · The VLDB Journal The International Journal on Very Large Data Bases · doi:10.1007/s007780050061 · Cited by 227
A machine learning approach to building domain-specific search engines
McCallum, A., Nigam, K., Rennie, J. D. M., & Seymore, K. (1999) · Cited by 183
Generalized Spatial Dirichlet Process Models
Duan, J. A., Guindani, M., & Gelfand, A. E. (2007) · Biometrika · doi:10.1093/biomet/asm071 · Cited by 175
Lafferty, J., & Blei, D. M. (2009) · Chapman & Hall/CRC data mining and knowledge discovery series · doi:10.1201/9781420059458.ch4 · Cited by 167
Self-citationThe Infinite PCFG Using Hierarchical Dirichlet Processes
Liang, P., Petrov, S., Jordan, M. I., & Klein, D. (2007) · Cited by 160
Self-citationBayesian Nonparametrics: Subject index
Hjort, N. L., Holmes, C. C., Müller, P., & Walker, S. G. (2010) · Cited by 152
Bayesian Nonparametrics: List of contributors
Hjort, N. L., Holmes, C. C., Müller, P., & Walker, S. G. (2010) · Cited by 152
Statistical entity-topic models
Newman, D. J., Chemudugunta, C., & Smyth, P. (2006) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1150402.1150487 · Cited by 147
Describing Visual Scenes using Transformed Dirichlet Processes
Torralba, A. B., Willsky, A. S., Sudderth, E. B., & Freeman, W. T. (2005) · neural information processing systems · Cited by 134
McCallum, A., Corrada-Emmanuel, A., & Wang, X. (2005) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 130
Building Domain-Specific Search Engines with Machine Learning Techniques
McCallum, A., Nigam, K., Rennie, J. D. M., & Seymore, K. (1999) · Cited by 130
Nonparametric Bayes Pachinko AllocationPreprint
Li, W., Blei, D. M., & McCallum, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.5270 · Cited by 79
Self-citationMimno, D., & McCallum, A. (2007) · ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL) · doi:10.1145/1255175.1255249 · Cited by 78
Variations on Random Graph Models for the Web
Drinea, E., Enachescu, M., & Mitzenmacher, M. (2001) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 67
Bayesian Haplotype Inference via the Dirichlet Process
Xing, E. P., Jordan, M. I., & Sharan, R. (2007) · Journal of Computational Biology · doi:10.1089/cmb.2006.0102 · Cited by 46
Self-citationApproximate inference for first-order probabilistic languages
Pasula, H., & Russell, S. (2001) · International Joint Conference on Artificial Intelligence · Cited by 43
Approximate inference for infinite contingent Bayesian networks
Milch, B., Marthi, B., Sontag, D. A., Russell, S., Ong, D. L., & Kolobov, A. (2005) · Cited by 43
Cited by
Blei, D. M. (2012) · Communications of the ACM · doi:10.1145/2133806.2133826 · Cited by 5,516
Self-citationKnowledge Graph Embedding: A Survey of Approaches and Applications
Wang, Q., Mao, Z., Wang, B., & Guo, L. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2754499 · Cited by 2,654
How to grow a mind: Statistics, structure, and abstraction
Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011) · Science · doi:10.1126/science.1192788 · Cited by 1,815
Self-citationLDA-based document models for ad-hoc retrieval
Wei, X., & Croft, W. B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148204 · Cited by 1,075
A review of topic modeling methods
Vayansky, I., & Kumar, S. A. P. (2020) · Information Systems · doi:10.1016/j.is.2020.101582 · Cited by 716
Metadata
- Authors
- Blei, D. M., Griffiths, T. L., & Jordan, M. I.
- Venue
- Journal of the ACM
- Published
- 2010-01
- Volume
- 57
- Issue
- 2
- Pages
- 1-30
- ISSN
- 0004-5411 (ISSN-L)
- 1557-735X
- OpenAlex
- W2150286230
- Cited by
- 646
- References
- 81
- FWCI
- 54.07
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.