The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Probabilistic Topic Models
Open accessAbstract
In this article, we review probabilistic topic models: graphical models that can be used to summarize a large collection of documents with a smaller number of distributions over words. Those distributions are called "topics" because, when fit to data, they capture the salient themes that run through the collection. We describe both finite-dimensional parametric topic models and their Bayesian nonparametric counterparts, which are based on the hierarchical Dirichlet process (HDP). We discuss two extensions of topic models to time-series data-one that lets the topics slowly change over time and one that lets the assumed prevalence of the topics change. Finally, we illustrate the application of topic models to nontext data, summarizing some recent research results in image analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Inference of Population Structure Using Multilocus Genotype Data
Pritchard, J. K., Stephens, M., & Donnelly, P. (2000) · Genetics · doi:10.1093/genetics/155.2.945 · Cited by 33,908
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
A Bayesian Analysis of Some Nonparametric Problems
Ferguson, T. S. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342360 · Cited by 4,697
The Statistical Analysis of Compositional Data
Aitchison, J. (1986) · doi:10.1007/978-94-009-4109-0 · Cited by 4,383
Monte Carlo Statistical Methods
Robert, C. P., & Casella, G. (2004) · Springer Texts in Statistics · doi:10.1007/978-1-4757-4145-2 · Cited by 4,271
A Bayesian Hierarchical Model for Learning Natural Scene Categories
Li, F.-F., & Perona, P. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.16 · Cited by 3,613
The Statistical Analysis of Compositional Data
Aitchison, J. (1982) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1982.tb01195.x · Cited by 3,405
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/jmlr.2003.3.4-5.993 · Cited by 3,024
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,846
Blei, D. M., & Lafferty, J. D. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143859 · Cited by 2,386
Self-citationKass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.2307/2291091 · Cited by 2,312
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
Self-citationProbabilistic Latent Semantic Analysis
Hofmann, T. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.6705 · Cited by 2,047
Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems
Antoniak, C. E. (1974) · The Annals of Statistics · doi:10.1214/aos/1176342871 · Cited by 1,972
Bayesian Forecasting and Dynamic Models
(1997) · Springer Series in Statistics · doi:10.1007/b98971 · Cited by 1,917
(2009) · Cited by 1,900
The sampling theory of selectively neutral alleles
Ewens, W. J. (1972) · Theoretical Population Biology · doi:10.1016/0040-5809(72)90035-4 · Cited by 1,640
Variational inference for Dirichlet process mixtures
Blei, D. M., & Jordan, M. I. (2006) · Bayesian Analysis · doi:10.1214/06-ba104 · Cited by 1,438
Self-citationTopics over time: a non-Markov continuous-time model of topical trends
Wang, X., & McCallum, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150450 · Cited by 1,121
Blei, D. M., & Jordan, M. I. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860460 · Cited by 1,054
Self-citationSteyvers, M., & Griffiths, T. (2015) · Handbook of Latent Semantic Analysis · doi:10.4324/9780203936399.ch21 · Cited by 1,011
Monte Carlo Statistical Methods (Springer Texts in Statistics)
Robert, C. P., & Casella, G. (2005) · Springer eBooks · Cited by 1,002
Combinatorial Stochastic Processes
(2006) · Lecture Notes in Mathematics · doi:10.1007/b11601500 · Cited by 935
Automatic evaluation of topic coherence
Newman, D. J., Lau, J. H., Grieser, K., & Baldwin, T. (2010) · Cited by 846
Mixed membership stochastic blockmodels
Airoldi, E. M., Blei, D. M., Fienberg, S. E., & Xing, E. P. (2007) · arXiv (Cornell University) · doi:10.48550/arxiv.0705.4485 · Cited by 781
Self-citationBosch, A., Zisserman, A., & Muñoz, X. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_40 · Cited by 767
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244303322533214 · Cited by 615
Wang, X., Ma, X., & Grimson, W. E. L. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.87 · Cited by 534
Simultaneous image classification and annotation
Chong, W., Blei, D., & Li, F.-F. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206800 · Cited by 510
Self-citationA Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation
Teh, Y. W., Newman, D., & Welling, M. (2007) · doi:10.21236/ada629956 · Cited by 490
Li, L.-J., Socher, R., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206718 · Cited by 484
Discovering object categories in image collections
Šivic, J., Russell, B. C., Efros, A. A., Zisserman, A., & Freeman, W. T. (2005) · Cited by 432
Cao, L., & Fei-Fei, L. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408965 · Cited by 360
Unsupervised Activity Perception by Hierarchical Bayesian Models
Wang, X., Ma, X., & Grimson, E. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383072 · Cited by 359
Blei, D. M., & Jordan, M. I. (2003) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/860458.860460 · Cited by 359
Self-citationDistance Dependent Chinese Restaurant ProcessesPreprint
Blei, D. M., & Frazier, P. I. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0910.1022 · Cited by 330
Self-citationTopic Models Conditioned on Arbitrary Features with Dirichlet-multinomial Regression
Mimno, D., & McCallum, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.3278 · Cited by 312
Continuous Time Dynamic Topic Models
Wang, C., Blei, D. M., & Heckerman, D. E. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.3298 · Cited by 311
Self-citationTopics over Time: A NonMarkov ContinuousTime Model of Topical Trends
Wang, X., & McCallum, A. (2006) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 291
Hierarchical relational models for document networks
Chang, J., & Blei, D. M. (2010) · The Annals of Applied Statistics · doi:10.1214/09-aoas309 · Cited by 255
Self-citationSpatial Latent Dirichlet Allocation
Wang, X., & Grimson, W. E. L. (2007) · Cited by 241
Distributed Inference for Latent Dirichlet Allocation
Newman, D. J., Smyth, P., Welling, M., & Asuncion, A. (2007) · Cited by 215
Variational Inference for Large-Scale Models of Discrete Choice
Braun, M., & McAuliffe, J. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.tm08030 · Cited by 169
Describing disability through individual-level mixture models for multivariate binary data
Erosheva, E. A., Fienberg, S. E., & Joutard, C. (2007) · The Annals of Applied Statistics · doi:10.1214/07-aoas126 · Cited by 159
Subspace, Latent Structure and Feature Selection
(2006) · Lecture Notes in Computer Science · doi:10.1007/11752790 · Cited by 158
Shared Segmentation of Natural Scenes Using Dependent Pitman-Yor Processes
Sudderth, E. B., & Jordan, M. I. (2008) · Cited by 153
Collapsed Variational Inference for HDP
Teh, Y. W., Kurihara, K., & Welling, M. (2007) · Cited by 142
Link-PLSA-LDA: A New Unsupervised Model for Topics and Influence of Blogs
Nallapati, R. M., & Cohen, W. W. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v2i1.18621 · Cited by 126
A Language-based Approach to Measuring Scholarly Impact
Gerrish, S., & Blei, D. M. (2010) · Cited by 123
Self-citationParallel Inference for Latent Dirichlet Allocation on Graphics Processing Units
Yan, F., Xu, N., & Qi, Y. (2009) · Cited by 102
Buntine, W., & Jakulin, A. (2006) · Lecture notes in computer science · doi:10.1007/11752790_1 · Cited by 96
Statistical Debugging Using Latent Topic Models
Andrzejewski, D., Mulhern, A., Liblit, B., & Zhu, X. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74958-5_5 · Cited by 83
VIBES: A Variational Inference Engine for Bayesian Networks
Bishop, C., Spiegelhalter, D. J., & Winn, J. M. (2002) · neural information processing systems · Cited by 81
Content-Based Musical Similarity Computation Using The Hierarchical Dirichlet Process.
Hoffman, M. D., Blei, D. M., & Cook, P. R. (2008) · doi:10.5281/zenodo.1417222 · Cited by 66
Self-citationHierarchical Bayesian Modeling of Topics in Time-Stamped Documents
Pruteanu-Malinici, I., Ren, L., Paisley, J. W., Wang, E. Z., & Carin, L. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.125 · Cited by 48
Self-citationA Bayesian Model for Simultaneous Image Clustering, Annotation and Object Segmentation.
Du, L., Ren, L., Dunson, D., & Carin, L. (2009) · PubMed · Cited by 47
Self-citationHierarchical kernel stick-breaking process for multi-task image analysis
An, Q., Wang, C., Shterev, I. D., Wang, E. Z., Carin, L., & Dunson, D. B. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390159 · Cited by 38
Self-citationDynamic Nonparametric Bayesian Models for Analysis of Music
Ren, L., Dunson, D. B., Lindroth, S., & Carin, L. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap08497 · Cited by 31
Self-citationYakhnenko, O., & Honavar, V. (2009) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972795.25 · Cited by 24
Reconstructing Pompeian HouseholdsPreprint
Mimno, D. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.3747 · Cited by 12
Cited by
The repertoire of mutational signatures in human cancer
Alexandrov, L. B., Kim, J., Haradhvala, N. J., Huang, M. N., Tian Ng, A. W., Wu, Y., Boot, A., Covington, K. R., Gordenin, D. A., Bergstrom, E. N., et al. (2020) · Nature · doi:10.1038/s41586-020-1943-3 · Cited by 3,496
The Repertoire of Mutational Signatures in Human Cancer
Alexandrov, L. B., Kim, J., Haradhvala, N. J., Huang, M. N., Ng, A. W., Wu, Y., Boot, A., Covington, K. R., Gordenin, D. A., Bergstrom, E. N., et al. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/322859 · Cited by 529
Automatic Crime Prediction Using Events Extracted from Twitter Posts
Wang, X., Gerber, M. S., & Brown, D. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-29047-3_28 · Cited by 335
Emergency information diffusion on online social media during storm Cindy in U.S.
Kim, J., Bae, J., & Hastak, M. (2018) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.02.003 · Cited by 166
Conflicting values in the smart electricity grid a comprehensive overview
de Wildt, T. E., Chappin, E. J. L., van de Kaa, G., Herder, P. M., & van de Poel, I. R. (2019) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2019.05.005 · Cited by 39
Metadata
- Authors
- Blei, D., Carin, L., & Dunson, D.
- Venue
- IEEE Signal Processing Magazine
- Published
- 2010-11
- Volume
- 27
- Issue
- 6
- Pages
- 55-65
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W2001932471
- Cited by
- 335
- References
- 65
- FWCI
- 9.86
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.