The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
A review of topic modeling methods
Abstract
Abstract Topic modeling is a popular analytical tool for evaluating data. Numerous methods of topic modeling have been developed which consider many kinds of relationships and restrictions within datasets; however, these methods are not frequently employed. Instead many researchers gravitate to Latent Dirichlet Analysis, which although flexible and adaptive, is not always suited for modeling more complex data relationships. We present different topic modeling approaches capable of dealing with correlation between topics, the changes of topics over time, as well as the ability to handle short texts such as encountered in social media or sparse text data. We also briefly review the algorithms which are used to optimize and infer parameters in topic modeling, which is essential to producing meaningful results regardless of method. We believe this review will encourage more diversity when performing topic modeling and help determine what topic modeling method best suits the user needs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
Blei, D. M. (2012) · Communications of the ACM · doi:10.1145/2133806.2133826 · Cited by 5,516
Probabilistic Latent Semantic Indexing
Hofmann, T. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130370 · Cited by 3,988
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1285773 · Cited by 3,811
Blei, D. M., & Lafferty, J. D. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143859 · Cited by 3,173
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
(1998) · Springer eBooks · doi:10.1007/978-94-011-5014-9 · Cited by 2,418
Practical markov chain monte carlo
Geyer, C. J. (1992) · Statistical Science · doi:10.1214/ss/1177011137 · Cited by 2,045
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. (2017) · Figshare · doi:10.6084/m9.figshare.5203696 · Cited by 1,919
(2003) · Cited by 1,680
Handbook of Latent Semantic Analysis
(2007) · Psychology Press eBooks · doi:10.4324/9780203936399 · Cited by 1,554
Topics over time: a non-Markov continuous-time model of topical trends
Wang, X., & McCallum, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150450 · Cited by 1,121
Empirical study of topic modeling in Twitter
Hong, L., & Davison, B. D. (2010) · Proceedings of the First Workshop on Social Media Analytics · doi:10.1145/1964858.1964870 · Cited by 1,120
A biterm topic model for short texts
Yan, X., Guo, J., Lan, Y., & Cheng, X. (2013) · Proceedings of the 22nd international conference on World Wide Web · doi:10.1145/2488388.2488514 · Cited by 1,088
Topic modeling: beyond bag-of-words
Wallach, H. M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143967 · Cited by 1,058
Steyvers, M., & Griffiths, T. (2015) · Handbook of Latent Semantic Analysis · doi:10.4324/9780203936399.ch21 · Cited by 1,011
Lafferty, J., & Blei, D. M. (2005) · neural information processing systems · Cited by 917
A density-based method for adaptive LDA model selection
Cao, J., Xia, T., Li, J., Zhang, Y., & Tang, S. (2009) · Neurocomputing · doi:10.1016/j.neucom.2008.06.011 · Cited by 880
SVD based initialization: A head start for nonnegative matrix factorization
Boutsidis, C., & Gallopoulos, E. (2008) · Pattern Recognition · doi:10.1016/j.patcog.2007.09.010 · Cited by 695
The nested chinese restaurant process and bayesian nonparametric inference of topic hierarchies
Blei, D. M., Griffiths, T. L., & Jordan, M. I. (2010) · Journal of the ACM · doi:10.1145/1667053.1667056 · Cited by 646
Pachinko allocation: DAG-structured mixture models of topic correlations
Li, W., & McCallum, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143917 · Cited by 609
Fast collapsed gibbs sampling for latent dirichlet allocation
Porteous, I., Newman, D., Ihler, A., Asuncion, A., Smyth, P., & Welling, M. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401960 · Cited by 560
A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation
Teh, Y. W., Newman, D., & Welling, M. (2007) · doi:10.21236/ada629956 · Cited by 490
Sharing Clusters among Related Groups: Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2004) · Cited by 435
An overview of topic modeling and its current applications in bioinformatics
Liu, L., Tang, L., Dong, W., Yao, S., & Zhou, W. (2016) · SpringerPlus · doi:10.1186/s40064-016-3252-8 · Cited by 392
A heuristic approach to determine an appropriate number of topics in topic modeling
Zhao, W., Chen, J. J., Perkins, R., Liu, Z., Ge, W., Ding, Y., & Zou, W. (2015) · BMC Bioinformatics · doi:10.1186/1471-2105-16-s13-s8 · Cited by 382
2018 IEEE Symposium Series on Computational Intelligence (SSCI)
(2018) · doi:10.1109/ssci40388.2018 · Cited by 379
Topic modeling and sentiment analysis of global climate change tweets
Dahal, B., Kumar, S. A. P., & Li, Z. (2019) · Social Network Analysis and Mining · doi:10.1007/s13278-019-0568-8 · Cited by 296
Self-citationA hierarchical Dirichlet language model
MacKay, D. J. C., & Peto, L. C. B. (1995) · Natural Language Engineering · doi:10.1017/s1351324900000218 · Cited by 274
fLDA: matrix factorization through latent dirichlet allocation
Agarwal, D., & Chen, B.-C. (2010) · Proceedings of the third ACM international conference on Web search and data mining · doi:10.1145/1718487.1718499 · Cited by 256
What is wrong with topic modeling? And how to fix it using search-based software engineering
Agrawal, A., Fu, W., & Menzies, T. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2018.02.005 · Cited by 229
Nonnegative Matrix Factorization for Interactive Topic Modeling and Document Clustering
Kuang, D., Choo, J., & Park, H. (2014) · Springer eBooks · doi:10.1007/978-3-319-09259-1_7 · Cited by 180
Topic Modeling of Short Texts: A Pseudo-Document View
Zuo, Y., Wu, J., Zhang, H., Lin, H., Wang, F., Xu, K., & Xiong, H. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939880 · Cited by 180
Collapsed Variational Inference for HDP
Teh, Y. W., Kurihara, K., & Welling, M. (2007) · Cited by 142
Lin, T., Tian, W., Mei, Q., & Cheng, H. (2014) · International World Wide Web Conference (WWW) · doi:10.1145/2566486.2567980 · Cited by 119
Video Behaviour Mining Using a Dynamic Topic Model
Hospedales, T. M., Gong, S., & Xiang, T. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0510-7 · Cited by 114
Stability of topic modeling via matrix factorization
Belford, M., Namee, B. M., & Greene, D. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.08.047 · Cited by 108
Improving the Mean Field Approximation Via the Use of Mixture Distributions
Jaakkola, T., & Jordan, M. I. (1998) · Springer eBooks · doi:10.1007/978-94-011-5014-9_6 · Cited by 104
Scaling up Dynamic Topic Models
Bhadury, A., Chen, J., Zhu, J., & Liu, S. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872427.2883046 · Cited by 83
Vorontsov, K. V., & Potapenko, A. (2014) · Communications in computer and information science · doi:10.1007/978-3-319-12580-0_3 · Cited by 60
Vayansky, I., Kumar, S., & Li, Z. (2019) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas48451.2019.8937859 · Cited by 27
Self-citationAutonomous Adaptive Underwater Exploration using Online Topic Modeling
Girdhar, Y., Giguère, P., & Dudek, G. (2013) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-00065-7_53 · Cited by 21
Singleton, S., Kumar, S., & Li, Z. (2018) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas.2018.8638266 · Cited by 14
Self-citationMachine Learning-Based Models for Assessing Impacts Before, During and After Hurricane Florence
Harvey, J. L., Kumar, S., & Bao, S. (2019) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci44817.2019.9003061 · Cited by 9
Self-citation
Cited by
Lampropoulos, G., Keramopoulos, E., Diamantaras, K., & Evangelidis, G. (2022) · Education Sciences · doi:10.3390/educsci12110798 · Cited by 119
Kaplan, D. M., Palitsky, R., Arconada Alvarez, S. J., Pozzo, N. S., Greenleaf, M. N., Atkinson, C. A., & Lam, W. A. (2024) · Journal of Medical Internet Research · doi:10.2196/51837 · Cited by 55
Chen, J., Cutrona, S. L., Dharod, A., Moses, A., Bridges, A., Ostasiewski, B., Foley, K. L., Houston, T. K., iDAPT (Implementation & Informatics Developing Adaptable Processes and Technologies for Cancer Control) Implementation Science Center for Cancer Control, Chen, J., et al. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf050 · Cited by 5
Metadata
- Authors
- Vayansky, I., & Kumar, S. A. P.
- Venue
- Information Systems
- Publisher
- Elsevier BV
- Published
- 2020-12
- Volume
- 94
- Pages
- 101582
- ISSN
- 0306-4379 (ISSN-L)
- OpenAlex
- W3036644138
- Cited by
- 716
- References
- 48
- FWCI
- 23.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.