The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Short Text Topic Modeling Techniques, Applications, and Performance: A Survey
Abstract
Analyzing short texts infers discriminative and coherent latent topics that is a critical and fundamental task since many real-world applications require semantic understanding of short texts. Traditional long text topic modeling algorithms (e.g., PLSA and LDA) based on word co-occurrences cannot solve this problem very well since only very limited word co-occurrence information is available in short texts. Therefore, short text topic modeling has already attracted much attention from the machine learning research community in recent years, which aims at overcoming the problem of sparseness in short texts. In this survey, we conduct a comprehensive review of various short text topic modeling techniques proposed in the literature. We present three categories of methods based on Dirichlet multinomial mixture, global word co-occurrences, and self-aggregation, with example of representative approaches in each category and analysis of their performance on various tasks. We develop the first comprehensive open-source library, called STTM, for use in Java that integrates all surveyed algorithms within a unified interface, benchmark datasets, to facilitate the expansion of new methods in this research field. Finally, we evaluate these state-of-the-art methods on many real-world datasets and compare their performance against one another and versus long text topic modeling algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
On the limited memory BFGS method for large scale optimization
Liu, D. C., & Nocedal, J. (1989) · Mathematical Programming · doi:10.1007/bf01589116 · Cited by 8,560
Blei, D. M. (2012) · Communications of the ACM · doi:10.1145/2133806.2133826 · Cited by 5,516
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/jmlr.2003.3.4-5.993 · Cited by 3,024
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
TwitterRank: finding topic-sensitive influential twitterers
Weng, J., Lim, E.-P., Jiang, J., & He, Q. (2010) · Proceedings of the third ACM international conference on Web search and data mining · doi:10.1145/1718487.1718520 · Cited by 1,742
LDAvis: A method for visualizing and interpreting topics
Sievert, C., & Shirley, K. (2014) · Proceedings of the Workshop on Interactive Language Learning, Visualization, and Interfaces · doi:10.3115/v1/w14-3110 · Cited by 1,366
Comparing Twitter and Traditional Media Using Topic Models
Zhao, W. X., Jiang, J., Weng, J., He, J., Lim, E.-P., Yan, H., & Li, X. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-20161-5_34 · Cited by 1,214
Empirical study of topic modeling in Twitter
Hong, L., & Davison, B. D. (2010) · Proceedings of the First Workshop on Social Media Analytics · doi:10.1145/1964858.1964870 · Cited by 1,120
Phan, X.-H., Nguyen, L.-M., & Horiguchi, S. (2008) · Proceedings of the 17th international conference on World Wide Web · doi:10.1145/1367497.1367510 · Cited by 740
Short text classification in twitter to improve information filtering
Sriram, B., Fuhry, D., Demir, E., Ferhatosmanoglu, H., & Demirbas, M. (2010) · Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1835449.1835643 · Cited by 727
Characterizing Microblogs with Topic Models
Ramage, D., Dumais, S., & Liebling, D. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14026 · Cited by 702
Open domain event extraction from twitter
Ritter, A., Mausam, Etzioni, O., & Clark, S. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339704 · Cited by 592
A dirichlet multinomial mixture model-based approach for short text clustering
Yin, J., & Wang, J. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623715 · Cited by 561
BTM: Topic Modeling over Short Texts
Cheng, X., Yan, X., Lan, Y., & Guo, J. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2313872 · Cited by 556
Improving LDA topic models for microblogs via tweet pooling and automatic labeling
Mehrotra, R., Sanner, S., Buntine, W., & Xie, L. (2013) · Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/2484028.2484166 · Cited by 461
Termite: visualization techniques for assessing textual topic models
Chuang, J., Manning, C. D., & Heer, J. (2012) · Proceedings of the International Working Conference on Advanced Visual Interfaces · doi:10.1145/2254556.2254572 · Cited by 420
Using twitter to recommend real-time topical news
Phelan, O., McCarthy, K., & Smyth, B. (2009) · Proceedings of the third ACM conference on Recommender systems · doi:10.1145/1639714.1639794 · Cited by 419
Chen (2010) · doi:10.1145/1753326.1753503 · Cited by 416
Personalized Recommendation Combining User Interest and Social Circle
Qian, X., Feng, H., Zhao, G., & Mei, T. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.168 · Cited by 352
Improving Topic Models with Latent Feature Word Representations
Nguyen, D. Q., Billingsley, R., Du, L., & Johnson, M. (2015) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00140 · Cited by 315
Topic Modeling for Short Texts with Auxiliary Word Embeddings
Li, C., Wang, H., Zhang, Z., Sun, A., & Ma, Z. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911499 · Cited by 292
Event Detection in Social Streams
Aggarwal, C. C., & Subbian, K. (2012) · Proceedings of the 2012 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972825.54 · Cited by 287
Mahmoud, H. (2008) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420059847 · Cited by 230
Transferring topical knowledge from auxiliary long texts for short text clustering
Jin, O., Liu, N. N., Zhao, K., Yu, Y., & Yang, Q. (2011) · Proceedings of the 20th ACM international conference on Information and knowledge management · doi:10.1145/2063576.2063689 · Cited by 218
Semi-supervised learning of compact document representations with deep networks
Ranzato, M. A., & Szummer, M. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390256 · Cited by 217
Word network topic model: a simple but general solution for short and imbalanced texts
Zuo, Y., Zhao, J., & Xu, K. (2015) · Knowledge and Information Systems · doi:10.1007/s10115-015-0882-z · Cited by 195
Topic Modeling of Short Texts: A Pseudo-Document View
Zuo, Y., Wu, J., Zhang, H., Lin, H., Wang, F., Xu, K., & Xiong, H. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939880 · Cited by 180
Shi, T., Kang, K., Choo, J., & Reddy, C. K. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186009 · Cited by 167
Dynamic User Modeling in Social Media Systems
Yin, H., Cui, B., Chen, L., Hu, Z., & Zhou, X. (2015) · ACM Transactions on Information Systems · doi:10.1145/2699670 · Cited by 162
A Novel Neural Topic Model and Its Supervised Extension
Cao, Z., Li, S., Liu, Y., Li, W., & Ji, H. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9499 · Cited by 160
Enhancing Topic Modeling for Short Texts with Auxiliary Word Embeddings
Li, C., Duan, Y., Wang, H., Zhang, Z., Sun, A., & Ma, Z. (2017) · ACM Transactions on Information Systems · doi:10.1145/3091108 · Cited by 147
Lin, T., Tian, W., Mei, Q., & Cheng, H. (2014) · International World Wide Web Conference (WWW) · doi:10.1145/2566486.2567980 · Cited by 119
Topic Modeling over Short Texts by Incorporating Word Embeddings
Qiang, J., Chen, P., Wang, T., & Wu, X. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-57529-2_29 · Cited by 110
Self-citationTopic-driven reader comments summarization
Ma, Z., Sun, A., Yuan, Q., & Cong, G. (2012) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2396761.2396798 · Cited by 103
A general framework to expand short text for topic modeling
Bicalho, P. V., Pita, M., Pedrosa, G., Lacerda, A. M., & Pappa, G. L. (2017) · Information Sciences · doi:10.1016/j.ins.2017.02.007 · Cited by 86
Incorporating Word Correlation Knowledge into Topic Modeling
Xie, P., Yang, D., & Xing, E. P. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1074 · Cited by 85
Guy, I. (2015) · Springer eBooks · doi:10.1007/978-1-4899-7637-6_15 · Cited by 85
Wang, Y., Liu, J., Huang, Y., & Feng, X. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2531661 · Cited by 82
Vo, D.-T., & Ock, C.-Y. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.09.031 · Cited by 76
A Probabilistic Model for Bursty Topic Discovery in Microblogs
Yan, X., Guo, J., Lan, Y., Xu, J., & Cheng, X. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9199 · Cited by 74
A unified model for stable and temporal topic detection from social media data
Yin, H., Cui, B., Lu, H. C., Huang, Y., & Yao, J. (2013) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2013.6544864 · Cited by 74
Model-based Clustering of Short Text Streams
Yin, J., Chao, D., Liu, Z., Zhang, W., Yu, X., & Wang, J. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220094 · Cited by 73
Dirichlet Process Mixture Model for Document Clustering with Feature Partition
Huang, R., Yu, G., Wang, Z., Zhang, J., & Shi, L. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.27 · Cited by 49
Document clustering via dirichlet process mixture model with feature selection
Yu, G., Huang, R., & Wang, Z. (2010) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1835804.1835901 · Cited by 49
A Text Clustering Algorithm Using an Online Clustering Scheme for Initialization
Yin, J., & Wang, J. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939841 · Cited by 49
User Based Aggregation for Biterm Topic Model
Chen, W., Wang, J., Zhang, Y., Yan, H., & Li, X. (2015) · doi:10.3115/v1/p15-2080 · Cited by 40
Short text clustering based on Pitman-Yor process mixture model
Qiang, J., Li, Y., Yuan, Y., & Wu, X. (2017) · Applied Intelligence · doi:10.1007/s10489-017-1055-4 · Cited by 40
Self-citationLu, H., Xie, L., Kang, N., Wang, C., & Xie, J. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10670 · Cited by 35
Topic Discovery from Heterogeneous Texts
Qiang, J., Chen, P., Ding, W., Wang, T., Xie, F., & Wu, X. (2016) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2016.0039 · Cited by 14
Self-citationLearning Latent Topics from the Word Co-occurrence Network
Wang, W., Zhou, H., He, K., & Hopcroft, J. E. (2017) · Communications in computer and information science · doi:10.1007/978-981-10-6893-5_2 · Cited by 14
Effects of Creativity and Cluster Tightness on Short Text Clustering Performance
Finegan‐Dollak, C., Coke, R., Zhang, R., Ye, X., & Radev, D. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1062 · Cited by 10
Cited by
A Topic Modeling Comparison Between LDA, NMF, Top2Vec, and BERTopic to Demystify Twitter Posts
Egger, R., & Yu, J. (2022) · Frontiers in Sociology · doi:10.3389/fsoc.2022.886498 · Cited by 970
Garcia, K., & Berton, L. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2020.107057 · Cited by 369
Topic Modeling Using Latent Dirichlet allocation: A Survey
Chauhan, U., & Shah, A. (2022) · ACM Computing Surveys · doi:10.1145/3462478 · Cited by 270
More Accounts, Fewer Links: How Algorithmic Curation Impacts Media Exposure in Twitter Timelines
Bandy, J., & Diakopoulos, N. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449152 · Cited by 54
Romero, J. D., Feijoo-Garcia, M. A., Nanda, G., Newell, B., & Magana, A. J. (2024) · Big Data and Cognitive Computing · doi:10.3390/bdcc8100132 · Cited by 27
Metadata
- Authors
- Qiang, J., Qian, Z., Li, Y., Yuan, Y., & Wu, X.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2022-03-01
- Volume
- 34
- Issue
- 3
- Pages
- 1427-1445
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W3021053579
- Cited by
- 314
- References
- 54
- FWCI
- 16.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.