The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
BTM: Topic Modeling over Short Texts
Abstract
Short texts are popular on today's web, especially with the emergence of social media. Inferring topics from large scale short texts becomes a critical but challenging task for many content analysis tasks. Conventional topic models such as latent Dirichlet allocation (LDA) and probabilistic latent semantic analysis (PLSA) learn topics from document-level word co-occurrences by modeling each document as a mixture of topics, whose inference suffers from the sparsity of word co-occurrence patterns in short texts. In this paper, we propose a novel way for short text topic modeling, referred as biterm topic model (BTM). BTM learns topics by directly modeling the generation of word co-occurrence patterns (i.e., biterms) in the corpus, making the inference effective with the rich corpus-level information. To cope with large scale short text data, we further introduce two online algorithms for BTM for efficient topic learning. Experiments on real-word short text collections show that BTM can discover more prominent and coherent topics, and significantly outperform the state-of-the-art baselines. We also demonstrate the appealing performance of the two online BTM algorithms on both time efficiency and topic learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
Blei, D. M. (2012) · Communications of the ACM · doi:10.1145/2133806.2133826 · Cited by 5,516
Probabilistic Latent Semantic Indexing
Hofmann, T. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130370 · Cited by 3,988
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
(2009) · Cited by 1,900
TwitterRank: finding topic-sensitive influential twitterers
Weng, J., Lim, E.-P., Jiang, J., & He, Q. (2010) · Proceedings of the third ACM international conference on Web search and data mining · doi:10.1145/1718487.1718520 · Cited by 1,742
Optimizing Semantic Coherence in Topic Models
Mimno, D., Wallach, H., Talley, E. M., Leenders, M., & McCallum, A. (2011) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 1,570
Online Learning for Latent Dirichlet Allocation
Hoffman, M. D., Blei, D. M., & Bach, F. (2010) · Cited by 1,363
Comparing Twitter and Traditional Media Using Topic Models
Zhao, W. X., Jiang, J., Weng, J., He, J., Lim, E.-P., Yan, H., & Li, X. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-20161-5_34 · Cited by 1,214
Topics over time: a non-Markov continuous-time model of topical trends
Wang, X., & McCallum, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150450 · Cited by 1,121
Empirical study of topic modeling in Twitter
Hong, L., & Davison, B. D. (2010) · Proceedings of the First Workshop on Social Media Analytics · doi:10.1145/1964858.1964870 · Cited by 1,120
A biterm topic model for short texts
Yan, X., Guo, J., Lan, Y., & Cheng, X. (2013) · Proceedings of the 22nd international conference on World Wide Web · doi:10.1145/2488388.2488514 · Cited by 1,088
Self-citationTopic modeling: beyond bag-of-words
Wallach, H. M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143967 · Cited by 1,058
Automatic evaluation of topic coherence
Newman, D. J., Lau, J. H., Grieser, K., & Baldwin, T. (2010) · Cited by 846
Phan, X.-H., Nguyen, L.-M., & Horiguchi, S. (2008) · Proceedings of the 17th international conference on World Wide Web · doi:10.1145/1367497.1367510 · Cited by 740
Characterizing Microblogs with Topic Models
Ramage, D., Dumais, S., & Liebling, D. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14026 · Cited by 702
Parameter estimation for text analysis
Heinrich, G. (2009) · Cited by 700
The Collapsed Gibbs Sampler in Bayesian Computations with Applications to a Gene Regulation Problem
Liu, J. S. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476829 · Cited by 641
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_5 · Cited by 551
Griffiths, T. L., Mark Steyvers, B., Blei, D. M., & Tenenbaum, J. B. (2004) · Cited by 501
AlSumait, L., Barbará, D., & Domeniconi, C. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.140 · Cited by 421
Using twitter to recommend real-time topical news
Phelan, O., McCarthy, K., & Smyth, B. (2009) · Proceedings of the third ACM conference on Recommender systems · doi:10.1145/1639714.1639794 · Cited by 419
Chen (2010) · doi:10.1145/1753326.1753503 · Cited by 416
Named entity recognition in query
Guo, J., Xu, G., Cheng, X., & Li, H. (2009) · Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1571941.1571989 · Cited by 379
Self-citationGruber, A., Weiss, Y., & Rosen‐Zvi, M. (2007) · Cited by 242
Topical Keyphrase Extraction from Twitter
Zhao, X., Jiang, J., He, J., Song, Y., Achananuparp, P., Xin, W., Zhao, J., Jing, J., Yang, H., Achananuparp, S. P., et al. (2011) · Cited by 242
Online Inference of Topics with Latent Dirichlet Allocation
Canini, K. R., Shi, L., & Griffiths, T. L. (2009) · Cited by 231
Transferring topical knowledge from auxiliary long texts for short text clustering
Jin, O., Liu, N. N., Zhao, K., Yu, Y., & Yang, Q. (2011) · Proceedings of the 20th ACM international conference on Information and knowledge management · doi:10.1145/2063576.2063689 · Cited by 218
TM-LDA: efficient online modeling of latent topic transitions in social media
Wang, Y., Agichtein, E., & Benzi, M. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339552 · Cited by 180
Syntactic Topic ModelsPreprint
Boyd-Graber, J. L., & Blei, D. M. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1002.4665 · Cited by 166
Modeling hidden topics on document manifold
Cai, D., Mei, Q., Han, J., & Zhai, C. (2008) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1458082.1458202 · Cited by 159
Improving Topic Coherence with Regularized Topic Models
Newman, D. J., Bonilla, E. V., & Buntine, W. (2011) · Cited by 159
Learning Topics in Short Texts by Non-negative Matrix Factorization on Term Correlation Matrix
Yan, X., Guo, J., Liu, S., Cheng, X., & Wang, Y. (2013) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972832.83 · Cited by 106
Self-citation
Cited by
Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey
Jelodar, H., Wang, Y., Yuan, C., Feng, X., Jiang, X., Li, Y., & Zhao, L. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6894-4 · Cited by 1,961
Short Text Topic Modeling Techniques, Applications, and Performance: A Survey
Qiang, J., Qian, Z., Li, Y., Yuan, Y., & Wu, X. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2992485 · Cited by 314
Topic Modeling for Short Texts with Auxiliary Word Embeddings
Li, C., Wang, H., Zhang, Z., Sun, A., & Ma, Z. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911499 · Cited by 292
Topic Modeling Using Latent Dirichlet allocation: A Survey
Chauhan, U., & Shah, A. (2022) · ACM Computing Surveys · doi:10.1145/3462478 · Cited by 270
Semi-supervised machine-learning classification of materials synthesis procedures
Huo, H., Rong, Z., Kononova, O., Sun, W., Botari, T., He, T., Tshitoyan, V., & Ceder, G. (2019) · npj Computational Materials · doi:10.1038/s41524-019-0204-1 · Cited by 151
Metadata
- Authors
- Cheng, X., Yan, X., Lan, Y., & Guo, J.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2014-12-01
- Volume
- 26
- Issue
- 12
- Pages
- 2928-2941
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2048195127
- Cited by
- 556
- References
- 41
- FWCI
- 32.35
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.