The Evolution of Topic Modeling
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Topic models have been applied to everything from books to newspapers to social media posts in an effort to identify the most prevalent themes of a text corpus. We provide an in-depth analysis of unsupervised topic models from their inception to today. We trace the origins of different types of contemporary topic models, beginning in the 1990s, and we compare their proposed algorithms, as well as their different evaluation approaches. Throughout, we also describe settings in which topic models have worked well and areas where new research is needed, setting the stage for the next generation of topic models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Blei, D. M., & Lafferty, J. D. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143859 · Cited by 3,173
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736 · cited 6×
“LSI [23] x x x pLSI [30] x x x DMM [57] x x x LDA [8] x x x HDP [74] x x x CTM [40] x x x DTM [7] x x x TOT [86] x x x SWB [15] x x x Online LDA [4] x x x x Online LDA [29] x x x x Online HDP [83] x x x x MTTM [52] x x x cDTM [82] x x x NMF [69] x x x NMF [36] x x x x NMF [89] x x x ETM [13] x x x TS [22] x x x TFM [2…”
InfluentialComparing Twitter and Traditional Media Using Topic Models
Zhao, W. X., Jiang, J., Weng, J., He, J., Lim, E.-P., Yan, H., & Li, X. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-20161-5_34 · Cited by 1,214 · cited 6×
“proposed a hybrid model of Twitter-LDA [95] and Topic Tracking Model (TTM) [32] called Twitter-TTM [67].”
InfluentialLatent dirichlet allocation for tag recommendation
Krestel, R., Fankhauser, P., & Nejdl, W. (2009) · Proceedings of the third ACM conference on Recommender systems · doi:10.1145/1639714.1639726 · Cited by 494 · cited 1×
“They have been used to generate tags for content tagging systems [37], to organize online recommendation systems [1], and to explain latent factors that lead to recommendations [65].”
Method
Cited by
Bias of AI-generated content: an examination of news produced by large language models
Fang, X., Che, S., Mao, M., Zhang, H., Zhao, M., & Zhao, X. (2024) · Scientific Reports · doi:10.1038/s41598-024-55686-2 · Cited by 194
“To this end, we leveraged the technique of topic modeling because it is widely used to uncover prevalent semantics from a collection of documents 37 .”
Method
Metadata
- Authors
- Churchill, R., & Singh, L.
- Venue
- ACM Computing Surveys
- Published
- 2022-01-31
- Volume
- 54
- Issue
- 10s
- Pages
- 1-35
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W4206729245
- Cited by
- 244
- References
- 7
- FWCI
- 15.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.