Latent dirichlet allocation: stability and applications to studies of user-generated content
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Topic modeling, in particular the Latent Dirichlet Allocation (LDA) model, has recently emerged as an important tool for understanding large datasets, in particular, user-generated datasets in social studies of the Web. In this work, we investigate the instability of LDA inference, propose a new metric of similarity between topics and a criterion of vocabulary reduction. We show the limitations of the LDA approach for the purposes of qualitative analysis in social science and sketch some ways for improvement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
The Hungarian method for the assignment problem
Kuhn, H. W. (1955) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800020109 · Cited by 13,120
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049 · cited 4×
“In the LDA model, Gibbs sampling after easy transformations [5] reduces to the so-called collapsed Gibbs sampling, where zw are iteratively resampled with distributions”
BackgroundMethodInfluentialMarkov Random Field Modeling in Image Analysis
Li, S. Z. (2001) · Computer Science Workbench · doi:10.1007/978-4-431-67044-5 · Cited by 1,533
Lafferty, J., & Blei, D. M. (2005) · neural information processing systems · Cited by 1,221
Topics over time: a non-Markov continuous-time model of topical trends
Wang, X., & McCallum, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150450 · Cited by 1,121
Steyvers, M., & Griffiths, T. (2015) · Handbook of Latent Semantic Analysis · doi:10.4324/9780203936399.ch21 · Cited by 1,011
Evaluation methods for topic models
Wallach, H. M., Murray, I., Salakhutdinov, R., & Mimno, D. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553515 · Cited by 863
Advances in Pattern Recognition
Casey, R. G., & Nagy, G. (1971) · Scientific American · doi:10.1038/scientificamerican0471-56 · Cited by 292
Cited by
A Model of Text for Experimentation in the Social Sciences
Roberts, M. E., Stewart, B. M., & Airoldi, E. M. (2016) · Journal of the American Statistical Association · doi:10.1080/01621459.2016.1141684 · Cited by 728
Investigating Capsule Networks with Dynamic Routing for Text Classification
Yang, M., Zhao, W., Ye, J., Lei, Z., Zhao, Z., & Zhang, S. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1350 · Cited by 366
Using Social Media to Mine and Analyze Public Opinion Related to COVID-19 in China
Han, X., Wang, J., Zhang, M., & Wang, X. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17082788 · Cited by 361
Topic modelling for qualitative studies
Nikolenko, S. I., Koltcov, S., & Koltsova, O. (2017) · Journal of Information Science · doi:10.1177/0165551515617393 · Cited by 332
Self-citationNeural News Recommendation with Long- and Short-term User Representations
An, M., Wu, F., Wu, C., Zhang, K., Liu, Z., & Xie, X. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1033 · Cited by 332
Unsupervised Domain Clusters in Pretrained Language Models
Aharoni, R., & Goldberg, Y. (2020) · arXiv · doi:10.48550/arxiv.2004.02105 · Cited by 187
Predicting the Spatio-Temporal Evolution of Chronic Diseases in Population with Human Mobility Data
Wang, Y., Zhou, X., Noulas, A., Mascolo, C., Xie, X., & Chen, E. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/497 · Cited by 22
Metadata
- Authors
- Koltcov, S., Koltsova, O., & Nikolenko, S.
- Venue
- Proceedings of the 2014 ACM conference on Web science
- Publisher
- ACM
- Published
- 2014-06-23
- Pages
- 161-165
- OpenAlex
- W1983719983
- Cited by
- 280
- References
- 14
- FWCI
- 39.04
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.