The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Automatic labeling of multinomial topic models
Abstract
Multinomial distributions over words are frequently used to model topics in text collections. A common, major challenge in applying all such topic models to any text mining problem is to label a multinomial topic model accurately so that a user can interpret the discovered topic. So far, such labels have been generated manually in a subjective way. In this paper, we propose probabilistic approaches to automatically labeling multinomial topic models in an objective way. We cast this labeling problem as an optimization problem involving minimizing Kullback-Leibler divergence between word distributions and maximizing mutual information between a label and a topic model. Experiments with user study have been done on two text data sets with different genres.The results show that the proposed labeling methods are quite effective to generate labels that are meaningful and useful for interpreting the discovered topic models. Our methods are general and can be applied to labeling topics learned through all kinds of topic models such as PLSA, LDA, and their variations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Finding groups in data: an introduction to cluster analysis
(1991) · Choice Reviews Online · doi:10.5860/choice.28-4558 · Cited by 10,474
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Finding Groups in Data: An Introduction to Cluster Analysis
Kaufman, L., & Rousseeuw, P. J. (1990) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316801 · Cited by 7,344
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
Probabilistic Latent Semantic Indexing
Hofmann, T. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130370 · Cited by 3,988
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
Word association norms, mutual information, and lexicography
Church, K., & Hanks, P. (1990) · doi:10.5555/89086.89095 · Cited by 3,590
Blei, D. M., & Lafferty, J. D. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143859 · Cited by 3,173
The use of MMR, diversity-based reranking for reordering documents and producing summaries
Carbonell, J., & Goldstein, J. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291025 · Cited by 2,329
Wiley Series in Probability and Mathematics Statistics
(1981) · Wiley Series in Probability and Statistics · doi:10.1002/0471725250.scard · Cited by 2,220
The Use of MMR, Diversity-Based Reranking for Reordering Documents and Producing Summaries
Carbonell, J., & Goldstein, J. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130369 · Cited by 2,156
Topics over time: a non-Markov continuous-time model of topical trends
Wang, X., & McCallum, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150450 · Cited by 1,121
LDA-based document models for ad-hoc retrieval
Wei, X., & Croft, W. B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148204 · Cited by 1,075
Lafferty, J., & Blei, D. M. (2005) · neural information processing systems · Cited by 917
Model-based feedback in the language modeling approach to information retrieval
Zhai, C., & Lafferty, J. (2001) · Proceedings of the tenth international conference on Information and knowledge management · doi:10.1145/502585.502654 · Cited by 787
Self-citationPachinko allocation: DAG-structured mixture models of topic correlations
Li, W., & McCallum, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143917 · Cited by 609
Discovering word senses from text
Pantel, P., & Lin, D. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775138 · Cited by 591
Probabilistic author-topic models for information discovery
Steyvers, M., Smyth, P., Rosen-Zvi, M., & Griffiths, T. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014087 · Cited by 572
Introduction to the Special Issue on Summarization
Radev, D. R., Hovy, E., & McKeown, K. (2002) · Computational Linguistics · doi:10.1162/089120102762671927 · Cited by 539
Discovering evolutionary theme patterns from text: an exploration of temporal text mining
Mei, Q., & Zhai, C. (2005) · Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining · doi:10.1145/1081870.1081895 · Cited by 524
Self-citationLanguage Modeling for Information Retrieval
(2003) · Springer eBooks · doi:10.1007/978-94-017-0171-6 · Cited by 371
A probabilistic approach to spatiotemporal theme pattern mining on weblogs
Mei, Q., Liu, C., Su, H., & Zhai, C. (2006) · Proceedings of the 15th international conference on World Wide Web · doi:10.1145/1135777.1135857 · Cited by 332
Self-citationA cross-collection mixture model for comparative text mining
Zhai, C., Velivelli, A., & Yu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014150 · Cited by 272
Self-citationThe Design, Implementation, and Use of the Ngram Statistics Package
Banerjee, S., & Pedersen, T. (2003) · Lecture Notes in Computer Science · doi:10.1007/3-540-36456-0_38 · Cited by 230
Applied Probability and Statistics
(2005) · Springer eBooks · doi:10.1007/0-387-28505-9 · Cited by 206
Statistical entity-topic models
Newman, D. J., Chemudugunta, C., & Smyth, P. (2006) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1150402.1150487 · Cited by 147
Pachinko allocation: dag-structured mixture models of topic correlations
McCallum, A., & Li, W. (2007) · Cited by 143
A mixture model for contextual text mining
Mei, Q., & Zhai, C. (2006) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1150402.1150482 · Cited by 139
Self-citationHammerton, J. A., Osborne, M., Armstrong, S., et al. (2000) · Applied Physics Letters · doi:10.1162/153244302320884533 · Cited by 62
Fast statistical parsing of noun phrases for document indexing
Zhai, C. (1997) · Conference on Applied Natural Language Processing · doi:10.3115/974557.974603 · Cited by 59
Self-citation
Cited by
(2009) · Cited by 1,900
Labeled LDA: a supervised topic model for credit attribution in multi-labeled corpora
Ramage, D., Hall, D., Nallapati, R., & Manning, C. D. (2009) · Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing Volume 1 - EMNLP '09 · doi:10.3115/1699510.1699543 · Cited by 1,190
The double‐edged sword of recombination in breakthrough innovation
Kaplan, S., & Vakili, K. (2015) · Strategic Management Journal · doi:10.1002/smj.2294 · Cited by 776
A Model of Text for Experimentation in the Social Sciences
Roberts, M. E., Stewart, B. M., & Airoldi, E. M. (2016) · Journal of the American Statistical Association · doi:10.1080/01621459.2016.1141684 · Cited by 728
How to analyze political attention with minimal assumptions and costs
Quinn, K. M., Monroe, B. L., Colaresi, M., Crespin, M. H., & Radev, D. R. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2009.00427.x · Cited by 671
Metadata
- Authors
- Mei, Q., Shen, X., & Zhai, C.
- Venue
- Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
- Publisher
- ACM
- Published
- 2007-08-12
- Pages
- 490-499
- OpenAlex
- W2113855231
- Cited by
- 384
- References
- 31
- FWCI
- 9.32
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.