Labeled LDA: a supervised topic model for credit attribution in multi-labeled corpora
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
A significant portion of the world's text is tagged by readers on social bookmarking websites. Credit attribution is an inherent problem in these corpora because most pages have multiple tags, but the tags do not always apply with equal specificity across the whole document. Solving the credit attribution problem requires associating each word in a document with the most appropriate tags and vice versa. This paper introduces Labeled LDA, a topic model that constrains Latent Dirichlet Allocation by defining a one-to-one correspondence between LDA's latent topics and user tags. This allows Labeled LDA to directly learn word-tag correspondences. We demonstrate Labeled LDA's improved expressiveness over traditional LDA with visualizations of a corpus of tagged web pages from del.icio.us. Labeled LDA outperforms SVMs by more than 3 to 1 when extracting tag-specific document snippets. As a multi-label text classifier, our model is competitive with a discriminative baseline on a variety of datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049 · cited 1×
“Therefore, we can use collapsed Gibbs sampling (Griffiths and Steyvers, 2004) for training where the sampling probability for a topic for position i in a document d in Labeled LDA is given by:”
MethodA comparison of event models for naive bayes text classification
McCallum, A., & Nigam, K. (1998) · Cited by 3,289
RCV1: A New Benchmark Collection for Text Categorization Research
Lewis, D., Yang, Y., Rose, T. G., & Li, F. (2004) · Goldsmiths (University of London) · doi:10.5555/1005332.1005345 · Cited by 2,503
Blei, D. M., & McAuliffe, J. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1003.0783 · Cited by 1,259
Lafferty, J., & Blei, D. M. (2005) · neural information processing systems · Cited by 1,221
Pachinko allocation: DAG-structured mixture models of topic correlations
Li, W., & McCallum, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143917 · Cited by 609
Can social bookmarking improve web search?
Heymann, P., Koutrika, G., & Garcia-Molina, H. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341558 · Cited by 434
DiscLDA: Discriminative Learning for Dimensionality Reduction and Classification
Lacoste-Julien, S., Sha, F., & Jordan, M. I. (2008) · Cited by 414
Cited by
Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey
Jelodar, H., Wang, Y., Yuan, C., Feng, X., Jiang, X., Li, Y., & Zhao, L. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6894-4 · Cited by 1,961
Empirical study of topic modeling in Twitter
Hong, L., & Davison, B. D. (2010) · Proceedings of the First Workshop on Social Media Analytics · doi:10.1145/1964858.1964870 · Cited by 1,120
A Model of Text for Experimentation in the Social Sciences
Roberts, M. E., Stewart, B. M., & Airoldi, E. M. (2016) · Journal of the American Statistical Association · doi:10.1080/01621459.2016.1141684 · Cited by 728
Characterizing Microblogs with Topic Models
Ramage, D., Dumais, S., & Liebling, D. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14026 · Cited by 702
Self-citationSpotting opinion spammers using behavioral footprints
Mukherjee, A., Kumar, A., Liu, B., Wang, J., Hsu, M., Castellanos, M., & Ghosh, R. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2487580 · Cited by 426
Recommender systems based on user reviews: the state of the art
Chen, L., Chen, G., & Wang, F. (2015) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-015-9155-5 · Cited by 403
An overview of topic modeling and its current applications in bioinformatics
Liu, L., Tang, L., Dong, W., Yao, S., & Zhou, W. (2016) · SpringerPlus · doi:10.1186/s40064-016-3252-8 · Cited by 392
Classifying urban land use by integrating remote sensing and social media data
Liu, X., He, J., Yao, Y., Zhang, J., Liang, H., Wang, H., & Hong, Y. (2017) · International Journal of Geographical Information Science · doi:10.1080/13658816.2017.1324976 · Cited by 368
Computer-Assisted Text Analysis for Comparative Politics
Lucas, C., Nielsen, R. A., Roberts, M. E., Stewart, B. M., Storer, A., & Tingley, D. (2015) · Political Analysis · doi:10.1093/pan/mpu019 · Cited by 366
Hu, Y., Boyd-Graber, J., Satinoff, B., & Smith, A. (2014) · Machine Learning · doi:10.1007/s10994-013-5413-0 · Cited by 338
Weakly Supervised Joint Sentiment-Topic Detection from Text
Lin, C., He, Y., Everson, R., & Ruger, S. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.48 · Cited by 310
Statistical topic models for multi-label document classification
Rubin, T. N., Chambers, A., Smyth, P., & Steyvers, M. (2012) · Machine Learning · doi:10.1007/s10994-011-5272-5 · Cited by 294
Chae, J., Thom, D., Bosch, H., Jang, Y., Maciejewski, R., Ebert, D. S., & Ertl, T. (2012) · 2012 IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2012.6400557 · Cited by 281
Automatically characterizing places with opportunistic crowdsensing using smartphones
Chon, Y., Lane, N. D., Li, F., Cha, H., & Zhao, F. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370288 · Cited by 270
Partially labeled topic models for interpretable text mining
Ramage, D., Manning, C. D., & Dumais, S. (2011) · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2020408.2020481 · Cited by 211
Self-citationAnalyzing and automatically labelling the types of user issues that are raised in mobile app reviews
McIlroy, S., Ali, N., Khalid, H., & E. Hassan, A. (2016) · Empirical Software Engineering · doi:10.1007/s10664-015-9375-7 · Cited by 190
A Novel Neural Topic Model and Its Supervised Extension
Cao, Z., Li, S., Liu, Y., Li, W., & Ji, H. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9499 · Cited by 160
Authorship Attribution with Topic Models
Seroussi, Y., Zukerman, I., & Bohnert, F. (2014) · Computational Linguistics · doi:10.1162/coli_a_00173 · Cited by 89
“Examples of generic upstream models include DiscLDA (Lacoste-Julien, Sha, and Jordan 2008), Labeled LDA (Ramage et al. 2009), and DMR (Mimno and McCallum 2008).”
BackgroundMethodInfluentialOf Pins and Tweets: Investigating How Users Behave Across Image- and Text-Based Social Networks
Ottoni, R., Las Casas, D., Pesce, J. P., Meira Jr., W., Wilson, C., Mislove, A., & Almeida, V. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14514 · Cited by 75
“After collecting the results from the AMT workers 7 , we analyzed the data to determine which of the 300 L-LDA topics could be mapped with high confidence onto our 35 categories.”
MethodInfluentialCalderón, C. A., de la Vega, G., & Herrero, D. B. (2020) · Social Sciences · doi:10.3390/socsci9110188 · Cited by 73
Data analytics of social media publicity to enhance household waste management
Jiang, P., Fan, Y. V., & Klemeš, J. J. (2021) · Resources, Conservation and Recycling · doi:10.1016/j.resconrec.2020.105146 · Cited by 73
Redundancy-Aware Topic Modeling for Patient Record Notes
Cohen, R., Aviram, I., Elhadad, M., & Elhadad, N. (2014) · PLoS ONE · doi:10.1371/journal.pone.0087555 · Cited by 71
“Topic modeling has been shown to help in large number of tasks, including document classification and clustering, multi-document summarization [5], search [6], document labeling [7,8], and information extraction [9].”
BackgroundMixed-Initiative Real-Time Topic Modeling & Visualization for Crisis Counseling
Dinakar, K., Chen, J., Lieberman, H., Picard, R., & Filbin, R. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701395 · Cited by 42
“This is achieved by using a labeled LDA model [21] trained over the set of topics derived from stage 1.”
Method
Metadata
- Authors
- Ramage, D., Hall, D., Nallapati, R., & Manning, C. D.
- Venue
- Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing Volume 1 - EMNLP '09
- Published
- 2009
- Volume
- 1
- Pages
- 248
- OpenAlex
- W1969486090
- Cited by
- 1,190
- References
- 15
- FWCI
- 30.08
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.