The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Topical N-Grams: Phrase and Topic Discovery, with an Application to Information Retrieval
Open accessAbstract
Most topic models, such as latent Dirichlet allocation, rely on the bag-of-words assumption. However, word order and phrases are often critical to capturing the meaning of text in many text mining tasks. This paper presents topical n-grams, a topic model that discovers topics as well as topical phrases. The probabilistic model generates words in their textual order by, for each word, first sampling a topic, then sampling its status as a unigram or bigram, and then sampling the word from a topic-specific unigram or bigram distribution. Thus our model can model "white house" as a special meaning phrase in the 'politics' topic, but not in the 'real estate' topic. Successive bigrams form longer phrases. We present experiments showing meaningful phrases and more interpretable topics from the NIPS data and improved information retrieval performance on a TREC collection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
Word association norms, mutual information, and lexicography
Church, K., & Hanks, P. (1990) · doi:10.5555/89086.89095 · Cited by 3,590
Accurate methods for the statistics of surprise and coincidence
Dunning, T. E. (1993) · doi:10.5555/972450.972454 · Cited by 2,647
An introduction to MCMC for machine learning.
Andrieu, C., de Freitas, N., Doucet, A., & Jordan, M. I. (2003) · Machine Learning · doi:10.1023/a:1020281327116 · Cited by 2,451
A study of smoothing methods for language models applied to information retrieval
Zhai, C., & Lafferty, J. (2004) · ACM Transactions on Information Systems · doi:10.1145/984321.984322 · Cited by 1,201
Word association norms, mutual information, and lexicography
Church, K. W., & Hanks, P. (1989) · Proceedings of the 27th annual meeting on Association for Computational Linguistics - · doi:10.3115/981623.981633 · Cited by 1,094
LDA-based document models for ad-hoc retrieval
Wei, X., & Croft, W. B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148204 · Cited by 1,075
Self-citationTopic modeling: beyond bag-of-words
Wallach, H. M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143967 · Cited by 1,058
Cited by
Topic Modeling in Management Research: Rendering New Theory from Textual Data
Hannigan, T. R., Haans, R. F. J., Vakili, K., Tchalian, H., Glaser, V. L., Wang, M. S., Kaplan, S., & Jennings, P. D. (2019) · Academy of Management Annals · doi:10.5465/annals.2017.0099 · Cited by 621
Machine Reading Tea Leaves: Automatically Evaluating Topic Coherence and Topic Model Quality
Lau, J. H., Newman, D., & Baldwin, T. (2014) · Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/v1/e14-1056 · Cited by 571
Exploring content models for multi-document summarization
Haghighi, A., & Vanderwende, L. (2009) · Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics on - NAACL '09 · doi:10.3115/1620754.1620807 · Cited by 500
Topic and Role Discovery in Social Networks with Experiments on Enron and Academic Email
McCallum, A., Wang, X., & Corrada-Emmanuel, A. (2007) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2229 · Cited by 447
Self-citationAntons, D., Grünwald, E., Cichy, P., & Salge, T. O. (2020) · R&D Management · doi:10.1111/radm.12408 · Cited by 289
Topic Modeling Using Latent Dirichlet allocation: A Survey
Chauhan, U., & Shah, A. (2022) · ACM Computing Surveys · doi:10.1145/3462478 · Cited by 270
Automatic term identification for bibliometric mapping
van Eck, N. J., Waltman, L., Noyons, E. C. M., & Buter, R. K. (2010) · Scientometrics · doi:10.1007/s11192-010-0173-0 · Cited by 264
Topic based classification and pattern identification in patents
Venugopalan, S., & Rai, V. (2015) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2014.10.006 · Cited by 116
Authorship Attribution with Topic Models
Seroussi, Y., Zukerman, I., & Bohnert, F. (2014) · Computational Linguistics · doi:10.1162/coli_a_00173 · Cited by 89
Analyzing and distinguishing fake and real news to mitigate the problem of disinformation
Vereshchaka, A., Cosimini, S., & Dong, W. (2020) · Computational and Mathematical Organization Theory · doi:10.1007/s10588-020-09307-8 · Cited by 34
Metadata
- Authors
- Wang, X., McCallum, A., & Wei, X.
- Venue
- Seventh IEEE International Conference on Data Mining (ICDM 2007)
- Publisher
- IEEE
- Published
- 2007-10
- Pages
- 697-702
- ISSN
- 1550-4786 (ISSN-L)
- OpenAlex
- W2169606435
- Cited by
- 482
- References
- 21
- FWCI
- 8.67
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.