The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Topical N-Grams: Phrase and Topic Discovery, with an Application to Information Retrieval
Open accessAbstract
Most topic models, such as latent Dirichlet allocation, rely on the bag-of-words assumption. However, word order and phrases are often critical to capturing the meaning of text in many text mining tasks. This paper presents topical n-grams, a topic model that discovers topics as well as topical phrases. The probabilistic model generates words in their textual order by, for each word, first sampling a topic, then sampling its status as a unigram or bigram, and then sampling the word from a topic-specific unigram or bigram distribution. Thus our model can model "white house" as a special meaning phrase in the 'politics' topic, but not in the 'real estate' topic. Successive bigrams form longer phrases. We present experiments showing meaningful phrases and more interpretable topics from the NIPS data and improved information retrieval performance on a TREC collection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
Word association norms, mutual information, and lexicography
Church, K., & Hanks, P. (1990) · doi:10.5555/89086.89095 · Cited by 3,590
Accurate methods for the statistics of surprise and coincidence
Dunning, T. E. (1993) · doi:10.5555/972450.972454 · Cited by 2,647
An introduction to MCMC for machine learning.
Andrieu, C., de Freitas, N., Doucet, A., & Jordan, M. I. (2003) · Machine Learning · doi:10.1023/a:1020281327116 · Cited by 2,451
A study of smoothing methods for language models applied to information retrieval
Zhai, C., & Lafferty, J. (2004) · ACM Transactions on Information Systems · doi:10.1145/984321.984322 · Cited by 1,201
Word association norms, mutual information, and lexicography
Church, K. W., & Hanks, P. (1989) · Proceedings of the 27th annual meeting on Association for Computational Linguistics - · doi:10.3115/981623.981633 · Cited by 1,094
LDA-based document models for ad-hoc retrieval
Wei, X., & Croft, W. B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148204 · Cited by 1,075
Self-citationTopic modeling: beyond bag-of-words
Wallach, H. M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143967 · Cited by 1,058
Technical terminology: some linguistic properties and an algorithm for identification in text
Justeson, J. S., & Katz, S. M. (1995) · Natural Language Engineering · doi:10.1017/s1351324900000048 · Cited by 820
Retrieving collocations from text: Xtract
Smadja, F. (1993) · Cited by 794
Griffiths, T. L., Mark Steyvers, B., Blei, D. M., & Tenenbaum, J. B. (2004) · Cited by 501
Using Statistics in Lexical Analysis
Church, K., Gale, W., Hanks, P., & Hindle, D. (2021) · Lexical Acquisition: Exploiting On-Line Resources to Build a Lexicon · doi:10.4324/9781315785387-8 · Cited by 459
Expectation-propagation for the generative aspect model
Minka, T. P., & Lafferty, J. (2002) · Cited by 439
A hierarchical Dirichlet language model
MacKay, D. J. C., & Peto, L. C. B. (1995) · Natural Language Engineering · doi:10.1017/s1351324900000218 · Cited by 274
An analysis of statistical and syntactic phrases
Mitra, M., Buckley, C., Singhal, A., & Cardie, C. (1997) · Cited by 210
Retrieving collocations from text
SmadjaFrank (1993) · Computational Linguistics · doi:10.5555/972450.972458 · Cited by 209
Modeling General and Specific Aspects of Documents with a Probabilistic Topic Model
Chemudugunta, C., Smyth, P., & Steyvers, M. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0035 · Cited by 186
Special Issue: Finite State Methods in Natural Language Processing
Karttunen, L., Koskenniemi, K., & Noord, V. G. (2003) · Cited by 127
Automatic indexing using selective NLP and first-order thesauri
Evans, D. A., Ginther-Webster, K., Hart, M. L., Lefferts, R. G., & Monarch, I. (1991) · Cited by 70
Cited by
Topic Modeling in Management Research: Rendering New Theory from Textual Data
Hannigan, T. R., Haans, R. F. J., Vakili, K., Tchalian, H., Glaser, V. L., Wang, M. S., Kaplan, S., & Jennings, P. D. (2019) · Academy of Management Annals · doi:10.5465/annals.2017.0099 · Cited by 621
Machine Reading Tea Leaves: Automatically Evaluating Topic Coherence and Topic Model Quality
Lau, J. H., Newman, D., & Baldwin, T. (2014) · Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/v1/e14-1056 · Cited by 571
Exploring content models for multi-document summarization
Haghighi, A., & Vanderwende, L. (2009) · Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics on - NAACL '09 · doi:10.3115/1620754.1620807 · Cited by 500
Topic and Role Discovery in Social Networks with Experiments on Enron and Academic Email
McCallum, A., Wang, X., & Corrada-Emmanuel, A. (2007) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2229 · Cited by 447
Self-citationAntons, D., Grünwald, E., Cichy, P., & Salge, T. O. (2020) · R&D Management · doi:10.1111/radm.12408 · Cited by 289
Metadata
- Authors
- Wang, X., McCallum, A., & Wei, X.
- Venue
- Seventh IEEE International Conference on Data Mining (ICDM 2007)
- Publisher
- IEEE
- Published
- 2007-10
- Pages
- 697-702
- ISSN
- 1550-4786 (ISSN-L)
- OpenAlex
- W2169606435
- Cited by
- 482
- References
- 21
- FWCI
- 8.67
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.