The DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index.
Wikipedia-based Semantic Interpretation for Natural Language Processing
Open accessAbstract
Adequate representation of natural language semantics requires access to vast amounts of common sense and domain-specific world knowledge. Prior work in the field was based on purely statistical techniques that did not make use of background knowledge, on limited lexicographic knowledge bases such as WordNet, or on huge manual efforts such as the CYC project. Here we propose a novel method, called Explicit Semantic Analysis (ESA), for fine-grained semantic interpretation of unrestricted natural language texts. Our method represents meaning in a high-dimensional space of concepts derived from Wikipedia, the largest encyclopedia in existence. We explicitly represent the meaning of any text in terms of Wikipedia-based concepts. We evaluate the effectiveness of our method on text categorization and on computing the degree of semantic relatedness between fragments of natural language text. Using ESA results in significant improvements over the previous state of the art in both tasks. Importantly, due to the use of natural concepts, the ESA model is easy to explain to human users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Numerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Baeza-Yates, R. A., & Ribeiro-Neto, B. A. (1999) · Cited by 11,505
WordNet: An Electronic Lexical Database
Kilgarriff, A., & Fellbaum, C. (2000) · Language · doi:10.2307/417141 · Cited by 11,464
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Term-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740
Introduction to Modern Information Retrieval
Salton, G., & McGill, M. J. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 9,680
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026683 · Cited by 7,999
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,926
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Introduction to modern information retrieval
Dillon, M. (1983) · Information Processing & Management · doi:10.1016/0306-4573(83)90062-6 · Cited by 5,909
(1991) · Springer eBooks · doi:10.1007/978-3-7091-2840-4 · Cited by 5,095
A Comparative Study on Feature Selection in Text Categorization
Yang, Y., & Pedersen, J. (1997) · Cited by 4,790
Making Large-Scale SVM Learning Practical
Joachims, T. (1998) · RePEc: Research Papers in Economics · doi:10.17877/de290r-14262 · Cited by 4,411
An Information-Theoretic Definition of Similarity
Lin, D. (1998) · Cited by 3,790
Cohen, W. W. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50023-2 · Cited by 3,787
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Peter, P., & Turney (2002) · Cited by 3,650
Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy
Jiang, J. J., & Conrath, D. W. (1997) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9709008 · Cited by 2,743
Relevance feedback in information retrieval
Rocchio, J. J. (1971) · Medical Entomology and Zoology · Cited by 2,680
A re-examination of text categorization methods
Yang, Y., & Liu, X. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312647 · Cited by 2,652
Alexander, S. T. (1986) · Springer eBooks · doi:10.1007/978-1-4612-4978-8 · Cited by 2,646
RCV1: A New Benchmark Collection for Text Categorization Research
Lewis, D., Yang, Y., Rose, T. G., & Li, F. (2004) · Goldsmiths (University of London) · doi:10.5555/1005332.1005345 · Cited by 2,503
Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews
Turney, P. D. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073153 · Cited by 2,352
Thumbs up? Sentiment Classification using Machine Learning Techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0205070 · Cited by 2,191
The Proper Treatment of Quantification in Ordinary English
Montague, R. (1973) · Approaches to Natural Language · doi:10.1007/978-94-010-2506-5_10 · Cited by 2,069
NewsWeeder: Learning to Filter Netnews
Lang, K. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50048-7 · Cited by 2,051
Resnik, P. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.514 · Cited by 2,047
Computing semantic relatedness using Wikipedia-based explicit semantic analysis
Gabrilovich, E., & Markovitch, S. (2007) · Cited by 1,981
Self-citationInternet encyclopaedias go head to head
Giles, J. (2005) · Nature · doi:10.1038/438900a · Cited by 1,978
CYC: a large-scale investment in knowledge infrastructure
Lenat, D. B. (1995) · Communications of the ACM · doi:10.1145/219717.219745 · Cited by 1,946
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks
Snow, R., O'Connor, B., Jurafsky, D., & Ng, A. Y. (2008) · Proceedings of the Conference on Empirical Methods in Natural Language Processing - EMNLP '08 · doi:10.3115/1613715.1613751 · Cited by 1,887
Combining Local Context and WordNet Similarity for Word Sense Identification
Leacock, C. (1998) · WordNet · doi:10.7551/mitpress/7287.003.0018 · Cited by 1,662
Contextual correlates of semantic similarity
Miller, G. A., & Charles, W. G. (1991) · Language and Cognitive Processes · doi:10.1080/01690969108406936 · Cited by 1,594
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Turney, P. D. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0212032 · Cited by 1,575
Automatic retrieval and clustering of similar words
Lin, D. (1998) · Proceedings of the 36th annual meeting on Association for Computational Linguistics - · doi:10.3115/980691.980696 · Cited by 1,545
Brill, E. (1995) · Cited by 1,520
Numerical Recipes in C-The Art of Scientific Computing.
G., W., Press, W. H., Flannery, B. P., Teukolsky, S. A., & Vetterling, W. T. (1989) · Mathematics of Computation · doi:10.2307/2008673 · Cited by 1,513
Inductive learning algorithms and representations for text categorization
Dumais, S., Platt, J., Heckerman, D., & Sahami, M. (1998) · Proceedings of the seventh international conference on Information and knowledge management · doi:10.1145/288627.288651 · Cited by 1,461
Evaluating WordNet-based Measures of Lexical Semantic Relatedness
Budanitsky, A., & Hirst, G. (2006) · Computational Linguistics · doi:10.1162/089120106776173093 · Cited by 1,448
Contextual correlates of synonymy
Rubenstein, H., & Goodenough, J. B. (1965) · Communications of the ACM · doi:10.1145/365628.365657 · Cited by 1,425
Mining the Web for Synonyms: PMI-IR versus LSA on TOEFL
Turney, P. D. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44795-4_42 · Cited by 1,285
Corpus-based and Knowledge-based Measures of Text Semantic Similarity
Mihalcea, R. F., Corley, C. D., & Strapparava, C. (2006) · University of North Texas Digital Library (University of North Texas) · Cited by 1,194
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Placing search in context: the concept revisited.
Finkelstein, L., Gabrilovich, E., Matias, Y., Rivlin, E., Solan, Z., Wolfman, G., & Ruppin, E. (2002) · Cited by 961
Self-citationLexical Chains as Representations of Context for the Detection and Correction of Malapropisms
St-Onge, D. (1998) · WordNet · doi:10.7551/mitpress/7287.003.0020 · Cited by 843
WordNet an electronic lexical database
Fellbaum, C. (n.d.) · Cited by 771
WikiRelate! computing semantic relatedness using wikipedia
Strube, M., & Ponzetto, S. P. (2006) · MADOC (University of Mannheim) · Cited by 744
A web-based kernel function for measuring the similarity of short text snippets
Sahami, M., & Heilman, T. D. (2006) · Proceedings of the 15th international conference on World Wide Web · doi:10.1145/1135777.1135834 · Cited by 735
Qiu, Y., & Frei, H.-P. (1993) · Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '93 · doi:10.1145/160688.160713 · Cited by 712
Distributional clustering of words for text classification
Baker, L. D., & McCallum, A. K. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.290970 · Cited by 676
An effective, low-cost measure of semantic relatedness obtained from Wikipedia links
Milne, D., & Witten, I. H. (2008) · Cited by 665
Measures of distributional similarity
Lee, L. (1999) · Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics - · doi:10.3115/1034678.1034693 · Cited by 583
Automatic retrieval and clustering of similar words
Lin, D. (1998) · Proceedings of the 17th international conference on Computational linguistics - · doi:10.3115/980432.980696 · Cited by 561
Widrow, B. C., & Stearns, S. D. (1985) · International Linear Collider · Cited by 558
An evaluation of phrasal and clustered representations on a text categorization task
Lewis, D. D. (1992) · Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '92 · doi:10.1145/133160.133172 · Cited by 544
Training algorithms for linear text classifiers
Lewis, D. D., Schapire, R. E., Callan, J. P., & Papka, R. (1996) · Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '96 · doi:10.1145/243199.243277 · Cited by 520
Cyc: toward programs with common sense
Lenat, D. B., Guha, R. V., Pittman, K., Pratt, D., & Shepherd, M. (1990) · Communications of the ACM · doi:10.1145/79173.79176 · Cited by 507
A divisive information theoretic feature clustering algorithm for text classification
Dhillon, I. S., Mallela, S., & Kumar, R. (2003) · doi:10.5555/944919.944973 · Cited by 500
Knowledge Based Systems in Artificial Intelligence
(1986) · Telematics and Informatics · doi:10.1016/s0736-5853(86)80076-4 · Cited by 463
Roget's Thesaurus of English Words and Phrases
Kirkpatrick, B. (1982) · CERN Document Server (European Organization for Nuclear Research) · Cited by 427
Automated Tag Clustering: Improving search and exploration in the tag space
Begelman, G., Keller, P., & Smadja, F. (2006) · Cited by 419
Text Categorization with Support Vector Machines. How to Represent Texts in Input Space?
Leopold, E., & Kindermann, J. (2002) · Machine Learning · doi:10.1023/a:1012491419635 · Cited by 403
Gabrilovich, E., & Markovitch, S. (2006) · Cited by 402
Self-citationBoolean Feature Discovery in Empirical Learning
Pagallo, G., & Haussler, D. (1990) · Machine Learning · doi:10.1023/a:1022611825350 · Cited by 390
Exploring the similarity space
Zobel, J., & Moffat, A. (1998) · ACM SIGIR Forum · doi:10.1145/281250.281256 · Cited by 378
Similarity-Based Models of Word Cooccurrence Probabilities
Dagan, I., Lee, L., & Pereira, F. C. N. (1999) · Machine Learning · doi:10.1023/a:1007537716579 · Cited by 375
Similarity of Semantic RelationsPreprint
Turney, P. D. (2006) · CogPrints (University of Southampton) · Cited by 359
Unsupervised Learning of Semantic Orientation from a Hundred-Billion-Word Corpus
Turney, P., & Littman, M. L. (2002) · arXiv (Cornell University) · doi:10.4224/8914027 · Cited by 359
A study of thresholding strategies for text categorization
Yang, Y. (2001) · Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/383952.383975 · Cited by 358
Supervised term weighting for automated text categorization
Debole, F., & Sebastiani, F. (2003) · Proceedings of the 2003 ACM symposium on Applied computing · doi:10.1145/952532.952688 · Cited by 352
OHSUMED: An Interactive Retrieval Evaluation and New Large Test Collection for Research
Hersh, W., Buckley, C., Leone, T. J., & Hickam, D. (1994) · SIGIR ’94 · doi:10.1007/978-1-4471-2099-5_20 · Cited by 352
Feature Engineering for Text Classification
Scott, S., & Matwin, S. (1999) · Cited by 307
The Proper Treatment of Quantification in Ordinary English
Montague, R. (1973) · Studies in cognitive systems · doi:10.1007/978-94-009-2727-8_7 · Cited by 306
Similarity Measures for Short Segments of Text
Metzler, D., Dumais, S., & Meek, C. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-71496-5_5 · Cited by 305
High-performing feature selection for text classification
Rogati, M., & Yang, Y. (2002) · Proceedings of the eleventh international conference on Information and knowledge management · doi:10.1145/584792.584911 · Cited by 303
Reuters-21578 Text Categorization Test Collection, Distribution 1.0
Lewis, D. (1997) · Medical Entomology and Zoology · Cited by 263
The Reuters Corpus Volume 1 -from Yesterday’s News to Tomorrow’s Language Resources
Rose, T. G., Stevenson, M., & Whitehead, M. (2002) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/5aeuc8zmytsy · Cited by 250
Augmenting Naive Bayes Classifiers with Statistical Language Models
Peng, F., Schuurmans, D., & Wang, S. (2004) · Information Retrieval · doi:10.1023/b:inrt.0000011209.19643.e2 · Cited by 243
Importance of semantic representation: dataless classification
Chang, M., Ratinov, L., Roth, D., & Srikumar, V. (2008) · National Conference on Artificial Intelligence · Cited by 229
Text classification and named entities for new event detection
Kumaran, G., & Allan, J. (2004) · Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1008992.1009044 · Cited by 220
Experiments on the Use of Feature Selection and Negative Evidence in Automated Text Categorization
Galavotti, L., Sebastiani, F., & Simi, M. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45268-0_6 · Cited by 210
Gabrilovich, E., & Markovitch, S. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015388 · Cited by 199
Self-citationConstructive induction on decision trees
Matheus, C. J., & Rendell, L. A. (1989) · Cited by 189
Caropreso, M. F., Matwin, S., & Sebastiani, F. (2001) · Cited by 179
Combining Naive Bayes and n-Gram Language Models for Text Classification
Peng, F., & Schuurmans, D. (2003) · Lecture Notes in Computer Science · doi:10.1007/3-540-36618-0_24 · Cited by 169
Measuring Semantic Similarity by Latent Relational Analysis
Turney, P. D. (2005) · CogPrints (University of Southampton) · doi:10.48550/arxiv.cs/0508053 · Cited by 167
Improving text retrieval for the routing problem using latent semantic indexing
Hull, D. A. (1994) · doi:10.5555/188490.188585 · Cited by 155
Using wiktionary for computing semantic relatedness
Zesch, T., Müller, C., & Gurevych, I. (2008) · TUbilio (Technical University of Darmstadt) · Cited by 150
Using LSI for text classification in the presence of background text
Zelikovitz, S., & Hirsh, H. (2001) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/502585.502605 · Cited by 147
Feature Generation Using General Constructor Functions
Markovitch, S., & Rosenstein, D. (2002) · Machine Learning · doi:10.1023/a:1014046307775 · Cited by 143
Self-citationA Wikipedia-Based Multilingual Retrieval Model
Potthast, M., Stein, B., & Anderka, M. (2008) · Springer eBooks · doi:10.1007/978-3-540-78646-7_51 · Cited by 129
A Case Study in Using Linguistic Phrases for Text Categorization on the WWW
Ffirnkranz, J., Mitchell, T. M., & Riloff, E. (1998) · Cited by 100
ID2-of-3: Constructive Induction of M-of-N Concepts for Discriminators in Decision Trees
Murphy, P. M., & Pazzani, M. J. (1991) · Elsevier eBooks · doi:10.1016/b978-1-55860-200-7.50040-4 · Cited by 98
Concept-based feature generation and selection for information retrieval
Egozi, O., Gabrilovich, E., & Markovitch, S. (2008) · Cited by 77
Self-citationAutomatically creating datasets for measures of semantic relatedness
Zesch, T., & Gurevych, I. (2006) · doi:10.3115/1641976.1641980 · Cited by 73
Gabrilovich, E., & Markovitch, S. (2007) · doi:10.5555/1314498.1314573 · Cited by 65
Self-citationA Comparative Study for Domain Ontology Guided Feature Extraction
Wang, B. B., McKay, B., Abbass, H. A., & Barlow, M. (2003) · Cited by 49
Interaction of Feature Selection Methods and Linear Classification Models
Brank, J., Grobelnik, M., Milic-Frayling, N., & Mladenic, D. (2002) · Cited by 47
Improving Short-Text Classification using Unlabeled Data for Classification Problems
Zelikovitz, S., & Hirsh, H. (2000) · International Conference on Machine Learning · Cited by 47
Text clustering with NTSO (neural text self organizer)
Jo, T., & Japkowicz, N. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2005.1555892 · Cited by 6
Cited by
Navigli, R., & Ponzetto, S. P. (2012) · Artificial Intelligence · doi:10.1016/j.artint.2012.07.001 · Cited by 1,465
Wamba-Taguimdje, S.-L., Fosso Wamba, S., Kala Kamdjoug, J. R., & Tchatchouang Wanko, C. E. (2020) · Business Process Management Journal · doi:10.1108/bpmj-10-2019-0411 · Cited by 1,280
TAGME: on-the-fly annotation of short text fragments (by wikipedia entities)
Ferragina, P., & Scaiella, U. (2010) · Proceedings of the 19th ACM international conference on Information and knowledge management · doi:10.1145/1871437.1871689 · Cited by 743
Good debt or bad debt: Detecting semantic orientations in economic texts
Malo, P., Sinha, A., Korhonen, P., Wallenius, J., & Takala, P. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23062 · Cited by 513
“…enrichment of lexicon with weights for di ff erent concepts and events, an important direction for future research will be to examine how phrase level models can be merged with content models (Gabrilovich & Markovitch, 2010; Malo, Sinha, Wallenius, & Korhonen, 2011; Malo, Si-itari, & Sinha, 2013)).”
BackgroundWijayati, D. T., Rahman, Z., Fahrullah, A., Rahman, M. F. W., Arifah, I. D. C., & Kautsar, A. (2022) · International Journal of Manpower · doi:10.1108/ijm-07-2021-0423 · Cited by 272
Metadata
- Authors
- Gabrilovich, E., & Markovitch, S.
- Venue
- Journal of Artificial Intelligence Research
- Publisher
- AI Access Foundation
- Published
- 2009-03-30
- Volume
- 34
- Pages
- 443-498
- ISSN
- 1076-9757 (ISSN-L)
- OpenAlex
- W2099938389
- Cited by
- 377
- References
- 101
- FWCI
- 31.81
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.