The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Concept-Based Information Retrieval Using Explicit Semantic Analysis
Abstract
Information retrieval systems traditionally rely on textual keywords to index and retrieve documents. Keyword-based retrieval may return inaccurate and incomplete results when different keywords are used to describe the same concept in the documents and in the queries. Furthermore, the relationship between these related keywords may be semantic rather than syntactic, and capturing it thus requires access to comprehensive human world knowledge. Concept-based retrieval methods have attempted to tackle these difficulties by using manually built thesauri, by relying on term cooccurrence data, or by extracting latent word relationships and concepts from a corpus. In this article we introduce a new concept-based retrieval approach based on Explicit Semantic Analysis (ESA), a recently proposed method that augments keyword-based text representation with concept-based features, automatically extracted from massive human knowledge repositories such as Wikipedia. Our approach generates new text features automatically, and we have found that high-quality feature selection becomes crucial in this setting to make the retrieval more focused. However, due to the lack of labeled data, traditional feature selection methods cannot be used, hence we propose new methods that use self-generated labeled training data. The resulting system is evaluated on several TREC datasets, showing superior performance over previous state-of-the-art results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
A Comparative Study on Feature Selection in Text Categorization
Yang, Y., & Pedersen, J. (1997) · Cited by 4,790
Introduction to WordNet: An On-line Lexical Database*
Miller, G. A., Beckwith, R., Fellbaum, C., Gross, D., & Miller, K. J. (1990) · International Journal of Lexicography · doi:10.1093/ijl/3.4.235 · Cited by 4,197
Probabilistic Latent Semantic Indexing
Hofmann, T. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130370 · Cited by 3,988
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
Relevance feedback in information retrieval
Rocchio, J. J. (1971) · Medical Entomology and Zoology · Cited by 2,680
Irrelevant Features and the Subset Selection Problem
John, G. H., Kohavi, R., & Pfleger, K. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50023-4 · Cited by 2,368
Computing semantic relatedness using Wikipedia-based explicit semantic analysis
Gabrilovich, E., & Markovitch, S. (2007) · Cited by 1,981
Self-citationThe vocabulary problem in human-system communication
Furnas, G. W., Landauer, T. K., Gomez, L. M., & Dumais, S. T. (1987) · Communications of the ACM · doi:10.1145/32206.32212 · Cited by 1,504
Improving retrieval performance by relevance feedback
Salton, G., & Buckley, C. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199006)41:4<288::aid-asi8>3.0.co;2-h · Cited by 1,495
LDA-based document models for ad-hoc retrieval
Wei, X., & Croft, W. B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148204 · Cited by 1,075
Query Expansion using Lexical-Semantic Relations
Voorhees, E. M. (1994) · SIGIR ’94 · doi:10.1007/978-1-4471-2099-5_7 · Cited by 947
Induction of decision trees. Machine Learning
Quinlan, J. R. (1986) · Symposium on the Theory of Computing · Cited by 809
Qiu, Y., & Frei, H.-P. (1993) · Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '93 · doi:10.1145/160688.160713 · Cited by 712
Cronen-Townsend, S., Zhou, Y., & Croft, W. B. (2002) · Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/564376.564429 · Cited by 663
Pachinko allocation: DAG-structured mixture models of topic correlations
Li, W., & McCallum, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143917 · Cited by 609
How reliable are the results of large-scale information retrieval experiments?
Zobel, J. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291014 · Cited by 579 · cited 2×
“However, research has shown that the use of pooling could discriminate against a new method that is based on novel principles [Zobel 1998], and it has been recommended that researchers consider the number of unjudged documents being fetched as an indication that performance is probably being underestimated.”
MethodImproving automatic query expansion
Mitra, M., Singhal, A., & Buckley, C. (1998) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/290941.290995 · Cited by 557
Improving the effectiveness of information retrieval with local context analysis
Xu, J., & Croft, W. B. (2000) · ACM Transactions on Information Systems · doi:10.1145/333135.333138 · Cited by 533
Gabrilovich, E., & Markovitch, S. (2006) · National Conference on Artificial Intelligence · Cited by 469
Self-citationVoorhees, E. M. (2001) · doi:10.1002/https://dx.doi.org/10.6028/nist.sp.500-266 · Cited by 462
Using WordNet to disambiguate word senses for text retrieval
Voorhees, E. M. (1993) · Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '93 · doi:10.1145/160688.160715 · Cited by 442
Passage-level evidence in document retrieval
Callan, J. P. (1994) · doi:10.5555/188490.188589 · Cited by 414
An Adaptation of the Vector-Space Model for Ontology-Based Information Retrieval
Castells, P., Fernandez, M., & Vallet, D. (2007) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.22 · Cited by 412
A survey on the use of relevance feedback for information access systems
RUTHVEN, I., & LALMAS, M. (2003) · The Knowledge Engineering Review · doi:10.1017/s0269888903000638 · Cited by 401
Indexing with WordNet synsets can improve Text Retrieval
Gonzalo, J. A., Verdejo, F., Chugur, I., & Cigarran, J. M. (1998) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9808002 · Cited by 337
The eighth text REtrieval conference (TREC-8)
(2000) · doi:10.6028/nist.sp.500-246 · Cited by 336
Robertson, S. E., & Walker, S. (1999) · Cited by 314
Fusion Via a Linear Combination of Scores
Vogt, C. C., & Cottrell, G. W. (1999) · Information Retrieval · doi:10.1023/a:1009980820262 · Cited by 311
Overview of the Eighth Text REtrieval Conference (TREC-8).
Voorhees, E. M., & Harman, D. K. (1999) · Cited by 303
Improvements that don't add up: ad-hoc retrieval results since 1998
Armstrong, T. G., Moffat, A., Webber, W., & Zobel, J. (2009) · Proceedings of the 18th ACM conference on Information and knowledge management · doi:10.1145/1645953.1646031 · Cited by 234
Importance of semantic representation: dataless classification
Chang, M., Ratinov, L., Roth, D., & Srikumar, V. (2008) · National Conference on Artificial Intelligence · Cited by 229
Latent Semantic Indexing (LSI) and TREC-2.
Dumais, S. (1993) · Cited by 205
Combining Approaches to Information Retrieval
Croft, W. B. (2005) · The Information Retrieval Series · doi:10.1007/0-306-47019-5_1 · Cited by 203
Combining multiple evidence from different properties of weighting schemes
Lee, J. H. (1995) · Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '95 · doi:10.1145/215206.215358 · Cited by 201
Word sense disambiguation in information retrieval revisited
Stokoe, C., Oakes, M., & Tait, J. I. (2003) · doi:10.1145/860435.860466 · Cited by 194
Passage retrieval based on language models
Liu, X., & Croft, W. B. (2002) · Proceedings of the eleventh international conference on Information and knowledge management · doi:10.1145/584792.584854 · Cited by 190
Overview of the Seventh Text REtrieval Conference
Voorhees, E. M. (1998) · Text REtrieval Conference · Cited by 187
A Comparative Study of Utilizing Topic Models for Information Retrieval
Yi, X., & Allan, J. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-00958-7_6 · Cited by 166
A knowledge-based search engine powered by wikipedia
Milne, D. N., Witten, I. H., & Nichols, D. M. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321504 · Cited by 162
Pachinko allocation: dag-structured mixture models of topic correlations
McCallum, A., & Li, W. (2007) · Cited by 143
The SMART retrieval system; experiments in automatic document processing
Hayes, R. M. (1973) · Information Processing & Management · doi:10.1016/0020-0271(73)90067-3 · Cited by 136
Sanderson, M. (2000) · Information Retrieval · doi:10.1023/a:1009933700147 · Cited by 130
The Use of WordNet in Information Retrieval.
Mandala, R., Tokunaga, T., & Tanaka, H. (1998) · International Conference on Computational Linguistics · Cited by 111
Learning routing queries in a query zone
Singhal, A., Mitra, M., & Buckley, C. (1997) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/258525.258530 · Cited by 107
Ontology-based Information Retrieval
Bulskov, H. (2006) · RUCforsk (Roskilde University) · Cited by 105
The thirteenth text REtrieval conference, TREC 2004
Voorhees, E. M., & Buckland, L. P. (2005) · doi:10.6028/nist.sp.500-261 · Cited by 94
Overview of the TREC 2004 Robust Track.
Voorhees, E. M. (2004) · Text REtrieval Conference · Cited by 88
Questioning query expansion: an examination of behaviour and parameters
Billerbeck, B., & Zobel, J. (2004) · Cited by 83
Knowledge-based query expansion to support scenario-specific retrieval of medical free text
Liu, Z., & Chu, W. W. (2007) · Information Retrieval · doi:10.1007/s10791-006-9020-6 · Cited by 80
Concept-based feature generation and selection for information retrieval
Egozi, O., Gabrilovich, E., & Markovitch, S. (2008) · Cited by 77
Self-citationArampatzis, A., & Kamps, J. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390517 · Cited by 58
Applying Data Mining to Pseudo-Relevance Feedback for High Performance Text Retrieval
Huang, X., Huang, Y., Wen, M., An, A., Liu, Y., & Poon, J. (2006) · Proceedings · doi:10.1109/icdm.2006.22 · Cited by 46
Text categorization with knowledge transfer from heterogeneous data sources
Gupta, R. K., & Ratinov, L. (2008) · Cited by 43
Knowledge-based query expansion to support scenario-specific retrieval of medical free text
Liu, Z., & Chu, W. W. (2005) · ACM Symposium on Applied Computing · doi:10.1145/1066677.1066922 · Cited by 33
Using Concept-Based Indexing to Improve Language Modeling Approach to Genomic IR
Zhou, X., Zhang, X., & Hu, X. (2006) · Lecture notes in computer science · doi:10.1007/11735106_39 · Cited by 22
The RMIT/CSIRO Ad Hoc, Q&A, Web, Interactive, and Speech Experiments at TREC 8.
Fuller, M. L., Kaszkiel, M., Kimberley, S., Ng, C., Wilkinson, R. G., Wu, M., & Zobel, J. (1999) · Text REtrieval Conference · Cited by 10
Cited by
Textual Analysis in Accounting and Finance: A Survey
LOUGHRAN, T., & MCDONALD, B. (2016) · Journal of Accounting Research · doi:10.1111/1475-679x.12123 · Cited by 2,261
Accurate and effective latent concept modeling for ad hoc information retrieval
Deveaud, R., SanJuan, E., & Bellot, P. (2014) · Document numérique · doi:10.3166/dn.17.1.61-84 · Cited by 609
Query expansion techniques for information retrieval: a survey
Azad, H. K., & Deepak, A. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.05.009 · Cited by 313
Semantics-Aware Content-Based Recommender Systems
de Gemmis, M., Lops, P., Musto, C., Narducci, F., & Semeraro, G. (2015) · Recommender Systems Handbook · doi:10.1007/978-1-4899-7637-6_4 · Cited by 258
Roostaee, M., Sadreddini, M. H., & Fakhrahmad, S. M. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.102150 · Cited by 31
Metadata
- Authors
- Egozi, O., Markovitch, S., & Gabrilovich, E.
- Venue
- ACM Transactions on Information Systems
- Published
- 2011-04
- Volume
- 29
- Issue
- 2
- Pages
- 1-34
- ISSN
- 1046-8188 (ISSN-L)
- 1558-2868
- OpenAlex
- W2099868020
- Cited by
- 277
- References
- 60
- FWCI
- 79.53
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.