The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Relevance-Based Language Models
Abstract
We explore the relation between classical probabilistic models of information retrieval and the emerging language modeling approaches. It has long been recognized that the primary obstacle to effective performance of classical models is the need to estimate a relevance model: probabilities of words in the relevant class. We propose a novel technique for estimating these probabilities using the query alone. We demonstrate that our technique can produce highly accurate relevance models, addressing important notions of synonymy and polysemy. Our experiments show relevance models outperforming baseline language modeling systems on TREC retrieval and TDT tracking tasks. The main contribution of this work is an effective formal method for estimating a relevance model with no training data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The mathematics of statistical machine translation: parameter estimation
Brown, P. F., Pietra, V. J. D., Pietra, S. A. D., & Mercer, R. L. (1993) · Cited by 3,973
A Language Modeling Approach to Information Retrieval
Ponte, J. M., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130368 · Cited by 2,503
Self-citationRobertson, S. E., Walker, S., Jones, S., Hancock‐Beaulieu, M., & Gatford, M. (1994) · Text REtrieval Conference · Cited by 2,212
Relevance weighting of search terms
Robertson, S. E., & Jones, K. S. (1976) · Journal of the American Society for Information Science · doi:10.1002/asi.4630270302 · Cited by 2,081
A language modeling approach to information retrieval
Ponte, J. M., & Croft, W. B. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291008 · Cited by 1,821
Self-citationSome Simple Effective Approximations to the 2-Poisson Model for Probabilistic Weighted Retrieval
Robertson, S. E., & Walker, S. (1994) · SIGIR ’94 · doi:10.1007/978-1-4471-2099-5_24 · Cited by 1,477
The DET curve in assessment of detection task performance
Martin, A., Doddington, G., Kamm, T., Ordowski, M., & Przybocki, M. (1997) · 5th European Conference on Speech Communication and Technology (Eurospeech 1997) · doi:10.21437/eurospeech.1997-504 · Cited by 1,384
THE PROBABILITY RANKING PRINCIPLE IN IR
ROBERTSON, S. E. (1977) · Journal of Documentation · doi:10.1108/eb026647 · Cited by 1,103
An empirical study of smoothing techniques for language modeling
Chen, S. F., & Goodman, J. (1996) · Proceedings of the 34th annual meeting on Association for Computational Linguistics - · doi:10.3115/981863.981904 · Cited by 770
Statistical Models for Text Segmentation
Beeferman, D., Berger, A., & Lafferty, J. (1999) · Machine Learning · doi:10.1023/a:1007506220214 · Cited by 680
Cited by
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,866
Understanding inverse document frequency: on theoretical arguments for IDF
Robertson, S. (2004) · Journal of Documentation · doi:10.1108/00220410410560582 · Cited by 1,541
A Study of Smoothing Methods for Language Models Applied to Ad Hoc Information Retrieval
Zhai, C., & Lafferty, J. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130377 · Cited by 1,537
A study of smoothing methods for language models applied to information retrieval
Zhai, C., & Lafferty, J. (2004) · ACM Transactions on Information Systems · doi:10.1145/984321.984322 · Cited by 1,201
Automatic image annotation and retrieval using cross-media relevance models
Jeon, J., Lavrenko, V., & Manmatha, R. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860459 · Cited by 1,139
Self-citationA Survey of Automatic Query Expansion in Information Retrieval
Carpineto, C., & Romano, G. (2012) · ACM Computing Surveys · doi:10.1145/2071389.2071390 · Cited by 1,109
LDA-based document models for ad-hoc retrieval
Wei, X., & Croft, W. B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148204 · Cited by 1,075
Self-citationInterpreting TF-IDF term weights as making relevance decisions
Wu, H. C., Luk, R. W. P., Wong, K. F., & Kwok, K. L. (2008) · ACM Transactions on Information Systems · doi:10.1145/1361684.1361686 · Cited by 821
Model-based feedback in the language modeling approach to information retrieval
Zhai, C., & Lafferty, J. (2001) · Proceedings of the tenth international conference on Information and knowledge management · doi:10.1145/502585.502654 · Cited by 787
A Survey of Techniques for Event Detection in Twitter
Atefeh, F., & Khreich, W. (2015) · Computational Intelligence · doi:10.1111/coin.12017 · Cited by 717
Translation techniques in cross-language information retrieval
Zhou, D., Truran, M., Brailsford, T., Wade, V., & Ashman, H. (2012) · ACM Computing Surveys · doi:10.1145/2379776.2379777 · Cited by 698
Cronen-Townsend, S., Zhou, Y., & Croft, W. B. (2002) · Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/564376.564429 · Cited by 663
Self-citationA Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Shen, Y., He, X., Gao, J., Deng, L., & Mesnil, G. (2014) · Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management · doi:10.1145/2661829.2661935 · Cited by 661
Accurate and effective latent concept modeling for ad hoc information retrieval
Deveaud, R., SanJuan, E., & Bellot, P. (2014) · Document numérique · doi:10.3166/dn.17.1.61-84 · Cited by 609
Cluster-based retrieval using language models
Liu, X., & Croft, W. B. (2004) · Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1008992.1009026 · Cited by 448
Self-citationFinding similar questions in large question and answer archives
Jeon, J., Croft, W. B., & Lee, J. H. (2005) · Proceedings of the 14th ACM international conference on Information and knowledge management · doi:10.1145/1099554.1099572 · Cited by 430
Self-citationSelecting good expansion terms for pseudo-relevance feedback
Cao, G., Nie, J.-Y., Gao, J., & Robertson, S. (2008) · Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1390334.1390377 · Cited by 426
Automatic image annotation and retrieval using cross-media relevance models
Jeon, J., Lavrenko, V. P., & Manmatha, R. (2003) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/860458.860459 · Cited by 417
Self-citationA Deep Look into neural ranking models for information retrieval
Guo, J., Fan, Y., Pang, L., Yang, L., Ai, Q., Zamani, H., Wu, C., Croft, W. B., & Cheng, X. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.102067 · Cited by 349
Self-citationAnserini: Enabling the Use of Lucene for Information Retrieval Research
Yang, P., Fang, H., & Lin, J. (2017) · Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3077136.3080721 · Cited by 319
Query expansion techniques for information retrieval: a survey
Azad, H. K., & Deepak, A. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.05.009 · Cited by 313
Similarity Measures for Short Segments of Text
Metzler, D., Dumais, S., & Meek, C. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-71496-5_5 · Cited by 305
Monolingual and Cross-Lingual Information Retrieval Models Based on (Bilingual) Word Embeddings
Vulić, I., & Moens, M.-F. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767752 · Cited by 294
Statistical Language Models for Information Retrieval A Critical Review
Zhai, C. (2007) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000008 · Cited by 291
Easy Samples First: Self-paced Reranking for Zero-Example Multimedia Search
Jiang, L., Meng, D., Mitamura, T., & Hauptmann, A. G. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654918 · Cited by 271
Entity query feature expansion using knowledge base links
Dalton, J., Dietz, L., & Allan, J. (2014) · Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval · doi:10.1145/2600428.2609628 · Cited by 257
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
Xiong, L., Xiong, C., Li, Y., Tang, K.-F., Liu, J., Bennett, P., Ahmed, J., & Overwijk, A. (2020) · arXiv · doi:10.48550/arxiv.2007.00808 · Cited by 204
Li, X., & Croft, W. B. (2003) · Proceedings of the twelfth international conference on Information and knowledge management · doi:10.1145/956863.956951 · Cited by 161
Self-citationJones, R., & Diaz, F. (2007) · ACM Transactions on Information Systems · doi:10.1145/1247715.1247720 · Cited by 147
Cronen-Townsend, S., & Croft, W. B. (2002) · Proceedings of the second international conference on Human Language Technology Research - · doi:10.3115/1289189.1289266 · Cited by 132
“[17] F. Song and W. B. Croft.”
MethodSelf-citationTask-Oriented Query Reformulation with Reinforcement Learning
Nogueira, R., & Cho, K. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1061 · Cited by 120
“A popular instantiation of a local method is the relevance model, which incorporates pseudo-relevance feedback into a language model form [10].”
MethodInfluentialEstimation methods for ranking recent information
Efron, M., & Golovchinsky, G. (2011) · Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval · doi:10.1145/2009916.2009984 · Cited by 78
A reinforcement learning framework for relevance feedback
Montazeralghaem, A., Zamani, H., & Allan, J. (2020) · Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3397271.3401099 · Cited by 36
Generation-Augmented Retrieval for Open-domain Question Answering
Mao, Y., He, P., Liu, X., Shen, Y., Gao, J., Han, J., & Chen, W. (2020) · arXiv · doi:10.48550/arxiv.2009.08553 · Cited by 31
Benchmark for Complex Answer Retrieval
Nanni, F., Mitra, B., Magnusson, M., & Dietz, L. (2017) · arXiv · doi:10.48550/arxiv.1705.04803 · Cited by 7
Metadata
- Authors
- Lavrenko, V., & Croft, W. B.
- Venue
- ACM SIGIR Forum
- Published
- 2017-08-02
- Volume
- 51
- Issue
- 2
- Pages
- 260-267
- ISSN
- 0163-5840 (ISSN-L)
- OpenAlex
- W2169213601
- Cited by
- 1,422
- References
- 28
- FWCI
- 128.88
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.