The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Relevance based language models
Abstract
We explore the relation between classical probabilistic models of information retrieval and the emerging language modeling approaches. It has long been recognized that the primary obstacle to effective performance of classical models is the need to estimate arelevance model: probabilities of words in the relevant class. We propose a novel technique for estimating these probabilities using the query alone. We demonstrate that our technique can produce highly accurate relevance models, addressing important notions of synonymy and polysemy. Our experiments show relevance models outperforming baseline language modeling systems on TREC retrieval and TDT tracking tasks. The main contribution of this work is an effective formal method for estimating a relevance model with no training data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The mathematics of statistical machine translation: parameter estimation
Brown, P. F., Pietra, V. J. D., Pietra, S. A. D., & Mercer, R. L. (1993) · Cited by 3,973
A language modeling approach to information retrieval
Ponte, J. M., & Croft, W. B. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291008 · Cited by 1,821
Self-citationSome Simple Effective Approximations to the 2-Poisson Model for Probabilistic Weighted Retrieval
Robertson, S. E., & Walker, S. (1994) · SIGIR ’94 · doi:10.1007/978-1-4471-2099-5_24 · Cited by 1,477
The DET curve in assessment of detection task performance
Martin, A., Doddington, G., Kamm, T., Ordowski, M., & Przybocki, M. (1997) · 5th European Conference on Speech Communication and Technology (Eurospeech 1997) · doi:10.21437/eurospeech.1997-504 · Cited by 1,384
Computational linguistics in 1990
Karlgren, H. (1990) · Proceedings of the 13th conference on Computational linguistics - · doi:10.3115/992507.992531 · Cited by 1,243
An empirical study of smoothing techniques for language modeling
Chen, S. F., & Goodman, J. (1996) · Proceedings of the 34th annual meeting on Association for Computational Linguistics - · doi:10.3115/981863.981904 · Cited by 770
Statistical Models for Text Segmentation
Beeferman, D., Berger, A., & Lafferty, J. (1999) · Machine Learning · doi:10.1023/a:1007506220214 · Cited by 680
Improving the effectiveness of information retrieval with local context analysis
Xu, J., & Croft, W. B. (2000) · ACM Transactions on Information Systems · doi:10.1145/333135.333138 · Cited by 533
Self-citationOn-line new event detection and tracking
Allan, J., Papka, R., & Lavrenko, V. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.290954 · Cited by 530
Self-citationA THEORETICAL BASIS FOR THE USE OF CO‐OCCURRENCE DATA IN INFORMATION RETRIEVAL
van Rijsbergen, C. J. (1977) · Journal of Documentation · doi:10.1108/eb026637 · Cited by 474
A hidden Markov model information retrieval system
Miller, D. R. H., Leek, T., & Schwartz, R. M. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312680 · Cited by 469
Information retrieval as statistical translation
Berger, A., & Lafferty, J. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312681 · Cited by 396
Bridging the lexical chasm: statistical approaches to answer-finding
Berger, A., Caruana, R., Cohn, D., Freitag, D., & Mittal, V. (2000) · Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/345508.345576 · Cited by 304
A general language model for information retrieval (poster abstract)
Song, F., & Croft, W. B. (1999) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/312624.312698 · Cited by 146
Self-citationOCELOT: a system for summarizing Web pages
Berger, A. L., & Mittal, V. O. (2000) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/345508.345565 · Cited by 145
Proceedings of the 1999 DARPA Broadcast News Workshop
Christie, J., Ellis, D. P. W., Fosler‐Lussier, E., Gotoh, Y., Kingsbury, B. E. D., Morgan, N. H., Renals, S. J., Robinson, T., & Williams, G. L. (1999) · Cited by 129
Efficient probabilistic inference for text retrieval
Turtle, H. R., & Croft, W. B. (1991) · Cited by 74
Self-citation
Cited by
The probabilistic relevance framework: BM25 and beyond
Robertson, S., & Zaragoza, H. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000019 · Cited by 3,374
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,866
Automatic image annotation and retrieval using cross-media relevance models
Jeon, J., Lavrenko, V., & Manmatha, R. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860459 · Cited by 1,139
Self-citationA Survey of Automatic Query Expansion in Information Retrieval
Carpineto, C., & Romano, G. (2012) · ACM Computing Surveys · doi:10.1145/2071389.2071390 · Cited by 1,109
LDA-based document models for ad-hoc retrieval
Wei, X., & Croft, W. B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148204 · Cited by 1,075
Self-citation
Metadata
- Authors
- Lavrenko, V., & Croft, W. B.
- Venue
- Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
- Publisher
- ACM
- Published
- 2001-09
- Pages
- 120-127
- OpenAlex
- W4246858749
- Cited by
- 1,037
- References
- 17
- FWCI
- 13.65
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.