The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Relevance-Based Language Models
Abstract
We explore the relation between classical probabilistic models of information retrieval and the emerging language modeling approaches. It has long been recognized that the primary obstacle to effective performance of classical models is the need to estimate a relevance model: probabilities of words in the relevant class. We propose a novel technique for estimating these probabilities using the query alone. We demonstrate that our technique can produce highly accurate relevance models, addressing important notions of synonymy and polysemy. Our experiments show relevance models outperforming baseline language modeling systems on TREC retrieval and TDT tracking tasks. The main contribution of this work is an effective formal method for estimating a relevance model with no training data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The mathematics of statistical machine translation: parameter estimation
Brown, P. F., Pietra, V. J. D., Pietra, S. A. D., & Mercer, R. L. (1993) · Cited by 3,973
A Language Modeling Approach to Information Retrieval
Ponte, J. M., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130368 · Cited by 2,503
Self-citationRobertson, S. E., Walker, S., Jones, S., Hancock‐Beaulieu, M., & Gatford, M. (1994) · Text REtrieval Conference · Cited by 2,212
Relevance weighting of search terms
Robertson, S. E., & Jones, K. S. (1976) · Journal of the American Society for Information Science · doi:10.1002/asi.4630270302 · Cited by 2,081
A language modeling approach to information retrieval
Ponte, J. M., & Croft, W. B. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291008 · Cited by 1,821
Self-citationSome Simple Effective Approximations to the 2-Poisson Model for Probabilistic Weighted Retrieval
Robertson, S. E., & Walker, S. (1994) · SIGIR ’94 · doi:10.1007/978-1-4471-2099-5_24 · Cited by 1,477
The DET curve in assessment of detection task performance
Martin, A., Doddington, G., Kamm, T., Ordowski, M., & Przybocki, M. (1997) · 5th European Conference on Speech Communication and Technology (Eurospeech 1997) · doi:10.21437/eurospeech.1997-504 · Cited by 1,384
THE PROBABILITY RANKING PRINCIPLE IN IR
ROBERTSON, S. E. (1977) · Journal of Documentation · doi:10.1108/eb026647 · Cited by 1,103
An empirical study of smoothing techniques for language modeling
Chen, S. F., & Goodman, J. (1996) · Proceedings of the 34th annual meeting on Association for Computational Linguistics - · doi:10.3115/981863.981904 · Cited by 770
Statistical Models for Text Segmentation
Beeferman, D., Berger, A., & Lafferty, J. (1999) · Machine Learning · doi:10.1023/a:1007506220214 · Cited by 680
On-Line New Event Detection and Tracking
Allan, J., Papka, R., & Lavrenko, V. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130366 · Cited by 646
Self-citationInformation Retrieval as Statistical Translation
Berger, A., & Lafferty, J. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130371 · Cited by 621
An Empirical Study of Smoothing Techniques for Language Modeling
Chen, S. F., & Goodman, J. (1996) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9606011 · Cited by 612
A general language model for information retrieval
Song, F., & Croft, W. B. (1999) · Proceedings of the eighth international conference on Information and knowledge management · doi:10.1145/319950.320022 · Cited by 544
Self-citationImproving the effectiveness of information retrieval with local context analysis
Xu, J., & Croft, W. B. (2000) · ACM Transactions on Information Systems · doi:10.1145/333135.333138 · Cited by 533
Self-citationOn-line new event detection and tracking
Allan, J., Papka, R., & Lavrenko, V. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.290954 · Cited by 530
Self-citationA THEORETICAL BASIS FOR THE USE OF CO‐OCCURRENCE DATA IN INFORMATION RETRIEVAL
van Rijsbergen, C. J. (1977) · Journal of Documentation · doi:10.1108/eb026637 · Cited by 474
A hidden Markov model information retrieval system
Miller, D. R. H., Leek, T., & Schwartz, R. M. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312680 · Cited by 469
Using Language Models for Information Retrieval
Hiemstra, D. (2001) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.570441 · Cited by 448
Information retrieval as statistical translation
Berger, A., & Lafferty, J. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312681 · Cited by 396
Sproat, R., Samuelsson, C., Chu‐Carroll, J., & Carpenter, B. (2003) · The Handbook of Linguistics · doi:10.1002/9780470756409.ch25 · Cited by 376
Bridging the lexical chasm: statistical approaches to answer-finding
Berger, A., Caruana, R., Cohn, D., Freitag, D., & Mittal, V. (2000) · Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/345508.345576 · Cited by 304
A general language model for information retrieval (poster abstract)
Song, F., & Croft, W. B. (1999) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/312624.312698 · Cited by 146
Self-citationOCELOT: a system for summarizing Web pages
Berger, A. L., & Mittal, V. O. (2000) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/345508.345565 · Cited by 145
Proceedings of the 1999 DARPA Broadcast News Workshop
Christie, J., Ellis, D. P. W., Fosler‐Lussier, E., Gotoh, Y., Kingsbury, B. E. D., Morgan, N. H., Renals, S. J., Robinson, T., & Williams, G. L. (1999) · Cited by 129
Topic tracking for radio, TV broadcast, and newswire
Jin, H., Schwartz, R., Sista, S., & Walls, F. G. (1999) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1999-536 · Cited by 100
Efficient probabilistic inference for text retrieval
Turtle, H. R., & Croft, W. B. (1991) · Cited by 74
Self-citationRelating the New Language Models of Information Retrieval to the Traditional Retrieval Models
Hiemstra, D., & de Vries, A. P. (2000) · Cited by 57
Cited by
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,866
Understanding inverse document frequency: on theoretical arguments for IDF
Robertson, S. (2004) · Journal of Documentation · doi:10.1108/00220410410560582 · Cited by 1,541
A Study of Smoothing Methods for Language Models Applied to Ad Hoc Information Retrieval
Zhai, C., & Lafferty, J. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130377 · Cited by 1,537
A study of smoothing methods for language models applied to information retrieval
Zhai, C., & Lafferty, J. (2004) · ACM Transactions on Information Systems · doi:10.1145/984321.984322 · Cited by 1,201
Metadata
- Authors
- Lavrenko, V., & Croft, W. B.
- Venue
- ACM SIGIR Forum
- Published
- 2017-08-02
- Volume
- 51
- Issue
- 2
- Pages
- 260-267
- ISSN
- 0163-5840 (ISSN-L)
- OpenAlex
- W2169213601
- Cited by
- 1,422
- References
- 28
- FWCI
- 128.88
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.