The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
UMass at TREC 2004: Novelty and HARD
Abstract
For the TREC 2004 Novelty track, UMass participated in all four tasks. Although finding relevant sentences was harder this year than last, we continue to show marked improvements over the baseline of calling all sentences relevant, with a variant of tfidf being the most successful approach. We achieve 5–9%improvements over the baseline in locating novel sentences, primarily by looking at the similarity of a sentence to earlier sentences and focusing on named entities. For the High Accuracy Retrieval from Documents (HARD) track, we investigated the use of clarification forms, fixed- and variable-length passage retrieval, and the use of metadata. Clarification form results indicate that passage level feedback can provide improvements comparable to user supplied related-text for document evaluation and outperforms related-text for passage evaluation. Document retrieval methods without a query expansion component show themost gains fromrelated-text. We also found that displaying the top passages for feedback outperformed displaying centroid passages. Named entity feedback resulted in mixed performance. Our primary findings for passage retrieval are that document retrieval methods performed better than passage retrieval methods on the passage evaluation metric of binary preference at 12,000 characters, and that clarification forms improved passage retrieval for every retrieval method explored. We found no benefit to using variable-length passages over fixed-length passages for this corpus. Our use of geography and genremetadata resulted in no significant changes in retrieval performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Making Large-Scale SVM Learning Practical
Joachims, T. (1998) · RePEc: Research Papers in Economics · doi:10.17877/de290r-14262 · Cited by 4,411
A re-examination of text categorization methods
Yang, Y., & Liu, X. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312647 · Cited by 2,652
A Language Modeling Approach to Information Retrieval
Ponte, J. M., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130368 · Cited by 2,503
Self-citationA language modeling approach to information retrieval
Ponte, J. M., & Croft, W. B. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291008 · Cited by 1,821
Self-citationInductive learning algorithms and representations for text categorization
Dumais, S., Platt, J., Heckerman, D., & Sahami, M. (1998) · Proceedings of the seventh international conference on Information and knowledge management · doi:10.1145/288627.288651 · Cited by 1,461
A study of smoothing methods for language models applied to information retrieval
Zhai, C., & Lafferty, J. (2004) · ACM Transactions on Information Systems · doi:10.1145/984321.984322 · Cited by 1,201
An Algorithm that Learns What's in a Name
Bikel, D. M., Schwartz, R., & Weischedel, R. M. (1999) · Machine Learning · doi:10.1023/a:1007558221122 · Cited by 776
Document Language Models, Query Models, and Risk Minimization for Information Retrieval
Lafferty, J., & Zhai, C. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130375 · Cited by 754
Viewing morphology as an inference process
Krovetz, R. (1993) · Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '93 · doi:10.1145/160688.160718 · Cited by 656
Document language models, query models, and risk minimization for information retrieval
Lafferty, J., & Zhai, C. (2001) · Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/383952.383970 · Cited by 530
Passage-level evidence in document retrieval
Callan, J. P. (1994) · doi:10.5555/188490.188589 · Cited by 414
Language Modeling for Information Retrieval
(2003) · Springer eBooks · doi:10.1007/978-94-017-0171-6 · Cited by 371
Automatic detection of text genre
Kessler, B., Numberg, G., & Schütze, H. (1997) · Proceedings of the 35th annual meeting on Association for Computational Linguistics - · doi:10.3115/976909.979622 · Cited by 358
Recognizing text genres with simple metrics using discriminant analysis
Karlgren, J., & Cutting, D. (1994) · Proceedings of the 15th conference on Computational linguistics - · doi:10.3115/991250.991324 · Cited by 293
Discriminative models for information retrieval
Nallapati, R. (2004) · Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1008992.1009006 · Cited by 285
A statistical learning learning model of text classification for support vector machines
Joachims, T. (2001) · Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/383952.383974 · Cited by 224
Text classification and named entities for new event detection
Kumaran, G., & Allan, J. (2004) · Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1008992.1009044 · Cited by 220
Self-citationAutomatic Detection of Text Genre
Kessler, B., Nunberg, G., & Schuetze, H. (1997) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9707002 · Cited by 204
Learning to classify documents according to genre
Finn, A., & Kushmerick, N. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20427 · Cited by 203
Re-examining the potential effectiveness of interactive query expansion
Ruthven, I. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860475 · Cited by 178
Text genre detection using common word frequencies
Stamatatos, E., Fakotakis, N., & Kokkinakis, G. (2000) · Proceedings of the 18th conference on Computational linguistics - · doi:10.3115/992730.992763 · Cited by 166
Li, X., & Croft, W. B. (2003) · Proceedings of the twelfth international conference on Information and knowledge management · doi:10.1145/956863.956951 · Cited by 161
Self-citationA Generative Theory of Relevance
Lavrenko, V. P. (2008) · The Kluwer international series on information retrieval · doi:10.1007/978-3-540-89364-6 · Cited by 133
On predicting rare classes with SVM ensembles in scene classification
Yan, R., Liu, Y., Jin, R., & Hauptmann, A. G. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2003.1199097 · Cited by 133
Larkey, L. S., Ogilvie, P., Price, M. A., & Tamilio, B. (2000) · doi:10.1145/336597.336664 · Cited by 109
Self-citationUsing temporal profiles of queries for precision prediction
Díaz, F., & Jones, R. (2004) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1008992.1008998 · Cited by 100
Document and Passage Retrieval Based on Hidden Markov Models
Mittendorf, E., & Scháuble, P. (1994) · Springer eBooks · doi:10.1007/978-1-4471-2099-5_33 · Cited by 95
Effective document presentation with a locality-based similarity heuristic
de Kretser, O., & Moffat, A. (1999) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/312624.312664 · Cited by 73
Kaszkiel, M., & Zobel, J. (1997) · ACM SIGIR Forum · doi:10.1145/278459.258561 · Cited by 53
Language Modeling for Information Retrieval
Sigurbjörnsson, B. (2004) · Journal of Logic Language and Information · doi:10.1007/s10849-004-3356-3 · Cited by 24
Li, X., & Croft, W. B. (2003) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/956950.956951 · Cited by 24
Self-citationAn Answer Updating Approach to Novelty Detection
Li, X. (2004) · Cited by 4
Self-citation
Cited by
An Introduction to Neural Information Retrieval
Mitra, B., & Craswell, N. (2018) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000061 · Cited by 317
Generation-Augmented Retrieval for Open-Domain Question Answering
Mao, Y., He, P., Liu, X., Shen, Y., Gao, J., Han, J., & Chen, W. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.316 · Cited by 146
Overview of the TREC 2020 Deep Learning Track
Craswell, N., Mitra, B., Yilmaz, E., & Campos, D. (2021) · arXiv · doi:10.48550/arxiv.2102.07662 · Cited by 107
Overview of the TREC 2019 deep learning track
Craswell, N., Mitra, B., Yilmaz, E., Campos, D., & Voorhees, E. M. (2020) · arXiv · doi:10.48550/arxiv.2003.07820 · Cited by 68
TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime
Craswell, N., Mitra, B., Yilmaz, E., Campos, D., Voorhees, E. M., & Soboroff, I. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3463249 · Cited by 58
Metadata
- Authors
- Abdul-Jaleel, N., Allan, J., Croft, W. B., Diaz, F., Larkey, L., Li, X., Smucker, M. D., & Wade, C.
- Publisher
- Defense Technical Information Center
- Published
- 2004-01-01
- OpenAlex
- W2117473841
- Cited by
- 274
- References
- 33
- Type
- report
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.