The DOI matches its Crossref record.
A STATISTICAL INTERPRETATION OF TERM SPECIFICITY AND ITS APPLICATION IN RETRIEVAL
Abstract
Abstract: The exhaustivity of document descriptions and the specificity of index terms are usually regarded as independent. It is suggested that specificity should be interpreted statistically, as a function of term use rather than of term meaning. The effects on retrieval of variations in term specificity are examined, experiments with three test collections showing, in particular, that frequently-occurring terms are required for good overall performance. It is argued that terms should be weighted according to collection frequency, so that matches on less frequent, more specific, terms are of greater value than matches on frequent terms. Results for the test collections show that considerable improvements in performance are obtained with this very simple procedure. Exhaustivity and specificity We are familiar with the notions of exhaustivity and specificity: exhaustivity is a property of index descriptions, and specificity one of index terms. They are most clearly illustrated by a simple keyword or descriptor system. In this case the exhaustivity of a document description is the coverage of its various topics given by the terms assigned to it; and the specificity of an individual term is the level of detail at which a given concept is represented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 10
- AITCHISON T. M., 1970, Comparative evaluation of index languages, Part II
- 10.1002/asi.4630200304 · DOI
- BORKO H., 1968, Mechanised information storage, retrieval and dissemination
- CLEVERDON C. W., 1966, Cranfield
- CURTICE R. M., 1969, P. E. An operational interactive retrieval system
- LANCASTER F.W., 1968, characteristics, testing and evaluation
- SALTON G., 1968, Automatic information organization and retrieval
- 10.1145/321439.321441 · DOI
- SPARCK JONES K., 1971, Automatic keyword classificationfor information retrieval
- 10.1002/asi.5090180209 · DOI
Cited by
A vector space model for automatic indexing
Salton, G., Wong, A., & Yang, C. S. (1975) · Communications of the ACM · doi:10.1145/361219.361220 · Cited by 7,521
The vocabulary problem in human-system communication
Furnas, G. W., Landauer, T. K., Gomez, L. M., & Dumais, S. T. (1987) · Communications of the ACM · doi:10.1145/32206.32212 · Cited by 1,504
An information-theoretic perspective of tf–idf measures
Aizawa, A. (2003) · Information Processing & Management · doi:10.1016/s0306-4573(02)00021-3 · Cited by 1,419
A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models
Fan, W., Ding, Y., Ning, L., Wang, S., Li, H., Yin, D., Chua, T.-S., & Li, Q. (2024) · Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3637528.3671470 · Cited by 827
Automated Text Analysis for Consumer Research
Humphreys, A., & Wang, R. J.-H. (2018) · Journal of Consumer Research · doi:10.1093/jcr/ucx104 · Cited by 636
Supervised classification enables rapid annotation of cell atlases
Pliner, H. A., Shendure, J., & Trapnell, C. (2019) · doi:10.1101/538652 · Cited by 498
Shifting the refugee narrative? An automated frame analysis of Europe’s 2015 refugee crisis
Greussing, E., & Boomgaarden, H. G. (2017) · Journal of Ethnic and Migration Studies · doi:10.1080/1369183x.2017.1282813 · Cited by 464
Can AI Help Reduce Disparities in General Medical and Mental Health Care?
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.167 · Cited by 401
Semi-automated screening of biomedical citations for systematic reviews
Wallace, B. C., Trikalinos, T. A., Lau, J., Brodley, C., & Schmid, C. H. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-55 · Cited by 351
Sparse, Dense, and Attentional Representations for Text Retrieval
Luan, Y., Eisenstein, J., Toutanova, K., & Collins, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00369 · Cited by 363
BARTScore: Evaluating Generated Text as Text Generation
Yuan, W., Neubig, G., & Liu, P. (2021) · arXiv · doi:10.48550/arxiv.2106.11520 · Cited by 353
Bridging the Gap: A Pragmatic Approach to Generating Insider Threat Data
Glasser, J., & Lindauer, B. (2013) · 2013 IEEE Security and Privacy Workshops · doi:10.1109/spw.2013.37 · Cited by 344
DeepFL: integrating multiple fault diagnosis dimensions for deep fault localization
Li, X., Li, W., Zhang, Y., & Zhang, L. (2019) · Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3293882.3330574 · Cited by 336
Real-Time Visual SLAM for Autonomous Underwater Hull Inspection Using Visual Saliency
Kim, A., & Eustice, R. M. (2013) · IEEE Transactions on Robotics · doi:10.1109/tro.2012.2235699 · Cited by 263
Fuzzy bag-of-words model for document representation
Zhao, R., & Mao, K. (2018) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2017.2690222 · Cited by 252
The effect of sampling temperature on problem solving in large language models
Renze, M. (2024) · Findings of the Association for Computational Linguistics: EMNLP 2024 · doi:10.18653/v1/2024.findings-emnlp.432 · Cited by 212
Tsintotas, K. A., Bampis, L., & Gasteratos, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3175656 · Cited by 175
“inverse-document-frequency (TF-IDF) scheme [191] has been adopted to weight each database element.”
MethodA survey on aspect-based sentiment classification
Brauwers, G., & Frasincar, F. (2023) · ACM Computing Surveys · doi:10.1145/3503044 · Cited by 165
Takahashi, T., & Igata, N. (2012) · The 6th International Conference on Soft Computing and Intelligent Systems, and The 13th International Symposium on Advanced Intelligence Systems · doi:10.1109/scis-isis.2012.6505254 · Cited by 131
CommunityCommands: command recommendations for software applications
Matejka, J., Li, W., Grossman, T., & Fitzmaurice, G. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622214 · Cited by 125
Fairness and Bias in Algorithmic Hiring: A Multidisciplinary Survey
Fabris, A., Baranowska, N., Dennis, M. J., Graus, D., Hacker, P., Saldivar, J., Zuiderveen Borgesius, F., & Biega, A. J. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3696457 · Cited by 117
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
Yang, J., Bisk, Y., & Gao, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01136 · Cited by 115
Distilling Knowledge from Reader to Retriever for Question Answering
Izacard, G., & Grave, E. (2020) · arXiv · doi:10.48550/arxiv.2012.04584 · Cited by 102
Loop closure detection in SLAM by combining visual and spatial appearance
Ho, K. L., & Newman, P. (2006) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2006.04.016 · Cited by 93
The landscape of biomedical research
González-Márquez, R., Schmidt, L., Schmidt, B. M., Berens, P., & Kobak, D. (2024) · Patterns · doi:10.1016/j.patter.2024.100968 · Cited by 89
Global Model Interpretation Via Recursive Partitioning
Yang, C., Rangarajan, A., & Ranka, S. (2018) · 2018 IEEE 20th International Conference on High Performance Computing and Communications; IEEE 16th International Conference on Smart City; IEEE 4th International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc/smartcity/dss.2018.00256 · Cited by 93
The search dashboard: how reflection and comparison impact search behavior
Bateman, S., Teevan, J., & White, R. W. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208311 · Cited by 69
SceneSkim: Searching and Browsing Movies Using Synchronized Captions, Scripts and Plot Summaries
Pavel, A., Goldman, D. B., Hartmann, B., & Agrawala, M. (2015) · Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology · doi:10.1145/2807442.2807502 · Cited by 67
Uncovering Trajectories of Informal Learning in Large Online Communities of Creators
Yang, S., Domeniconi, C., Revelle, M., Sweeney, M., Gelman, B. U., Beckley, C., & Johri, A. (2015) · Proceedings of the Second (2015) ACM Conference on Learning @ Scale · doi:10.1145/2724660.2724674 · Cited by 60
Interactive Intent Modeling for Exploratory Search
Ruotsalo, T., Peltonen, J., Eugster, M. J. A., Głowacka, D., Floréen, P., Myllymäki, P., Jacucci, G., & Kaski, S. (2018) · ACM Transactions on Information Systems · doi:10.1145/3231593 · Cited by 57
Do, R. K. G., Lupton, K., Causa Andrieu, P. I., Luthra, A., Taya, M., Batch, K., Nguyen, H., Rahurkar, P., Gazit, L., Nicholas, K., et al. (2021) · Radiology · doi:10.1148/radiol.2021210043 · Cited by 54
Hjørland, B. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23250 · Cited by 47
A Review of Current Trends, Techniques, and Challenges in Large Language Models (LLMs)
Patil, R., & Gudivada, A. V. (2024) · doi:10.20944/preprints202402.0357.v1 · Cited by 296
Power Law Distributions in Information Retrieval
Petersen, C., Simonsen, J. G., & Lioma, C. (2016) · ACM Transactions on Information Systems · doi:10.1145/2816815 · Cited by 46
Clay, B., Bergman, H. I., Salim, S., Pergola, G., Shalhoub, J., & Davies, A. H. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109808 · Cited by 41
Four Text‐Mining Methods for Measuring Elaboration
Dumas, D., Organisciak, P., Maio, S., & Doherty, M. (2021) · The Journal of Creative Behavior · doi:10.1002/jocb.471 · Cited by 38
Online grooming detection: A comprehensive survey of child exploitation in chat logs
Borj, P. R., Raja, K., & Bours, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110039 · Cited by 38
RevMiner: an extractive interface for navigating reviews on a smartphone
Huang, J., Etzioni, O., Zettlemoyer, L., Clark, K., & Lee, C. (2012) · Proceedings of the 25th annual ACM symposium on User interface software and technology · doi:10.1145/2380116.2380120 · Cited by 37
“Math word problem generation with mathematical consistency and problem context constraints,”
Wang, Z., Lan, A., & Baraniuk, R. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.484 · Cited by 39
RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval
Sarthi, P., Abdullah, S., Tuli, A., Khanna, S., Goldie, A., & Manning, C. D. (2024) · arXiv · doi:10.48550/arxiv.2401.18059 · Cited by 36
Neural Retrievers are Biased Towards LLM-Generated Content
Dai, S., Zhou, Y., Pang, L., Liu, W., Hu, X., Liu, Y., Zhang, X., Wang, G., & Xu, J. (2024) · Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3637528.3671882 · Cited by 35
Guo, P., Xue, H., Ma, J., & Cheng, J. C. P. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106374 · Cited by 31
Critical Search: A Procedure for Guided Reading in Large-Scale Textual Corpora
Guldi, J. (2018) · Journal of Cultural Analytics · doi:10.22148/16.030 · Cited by 23
Mining Free-Text Medical Notes for Suicide Risk Assessment
Adamou, M., Antoniou, G., Greasidou, E., Lagani, V., Charonyktakis, P., & Tsamardinos, I. (2018) · Proceedings of the 10th Hellenic Conference on Artificial Intelligence · doi:10.1145/3200947.3201020 · Cited by 22
Zeng, H., Luo, C., & Zamani, H. (2024) · Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3626772.3657746 · Cited by 22
Chen, Q., Du, J., Kim, S., Wilbur, W. J., & Lu, Z. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-1044-0 · Cited by 19
A language framework for modeling social media account behavior
Nwala, A. C., Flammini, A., & Menczer, F. (2023) · EPJ Data Science · doi:10.1140/epjds/s13688-023-00410-9 · Cited by 31
Uyeda, A. M., Curtis, J. R., Engelberg, R. A., Brumback, L. C., Guo, Y., Sibley, J., Lober, W. B., Cohen, T., Torrence, J., Heywood, J., et al. (2022) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2022.02.006 · Cited by 19
Predatory Conversation Detection
Borj, P. R., & Bours, P. (2019) · 2019 International Conference on Cyber Security for Emerging Technologies (CSET) · doi:10.1109/cset.2019.8904885 · Cited by 19
A Systematic Comparison of Large Language Models Performance for Intrusion Detection
Bui, M.-T., Boffa, M., Valentim, R. V., Navarro, J. M., Chen, F., Bao, X., Houidi, Z. B., & Rossi, D. (2024) · Proceedings of the ACM on Networking · doi:10.1145/3696379 · Cited by 19
Dense and influential core promotion of daily viral information spread in political echo chambers
Asatani, K., Yamano, H., Sakaki, T., & Sakata, I. (2021) · Scientific Reports · doi:10.1038/s41598-021-86750-w · Cited by 18
Online perceptual learning and natural language acquisition for autonomous robots
Alomari, M., Li, F., Hogg, D. C., & Cohn, A. G. (2022) · Artificial Intelligence · doi:10.1016/j.artint.2021.103637 · Cited by 17
North, S., Piwek, L., & Joinson, A. (2021) · Policy & Internet · doi:10.1002/poi3.247 · Cited by 16
Jones, K. S. (2005) · Computational Linguistics · doi:10.1162/0891201053630237 · Cited by 15
Self-citationGubanov, M., Pyayt, A., & Karolak, A. (2024) · Proceedings of the 33rd ACM International Conference on Information and Knowledge Management · doi:10.1145/3627673.3680094 · Cited by 10
Structural motif search across the protein universe with Folddisco
Kim, H., Kim, R. S., Mirdita, M., Yoon, J., & Steinegger, M. (2026) · Nature Biotechnology · doi:10.1038/s41587-026-03162-9 · Cited by 10
Riviera, E. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23248 · Cited by 9
Kazi, S., Khoja, S., & Daud, A. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100756 · Cited by 9
Fine-tuning BERT Models for Summarizing German Radiology Findings
Liang, S., Kades, K., Fink, M., Full, P., Weber, T., Kleesiek, J., Strube, M., & Maier-Hein, K. (2022) · Proceedings of the 4th Clinical Natural Language Processing Workshop · doi:10.18653/v1/2022.clinicalnlp-1.4 · Cited by 8
Zep: A Temporal Knowledge Graph Architecture for Agent Memory
Rasmussen, P., Paliychuk, P., Beauvais, T., Ryan, J., & Chalef, D. (2025) · arXiv · doi:10.48550/arxiv.2501.13956 · Cited by 9
“RAG leverages Information Retrieval (IR) techniques pioneered over the last fifty years[2] to supply necessary domain knowledge to LLMs. Current approaches using RAG have focused on broad domain knowledge and largely static corpora—that is, document contents added to a corpus seldom change.”
Human-inspired Perspectives: A Survey on AI Long-term Memory
He, Z., Lin, W., Zheng, H., Zhang, F., Jones, M. W., Aitchison, L., Xu, X., Liu, M., Kristensson, P. O., & Shen, J. (2024) · arXiv · doi:10.48550/arxiv.2411.00489 · Cited by 3
“The following subsections provide a detailed discussion of the storage, retrieval, and forgetting processes of parametric memory.”
SimpleQA Verified: A Reliable Factuality Benchmark to Measure Parametric Knowledge
Haas, L., Yona, G., D'Antonio, G., Goldshtein, S., & Das, D. (2025) · arXiv · doi:10.48550/arxiv.2509.07968 · Cited by 1
“In a subsequent step, we compute a TF-IDF matrix (Jones, 1972) to find unreasonably similar questions using exact word matches.”
Memory in the Age of AI Agents
Hu, Y., Liu, S., Yue, Y., Zhang, G., Liu, B., Zhu, F., Lin, J., Guo, H., Dou, S., Xi, Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2512.13564 · Cited by 389
AIM review tool: artificial intelligence for smarter systematic review screening
Mena, S., Rituerto-González, E., Coutts, F., von Trott, J., Jacobs, G. R., Bryant, L., Moles, L., Sirbu, N., Promet, L., Oliver, D., et al. (2026) · npj Artificial Intelligence · doi:10.1038/s44387-026-00080-8
“(cid:129) Term frequency-inverse document frequency (TF-IDF; scikit-learn) 42 — default option (cid:129) Latent semantic analysis (LSA; scikit-learn) of TF-IDF using truncated singular value decomposition (cid:129) Universal sentence encoder (univBERT; tensor fl ow.js) 43 (cid:129) Document to…”
Lewis, M., Thio, S., Roberts, A., Siju, C., Mukit, W., Kuruvilla, R., Jiang, Z. J., Möller-Grell, N., Borakati, A., Dobson, R. J., et al. (2025) · arXiv · doi:10.48550/arxiv.2510.02967
“BM25 builds upon the Term Frequency-Inverse Document Frequency (TF-IDF) (Sparck Jones, 1972) model to score the relevance of documents to a given query.”
Metadata
- Authors
- SPARCK JONES, K.
- Venue
- Journal of Documentation
- Publisher
- Emerald
- Published
- 1972-01
- Volume
- 28
- Issue
- 1
- Pages
- 11-21
- ISSN
- 0022-0418 (ISSN-L)
- OpenAlex
- W2144211451
- Cited by
- 4,505
- References
- 0
- FWCI
- 42.98
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
