A vector space model for automatic indexing
Open accessAbstract
In a document retrieval, or other pattern matching environment where stored entities (documents) are compared with each other or with incoming patterns (search requests), it appears that the best indexing (property) space is one where each entity lies as far away from the others as possible; in these circumstances the value of an indexing system may be expressible as a function of the density of the object space; in particular, retrieval performance may correlate inversely with space density. An approach based on space density computations is used to choose an optimum indexing vocabulary for a collection of documents. Typical evaluation results are shown, demonstating the usefulness of the model.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The TF-IDF language model is an information retrieval theory that dates back to the mid 1970s.
“The TF-IDF language model, which is used by many AI/ML-based text predicting systems, is actually an information retrieval theory that dates back to the mid 1970s 1,2,3 .”
From Automated Knowledge Organization AI ML based Subject Indexing System for Libraries (2023) · cites this paper as [1]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 3
- Salton, G. Automatic btformation Organiza;ion and Retrieval. McGraw-Hill, New York, 1968, Ch. 4.
- Salton, G. A theory of indexing. Regional Conference Series in Applied Mathematics No. 18, SIAM, Philadelphia, Pa., 1975.
- Salton, G., Yang, C.S., and Yu, C.T. Contribution to the theory of indexing. Proc. 1FIP Congress 74, Stockholm, August 1974. American Elsevier, New York, 1974.
Cited by
Sorted by citations
Hate speech detection: Challenges and solutions
MacAvaney, S., Yao, H.-R., Yang, E., Russell, K., Goharian, N., & Frieder, O. (2019) · PLOS ONE · doi:10.1371/journal.pone.0221152 · Cited by 566 · see citing works
Symbol Interdependency in Symbolic and Embodied Cognition
Louwerse, M. M. (2011) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01106.x · Cited by 399 · see citing works
Wei, X., Yang, Z., Liu, Y., Wei, D., Jia, L., & Li, Y. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2019.01.008 · Cited by 338 · see citing works
Information retrieval and text mining technologies for chemistry
Krallinger, M., Rabal, O., Lourenço, A., Oyarzabal, J., & Valencia, A. (2017) · Chemical Reviews · doi:10.1021/acs.chemrev.6b00851 · Cited by 281 · see citing works
PubMed related articles: a probabilistic topic-based model for content similarity
Lin, J., & Wilbur, W. J. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-423 · Cited by 243 · see citing works
Large Language Models for Information Retrieval: A Survey
Zhu, Y., Yuan, H., Wang, S., Liu, J., Liu, W., Deng, C., Chen, H., Liu, Z., Dou, Z., & Wen, J.-R. (2026) · ACM Transactions on Information Systems · doi:10.1145/3748304 · Cited by 225 · see citing works
Dense Text Retrieval Based on Pretrained Language Models: A Survey
Zhao, W. X., Liu, J., Ren, R., & Wen, J.-R. (2024) · ACM Transactions on Information Systems · doi:10.1145/3637870 · Cited by 211 · see citing works
“Among the early efforts, a significant achievement is the vector space model [9], [10] based on the “bagof-words” assumption, representing both documents and queries as sparse term-based vectors1.”
BackgroundPrioritising references for systematic reviews with RobotAnalyst: A user study
Przybyła, P., Brockmeier, A. J., Kontonatsios, G., Le Pogam, M., McNaught, J., von Elm, E., Nolan, K., & Ananiadou, S. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1311 · Cited by 148 · see citing works
“41 Spectral clustering 75 operates on the cosine similarities between the bag-of-words vector representation of the abstracts and titles using the term frequency inverse document frequency (TF–IDF) weighting.”
MethodUncovering customer service experiences with Twitter: the case of airline industry
Misopoulos, F., Mitic, M., Kapoulas, A., & Karapiperis, C. (2014) · Management Decision · doi:10.1108/md-03-2012-0235 · Cited by 137 · see citing works
Raj, C., Agarwal, A., Bharathy, G., Narayan, B., & Prasad, M. (2021) · Electronics · doi:10.3390/electronics10222810 · Cited by 128 · see citing works
MedSTS: a resource for clinical semantic textual similarity
Wang, Y., Afzal, N., Fu, S., Wang, L., Shen, F., Rastegar-Mojarad, M., & Liu, H. (2020) · Language Resources and Evaluation · doi:10.1007/s10579-018-9431-1 · Cited by 124 · see citing works
A visual analysis approach to validate the selection review of primary studies in systematic reviews
Felizardo, K. R., Andery, G. F., Paulovich, F. V., Minghim, R., & Maldonado, J. C. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.04.003 · Cited by 60 · see citing works
CorpusBrain: Pre-train a Generative Retrieval Model for Knowledge-Intensive Language Tasks
Chen, J., Zhang, R., Guo, J., Liu, Y., Fan, Y., & Cheng, X. (2022) · Proceedings of the 31st ACM International Conference on Information & Knowledge Management · doi:10.1145/3511808.3557271 · Cited by 57 · see citing works
A Review of Current Trends, Techniques, and Challenges in Large Language Models (LLMs)
Patil, R., & Gudivada, A. V. (2024) · doi:10.20944/preprints202402.0357.v1 · Cited by 296 · see citing works
MBOSS: A Symbolic Representation of Human Activity Recognition Using Mobile Sensors
Montero Quispe, K. G., Sousa Lima, W., Macêdo Batista, D., & Souto, E. (2018) · Sensors · doi:10.3390/s18124354 · Cited by 24 · see citing works
Automated Knowledge Organization AI ML based Subject Indexing System for Libraries
Ahmed, M., Mukhopadhyay, M., & Mukhopadhyay, P. (2023) · DESIDOC Journal of Library & Information Technology · doi:10.14429/djlit.43.01.18619 · Cited by 20 · see citing works
Self-Tuned Descriptive Document Clustering Using a Predictive Network
Brockmeier, A. J., Mu, T., Ananiadou, S., & Goulermas, J. Y. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2781721 · Cited by 15 · see citing works
Enhancement of information seeking using an information needs radar model
Shih, C.-W., Chen, M.-Y., Chu, H.-C., & Chen, Y.-M. (2012) · Information Processing & Management · doi:10.1016/j.ipm.2011.08.010 · Cited by 12 · see citing works
Kazi, S., Khoja, S., & Daud, A. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100756 · Cited by 9 · see citing works
Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge
Gou, B., Huang, Z., Ning, Y., Gu, Y., Lin, M., Qi, W., Kopanev, A., Yu, B., Gutiérrez, B. J., Shu, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.21506 · Cited by 3 · see citing works
- Authors
- Salton, G., Wong, A., & Yang, C. S.
- Affiliations
- Cornell University (US)
- ORCID
- Yang, C. S.
- Venue
- Communications of the ACM
- Published
- 1975-11
- Volume
- 18
- Issue
- 11
- Pages
- 613-620
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2165612380
- Cited by
- 7,521
- References
- 0
- Citations by year
- 2026: 173 · 2025: 189 · 2024: 188 · 2023: 216 · 2022: 218 · 2021: 276 · 2020: 294 · 2019: 345 · 2018: 374 · 2017: 402 · 2016: 447 · 2015: 429 · 2014: 504 · 2013: 528 · 2012: 466
- FWCI
- 11.38
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Communications of the ACM (publishedVersion)
- eCommons (Cornell University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Algorithms and Data Compression
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Keywords
- vector space model, automatic indexing, document retrieval, spatial density, object space, retrieval effectiveness, pattern matching
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
