Fuzzy Bag-of-Words Model for Document Representation
The DOI matches its Crossref record; 53 of the 56 references it cites were found in a registry or an index.
Abstract
One key issue in text mining and natural language processing is how to effectively represent documents using numerical vectors. One classical model is the Bag-of-Words (BoW). In a BoW-based vector representation of a document, each element denotes the normalized number of occurrence of a basis term in the document. To count the number of occurrence of a basis term, BoW conducts exact word matching, which can be regarded as a hard mapping from words to the basis term. BoW representation suffers from its intrinsic extreme sparsity, high dimensionality, and inability to capture high-level semantic meanings behind text data. To address the aforementioned issues, we propose a new document representation method named fuzzy Bag-of-Words (FBoW) in this paper. FBoW adopts a fuzzy mapping based on semantic correlation among words quantified by cosine similarity measures between word embeddings. Since word semantic matching instead of exact word string matching is used, the FBoW could encode more semantics into the numerical representation. In addition, we propose to use word clusters instead of individual words as basis terms and develop fuzzy Bag-of-WordClusters (FBoWC) models. Three variants under the framework of FBoWC are proposed based on three different similarity measures between word clusters and words, which are named as FBoWCmean, FBoWCmax, and FBoWCmin , respectively. Document representations learned by the proposed FBoW and FBoWC are dense and able to encode high-level sema…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Traditional methods for extracting emotional features use the bag-of-words (BoW) model [58,59].”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [59]
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918 · cited 4×
“Linear support vector machine (SVM) [48] was applied to the document representations learned by the aforementioned”
MethodInfluential(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · cited 1×
“Another is deep model: multilayers neural networks with various forms including recursive [19], [20], recurrent [21], [22], and convolution [23]–[25] neural networks to learn and perform compositions over word embeddings.”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“In the popular word embeddings word2vec [11], [15], [18], a two-layer neural network language model is designed to learn vector representations for each word.”
BackgroundConvolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831 · cited 3×
“Another is deep model: multilayers neural networks with various forms including recursive [19], [20], recurrent [21], [22], and convolution [23]–[25] neural networks to learn and perform compositions over word embeddings.”
BackgroundRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“resentation of data and the good representation determines the upper bound of the performance of machine learning algorithms [1].”
BackgroundTerm-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740 · cited 1×
“It should be noted that the basis terms are the high frequency words in a corpus, and the number of basis terms or the dimensionality of BoW vectors is less than the size of vocabulary [7], [8], [9], [10].”
BackgroundRecursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 2×
“Another is deep model: multilayers neural networks with various forms including recursive [19], [20], recurrent [21], [22], and convolution [23]–[25] neural networks to learn and perform compositions over word embeddings.”
BackgroundOpinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
Cited by
Internet of Underwater Things and Big Marine Data Analytics—A Comprehensive Survey
Jahanbakht, M., Xiang, W., Hanzo, L., & Rahimi Azghadi, M. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3053118 · Cited by 425
“[222]–[226].”
Itahara, S., Nishio, T., Koda, Y., Morikura, M., & Yamamoto, K. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3070013 · Cited by 338
Itahara, S., Nishio, T., Koda, Y., Morikura, M., & Yamamoto, K. (2020) · arXiv · doi:10.48550/arxiv.2008.06180 · Cited by 338
Internet of underwater things and big marine data analytics – a comprehensive survey
Jahanbakht, M., Xiang, W., Hanzo, L., & Azghadi, M. R. (2021) · ResearchOnline at James Cook University (James Cook University) · Cited by 317
Zhang, S., Yang, Y., Chen, C., Zhang, X., Leng, Q., & Zhao, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121692 · Cited by 251
Metadata
- Authors
- Zhao, R., & Mao, K.
- Affiliations
- Nanyang Technological University (SG)
- ORCID
- Venue
- IEEE Transactions on Fuzzy Systems
- Published
- 2018-04
- Volume
- 26
- Issue
- 2
- Pages
- 794-804
- ISSN
- 1063-6706 (ISSN-L)
- 1941-0034
- OpenAlex
- W2597485909
- Cited by
- 252
- References
- 56
- Citations by year
- 2026: 10 · 2025: 20 · 2024: 21 · 2023: 40 · 2022: 39 · 2021: 47 · 2020: 31 · 2019: 30 · 2018: 11
- FWCI
- 12.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Fuzzy Systems (publishedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Keywords
- document representation, fuzzy mappings, word embeddings, cosine similarity, word clusters, document classification, high-level semantics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Fuzzy Bag-of-Words Model for Document Representation. https://app.cochat.ai/papers/10.1109/tfuzz.2017.2690222
- The paper
- Zhao, R., & Mao, K. (2018). Fuzzy Bag-of-Words Model for Document Representation. IEEE Transactions on Fuzzy Systems. https://doi.org/10.1109/tfuzz.2017.2690222
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.