Fuzzy Bag-of-Words Model for Document Representation
The DOI matches its Crossref record; 53 of the 56 references it cites were found in a registry or an index.
Abstract
One key issue in text mining and natural language processing is how to effectively represent documents using numerical vectors. One classical model is the Bag-of-Words (BoW). In a BoW-based vector representation of a document, each element denotes the normalized number of occurrence of a basis term in the document. To count the number of occurrence of a basis term, BoW conducts exact word matching, which can be regarded as a hard mapping from words to the basis term. BoW representation suffers from its intrinsic extreme sparsity, high dimensionality, and inability to capture high-level semantic meanings behind text data. To address the aforementioned issues, we propose a new document representation method named fuzzy Bag-of-Words (FBoW) in this paper. FBoW adopts a fuzzy mapping based on semantic correlation among words quantified by cosine similarity measures between word embeddings. Since word semantic matching instead of exact word string matching is used, the FBoW could encode more semantics into the numerical representation. In addition, we propose to use word clusters instead of individual words as basis terms and develop fuzzy Bag-of-WordClusters (FBoWC) models. Three variants under the framework of FBoWC are proposed based on three different similarity measures between word clusters and words, which are named as FBoWCmean, FBoWCmax, and FBoWCmin , respectively. Document representations learned by the proposed FBoW and FBoWC are dense and able to encode high-level sema…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Traditional methods for extracting emotional features use the bag-of-words (BoW) model [58,59].”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [59]
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918 · cited 4×
“Linear support vector machine (SVM) [48] was applied to the document representations learned by the aforementioned”
MethodInfluential(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · cited 1×
“Another is deep model: multilayers neural networks with various forms including recursive [19], [20], recurrent [21], [22], and convolution [23]–[25] neural networks to learn and perform compositions over word embeddings.”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“In the popular word embeddings word2vec [11], [15], [18], a two-layer neural network language model is designed to learn vector representations for each word.”
BackgroundConvolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831 · cited 3×
“Another is deep model: multilayers neural networks with various forms including recursive [19], [20], recurrent [21], [22], and convolution [23]–[25] neural networks to learn and perform compositions over word embeddings.”
BackgroundRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“resentation of data and the good representation determines the upper bound of the performance of machine learning algorithms [1].”
BackgroundTerm-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740 · cited 1×
“It should be noted that the basis terms are the high frequency words in a corpus, and the number of basis terms or the dimensionality of BoW vectors is less than the size of vocabulary [7], [8], [9], [10].”
BackgroundRecursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 2×
“Another is deep model: multilayers neural networks with various forms including recursive [19], [20], recurrent [21], [22], and convolution [23]–[25] neural networks to learn and perform compositions over word embeddings.”
BackgroundOpinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
Cited by
Items 201–253 of 253
Hybrid SVD For Document Representation Using Different Vectorization
Kalpana, P., Rosini, B. R., P, S. P. K., & Sowmiya, S. (2019) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit195260
Web text-aided image classification
Wang, D. (2019) · doi:10.32657/10220/47855
Correlations between Word Vector SetsPreprint
Zhelezniak, V., Shen, A., Busbridge, D., Savkov, A., & Hammerla, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.02902 · Cited by 1
“One step further, Zhao and Mao (2017); Zhelezniak et al.”
BackgroundFuzzy Mapping Model For Classification In Supervised Learning
Mathew, A., & Jamal, S. (2019) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon.2019.8929669
“A fuzzy mapping based on cosine similarity derived from word embedding model is proposed by Fuzzy Bag of Words model (FBoW) [2].”
MethodInfluentialDiversified Clustering Methods and Algorithms in Data Mining used for Document Representation
Jorvekar, P. P., Prasad, R. S., & Prasad, J. R. (2019) · International Conference on Computing Communication Control and automation · doi:10.1109/iccubea47591.2019.9129300
Hierarchical Fuzzy Clustering Semantics (HFCS) in Web Document for Discovering Latent Semantics
khameneh, B. T., & Shokrzadeh, H. (2020) · Signal and Data Processing · doi:10.29252/jsdp.17.1.29
Nishida, Y., & Honda, K. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62509-2_16
MULTITOPIC TEXT CLUSTERING AND CLUSTER LABELING USING CONTEXTUALIZED WORD EMBEDDINGS
Ostapiuk, Z. V., & Korotyeyeva, T. (2020) · Radio Electronics Computer Science Control · doi:10.15588/1607-3274-2020-4-10
“A study [3] was performed to overcome the hard-mapping consequences of BoW.”
MethodVenugopal, M., Sharma, V. K., & Sharma, K. (2021) · Materials Today Proceedings · doi:10.1016/j.matpr.2021.04.104
Studying the Evolution of Bitcoin-Related Topics Extracted from an Online Forum
Badlou, D. S. (2021) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2021-14411
Dynamic Document Localization for Efficient Mining
Sijin, P., & Champa, H. N. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-981-16-5157-1_2
Approximate Query Answering by Twig Level Analysis
Sijin, P., & Champa, H. N. (2021) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac52330.2021.9640654
Cognitive technology for a personalized seizure predictive and healthcare analytic device
Kosana, V., Teeparthi, K., & Rana, A. U. H. S. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-85751-2.00012-8 · Cited by 1
A Comparative Study on Utilization of Semantic Information in Fuzzy Co-clustering
Takahata, Y., Honda, K., & Ubukata, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-98018-4_18
2018 Index IEEE Transactions on Fuzzy Systems Vol. 26
(2018) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2019.2894238
Content-aware Topic Recognition of Inquiry Letter
Wang, W. A., Wei, G., Gao, X., & He, H. (2021) · International Conference on Computer, Blockchain and Financial Development (CBFD) · doi:10.1109/cbfd52659.2021.00039
Analysis of unsupervised learning methods for automated clustering of equipment downtime reports
Medani, L. V., Filho, V. J. M. F., Jardim, T. S., Medeiros, M. D. D., & dos Santos, T. F. (2022) · Technical Papers ... Rio Oil & Gas · doi:10.48072/2525-7579.rog.2022.316
Information Asymmetries and the Role of Information Intermediaries on Capital Markets
Bankamp, S. (2022) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-9476
Kavitha, U., & Rao, B. (2022) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2022.47130
REGION BASED USER FRIENDLY RECIPE RECOMMENDATION BASED ON INGREDIENTS
(2023) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets33981
Multi-Dimensional Intention Recognition for User-Generated Short Texts
Zhang, Y., Zhang, F., & Zhang, X. Y. (2022) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-dss-smartcity-dependsys57074.2022.00306
“For non-numeric attributes, we use cosine similarity [21] to get their degrees.”
MethodZhao, G., Zhang, J., Du, D., Gao, Q. Z., Lin, S., Xiao, X., & Wu, Y. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-33374-3_33
A Comparative Study of Topic Modeling Methods for Document Retrieval
Reyad, I., Rashad, M., & Abdelfattah, M. (2022) · International Conference on Computer Theory and Applications (ICCTA) · doi:10.1109/iccta58027.2022.10206075 · Cited by 2
Context based diversification on keyword search by conceptualization of typed terms of the query
Sijin, P., & Champa, H. N. (2023) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2023.100196 · Cited by 1
Advancing document-level event extraction: Integration across texts and reciprocal feedback
Zuo, M., Li, J., Wu, D., Wang, Y., Dong, W., Kong, J., & Hu, K. (2023) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2023888
Cross comparison of COVID-19 fake news detection machine learning modelsPreprint
Qadees, M., & Hannan, A. (2023) · doi:10.36227/techrxiv.24454561.v1 · Cited by 1
Lee, C., & Kartowisastro, I. H. (2023) · Ingénierie des systèmes d information · doi:10.18280/isi.280626
Alam, A. (2023) · International Conference on Quantum Technologies, Communications, Computing, Hardware and Embedded Systems Security (iQ-CCHESS) · doi:10.1109/iq-cchess56596.2023.10391392
“The BoW model portrays text as a “bag” of its individual words since it considers that the order of the words is immaterial [4], [5], [6].”
BackgroundFault diagnosis models based on cross time field transfer
Yan, R., & Shen, F. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-99989-2.00006-2
AI Incorporating NLP – to Boldly Go, Where No Algorithms Have Gone Before
Mohammad, A. F., Alagappan, N., & Basit, M. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-45651-0_28
A New Document Embedding Method for News Classification
Rahimi, Z., & Homayounpour, M. M. (2023) · Archives de l'Institut d'Hessarek. · doi:10.61186/jsdp.19.4.137
Explainable Knowledge-Based Learning for Online Medical Question Answering
Cui, M., Li, X., & Qin, P. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5489-2_26
Text Mining: Text Representation
Vallelunga, R., & Scarpino, I. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95502-7.00172-x
Analyzing End-of-Course Comments by Using Deep Hierachical Net
Hu, F. (2025) · IEEE International Conference on Electronics, Energy Systems and Power Engineering (EESPE) · doi:10.1109/eespe63401.2025.10987008
“The comment "[4,2,3,4,1]" is then encoded.”
A Novel Framework for Identifying Hot Spots in Coal Research
Li, P., Wang, Y., & Xu, N. (2025) · Natural Resources Research · doi:10.1007/s11053-025-10504-y · Cited by 1
“One classical model is the BoW (Gupta & Lehal, 2009; Zhao & Mao, 2018), which represents text as an unordered collection of words.”
A transfer deep residual shrinkage network for bird sound recognition
Chen, X., Zeng, Z., & Xu, T. (2025) · Electronic Research Archive · doi:10.3934/era.2025185
A Review for Visual Place Recognition: From Hand-Crafted and Deep Learning Perspective
Wang, X., Qiu, L., Hu, Z., Li, Y., & Wang, G. (2025) · International Conference on Transportation Information and Safety · doi:10.1109/ictis68762.2025.11214850
“By using the road scene model to construct the bag-of-words model, the road image features is mapped to the histogram of the bag-of-words model[16]-[22].”
Measuring Interdisciplinarity in Geology: A Semantic Analysis Approach
Li, P., Wang, Y., & Xu, N. (2025) · Earth and Space Science · doi:10.1029/2025ea004494
“Specifically, it can be measured by calculating the cosine of the angle between two vectors (Zhao & Mao, 2018).”
Li, H., Wang, C., & Hu, P. (2025) · OMEGA - Journal of Death and Dying · doi:10.1177/00302228251407444
Standardized Logging Approach for Software Code-bases Using Natural Language Processing
Tum, B. K., Mwangi, E. N., Irungu, A. W., & Oteyo, I. N. (2025) · International Conference on Information and Communication Technology for Development for Africa (ICT4DA) · doi:10.1109/ict4da67218.2025.11282517
“Early approaches in NLP relied on the Bag of Words (BoW) [17] and Term Frequency-Inverse Document Frequency (TF-IDF) [18] to process text.”
Lokanan, M. E. (2026) · Journal of Economic Criminology · doi:10.1016/j.jeconc.2026.100207
Ding, Q., Ding, H., Wang, J., Xian, Y., Li, T., Li, N., Fang, T., & Chen, J. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.115516 · Cited by 2
Improving the inventive design process by using agile methods and machine learning algorithms
Hanifi, M. (2021) · theses.fr (ABES) · doi:10.70675/03d3d902z0cefz4f55z850czbe0a7025f949
Multimodal Document Understanding with Unified Vision and Language Cross-Modal Learning
Bakkali, S. (2022) · theses.fr (ABES) · doi:10.70675/aeb1fb70za11fz410fzaf33z6a28e0f0f154
A Survey of Multimodal Emotion Recognition Systems for Visually Impaired
Ingale, S., Dhanaraj, R. K., & Al-Khasawneh, M. A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-18913-4_7
Srinadh, U., & Rao, P. S. (2026) · Progress in Artificial Intelligence · doi:10.1007/s13748-026-00469-1
Lower, M., Magott, J., & Skorupski, J. (2026) · Safety Science · doi:10.1016/j.ssci.2026.107393
An Empirical Comparison of CNN Setups for Multi-label Image Classification
Orczyk, T., Porwik, P., & Wróbel, K. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-37933-7_5
Metadata
- Authors
- Zhao, R., & Mao, K.
- Affiliations
- Nanyang Technological University (SG)
- ORCID
- Venue
- IEEE Transactions on Fuzzy Systems
- Published
- 2018-04
- Volume
- 26
- Issue
- 2
- Pages
- 794-804
- ISSN
- 1063-6706 (ISSN-L)
- 1941-0034
- OpenAlex
- W2597485909
- Cited by
- 252
- References
- 56
- Citations by year
- 2026: 10 · 2025: 20 · 2024: 21 · 2023: 40 · 2022: 39 · 2021: 47 · 2020: 31 · 2019: 30 · 2018: 11
- FWCI
- 12.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Fuzzy Systems (publishedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Keywords
- document representation, fuzzy mappings, word embeddings, cosine similarity, word clusters, document classification, high-level semantics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.