The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Adapting Feature Selection Algorithms for the Classification of Chinese Texts
Open accessAbstract
Text classification has been highlighted as the key process to organize online texts for better communication in the Digital Media Age. Text classification establishes classification rules based on text features, so the accuracy of feature selection is the basis of text classification. Facing fast-increasing Chinese electronic documents in the digital environment, scholars have accumulated quite a few algorithms for the feature selection for the automatic classification of Chinese texts in recent years. However, discussion about how to adapt existing feature selection algorithms for various types of Chinese texts is still inadequate. To address this, this study proposes three improved feature selection algorithms and tests their performance on different types of Chinese texts. These include an enhanced CHI square with mutual information (MI) algorithm, which simultaneously introduces word frequency and term adjustment (CHMI); a term frequency–CHI square (TF–CHI) algorithm, which enhances weight calculation; and a term frequency–inverse document frequency (TF–IDF) algorithm enhanced with the extreme gradient boosting (XGBoost) algorithm, which improves the algorithm’s ability of word filtering (TF–XGBoost). This study randomly chooses 3000 texts from six different categories of the Sogou news corpus to obtain the confusion matrix and evaluate the performance of the new algorithms with precision and the F1-score. Experimental comparisons are conducted on support vector machine (SVM) and naive Bayes (NB) classifiers. The experimental results demonstrate that the feature selection algorithms proposed in this paper improve performance across various news corpora, although the best feature selection schemes for each type of corpus are different. Further studies of the application of the improved feature selection methods in other languages and the improvement in classifiers are suggested.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,926
A vector space model for automatic indexing
Salton, G., Wong, A., & Yang, C. S. (1975) · Communications of the ACM · doi:10.1145/361219.361220 · Cited by 7,521
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
A Review on Multi-Label Learning Algorithms
Zhang, M.-L., & Zhou, Z.-H. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.39 · Cited by 3,321
The Automatic Creation of Literature Abstracts
Luhn, H. P. (1958) · IBM Journal of Research and Development · doi:10.1147/rd.22.0159 · Cited by 3,246
Shi, B., Bai, X., & Yao, C. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2646371 · Cited by 3,172
On Relevance, Probabilistic Indexing and Information Retrieval
Maron, M. E., & Kuhns, J. L. (1960) · Journal of the ACM · doi:10.1145/321033.321035 · Cited by 907
Text Mining: Use of TF-IDF to Examine the Relevance of Words to Documents
Qaiser, S., & Ali, R. (2018) · International Journal of Computer Applications · doi:10.5120/ijca2018917395 · Cited by 827
Ensemble of keyword extraction methods and classifiers in text classification
Onan, A., Korukoğlu, S., & Bulut, H. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.03.045 · Cited by 630
Automatic Indexing: An Experimental Inquiry
Maron, M. E. (1961) · Journal of the ACM · doi:10.1145/321075.321084 · Cited by 570
Approximating XGBoost with an interpretable decision tree
Sagi, O., & Rokach, L. (2021) · Information Sciences · doi:10.1016/j.ins.2021.05.055 · Cited by 554
Feature Selection for Classification using Principal Component Analysis and Information Gain
Odhiambo Omuya, E., Onyango Okeyo, G., & Waema Kimwele, M. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114765 · Cited by 398
Emotion classification for short texts: an improved multi-label method
Liu, X., Shi, T., Zhou, G., Liu, M., Yin, Z., Yin, L., & Zheng, W. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-01816-6 · Cited by 175
Self-citationOpinion mining using ensemble text hidden Markov models for text classification
Kang, M., Ahn, J., & Lee, K. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.07.019 · Cited by 168
A Data-Driven Text Mining and Semantic Network Analysis for Design Information Retrieval
Shi, F., Chen, L., Han, J., & Childs, P. (2017) · Journal of Mechanical Design · doi:10.1115/1.4037649 · Cited by 161
Developing Multi-Labelled Corpus of Twitter Short Texts: A Semi-Automatic Method
Liu, X., Zhou, G., Kong, M., Yin, Z., Li, X., Yin, L., & Zheng, W. (2023) · Systems · doi:10.3390/systems11080390 · Cited by 159
Self-citationAzam, N., & Yao, J. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.09.160 · Cited by 152
Improved Text Classification via Contrastive Adversarial Training
Pan, L., Hang, C.-W., Sil, A., & Potdar, S. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21362 · Cited by 150
A review on feature selection and feature extraction for text classification
Shah, F., & Patel, V. D. (2016) · International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET) · doi:10.1109/wispnet.2016.7566545 · Cited by 142
A Chi-Square Statistics Based Feature Selection Method in Text Classification
Zhai, Y., Song, W., Liu, X., Liu, L., & Zhao, X. S. (2018) · IEEE International Conference on Software Engineering and Service Science (ICSESS) · doi:10.1109/icsess.2018.8663882 · Cited by 135
Self-citationcw2vec: Learning Chinese Word Embeddings with Stroke n-gram Information
Cao, S., Lu, W., Zhou, J. W., & Li, X. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12029 · Cited by 125
Self-citationTwo-stage three-way enhanced technique for ensemble learning in inclusive policy text classification
Liang, D., & Yi, B. (2020) · Information Sciences · doi:10.1016/j.ins.2020.08.051 · Cited by 61
Category Specific Dictionary Learning for Attribute Specific Feature Selection
Wang, W., Yan, Y., WINKLER, S. S., & Sebe, N. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2523340 · Cited by 59
Barakat, B. K., Seitz, A. R., & Shams, L. B. (2013) · Cognition · doi:10.1016/j.cognition.2013.07.003 · Cited by 52
Jiang, A., Huang, X., Zhang, Z., et al. (2010) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2010.05.015 · Cited by 48
A comprehensive study of eleven feature selection algorithms and their impact on text classification
Vora, S., & Yang, H. Q. (2017) · 2017 Computing Conference · doi:10.1109/sai.2017.8252136 · Cited by 48
Composite Feature Extraction and Selection for Text Classification
Wan, C., Wang, Y., Liu, Y., Ji, J., & Feng, G. (2019) · IEEE Access · doi:10.1109/access.2019.2904602 · Cited by 35
Bai, L., Li, H., Gao, W., Xie, J. H., & Wang, H. (2023) · Information Sciences · doi:10.1016/j.ins.2023.01.069 · Cited by 28
Research on Keyword Extraction of Word2vec Model in Chinese Corpus
Zhang, C., Wang, X., Yu, S., et al. (2018) · IEEE/ACIS International Conference on Computer and Information Science (ICIS) · doi:10.1109/icis.2018.8466534 · Cited by 16
Szczepanek, R. (2023) · Water · doi:10.3390/w15061197 · Cited by 14
Chinese Texts Classification System
Zhu, M. S., & Yang, X. (2019) · International Conference on Information and Computer Technologies (ICICT) · doi:10.1109/infoct.2019.8710894 · Cited by 4
Research works printed but not linked: 4
- Lancaster, H.O., and Seneta, E. (2005). Encyclopedia of Biostatistics, John Wiley & Sons.
- Bai, R., Wang, X., and Liao, J. (2010, January 23–25). Extract semantic information from wordnet to improve text classification performance. Proceedings of the International Conference on Advanced Computer Science and Information Technology, Miyazaki, Japan. · doi:10.1007/978-3-642-13577-4_36
- Bengio, Y., Ducharme, R., and Vincent, P. (December, January 29). A neural probabilistic language model. Proceedings of the 13th 2000 Neural Information Processing Systems (NIPS) Conference, Denver, CO, USA.
- Yao, Z., and Ze-wen, C. (2011, January 28–29). Research on the construction and filter method of stop-word list in text preprocessing. Proceedings of the 2011 Fourth International Conference on Intelligent Computation Technology and Automation, Shenzhen, China. · doi:10.1109/icicta.2011.64
Cited by
(1996) · Institutional Research Information System University of Turin (University of Turin) · doi:10.1111/j · Cited by 5,486
Al-Zahrani, A. M., & Alasmari, T. M. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03432-4 · Cited by 292
Li, Y., & Tian, C. (2023) · Environmental Science and Pollution Research · doi:10.1007/s11356-023-31267-0 · Cited by 4
RetractedDilber, C., & Yoşumaz, İ. (2026) · Journal of Academic Ethics · doi:10.1007/s10805-025-09681-5 · Cited by 1
Metadata
- Authors
- Liu, X., Wang, S., Lu, S., Yin, Z., Li, X., Yin, L., Tian, J., & Zheng, W.
- Venue
- Systems
- Publisher
- MDPI AG
- Published
- 2023-09-20
- Volume
- 11
- Issue
- 9
- Pages
- 483
- ISSN
- 2079-8954 (ISSN-L)
- OpenAlex
- W4386933640
- Cited by
- 336
- References
- 35
- FWCI
- 13.18
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Sichuan Science and Technology Program (2023YFSY0026, 2023YFH0004, SC22ZDCY09)
- Sichuan Social Science Major Project (2023YFSY0026, 2023YFH0004, SC22ZDCY09)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.