The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Evaluation of feature selection methods for text classification with small datasets using multiple criteria decision-making methods
Open accessAbstract
The evaluation of feature selection methods for text classification with small sample datasets must consider classification performance, stability, and efficiency. It is, thus, a multiple criteria decision-making (MCDM) problem. Yet there has been few research in feature selection evaluation using MCDM methods which considering multiple criteria. Therefore, we use MCDM-based methods for evaluating feature selection methods for text classification with small sample datasets. An experimental study is designed to compare five MCDM methods to validate the proposed approach with 10 feature selection methods, nine evaluation measures for binary classification, seven evaluation measures for multi-class classification, and three classifiers with 10 small datasets. Based on the ranked results of the five MCDM methods, we make recommendations concerning feature selection methods. The results demonstrate the effectiveness of the used MCDM-based method in evaluating feature selection methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,926
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515
Learning Word Vectors for Sentiment Analysis
Maas, A. L., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y., & Potts, C. (2011) · Cited by 6,961
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
A Comparative Study on Feature Selection in Text Categorization
Yang, Y., & Pedersen, J. (1997) · Cited by 4,790
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Rokach, L. (2010) · Artificial Intelligence Review · doi:10.1007/s10462-009-9124-7 · Cited by 2,657
Multiple Objective Decision Making ― Methods and Applications: A State-of-the-Art Survey
Hwang, C.-L., & Yoon, K. (1979) · Medical Entomology and Zoology · Cited by 1,853
A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Categorization
Joachims, T. (1997) · Cited by 1,262
STATE OF ART SURVEYS OF OVERVIEWS ON MCDM/MADM METHODS
Zavadskas, E. K., Turskis, Z., & Kildienė, S. (2014) · Technological and Economic Development of Economy · doi:10.3846/20294913.2014.892037 · Cited by 931
An experimental comparison of performance measures for classification
Ferri, C., Hernández-Orallo, J., & Modroiu, R. (2009) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.08.010 · Cited by 889
Evaluation of clustering algorithms for financial risk analysis using MCDM methods
Kou, G., Peng, Y., & Wang, G. (2014) · Information Sciences · doi:10.1016/j.ins.2014.02.137 · Cited by 764
Self-citationPang, B., & Lee, L. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0506075 · Cited by 678
Robust Feature Selection Using Ensemble Feature Selection Techniques
Saeys, Y., Abeel, T., & Van de Peer, Y. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-87481-2_21 · Cited by 663
Stability of feature selection algorithms: a study on high-dimensional spaces
Kalousis, A., Prados, J., & Hilario, M. (2007) · Knowledge and Information Systems · doi:10.1007/s10115-006-0040-8 · Cited by 614
Feature selection for text classification with Naïve Bayes
Chen, J., Huang, H., Tian, S., & Qu, Y. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.06.054 · Cited by 576
EVALUATION OF CLASSIFICATION ALGORITHMS USING MCDM AND RANK CORRELATION
KOU, G., LU, Y., PENG, Y., & SHI, Y. (2012) · International Journal of Information Technology & Decision Making · doi:10.1142/s0219622012500095 · Cited by 566
Self-citationAUC Optimization vs. Error Rate Minimization
Cortes, C., & Mohri, M. (2003) · Cited by 530
A comparison of weight approximation techniques in multiattribute utility decision making
Stillwell, W. G., Seaver, D. A., & Edwards, W. (1981) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(81)90015-5 · Cited by 471
Contributions to the study of SMS spam filtering: new collection and results
Almeida, T. A., Hidalgo, J. M. G., & Yamakami, A. (2011) · Proceedings of the 11th ACM symposium on Document engineering · doi:10.1145/2034691.2034742 · Cited by 463
Uğuz, H. (2011) · Knowledge-Based Systems · doi:10.1016/j.knosys.2011.04.014 · Cited by 460
PAIRWISE COMPARISON MATRIX IN MULTIPLE CRITERIA DECISION MAKING
KOU, G., ERGU, D., CHEN, Y., & LIN, C. (2016) · Technological and Economic Development of Economy · doi:10.3846/20294913.2016.1210694 · Cited by 410
Self-citationText feature selection using ant colony optimization
Aghdam, M. H., Ghasem-Aghaee, N., & Basiri, M. E. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.08.022 · Cited by 389
Soft consensus cost models for group decision making and economic interpretations
Zhang, H., Kou, G., & Peng, Y. (2019) · European Journal of Operational Research · doi:10.1016/j.ejor.2019.03.009 · Cited by 387
Self-citationLee, C., & Lee, G. G. (2006) · Information Processing & Management · doi:10.1016/j.ipm.2004.08.006 · Cited by 356
A cosine maximization method for the priority vector derivation in AHP
Kou, G., & Lin, C. (2014) · European Journal of Operational Research · doi:10.1016/j.ejor.2013.10.019 · Cited by 347
Self-citationA novel feature selection algorithm for text categorization
Shang, W., Huang, H., Zhu, H., Lin, Y., Qu, Y., & Wang, Z. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.04.001 · Cited by 344
Liu, Y., Bi, J.-W., & Fan, Z.-P. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.11.012 · Cited by 333
A novel probabilistic feature selection method for text classification
Uysal, A. K., & Gunal, S. (2012) · Knowledge-Based Systems · doi:10.1016/j.knosys.2012.06.005 · Cited by 305
A Group Decision Making Model for Integrating Heterogeneous Information
Li, G., Kou, G., & Peng, Y. (2018) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2016.2627050 · Cited by 286
Self-citationKou, G., Ergu, D., & Shang, J. (2014) · European Journal of Operational Research · doi:10.1016/j.ejor.2013.11.035 · Cited by 275
Self-citationPredicting the daily return direction of the stock market using hybrid machine learning algorithms
Zhong, X., & Enke, D. (2019) · Financial Innovation · doi:10.1186/s40854-019-0138-0 · Cited by 274
Indian stock market prediction using artificial neural networks on tick data
Selvamuthu, D., Kumar, V., & Mishra, A. (2019) · Financial Innovation · doi:10.1186/s40854-019-0131-7 · Cited by 270
FAMCDM: A fusion approach of MCDM methods to rank multiclass classification algorithms
Peng, Y., Kou, G., Wang, G., & Shi, Y. (2011) · Omega · doi:10.1016/j.omega.2011.01.009 · Cited by 212
Self-citationLi, Z., Xiao, S., Ge, S. S., & Su, H. (2016) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2015.2422267 · Cited by 199
A novel feature selection method considering feature interaction
Zeng, Z., Zhang, H., Zhang, R., & Yin, C. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.02.025 · Cited by 198
An improved global feature selection scheme for text classification
Uysal, A. K. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.08.050 · Cited by 194
An empirical study of classification algorithm evaluation for financial risk prediction
Peng, Y., Wang, G., Kou, G., & Shi, Y. (2011) · Applied Soft Computing · doi:10.1016/j.asoc.2010.11.028 · Cited by 189
Self-citationSomol, P., & Novovičová, J. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.34 · Cited by 153
Feature selection via maximizing global information gain for text classification
Shang, C., Li, M., Feng, S., Jiang, Q., & Fan, J. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.09.019 · Cited by 138
Yang, J., Liu, Y., Zhu, X., Liu, Z., & Zhang, X. (2012) · Information Processing & Management · doi:10.1016/j.ipm.2011.12.005 · Cited by 137
Rosset, S. (2004) · International Conference on Machine Learning · doi:10.1145/1015330.1015400 · Cited by 119
Partial State Constraints-Based Control for Nonlinear Systems With Backlash-Like Hysteresis
Liu, L., & Tang, L. D. (2018) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2018.2841063 · Cited by 108
Analysis of feature selection stability on high dimension and small sample data
Dernoncourt, D., Hanczar, B., & Zucker, J. (2013) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2013.07.012 · Cited by 106
MCDM Methodologies and Applications: A Literature Review from 1999 to 2009
Eshlaghy, A. T., & Homayonfar, M. (2011) · Cited by 80
Feature selection by optimizing a lower bound of conditional mutual information
Peng, H., & Yong Fan, A. (2017) · Information Sciences · doi:10.1016/j.ins.2017.08.036 · Cited by 63
Effectively classifying short texts by structured sparse representation with dictionary filtering
Gao, L., Zhou, S., & Guan, J. (2015) · Information Sciences · doi:10.1016/j.ins.2015.06.033 · Cited by 40
Active learning using on-line algorithms
Mesterharm, C., & Pazzani, M. J. (2011) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2020408.2020553 · Cited by 25
Terms-based discriminative information space for robust text classification
Junejo, K. N., Karim, A., Hassan, M. T., & Jeon, M. (2016) · Information Sciences · doi:10.1016/j.ins.2016.08.073 · Cited by 19
Kong, Y., Owusu-Akomeah, M., Antwi, H. A., et al. (2019) · Financial Innovation · doi:10.1186/s40854-019-0125-5 · Cited by 15
Multi crteria decision making and its applications : a literature review
Alias, M. A., Hashim, S. Z. M., & Samsudin, S. (2008) · Cited by 10
Cited by
A comprehensive survey on sentiment analysis: Approaches, challenges and trends
Birjali, M., Kasri, M., & Beni-Hssane, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107134 · Cited by 921
Explainable AI for Healthcare 5.0: Opportunities and Challenges
Saraswat, D., Bhattacharya, P., Verma, A., Prasad, V. K., Tanwar, S., Sharma, G., Bokoro, P. N., & Sharma, R. (2022) · IEEE Access · doi:10.1109/access.2022.3197671 · Cited by 523
Feature selection techniques for machine learning: a survey of more than two decades of research
Theng, D., & Bhoyar, K. K. (2024) · Knowledge and Information Systems · doi:10.1007/s10115-023-02010-5 · Cited by 510
Review of swarm intelligence-based feature selection methods
Rostami, M., Berahmand, K., Nasiri, E., & Forouzandeh, S. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104210 · Cited by 451
Zhang, H., Zhao, S., Kou, G., Li, C.-C., Dong, Y., & Herrera, F. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.03.001 · Cited by 355
Self-citation
Metadata
- Authors
- Kou, G., Yang, P., Peng, Y., Xiao, F., Chen, Y., & Alsaadi, F. E.
- Venue
- Applied Soft Computing
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 86
- Pages
- 105836
- ISSN
- 1568-4946 (ISSN-L)
- OpenAlex
- W2981842822
- Cited by
- 357
- References
- 51
- FWCI
- 25.33
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.