The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Input feature selection for classification problems
Abstract
Feature selection plays an important role in classifying systems such as neural networks (NNs). We use a set of attributes which are relevant, irrelevant or redundant and from the viewpoint of managing a dataset which can be huge, reducing the number of attributes by selecting only the relevant ones is desirable. In doing so, higher performances with lower computational effort is expected. In this paper, we propose two feature selection algorithms. The limitation of mutual information feature selector (MIFS) is analyzed and a method to overcome this limitation is studied. One of the proposed algorithms makes more considered use of mutual information between input attributes and output classes than the MIFS. What is demonstrated is that the proposed method can provide the performance of the ideal greedy selection algorithm when information is distributed uniformly. The computational load for this algorithm is nearly the same as that of MIFS. In addition, another feature selection algorithm using the Taguchi method is proposed. This is advanced as a solution to the question as to how to identify good features with as few experiments as possible. The proposed algorithms are applied to several classification problems and compared with MIFS. These two algorithms can be combined to complement each other's limitations. The combined algorithm performed well in several experiments and should prove to be a useful method in selecting features for classification problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,411
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
(1992) · Cited by 23,431
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2005) · doi:10.1002/047174882x · Cited by 13,791
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Goodall, C. (1988) · Technometrics · doi:10.1080/00401706.1988.10488412 · Cited by 8,675
Cited by
A survey on feature selection methods
Chandrashekar, G., & Sahin, F. (2014) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2013.11.024 · Cited by 5,189
Normalized Mutual Information Feature Selection
Estevez, P. A., Tesmer, M., Perez, C. A., & Zurada, J. M. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005601 · Cited by 1,288
A review of feature selection methods based on mutual information
Vergara, J. R., & Estévez, P. A. (2014) · Neural Computing and Applications · doi:10.1007/s00521-013-1368-0 · Cited by 1,255
Feature selection using Joint Mutual Information Maximisation
Bennasar, M., Hicks, Y., & Setchi, R. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.07.007 · Cited by 659
Building an Intrusion Detection System Using a Filter-Based Feature Selection Algorithm
Ambusaidi, M. A., He, X., Nanda, P., & Tan, Z. (2016) · IEEE Transactions on Computers · doi:10.1109/tc.2016.2519914 · Cited by 646
Input feature selection by mutual information based on Parzen window
Kwak, N., & Choi, C.-H. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1114861 · Cited by 641
Self-citationFrom explanations to feature selection: assessing SHAP values as feature selection mechanism
Marcilio, W. E., & Eler, D. M. (2020) · 2020 33rd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi51738.2020.00053 · Cited by 504
Information-preserving hybrid data reduction based on fuzzy-rough techniques
Hu, Q., Yu, D., & Xie, Z. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.09.004 · Cited by 462
Group sparse regularization for deep neural networks
Scardapane, S., Comminiello, D., Hussain, A., & Uncini, A. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.02.029 · Cited by 457
Review of swarm intelligence-based feature selection methods
Rostami, M., Berahmand, K., Nasiri, E., & Forouzandeh, S. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104210 · Cited by 451
MIFS-ND: A mutual information-based feature selection method
Hoque, N., Bhattacharyya, D. K., & Kalita, J. K. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.04.019 · Cited by 442
Differential evolution for filter feature selection based on information theory and feature ranking
Hancer, E., Xue, B., & Zhang, M. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.10.028 · Cited by 394
Review of Input Variable Selection Methods for Artificial Neural Networks
May, R., Dandy, G., & Maier, H. (2011) · Artificial Neural Networks - Methodological Advances and Biomedical Applications · doi:10.5772/16004 · Cited by 373
Robust Sparse Linear Discriminant Analysis
Wen, J., Fang, X., Cui, J., Fei, L., Yan, K., Chen, Y., & Xu, Y. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2799214 · Cited by 370
Feature selection and classification systems for chronic disease prediction: A review
Jain, D., & Singh, V. (2018) · Egyptian Informatics Journal · doi:10.1016/j.eij.2018.03.002 · Cited by 368
Feature selection for high-dimensional classification using a competitive swarm optimizer
Gu, S., Cheng, R., & Jin, Y. (2018) · Soft Computing · doi:10.1007/s00500-016-2385-6 · Cited by 360
Genetic programming for simultaneous feature selection and classifier design
Muni, D. P., Pal, N. R., & Das, J. (2006) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2005.854499 · Cited by 357
Pareto front feature selection based on artificial bee colony optimization
Hancer, E., Xue, B., Zhang, M., Karaboga, D., & Akay, B. (2018) · Information Sciences · doi:10.1016/j.ins.2017.09.028 · Cited by 325
Feature selection with multi-view data: A survey
Zhang, R., Nie, F., Li, X., & Wei, X. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.11.019 · Cited by 313
Tutorial on practical tips of the most influential data preprocessing algorithms in data mining
García, S., Luengo, J., & Herrera, F. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.12.006 · Cited by 310
Non-linear variable selection for artificial neural networks using partial mutual information
May, R. J., Maier, H. R., Dandy, G. C., & Fernando, T. M. K. G. (2008) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2008.03.007 · Cited by 310
Li, S., Wu, H., Wan, D., & Zhu, J. (2011) · Knowledge-Based Systems · doi:10.1016/j.knosys.2010.07.003 · Cited by 308
Cyber intrusion detection by combined feature selection algorithm
Mohammadi, S., Mirvaziri, H., Ghazizadeh-Ahsaee, M., & Karimipour, H. (2019) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2018.11.007 · Cited by 295
A New Feature Selection Technique for Load and Price Forecast of Electrical Power Systems
Abedinia, O., Amjady, N., & Zareipour, H. (2017) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2016.2556620 · Cited by 273
A Fitting Model for Feature Selection With Fuzzy Rough Sets
Wang, C., Qi, Y., Shao, M., Hu, Q., Chen, D., Qian, Y., & Lin, Y. (2017) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2016.2574918 · Cited by 266
Classifying Drosophila Olfactory Projection Neuron Subtypes by Single-Cell RNA Sequencing
Li, H., Horns, F., Wu, B., Xie, Q., Li, J., Li, T., Luginbuhl, D. J., Quake, S. R., & Luo, L. (2017) · Cell · doi:10.1016/j.cell.2017.10.019 · Cited by 265
Selecting Discrete and Continuous Features Based on Neighborhood Decision Error Minimization
Hu, Q., Pedrycz, W., Yu, D., & Lang, J. (2010) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2009.2024166 · Cited by 265
Using Bayesian Deep Learning to Capture Uncertainty for Residential Net Load Forecasting
Sun, M., Zhang, T., Wang, Y., Strbac, G., & Kang, C. (2020) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2019.2924294 · Cited by 262
Geng, X., Liu, T.-Y., Qin, T., & Li, H. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277811 · Cited by 255
A novel community detection based genetic algorithm for feature selection
(2021) · doi:10.1186/s40537-020-00398-3 · Cited by 197
Couceiro, R., Carvalho, P., Paiva, R. P., Henriques, J., & Muehlsteff, J. (2012) · 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/embc.2012.6346497 · Cited by 33
Stress and emotion recognition using log-Gabor filter analysis of speech spectrograms
He, L., Lech, M., Maddage, N., & Allen, N. (2009) · 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops · doi:10.1109/acii.2009.5349454 · Cited by 29
Environmental sound classification using log-Gabor filter
Souli, S., & Lachiri, Z. (2012) · 2012 IEEE 11th International Conference on Signal Processing · doi:10.1109/icosp.2012.6491621 · Cited by 3
Metadata
- Authors
- Kwak, N., & Choi, C.-H.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 2002
- Volume
- 13
- Issue
- 1
- Pages
- 143-159
- ISSN
- 1045-9227 (ISSN-L)
- OpenAlex
- W2113890143
- Cited by
- 938
- References
- 28
- FWCI
- 19.40
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.