The DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
A Review of Feature Selection and Its Methods
Open accessAbstract
Nowadays, being in digital era the data generated by various applications are increasing drastically both row-wise and column wise; this creates a bottleneck for analytics and also increases the burden of machine learning algorithms that work for pattern recognition. This cause of dimensionality can be handled through reduction techniques. The Dimensionality Reduction (DR) can be handled in two ways namely Feature Selection (FS) and Feature Extraction (FE). This paper focuses on a survey of feature selection methods, from this extensive survey we can conclude that most of the FS methods use static data. However, after the emergence of IoT and web-based applications, the data are generated dynamically and grow in a fast rate, so it is likely to have noisy data, it also hinders the performance of the algorithm. With the increase in the size of the data set, the scalability of the FS methods becomes jeopardized. So the existing DR algorithms do not address the issues with the dynamic data. Using FS methods not only reduces the burden of the data but also avoids overfitting of the model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Particle swarm optimization: An overview
Poli, R., Kennedy, J., & Blackwell, T. (2007) · Swarm Intelligence · doi:10.1007/s11721-007-0002-0 · Cited by 21,101
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Goldberg, D. E., & Shakespeare, W. (2002) · Cited by 16,088
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
Wrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947
(2019) · Handbook of Machine Learning · doi:10.1142/9789811205675_0004 · Cited by 6,270
A Comparative Study on Feature Selection in Text Categorization
Yang, Y., & Pedersen, J. (1997) · Cited by 4,790
Future paths for integer programming and links to artificial intelligence
Glover, F. (1986) · Computers & Operations Research · doi:10.1016/0305-0548(86)90048-1 · Cited by 4,181
Thirteen Ways to Look at the Correlation Coefficient
Lee Rodgers, J., & Nicewander, W. A. (1988) · The American Statistician · doi:10.1080/00031305.1988.10475524 · Cited by 4,052
Feature selection for classification
DASH, M., & LIU, H. (1997) · Intelligent Data Analysis · doi:10.1016/s1088-467x(97)00008-5 · Cited by 3,574
Semi-supervised learning using Gaussian fields and harmonic functions
Zhu, X., Zoubin Ghahramani, A., & Lafferty, J. (2003) · Cited by 3,509
Floating search methods in feature selection
Pudil, P., Novovičová, J., & Kittler, J. (1994) · Pattern Recognition Letters · doi:10.1016/0167-8655(94)90127-9 · Cited by 3,098
A Practical Approach to Feature Selection
Kira, K., & Rendell, L. A. (1992) · Machine Learning Proceedings 1992 · doi:10.1016/b978-1-55860-247-2.50037-1 · Cited by 2,978
Estimating attributes: Analysis and extensions of RELIEF
Kononenko, I. (1994) · Lecture Notes in Computer Science · doi:10.1007/3-540-57868-4_57 · Cited by 2,958
Irrelevant Features and the Subset Selection Problem
John, G. H., Kohavi, R., & Pfleger, K. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50023-4 · Cited by 2,368
Feature selection: evaluation, application, and small sample performance
Jain, A., & Zongker, D. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.574797 · Cited by 2,171
Instance-based learning algorithms
Aha, D. W., Kibler, D., & Albert, M. K. (1991) · Machine Learning · doi:10.1007/bf00153759 · Cited by 2,163
Using mutual information for selecting features in supervised neural net learning
Battiti, R. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.298224 · Cited by 2,148
An Automatic Method for Solving Discrete Programming Problems
Land, A. H., & Doig, A. G. (2010) · 50 Years of Integer Programming 1958-2008 · doi:10.1007/978-3-540-68279-0_5 · Cited by 1,988
Efficient Feature Selection via Analysis of Relevance and Redundancy
Yu, L., & Liu, H. (2004) · doi:10.5555/1005332.1044700 · Cited by 1,983
Laplacian Score for Feature Selection
He, X., Cai, D., & Niyogi, P. (2005) · Cited by 1,962
An Automatic Method of Solving Discrete Programming Problems
Land, A. H., & Doig, A. G. (1960) · Econometrica · doi:10.2307/1910129 · Cited by 1,942
Measuring Statistical Dependence with Hilbert-Schmidt Norms
Gretton, A., Bousquet, O., Smola, A., & Schölkopf, B. (2005) · Lecture Notes in Computer Science · doi:10.1007/11564089_7 · Cited by 1,560
Unsupervised feature selection using feature similarity
Mitra, P., Murthy, C. A., & Pal, S. K. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990133 · Cited by 1,460
Normalized Mutual Information Feature Selection
Estevez, P. A., Tesmer, M., Perez, C. A., & Zurada, J. M. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005601 · Cited by 1,288
A Branch and Bound Algorithm for Feature Subset Selection
Narendra, & Fukunaga (1977) · IEEE Transactions on Computers · doi:10.1109/tc.1977.1674939 · Cited by 1,245
Unsupervised feature selection for multi-cluster data
Cai, D., Zhang, C., & He, X. (2010) · Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1835804.1835848 · Cited by 1,112
Learning from Labeled and Unlabeled Data using Graph Mincuts
Blum, A. L., & Chawla, S. (2018) · doi:10.1184/r1/6606860 · Cited by 928
Spectral feature selection for supervised and unsupervised learning
Zhao, Z., & Liu, H. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273641 · Cited by 906
A probabilistic approach to feature selection - a filter solution
Liu, H., & Setiono, R. (1996) · Cited by 665
A Fast Clustering-Based Feature Subset Selection Algorithm for High-Dimensional Data
Song, Q., Ni, J., & Wang, G. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.181 · Cited by 663
Chaotic simulated annealing by a neural network model with transient chaos
Chen, L., & Aihara, K. (1995) · Neural Networks · doi:10.1016/0893-6080(95)00033-v · Cited by 661
Building an Intrusion Detection System Using a Filter-Based Feature Selection Algorithm
Ambusaidi, M. A., He, X., Nanda, P., & Tan, Z. (2016) · IEEE Transactions on Computers · doi:10.1109/tc.2016.2519914 · Cited by 646
Input feature selection by mutual information based on Parzen window
Kwak, N., & Choi, C.-H. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1114861 · Cited by 641
Supervised, Unsupervised, and Semi-Supervised Feature Selection: A Review on Gene Selection
Ang, J. C., Mirzal, A., Haron, H., & Hamed, H. N. A. (2016) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2015.2478454 · Cited by 641
Feature subset selection in large dimensionality domains
Gheyas, I. A., & Smith, L. S. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2009.06.009 · Cited by 597
l 2,1 -norm regularized discriminative feature selection for unsupervised learning
Yang, Y. P., Shen, H. T., Ma, Z., Huang, Z. H., & Zhou, X. (2011) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · doi:10.5591/978-1-57735-516-8/ijcai11-267 · Cited by 549
Caruana, R., & Freitag, D. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50012-x · Cited by 545
Feature selection and analysis on correlated gas sensor data with recursive feature elimination
Yan, K., & Zhang, D. (2015) · Sensors and Actuators B: Chemical · doi:10.1016/j.snb.2015.02.025 · Cited by 516
Unsupervised Feature Selection Using Nonnegative Spectral Analysis
Li, Z., Yang, Y., Liu, J., Zhou, X., & Lu, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i1.8289 · Cited by 508
Prototype and Feature Selection by Sampling and Random Mutation Hill Climbing Algorithms
Skalak, D. B. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50043-x · Cited by 486
Mutual information-based feature selection for intrusion detection systems
Amiri, F., Rezaei Yousefi, M., Lucas, C., Shakery, A., & Yazdani, N. (2011) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2011.01.002 · Cited by 471
Towards a theoretical foundation for Laplacian-based manifold methods
Belkin, M., & Niyogi, P. (2008) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2007.08.006 · Cited by 464
Generalized Fisher Score for Feature Selection
Gu, Q., Li, Z., & Han, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.3725 · Cited by 439
Zhang, Y., Wang, S., Phillips, P., & Ji, G. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.03.015 · Cited by 431
ON AUTOMATIC FEATURE SELECTION
SIEDLECKI, W., & SKLANSKY, J. (1988) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001488000145 · Cited by 392
Feature Mining for Hyperspectral Image Classification
Jia, X., Kuo, B.-C., & Crawford, M. M. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2229082 · Cited by 383
A GA-LR wrapper approach for feature selection in network intrusion detection
Khammassi, C., & Krichen, S. (2017) · Computers & Security · doi:10.1016/j.cose.2017.06.005 · Cited by 382
Supervised feature selection via dependence estimation
Song, L., Smola, A., Gretton, A., Borgwardt, K. M., & Bedo, J. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273600 · Cited by 379
Trace ratio criterion for feature selection
Nie, F., Xiang, S., Jia, Y., Zhang, C., & Yan, S. (2008) · Cited by 356
Jirapech-Umpai, T., & Aitken, S. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-148 · Cited by 328
Spectral Embedded Clustering: A Framework for In-Sample and Out-of-Sample Spectral Clustering
Nie, F., Zeng, Z., Tsang, I. W., Xu, D., & Zhang, C. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2162000 · Cited by 325
Unsupervised feature selection by regularized self-representation
Zhu, P., Zuo, W., Zhang, L., Hu, Q., & Shiu, S. C. K. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2014.08.006 · Cited by 323
Semi-supervised Feature Selection via Spectral Analysis
Zhao, Z., & Liu, H. (2007) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972771.75 · Cited by 311
Comparative study of techniques for large-scale feature selection
(1994) · Machine Intelligence and Pattern Recognition · doi:10.1016/b978-0-444-81892-8.50040-7 · Cited by 307
Data Visualization and Feature Selection: New Algorithms for Nongaussian Data
Yang, H. H., & Moody, J. E. (1999) · Cited by 307
From Gestalt Theory to Image Analysis: A Probabilistic Approach
Desolneux, A., Moisan, L., & Morel, J.-M. (2008) · Interdisciplinary Applied Mathematics · doi:10.1007/978-0-387-74378-3 · Cited by 300
Roffo, G., Melzi, S., & Cristani, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.478 · Cited by 290
A neural network model as a globally coupled map and applications based on chaos
Nozawa, H. (1992) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.165880 · Cited by 280
Zhang, Y., Dong, Z., Phillips, P., Wang, S., Ji, G., Yang, J., & Yuan, T.-F. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00066 · Cited by 279
Jin, X., Xu, A., Bie, R., & Guo, P. (2006) · Lecture Notes in Computer Science · doi:10.1007/11691730_11 · Cited by 261
Feature Subset Selection and Order Identification for Unsupervised Learning
Dy, J., & Brodley, C. E. (2000) · Cited by 234
Detection of Life-Threatening Arrhythmias Using Feature Selection and Support Vector Machines
Alonso-Atienza, F., Morgado, E., Fernandez-Martinez, L., Garcia-Alberola, A., & Rojo-Alvarez, J. L. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2290800 · Cited by 222
The attribute selection problem in decision tree generation
Fayyad, U. M., & Irani, K. B. (1992) · National Conference on Artificial Intelligence · Cited by 218
Wang, L., Li, S., Tian, F., & Fu, X. (2004) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2004.829778 · Cited by 169
Feature Selection for High-Dimensional Data — A Pearson Redundancy Based Filter
Biesiada, J., & Duch, W. (2007) · Advances in intelligent and soft computing · doi:10.1007/978-3-540-75175-5_30 · Cited by 161
Feature Subset Selection Using Ant Colony Optimization
Al-Ani, A. (2008) · UTS ePRESS (University of Technology Sydney) · doi:10.5281/zenodo.1072065 · Cited by 160
On the Use of Variable Complementarity for Feature Selection in Cancer Classification
Meyer, P. E., & Bontempi, G. (2006) · Lecture Notes in Computer Science · doi:10.1007/11732242_9 · Cited by 159
Graph self-representation method for unsupervised feature selection
Hu, R., Zhu, X., Cheng, D., He, W., Yan, Y., Song, J., & Zhang, S. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.05.081 · Cited by 159
A Hybrid GA/SVM Approach for Gene Selection and Classification of Microarray Data
Huerta, E. B., Duval, B., & Hao, J. (2006) · Lecture notes in computer science · doi:10.1007/11732242_4 · Cited by 154
Literature Review on Feature Selection Methods for High-Dimensional Data
Singh, D. A. A. G., Appavu, S., & Leavline, E. J. (2016) · International Journal of Computer Applications · doi:10.5120/ijca2016908317 · Cited by 143
Feature selection from huge feature sets
Bins, J., & Draper, B. A. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937619 · Cited by 140
Graph transduction via alternating minimization
Wang, J., Jebara, T., & Chang, S. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390300 · Cited by 125
Wrapper Feature Subset Selection for Dimension Reduction Based on Ensemble Learning Algorithm
Panthong, R., & Srivihok, A. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.12.117 · Cited by 116
Web and Personal Image Annotation by Mining Label Correlation With Relaxed Visual Graph Embedding
Yang, Y., Wu, F., Nie, F., Shen, H. T., Zhuang, Y., & Hauptmann, A. G. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2169269 · Cited by 115
Yao, C., Liu, Y., Jiang, B., Han, J., & Han, J. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2733200 · Cited by 103
Wrapper-based gene selection with Markov blanket
Wang, A., An, N., Yang, J., Chen, G., Li, L., & Alterovitz, G. (2016) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2016.12.002 · Cited by 90
Discriminative Gabor Feature Selection for Hyperspectral Image Classification
Shen, L., Zhu, Z., Jia, S., Zhu, J., & Sun, Y. (2012) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2012.2191761 · Cited by 74
Unsupervised feature selection via low-rank approximation and structure learning
Wang, S., & Wang, H. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.03.002 · Cited by 69
Tabu Search and Binary Particle Swarm Optimization for Feature Selection Using Microarray Data
Chuang, L., Yang, C., & Yang, C.-H. (2009) · Journal of Computational Biology · doi:10.1089/cmb.2007.0211 · Cited by 62
Gene Selection Using Wilcoxon Rank Sum Test and Support Vector Machine for Cancer Classification
Liao, C., Shutao Li, A., & Luo, Z. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74377-4_7 · Cited by 61
Mohsenzadeh, Y., Sheikhzadeh, H., Reza, A. M., Bathaee, N. S., & Kalayeh, M. M. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2260736 · Cited by 59
Optimal Sensor Configuration and Feature Selection for AHU Fault Detection and Diagnosis
Li, D., Zhou, Y., Hu, G., & Spanos, C. J. (2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2644669 · Cited by 58
SlimPLS: A Method for Feature Selection in Gene Expression-Based Disease Classification
Gutkin, M., Ron Shamir, A., & Dror, G. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006416 · Cited by 54
CSE-92-18 - An Evaluation of Feature Selection Methodsand Their Application to Computer Security
Doak, J. (1992) · eScholarship (California Digital Library) · Cited by 54
Unsupervised feature selection via Diversity-induced Self-representation
Liu, Y., Liu, K., Zhang, C., Wang, J., & Wang, X. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.09.043 · Cited by 45
Vinh, L. T., Thang, N. D., & Lee, Y.-K. (2010) · IEEE/IPSJ International Symposium on Applications and the Internet (SAINT) · doi:10.1109/saint.2010.50 · Cited by 43
Ant Colony Optimization for the Traveling Salesman Problem Based on Ants with Memory
Li, B., Wang, L., & Song, W. (2008) · International Conference on Natural Computation (ICNC) · doi:10.1109/icnc.2008.354 · Cited by 42
Martín-Smith, P., Ortega, J., Asensio-Cubero, J., Gan, J. Q., & Ortíz, A. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.09.123 · Cited by 36
Mirzaei, A., Mohsenzadeh, Y., & Sheikhzadeh, H. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.02.057 · Cited by 27
Korfiatis, V. C., Asvestas, P. A., Delibasis, K. K., & Matsopoulos, G. K. (2013) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2013.09.016 · Cited by 18
Cited by
Benchmark for filter methods for feature selection in high-dimensional classification data
Bommert, A., Sun, X., Bischl, B., Rahnenführer, J., & Lang, M. (2020) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2019.106839 · Cited by 725
Kumar, P., Kumar, R., Srivastava, G., Gupta, G. P., Tripathi, R., Gadekallu, T. R., & Xiong, N. N. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3089435 · Cited by 360
A comprehensive survey on recent metaheuristics for feature selection
Dokeroglu, T., Deniz, A., & Kiziloz, H. E. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.04.083 · Cited by 356
Polat, H., Polat, O., & Cetin, A. (2020) · Sustainability · doi:10.3390/su12031035 · Cited by 265
Benchmark of filter methods for feature selection in high-dimensional gene expression survival data
Bommert, A., Welchowski, T., Schmid, M., & Rahnenführer, J. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab354 · Cited by 182
Metadata
- Authors
- Venkatesh, B., & Anuradha, J.
- Venue
- Cybernetics and Information Technologies
- Publisher
- Walter de Gruyter GmbH
- Published
- 2019-03-01
- Volume
- 19
- Issue
- 1
- Pages
- 3-26
- ISSN
- 1311-9702 (ISSN-L)
- 1314-4081
- OpenAlex
- W2925507233
- Cited by
- 631
- References
- 92
- FWCI
- 22.68
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.