A survey on feature selection methods

Particle swarm optimization

Kennedy, J., & Eberhart, R. (2002) · Proceedings of ICNN'95 - International Conference on Neural Networks · doi:10.1109/icnn.1995.488968 · Cited by 58,192

Genetic algorithms in search, optimization, and machine learning

(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,178

LIBSVM: A library for support vector machines

Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918

An Introduction to the Bootstrap

Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500

Neural Networks: A Comprehensive Foundation

Haykin, S. (1998) · Cited by 30,070

Genetic Algorithms in Search, Optimization and Machine Learning

Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391

Genetic Algorithms

Goldberg, D. E., & Shakespeare, W. (2002) · Cited by 16,088

A training algorithm for optimal margin classifiers

Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992

Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy

Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,818

Gene selection for cancer classification using support vector machines

Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954

Wrappers for feature subset selection

Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 9,096

An introduction to variable and feature selection

GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 8,354

Independent component analysis, A new concept?

Comon, P. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90029-9 · Cited by 8,324

Neural networks: A comprehensive foundation

Tadeusiewicz, R. (1995) · Control Engineering Practice · doi:10.1016/0967-0661(95)90080-2 · Cited by 7,217

An Introduction to Variable and Feature Selection.

Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576

A Comparative Study on Feature Selection in Text Categorization

Yang, Y., & Pedersen, J. (1997) · Cited by 4,749

Semi-Supervised Learning Literature Survey

Zhu, X. (2005) · Cited by 3,828

Selection of relevant features and examples in machine learning

Blum, A. L., & Pat Langley, B. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00063-5 · Cited by 3,294

Floating search methods in feature selection

Pudil, P., Novovičová, J., & Kittler, J. (1994) · Pattern Recognition Letters · doi:10.1016/0167-8655(94)90127-9 · Cited by 3,130

MINIMUM REDUNDANCY FEATURE SELECTION FROM MICROARRAY GENE EXPRESSION DATA

Ding, C. H. Q., & PENG, H. (2005) · Journal of Bioinformatics and Computational Biology · doi:10.1142/s0219720005001004 · Cited by 2,775

Using mutual information for selecting features in supervised neural net learning

Battiti, R. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.298224 · Cited by 2,629

Irrelevant Features and the Subset Selection Problem

John, G. H., Kohavi, R., & Pfleger, K. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-335-6.50023-4 · Cited by 2,403

An extensive empirical study of feature selection metrics for text classification

Forman, G. (2003) · doi:10.5555/944919.944974 · Cited by 2,400

The feature selection problem: traditional methods and a new algorithm

Kira, K., & Rendell, L. A. (1992) · National Conference on Artificial Intelligence · Cited by 1,828

Introduction to Machine Learning

(2019) · Series in machine perception and artificial intelligence · doi:10.1142/9789811201967_0001 · Cited by 1,638

In Defense of One-Vs-All Classification

Rifkin, R. M., & Junior, A. B. D. R. K. (2004) · Cited by 1,598

Unsupervised feature selection using feature similarity

Mitra, P., Murthy, C. A., & Pal, S. K. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990133 · Cited by 1,472

Feature subset selection using a genetic algorithm

Yang, J., & Honavar, V. (1998) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.671091 · Cited by 1,368

A Branch and Bound Algorithm for Feature Subset Selection

Narendra, & Fukunaga (1977) · IEEE Transactions on Computers · doi:10.1109/tc.1977.1674939 · Cited by 1,260

The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination

Eshelman, L. J. (1991) · Foundations of genetic algorithms · doi:10.1016/b978-0-08-050684-5.50020-3 · Cited by 1,042

Elimination of Uninformative Variables for Multivariate Calibration

Centner, V., Massart, D.-L., de Noord, O. E., de Jong, S., Vandeginste, B. G. M., & Sterna, C. (1996) · Analytical Chemistry · doi:10.1021/ac960321m · Cited by 1,002

Fast Binary Feature Selection with Conditional Mutual Information

Fleuret, F. (2004) · doi:10.5555/1005332.1044711 · Cited by 986

Input feature selection for classification problems

Kwak, N., & Choi, C. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.977291 · Cited by 940

Comparison of algorithms that select features for pattern classifiers

Kudo, M., & Sklansky, J. (2000) · Pattern Recognition · doi:10.1016/s0031-3203(99)00041-2 · Cited by 905

In Defense of One-Vs-All Classification

RifkinRyan, & KlautauAldebaro (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1005336 · Cited by 895

Selection of Relevant Features in Machine Learning.

Langley, P. (1994) · Defense Technical Information Center (DTIC) · doi:10.21236/ada292575 · Cited by 714

Introduction to Machine Learning

Ayodele, T. O. (2010) · InTech eBooks · doi:10.5772/9394 · Cited by 666

Simultaneous feature selection and clustering using mixture models

Law, M. H. C., Figueiredo, M. A. T., & Jain, A. K. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.71 · Cited by 665

A probabilistic approach to feature selection - a filter solution

Liu, H., & Setiono, R. (1996) · Cited by 656

Stability of feature selection algorithms: a study on high-dimensional spaces

Kalousis, A., Prados, J., & Hilario, M. (2006) · Knowledge and Information Systems · doi:10.1007/s10115-006-0040-8 · Cited by 642

A survey on filter techniques for feature selection in gene expression microarray analysis

Lazar, C., Taminau, J., Meganck, S., Steenhoff, D., Coletta, A., Molter, C., de Schaetzen, V., Duque, R., Bersini, H., & Nowe, A. (2012) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2012.33 · Cited by 619

Feature extraction by non parametric mutual information maximization

Torkkola, K. (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944981 · Cited by 611

Improved binary PSO for feature selection using gene expression data

Chuang, L., Chang, H., Tu, C.-J., & Yang, C. (2007) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2007.09.005 · Cited by 596

Robust biomarker identification for cancer diagnosis with ensemble feature selection methods

Abeel, T., Helleputte, T., de Peer, Y. V., Dupont, P., & Saeys, Y. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp630 · Cited by 585

Overfitting in making comparisons between variable selection methods

Reunanen, J. (2003) · doi:10.5555/944919.944978 · Cited by 453

The Influence of Feature Selection Methods on Accuracy, Stability and Interpretability of Molecular Signatures

Haury, A.-C., Gestraud, P., & Vert, J. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028210 · Cited by 418

Discriminative Semi-Supervised Feature Selection Via Manifold Regularization

Xu, Z., King, I., Lyu, M. R.-T., & Jin, R. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2047114 · Cited by 390

Neural-network feature selector

Setiono, R., & Liu, H. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572104 · Cited by 381

SVM-RFE With MRMR Filter for Gene Selection

Mundra, P. A., & Rajapakse, J. C. (2009) · IEEE Transactions on NanoBioscience · doi:10.1109/tnb.2009.2035284 · Cited by 334

Comparative study of techniques for large-scale feature selection

Ferri, F. J., Pudil, P., Hatef, M., & Kittler, J. (1994) · Machine intelligence and pattern recognition · doi:10.1016/b978-0-444-81892-8.50040-7 · Cited by 307

Semi-supervised Feature Selection via Spectral Analysis

Zhao, Z., & Liu, H. (2007) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972771.75 · Cited by 305

Genetic Algorithms as a Tool for Wavelength Selection in Multivariate Calibration

Jouan-Rimbaud, D., Massart, D.-L., Leardi, R., & de Noord, O. E. (1995) · Analytical Chemistry · doi:10.1021/ac00119a015 · Cited by 305

Adaptive floating search methods in feature selection

Somol, P., Pudil, P., Novovičová, J., & Paclı́k, P. (1999) · Pattern Recognition Letters · doi:10.1016/s0167-8655(99)00083-5 · Cited by 305

Ranking a random feature for variable and feature selection

Stoppiglia, H., Dreyfus, G., Dubois, R., & Oussar, Y. (2003) · doi:10.5555/944919.944980 · Cited by 286

Distributional word clusters vs. words for text categorization

Bekkerman, R., El‐Yaniv, R., Tishby, N., & Winter, Y. (2003) · doi:10.5555/944919.944969 · Cited by 279

Feature Selection and Classification of Hyperspectral Images With Support Vector Machines

Archibald, R. K., & Fann, G. I. (2007) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2007.905116 · Cited by 278

Combined SVM-Based Feature Selection and Classification

Neumann, J. K., Schnörr, C., & Steidl, G. (2005) · Machine Learning · doi:10.1007/s10994-005-1505-9 · Cited by 248

Gene selection in cancer classification using PSO/SVM and GA/SVM hybrid algorithms

Alba, E., García-Nieto, J., Jourdan, L., & Talbi, E. (2007) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2007.4424483 · Cited by 246

Further Research on Feature Selection and Classification Using Genetic Algorithms

Punch, W. F., Goodman, E. D., Pei, M., Chia-Shun, L., Hovland, P., & Enbody, R. J. (1993) · Cited by 242

CLIFF: clustering of high-dimensional microarray data via iterative feature filtering using normalized cuts

Xing, E. P., & Karp, R. M. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.suppl_1.s306 · Cited by 202

A Methodology for Feature Selection Using Multiobjective Genetic Algorithms for Handwritten Digit String Recognition

Oliveira, L. S., Sabourin, R., Bortolozzi, F., & Suen, C. Y. (2003) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s021800140300271x · Cited by 157

Robust Feature Selection for Microarray Data Based on Multicriterion Fusion

Yang, F., & Mao, K. (2010) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2010.103 · Cited by 147

Evaluating Stability and Comparing Output of Feature Selectors that Optimize Feature Subset Cardinality

Somol, P., & Novovičová, J. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.34 · Cited by 139

An improvement on floating search algorithms for feature subset selection

Nakariyakul, S., & Casasent, D. P. (2008) · Pattern Recognition · doi:10.1016/j.patcog.2008.11.018 · Cited by 138

Unsupervised feature evaluation: a neuro-fuzzy approach

Pal, S. K., De, R. K., & Basak, J. K. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.839007 · Cited by 137

Solutions to Instability Problems with Sequential Wrapper-based Approaches to Feature Selection

Dunne, K., Cunningham, P., & Azuaje, F. J. (2002) · Cited by 132

FEATURE SELECTION USING PSO-SVM

Tu, C.-H., Chuang, L., Chang, J.-Y., & Yang, C. (2006) · Cited by 115

Performing Feature Selection With Multilayer Perceptrons

Romero, E. E., & Sopena, J. M. G. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2007.909535 · Cited by 107

Feature Selection Based on Class-Dependent Densities for High-Dimensional Binary Data

Javed, K., Babri, H. A., & Saeed, M. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.263 · Cited by 105

Variable selection in wavelet regression models

Alsberg, B. K., Woodward, A. M., Winson, M. K., Rowland, J. J., & Kell, D. B. (1998) · Analytica Chimica Acta · doi:10.1016/s0003-2670(98)00194-9 · Cited by 97

A two-stage evolutionary algorithm for variable selection in the development of RBF neural network models

Alexandridis, A., Patrinos, P., Sarimveis, H., & Tsekouras, G. E. (2004) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2004.06.004 · Cited by 73

Benefitting from the variables that variable selection discards

Caruana, R., & de Sa, V. R. (2003) · doi:10.5555/944919.944972 · Cited by 70

Feature selection based on the approximation of class densities by finite mixtures of special type

Pudil, P., Novovičová, J., Choakjarernwanit, N., & Kittler, J. (1995) · Pattern Recognition · doi:10.1016/0031-3203(94)00009-b · Cited by 67

Feature-based image registration by means of the CHC evolutionary algorithm

Cordón, Ó., Damas, S., & Santamaría, J. (2006) · Image and Vision Computing · doi:10.1016/j.imavis.2006.02.002 · Cited by 65

A Comparison of Feature Selection Methods for the Detection of Breast Cancers in Mammograms: Adaptive Sequential Floating Search vs. Genetic Algorithm

Sun, Y., Babbs, C. F., & Delp, E. J. (2005) · doi:10.1109/iembs.2005.1615996 · Cited by 64

Radial basis function classifiers to help in the diagnosis of the obstructive sleep apnoea syndrome from nocturnal oximetry

Marcos, J. V., Hornero, R., Álvarez, D., del Campo, F., López, M., & Zamarrón, C. (2007) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-007-0280-0 · Cited by 39

Feature selection for steganalysis using the Mahalanobis distance

Davidson, J. L., & Jalan, J. (2010) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.841074 · Cited by 27

Randomized Variable Elimination

Stracuzzi, D. J., & Utgoff, P. E. (2002) · doi:10.5555/1005332.1044704 · Cited by 27

The Application of Dynamic K-means Clustering Algorithm in the Center Selection of RBF Neural Networks

He, J., & Liu, H. (2009) · International Conference on Genetic and Evolutionary Computing · doi:10.1109/wgec.2009.112 · Cited by 19

A study of recent classification algorithms and a novel approach for EEG data classification

Çinar, E. M., & Sahin, F. (2010) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2010.5642424 · Cited by 14

Uninformation Variable Elimination and Successive Projections Algorithm in Mid-Infrared Spectral Wavenumber Selection

Wu, D., Zhou, Z., Feng, S., & He, Y. (2009) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp.2009.5303610 · Cited by 11

In-vivo fault prediction for RF generators using variable elimination and state-of-the-art classifiers

Chandrashekar, G., & Sahin, F. (2012) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2012.6377999 · Cited by 7

Criterion in selecting the clustering algorithm in radial basis functional link nets

Loong, A. S., Choon, O. H., & Chin, L. H. (2008) · WSEAS TRANSACTIONS on SYSTEMS archive · Cited by 6

HUMOR KAO ELEMENT SAVREMENE POLITIČKE KOMUNIKACIJE: IZBORNE KAMPANJE SRBIJE I ŠPANIJE

Stošić, S., & Bjelja, D. (2012) · Politička revija · doi:10.22182/pr.3332012.16 · Cited by 1

Feature Selection: A Data Perspective

Li, J., Cheng, K., Wang, S., Morstatter, F., Trevino, R. P., Tang, J., & Liu, H. (2018) · ACM Computing Surveys · doi:10.1145/3136625 · Cited by 2,442

Binary grey wolf optimization approaches for feature selection

Emary, E., Zawbaa, H. M., & Hassanien, A. E. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.06.083 · Cited by 1,448

Relief-based feature selection: Introduction and review

Urbanowicz, R. J., Meeker, M., La Cava, W., Olson, R. S., & Moore, J. H. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.07.014 · Cited by 1,311

Hybrid Whale Optimization Algorithm with simulated annealing for feature selection

Mafarja, M. M., & Mirjalili, S. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.04.053 · Cited by 1,150

Global soil pollution by toxic metals threatens agriculture and human health

Hou, D., Jia, X., Wang, L., McGrath, S. P., Zhu, Y., Hu, Q., Zhao, F. J., Bank, M. S., O’Connor, D., & Nriagu, J. O. (2025) · Science · doi:10.1126/science.adr5214 · Cited by 1,121

Feature selection methods in machine learning: A review

Lalit, R., ., N., Nitin, N., & Хабибуллин, А. Р. (2025) · CRC Press eBooks · doi:10.1201/9781003606208-100 · Cited by 2

Feature Selection

Bhattacharyya, D. K., & Kalita, J. K. (2013) · Chapman & Hall/CRC eBooks · doi:10.1201/b15088-13 · Cited by 1

Effective Feature Selection For High Dimensional Data using Fast Algorithm

Abinaya, I. P., & Sutha, J. (2014) · Cited by 5

Feature Selection in Machine Learning: Methods and Comparison

Kaur, A., Guleria, K., & Trivedi, N. K. (2021) · International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE) · doi:10.1109/icacite51222.2021.9404623 · Cited by 79

An introduction to variable and feature selection

GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 8,354