The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Stability of feature selection algorithm: A review
Open accessAbstract
Feature selection technique is a knowledge discovery tool which provides an understanding of the problem through the analysis of the most relevant features. Feature selection aims at building better classifier by listing significant features which also helps in reducing computational overload. Due to existing high throughput technologies and their recent advancements are resulting in high dimensional data due to which feature selection is being treated as handy and mandatory in such datasets. This actually questions the interpretability and stability of traditional feature selection algorithms. The high correlation in features frequently produces multiple equally optimal signatures, which makes traditional feature selection method unstable and thus leading to instability which reduces the confidence of selected features. Stability is the robustness of the feature preferences it produces to perturbation of training samples. Stability indicates the reproducibility power of the feature selection method. High stability of the feature selection algorithm is equally important as the high classification accuracy when evaluating feature selection performance. In this paper, we provide an overview of feature selection techniques and instability of the feature selection algorithm. We also present some of the solutions which can handle the different source of instability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Storn, R., & Price, K. (1997) · Journal of Global Optimization · doi:10.1023/a:1008202821328 · Cited by 29,569
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2013.12.007 · Cited by 19,343
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903
A survey on feature selection methods
Chandrashekar, G., & Sahin, F. (2014) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2013.11.024 · Cited by 5,189
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · cited 3×
“Stability helps in the trade-off between bias-variance of the classification error rate (Geman et al., 1992).”
InfluentialBrest, J., Greiner, S., Boskovic, B., Mernik, M., & Zumer, V. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.872133 · Cited by 3,077
Sparsity and Smoothness Via the Fused Lasso
Tibshirani, R., Saunders, M., Rosset, S., Zhu, J., & Knight, K. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00490.x · Cited by 2,724
Meinshausen, N., & Bühlmann, P. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00740.x · Cited by 2,215
Selection bias in gene extraction on the basis of microarray gene-expression data
Ambroise, C., & McLachlan, G. J. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.102102699 · Cited by 1,480
Machine Learning methods for Quantitative Radiomic Biomarkers
Parmar, C., Grossmann, P., Bussink, J., Lambin, P., & Aerts, H. J. W. L. (2015) · Scientific Reports · doi:10.1038/srep13087 · Cited by 1,019
Group lasso with overlap and graph lasso
Jacob, L., Obozinski, G., & Vert, J.-P. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553431 · Cited by 833
Feature Selection: A literature Review
Kumar, V. (2014) · The Smart Computing Review · doi:10.6029/smartcr.2014.03.007 · Cited by 659
Feature selection using Joint Mutual Information Maximisation
Bennasar, M., Hicks, Y., & Setchi, R. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.07.007 · Cited by 659
Stability of feature selection algorithms: a study on high-dimensional spaces
Kalousis, A., Prados, J., & Hilario, M. (2007) · Knowledge and Information Systems · doi:10.1007/s10115-006-0040-8 · Cited by 614
Is cross-validation valid for small-sample microarray classification?
Braga-Neto, U. M., & Dougherty, E. R. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg419 · Cited by 597
Robust biomarker identification for cancer diagnosis with ensemble feature selection methods
Abeel, T., Helleputte, T., Van de Peer, Y., Dupont, P., & Saeys, Y. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp630 · Cited by 574
(2007) · The MIT Press eBooks · doi:10.7551/mitpress/7443.001.0001 · Cited by 525
Feature selection and analysis on correlated gas sensor data with recursive feature elimination
Yan, K., & Zhang, D. (2015) · Sensors and Actuators B: Chemical · doi:10.1016/j.snb.2015.02.025 · Cited by 516
Mass Spectrometry–Based Proteomics and Network Biology
Bensimon, A., Heck, A. J. R., & Aebersold, R. (2012) · Annual Review of Biochemistry · doi:10.1146/annurev-biochem-072909-100424 · Cited by 410
Recent advances in feature selection and its applications
Li, Y., Li, T., & Liu, H. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1059-8 · Cited by 400
Haury, A.-C., Gestraud, P., & Vert, J.-P. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028210 · Cited by 392
Stable feature selection for biomarker discovery
He, Z., & Yu, W. (2010) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2010.07.002 · Cited by 309
Is feature selection secure against training data poisoning?
Huang, X. X., Biggio, B., Brown, G., Fumera, G., Eckert, C. M., & Roli, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.07933 · Cited by 269
Feature Selection with the R Package MXM : Discovering Statistically Equivalent Feature Subsets
Lagani, V., Athineou, G., Farcomeni, A., Tsagris, M., & Tsamardinos, I. (2017) · Journal of Statistical Software · doi:10.18637/jss.v080.i07 · Cited by 208
On dimensionality and sample size in statistical pattern classification
Kanal, L., & Chandrasekaran, B. (1971) · Pattern Recognition · doi:10.1016/0031-3203(71)90013-6 · Cited by 197
Sparse Algorithms Are Not Stable: A No-Free-Lunch Theorem
Xu, H., Caramanis, C., & Mannor, S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.177 · Cited by 196
Mostafa, S. A., Mustapha, A., Mohammed, M. A., Hamed, R. I., Arunkumar, N., Abd Ghani, M. K., Jaber, M. M., & Khaleefah, S. H. (2019) · Cognitive Systems Research · doi:10.1016/j.cogsys.2018.12.004 · Cited by 184
Graph self-representation method for unsupervised feature selection
Hu, R., Zhu, X., Cheng, D., He, W., Yan, Y., Song, J., & Zhang, S. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.05.081 · Cited by 159
Katrutsa, A., & Strijov, V. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.01.048 · Cited by 155
Robust Feature Selection for Microarray Data Based on Multicriterion Fusion
Yang, F., & Mao, K. (2010) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2010.103 · Cited by 147
Lahmiri, S., & Shmuel, A. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2018.08.029 · Cited by 146
Somol, P., & Novovičová, J. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.34 · Cited by 139
Consensus group stable feature selection
Loscalzo, S., Yu, L., & Ding, C. H. Q. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557084 · Cited by 138
Kang, C., Huo, Y., Xin, L., Tian, B., & Yu, B. (2018) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2018.12.010 · Cited by 136
Variants of the Borda count method for combining ranked classifier hypotheses
van Erp, M., & Schomaker, L. (2000) · Cited by 134
Solutions to Instability Problems with Sequential Wrapper-based Approaches to Feature Selection
Dunne, K., Cunningham, P., & Azuaje, F. J. (2002) · Cited by 132
Sparse hashing for fast multimedia search
Zhu, X., Huang, Z. H., Cheng, H., Cui, J., & Shen, H. T. (2013) · ACM Transactions on Information Systems · doi:10.1145/2457465.2457469 · Cited by 125
An experimental comparison of feature selection methods on two-class biomedical datasets
Drotár, P., Gazda, J., & Smékal, Z. (2015) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2015.08.010 · Cited by 103
Stable feature selection for clinical prediction: Exploiting ICD tree structure using Tree-Lasso
Kamkar, I., Gupta, S., Phung, D., & Venkatesh, S. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.11.013 · Cited by 98
Sequential random k-nearest neighbor feature selection for high-dimensional data
Park, C. H., & Kim, S. B. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.10.044 · Cited by 97
Measuring the Stability of Feature Selection
Nogueira, S., & Brown, G. (2016) · ECML/PKDD · doi:10.1007/978-3-319-46227-1_28 · Cited by 88
Multi-Feature Based Network Revealing the Structural Abnormalities in Autism Spectrum Disorder
Zheng, W., Eilam‐Stock, T., Wu, T., Spagna, A., Chen, C., Hu, B., & Fan, J. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2890597 · Cited by 87
Evaluating feature-selection stability in next-generation proteomics
Goh, W. W. B., & Wong, L. (2016) · Journal of Bioinformatics and Computational Biology · doi:10.1142/s0219720016500293 · Cited by 84
A survey of the application of the cepstrum to structural modal analysis
Randall, R. B., Antoni, J., & Smith, W. A. (2018) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.08.059 · Cited by 78
Stable and Accurate Feature Selection
Gülgezen, G., Çataltepe, Z., & Lei, Y. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04180-8_47 · Cited by 67
FREL: A Stable Feature Selection Algorithm
Li, Y., Si, J., Zhou, G., Huang, S., & Chen, S. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2341627 · Cited by 67
SCoRS—A Method Based on Stability for Feature Selection and Mapping in Neuroimaging
Rondina, J. M., Hahn, T., Oliveira, L., Marquand, A. F., Dresler, T., Leitner, T., Fallgatter, A. J., Shawe-Taylor, J. S., & Mourão-Miranda, J. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2281398 · Cited by 65
Selvaraj, G., Kaliamurthi, S., Kaushik, A. C., Khan, A., Wei, Y.-K., Cho, W. C. S., Gu, K., & Wei, D. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.09.004 · Cited by 59
Wade, B., Joshi, S. H., Gutman, B. A., & Thompson, P. M. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.09.034 · Cited by 58
Finding consistent disease subnetworks using PFSNet
Lim, K. J., & Wong, L. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt625 · Cited by 52
A survey of stability analysis of feature subset selection techniques
Khoshgoftaar, T. M., Fazelpour, A., Wang, H., & Wald, R. (2013) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri.2013.6642502 · Cited by 51
Texture classification using feature selection and kernel-based techniques
Fernandez-Lozano, C., Seoane, J. A., Gestal, M., Gaunt, T. R., Dorado, J., & Campbell, C. (2015) · Soft Computing · doi:10.1007/s00500-014-1573-5 · Cited by 49
Ye, G., Chen, Y., & Xie, X. S. (2011) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 48
Ramondt, S., & Ramírez, A. S. (2018) · Patient Education and Counseling · doi:10.1016/j.pec.2018.07.020 · Cited by 47
Robust and stable gene selection via Maximum–Minimum Correntropy Criterion
Mohammadi, M., Noghabi, H. S., Hodtani, G. A., & Mashhadi, H. R. (2016) · Genomics · doi:10.1016/j.ygeno.2015.12.006 · Cited by 47
Proteomics Signature Profiling (PSP): A Novel Contextualization Approach for Cancer Proteomics
Goh, W. W. B., Lee, Y. H., Ramdzan, Z. M., Sergot, M. J., Chung, M. C. M., & Wong, L. (2012) · Journal of Proteome Research · doi:10.1021/pr200698c · Cited by 46
Finding consistent disease subnetworks across microarray datasets
Soh, D. C. L., Dong, D., Guo, Y., & Wong, L. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-s13-s15 · Cited by 44
ELITE: Ensemble of Optimal Input-Pruned Neural Networks Using TRUST-TECH
Wang, B., & Chiang, H. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2087354 · Cited by 39
A family of heuristic search algorithms for feature model optimization
Sánchez, L. E., Diaz-Pace, J. A., & Zunino, A. (2018) · Science of Computer Programming · doi:10.1016/j.scico.2018.12.002 · Cited by 39
Le Commerce et les Commercants.
J., H. S., & Guyot, Y. (1909) · Journal Of The Royal Statistical Society · doi:10.2307/2340233 · Cited by 38
A variance reduction framework for stable feature selection
Han, Y., & Lei, Y. (2012) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11152 · Cited by 37
Chen, G., Cao, M., Yu, J., Guo, X., & Shi, S. (2018) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2018.10.047 · Cited by 35
Feature Importance in Nonlinear Embeddings (FINE): Applications in Digital Pathology
Ginsburg, S. B., Lee, G., Ali, S., & Madabhushi, A. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2456188 · Cited by 33
Mobile app traffic flow feature extraction and selection for improving classification robustness
Liu, Z., Wang, R., Japkowicz, N., Cai, Y., Tang, D., & Cai, X. (2018) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2018.10.018 · Cited by 32
Stability of feature selection in classification issues for high-dimensional correlated data
Perthame, É., Friguet, C., & Causeur, D. (2015) · Statistics and Computing · doi:10.1007/s11222-015-9569-2 · Cited by 28
Khanji, C., Lalonde, L., Bareil, C., Lussier, M., Perreault, S., & Schnitzer, M. E. (2018) · Medical Care · doi:10.1097/mlr.0000000000001014 · Cited by 25
Tran, L., Kossaifi, J., Panagakis, Y., & Pantić, M. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01155-7 · Cited by 17
Marcone, R., Carrière, M., Rougemont, J., Oudot, S., Hess, K. P., & Brisken, C. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz052 · Cited by 16
Taylor, A., Steinberg, J., Andrews, T. S., & Webber, C. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu669 · Cited by 14
HUANG, G. T., Tsamardinos, I., Raghu, V. K., Kaminski, N., & Benos, P. V. (2014) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789814644730_0041 · Cited by 13
Stability in Biomarker Discovery: Does Ensemble Feature Selection Really Help?
Dessì, N., & Pes, B. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19066-2_19 · Cited by 12
Exploiting feature relationships towards stable feature selection
Kamkar, I., Gupta, S., Phung, D., & Venkatesh, S. (2015) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2015.7344859 · Cited by 11
Stable Feature Selection with Support Vector Machines
Kamkar, I., Gupta, S., Phung, D., & Venkatesh, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-26350-2_26 · Cited by 11
Quadratic Programming Optimization with Feature Selection for Nonlinear Models
Isachenko, R. V., & Strijov, V. (2018) · Lobachevskii Journal of Mathematics · doi:10.1134/s199508021809010x · Cited by 6
Low-rank unsupervised graph feature selection via feature self-representation
He, W., Zhu, X., Cheng, D., Hu, R., & Zhang, S. (2016) · Multimedia Tools and Applications · doi:10.1007/s11042-016-3937-6 · Cited by 5
Cited by
Zebari, R., Abdulazeez, A., Zeebaree, D., Zebari, D., & Saeed, J. (2020) · Journal of Applied Science and Technology Trends · doi:10.38094/jastt1224 · Cited by 918
Metaheuristic Algorithms on Feature Selection: A Survey of One Decade of Research (2009-2019)
Agrawal, P., Abutarboush, H. F., Ganesh, T., & Mohamed, A. W. (2021) · IEEE Access · doi:10.1109/access.2021.3056407 · Cited by 613
A review of the-state-of-the-art in data-driven approaches for building energy prediction
Sun, Y., Haghighat, F., & Fung, B. C. M. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.110022 · Cited by 506
Naz, S., Butt, S. A., ul Hassan, M. M., Escorcia-Gutierrez, J., Fatima, A., & ul Ain, F. (2025) · Neurocomputing · doi:10.1016/j.neucom.2024.128615 · Cited by 17
A Feature Selection Method for Multimodal Multispectral LiDAR Sensing
Han, Y., Salido-Monzú, D., Butt, J. A., Schweizer, S., & Wieser, A. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.04.022 · Cited by 6
Metadata
- Authors
- Khaire, U. M., & Dhanalakshmi, R.
- Venue
- Journal of King Saud University - Computer and Information Sciences
- Published
- 2022-04
- Volume
- 34
- Issue
- 4
- Pages
- 1060-1073
- ISSN
- 1319-1578 (ISSN-L)
- OpenAlex
- W2955612236
- Cited by
- 630
- References
- 79
- FWCI
- 30.99
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.