The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Differential evolution for filter feature selection based on information theory and feature ranking
Abstract
© 2017 Elsevier B.V. Feature selection is an essential step in various tasks, where filter feature selection algorithms are increasingly attractive due to their simplicity and fast speed. A common filter is to use mutual information to estimate the relationships between each feature and the class labels (mutual relevancy), and between each pair of features (mutual redundancy). This strategy has gained popularity resulting a variety of criteria based on mutual information. Other well-known strategies are to order each feature based on the nearest neighbor distance as in ReliefF, and based on the between-class variance and the within-class variance as in Fisher Score. However, each strategy comes with its own advantages and disadvantages. This paper proposes a new filter criterion inspired by the concepts of mutual information, ReliefF and Fisher Score. Instead of using mutual redundancy, the proposed criterion tries to choose the highest ranked features determined by ReliefF and Fisher Score while providing the mutual relevance between features and the class labels. Based on the proposed criterion, two new differential evolution (DE) based filter approaches are developed. While the former uses the proposed criterion as a single objective problem in a weighted manner, the latter considers the proposed criterion in a multi-objective design. Moreover, a well known mutual information feature selection approach (MIFS) based on maximum-relevance and minimum-redundancy is also adopted in single-objective and multi-objective DE algorithms for feature selection. The results show that the proposed criterion outperforms MIFS in both single objective and multi-objective DE frameworks. The results also indicate that considering feature selection as a multi-objective problem can generally provide better performance in terms of the feature subset size and the classification accuracy. © This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
Storn, R., & Price, K. (1997) · Journal of Global Optimization · doi:10.1023/a:1008202821328 · Cited by 29,569
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,387
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
Wrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947
Differential Evolution: A Survey of the State-of-the-Art
Das, S., & Suganthan, P. N. (2011) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2010.2059031 · Cited by 5,307
A survey on feature selection methods
Chandrashekar, G., & Sahin, F. (2014) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2013.11.024 · Cited by 5,189
Handling multiple objectives with particle swarm optimization
Coello, C. A. C., Pulido, G. T., & Lechuga, M. S. (2004) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2004.826067 · Cited by 4,455
Pearson Correlation Coefficient
Benesty, J., Chen, J., Huang, Y., & Cohen, I. (2009) · Springer Topics in Signal Processing · doi:10.1007/978-3-642-00296-0_5 · Cited by 3,059
Theoretical and Empirical Analysis of ReliefF and RReliefF
Robnik-Šikonja, M., & Kononenko, I. (2003) · Machine Learning · doi:10.1023/a:1025667309714 · Cited by 3,025 · cited 3×
“To achieve this goal, a novel filter evaluation criterion (named MIRFFS) based on the concepts of mutual relevance, RelifF [27] and Fisher Score [28] is proposed, and using this proposed criterion, the standard DE and multi-objective DE (MODE) based feature selection approaches are developed.”
BackgroundMethodSpikes: Exploring the Neural Code
Rieke, F. M., Warland, D., van Steveninck, R. R. D. R., & Bialek, W. (1996) · Medical Entomology and Zoology · Cited by 2,844
Using mutual information for selecting features in supervised neural net learning
Battiti, R. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.298224 · Cited by 2,148
Laplacian Score for Feature Selection
He, X., Cai, D., & Niyogi, P. (2005) · Cited by 1,962
Neural networks for pattern recognition
Marshall, J. A. (1995) · Neural Networks · doi:10.1016/0893-6080(95)90002-0 · Cited by 1,889
Feature Extraction: Foundations and Applications (Studies in Fuzziness and Soft Computing)
Guyon, I., Gunn, S., Nikravesh, M., & Zadeh, L. A. (2006) · Springer eBooks · Cited by 1,845
A Survey on Evolutionary Computation Approaches to Feature Selection
Xue, B., Zhang, M., Browne, W. N., & Yao, X. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2504420 · Cited by 1,841
Self-citationCorrelation-based Feature Selection for Discrete and Numeric Class Machine Learning
Hall, M. A. (2000) · Cited by 1,715
Noise Reduction in Speech Processing
Cohen, I., Huang, Y., Chen, J., & Benesty, J. (2009) · Springer Topics in Signal Processing · doi:10.1007/978-3-642-00296-0 · Cited by 1,459
Normalized Mutual Information Feature Selection
Estevez, P. A., Tesmer, M., Perez, C. A., & Zurada, J. M. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005601 · Cited by 1,288
Particle swarm optimization for feature selection in classification: a multi-objective approach
Xue, B., Zhang, M., & Browne, W. N. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2227469 · Cited by 1,282
Self-citationCorrelation-based Feature Subset Selection for Machine Learning
Hall, M. A. (1998) · Cited by 955
Input feature selection for classification problems
Kwak, N., & Choi, C.-H. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.977291 · Cited by 938
2015 IEEE Congress on Evolutionary Computation (CEC2015)
(2015) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2014.2369861 · Cited by 805
Improving PSO-Based Multi-objective Optimization Using Crowding, Mutation and ∈-Dominance
Sierra, M. R., & Coello Coello, C. A. (2005) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-31880-4_35 · Cited by 779
Fast Binary Feature Selection with Conditional Mutual Information
FleuretFrançois (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1044711 · Cited by 593
Caruana, R., & Freitag, D. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50012-x · Cited by 545
A Non-dominated Sorting Particle Swarm Optimizer for Multiobjective Optimization
Li, X. (2003) · Lecture Notes in Computer Science · doi:10.1007/3-540-45105-6_4 · Cited by 532
Driver Drowsiness Classification Using Fuzzy Wavelet-Packet-Based Feature-Extraction Algorithm
Khushaba, R. N., Kodagoda, S., Lal, S., & Dissanayake, G. (2011) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2077291 · Cited by 525
2011 IEEE Congress of Evolutionary Computation (CEC)
(2011) · doi:10.1109/cec15497.2011 · Cited by 487
A hybrid genetic algorithm for feature selection wrapper based on mutual information
Huang, J., Cai, Y., & Xu, X. (2007) · Pattern Recognition Letters · doi:10.1016/j.patrec.2007.05.011 · Cited by 358
A Novel Bayes Model: Hidden Naive Bayes
Jiang, L., Zhang, H., & Cai, Z. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.234 · Cited by 358
Pareto front feature selection based on artificial bee colony optimization
Hancer, E., Xue, B., Zhang, M., Karaboga, D., & Akay, B. (2018) · Information Sciences · doi:10.1016/j.ins.2017.09.028 · Cited by 325
Self-citation(2005) · Natural Computing Series · doi:10.1007/3-540-31306-0 · Cited by 256
Conditional Infomax Learning: An Integrated Framework for Feature Extraction and Fusion
Lin, D., & Tang, X. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_6 · Cited by 226
Senthamarai Kannan, S., & Ramaraj, N. (2010) · Knowledge-Based Systems · doi:10.1016/j.knosys.2010.03.016 · Cited by 209
A New Technique for Combining Multiple Classifiers using The Dempster-Shafer Theory of Evidence
Al-Ani, A. K., & Deriche, M. A. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1026 · Cited by 197
Integration of graph clustering with ant colony optimization for feature selection
Moradi, P., & Rostami, M. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.04.007 · Cited by 188
de la Hoz, E., de la Hoz, E., Ortiz, A., Ortega, J., & Martínez-Álvarez, A. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.08.013 · Cited by 185
Binary particle swarm optimisation for feature selection: A filter based approach
Cervante, L., Xue, B., Zhang, M., & Shang, L. (2012) · 2012 IEEE Congress on Evolutionary Computation · doi:10.1109/cec.2012.6256452 · Cited by 172
Self-citationGranular multi-label feature selection based on mutual information
Li, F., Miao, D., & Pedrycz, W. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.02.025 · Cited by 167
A New Perspective for Information Theoretic Feature Selection
Gavin Brown, B. (2009) · Cited by 159
Ensemble feature selection using bi-objective genetic algorithm
Das, A. K., Das, S., & Ghosh, A. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.02.013 · Cited by 152
Information Theory and Statistical Learning
Emmert‐Streib, F., & Dehmer, M. (2008) · Springer eBooks · doi:10.1007/978-0-387-84816-7 · Cited by 113
Bostani, H., & Sheikhan, M. (2015) · Soft Computing · doi:10.1007/s00500-015-1942-8 · Cited by 109
Xue, B., Cervante, L., Shang, L., Browne, W. N., & Zhang, M. (2012) · Connection Science · doi:10.1080/09540091.2012.737765 · Cited by 108
Self-citationWang, H., Jing, X., & Niu, B. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.04.004 · Cited by 98
An evaluation of classifier-specific filter measure performance for feature selection
Freeman, C., Kulić, D., & Basir, O. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.11.010 · Cited by 97
Ant Colony Optimization and Swarm Intelligence
Hutchison, D., Winfield, A. F. T., Weikum, G., Vardi, M. Y., Tygar, D., Terzopoulos, D., Sudan, M., Stützle, T., Steffen, B., Pandu Rangan, C., et al. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87527-7 · Cited by 96
Ant Colony Optimization For Feature Subset Selection
Al-Ani, A. K. (2007) · doi:10.5281/zenodo.1075109 · Cited by 93
A Combined Ant Colony and Differential Evolution Feature Selection Algorithm
Khushaba, R. N., Al-Ani, A., Alsukker, A., & Al-Jumaily, A. A. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87527-7_1 · Cited by 84
Feature selection with redundancy-complementariness dispersion
Chen, Z., Wu, C., Zhang, Y., et al. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.07.004 · Cited by 81
A Comprehensive Comparison on Evolutionary Feature Selection Approaches to Classification
Xue, B., Zhang, M., & Browne, W. N. (2015) · International Journal of Computational Intelligence and Applications · doi:10.1142/s146902681550008x · Cited by 79
Self-citationA multi-objective artificial bee colony approach to feature selection using fuzzy mutual information
Hançer, E., Xue, B., Zhang, M., Karaboğa, D., & Akay, B. (2015) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2015.7257185 · Cited by 76
Self-citationLi, R., Lu, J., Zhang, Y., & Zhao, T. (2009) · Knowledge-Based Systems · doi:10.1016/j.knosys.2009.11.020 · Cited by 71
LOFS: A library of online streaming feature selection
Yu, K., Ding, W., & Wu, X. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.08.026 · Cited by 56
A New Feature Selection Approach to Naive Bayes Text Classifiers
Zhang, L., Jiang, L., & Li, C. (2015) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001416500038 · Cited by 45
Zhong, M., & Girolami, M. (2009) · Cited by 41
Mutual information for feature selection: estimation or counting?
Nguyen, B. H., Xue, B., & Andreae, P. M. (2016) · Evolutionary Intelligence · doi:10.1007/s12065-016-0143-4 · Cited by 26
Self-citation
Cited by
A comprehensive survey: Whale Optimization Algorithm and its applications
Gharehchopogh, F. S., & Gholizadeh, H. (2019) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2019.03.004 · Cited by 758
Singh, D., Kumar, V., Vaishali, & Kaur, M. (2020) · European Journal of Clinical Microbiology & Infectious Diseases · doi:10.1007/s10096-020-03901-z · Cited by 647
Review of swarm intelligence-based feature selection methods
Rostami, M., Berahmand, K., Nasiri, E., & Forouzandeh, S. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104210 · Cited by 451
Binary differential evolution with self-learning for multi-objective feature selection
Zhang, Y., Gong, D.-W., Gao, X.-Z., Tian, T., & Sun, X.-Y. (2020) · Information Sciences · doi:10.1016/j.ins.2019.08.040 · Cited by 429
Kou, G., Xu, Y., Peng, Y., Shen, F., Chen, Y., Chang, K., & Kou, S. (2021) · Decision Support Systems · doi:10.1016/j.dss.2020.113429 · Cited by 380
Metadata
- Authors
- Hancer, E., Xue, B., & Zhang, M.
- Venue
- Knowledge-Based Systems
- Publisher
- Elsevier BV
- Published
- 2018-01
- Volume
- 140
- Pages
- 103-119
- ISSN
- 0950-7051 (ISSN-L)
- OpenAlex
- W2765937321
- Cited by
- 394
- References
- 60
- FWCI
- 18.04
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.