An efficient binary Salp Swarm Algorithm with crossover scheme for feature selection problems
Open accessThe DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
Abstract Searching for the (near) optimal subset of features is a challenging problem in the process of feature selection (FS). In the literature, Swarm Intelligence (SI) algorithms show superior performance in solving this problem. This motivated our attempts to test the performance of the newly proposed Salp Swarm Algorithm (SSA) in this area. As such, two new wrapper FS approaches that use SSA as the search strategy are proposed. In the first approach, eight transfer functions are employed to convert the continuous version of SSA to binary. In the second approach, the crossover operator is used in addition to the transfer functions to replace the average operator and enhance the exploratory behavior of the algorithm. The proposed approaches are benchmarked on 22 well-known UCI datasets and the results are compared with 5 FS methods: Binary Grey Wolf Optimizer (BGWO), Binary Gravitational Search Algorithms (BGSA), Binary Bat Algorithm (BBA), Binary Particle Swarm Optimization (BPSO), and Genetic Algorithm (GA). The paper also considers an extensive study of the parameter setting for the proposed technique. From the results, it is observed that the proposed approach significantly outperforms others on around 90% of the datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1992) · Cited by 23,431
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439 · cited 2×
“Filter methods (Chi-Square [3], Information Gain [4], Gain Ratio [5], ReliefF [6]) rely on some data properties without involving a specific learning algorithm.”
MethodMirjalili, S., Mirjalili, S. M., & Lewis, A. (2014) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2013.12.007 · Cited by 19,343
Self-citationA new optimizer using particle swarm theory
Eberhart, R., & Kennedy, J. (2002) · MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science · doi:10.1109/mhs.1995.494215 · Cited by 16,067 · cited 14×
“P T In addition, the results of the BSSA_S3_CP approach is also compared to the results of the bGWO1, bGWO2, GA, and PSO techniques reported in [46].”
BackgroundInfluentialThe Whale Optimization Algorithm
Mirjalili, S., & Lewis, A. (2016) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2016.01.008 · Cited by 14,581
Self-citationNo free lunch theorems for optimization
Wolpert, D. H., & Macready, W. G. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585893 · Cited by 14,237 · cited 2×
“According to NFL theorem [66], all algorithms perform equal when considering all types of optimization problems.”
BackgroundMethodWrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
(2007) · Handbook of Approximation Algorithms and Metaheuristics · doi:10.1201/9781420010749-33 · Cited by 6,607
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems
Mirjalili, S., Gandomi, A. H., Mirjalili, S. Z., Saremi, S., Faris, H., & Mirjalili, S. M. (2017) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2017.07.002 · Cited by 5,082
Self-citationA discrete binary version of the particle swarm algorithm
Kennedy, J., & Eberhart, R. C. (2002) · 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation · doi:10.1109/icsmc.1997.637339 · Cited by 4,767
(1996) · Cited by 4,738
Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm
Mirjalili, S. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.07.006 · Cited by 4,626
Self-citationFirefly Algorithms for Multimodal Optimization
Yang, X.-S. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-04944-6_14 · Cited by 4,075
Feature selection for classification
DASH, M., & LIU, H. (1997) · Intelligent Data Analysis · doi:10.1016/s1088-467x(97)00008-5 · Cited by 3,574
Mirjalili, S. (2015) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2015.01.010 · Cited by 3,233
Self-citationTheoretical and Empirical Analysis of ReliefF and RReliefF
Robnik-Šikonja, M., & Kononenko, I. (2003) · Machine Learning · doi:10.1023/a:1025667309714 · Cited by 3,025 · cited 2×
“Filter methods (Chi-Square [3], Information Gain [4], Gain Ratio [5], ReliefF [6]) rely on some data properties without involving a specific learning algorithm.”
MethodMirjalili, S. (2016) · Neural Computing and Applications · doi:10.1007/s00521-015-1920-1 · Cited by 2,765
Self-citationToward integrating feature selection algorithms for classification and clustering
Liu, H., & Yu, L. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.66 · Cited by 2,706
Feature Selection for Knowledge Discovery and Data Mining
Liu, H., & Motoda, H. (1998) · Springer eBooks · doi:10.1007/978-1-4615-5689-3 · Cited by 2,198
Krill herd: A new bio-inspired optimization algorithm
Gandomi, A. H., & Alavi, A. H. (2012) · Communications in Nonlinear Science and Numerical Simulation · doi:10.1016/j.cnsns.2012.05.010 · Cited by 1,882
Dorigo, M., Birattari, M., & Stutzle, T. (2006) · IEEE Computational Intelligence Magazine · doi:10.1109/ci-m.2006.248054 · Cited by 1,880
A new Fruit Fly Optimization Algorithm: Taking the financial distress model as an example
Pan, W.-T. (2012) · Knowledge-Based Systems · doi:10.1016/j.knosys.2011.07.001 · Cited by 1,543
Binary grey wolf optimization approaches for feature selection
Emary, E., Zawbaa, H. M., & Hassanien, A. E. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.06.083 · Cited by 1,410
Grey wolf optimizer: a review of recent variants and applications
Faris, H., Aljarah, I., Al-Betar, M. A., & Mirjalili, S. (2018) · Neural Computing and Applications · doi:10.1007/s00521-017-3272-5 · Cited by 1,180
Self-citationHybrid Whale Optimization Algorithm with simulated annealing for feature selection
Mafarja, M. M., & Mirjalili, S. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.04.053 · Cited by 1,148
Self-citationS-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization
Mirjalili, S., & Lewis, A. (2013) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2012.09.002 · Cited by 1,099
Self-citationOptimizing connection weights in neural networks using the whale optimization algorithm
Aljarah, I., Faris, H., & Mirjalili, S. (2018) · Soft Computing · doi:10.1007/s00500-016-2442-1 · Cited by 752
Self-citationBGSA: binary gravitational search algorithm
Rashedi, E., Nezamabadi-pour, H., & Saryazdi, S. (2010) · Natural Computing · doi:10.1007/s11047-009-9175-3 · Cited by 733
Mirjalili, S., Mirjalili, S. M., & Yang, X.-S. (2014) · Neural Computing and Applications · doi:10.1007/s00521-013-1525-5 · Cited by 665
Self-citationBinary ant lion approaches for feature selection
Emary, E., Zawbaa, H. M., & Hassanien, A. E. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.03.101 · Cited by 483
Abualigah, L. M., Khader, A. T., & Hanandeh, E. S. (2018) · Journal of Computational Science · doi:10.1016/j.jocs.2017.07.018 · Cited by 480
An efficient modified grey wolf optimizer with Lévy flight for optimization tasks
Heidari, A. A., & Pahlavani, P. (2017) · Applied Soft Computing · doi:10.1016/j.asoc.2017.06.044 · Cited by 464
Self-citationMafarja, M., Aljarah, I., Heidari, A. A., Hammouri, A. I., Faris, H., Al-Zoubi, A. M., & Mirjalili, S. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.12.037 · Cited by 418
Self-citationMoradi, P., & Gholampour, M. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2016.01.044 · Cited by 372
A hybrid approach of differential evolution and artificial bee colony for feature selection
Zorarpacı, E., & Özel, S. A. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.06.004 · Cited by 371
An advanced ACO algorithm for feature subset selection
Kashef, S., & Nezamabadi-pour, H. (2015) · Neurocomputing · doi:10.1016/j.neucom.2014.06.067 · Cited by 333
Aljarah, I., Al-Zoubi, A. M., Faris, H., Hassonah, M. A., Mirjalili, S., & Saadeh, H. (2018) · Cognitive Computation · doi:10.1007/s12559-017-9542-9 · Cited by 252
Self-citationA wrapper approach for feature selection based on Bat Algorithm and Optimum-Path Forest
Rodrigues, D., Pereira, L. A. M., Nakamura, R. Y. M., Costa, K. A. P., Yang, X.-S., Souza, A. N., & Papa, J. P. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.09.023 · Cited by 251
Faris, H., Hassonah, M. A., Al-Zoubi, A. M., Mirjalili, S., & Aljarah, I. (2018) · Neural Computing and Applications · doi:10.1007/s00521-016-2818-2 · Cited by 232
Self-citationExperienced Gray Wolf Optimization Through Reinforcement Learning and Neural Networks
Emary, E., Zawbaa, H. M., & Grosan, C. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2634548 · Cited by 222
Shunmugapriya, P., & Kanmani, S. (2017) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2017.04.002 · Cited by 216
Feature Subset Selection Approach by Gray-Wolf Optimization
Emary, E., Zawbaa, H. M., Grosan, C., & Hassenian, A. E. (2015) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-13572-4_1 · Cited by 197
Sörensen, K., Sevaux, M., & Glover, F. (2018) · Springer eBooks · doi:10.1007/978-3-319-07124-4_4 · Cited by 179
A feature selection method based on modified binary coded ant colony optimization algorithm
Wan, Y., Wang, M., Ye, Z., & Lai, X. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2016.08.011 · Cited by 178
Binary black hole algorithm for feature selection and classification on biological data
Pashaei, E., & Aydin, N. (2017) · Applied Soft Computing · doi:10.1016/j.asoc.2017.03.002 · Cited by 178
Handbook of Nature-Inspired and Innovative Computing
(2006) · Kluwer Academic Publishers eBooks · doi:10.1007/0-387-27705-6 · Cited by 171
Differential evolution algorithm as a tool for optimal feature subset selection in motor imagery EEG
Baig, M. Z., Aslam, N., Shum, H. P. H., & Zhang, L. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.07.033 · Cited by 167
Sheikhpour, R., Sarram, M. A., & Sheikhpour, R. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2015.10.005 · Cited by 161
Feature selection for high dimensional imbalanced class data using harmony search
Moayedikia, A., Ong, K.-L., Boo, Y. L., Yeoh, W. G., & Jensen, R. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.10.008 · Cited by 160
An efficient chaotic water cycle algorithm for optimization tasks
Heidari, A. A., Ali Abbaspour, R., & Rezaee Jordehi, A. (2017) · Neural Computing and Applications · doi:10.1007/s00521-015-2037-2 · Cited by 158
Self-citationImproved particle swarm optimization algorithm and its application in text feature selection
Lu, Y., Liang, M., Ye, Z., & Cao, L. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.07.005 · Cited by 154
Ensemble feature selection using bi-objective genetic algorithm
Das, A. K., Das, S., & Ghosh, A. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.02.013 · Cited by 152
Bharti, K. K., & Singh, P. K. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2016.01.019 · Cited by 147
Recent Advances in Swarm Intelligence and Evolutionary Computation
Yang, X. (2014) · Studies in computational intelligence · doi:10.1007/978-3-319-13826-8 · Cited by 138
Binary Flower Pollination Algorithm and Its Application to Feature Selection
Rodrigues, D., Yang, X., de Souza, A. N., et al. (2014) · Studies in computational intelligence · doi:10.1007/978-3-319-13826-8_5 · Cited by 138
Ramos, C. C. O., de Souza, A. N., Chiachia, G., Falcão, A. X., & Papa, J. P. (2011) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2011.09.013 · Cited by 135
Mlakar, U., Fister, I., Brest, J., & Potočnik, B. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.07.037 · Cited by 128
Image steganalysis using a bee colony based feature selection algorithm
Mohammadi, F. G., & Abadeh, M. S. (2013) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2013.09.016 · Cited by 124
Bayesian network classifiers versus selective -NN classifier
Pernkopf, F. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2004.05.012 · Cited by 115
Feature selection based on antlion optimization algorithm
Zawbaa, H. M., Emary, E., & Pârv, B. (2015) · World Conference on Complex Systems · doi:10.1109/icocs.2015.7483317 · Cited by 99
Gunasundari, S., Janakiraman, S., & Selvaraj, M. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.02.042 · Cited by 85
A new feature selection algorithm based on binary ant colony optimization
Kashef, S., & Nezamabadi–pour, H. (2013) · International Conference on Information and Knowledge Technology (IKT) · doi:10.1109/ikt.2013.6620037 · Cited by 59
Fault identification with binary adaptive fireflies in parallel and distributed systems
Falcon, R., Almeida, M., & Nayak, A. R. (2011) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2011.5949774 · Cited by 55
Zainuddin, Z., Lai, K. H., & Ong, P. (2016) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2016.02.009 · Cited by 42
Lü, L., Yan, J., & de Silva, C. W. (2016) · Measurement · doi:10.1016/j.measurement.2016.07.043 · Cited by 42
Enhanced Chaotic Grey Wolf Optimizer for Real-World Optimization Problems
Heidari, A. A., & Abbaspour, R. A. (2017) · Advances in business information systems and analytics book series · doi:10.4018/978-1-5225-2990-3.ch030 · Cited by 19
Self-citation
Cited by
Harris hawks optimization: Algorithm and applications
Heidari, A. A., Mirjalili, S., Faris, H., Aljarah, I., Mafarja, M., & Chen, H. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.02.028 · Cited by 6,324
Self-citationKhishe, M., & Mosavi, M. R. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113338 · Cited by 1,229
An improved grey wolf optimizer for solving engineering problems
Nadimi-Shahraki, M. H., Taghian, S., & Mirjalili, S. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113917 · Cited by 1,153
Self-citationA survey on new generation metaheuristic algorithms
Dokeroglu, T., Sevinc, E., Kucukyilmaz, T., & Cosar, A. (2019) · Computers & Industrial Engineering · doi:10.1016/j.cie.2019.106040 · Cited by 923
Metaheuristic Algorithms on Feature Selection: A Survey of One Decade of Research (2009-2019)
Agrawal, P., Abutarboush, H. F., Ganesh, T., & Mohamed, A. W. (2021) · IEEE Access · doi:10.1109/access.2021.3056407 · Cited by 613
Metadata
- Authors
- Faris, H., Mafarja, M. M., Heidari, A. A., Aljarah, I., Al-Zoubi, A. M., Mirjalili, S., & Fujita, H.
- Venue
- Knowledge-Based Systems
- Publisher
- Elsevier BV
- Published
- 2018-08
- Volume
- 154
- Pages
- 43-67
- ISSN
- 0950-7051 (ISSN-L)
- OpenAlex
- W2801536506
- Cited by
- 660
- References
- 68
- FWCI
- 47.53
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.