The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms
Abstract
In classification, feature selection is an important data pre-processing technique, but it is a difficult problem due mainly to the large search space. Particle swarm optimisation (PSO) is an efficient evolutionary computation technique. However, the traditional personal best and global best updating mechanism in PSO limits its performance for feature selection and the potential of PSO for feature selection has not been fully investigated. This paper proposes three new initialisation strategies and three new personal best and global best updating mechanisms in PSO to develop novel feature selection approaches with the goals of maximising the classification performance, minimising the number of features and reducing the computational time. The proposed initialisation strategies and updating mechanisms are compared with the traditional initialisation and the traditional updating mechanism. Meanwhile, the most promising initialisation strategy and updating mechanism are combined to form a new approach (PSO(4-2)) to address feature selection problems and it is compared with two traditional feature selection methods and two PSO based methods. Experiments on twenty benchmark datasets show that PSO with the new initialisation strategies and/or the new updating mechanisms can automatically evolve a feature subset with a smaller number of features and higher classification performance than using all features. PSO(4-2) outperforms the two traditional methods and two PSO based algorithm in terms of the computational time, the number of features and the classification performance. The superior performance of this algorithm is due mainly to both the proposed initialisation strategy, which aims to take the advantages of both the forward selection and backward selection to decrease the number of features and the computational time, and the new updating mechanism, which can overcome the limitations of traditional updating mechanisms by taking the number of features into account, which reduces the number of features and the computational time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kennedy, J., & Eberhart, R. (2002) · Proceedings of ICNN'95 - International Conference on Neural Networks · doi:10.1109/icnn.1995.488968 · Cited by 58,192
A Simplex Method for Function Minimization
Nelder, J. A., & Mead, R. (1965) · The Computer Journal · doi:10.1093/comjnl/7.4.308 · Cited by 28,905
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,411
A modified particle swarm optimizer
Shi, Y., & Eberhart, R. (2002) · 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360) · doi:10.1109/icec.1998.699146 · Cited by 10,229
The particle swarm - explosion, stability, and convergence in a multidimensional complex space
Clerc, M., & Kennedy, J. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.985692 · Cited by 9,017
Wrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
A discrete binary version of the particle swarm algorithm
Kennedy, J., & Eberhart, R. C. (2002) · 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation · doi:10.1109/icsmc.1997.637339 · Cited by 4,767
Feature selection for classification
DASH, M., & LIU, H. (1997) · Intelligent Data Analysis · doi:10.1016/s1088-467x(97)00008-5 · Cited by 3,574
A Practical Approach to Feature Selection
Kira, K., & Rendell, L. A. (1992) · Machine Learning Proceedings 1992 · doi:10.1016/b978-1-55860-247-2.50037-1 · Cited by 2,978
Computational Intelligence: An Introduction
(2006) · Advances in Industrial Control · doi:10.1007/1-84628-184-9_1 · Cited by 2,027
Proceedings of the Genetic and Evolutionary Computation Conference, GECCO 2019
Auger, A., & Stützle, T. (2019) · Dépôt institutionnel de l'Université libre de Bruxelles (Université Libre de Bruxelles) · Cited by 1,749
The elements of statistical learning: Data mining, inference, and prediction
Franklin, J. (2005) · The Mathematical Intelligencer · doi:10.1007/bf02985802 · Cited by 1,400
Particle swarm optimization for feature selection in classification: a multi-objective approach
Xue, B., Zhang, M., & Browne, W. N. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2227469 · Cited by 1,282
Self-citationA Direct Method of Nonparametric Measurement Selection
Whitney, A. W. (1971) · IEEE Transactions on Computers · doi:10.1109/t-c.1971.223410 · Cited by 851
Feature selection based on rough sets and particle swarm optimization
Wang, X., Yang, J., Teng, X., Xia, W., & Jensen, R. (2007) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.09.003 · Cited by 837
On the effectiveness of receptors in recognition systems
Marill, T., & Green, D. (1963) · IEEE Transactions on Information Theory · doi:10.1109/tit.1963.1057810 · Cited by 664
Feature subset selection in large dimensionality domains
Gheyas, I. A., & Smith, L. S. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2009.06.009 · Cited by 597
Improved binary PSO for feature selection using gene expression data
Chuang, L.-Y., Chang, H.-W., Tu, C.-J., & Yang, C.-H. (2008) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2007.09.005 · Cited by 596
A distributed PSO–SVM hybrid system with feature selection and parameter optimization
Huang, C.-L., & Dun, J.-F. (2008) · Applied Soft Computing · doi:10.1016/j.asoc.2007.10.007 · Cited by 573
Caruana, R., & Freitag, D. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50012-x · Cited by 545
Learning Boolean concepts in the presence of many irrelevant features
Almuallim, H., & Dietterich, T. G. (1994) · Artificial Intelligence · doi:10.1016/0004-3702(94)90084-1 · Cited by 520
2011 IEEE Congress of Evolutionary Computation (CEC)
(2011) · doi:10.1109/cec15497.2011 · Cited by 487
Wrapper–Filter Feature Selection Algorithm Using a Memetic Framework
Zhu, Z., Ong, Y.-S., & Dash, M. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2006.883267 · Cited by 443
2000 Genetic and Evolutionary Computation Conference (GECCO-2000)
智晴, 中. (2000) · システム/制御/情報 : システム制御情報学会誌 · doi:10.11509/isciesci.44.10_611 · Cited by 422
A novel binary particle swarm optimization
Khanesar, M. A., Teshnehlab, M., & Shoorehdeli, M. A. (2007) · 2007 Mediterranean Conference on Control & Automation · doi:10.1109/med.2007.4433821 · Cited by 364
Genetic programming for simultaneous feature selection and classifier design
Muni, D. P., Pal, N. R., & Das, J. (2006) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2005.854499 · Cited by 357
A rough set approach to feature selection based on ant colony optimization
Chen, Y., Miao, D., & Wang, R. (2009) · Pattern Recognition Letters · doi:10.1016/j.patrec.2009.10.013 · Cited by 288
Large-scale attribute selection using wrappers
Gutlein, M., Frank, E., Hall, M., & Karwath, A. (2009) · 2009 IEEE Symposium on Computational Intelligence and Data Mining · doi:10.1109/cidm.2009.4938668 · Cited by 264
Improved binary particle swarm optimization using catfish effect for feature selection
Chuang, L.-Y., Tsai, S.-W., & Yang, C.-H. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.04.057 · Cited by 240
Neshatian, K., Zhang, M., & Andreae, P. (2012) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2011.2166158 · Cited by 197
Self-citationAn efficient ant colony optimization approach to attribute reduction in rough set theory
Ke, L., Feng, Z., & Ren, Z. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.02.006 · Cited by 176
Initializing the Particle Swarm Optimizer Using the Nonlinear Simplex Method
Parsopoulos, K. E. (2002) · Cited by 95
Choosing a starting configuration for particle swarm optimization
(2004) · IEEE International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2004.1380986 · Cited by 95
Proceedings of the 2005 UK Workshop on Computational Intelligence
Galea, M., Shen, Q., & Singh, V. K. (2005) · Cited by 92
Rough set feature selection and rule induction for prediction of malignancy degree in brain glioma
Wang, X., Yang, J., Jensen, R., & Liu, X. (2006) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2006.06.007 · Cited by 86
New fitness functions in binary particle swarm optimisation for feature selection
Xue, B., Zhang, M., & Browne, W. N. (2012) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2012.6256617 · Cited by 85
Self-citation2022 IEEE Congress on Evolutionary Computation (CEC)
(2022) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec55065.2022.9870418 · Cited by 84
Opposition based initialization in particle swarm optimization (O-PSO)
Jabeen, H., Jalil, Z., & Baig, A. R. (2009) · doi:10.1145/1570256.1570274 · Cited by 79
Lin, S.-W., & Chen, S. (2009) · Applied Soft Computing · doi:10.1016/j.asoc.2009.01.001 · Cited by 71
Novel Initialisation and Updating Mechanisms in PSO for Feature Selection in Classification
Xue, B., Zhang, M., & Browne, W. N. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37192-9_43 · Cited by 53
Self-citationPareto front feature selection
Neshatian, K., & Zhang, M. (2009) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1569901.1570040 · Cited by 49
Self-citationApplication of global optimization methods to model and feature selection
Boubezoul, A., & Paris, S. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.04.015 · Cited by 45
Using genetic programming for context-sensitive feature scoring in classification problems
Neshatian, K., & Zhang, M. (2011) · Connection Science · doi:10.1080/09540091.2011.630065 · Cited by 34
Self-citationAdaptive Particle Swarm Optimizer for Feature Selection
Esseghir, M. A., Gonçalves, G., & Slimani, Y. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15381-5_28 · Cited by 26
Improving Relevance Measures Using Genetic Programming
Neshatian, K., & Zhang, M. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-29139-5_9 · Cited by 25
Self-citationIEEE Symposium on Computational Intelligence and Data Mining (CIDM 2007)
(2007) · IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2007.368843 · Cited by 21
Cited by
Feature selection in machine learning: A new perspective
Cai, J., Luo, J., Wang, S., & Yang, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.11.077 · Cited by 2,061
A Survey on Evolutionary Computation Approaches to Feature Selection
Xue, B., Zhang, M., Browne, W. N., & Yao, X. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2504420 · Cited by 1,841
Self-citationWhale optimization approaches for wrapper feature selection
Mafarja, M., & Mirjalili, S. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2017.11.006 · Cited by 825
Greylag Goose Optimization: Nature-inspired optimization algorithm
El-kenawy, E.-S. M., Khodadadi, N., Mirjalili, S., Abdelhamid, A. A., Eid, M. M., & Ibrahim, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122147 · Cited by 586
A Survey on semi-supervised feature selection methods
Sheikhpour, R., Sarram, M. A., Gharaghani, S., & Chahooki, M. A. Z. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.11.003 · Cited by 505
Metadata
- Authors
- Xue, B., Zhang, M., & Browne, W. N.
- Venue
- Applied Soft Computing
- Publisher
- Elsevier BV
- Published
- 2014-05
- Volume
- 18
- Pages
- 261-276
- ISSN
- 1568-4946 (ISSN-L)
- OpenAlex
- W1543715688
- Cited by
- 614
- References
- 49
- FWCI
- 29.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.