The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Ensemble feature selection: Homogeneous and heterogeneous approaches
Abstract
In the last decade, ensemble learning has become a prolific discipline in pattern recognition, based on the assumption that the combination of the output of several models obtains better results than the output of any individual model. On the basis that the same principle can be applied to feature selection, we describe two approaches: (i) homogeneous, i.e., using the same feature selection method with different training data and distributing the dataset over several nodes; and (ii) heterogeneous, i.e., using different feature selection methods with the same training data. Both approaches are based on combining rankings of features that contain all the ordered features. The results of the base selectors are combined using different combination methods, also called aggregators, and a practical subset is selected according to several different threshold values (traditional values based on fixed percentages, and more novel automatic methods based on data complexity measures). In testing using a Support Vector Machine as a classifier, ensemble results for seven datasets demonstrate performance that is at least comparable and often better than the performance of individual feature selection methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,411
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
A Tutorial on Support Vector Machines for Pattern Recognition
Burges, C. J. C. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009715923555 · Cited by 16,429
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
The Nature of Statistical Learning Theory
Vapnik, V. N. (2000) · Springer eBooks · doi:10.1007/978-1-4757-3264-1 · Cited by 10,696
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
Gene selection for cancer classification using support vector machines
Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
Advances in kernel methods: support vector learning
Schölkopf, B., Burges, C. J. C., & Smola, A. J. (1999) · doi:10.5555/299094 · Cited by 5,789
The Strength of Weak Learnability
Schapire, R. E. (1990) · Machine Learning · doi:10.1007/bf00116037 · Cited by 4,600
Comparing Individual Means in the Analysis of Variance
Tukey, J. W. (1949) · Biometrics · doi:10.2307/3001913 · Cited by 4,246
Universal Approximation Using Radial-Basis-Function Networks
Park, J., & Sandberg, I. W. (1991) · Neural Computation · doi:10.1162/neco.1991.3.2.246 · Cited by 4,112
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
Combining Pattern Classifiers: Methods and Algorithms
Bagui, S. C. (2005) · Technometrics · doi:10.1198/tech.2005.s320 · Cited by 3,202
Estimating attributes: Analysis and extensions of RELIEF
Kononenko, I. (1994) · Lecture Notes in Computer Science · doi:10.1007/3-540-57868-4_57 · Cited by 2,958
Feature Selection: A Data Perspective
Li, J., Cheng, K., Wang, S., Morstatter, F., Trevino, R. P., Tang, J., & Liu, H. (2018) · ACM Computing Surveys · doi:10.1145/3136625 · Cited by 2,442
Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy
Kuncheva, L. I., & Whitaker, C. J. (2003) · Machine Learning · doi:10.1023/a:1022859003006 · Cited by 2,335
Efficient Feature Selection via Analysis of Relevance and Redundancy
Yu, L., & Liu, H. (2004) · doi:10.5555/1005332.1044700 · Cited by 1,983
The feature selection problem: traditional methods and a new algorithm
Kira, K., & Rendell, L. A. (1992) · National Conference on Artificial Intelligence · Cited by 1,897
Feature extraction : foundations and applications
Guyon, I., Gunn, S. R., Nikravesh, M., & zadeh, L. N. (2006) · Cited by 1,658
Benchmarking attribute selection techniques for discrete class data mining
Hall, M. A., & Holmes, G. (2003) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2003.1245283 · Cited by 1,232
Robust rank aggregation for gene list integration and meta-analysis
Kolde, R., Laur, S., Adler, P., & Vilo, J. (2012) · Bioinformatics · doi:10.1093/bioinformatics/btr709 · Cited by 1,191
Gene prioritization through genomic data fusion
Aerts, S., Lambrechts, D., Maity, S., Van Loo, P., Coessens, B., De Smet, F., Tranchevent, L.-C., De Moor, B., Marynen, P., Hassan, B., et al. (2006) · Nature Biotechnology · doi:10.1038/nbt1203 · Cited by 890
Bramer, M. (2013) · Undergraduate Topics in Computer Science · doi:10.1007/978-1-4471-4884-5 · Cited by 838
A review of feature selection methods on synthetic data
Bolón-Canedo, V., Sánchez-Maroño, N., & Alonso-Betanzos, A. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-012-0487-8 · Cited by 830
Self-citationRobust biomarker identification for cancer diagnosis with ensemble feature selection methods
Abeel, T., Helleputte, T., Van de Peer, Y., Dupont, P., & Saeys, Y. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp630 · Cited by 574
Diversity in search strategies for ensemble feature selection
Tsymbal, A., Pechenizkiy, M., & Cunningham, P. (2005) · Information Fusion · doi:10.1016/j.inffus.2004.04.003 · Cited by 321
Recent advances and emerging challenges of feature selection in the context of big data
Bolón-Canedo, V., Sánchez-Maroño, N., & Alonso-Betanzos, A. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.05.014 · Cited by 320
Self-citationKendall Rank Correlation Coefficient
(2008) · The Concise Encyclopedia of Statistics · doi:10.1007/978-0-387-32833-1_211 · Cited by 319
A New Feature Transformation Method Based on Rotation for Speaker Identification
Kim, M.-S., & Yu, H.-J. (2007) · 19th IEEE International Conference on Tools with Artificial Intelligence(ICTAI 2007) · doi:10.1109/ictai.2007.49 · Cited by 228
An ensemble of filters and classifiers for microarray data classification
Bolón-Canedo, V., Sánchez-Maroño, N., & Alonso-Betanzos, A. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.06.006 · Cited by 183
Self-citationCombination of Similarity Rankings Using Data Fusion
Willett, P. (2013) · Journal of Chemical Information and Modeling · doi:10.1021/ci300547g · Cited by 154
Robust Feature Selection for Microarray Data Based on Multicriterion Fusion
Yang, F., & Mao, K. (2010) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2010.103 · Cited by 147
A Comparative Study of Ensemble Feature Selection Techniques for Software Defect Prediction
Wang, H., Khoshgoftaar, T. M., & Napolitano, A. (2010) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2010.27 · Cited by 123
Data Complexity in Pattern Recognition
Basu, M., & Ho, T. K. (2020) · CERN Document Server (European Organization for Nuclear Research) · doi:10.1007/978-1-84628-172-3 · Cited by 121
The Average Spearman Rank Correlation Coefficient
Lyerly, S. B. (1952) · Psychometrika · doi:10.1007/bf02288917 · Cited by 101
Data classification using an ensemble of filters
Bolón‐Canedo, V., Sánchez‐Maroño, N., & Alonso‐Betanzos, A. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.03.067 · Cited by 92
Self-citationIntelligent Data Engineering and Automated Learning - IDEAL 2007
Bertini, C., Ortobelli Lozza, S., & STAINO, A. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-77226-2 · Cited by 69
(2007) · Lecture notes in computer science · doi:10.1007/978-3-540-72523-7 · Cited by 67
Combining feature selectors for text classification
Olsson, J., & Oard, D. W. (2006) · doi:10.1145/1183614.1183736 · Cited by 53
Robust ensemble feature selection for high dimensional data sets
Brahim, A. B., & Limam, M. (2013) · International Conference on High Performance Computing & Simulation (HPCS) · doi:10.1109/hpcsim.2013.6641406 · Cited by 41
Embedded Feature Ranking for Ensemble MLP Classifiers
Windeatt, T., Duangsoithong, R., & Smith, R. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2138158 · Cited by 34
Ensemble Feature Selection for Rankings of Features
Seijo-Pardo, B., Bolón‐Canedo, V., Porto-Díaz, I., & Alonso‐Betanzos, A. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19222-2_3 · Cited by 33
Self-citationUsing a feature selection ensemble on DNA microarray datasets.
Seijo-Pardo, B., Bolón‐Canedo, V., & Alonso‐Betanzos, A. (2016) · The European Symposium on Artificial Neural Networks · Cited by 26
Self-citationEnsemble Feature Selection Technique for Software Quality Classification.
Wang, H., Khoshgoftaar, T. M., & Gao, K. (2010) · Cited by 18
Machine learning and applications (icmla), 2010 ninth international conference on
Seth, S., & Príncipe, J. C. (2010) · International Conference on Machine Learning and Applications · Cited by 18
Advances in Computational Intelligence
Rojas, I., Joya, G., & Catalá, A. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19222-2 · Cited by 14
Stopping Criteria for Ensemble-Based Feature Selection
Windeatt, T., & Prior, M. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-72523-7_28 · Cited by 10
Cited by
Ensemble deep learning: A review
Ganaie, M. A., Hu, M., Malik, A. K., Tanveer, M., & Suganthan, P. N. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105151 · Cited by 2,143
A comprehensive review on ensemble deep learning: Opportunities and challenges
Mohammed, A., & Kora, R. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.01.014 · Cited by 1,127
Pisner, D. A., & Schnyer, D. M. (2020) · Machine Learning · doi:10.1016/b978-0-12-815739-8.00006-7 · Cited by 1,004
Ensembles for feature selection: A review and future trends
Bolón-Canedo, V., & Alonso-Betanzos, A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.11.008 · Cited by 541
Self-citationA recent overview of the state-of-the-art elements of text classification
Mirończuk, M. M., & Protasiewicz, J. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.058 · Cited by 317
Metadata
- Authors
- Seijo-Pardo, B., Porto-Díaz, I., Bolón-Canedo, V., & Alonso-Betanzos, A.
- Venue
- Knowledge-Based Systems
- Publisher
- Elsevier BV
- Published
- 2017-02
- Volume
- 118
- Pages
- 124-139
- ISSN
- 0950-7051 (ISSN-L)
- OpenAlex
- W2556301080
- Cited by
- 300
- References
- 54
- FWCI
- 12.32
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.