The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Feature selection for high-dimensional class-imbalanced data sets using Support Vector Machines
Open accessAbstract
Feature selection and classification of imbalanced data sets are two of the most interesting machine learning challenges, attracting a growing attention from both, industry and academia. Feature selection addresses the dimensionality reduction problem by determining a subset of available features to build a good model for classification or prediction, while the class-imbalance problem arises when the class distribution is too skewed. Both issues have been independently studied in the literature, and a plethora of methods to address high dimensionality as well as class-imbalance has been proposed. The aim of this work is to simultaneously explore both issues, proposing a family of methods that select those attributes that are relevant for the identification of the target class in binary classification. We propose a backward elimination approach based on successive holdout steps, whose contribution measure is based on a balanced loss function obtained on an independent subset. Our experiments are based on six highly imbalanced microarray data sets, comparing our methods with well-known feature selection techniques, and obtaining a better prediction with consistently fewer relevant features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Gene selection for cancer classification using support vector machines
Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954
Support Vector Data Description
Tax, D. M. J., & Duin, R. P. W. (2004) · Machine Learning · doi:10.1023/b:mach.0000008084.60811.49 · Cited by 3,512
Khan, J., Wei, J. S., Ringnér, M., Saal, L. H., Ladanyi, M., Westermann, F., Berthold, F., Schwab, M., Antonescu, C. R., Peterson, C., et al. (2001) · Nature Medicine · doi:10.1038/89044 · Cited by 2,644
Bhattacharjee, A., Richards, W. G., Staunton, J., Li, C., Monti, S., Vasa, P., Ladd, C., Beheshti, J., Bueno, R., Gillette, M., et al. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.191502998 · Cited by 2,576
Brucker, P. (1995) · Scheduling Algorithms · doi:10.1007/978-3-662-03088-2_3 · Cited by 2,289
Editorial: special issue on learning from imbalanced data sets
Chawla, N. V., Japkowicz, N., & Kotcz, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007733 · Cited by 2,063
Gene-expression profiles predict survival of patients with lung adenocarcinoma
Beer, D. G., Kardia, S. L. R., Huang, C.-C., Giordano, T. J., Levin, A. M., Misek, D. E., Lin, L., Chen, G., Gharib, T. G., Thomas, D. G., et al. (2002) · Nature Medicine · doi:10.1038/nm733 · Cited by 2,025
Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation
Sokolova, M., Japkowicz, N., & Szpakowicz, S. (2006) · Lecture Notes in Computer Science · doi:10.1007/11941439_114 · Cited by 1,974
Feature Extraction: Foundations and Applications (Studies in Fuzziness and Soft Computing)
Guyon, I., Gunn, S., Nikravesh, M., & Zadeh, L. A. (2006) · Springer eBooks · Cited by 1,845
Feature extraction : foundations and applications
Guyon, I., Gunn, S. R., Nikravesh, M., & zadeh, L. N. (2006) · Cited by 1,658
Cost-sensitive boosting for classification of imbalanced data
Sun, Y., Kamel, M. S., Wong, A. K. C., & Wang, Y. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2007.04.009 · Cited by 1,423
Rätsch, G., Onoda, T., & Müller, K.-R. (2001) · Machine Learning · doi:10.1023/a:1007618119488 · Cited by 1,299
Use of Gene-Expression Profiling to Identify Prognostic Subclasses in Adult Acute Myeloid Leukemia
Bullinger, L., Döhner, K., Bair, E., Fröhling, S., Schlenk, R. F., Tibshirani, R., Döhner, H., & Pollack, J. R. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa031046 · Cited by 993
Feature Selection via Concave Minimization and Support Vector Machines
Bradley, P. S., & Mangasarian, O. L. (1998) · Cited by 984
Nutt, C. L., Mani, D. R., Betensky, R. A., Tamayo, P., Cairncross, J. G., Ladd, C., Pohl, U., Hartmann, C. J., McLaughlin, M. E., Batchelor, T. T., et al. (2003) · PubMed · Cited by 959
Variable selection using svm based criteria
Rakotomamonjy, A. (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944977 · Cited by 712
Use of the zero norm with linear models and kernel methods
Weston, J., Elisseeff, A., Schölkopf, B., & Tipping, M. (2003) · MPG.PuRe (Max Planck Society) · doi:10.5555/944919.944982 · Cited by 688
Molecular classification of human carcinomas by use of gene expression signatures.
Su, A. I., Welsh, J. B., Sapinoso, L. M., Kern, S. G., Dimitrov, P., Lapp, H., Schultz, P. G., Powell, S. M., Moskaluk, C. A., Frierson, H. F., et al. (2001) · PubMed · Cited by 688
Feature selection for text categorization on imbalanced data
Zheng, Z., Wu, X., & Srihari, R. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007741 · Cited by 549
Ultrahigh dimensional variable selection: beyond the linear model
Fan, J., Samworth, R. J., & Wu, Y. (2008) · PubMed · doi:10.48550/arxiv.0812.3201 · Cited by 521
Feature selection via dependence maximization
Song, L., Smola, A. J., Gretton, A., Bedő, J., & Borgwardt, K. M. (2012) · Journal of Machine Learning Research · doi:10.5555/2188385.2343691 · Cited by 495
A wrapper method for feature selection using Support Vector Machines
Maldonado, S., & Weber, R. (2009) · Information Sciences · doi:10.1016/j.ins.2009.02.014 · Cited by 473
Self-citationCombating the Small Sample Class Imbalance Problem Using Feature Selection
Wasikowski, M., & Chen, X.-W. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.187 · Cited by 390
Class Imbalances versus Class Overlapping: An Analysis of a Learning System Behavior
Prati, R. C., Batista, G. E. A. P. A., & Monard, M. C. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24694-7_32 · Cited by 339
Simultaneous feature selection and classification using kernel-penalized support vector machines
Maldonado, S., Weber, R., & Basak, J. (2011) · Information Sciences · doi:10.1016/j.ins.2010.08.047 · Cited by 258
Self-citationClass prediction for high-dimensional class-imbalanced data
Blagus, R., & Lusa, L. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-523 · Cited by 236
Chen, X.-W., & Wasikowski, M. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401910 · Cited by 216
Ultrahigh Dimensional Feature Selection: Beyond The Linear Model
FanJianqing, SamworthRichard, & WuYichao (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1755853 · Cited by 210
Feature Selection with High-Dimensional Imbalanced Data
Van Hulse, J., Khoshgoftaar, T. M., Napolitano, A., & Wald, R. (2009) · 2009 IEEE International Conference on Data Mining Workshops · doi:10.1109/icdmw.2009.35 · Cited by 198
A stable gene selection in microarray data analysis
Yang, K., Cai, Z., Li, J., & Lin, G. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-228 · Cited by 195
Wang, S., Li, D., Song, X., Wei, Y., & Li, H. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.01.077 · Cited by 191
Adjusted F-measure and kernel scaling for imbalanced data learning
Maratea, A., Petrosino, A., & Manzo, M. (2013) · Information Sciences · doi:10.1016/j.ins.2013.04.016 · Cited by 175
Predicting credit card customer churn in banks using data mining
Kumar, D. A., & Ravi, V. (2008) · International Journal of Data Analysis Techniques and Strategies · doi:10.1504/ijdats.2008.020020 · Cited by 167
EasyEnsemble and Feature Selection for Imbalance Data Sets
Liu, T. (2009) · International Joint Conferences on Bioinformatics, Systems Biology and Intelligent Computing · doi:10.1109/ijcbs.2009.22 · Cited by 121
Feature Selection and the Class Imbalance Problem in Predicting Protein Function from Sequence
Al‐Shahib, A., Breitling, R., & Gilbert, D. (2005) · Applied Bioinformatics · doi:10.2165/00822942-200504030-00004 · Cited by 120
Fernández, A., del Jesús, M. J., & Herrera, F. (2010) · Information Sciences · doi:10.1016/j.ins.2009.12.014 · Cited by 115
George, V. S., & Raj, C. (2011) · International Journal of Computer Science & Engineering Survey · doi:10.5121/ijcses.2011.2302 · Cited by 81
Alibeigi, M., Hashemi, S., & Hamzeh, A. (2012) · Data & Knowledge Engineering · doi:10.1016/j.datak.2012.08.001 · Cited by 78
The design of polynomial function-based neural network predictors for detection of software defects
Park, B., Oh, S., & Witold Pedrycz, C. (2011) · Information Sciences · doi:10.1016/j.ins.2011.01.026 · Cited by 66
Simultaneous Grouping Pursuit and Feature Selection Over an Undirected Graph
Zhu, Y., Shen, X., & Pan, W. (2013) · Journal of the American Statistical Association · doi:10.1080/01621459.2013.770704 · Cited by 59
Hidalgo-Muñoz, A. R., López, M., Santos, I. M., Pereira, A. T., Vázquez-Marrufo, M., Galvao-Carmona, A., & Tomé, A. M. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.10.013 · Cited by 51
Face recognition by generalized two-dimensional FLD method and multi-class support vector machines
Chowdhury, S., Sing, J. K., Basu, D. K., & Nasipuri, M. (2010) · Applied Soft Computing · doi:10.1016/j.asoc.2010.12.002 · Cited by 50
Villar, P., Fernández, A., Carrasco, R. A., & Herrera, F. (2012) · International Journal of Uncertainty Fuzziness and Knowledge-Based Systems · doi:10.1142/s0218488512500195 · Cited by 33
Ultrahigh Dimensional Feature Screening via RKHS Embeddings
Balasubramanian, K., Sriperumbudur, B. K., & Lebanon, G. (2013) · Cited by 30
Ensemble Approach for the Classification of Imbalanced Data
Nikulin, V., McLachlan, G. J., & Ng, S. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-10439-8_30 · Cited by 29
Cited by
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
A review of feature selection methods with applications
Jovic, A., Brkic, K., & Bogunovic, N. (2015) · 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) · doi:10.1109/mipro.2015.7160458 · Cited by 1,209
A comprehensive survey on sentiment analysis: Approaches, challenges and trends
Birjali, M., Kasri, M., & Beni-Hssane, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107134 · Cited by 921
A Systematic Review on Imbalanced Data Challenges in Machine Learning: Applications and Solutions
Kaur, H., Pannu, H. S., & Malhi, A. K. (2020) · ACM Computing Surveys · doi:10.1145/3343440 · Cited by 488
Feature selection and classification systems for chronic disease prediction: A review
Jain, D., & Singh, V. (2018) · Egyptian Informatics Journal · doi:10.1016/j.eij.2018.03.002 · Cited by 368
Metadata
- Authors
- Maldonado, S., Weber, R., & Famili, F.
- Venue
- Information Sciences
- Publisher
- Elsevier BV
- Published
- 2014-12
- Volume
- 286
- Pages
- 228-246
- ISSN
- 0020-0255 (ISSN-L)
- OpenAlex
- W1975664724
- Cited by
- 317
- References
- 48
- FWCI
- 9.00
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.