The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Class-imbalanced classifiers for high-dimensional data
Abstract
A class-imbalanced classifier is a decision rule to predict the class membership of new samples from an available data set where the class sizes differ considerably. When the class sizes are very different, most standard classification algorithms may favor the larger (majority) class resulting in poor accuracy in the minority class prediction. A class-imbalanced classifier typically modifies a standard classifier by a correction strategy or by incorporating a new strategy in the training phase to account for differential class sizes. This article reviews and evaluates some most important methods for class prediction of high-dimensional imbalanced data. The evaluation addresses the fundamental issues of the class-imbalanced classification problem: imbalance ratio, small disjuncts and overlap complexity, lack of data and feature selection. Four class-imbalanced classifiers are considered. The four classifiers include three standard classification algorithms each coupled with an ensemble correction strategy and one support vector machines (SVM)-based correction classifier. The three algorithms are (i) diagonal linear discriminant analysis (DLDA), (ii) random forests (RFs) and (ii) SVMs. The SVM-based correction classifier is SVM threshold adjustment (SVM-THR). A Monte-Carlo simulation and five genomic data sets were used to illustrate the analysis and address the issues. The SVM-ensemble classifier appears to perform the best when the class imbalance is not too severe. The SVM-THR performs well if the imbalance is severe and predictors are highly correlated. The DLDA with a feature selection can perform well without using the ensemble correction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Jemal, A., Siegel, R., Xu, J., & Ward, E. (2010) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.20073 · Cited by 12,596
Gene selection for cancer classification using support vector machines
Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
Alon, U., Barkai, N., Notterman, D. A., Gish, K., Ybarra, S., Mack, D., & Levine, A. J. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.12.6745 · Cited by 4,167
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
(1999) · doi:10.1162/089976600300015565 · Cited by 2,799
Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data
Dudoit, S., Fridlyand, J., & Speed, T. P. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479248 · Cited by 2,672
Bhattacharjee, A., Richards, W. G., Staunton, J., Li, C., Monti, S., Vasa, P., Ladd, C., Beheshti, J., Bueno, R., Gillette, M., et al. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.191502998 · Cited by 2,576
The Non-Hodgkin's Lymphoma Classification Project (1997) · Blood · doi:10.1182/blood.v89.11.3909 · Cited by 2,461
A molecular signature of metastasis in primary solid tumors
Ramaswamy, S., Ross, K. N., Lander, E. S., & Golub, T. R. (2003) · Nature Genetics · doi:10.1038/ng1060 · Cited by 2,449
Shipp, M. A., Ross, K. N., Tamayo, P., Weng, A. P., Kutok, J. L., Aguiar, R. C. T., Gaasenbeek, M., Angelo, M., Reich, M., Pinkus, G. S., et al. (2002) · Nature Medicine · doi:10.1038/nm0102-68 · Cited by 2,428
Genomic imprinting: parental influence on the genome
Reik, W., & Walter, J. (2001) · Nature Reviews Genetics · doi:10.1038/35047554 · Cited by 2,285
Editorial: special issue on learning from imbalanced data sets
Chawla, N. V., Japkowicz, N., & Kotcz, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007733 · Cited by 2,063
Sotiriou, C., Neo, S.-Y., McShane, L. M., Korn, E. L., Long, P. M., Jazaeri, A., Martiat, P., Fox, S. B., Harris, A. L., & Liu, E. T. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1732912100 · Cited by 1,993
SMOTEBoost: Improving Prediction of the Minority Class in Boosting
Chawla, N. V., Lazarevic, A., Hall, L. O., & Bowyer, K. W. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39804-2_12 · Cited by 1,668
Mining with rarity: a unifying framework
Weiss, G. M. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007734 · Cited by 1,393
Training cost-sensitive neural networks with methods addressing the class imbalance problem
Zhou, Z.-H., & Liu, X.-Y. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.17 · Cited by 1,326
Robust classification for imprecise environments
Provost, F., & Fawcett, T. (2001) · Machine Learning · doi:10.1023/a:1007601015854 · Cited by 1,250
Applying Support Vector Machines to Imbalanced Datasets
Akbani, R., Kwek, S., & Japkowicz, N. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30115-8_7 · Cited by 1,134
The Case against Accuracy Estimation for Comparing Induction Algorithms
Provost, F. J., Fawcett, T. E., & Kohavi, R. (1998) · Cited by 1,031
SVMs Modeling for Highly Imbalanced Classification
Tang, Y., Zhang, Y.-Q., Chawla, N. V., & Krasser, S. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2002909 · Cited by 966
Learning when training data are costly: the effect of class distribution on tree induction
Weiss, G. M., & Provost, F. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1199 · Cited by 921
Fawcett, T., & Provost, F. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009700419189 · Cited by 881
KNN approach to unbalanced data distributions: a case study involving information extraction
Ziang, J. (2003) · International Conference on Machine Learning · Cited by 772
Data mining for direct marketing: problems and solutions
Ling, C. X., & Cheng-hui, L. (1998) · Cited by 661
Strategies for learning in class imbalance problems
Barandela, R., Sánchez, J. S., Garcı́a, V, & Rangel, E. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00257-1 · Cited by 579
Iizuka, N., Oka, M., Yamada-Okabe, H., Nishida, M., Maeda, Y., Mori, N., Takao, T., Tamesa, T., Tangoku, A., Tabuchi, H., et al. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12775-4 · Cited by 511
KBA: kernel boundary alignment considering imbalanced data distribution
Wu, G., & Chang, E. Y. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.95 · Cited by 380
Filtering for increased power for microarray data analysis
Hackstadt, A. J., & Hess, A. M. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-11 · Cited by 290
Extreme re-balancing for SVMs: a case study
Raskutti, B., & Kowalczyk, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007739 · Cited by 287
Class prediction for high-dimensional class-imbalanced data
Blagus, R., & Lusa, L. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-523 · Cited by 236
Greally, J. M. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.012539199 · Cited by 161
Tong, W., Xie, Q., Hong, H., Shi, L. M., Fang, H., & Perkins, R. (2004) · Environmental Health Perspectives · doi:10.1289/txg.7125 · Cited by 118
RELATIONSHIP OF ŒSTROGEN-RECEPTOR STATUS TO SURVIVAL IN BREAST CANCER
Bishop, H., Elston, C. W., Blamey, R. W., Haybittle, J. L., Nicholson, R. I., & Griffiths, K. (1979) · The Lancet · doi:10.1016/s0140-6736(79)90295-2 · Cited by 117
Decision threshold adjustment in class prediction
Chen, J. J., Tsai, C., Moon, H., Ahn, H., Young, J., & Chen, C. (2006) · SAR and QSAR in environmental research · doi:10.1080/10659360600787700 · Cited by 89
Self-citationA survey of the Predictive Toxicology Challenge 2000–2001
Helma, C., & Krämer, S. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg084 · Cited by 66
Development of biomarker classifiers from high-dimensional data
Baek, S., Tsai, C., & Chen, J. J. (2009) · Briefings in Bioinformatics · doi:10.1093/bib/bbp016 · Cited by 56
Self-citationClassification ensembles for unbalanced class sizes in predictive toxicology
Chen, J. J., Tsai, C., Young, J. F., & Kodell, R. L. (2005) · SAR and QSAR in environmental research · doi:10.1080/10659360500468468 · Cited by 55
Self-citationGranular SVM with Repetitive Undersampling for Highly Imbalanced Protein Homology Prediction
Tang, Y., & Zhang, Y. (2006) · IEEE International Conference on Granular Computing (GrC) · doi:10.1109/grc.2006.1635839 · Cited by 45
A classification procedure for highly imbalanced class sizes
Byon, E., Shrivastava, A. K., & Ding, Y. C. (2010) · IIE Transactions · doi:10.1080/07408170903228967 · Cited by 41
Solving Imbalanced Classification Problems with Support Vector Machines.
Lessmann, S. (2004) · International Conference on Artificial Intelligence · Cited by 30
Uncertainty sampling methods for one-class classifiers
Juszczak, P., & Duin, R. P. W. (2003) · Cited by 30
Rosenkranz, H. S. (2004) · Mutation Research/Genetic Toxicology and Environmental Mutagenesis · doi:10.1016/j.mrgentox.2003.12.010 · Cited by 11
Cited by
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernandez, A., Garcia, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,219
Feature selection in machine learning: A new perspective
Cai, J., Luo, J., Wang, S., & Yang, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.11.077 · Cited by 2,061
López, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590
Boulesteix, A., Janitza, S., Kruppa, J., & König, I. R. (2012) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1072 · Cited by 924
Pelletier, C., Valero, S., Inglada, J., Champion, N., & Dedieu, G. (2016) · Remote Sensing of Environment · doi:10.1016/j.rse.2016.10.010 · Cited by 630
Metadata
- Authors
- Lin, W.-J., & Chen, J. J.
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-03-09
- Volume
- 14
- Issue
- 1
- Pages
- 13-26
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W2154706222
- Cited by
- 284
- References
- 46
- FWCI
- 16.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.