RSMOTE: A self-adaptive robust SMOTE for imbalanced problems with label noise
The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
Abstract Imbalanced classification is an important task in supervised learning, and Synthetic Minority Over-sampling Technique (SMOTE) is the most common method to address it. However, the performance of SMOTE deteriorates in the presence of label noise. Current generalizations of SMOTE try to tackle this problem by either selecting some samples in minority class as seed samples or combining SMOTE with a certain noise filter. Unfortunately, the former approach usually introduces extra parameters difficult to be optimized, and the latter one relies heavily on the performance of certain specific noise filter. In this paper, a self-adaptive robust SMOTE, called RSMOTE, is proposed for imbalanced classification with label noise. In RSMOTE, relative density has been introduced to measure the local density of every minority sample, and the non-noisy minority samples are divided into the borderline samples and safe samples adaptively basing their distinguishing characteristics of relative density. In addition, we reweigh the number that needs to be generated by every minority samples based on its chaotic level. Furthermore, we generate new samples within in the borderline area and safe area respectively to enhance the separability of the boundary. RSMOTE does not rely on any specific noise filter nor introduce any extra parameters. The experimental results demonstrate that the proposed approach performs better than the comparison methods in terms of several metrics, including Precision, Recall, Area Under the Curve (AUC), F1-measure, and G-mean. The implementation of the proposed RSMOTE in programming language Python is available at https://github.com/syxiaa/RSMOTE.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515
The use of ranks to avoid the assumption of normality implicit in the analysis of variance
Friedman, M. (1937) · Journal of the American Statistical Association · doi:10.1080/01621459.1937.10503522 · Cited by 7,005
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., & Herrera, F. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2161285 · Cited by 2,794
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernandez, A., Garcia, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,219
Editorial: special issue on learning from imbalanced data sets
Chawla, N. V., Japkowicz, N., & Kotcz, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007733 · Cited by 2,063
Classification by pairwise coupling
Hastie, T., & Tibshirani, R. (1998) · The Annals of Statistics · doi:10.1214/aos/1028144844 · Cited by 1,299
Improving imbalanced learning through a heuristic oversampling method based on k-means and SMOTE
Douzas, G., Bacao, F., & Last, F. (2018) · Information Sciences · doi:10.1016/j.ins.2018.06.056 · Cited by 1,277
MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning
Barua, S., Islam, M. M., Yao, X., & Murase, K. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.232 · Cited by 1,150
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Handling imbalanced datasets: A review
Kotsiantis, S. B., Kanellopoulos, D. N., & Pintelas, P. (2006) · Cited by 1,030
Bunkhumpornpat, C., Sinapiromsaran, K., & Lursinsap, C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01307-2_43 · Cited by 943
Galar, M., Fernández, A., Barrenechea, E., Bustince, H., & Herrera, F. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.01.017 · Cited by 764
Cluster-based under-sampling approaches for imbalanced data distributions
Yen, S.-J., & Lee, Y.-S. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.06.108 · Cited by 732
Sáez, J. A., Luengo, J., Stefanowski, J., & Herrera, F. (2015) · Information Sciences · doi:10.1016/j.ins.2014.08.051 · Cited by 627
Ramentol, E., Caballero, Y., Bello, R., & Herrera, F. (2012) · Knowledge and Information Systems · doi:10.1007/s10115-011-0465-6 · Cited by 489
Efficient classification for multiclass problems using modular neural networks
Anand, R., Mehrotra, K., Mohan, C. K., & Ranka, S. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.363444 · Cited by 392
SPECIAL ISSUE ON LEARNING FROM IMBALANCED DATA SETS
Chawla, N. V., Japkowicz, N., & Kołcz, A. (2004) · Cited by 325
Tutorial on practical tips of the most influential data preprocessing algorithms in data mining
García, S., Luengo, J., & Herrera, F. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.12.006 · Cited by 310
A Comprehensive Investigation of the Role of Imbalanced Learning for Software Defect Prediction
Song, Q., Guo, Y., & Shepperd, M. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2836442 · Cited by 295
Geometric SMOTE a geometrically enhanced drop-in replacement for SMOTE
Douzas, G., & Bacao, F. (2019) · Information Sciences · doi:10.1016/j.ins.2019.06.007 · Cited by 291
Local neighbourhood extension of SMOTE for mining imbalanced data
Maciejewski, T., & Stefanowski, J. (2011) · 2011 IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2011.5949434 · Cited by 255
The Influence of Class Imbalance on Cost-Sensitive Learning: An Empirical Study
Liu, X.-Y., & Zhou, Z.-H. (2006) · Sixth International Conference on Data Mining (ICDM'06) · doi:10.1109/icdm.2006.158 · Cited by 248
STAC: A web platform for the comparison of algorithms using statistical tests
Rodriguez-Fdez, I., Canosa, A., Mucientes, M., & Bugarin, A. (2015) · 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz-ieee.2015.7337889 · Cited by 227
Santos, M. S., Abreu, P. H., García-Laencina, P. J., Simão, A., & Carvalho, A. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.09.012 · Cited by 219
Parasite detection and identification for automated thin blood film malaria diagnosis
Tek, F. B., Dempster, A. G., & Kale, İ. (2010) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2009.08.003 · Cited by 202
Does cost-sensitive learning beat sampling for classifying rare classes?
McCarthy, K., Zabar, B., & Weiss, G. (2005) · Proceedings of the 1st international workshop on Utility-based data mining - UBDM '05 · doi:10.1145/1089827.1089836 · Cited by 174
An approach for classification of highly imbalanced data using weighting and undersampling
Anand, A., Pugalenthi, G., Fogel, G. B., & Suganthan, P. N. (2010) · Amino Acids · doi:10.1007/s00726-010-0595-2 · Cited by 172
Radial-Based oversampling for noisy imbalanced data classification
Koziarski, M., Krawczyk, B., & Woźniak, M. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.04.089 · Cited by 165
Multi-Imbalance: An open-source software for multi-class imbalance learning
Zhang, C., Bi, J., Xu, S., Ramentol, E., Fan, G., Qiao, B., & Fujita, H. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.03.001 · Cited by 164
López, V., Fernández, A., & Herrera, F. (2014) · Information Sciences · doi:10.1016/j.ins.2013.09.038 · Cited by 160
A Novel Algorithm for Imbalance Data Classification Based on Genetic Algorithm Improved SMOTE
Jiang, K., Lu, J., & Xia, K. (2016) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-016-2179-2 · Cited by 132
Sixth International Conference on Data Mining (ICDM'06)
(2006) · doi:10.1109/icdm11877.2006 · Cited by 131
Noise Reduction A Priori Synthetic Over-Sampling for class imbalanced data sets
Rivera, W. (2017) · Information Sciences · doi:10.1016/j.ins.2017.04.046 · Cited by 124
A-SMOTE: A New Preprocessing Approach for Highly Imbalanced Datasets by Improving SMOTE
Hussein, A. S., Li, T., Yohannese, C. W., & Bashir, K. (2019) · International Journal of Computational Intelligence Systems · doi:10.2991/ijcis.d.191114.002 · Cited by 117
PSO-based method for SVM classification on skewed data sets
Cervantes, J., García‐Lamont, F., Rodríguez, L., López‐Chau, A., Castilla, J. R., & Espinosa, A. T. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.10.041 · Cited by 98
Ramentol, E., Torné, I. G., Choy, S. L., Bello, R., Caballero, Y., Cornelis, C., & Herrera, F. (2015) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2015.10.009 · Cited by 92
Grouped SMOTE With Noise Filtering Mechanism for Classifying Imbalanced Data
Ke, C., Zhang, C., Yu, H., Yang, X., Zou, H., & Gao, S. (2019) · IEEE Access · doi:10.1109/access.2019.2955086 · Cited by 90
A Novel Boundary Oversampling Algorithm Based on Neighborhood Rough Set Model: NRSBoundary-SMOTE
Hu, F., & Li, H. (2013) · Mathematical Problems in Engineering · doi:10.1155/2013/694809 · Cited by 85
Khor, K., Ting, C., & Phon-Amnuaisuk, S. (2010) · Applied Intelligence · doi:10.1007/s10489-010-0263-y · Cited by 85
Start Globally, Optimize Locally, Predict Globally: Improving Performance on Imbalanced Data
Cieslak, D. A., & Chawla, N. V. (2008) · Proceedings · doi:10.1109/icdm.2008.87 · Cited by 84
Kang, S., Cho, S., & Kang, P. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.08.006 · Cited by 80
A Parameter-Free Cleaning Method for SMOTE in Imbalanced Classification
Yan, Y., Liu, R., Ding, Z., Du, X., Chen, J., & Zhang, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2899467 · Cited by 77
Prediction of protein–protein interactions based on PseAA composition and hybrid feature selection
Liu, L., Cai, Y., Lu, W., Feng, K., Peng, C., & Niu, B. (2009) · Biochemical and Biophysical Research Communications · doi:10.1016/j.bbrc.2009.01.077 · Cited by 67
Addressing imbalanced classification with instance generation techniques: IPADE-ID
López, V., Triguero, I., Carmona, C. J., García, S., & Herrera, F. (2013) · Neurocomputing · doi:10.1016/j.neucom.2013.01.050 · Cited by 60
Alejo, R., García, V., & Pacheco-Sánchez, J. H. (2014) · Neural Processing Letters · doi:10.1007/s11063-014-9376-3 · Cited by 44
A three-way decision ensemble method for imbalanced data oversampling
Yan, Y. T., Wu, Z. B., Du, X. Q., Chen, J., Zhao, S. G., & Zhang, Y. P. (2018) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2018.12.011 · Cited by 44
Relative density based support vector machine
Xia, S., Xiong, Z., Luo, Y., Dong, L., & Xing, C. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.08.053 · Cited by 41
Self-citationProceedings of the 1st international workshop on Utility-based data mining
Weiss, G. M., Saar‐Tsechansky, M., & Zadrozny, B. (2005) · Cited by 41
Puntumapon, K., & Waiyamai, K. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30220-6_31 · Cited by 39
A Ranked Subspace Learning Method for Gene Expression Data Classification
He, H., & Shen, X. (2007) · International Conference on Artificial Intelligence · Cited by 38
Fuzzy relevance vector machine for learning from unbalanced data and noise
Li, D.-F., Hu, W., Xiong, W., & Yang, J. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.01.009 · Cited by 27
Sáez, J. A., Luengo, J., Stefanowski, J., & Herrera, F. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10840-7_8 · Cited by 27
A hybrid system for imbalanced data mining
Lee, Z.-J., Lee, C., Chou, S.-T., Ma, W.-P., Ye, F., & Chen, Z. (2019) · Microsystem Technologies · doi:10.1007/s00542-019-04566-1 · Cited by 17
Self-citationRBM-SMOTE: Restricted Boltzmann Machines for Synthetic Minority Oversampling Technique
Zięba, M., Tomczak, J. M., & Gonczarek, A. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-15702-3_37 · Cited by 14
Imbalanced data classification procedure based on SMOTE
Gyoten, D., Ohkubo, M., & Nagata, Y. (2020) · Total Quality Science · doi:10.17929/tqs.5.64 · Cited by 13
Metadata
- Authors
- Chen, B., Xia, S., Chen, Z., Wang, B., & Wang, G.
- Venue
- Information Sciences
- Publisher
- Elsevier BV
- Published
- 2021-04
- Volume
- 553
- Pages
- 397-428
- ISSN
- 0020-0255 (ISSN-L)
- OpenAlex
- W3093212523
- Cited by
- 177
- References
- 61
- FWCI
- 8.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.