The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
RUSBoost: A Hybrid Approach to Alleviating Class Imbalance
Abstract
Class imbalance is a problem that is common to many application domains. When examples of one class in a training data set vastly outnumber examples of the other class(es), traditional data mining algorithms tend to create suboptimal classification models. Several techniques have been used to alleviate the problem of class imbalance, including data sampling and boosting. In this paper, we present a new hybrid sampling/boosting algorithm, called RUSBoost, for learning from skewed training data. This algorithm provides a simpler and faster alternative to SMOTEBoost, which is another algorithm that combines boosting and data sampling. This paper evaluates the performances of RUSBoost and SMOTEBoost, as well as their individual components (random undersampling, synthetic minority oversampling technique, and AdaBoost). We conduct experiments using 15 data sets from various application domains, four base learners, and four evaluation metrics. RUSBoost and SMOTEBoost both outperform the other procedures, and RUSBoost performs comparably to (and often better than) SMOTEBoost while being a simpler and faster technique. Given these experimental results, we highly recommend RUSBoost as an attractive alternative for improving the classification performance of learners built using imbalanced data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
(1992) · Cited by 23,431
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Witten, I. H. (2008) · Cited by 9,143
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
Cohen, W. W. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50023-2 · Cited by 3,787
A Short Introduction to Boosting
Freund, Y., & Schapire, R. E. (1999) · Cited by 3,140
Cited by
Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., & Herrera, F. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2161285 · Cited by 2,794
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
Text Data Augmentation for Deep Learning
Shorten, C., Khoshgoftaar, T. M., & Furht, B. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00492-0 · Cited by 1,740
Self-citationLópez, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590
A Survey of Predictive Modeling on Imbalanced Domains
Branco, P., Torgo, L., & Ribeiro, R. P. (2017) · ACM Computing Surveys · doi:10.1145/2907070 · Cited by 1,129
Clustering-based undersampling in class-imbalanced data
Lin, W.-C., Tsai, C.-F., Hu, Y.-H., & Jhang, J.-S. (2017) · Information Sciences · doi:10.1016/j.ins.2017.05.008 · Cited by 832
Deep Learning Based Vulnerability Detection: Are We There Yet?
Chakraborty, S., Krishna, R., Ding, Y., & Ray, B. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3087402 · Cited by 790
A survey on addressing high-class imbalance in big data
Leevy, J. L., Khoshgoftaar, T. M., Bauder, R. A., & Seliya, N. (2018) · Journal of Big Data · doi:10.1186/s40537-018-0151-6 · Cited by 759
Self-citationElreedy, D., & Atiya, A. F. (2019) · Information Sciences · doi:10.1016/j.ins.2019.07.070 · Cited by 756
Multiple instance learning: A survey of problem characteristics and applications
Carbonneau, M.-A., Cheplygina, V., Granger, E., & Gagnon, G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.009 · Cited by 740
“There are external methods like SMOTE [156] and RUSBoost [157] that necessitate accurate labels to perform over or under sampling.”
MethodA survey on imbalanced learning: latest research, applications and future directions
Chen, W., Yang, K., Yu, Z., Shi, Y., & Chen, C. L. P. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10759-6 · Cited by 506
Detecting Accounting Fraud in Publicly Traded U.S. Firms Using a Machine Learning Approach
BAO, Y., KE, B., LI, B., YU, Y. J., & ZHANG, J. (2020) · Journal of Accounting Research · doi:10.1111/1475-679x.12292 · Cited by 499
Improved Random Forest for Classification
Paul, A., Mukherjee, D. P., Das, P., Gangopadhyay, A., Chintha, A. R., & Kundu, S. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2834830 · Cited by 483
Assessment of algorithms for mitosis detection in breast cancer histopathology images
Veta, M., van Diest, P. J., Willems, S. M., Wang, H., Madabhushi, A., Cruz-Roa, A., Gonzalez, F., Larsen, A. B. L., Vestergaard, J. S., Dahl, A. B., et al. (2015) · Medical Image Analysis · doi:10.1016/j.media.2014.11.010 · Cited by 480
Boosting methods for multi-class imbalanced data classification: an experimental review
Tanha, J., Abdi, Y., Samadi, N., Razzaghi, N., & Asadpour, M. (2020) · Journal of Big Data · doi:10.1186/s40537-020-00349-y · Cited by 452
Class Imbalance Problem in Data Mining Review
Longadge, R., & Dongre, S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1305.1707 · Cited by 432
EUSBoost: Enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling
Galar, M., Fernández, A., Barrenechea, E., & Herrera, F. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.05.006 · Cited by 419
A novel ensemble method for classifying imbalanced data
Sun, Z., Song, Q., Zhu, X., Sun, H., Xu, B., & Zhou, Y. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2014.11.014 · Cited by 414
Under-sampling class imbalanced datasets by combining clustering analysis and instance selection
Tsai, C.-F., Lin, W.-C., Hu, Y.-H., & Yao, G.-T. (2019) · Information Sciences · doi:10.1016/j.ins.2018.10.029 · Cited by 329
Fernando, K. R. M., & Tsokos, C. P. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3047335 · Cited by 329
Tantithamthavorn, C., Hassan, A. E., & Matsumoto, K. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2876537 · Cited by 327
Review of Classification Methods on Unbalanced Data Sets
Wang, L., Han, M., Li, X., Zhang, N., & Cheng, H. (2021) · IEEE Access · doi:10.1109/access.2021.3074243 · Cited by 307
Machine Learning–Based Radiomics for Molecular Subtyping of Gliomas
Lu, C.-F., Hsu, F.-T., Hsieh, K. L.-C., Kao, Y.-C. J., Cheng, S.-J., Hsu, J. B.-K., Tsai, P.-H., Chen, R.-J., Huang, C.-C., Yen, Y., et al. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-17-3445 · Cited by 306
Comparing Boosting and Bagging Techniques With Noisy and Imbalanced Data
Khoshgoftaar, T. M., Van Hulse, J., & Napolitano, A. (2011) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2010.2084081 · Cited by 300
Self-citationLabel-free cell cycle analysis for high-throughput imaging flow cytometry
Blasi, T., Hennig, H., Summers, H. D., Theis, F. J., Cerveira, J., Patterson, J. O., Davies, D., Filby, A., Carpenter, A. E., & Rees, P. (2016) · Nature Communications · doi:10.1038/ncomms10256 · Cited by 299
A Comprehensive Investigation of the Role of Imbalanced Learning for Software Defect Prediction
Song, Q., Guo, Y., & Shepperd, M. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2836442 · Cited by 295
On the class overlap problem in imbalanced data classification
Vuttipittayamongkol, P., Elyan, E., & Petrovski, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106631 · Cited by 290
Neighbourhood-based undersampling approach for handling imbalanced and overlapped data
Vuttipittayamongkol, P., & Elyan, E. (2020) · Information Sciences · doi:10.1016/j.ins.2019.08.062 · Cited by 286
A broad review on class imbalance learning techniques
Rezvani, S., & Wang, X. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110415 · Cited by 281
Research and application of XGBoost in imbalanced data
Zhang, P., Jia, Y., & Shang, Y. (2022) · International Journal of Distributed Sensor Networks · doi:10.1177/15501329221106935 · Cited by 275
Hassan, A. R., & Bhuiyan, M. I. H. (2016) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2015.09.002 · Cited by 273
Intrinsic and extrinsic effects on image memorability
Bylinskii, Z., Isola, P., Bainbridge, C., Torralba, A., & Oliva, A. (2015) · Vision Research · doi:10.1016/j.visres.2015.03.005 · Cited by 266
Evolutionary undersampling boosting for imbalanced classification of breast cancer malignancy
Krawczyk, B., Galar, M., Jeleń, Ł., & Herrera, F. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2015.08.060 · Cited by 263
Multi-modal classification of Alzheimer's disease using nonlinear graph fusion
Tong, T., Gray, K., Gao, Q., Chen, L., & Rueckert, D. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.10.009 · Cited by 258
Andaur Navarro, C. L., Damen, J. A. A., van Smeden, M., Takada, T., Nijman, S. W. J., Dhiman, P., Ma, J., Collins, G. S., Bajpai, R., Riley, R. D., et al. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.11.015 · Cited by 121
Identifying incipient dementia individuals using machine learning and amyloid imaging
Mathotaarachchi, S., Pascoal, T. A., Shin, M., Benedet, A. L., Kang, M. S., Beaudry, T., Fonov, V. S., Gauthier, S., & Rosa-Neto, P. (2017) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2017.06.027 · Cited by 118
Scenario-Based Insider Threat Detection From Cyber Activities
Chattopadhyay, P., Wang, L., & Tan, Y.-P. (2018) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2018.2857473 · Cited by 115
O'Brien, M. K., Shawen, N., Mummidisetty, C. K., Kaur, S., Bo, X., Poellabauer, C., Kording, K., & Jayaraman, A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7385 · Cited by 78
Ma, D., Lu, D., Popuri, K., Wang, L., Beg, M. F., & Initiative, A. D. N. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00853 · Cited by 56
Tong, T., Ledig, C., Guerrero, R., Schuh, A., Koikkalainen, J., Tolonen, A., Rhodius, H., Barkhof, F., Tijms, B., Lemstra, A. W., et al. (2017) · NeuroImage: Clinical · doi:10.1016/j.nicl.2017.06.012 · Cited by 54
Multi-modality of polysomnography signals’ fusion for automatic sleep scoring
Yan, R., Zhang, C., Spruyt, K., Wei, L., Wang, Z., Tian, L., Li, X., Ristaniemi, T., Zhang, J., & Cong, F. (2019) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2018.10.001 · Cited by 49
Gao, X., He, Y., Zhang, M., Diao, X., Jing, X., Ren, B., & Ji, W. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.104034 · Cited by 44
Fisher, T. B., Saini, G., Rekha, T. S., Krishnamurthy, J., Bhattarai, S., Callagy, G., Webber, M., Janssen, E. A. M., Kong, J., & Aneja, R. (2024) · Breast Cancer Research · doi:10.1186/s13058-023-01752-y · Cited by 42
Predicting employee absenteeism for cost effective interventions
Lawrance, N., Petrides, G., & Guerry, M.-A. (2021) · Decision Support Systems · doi:10.1016/j.dss.2021.113539 · Cited by 40
Bednarski, B. P., Singh, A. D., Zhang, W., Jones, W. M., Naeim, A., & Ramezani, R. (2022) · Scientific Reports · doi:10.1038/s41598-022-25472-z · Cited by 41
“SMOTEBoost and RUSBoot are examples of ensemble rebalancing methods 30,37 .”
MethodSGBBA: An Efficient Method for Prediction System in Machine Learning using Imbalance Dataset
Islam, S., Sara, U., Kawsar, A., Rahman, A., Kundu, D., Das, D., Rezaul, A. N. M., & Hasan, M. (2021) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2021.0120351 · Cited by 37
A quantitative analysis of dressing dynamics for robotic dressing assistance
Chance, G., Jevtić, A., Caleb-Solly, P., & Dogramadzi, S. (2017) · Frontiers in Robotics and AI · doi:10.3389/frobt.2017.00013 · Cited by 34
Prediction of DNA i-motifs via machine learning
Yang, B., Guneri, D., Yu, H., Wright, E. P., Chen, W., Waller, Z. A. E., & Ding, Y. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkae092 · Cited by 29
A human brain network linked to restoration of consciousness after deep brain stimulation
Warren, A. E. L., Raguž, M., Friedrich, H., Schaper, F. L. W. V. J., Tasserie, J., Snider, S. B., Li, J., Chua, M. M. J., Butenko, K., Friedrich, M. U., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-61988-4 · Cited by 18
Performance evaluation of manifold algorithms on a P300 paradigm based online BCI dataset
Chatterjee, B., Palaniappan, R., & Gupta, C. N. (2020) · IFMBE Proceedings · doi:10.1007/978-3-030-31635-8_231 · Cited by 11
Metadata
- Authors
- Seiffert, C., Khoshgoftaar, T. M., Van Hulse, J., & Napolitano, A.
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans
- Published
- 2010-01
- Volume
- 40
- Issue
- 1
- Pages
- 185-197
- ISSN
- 1083-4427 (ISSN-L)
- 1558-2426
- OpenAlex
- W2096945460
- Cited by
- 1,867
- References
- 37
- FWCI
- 14.10
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.