The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Machine Learning with Oversampling and Undersampling Techniques: Overview Study and Experimental Results
Abstract
Data imbalance in Machine Learning refers to an unequal distribution of classes within a dataset. This issue is encountered mostly in classification tasks in which the distribution of classes or labels in a given dataset is not uniform. The straightforward method to solve this problem is the resampling method by adding records to the minority class or deleting ones from the majority class. In this paper, we have experimented with the two resampling widely adopted techniques: oversampling and undersampling. In order to explore both techniques, we have chosen a public imbalanced dataset from kaggle website Santander Customer Transaction Prediction and have applied a group of well-known machine learning algorithms with different hyperparamters that give best results for both resampling techniques. One of the key findings of this paper is noticing that oversampling performs better than undersampling for different classifiers and obtains higher scores in different evaluation metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Matplotlib: a 2D graphics environment
Hunter, J. D. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.55 · Cited by 39,249
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · cited 1×
“First, it will rise the probability of over-fitting, as it creates the same reproductions of the minority class instances [26].”
BackgroundA decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
Addressing the Curse of Imbalanced Training Sets: One-Sided Selection.
Kubát, M., & Matwin, S. (1997) · Cited by 2,230
Asymptotic Properties of Nearest Neighbor Rules Using Edited Data
Wilson, D. L. (1972) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1972.4309137 · Cited by 2,130
Editorial: special issue on learning from imbalanced data sets
Chawla, N. V., Japkowicz, N., & Kotcz, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007733 · Cited by 2,063
The condensed nearest neighbor rule (Corresp.)
Hart, P. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054155 · Cited by 1,733
CLASSIFICATION OF IMBALANCED DATA: A REVIEW
SUN, Y., WONG, A. K. C., & KAMEL, M. S. (2009) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001409007326 · Cited by 1,692
Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning
Lemaître, G., Nogueira, F., & Aridas, C. K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.06570 · Cited by 1,514
(1976) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1976.4309452 · Cited by 1,078
KNN approach to unbalanced data distributions: a case study involving information extraction
Ziang, J. (2003) · International Conference on Machine Learning · Cited by 772
Improving Identification of Difficult Small Classes by Balancing Class Distribution
Laurikkala, J. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-48229-6_9 · Cited by 748
The Geometry of Information Retrieval
van Rijsbergen, C. J. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511543333 · Cited by 394
The geometry of information retrieval
(2006) · Choice Reviews Online · doi:10.5860/choice.43-2848 · Cited by 387
Effective detection of sophisticated online banking fraud on extremely imbalanced data
Wei, W., Li, J., Cao, L., Ou, Y., & Chen, J. (2013) · World Wide Web · doi:10.1007/s11280-012-0178-0 · Cited by 325
SPECIAL ISSUE ON LEARNING FROM IMBALANCED DATA SETS
Chawla, N. V., Japkowicz, N., & Kołcz, A. (2004) · Cited by 325
Evolutionary undersampling boosting for imbalanced classification of breast cancer malignancy
Krawczyk, B., Galar, M., Jeleń, Ł., & Herrera, F. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2015.08.060 · Cited by 263
Learning from imbalanced data in surveillance of nosocomial infection
Cohen, G., Hilario, M., Sax, H., Hugonnet, S., & Geissbuhler, A. (2006) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2005.03.002 · Cited by 258
Evaluation Measures of the Classification Performance of Imbalanced Data Sets
Gu, Q., Zhu, L., & Cai, Z. (2009) · Communications in Computer and Information Science · doi:10.1007/978-3-642-04962-0_53 · Cited by 254
ISSUES IN MINING IMBALANCED DATA SETS - A REVIEW PAPER
Sofa, V., & Anca, R. (2005) · Cited by 163
Prediction of weather-induced airline delays based on machine learning algorithms
Choi, S., Kim, Y. J., Briceno, S., & Mavris, D. (2016) · 2016 IEEE/AIAA 35th Digital Avionics Systems Conference (DASC) · doi:10.1109/dasc.2016.7777956 · Cited by 162
A Mixture-of-Experts Framework for Learning from Imbalanced Data Sets
Estabrooks, A., & Japkowicz, N. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44816-0_4 · Cited by 86
Optimized Precision - A New Measure for Classifier Performance Evaluation
Ranawana, R., & Palade, V. (2006) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2006.1688586 · Cited by 70
Comparing alternative classifiers for database marketing: The case of imbalanced datasets
Duman, E., Ekinci, Y., & Tanrıverdi, A. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.06.048 · Cited by 46
A hybrid evaluation metric for optimizing classifier
Hossin, M. E., Sulaiman, M. N., Mustapha, A., Mustapha, N., & Rahmat, W. (2011) · Conference on Data Mining and Optimization (DMO) · doi:10.1109/dmo.2011.5976522 · Cited by 24
Research works printed but not linked: 2
- monard, 2002, Learmng with skewed class distrihutions, Advances in Logic Artificial Intelligence and Robotics, 85, 173
- 10.1109/TSMC.1976.5409182 · doi:10.1109/tsmc.1976.5409182
Cited by
Bias in medical AI: Implications for clinical decision-making
Cross, J. L., Choma, M. A., & Onofrey, J. A. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000651 · Cited by 607
Alibrahim, H., & Ludwig, S. A. (2021) · 2021 IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec45853.2021.9504761 · Cited by 489
“Unfortunately a direct comparison with past research results cannot be made, however, putting it into perspective in [21] the same data set was investigated.”
MethodResultWongvorachan, T., He, S., & Bulut, O. (2023) · Information · doi:10.3390/info14010054 · Cited by 375
An artificial intelligence life cycle: from conception to production
De Silva, D., & Alahakoon, D. (2022) · Patterns · doi:10.1016/j.patter.2022.100489 · Cited by 189
Hannousse, A., & Yahiouche, S. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104347 · Cited by 157
Metadata
- Authors
- Mohammed, R., Rawashdeh, J., & Abdullah, M.
- Venue
- 2020 11th International Conference on Information and Communication Systems (ICICS)
- Publisher
- IEEE
- Published
- 2020-04
- Pages
- 243-248
- OpenAlex
- W3021503072
- Cited by
- 684
- References
- 29
- FWCI
- 26.51
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.