The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Cross-Validation for Imbalanced Datasets: Avoiding Overoptimistic and Overfitting Approaches [Research Frontier]
Abstract
Although cross-validation is a standard procedure for performance evaluation, its joint application with oversampling remains an open question for researchers farther from the imbalanced data topic. A frequent experimental flaw is the application of oversampling algorithms to the entire dataset, resulting in biased models and overly-optimistic estimates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · cited 1×
“At last, AUC makes use of the ROC curve to exhibit the trade-off between the classifier’s TP and FP rates [31].”
MethodFinding groups in data: an introduction to cluster analysis
(1991) · Choice Reviews Online · doi:10.5860/choice.28-4558 · Cited by 10,474
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Davies, D. L., & Bouldin, D. W. (1979) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1979.4766909 · Cited by 9,145
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521
A dendrite method for cluster analysis
Caliński, T., & Harabasz, J. (1974) · Communications in Statistics · doi:10.1080/03610927408827101 · Cited by 4,480
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
Asymptotic Properties of Nearest Neighbor Rules Using Edited Data
Wilson, D. L. (1972) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1972.4309137 · Cited by 2,130
Editorial: special issue on learning from imbalanced data sets
Chawla, N. V., Japkowicz, N., & Kotcz, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007733 · Cited by 2,063
López, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590
MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning
Barua, S., Islam, M. M., Yao, X., & Murase, K. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.232 · Cited by 1,150
(1976) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1976.4309452 · Cited by 1,078
Bunkhumpornpat, C., Sinapiromsaran, K., & Lursinsap, C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01307-2_43 · Cited by 943
Complexity measures of supervised classification problems
Ho, T. K., & Basu, M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990132 · Cited by 734
Class imbalances versus small disjuncts
Jo, T., & Japkowicz, N. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007737 · Cited by 683
SPECIAL ISSUE ON LEARNING FROM IMBALANCED DATA SETS
Chawla, N. V., Japkowicz, N., & Kołcz, A. (2004) · Cited by 325
López, V., Fernández, A., Moreno-Torres, J. G., & Herrera, F. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.12.043 · Cited by 316
Moreno-Torres, J. G., Saez, J. A., & Herrera, F. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2199516 · Cited by 306
Evolving Diverse Ensembles Using Genetic Programming for Classification With Unbalanced Data
Bhowan, U., Johnston, M., Zhang, M., & Yao, X. (2013) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2012.2199119 · Cited by 259
Learning from imbalanced data in surveillance of nosocomial infection
Cohen, G., Hilario, M., Sax, H., Hugonnet, S., & Geissbuhler, A. (2006) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2005.03.002 · Cited by 258
Local neighbourhood extension of SMOTE for mining imbalanced data
Maciejewski, T., & Stefanowski, J. (2011) · 2011 IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2011.5949434 · Cited by 255
Sáez, J. A., Krawczyk, B., & Woźniak, M. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.03.012 · Cited by 242
Learning from Imbalanced Data in Presence of Noisy and Borderline Examples
Napierała, K., Stefanowski, J., & Wilk, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-13529-3_18 · Cited by 229
Santos, M. S., Abreu, P. H., García-Laencina, P. J., Simão, A., & Carvalho, A. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.09.012 · Cited by 219
Self-citationLuengo, J., Fernández, A., García, S., & Herrera, F. (2011) · Soft Computing · doi:10.1007/s00500-010-0625-8 · Cited by 191
Selective Pre-processing of Imbalanced Data for Improving Classification Performance
Stefanowski, J., & Wilk, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-85836-2_27 · Cited by 188
Prediction of Preterm Deliveries from EHG Signals Using Machine Learning
Fergus, P., Cheung, P., Hussain, A. J., Al‐Jumeily, D., Dobbins, C., & Iram, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0077154 · Cited by 185
Self-Organizing Map Oversampling (SOMO) for imbalanced data set learning
Douzas, G., & Bacao, F. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.03.073 · Cited by 179
Loyola-González, O., Martínez-Trinidad, J. F., Carrasco-Ochoa, J. A., & García-Borroto, M. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.04.120 · Cited by 177
Predicting Breast Cancer Recurrence Using Machine Learning Techniques: A Systematic Review
Abreu, P. H., Santos, M. S., Abreu, M. H., Andrade, B., & Silva, D. C. (2016) · ACM Computing Surveys · doi:10.1145/2988544 · Cited by 171
Self-citationBlagus, R., & Lusa, L. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0784-9 · Cited by 158
Dealing with Data Difficulty Factors While Learning from Imbalanced Data
Stefanowski, J. (2015) · Studies in computational intelligence · doi:10.1007/978-3-319-18781-5_17 · Cited by 146
A SVM framework for fault detection of the braking system in a high speed train
Liu, J., Li, Y., & Zio, E. (2016) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2016.10.034 · Cited by 117
Acharya, U. R., Sudarshan, V. K., Rong, S. Q., Tan, Z., Lim, C. M., Koh, J. E., Nayak, S., & Bhandary, S. V. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.04.013 · Cited by 103
Rivera, W., & Xanthopoulos, P. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.09.010 · Cited by 74
Medical decision support system for extremely imbalanced datasets
Shilaskar, S., Ghatol, A. A., & Chatur, P. N. (2016) · Information Sciences · doi:10.1016/j.ins.2016.08.077 · Cited by 64
The generation mechanism of synthetic minority class examples
Tang, S., & Chen, S. (2008) · IEEE International Conference on Information Technology and Applications in Biomedicine · doi:10.1109/itab.2008.4570642 · Cited by 59
Oppedal, K., Engan, K., Eftestøl, T., Beyer, M. K., & Aarsland, D. (2016) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2016.10.007 · Cited by 18
Cited by
Machine Learning in Environmental Research: Common Pitfalls and Best Practices
Zhu, J.-J., Yang, M., & Ren, Z. J. (2023) · Environmental Science & Technology · doi:10.1021/acs.est.3c00026 · Cited by 672
Hossain, E., Rana, R., Higgins, N., Soar, J., Barua, P. D., Pisani, A. R., & Turner, K. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106649 · Cited by 407
Wongvorachan, T., He, S., & Bulut, O. (2023) · Information · doi:10.3390/info14010054 · Cited by 375
A comprehensive data level analysis for cancer diagnosis on imbalanced data
Fotouhi, S., Asadi, S., & Kattan, M. W. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.12.003 · Cited by 343
How Complex Is Your Classification Problem?: A Survey on Measuring Classification Complexity
Lorena, A. C., Garcia, L. P. F., Lehmann, J., Souto, M. C. P., & Ho, T. K. (2020) · ACM Computing Surveys · doi:10.1145/3347711 · Cited by 275
Metadata
- Authors
- Santos, M. S., Soares, J. P., Abreu, P. H., Araujo, H., & Santos, J.
- Venue
- IEEE Computational Intelligence Magazine
- Published
- 2018-11
- Volume
- 13
- Issue
- 4
- Pages
- 59-76
- ISSN
- 1556-603X (ISSN-L)
- 1556-6048
- OpenAlex
- W2896236534
- Cited by
- 402
- References
- 41
- FWCI
- 15.42
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.