The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
A comprehensive data level analysis for cancer diagnosis on imbalanced data
Open accessAbstract
The early diagnosis of cancer, as one of the major causes of death, is vital for cancerous patients. Diagnosing diseases in general and cancer in particular is a considerable application of data analysis for medical science. However, imbalanced data distribution and imbalanced quality of the majority and minority classes, which lead to misclassification, is a great challenge in this field. Though the samples of the majority class and their proper classification are more important to classifier, cancer is diagnosed by relying on the minority class samples (cancer data class). While the consequence of wrong diagnosis for non-cancerous patients is several additional clinical tests, the cancerous patients pay the price of wrong diagnosis with their lives. As such, studying the class imbalance problem is vital from the medical's perspective. To serve this purpose, a comprehensive study on the consequences of imbalanced data problem is performed in this paper on the data of cancer patients for the first time. In this context, oversampling and under sampling as two main balancing techniques including 18 algorithms are employed. The techniques used in oversampling are ADASYN, ADOMS, AHC, Borderline-SMOTE, ROS, Safe-Level-SMOTE, SMOTE, SMOTE-ENN, SMOTE-TL, SPIDER and SPIDER2, while under sampling techniques are CNN, CNNTL, NCL, OSS, RUS, SBC and TL. To examine the impact of balancers on the performance of classifiers, four classifiers named RIPPER, MLP, KNN, and C4.5 are employed as learners. In addition, 15 cancer data sets from SEER program used for the study are kidney, soft tissue, bladder, rectum, colon, bone, larynx, breast, cervix, prostate, oropharynx, melanoma, thyroid, testis, and lip. The findings of the study are centered on examining the impact of class imbalance on the function of classifiers, a general comparing of the function of pre-processing techniques and classifying all data sets and finally determining the best balancer and classifier for each kind of cancer data set. According to the results, significant improvement is obtained through using balancers. Assessing by AUC, the performance of different classifiers of cancer imbalanced data sets has improved in 90% of the cases after using balancing techniques. To be more precise, Friedman statistical tests are applied and interestingly, each kind of cancer data set responded differently to different balancing techniques and classifiers. Moreover, considering the mean rank of each technique and classifier that were used for data sets, oversampling balancing techniques result in better outcomes than under sampling ones.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Siegel, R. L., Miller, K. D., & Jemal, A. (2016) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21332 · Cited by 16,003
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359 · cited 3×
“For medical industry, such error is more costly than classifying a noncancerous patient as cancerous [19].”
BackgroundMethodInfluentialBorderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
A survey of cross-validation procedures for model selection
Arlot, S., & Célisse, A. (2010) · LillOA (Université de Lille (University Of Lille)) · Cited by 3,669
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522
Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., & Herrera, F. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2161285 · Cited by 2,794
Alcalá‐Fdez, J., Fernández, A., Luengo, J., Derrac, J., García, S., Sánchez, L., & Herrera, F. (2011) · Repositorio de la Universidad de Oviedo (RUO) · Cited by 2,729
Learning from imbalanced data: open challenges and future directions
Krawczyk, B. (2016) · Progress in Artificial Intelligence · doi:10.1007/s13748-016-0094-0 · Cited by 2,459
Bray, F., Jemal, A., Grey, N., Ferlay, J., & Forman, D. (2012) · The Lancet Oncology · doi:10.1016/s1470-2045(12)70211-5 · Cited by 2,223
The condensed nearest neighbor rule (Corresp.)
Hart, P. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054155 · Cited by 1,733
CLASSIFICATION OF IMBALANCED DATA: A REVIEW
SUN, Y., WONG, A. K. C., & KAMEL, M. S. (2009) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001409007326 · Cited by 1,692
López, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590
KEEL: a software tool to assess evolutionary algorithms for data mining problems
Alcalá-Fdez, J., Sánchez, L., García, S., del Jesus, M. J., Ventura, S., Garrell, J. M., Otero, J., Romero, C., Bacardit, J., Rivas, V. M., et al. (2009) · Soft Computing · doi:10.1007/s00500-008-0323-y · Cited by 1,505
(1976) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1976.4309452 · Cited by 1,078
Bunkhumpornpat, C., Sinapiromsaran, K., & Lursinsap, C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01307-2_43 · Cited by 943
Improving Identification of Difficult Small Classes by Balancing Class Distribution
Laurikkala, J. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-48229-6_9 · Cited by 748
Sáez, J. A., Luengo, J., Stefanowski, J., & Herrera, F. (2015) · Information Sciences · doi:10.1016/j.ins.2014.08.051 · Cited by 627
EUSBoost: Enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling
Galar, M., Fernández, A., Barrenechea, E., & Herrera, F. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.05.006 · Cited by 419
Santos, M. S., Soares, J. P., Abreu, P. H., Araujo, H., & Santos, J. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2866730 · Cited by 402
Data Mining in Healthcare – A Review
Jothi, N., Rashid, N. A., & Husain, W. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.12.145 · Cited by 300
Addressing imbalance in multilabel classification: Measures and random resampling algorithms
Charte, F., Rivera, A. J., del Jesus, M. J., & Herrera, F. (2015) · Neurocomputing · doi:10.1016/j.neucom.2014.08.091 · Cited by 288
Finding the Best Classification Threshold in Imbalanced Classification
Zou, Q., Xie, S., Lin, Z., Wu, M., & Ju, Y. (2016) · Big Data Research · doi:10.1016/j.bdr.2015.12.001 · Cited by 281
Evolutionary undersampling boosting for imbalanced classification of breast cancer malignancy
Krawczyk, B., Galar, M., Jeleń, Ł., & Herrera, F. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2015.08.060 · Cited by 263
Learning from imbalanced data in surveillance of nosocomial infection
Cohen, G., Hilario, M., Sax, H., Hugonnet, S., & Geissbuhler, A. (2006) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2005.03.002 · Cited by 258
Learning from Imbalanced Data in Presence of Noisy and Borderline Examples
Napierała, K., Stefanowski, J., & Wilk, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-13529-3_18 · Cited by 229
Under-Sampling Approaches for Improving Prediction of the Minority Class in an Imbalanced Dataset
Yen, S.-J., & Lee, Y. (2006) · Springer eBooks · doi:10.1007/11816492_89 · Cited by 214
Redundancy-driven modified Tomek-link based undersampling: A solution to class imbalance
Devi, D., Biswas, S. K., & Purkayastha, B. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.10.006 · Cited by 211
Zięba, M., Tomczak, J. M., Lubicz, M., & Świątek, J. (2013) · Applied Soft Computing · doi:10.1016/j.asoc.2013.07.016 · Cited by 182
A method for resampling imbalanced datasets in binary classification tasks for real-world problems
Cateni, S., Colla, V., & Vannucci, M. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.05.059 · Cited by 176
Wang, K., Makond, B., Chen, K.-H., & Wang, K.-M. (2013) · Applied Soft Computing · doi:10.1016/j.asoc.2013.09.014 · Cited by 149
Majid, A., Ali, S., Iqbal, M., & Kausar, N. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2014.01.001 · Cited by 117
An ensemble classification approach for melanoma diagnosis
Schaefer, G., Krawczyk, B., Celebi, M. E., & Iyatomi, H. (2014) · Memetic Computing · doi:10.1007/s12293-014-0144-8 · Cited by 113
A resampling ensemble algorithm for classification of imbalance problems
Qian, Y., Liang, Y., Li, M., Feng, G., & Shi, X. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.06.021 · Cited by 111
Decision Tree Based Predictive Models for Breast Cancer Survivability on Imbalanced Data
Liu, Y., Wang, C., & Zhang, L. (2009) · International Conference on Bioinformatics and Biomedical Engineering · doi:10.1109/icbbe.2009.5162571 · Cited by 106
A new automatic mass detection method for breast cancer with false positive reduction
Liu, X., & Zeng, Z. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.10.040 · Cited by 89
Applying Data Mining Techniques to Improve Breast Cancer Diagnosis
Diz, J., Marreiros, G., & Freitas, A. (2016) · Journal of Medical Systems · doi:10.1007/s10916-016-0561-y · Cited by 71
Lung Cancer Survival Prediction using Ensemble Data Mining on Seer Data
Agrawal, A., Misra, S., Narayanan, R., Polepeddi, L., & Choudhary, A. (2012) · Scientific Programming · doi:10.1155/2012/920245 · Cited by 69
Huang, Z., Chan, T.-M., & Dong, W. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.01.001 · Cited by 69
Colon cancer survival prediction using ensemble data mining on SEER data
Al-Bahrani, R., Agrawal, A., & Choudhary, A. (2013) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2013.6691752 · Cited by 62
The generation mechanism of synthetic minority class examples
Tang, S., & Chen, S. (2008) · IEEE International Conference on Information Technology and Applications in Biomedicine · doi:10.1109/itab.2008.4570642 · Cited by 59
Wang, K., Adrian, A. M., Chen, K., & Wang, K.-M. (2015) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2015.03.003 · Cited by 56
Mansourypoor, F., & Asadi, S. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.10.024 · Cited by 56
Self-citationNahar, J., Imam, T., Tickle, K. S., Ali, A. B. M. S., & Chen, Y. P. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.04.045 · Cited by 54
A hybrid classifier committee for analysing asymmetry features in breast thermograms
Krawczyk, B., & Schaefer, G. (2013) · Applied Soft Computing · doi:10.1016/j.asoc.2013.11.011 · Cited by 49
Impact of noise and data sampling on stability of feature ranking techniques for biological datasets
Shanab, A. A., Khoshgoftaar, T. M., Wald, R., & Napolitano, A. (2012) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri.2012.6303039 · Cited by 42
A comparative study on sampling techniques for handling class imbalance in streaming data
Nguyen, H. M., Cooper, E. W., & Kamei, K. (2012) · Joint International Conference on Soft Computing and Intelligent Systems and International Symposium on Advanced Intelligent Systems (SCIS&ISIS) · doi:10.1109/scis-isis.2012.6505291 · Cited by 39
EMDID: Evolutionary multi-objective discretization for imbalanced datasets
Tahan, M. H., & Asadi, S. (2017) · Information Sciences · doi:10.1016/j.ins.2017.12.023 · Cited by 37
Self-citationRipMC: RIPPER for Multiclass Classification
Asadi, S., & Shahrabi, J. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.01.010 · Cited by 29
Self-citationACORI: a novel ACO algorithm for rule induction
Asadi, S., & Shahrabi, J. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.01.005 · Cited by 25
Self-citationUnder-sampling by algorithm with performance guaranteed for class-imbalance problem
Jindaluang, W., Chouvatut, V., & Kantabutra, S. (2014) · International Computer Science and Engineering Conference · doi:10.1109/icsec.2014.6978197 · Cited by 24
Complexity-based parallel rule induction for multiclass classification
Asadi, S., & Shahrabi, J. (2016) · Information Sciences · doi:10.1016/j.ins.2016.10.047 · Cited by 21
Self-citation
Cited by
A survey on imbalanced learning: latest research, applications and future directions
Chen, W., Yang, K., Yu, Z., Shi, Y., & Chen, C. L. P. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10759-6 · Cited by 506
Elreedy, D., Atiya, A. F., & Kamalov, F. (2024) · Machine Learning · doi:10.1007/s10994-022-06296-4 · Cited by 388
A Comparative Performance Analysis of Data Resampling Methods on Imbalance Medical Data
Khushi, M., Shaukat, K., Alam, T. M., Hameed, I. A., Uddin, S., Luo, S., Yang, X., & Reyes, M. C. (2021) · IEEE Access · doi:10.1109/access.2021.3102399 · Cited by 335
Xu, Z., Shen, D., Nie, T., & Kou, Y. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103465 · Cited by 297
Handling imbalanced medical datasets: review of a decade of research
Salmi, M., Atif, D., Oliva, D., Abraham, A., & Ventura, S. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10884-2 · Cited by 272
Metadata
- Authors
- Fotouhi, S., Asadi, S., & Kattan, M. W.
- Venue
- Journal of Biomedical Informatics
- Publisher
- Elsevier BV
- Published
- 2019-02
- Volume
- 90
- Pages
- 103089
- ISSN
- 1532-0464 (ISSN-L)
- OpenAlex
- W2908465383
- Cited by
- 343
- References
- 53
- FWCI
- 16.69
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.