The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Cost-sensitive decision tree ensembles for effective imbalanced classification
Open accessAbstract
Real-life datasets are often imbalanced, that is, there are significantly more training samples available for some classes than for others, and consequently the conventional aim of reducing overall classification accuracy is not appropriate when dealing with such problems. Various approaches have been introduced in the literature to deal with imbalanced datasets, and are typically based on oversampling, undersampling or cost-sensitive classification. In this paper, we introduce an effective ensemble of cost-sensitive decision trees for imbalanced classification. Base classifiers are constructed according to a given cost matrix, but are trained on random feature subspaces to ensure sufficient diversity of the ensemble members. We employ an evolutionary algorithm for simultaneous classifier selection and assignment of committee member weights for the fusion process. Our proposed algorithm is evaluated on a variety of benchmark datasets, and is confirmed to lead to improved recognition of the minority class, to be capable of outperforming other state-of-the-art algorithms, and hence to represent a useful and effective approach for dealing with imbalanced datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Russell, E. L., Chiang, L. H., & Braatz, R. D. (2000) · Advances in Industrial Control · doi:10.1007/978-1-4471-0409-4_3 · Cited by 7,862
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,842
Statistical pattern recognition: a review
Jain, A. K., Duin, P. W., & Mao, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824819 · Cited by 6,767
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521
Combining Pattern Classifiers: Methods and Algorithms
Bagui, S. C. (2005) · Technometrics · doi:10.1198/tech.2005.s320 · Cited by 3,202
Combining Pattern Classifiers: Methods and Algorithms
Kuncheva, L. I. (2004) · Wiley eBooks · doi:10.1002/0471660264 · Cited by 3,005
Alcalá‐Fdez, J., Fernández, A., Luengo, J., Derrac, J., García, S., Sánchez, L., & Herrera, F. (2011) · Repositorio de la Universidad de Oviedo (RUO) · Cited by 2,730
Exploratory Undersampling for Class-Imbalance Learning
Liu, X.-Y., Wu, J., & Zhou, Z.-H. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2007853 · Cited by 2,465
Srinivas, M., & Patnaik, L. M. (1994) · Computer · doi:10.1109/2.294849 · Cited by 2,180
Methods of combining multiple classifiers and their applications to handwriting recognition
Xu, L., Krzyzak, A., & Suen, C. Y. (1992) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.155943 · Cited by 2,179
CLASSIFICATION OF IMBALANCED DATA: A REVIEW
SUN, Y., WONG, A. K. C., & KAMEL, M. S. (2009) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001409007326 · Cited by 1,692
Proceedings of the International Joint Conference on Neural Networks, 2003.
(2003) · doi:10.1109/ijcnn.2003 · Cited by 1,674
SMOTEBoost: Improving Prediction of the Minority Class in Boosting
Chawla, N. V., Lazarevic, A., Hall, L. O., & Bowyer, K. W. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39804-2_12 · Cited by 1,668
Cost-sensitive boosting for classification of imbalanced data
Sun, Y., Kamel, M. S., Wong, A. K. C., & Wang, Y. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2007.04.009 · Cited by 1,423
Proceedings of the twenty-first international conference on Machine learning
Brodley, C. E. (2004) · Cited by 1,020
Decision templates for multiple classifier fusion: an experimental comparison
Kuncheva, L. I., Bezdek, J. C., & Duin, R. P. W. (2001) · Pattern Recognition · doi:10.1016/s0031-3203(99)00223-x · Cited by 1,003
Diversity analysis on imbalanced data sets by using ensemble models
Wang, S., & Yao, X. (2009) · 2009 IEEE Symposium on Computational Intelligence and Data Mining · doi:10.1109/cidm.2009.4938667 · Cited by 548
The Supervised Learning No-Free-Lunch Theorems
Wolpert, D. H. (2002) · Soft Computing and Industry · doi:10.1007/978-1-4471-0123-9_3 · Cited by 468
Combined 5 × 2 cv F Test for Comparing Supervised Classification Learning Algorithms
Alpaydm, E. (1999) · Neural Computation · doi:10.1162/089976699300016007 · Cited by 431
Evolutionary Computation for Modeling and Optimization
(2006) · Springer eBooks · doi:10.1007/0-387-31909-3 · Cited by 401
The combining classifier: to train or not to train?
Duin, R. P. W. (2003) · Object recognition supported by user interaction for service robots · doi:10.1109/icpr.2002.1048415 · Cited by 332
López, V., Fernández, A., Moreno-Torres, J. G., & Herrera, F. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.12.043 · Cited by 316
Decision trees with minimal costs
Ling, C. X., Yang, Q., Wang, J., & Zhang, S. (2004) · International Conference on Machine Learning · doi:10.1145/1015330.1015369 · Cited by 286
On the k-NN performance in a challenging scenario of imbalance and overlapping
García, V., Mollineda, R. A., & Sánchez, J. S. (2008) · Pattern Analysis and Applications · doi:10.1007/s10044-007-0087-5 · Cited by 219
Chen, X.-W., & Wasikowski, M. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401910 · Cited by 216
RAMOBoost: Ranked Minority Oversampling in Boosting
Chen, S., He, H., & Garcia, E. A. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2066988 · Cited by 208
Face Recognition Using Total Margin-Based Adaptive Fuzzy Support Vector Machines
Liu, Y.-H., & Chen, Y.-T. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.883013 · Cited by 203
The Use of Background Knowledge in Decision Tree Induction
Núñez, M. (1991) · Machine Learning · doi:10.1023/a:1022609710832 · Cited by 196
An overview and comparison of voting methods for pattern recognition
van Erp, M., Vuurpijl, L., & Schomaker, L. (2003) · Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition · doi:10.1109/iwfhr.2002.1030908 · Cited by 190
Association Rule Mining-Based Dissolved Gas Analysis for Fault Diagnosis of Power Transformers
Yang, Z., Tang, W., Shintemirov, A., & Wu, Q. (2009) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2009.2021989 · Cited by 146
2009 IEEE Symposium on Computational Intelligence and Data Mining
(2009) · doi:10.1109/cidm14692.2009 · Cited by 143
Proceedings of the 5th International Conference on
Focardi, E. (2002) · Nuclear Instruments and Methods in Physics Research Section A Accelerators Spectrometers Detectors and Associated Equipment · doi:10.1016/s0168-9002(02)00519-3 · Cited by 132
Khreich, W., Granger, É., Miri, A., & Sabourin, R. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2010.03.006 · Cited by 117
The use of background knowledge in decision tree induction
N��ez, M. (1991) · Machine Learning · doi:10.1007/bf00114778 · Cited by 113
Jackowski, K., & Woźniak, M. (2008) · Pattern Analysis and Applications · doi:10.1007/s10044-008-0137-7 · Cited by 45
Self-citationSome Remarks on Chosen Methods of Classifier Fusion Based on Weighted Voting
Woźniak, M., & Jackowski, K. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02319-4_65 · Cited by 43
Self-citationDiversity in Ensembles for One-Class Classification
Krawczyk, B. (2012) · Advances in intelligent systems and computing · doi:10.1007/978-3-642-32518-2_12 · Cited by 21
Self-citation
Cited by
Learning from imbalanced data: open challenges and future directions
Krawczyk, B. (2016) · Progress in Artificial Intelligence · doi:10.1007/s13748-016-0094-0 · Cited by 2,459
Self-citationLearning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Data
Dablain, D., Krawczyk, B., & Chawla, N. V. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3136503 · Cited by 591
Self-citationA Systematic Review on Imbalanced Data Challenges in Machine Learning: Applications and Solutions
Kaur, H., Pannu, H. S., & Malhi, A. K. (2020) · ACM Computing Surveys · doi:10.1145/3343440 · Cited by 488
Dynamic classifier selection: Recent advances and perspectives
Cruz, R. M. O., Sabourin, R., & Cavalcanti, G. D. C. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.09.010 · Cited by 440
Metadata
- Authors
- Krawczyk, B., Woźniak, M., & Schaefer, G.
- Venue
- Applied Soft Computing
- Publisher
- Elsevier BV
- Published
- 2014-01
- Volume
- 14
- Pages
- 554-562
- ISSN
- 1568-4946 (ISSN-L)
- OpenAlex
- W1984323748
- Cited by
- 361
- References
- 43
- FWCI
- 18.04
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.