The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Evolving Diverse Ensembles Using Genetic Programming for Classification With Unbalanced Data
Abstract
In classification, machine learning algorithms can suffer a performance bias when data sets are unbalanced. Data sets are unbalanced when at least one class is represented by only a small number of training examples (called the minority class), while the other class(es) make up the majority. In this scenario, classifiers can have good accuracy on the majority class, but very poor accuracy on the minority class(es). This paper proposes a multiobjective genetic programming (MOGP) approach to evolving accurate and diverse ensembles of genetic program classifiers with good performance on both the minority and majority of classes. The evolved ensembles comprise of nondominated solutions in the population where individual members vote on class membership. This paper evaluates the effectiveness of two popular Pareto-based fitness strategies in the MOGP algorithm (SPEA2 and NSGAII), and investigates techniques to encourage diversity between solutions in the evolved ensembles. Experimental results on six (binary) class imbalance problems show that the evolved ensembles outperform their individual members, as well as single-predictor methods such as canonical GP, naive Bayes, and support vector machines, on highly unbalanced tasks. This highlights the importance of developing an effective fitness evaluation strategy in the underlying MOGP algorithm to evolve good ensemble members.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Genetic Programming: On the Programming of Computers by Means of Natural Selection
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 13,082
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
Evolutionary Algorithms for Solving Multi-Objective Problems
(2007) · Genetic and Evolutionary Computation Series · doi:10.1007/978-0-387-36797-2 · Cited by 5,686
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
Popular Ensemble Methods: An Empirical Study
Opitz, D., & Maclin, R. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.614 · Cited by 2,953 · cited 6×
“The first involv es manipulating or dividing up the input-space into many subse ts which are used to train the different ensemble members, such as bagging and boosting techniques [4][18][27].”
BackgroundMethodInfluentialExploratory Undersampling for Class-Imbalance Learning
Liu, X.-Y., Wu, J., & Zhou, Z.-H. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2007853 · Cited by 2,465
Addressing the Curse of Imbalanced Training Sets: One-Sided Selection.
Kubát, M., & Matwin, S. (1997) · Cited by 2,230
Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation)
Coello, C. A. C., Lamont, G. B., & Veldhuizen, D. A. V. (2006) · Springer eBooks · Cited by 1,631
SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization
Zitzler, E., Giannakoglou, K., Tsahalis, D., Periaux, J., Papailiou, K., (eds, T. F., Ler, E. Z., Laumanns, M., & Thiele, L. (2002) · Cited by 1,010
SVMs Modeling for Highly Imbalanced Classification
Tang, Y., Zhang, Y.-Q., Chawla, N. V., & Krasser, S. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2002909 · Cited by 966
Learning when training data are costly: the effect of class distribution on tree induction
Weiss, G. M., & Provost, F. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1199 · Cited by 921
A Tutorial on the Performance Assessment of Stochastic Multiobjective Optimizers
Knowles, J. D., Thiele, L., & Zitzler, E. (2006) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000023822 · Cited by 863
Strategies for learning in class imbalance problems
Barandela, R., Sánchez, J. S., Garcı́a, V, & Rangel, E. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00257-1 · Cited by 579
An Experimental Study on Pedestrian Classification
Munder, S., & Gavrila, D. M. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.217 · Cited by 555
Diversity analysis on imbalanced data sets by using ensemble models
Wang, S., & Yao, X. (2009) · 2009 IEEE Symposium on Computational Intelligence and Data Mining · doi:10.1109/cidm.2009.4938667 · Cited by 548
Self-citationPareto-Based Multiobjective Machine Learning: An Overview and Case Studies
Jin, Y., & Sendhoff, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2008.919172 · Cited by 455
Adressing the curse of imbalanced training sets: one-sided selection
Kubát, M. (1997) · Medical Entomology and Zoology · Cited by 328
Generating Accurate and Diverse Members of a Neural-Network Ensemble
Opitz, D. W., & SHAVLIK, J. W. (1995) · Cited by 279
Making use of population information in evolutionary artificial neural networks
Yao, X., & Liu, Y. (1998) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.678637 · Cited by 257
Self-citationFundamentals of Exploratory Analysis of Variance
(1991) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316832 · Cited by 205
Credit Card Fraud Detection Using Meta-Learning: Issues and Initial Results 1
Stolfo, S. J., Fan, D. W., Lee, W., Prodromidis, A. L., & Chan, P. K. (1997) · Cited by 192
Ensemble Learning Using Multi-Objective Evolutionary Algorithms
Chandra, A., & Yao, X. (2006) · Journal of Mathematical Modelling and Algorithms · doi:10.1007/s10852-005-9020-3 · Cited by 179
Self-citationMultiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning
Chen, H., & Yao, X. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.26 · Cited by 162
Self-citationTraining Genetic Programming on Half a Million Patterns: An Example From Anomaly Detection
Song, D., Heywood, M. I., & Zincir-Heywood, N. (2005) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2004.841683 · Cited by 160
Intelligent Data Engineering and Automated Learning
Goh, O. S., & Fung, C. C. (2003) · Lecture notes in computer science · doi:10.1007/b11717 · Cited by 141
Relationships between Diversity of Classification Ensembles and Single-Class Performance Measures
Wang, S., & Yao, X. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.207 · Cited by 126
Self-citationPareto neuro-evolution: constructing ensemble of neural networks using multi-objective optimization
Abbass, H. A. (2004) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2003.1299928 · Cited by 121
Predictive Ensemble Pruning by Expectation Propagation
Chen, H., Peter Tiňo, B., & Yao, X. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.62 · Cited by 118
Self-citationEvolving Teams of Predictors with Linear Genetic Programming
Brameier, M., & Banzhaf, W. (2001) · Genetic Programming and Evolvable Machines · doi:10.1023/a:1012978805372 · Cited by 114
DIVACE: Diverse and Accurate Ensemble Learning Algorithm
Chandra, A., & Yao, X. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-28651-6_91 · Cited by 95
Self-citationBalancing Strategies and Class Overlapping
Batista, G., Prati, R. C., & Monard, M. C. (2005) · Lecture notes in computer science · doi:10.1007/11552253_3 · Cited by 88
GP Classification under Imbalanced Data sets: Active Sub-sampling and AUC Approximation
Doucette, J. A., & Heywood, M. I. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-78671-9_23 · Cited by 76
Exploiting Diversity in Ensembles: Improving the Performance on Unbalanced Datasets
Chawla, N. V., & Sylvester, J. (2007) · Springer eBooks · doi:10.1007/978-3-540-72523-7_40 · Cited by 53
A Genetic Programming Approach for Bankruptcy Prediction Using a Highly Unbalanced Database
Alfaro-Cid, E., Sharman, K. C., & Esparcia-Alcázar, A. I. (2007) · Springer eBooks · doi:10.1007/978-3-540-71805-5_19 · Cited by 41
Ensemble learning for free with evolutionary algorithms?
Gagné, C., Sébag, M., Schoenauer, M., & Tomassini, M. (2007) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1276958.1277317 · Cited by 38
Diversity exploration and negative correlation learning on imbalanced data sets
Wang, S., Tang, K., & Yao, X. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178836 · Cited by 35
Self-citationEvolving ensembles in multi-objective genetic programming for classification with unbalanced data
Bhowan, U., Johnston, M., & Zhang, M. (2011) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2001576.2001756 · Cited by 33
Self-citation
Cited by
Automated Machine Learning: Methods, Systems, Challenges
(2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5 · Cited by 1,485
Calibrating Probability with Undersampling for Unbalanced Classification
Pozzolo, A. D., Caelen, O., Johnson, R. A., & Bontempi, G. (2015) · 2015 IEEE Symposium Series on Computational Intelligence · doi:10.1109/ssci.2015.33 · Cited by 667
TPOT: A Tree-Based Pipeline Optimization Tool for Automating Machine Learning
Olson, R. S., & Moore, J. H. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_8 · Cited by 547
Santos, M. S., Soares, J. P., Abreu, P. H., Araujo, H., & Santos, J. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2866730 · Cited by 402
A Cost-Sensitive Deep Belief Network for Imbalanced Classification
Zhang, C., Tan, K. C., Li, H., & Hong, G. S. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2832648 · Cited by 282
Metadata
- Authors
- Bhowan, U., Johnston, M., Zhang, M., & Yao, X.
- Venue
- IEEE Transactions on Evolutionary Computation
- Published
- 2013-06
- Volume
- 17
- Issue
- 3
- Pages
- 368-386
- ISSN
- 1089-778X (ISSN-L)
- 1941-0026
- OpenAlex
- W2078885513
- Cited by
- 259
- References
- 42
- FWCI
- 25.40
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.