The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
A Systematic Study of Online Class Imbalance Learning With Concept Drift
Open accessAbstract
As an emerging research topic, online class imbalance learning often combines the challenges of both class imbalance and concept drift. It deals with data streams having very skewed class distributions, where concept drift may occur. It has recently received increased research attention; however, very little work addresses the combined problem where both class imbalance and concept drift coexist. As the first systematic study of handling concept drift in class-imbalanced data streams, this paper first provides a comprehensive review of current research progress in this field, including current research focuses and open challenges. Then, an in-depth experimental study is performed, with the goal of understanding how to best overcome concept drift in online learning with class imbalance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515
PAGE, E. S. (1954) · Biometrika · doi:10.1093/biomet/41.1-2.100 · Cited by 5,739
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
A survey on concept drift adaptation
Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014) · ACM Computing Surveys · doi:10.1145/2523813 · Cited by 3,735
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
Ensemble based systems in decision making
Polikar, R. (2006) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2006.1688199 · Cited by 2,938
Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., & Herrera, F. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2161285 · Cited by 2,794
Exploratory Undersampling for Class-Imbalance Learning
Liu, X.-Y., Wu, J., & Zhou, Z.-H. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2007853 · Cited by 2,465
A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems
Hand, D. J., & Till, R. J. (2001) · Machine Learning · doi:10.1023/a:1010920819831 · Cited by 2,276
Addressing the Curse of Imbalanced Training Sets: One-Sided Selection.
Kubát, M., & Matwin, S. (1997) · Cited by 2,230
A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks
Liang, N.-Y., Huang, G.-B., Saratchandran, P., & Sundararajan, N. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.880583 · Cited by 1,965
SMOTEBoost: Improving Prediction of the Minority Class in Boosting
Chawla, N. V., Lazarevic, A., Hall, L. O., & Bowyer, K. W. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39804-2_12 · Cited by 1,668
Nonlinear neural networks: Principles, mechanisms, and architectures
Grossberg, S. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90021-4 · Cited by 1,623
López, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590
Gama, J., Medas, P., Castillo, G., & Rodrigues, P. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28645-5_29 · Cited by 1,536
Machine Learning for the Detection of Oil Spills in Satellite Radar Images
Kubat, M., Holte, R. C., & Matwin, S. (1998) · Machine Learning · doi:10.1023/a:1007452223027 · Cited by 1,243
A streaming ensemble algorithm (SEA) for large-scale classification
Street, W. N., & Kim, Y. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502568 · Cited by 1,205
MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning
Barua, S., Islam, M. M., Yao, X., & Murase, K. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.232 · Cited by 1,150
Self-citation(1976) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1976.4309452 · Cited by 1,078
A Multiple Resampling Method for Learning from Imbalanced Data Sets
Estabrooks, A., Jo, T., & Japkowicz, N. (2004) · Computational Intelligence · doi:10.1111/j.0824-7935.2004.t01-1-00228.x · Cited by 1,014
Incremental Learning of Concept Drift in Nonstationary Environments
Elwell, R., & Polikar, R. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2160459 · Cited by 931
Learning when training data are costly: the effect of class distribution on tree induction
Weiss, G. M., & Provost, F. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1199 · Cited by 921
Learn++: an incremental learning algorithm for supervised neural networks
Polikar, R., Upda, L., Upda, S. S., & Honavar, V. (2001) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/5326.983933 · Cited by 888
Learning in Nonstationary Environments: A Survey
Ditzler, G., Roveri, M., Alippi, C., & Polikar, R. (2015) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2471196 · Cited by 793
Experimental perspectives on learning from imbalanced data
Van Hulse, J., Khoshgoftaar, T. M., & Napolitano, A. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273614 · Cited by 786
KNN approach to unbalanced data distributions: a case study involving information extraction
Ziang, J. (2003) · International Conference on Machine Learning · Cited by 772
Improving Identification of Difficult Small Classes by Balancing Class Distribution
Laurikkala, J. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-48229-6_9 · Cited by 748
Class imbalances versus small disjuncts
Jo, T., & Japkowicz, N. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007737 · Cited by 683
AdaCost: Misclassification Cost-Sensitive Boosting
Fan, W., Stolfo, S. J., Zhang, J., & Chan, P. K. (1999) · Cited by 612
Learning from imbalanced data sets with boosting and data generation: the DataBoost-IM approach
Guo, H., & Viktor, H. L. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007736 · Cited by 605
Oza, N. C. (2006) · 2005 IEEE International Conference on Systems, Man and Cybernetics · doi:10.1109/icsmc.2005.1571498 · Cited by 569
Webb, G. I., Hyde, R., Cao, H., Nguyen, H. L., & Petitjean, F. (2016) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-015-0448-4 · Cited by 536
On evaluating stream learning algorithms
Gama, J., Sebastião, R., & Rodrigues, P. P. (2013) · Machine Learning · doi:10.1007/s10994-012-5320-9 · Cited by 532
The Impact of Diversity on Online Ensemble Learning in the Presence of Concept Drift
Minku, L. L., White, A. P., & Yao, X. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.156 · Cited by 440
Self-citationDDD: A New Ensemble Approach for Dealing with Concept Drift
Minku, L. L., & Yao, X. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.58 · Cited by 431
Self-citationClass-Boundary Alignment for Imbalanced Dataset Learning
Wu, G., & Chang, E. Y. (2003) · Cited by 427
Reacting to Different Types of Concept Drift: The Accuracy Updated Ensemble Algorithm
Brzezinski, D., & Stefanowski, J. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2251352 · Cited by 423
A novelty detection approach to classification
Japkowicz, N., Myers, C. E., & Gluck, M. A. (1995) · Cited by 412
Incremental Learning of Concept Drift from Streaming Imbalanced Data
Ditzler, G., & Polikar, R. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.136 · Cited by 406
Learning When Data Sets are Imbalanced and When Costs are Unequal and Unknown
Maloof, M. A. (2003) · Cited by 406
Resampling-Based Ensemble Methods for Online Class Imbalance Learning
Wang, S., Minku, L. L., & Yao, X. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2345380 · Cited by 396
Self-citationWind power forecasting : state-of-the-art 2009.
Monteiro, C., Bessa, R., Miranda, V., Botterud, A., Wang, J., Conzelmann, G., & Porto, I. (2009) · doi:10.2172/968212 · Cited by 378
Class Imbalances versus Class Overlapping: An Analysis of a Learning System Behavior
Prati, R. C., Batista, G. E. A. P. A., & Monard, M. C. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24694-7_32 · Cited by 339
Boosting for Learning Multiple Classes with Imbalanced Class Distribution
Sun, Y., Kamel, M., & Wang, Y. (2006) · Sixth International Conference on Data Mining (ICDM'06) · doi:10.1109/icdm.2006.29 · Cited by 307
Li, R., Wang, S., Deng, H., Wang, R., & Chang, K. C.-C. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339692 · Cited by 307
Self-citationLearning from streaming data with concept drift and imbalance: an overview
Hoens, T. R., Polikar, R., & Chawla, N. V. (2012) · Progress in Artificial Intelligence · doi:10.1007/s13748-011-0008-0 · Cited by 301
Types of minority class examples and their influence on learning classifiers from imbalanced data
Napierala, K., & Stefanowski, J. (2016) · Journal of Intelligent Information Systems · doi:10.1007/s10844-015-0368-1 · Cited by 290
Learning when negative examples abound
Kubat, M., Holte, R., & Matwin, S. (1997) · Lecture Notes in Computer Science · doi:10.1007/3-540-62858-4_79 · Cited by 281
Evaluating boosting algorithms to classify rare classes: comparison and improvements
Joshi, M. V., Kumar, V., & Agarwal, R. C. (2002) · Proceedings 2001 IEEE International Conference on Data Mining · doi:10.1109/icdm.2001.989527 · Cited by 268
The Influence of Class Imbalance on Cost-Sensitive Learning: An Empirical Study
Liu, X.-Y., & Zhou, Z.-H. (2006) · Sixth International Conference on Data Mining (ICDM'06) · doi:10.1109/icdm.2006.158 · Cited by 248
Experimental comparisons of online and batch versions of bagging and boosting
Oza, N. C., & Russell, S. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502565 · Cited by 244
A General Framework for Mining Concept-Drifting Data Streams with Skewed Distributions
Gao, J., Fan, W., Han, J., & Yu, P. S. (2007) · Proceedings of the 2007 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972771.1 · Cited by 242
Sáez, J. A., Krawczyk, B., & Woźniak, M. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.03.012 · Cited by 242
The impact of changing populations on classifier performance
Kelly, M. G., Hand, D. J., & Adams, N. M. (1999) · Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/312129.312285 · Cited by 225
Neighbourhood sampling in bagging for imbalanced data
Błaszczyński, J., & Stefanowski, J. (2015) · Neurocomputing · doi:10.1016/j.neucom.2014.07.064 · Cited by 211
Online Ensemble Learning of Data Streams with Gradually Evolved Classes
Sun, Y., Tang, K., Minku, L. L., Wang, S., & Yao, X. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2526675 · Cited by 174
Self-citationEnsemble of subset online sequential extreme learning machine for class imbalance and concept drift
Mirza, B., Lin, Z., & Liu, N. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.03.075 · Cited by 167
Concept drift detection for streaming data
Wang, H., & Abraham, Z. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280398 · Cited by 155
Chen, S., & He, H. (2010) · Evolving Systems · doi:10.1007/s12530-010-9021-y · Cited by 153
Prequential AUC: properties of the area under the ROC curve for data streams with concept drift
Brzeziński, D., & Stefanowski, J. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1022-8 · Cited by 144
Concept Drift Detection Through Resampling
Harel, M., Mannor, S., El‐Yaniv, R., & Crammer, K. (2014) · International Conference on Machine Learning · Cited by 142
A learning framework for online class imbalance learning
Wang, S., Minku, L. L., & Yao, X. (2013) · doi:10.1109/ciel.2013.6613138 · Cited by 138
Self-citationOn predicting rare classes with SVM ensembles in scene classification
Yan, R., Liu, Y., Jin, R., & Hauptmann, A. G. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2003.1199097 · Cited by 133
SERA: Selectively recursive approach towards nonstationary imbalanced stream data mining
Chen, S., & He, H. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178874 · Cited by 130
Classifying Data Streams with Skewed Class Distributions and Concept Drifts
Gao, J., Ding, B., Fan, W., et al. (2008) · IEEE Internet Computing · doi:10.1109/mic.2008.119 · Cited by 129
Hierarchical Change-Detection Tests
Alippi, C., Boracchi, G., & Roveri, M. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2512714 · Cited by 120
Weighted Online Sequential Extreme Learning Machine for Class Imbalance Learning
Mirza, B., Lin, Z., & Toh, K. (2013) · Neural Processing Letters · doi:10.1007/s11063-013-9286-9 · Cited by 112
Cost-Sensitive Online Classification
Wang, J., Zhao, P., & Hoi, S. C. H. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.157 · Cited by 112
A new dynamic modeling framework for credit risk assessment
Sousa, M. R., da Gama, J. M. P., & Brandão, E. F. M. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.09.055 · Cited by 110
Classifying imbalanced data using a bagging ensemble variation (BEV)
Li, C. (2007) · ACM Southeast Regional Conference (ACMSE) · doi:10.1145/1233341.1233378 · Cited by 100
Balancing Strategies and Class Overlapping
Batista, G., Prati, R. C., & Monard, M. C. (2005) · Lecture notes in computer science · doi:10.1007/11552253_3 · Cited by 88
ONLINE CLASS IMBALANCE LEARNING AND ITS APPLICATIONS IN FAULT DETECTION
Wang, S., Minku, L. L., & Yao, X. (2013) · International Journal of Computational Intelligence and Applications · doi:10.1142/s1469026813400014 · Cited by 86
Self-citationHao, M., Wang, Y., & Bryant, S. H. (2013) · Analytica Chimica Acta · doi:10.1016/j.aca.2013.10.050 · Cited by 75
Online neural network model for non-stationary and imbalanced data stream classification
Ghazikhani, A., Monsefi, R., & Yazdi, H. S. (2013) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-013-0180-6 · Cited by 73
Graph Ensemble Boosting for Imbalanced Noisy Graph Stream Classification
Pan, S., Wu, J. X., Xingquan Zhu, A., & Chengqi Zhang, B. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2341031 · Cited by 70
Exploiting Diversity in Ensembles: Improving the Performance on Unbalanced Datasets
Chawla, N. V., & Sylvester, J. (2007) · Springer eBooks · doi:10.1007/978-3-540-72523-7_40 · Cited by 53
Dealing with multiple classes in online class imbalance learning
Wang, S., Minku, L. L., & Yao, X. (2016) · Leicester Research Archive (University of Leicester) · Cited by 53
Self-citationHandling Concept Drift in Text Data Stream Constrained by High Labelling Cost
Lindstrom, P. (2010) · Arrow@dit (Dublin Institute of Technology) · doi:10.21427/d7b022 · Cited by 50
Prequential AUC for Classifier Evaluation and Drift Detection in Evolving Data Streams
Brzeziński, D., & Stefanowski, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-17876-9_6 · Cited by 41
Learning in non-stationary environments with class imbalance
Hoens, T. R., & Chawla, N. V. (2012) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2339530.2339558 · Cited by 38
Ensemble diversity for class imbalance learning
Wang, S. (2011) · University of Birmingham Institutional Research Archive (University of Birmingham) · Cited by 16
Self-citation
Cited by
Khan, A. A., Chaudhari, O., & Chandra, R. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122778 · Cited by 530
From concept drift to model degradation: An overview on performance-aware drift detectors
Bayram, F., Ahmed, B. S., & Kassler, A. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108632 · Cited by 407
Elreedy, D., Atiya, A. F., & Kamalov, F. (2024) · Machine Learning · doi:10.1007/s10994-022-06296-4 · Cited by 388
An effective intrusion detection approach using SVM with naïve Bayes feature embedding
Gu, J., & Lu, S. (2021) · Computers & Security · doi:10.1016/j.cose.2020.102158 · Cited by 340
Spiking Neural Networks and online learning: An overview and perspectives
Lobo, J. L., Del Ser, J., Bifet, A., & Kasabov, N. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.09.004 · Cited by 304
Metadata
- Authors
- Wang, S., Minku, L. L., & Yao, X.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2018-10
- Volume
- 29
- Issue
- 10
- Pages
- 4802-4821
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2604756720
- Cited by
- 331
- References
- 86
- FWCI
- 18.53
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.