The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Incremental Learning of Concept Drift from Streaming Imbalanced Data
Abstract
Learning in nonstationary environments, also known as learning concept drift, is concerned with learning from data whose statistical characteristics change over time. Concept drift is further complicated if the data set is class imbalanced. While these two issues have been independently addressed, their joint treatment has been mostly underexplored. We describe two ensemble-based approaches for learning concept drift from imbalanced data. Our first approach is a logical combination of our previously introduced Learn++.NSE algorithm for concept drift, with the well-established SMOTE for learning from imbalanced data. Our second approach makes two major modifications to Learn++.NSE-SMOTE integration by replacing SMOTE with a subensemble that makes strategic use of minority class data; and replacing Learn++.NSE and its class-independent error weighting mechanism with a penalty constraint that forces the algorithm to balance accuracy on all classes. The primary novelty of this approach is in determining the voting weights for combining ensemble members, based on each classifier's time and imbalance-adjusted accuracy on current and past environments. Favorable results in comparison to other approaches indicate that both approaches are able to address this challenging problem, each with its own specific areas of strength. We also release all experimental data as a resource and benchmark for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Learning in the Presence of Concept Drift and Hidden Contexts
Widmer, G., & Kubat, M. (1996) · Machine Learning · doi:10.1023/a:1018046501280 · Cited by 1,857
Mining time-changing data streams
Hulten, G., Spencer, L., & Domingos, P. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502529 · Cited by 1,748
The condensed nearest neighbor rule (Corresp.)
Hart, P. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054155 · Cited by 1,733
SMOTEBoost: Improving Prediction of the Minority Class in Boosting
Chawla, N. V., Lazarevic, A., Hall, L. O., & Bowyer, K. W. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39804-2_12 · Cited by 1,668
Nonlinear neural networks: Principles, mechanisms, and architectures
Grossberg, S. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90021-4 · Cited by 1,623
Machine Learning for the Detection of Oil Spills in Satellite Radar Images
Kubat, M., Holte, R. C., & Matwin, S. (1998) · Machine Learning · doi:10.1023/a:1007452223027 · Cited by 1,243
A streaming ensemble algorithm (SEA) for large-scale classification
Street, W. N., & Kim, Y. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502568 · Cited by 1,205
(1976) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1976.4309452 · Cited by 1,078
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
SVMs Modeling for Highly Imbalanced Classification
Tang, Y., Zhang, Y.-Q., Chawla, N. V., & Krasser, S. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2002909 · Cited by 966
Incremental Learning of Concept Drift in Nonstationary Environments
Elwell, R., & Polikar, R. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2160459 · Cited by 931
Self-citationLearn++: an incremental learning algorithm for supervised neural networks
Polikar, R., Upda, L., Upda, S. S., & Honavar, V. (2001) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/5326.983933 · Cited by 888
Self-citationBifetAlbert, HolmesGeoff, KirkbyRichard, & PfahringerBernhard (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859903 · Cited by 771
Incremental learning from noisy data
Schlimmer, J. C., & Granger, R. H. (1986) · Machine Learning · doi:10.1007/bf00116895 · Cited by 653
Learning from imbalanced data sets with boosting and data generation: the DataBoost-IM approach
Guo, H., & Viktor, H. L. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007736 · Cited by 605
New ensemble methods for evolving data streams
Bifet, A., Holmes, G., Pfahringer, B., Kirkby, R., & Gavaldà, R. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557041 · Cited by 558
Dynamic weighted majority: a new ensemble method for tracking concept drift
Kolter, J. Z., & Maloof, M. A. (2004) · Third IEEE International Conference on Data Mining · doi:10.1109/icdm.2003.1250911 · Cited by 419
FSVM-CIL: Fuzzy Support Vector Machines for Class Imbalance Learning
Batuwita, R., & Palade, V. (2010) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2010.2042721 · Cited by 411
Classifier Ensembles for Changing Environments
Kuncheva, L. I. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-25966-4_1 · Cited by 335
A General Framework for Mining Concept-Drifting Data Streams with Skewed Distributions
Gao, J., Fan, W., Han, J., & Yu, P. S. (2007) · Proceedings of the 2007 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972771.1 · Cited by 242
Muhlbaier, M. D., Topalis, A., & Polikar, R. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2008326 · Cited by 207
Self-citationDynamic integration of classifiers for handling concept drift
Tsymbal, A., Pechenizkiy, M., Cunningham, P., & Puuronen, S. (2008) · Information Fusion · doi:10.1016/j.inffus.2006.11.002 · Cited by 195
A note on the utility of incremental learning
Giraud-Carrier, C. G. (2000) · Cited by 182
Tracking drifting concepts by minimizing disagreements
Helmbold, D. P., & Long, P. M. (1994) · Machine Learning · doi:10.1007/bf00993161 · Cited by 161
Just-in-Time Adaptive Classifiers—Part I: Detecting Nonstationary Changes
Alippi, C., & Roveri, M. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2000082 · Cited by 154
Chen, S., & He, H. (2010) · Evolving Systems · doi:10.1007/s12530-010-9021-y · Cited by 144
On Appropriate Assumptions to Mine Data Streams: Analysis and Practice
Gao, J., Fan, W., & Han, J. (2007) · Proceedings · doi:10.1109/icdm.2007.96 · Cited by 141
Classifying Data Streams with Skewed Class Distributions and Concept Drifts
Gao, J., Ding, B., Fan, W., et al. (2008) · IEEE Internet Computing · doi:10.1109/mic.2008.119 · Cited by 129
SERA: Selectively recursive approach towards nonstationary imbalanced stream data mining
Chen, S., & He, H. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178874 · Cited by 117
Classifier Ensembles for Detecting Concept Change in Streaming Data: Overview and Perspectives
Kuncheva, L. I. (2008) · Cited by 110
Life-long learning Cell Structures—continuously learning without catastrophic interference
Hamker, F. H. (2001) · Neural Networks · doi:10.1016/s0893-6080(01)00018-1 · Cited by 101
Entropy-based Concept Shift Detection
Vorburger, P., & Bernstein, A. (2006) · Proceedings · doi:10.1109/icdm.2006.66 · Cited by 96
Adaptive learning and mining for data streams and frequent patterns
Bifet, A. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656287 · Cited by 86
Classifying imbalanced data using a bagging ensemble variation (BEV)
Li, C. (2007) · ACM Southeast Regional Conference (ACMSE) · doi:10.1145/1233341.1233378 · Cited by 85
Just-in-Time Adaptive Classifiers—Part II: Designing the Classifier
Alippi, C., & Roveri, M. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2003998 · Cited by 82
Incremental learning in nonstationary environments with controlled forgetting
Elwell, R., & Polikar, R. (2009) · doi:10.1109/ijcnn.2009.5178779 · Cited by 61
Self-citationIMORL: Incremental Multiple-Object Recognition and Localization
He, H., & Chen, S. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2001774 · Cited by 53
Adaptive Classifiers-Ensemble System for Tracking Concept Drift
Nishida, K., & Yamauchi, K. (2007) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2007.4370772 · Cited by 49
Learning concept drift in nonstationary environments using an ensemble of classifiers based approach
Karnick, M. T., Ahiskali, M., Muhlbaier, M. D., & Robi Polikar, A. (2008) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2008.4634290 · Cited by 42
Change detection tests using the ICI rule
Alippi, C., Boracchi, G., & Roveri, M. (2010) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2010.5596537 · Cited by 41
Just in time classifiers: Managing the slow drift case
Alippi, C., Boracchi, G., & Roveri, M. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178799 · Cited by 38
Incremental Learning of New Classes in Unbalanced Datasets: Learn + + .UDNC
Ditzler, G., Muhlbaier, M. D., & Robi Polikar, A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12127-2_4 · Cited by 32
Self-citationFormal models of incremental learning and their analysis
Lange, S., & Zilles, S. (2004) · doi:10.1109/ijcnn.2003.1223992 · Cited by 18
Cited by
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050
Learning under Concept Drift: A Review
Lu, J., Liu, A., Dong, F., Gu, F., Gama, J., & Zhang, G. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2876857 · Cited by 1,603
A Survey on Ensemble Learning for Data Stream Classification
Gomes, H. M., Barddal, J. P., Enembreck, F., & Bifet, A. (2018) · ACM Computing Surveys · doi:10.1145/3054925 · Cited by 579
Resampling-Based Ensemble Methods for Online Class Imbalance Learning
Wang, S., Minku, L. L., & Yao, X. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2345380 · Cited by 396
Metadata
- Authors
- Ditzler, G., & Polikar, R.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2013-10
- Volume
- 25
- Issue
- 10
- Pages
- 2283-2301
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2088220893
- Cited by
- 406
- References
- 46
- FWCI
- 14.57
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
