The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Resampling-Based Ensemble Methods for Online Class Imbalance Learning
Open accessAbstract
Online class imbalance learning is a new learning problem that combines the challenges of both online learning and class imbalance learning. It deals with data streams having very skewed class distributions. This type of problems commonly exists in real-world applications, such as fault diagnosis of real-time control monitoring systems and intrusion detection in computer networks. In our earlier work, we defined class imbalance online, and proposed two learning algorithms OOB and UOB that build an ensemble model overcoming class imbalance in real time through resampling and time-decayed metrics. In this paper, we further improve the resampling strategy inside OOB and UOB, and look into their performance in both static and dynamic data streams. We give the first comprehensive analysis of class imbalance in data streams, in terms of data distributions, imbalance rates and changes in class imbalance status. We find that UOB is better at recognizing minority-class examples in static data streams, and OOB is more robust against dynamic changes in class imbalance status. The data distribution is a major factor affecting their performance. Based on the insight gained, we then propose two new ensemble methods that maintain both OOB and UOB with adaptive weights for final predictions, called WEOB1 and WEOB2. They are shown to possess the strength of OOB and UOB with good accuracy and robustness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
On Methods in the Analysis of Profile Data
Greenhouse, S. W., & Geisser, S. (1959) · Psychometrika · doi:10.1007/bf02289823 · Cited by 4,937
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
Ensemble based systems in decision making
Polikar, R. (2006) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2006.1688199 · Cited by 2,938
Addressing the Curse of Imbalanced Training Sets: One-Sided Selection.
Kubát, M., & Matwin, S. (1997) · Cited by 2,230
The foundations of cost-sensitive learning
Elkan, C. (2001) · Cited by 1,945
Mining time-changing data streams
Hulten, G., Spencer, L., & Domingos, P. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502529 · Cited by 1,748
Mining with rarity: a unifying framework
Weiss, G. M. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007734 · Cited by 1,393
Design and Analysis of Experiments: Advanced Experimental Design
Hinkelmann, K., & Kempthorne, O. (2005) · Wiley Series in Probability and Statistics · doi:10.1002/0471709948 · Cited by 961
Experimental perspectives on learning from imbalanced data
Van Hulse, J., Khoshgoftaar, T. M., & Napolitano, A. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273614 · Cited by 786
Class imbalances versus small disjuncts
Jo, T., & Japkowicz, N. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007737 · Cited by 683
Extreme learning machine: algorithm, theory and applications
Ding, S., Zhao, H., Zhang, Y., Xu, X., & Nie, R. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-013-9405-z · Cited by 593
Cautionary note on reporting eta-squared values from multifactor ANOVA designs.
Pierce, C. A., Block, R. A., & Aguinis, H. (2004) · Educational and Psychological Measurement · doi:10.1177/0013164404264848 · Cited by 584
Oza, N. C. (2006) · 2005 IEEE International Conference on Systems, Man and Cybernetics · doi:10.1109/icsmc.2005.1571498 · Cited by 569
DDD: A New Ensemble Approach for Dealing with Concept Drift
Minku, L. L., & Yao, X. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.58 · Cited by 431
Self-citationIncremental Learning of Concept Drift from Streaming Imbalanced Data
Ditzler, G., & Polikar, R. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.136 · Cited by 406
Class Imbalances versus Class Overlapping: An Analysis of a Learning System Behavior
Prati, R. C., Batista, G. E. A. P. A., & Monard, M. C. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24694-7_32 · Cited by 339
Adressing the curse of imbalanced training sets: one-sided selection
Kubát, M. (1997) · Medical Entomology and Zoology · Cited by 328
Experimental comparisons of online and batch versions of bagging and boosting
Oza, N. C., & Russell, S. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502565 · Cited by 244
Chen, S., & He, H. (2010) · Evolving Systems · doi:10.1007/s12530-010-9021-y · Cited by 144
A learning framework for online class imbalance learning
Wang, S., Minku, L. L., & Yao, X. (2013) · doi:10.1109/ciel.2013.6613138 · Cited by 113
Self-citationAn Empirical Study of the Behavior of Classifiers on Imbalanced and Overlapped Data Sets
García, V., Sánchez, J. S., & Mollineda, R. A. (2007) · Springer eBooks · doi:10.1007/978-3-540-76725-1_42 · Cited by 111
Weighted Online Sequential Extreme Learning Machine for Class Imbalance Learning
Mirza, B., Lin, Z., & Toh, K. (2013) · Neural Processing Letters · doi:10.1007/s11063-013-9286-9 · Cited by 105
ONLINE CLASS IMBALANCE LEARNING AND ITS APPLICATIONS IN FAULT DETECTION
Wang, S., Minku, L. L., & Yao, X. (2013) · International Journal of Computational Intelligence and Applications · doi:10.1142/s1469026813400014 · Cited by 80
Self-citation
Cited by
Learning from imbalanced data: open challenges and future directions
Krawczyk, B. (2016) · Progress in Artificial Intelligence · doi:10.1007/s13748-016-0094-0 · Cited by 2,459
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernandez, A., Garcia, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,219
Learning under Concept Drift: A Review
Lu, J., Liu, A., Dong, F., Gu, F., Gama, J., & Zhang, G. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2876857 · Cited by 1,603
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050
Self-citation
Metadata
- Authors
- Wang, S., Minku, L. L., & Yao, X.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2015-05-01
- Volume
- 27
- Issue
- 5
- Pages
- 1356-1368
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2107327607
- Cited by
- 396
- References
- 25
- FWCI
- 18.49
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.