The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Reacting to Different Types of Concept Drift: The Accuracy Updated Ensemble Algorithm
Abstract
Data stream mining has been receiving increased attention due to its presence in a wide range of applications, such as sensor networks, banking, and telecommunication. One of the most important challenges in learning from data streams is reacting to concept drift, i.e., unforeseen changes of the stream's underlying data distribution. Several classification algorithms that cope with concept drift have been put forward, however, most of them specialize in one type of change. In this paper, we propose a new data stream classifier, called the Accuracy Updated Ensemble (AUE2), which aims at reacting equally well to different types of drift. AUE2 combines accuracy-based weighting mechanisms known from block-based ensembles with the incremental nature of Hoeffding Trees. The proposed algorithm is experimentally compared with 11 state-of-the-art stream methods, including single classifiers, block-based and online ensembles, and hybrid approaches in different drift scenarios. Out of all the compared algorithms, AUE2 provided best average classification accuracy while proving to be less memory consuming than other ensemble approaches. Experimental results show that AUE2 can be considered suitable for scenarios, involving many types of drift as well as static environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
PAGE, E. S. (1954) · Biometrika · doi:10.1093/biomet/41.1-2.100 · Cited by 5,739
Combining Pattern Classifiers: Methods and Algorithms
Bagui, S. C. (2005) · Technometrics · doi:10.1198/tech.2005.s320 · Cited by 3,202
Combining Pattern Classifiers: Methods and Algorithms
Kuncheva, L. I. (2004) · Wiley eBooks · doi:10.1002/0471660264 · Cited by 3,005
Mining high-speed data streams
Domingos, P., & Hulten, G. (2000) · Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/347090.347107 · Cited by 2,185
Learning in the Presence of Concept Drift and Hidden Contexts
Widmer, G., & Kubat, M. (1996) · Machine Learning · doi:10.1023/a:1018046501280 · Cited by 1,857
Learning from Time-Changing Data with Adaptive Windowing
Bifet, A., & Gavaldà, R. (2007) · Proceedings of the 2007 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972771.42 · Cited by 1,789
Mining time-changing data streams
Hulten, G., Spencer, L., & Domingos, P. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502529 · Cited by 1,748
Gama, J., Medas, P., Castillo, G., & Rodrigues, P. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28645-5_29 · Cited by 1,536
Mining concept-drifting data streams using ensemble classifiers
Wang, H., Fan, W., Yu, P. S., & Han, J. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956778 · Cited by 1,256
A streaming ensemble algorithm (SEA) for large-scale classification
Street, W. N., & Kim, Y. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502568 · Cited by 1,205
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Incremental Learning of Concept Drift in Nonstationary Environments
Elwell, R., & Polikar, R. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2160459 · Cited by 931
The problem of concept drift: definitions and related work
Tsymbal, A. (2004) · Cited by 929
BifetAlbert, HolmesGeoff, KirkbyRichard, & PfahringerBernhard (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859903 · Cited by 771
Dynamic Weighted Majority: An Ensemble Method for Drifting Concepts
Kolter, J. Z., & Maloof, M. A. (2007) · doi:10.5555/1314498.1390333 · Cited by 648
Knowledge Discovery from Data Streams
Gama, J. (2010) · Chapman & Hall/CRC eBooks · doi:10.1201/ebk1439826119 · Cited by 571
New ensemble methods for evolving data streams
Bifet, A., Holmes, G., Pfahringer, B., Kirkby, R., & Gavaldà, R. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557041 · Cited by 558
Knowledge Discovery in Data Streams
(2009) · Encyclopedia of Library and Information Sciences, Third Edition · doi:10.1081/e-elis3-120043643 · Cited by 551
The Impact of Diversity on Online Ensemble Learning in the Presence of Concept Drift
Minku, L. L., White, A. P., & Yao, X. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.156 · Cited by 440
DDD: A New Ensemble Approach for Dealing with Concept Drift
Minku, L. L., & Yao, X. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.58 · Cited by 431
Dynamic weighted majority: a new ensemble method for tracking concept drift
Kolter, J. Z., & Maloof, M. A. (2004) · Third IEEE International Conference on Data Mining · doi:10.1109/icdm.2003.1250911 · Cited by 419
Mining concept-drifting data streams using ensemble classifiers
Wang, H., Fan, W., Yu, P. S., & Han, J. (2003) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/956755.956778 · Cited by 390
Leveraging Bagging for Evolving Data Streams
Bifet, A., Holmes, G., & Pfahringer, B. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15880-3_15 · Cited by 378
Classifier Ensembles for Changing Environments
Kuncheva, L. I. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-25966-4_1 · Cited by 335
Experimental comparisons of online and batch versions of bagging and boosting
Oza, N. C., & Russell, S. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502565 · Cited by 244
Systematic data selection to mine concept-drifting data streams
Fan, W. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014069 · Cited by 242
Oza, N. C. (2000) · National Conference on Artificial Intelligence · Cited by 195
Accuracy Updated Ensemble for Data Streams with Concept Drift
Brzeziński, D., & Stefanowski, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21222-2_19 · Cited by 161
Self-citationA Practical Approach to Classify Evolving Data Streams: Training with Limited Amount of Labeled Data
Masud, M. M., Gao, J., Khan, L. R., Han, J., & Thuraisingham, B. M. (2008) · Proceedings · doi:10.1109/icdm.2008.152 · Cited by 150
Classifier Ensembles for Detecting Concept Change in Streaming Data: Overview and Perspectives
Kuncheva, L. I. (2008) · Cited by 142
ACE: Adaptive Classifiers-Ensemble System for Concept-Drifting Environments
Nishida, K., Yamauchi, K., & Omori, T. (2005) · Lecture notes in computer science · doi:10.1007/11494683_18 · Cited by 109
Fan, W., Huang, Y.-A., Wang, H., et al. (2004) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972740.46 · Cited by 106
Predictive Modular Neural Networks for Time Series Classification
Kehagias, A., & Petridis, V. (1997) · Neural Networks · doi:10.1016/s0893-6080(96)00040-8 · Cited by 68
SOMKE: Kernel Density Estimation Over Data Streams by Sequences of Self-Organizing Maps
Cao, Y., He, H., & Man, H. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2201167 · Cited by 60
Combining Time and Space Similarity for Small Size Learning under Concept Drift
Žliobaitė, I. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04125-9_44 · Cited by 24
Adaptive Training Set Formation
Žliobaitė, I. (2010) · Laba (Lietuvos akademinių bibliotekų direktorių asociacija) · Cited by 19
Semi-supervised approach to handle sudden concept drift in Enron data
Kmieciak, M. R., & Stefanowski, J. (2011) · Control and Cybernetics · Cited by 8
Self-citation
Cited by
Dong, X., Yu, Z., Cao, W., Shi, Y., & Ma, Q. (2020) · Frontiers of Computer Science · doi:10.1007/s11704-019-8208-z · Cited by 1,928
Learning under Concept Drift: A Review
Lu, J., Liu, A., Dong, F., Gu, F., Gama, J., & Zhang, G. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2876857 · Cited by 1,603
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050
Self-citationLearning in Nonstationary Environments: A Survey
Ditzler, G., Roveri, M., Alippi, C., & Polikar, R. (2015) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2471196 · Cited by 793
Webb, G. I., Hyde, R., Cao, H., Nguyen, H. L., & Petitjean, F. (2016) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-015-0448-4 · Cited by 536
Metadata
- Authors
- Brzezinski, D., & Stefanowski, J.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2014-01
- Volume
- 25
- Issue
- 1
- Pages
- 81-94
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2000454347
- Cited by
- 423
- References
- 39
- FWCI
- 28.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.