The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
The Impact of Diversity on Online Ensemble Learning in the Presence of Concept Drift
Abstract
Online learning algorithms often have to operate in the presence of concept drift (i.e., the concepts to be learned can change with time). This paper presents a new categorization for concept drift, separating drifts according to different criteria into mutually exclusive and nonheterogeneous categories. Moreover, although ensembles of learning machines have been used to learn in the presence of concept drift, there has been no deep study of why they can be helpful for that and which of their features can contribute or not for that. As diversity is one of these features, we present a diversity analysis in the presence of different types of drifts. We show that, before the drift, ensembles with less diversity obtain lower test errors. On the other hand, it is a good strategy to maintain highly diverse ensembles to obtain lower test errors shortly after the drift independent on the type of drift, even though high diversity is more important for more severe drifts. Longer after the drift, high diversity becomes less important. Diversity by itself can help to reduce the initial increase in error caused by a drift, but does not provide the faster recovery from drifts in long-term.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Statistical Methods for Psychology.
Gudgeon, A. C., & Howell, D. C. (1994) · The Statistician · doi:10.2307/2348956 · Cited by 8,278
Data mining: practical machine learning tools and techniques with Java implementations
Witten, I. H., & Frank, E. (2002) · ACM SIGMOD Record · doi:10.1145/507338.507355 · Cited by 5,137
On Methods in the Analysis of Profile Data
Greenhouse, S. W., & Geisser, S. (1959) · Psychometrika · doi:10.1007/bf02289823 · Cited by 4,937
(2024) · Physics Subject Headings (PhySH) · doi:10.29172/7c2a6982-6d72-4cd8-bba6-2fccb06a7011 · Cited by 3,857
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279
On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
Vapnik, V. N., & Chervonenkis, A. Y. (2015) · Measures of Complexity · doi:10.1007/978-3-319-21852-6_3 · Cited by 3,105
Dietterich, T. G. (2000) · Machine Learning · doi:10.1023/a:1007607513941 · Cited by 2,941
On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
Vapnik, V. N., & Chervonenkis, A. Y. (1971) · Theory of Probability & Its Applications · doi:10.1137/1116025 · Cited by 2,448
Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy
Kuncheva, L. I., & Whitaker, C. J. (2003) · Machine Learning · doi:10.1023/a:1022859003006 · Cited by 2,335
Learning in the Presence of Concept Drift and Hidden Contexts
Widmer, G., & Kubat, M. (1996) · Machine Learning · doi:10.1023/a:1018046501280 · Cited by 1,857
Evolutionary Optimization in Uncertain Environments—A Survey
Jin, Y., & Branke, J. (2005) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.846356 · Cited by 1,572
Gama, J., Medas, P., Castillo, G., & Rodrigues, P. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28645-5_29 · Cited by 1,536
Mining concept-drifting data streams using ensemble classifiers
Wang, H., Fan, W., Yu, P. S., & Han, J. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956778 · Cited by 1,256
A streaming ensemble algorithm (SEA) for large-scale classification
Street, W. N., & Kim, Y. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502568 · Cited by 1,205
Significance Test for Sphericity of a Normal $n$-Variate Distribution
Mauchly, J. W. (1940) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731915 · Cited by 1,136
Diversity creation methods: a survey and categorisation
Brown, G., Wyatt, J., Harris, R., & Yao, X. (2005) · Information Fusion · doi:10.1016/j.inffus.2004.04.004 · Cited by 985
Self-citationDesign and Analysis of Experiments: Advanced Experimental Design
Hinkelmann, K., & Kempthorne, O. (2005) · Wiley Series in Probability and Statistics · doi:10.1002/0471709948 · Cited by 961
Learn++: an incremental learning algorithm for supervised neural networks
Polikar, R., Upda, L., Upda, S. S., & Honavar, V. (2001) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/5326.983933 · Cited by 888
Evolutionary Optimization in Dynamic Environments
Branke, J. (2002) · Genetic Algorithms and Evolutionary Computation · doi:10.1007/978-1-4615-0911-0 · Cited by 829
UCI Repository of Machine Learning Database
Newman, D. J. (1998) · Medical Entomology and Zoology · Cited by 824
Incremental learning from noisy data
Schlimmer, J. C., & Granger, R. H. (1986) · Machine Learning · doi:10.1007/bf00116895 · Cited by 653
Cautionary note on reporting eta-squared values from multifactor ANOVA designs.
Pierce, C. A., Block, R. A., & Aguinis, H. (2004) · Educational and Psychological Measurement · doi:10.1177/0013164404264848 · Cited by 584
Dynamic weighted majority: a new ensemble method for tracking concept drift
Kolter, J. Z., & Maloof, M. A. (2004) · Third IEEE International Conference on Data Mining · doi:10.1109/icdm.2003.1250911 · Cited by 419
An analysis of diversity measures
Tang, E. K., Suganthan, P. N., & Yao, X. (2006) · Machine Learning · doi:10.1007/s10994-006-9449-2 · Cited by 404
Self-citationDecision Tree Induction Based on Efficient Tree Restructuring
Utgoff, P. E., Berkman, N. C., & Clouse, J. A. (1997) · Machine Learning · doi:10.1023/a:1007413323501 · Cited by 359
A case study of incremental concept induction
Schlimmer, J. C., & Fisher, D. (1986) · National Conference on Artificial Intelligence · Cited by 298
Detecting Concept Drift Using Statistical Testing
Nishida, K., & Yamauchi, K. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75488-6_27 · Cited by 285
Using additive expert ensembles to cope with concept drift
Kolter, J. Z., & Maloof, M. A. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102408 · Cited by 261
Experimental comparisons of online and batch versions of bagging and boosting
Oza, N. C., & Russell, S. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502565 · Cited by 244
A General Framework for Mining Concept-Drifting Data Streams with Skewed Distributions
Gao, J., Fan, W., Han, J., & Yu, P. S. (2007) · Proceedings of the 2007 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972771.1 · Cited by 242
Systematic data selection to mine concept-drifting data streams
Fan, W. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014069 · Cited by 242
Generalization error of ensemble estimators
Ueda, N., & Nakano, R. (2002) · Proceedings of International Conference on Neural Networks (ICNN'96) · doi:10.1109/icnn.1996.548872 · Cited by 230
Online Ensemble Learning: An Empirical Study
Fern, A., & Givan, R. L. (2003) · Machine Learning · doi:10.1023/a:1025619426553 · Cited by 148
On Appropriate Assumptions to Mine Data Streams: Analysis and Practice
Gao, J., Fan, W., & Han, J. (2007) · Proceedings · doi:10.1109/icdm.2007.96 · Cited by 141
Fast and Light Boosting for Adaptive Mining of Data Streams
Chu, F., & Zaniolo, C. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24775-3_36 · Cited by 134
Boosting classifiers for drifting concepts
Klinkenberg, R., & Scholz, M. (2006) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-14320 · Cited by 106
Tackling concept drift by temporal inductive transfer
Forman, G. (2006) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1148170.1148216 · Cited by 92
Boosting classifiers for drifting concepts
Scholz, M., & Klinkenberg, R. (2007) · Intelligent Data Analysis · doi:10.3233/ida-2007-11102 · Cited by 89
A framework for generating data to simulate changing environments
Narasimhamurthy, A. M., & Kuncheva, L. I. (2007) · Conference on Artificial Intelligence for Applications · Cited by 78
Tracking Recurrent Concept Drift in Streaming Data Using Ensemble Classifiers
Ramamurthy, S., & Bhatnagar, R. (2007) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2007.109 · Cited by 77
Learning Time-varying Concepts
Kuh, A., Petsche, T., & Rivest, R. L. (1990) · neural information processing systems · Cited by 66
Tsymbal, A., Pechenizkiy, M., Cunningham, P., & Puuronen, S. J. (2006) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2006.94 · Cited by 54
IMORL: Incremental Multiple-Object Recognition and Localization
He, H., & Chen, S. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2001774 · Cited by 53
Adaptive Classifiers-Ensemble System for Tracking Concept Drift
Nishida, K., & Yamauchi, K. (2007) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2007.4370772 · Cited by 49
Abdulsalam, H. (2008) · QSpace (Queen's University Library) · Cited by 48
Negative correlation in incremental learning
Minku, F. L., Inoue, H., & Yao, X. (2007) · Natural Computing · doi:10.1007/s11047-007-9063-7 · Cited by 43
Self-citationAbdulsalam, H. M., Skillicorn, D. B., & Martin, P. (2007) · Proceedings - International Database Engineering and Applications Symposium · doi:10.1109/ideas.2007.4318108 · Cited by 41
Valiant, L. G. (2026) · Foundations of Computation and Machine Learning · doi:10.1145/3749740.3749746
Cited by
A survey on concept drift adaptation
Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014) · ACM Computing Surveys · doi:10.1145/2523813 · Cited by 3,735
Sagi, O., & Rokach, L. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1249 · Cited by 3,103
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050
Self-citationIncremental Learning of Concept Drift in Nonstationary Environments
Elwell, R., & Polikar, R. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2160459 · Cited by 931
A Survey on Ensemble Learning for Data Stream Classification
Gomes, H. M., Barddal, J. P., Enembreck, F., & Bifet, A. (2018) · ACM Computing Surveys · doi:10.1145/3054925 · Cited by 579
Metadata
- Authors
- Minku, L. L., White, A. P., & Yao, X.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2010-05
- Volume
- 22
- Issue
- 5
- Pages
- 730-742
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2139327121
- Cited by
- 440
- References
- 52
- FWCI
- 16.26
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.