The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Online and Non-Parametric Drift Detection Methods Based on Hoeffding’s Bounds
Open accessAbstract
Incremental and online learning algorithms are more relevant in the data mining context because of the increasing necessity to process data streams. In this context, the target function may change overtime, an inherent problem of online learning (known as concept drift). In order to handle concept drift regardless of the learning model, we propose new methods to monitor the performance metrics measured during the learning process, to trigger drift signals when a significant variation has been detected. To monitor this performance, we apply some probability inequalities that assume only independent, univariate and bounded random variables to obtain theoretical guarantees for the detection of such distributional changes. Some common restrictions for the online change detection as well as relevant types of change (abrupt and gradual) are considered. Two main approaches are proposed, the first one involves moving averages and is more suitable to detect abrupt changes. The second one follows a widespread intuitive idea to deal with gradual changes using weighted moving averages. The simplicity of the proposed methods, together with the computational efficiency make them very advantageous. We use a Naive Bayes classifier and a Perceptron to evaluate the performance of the methods over synthetic and real data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Time Series Analysis: Forecasting and Control
Geurts, M., Box, G. E. P., & Jenkins, G. M. (1977) · Journal of Marketing Research · doi:10.2307/3150485 · Cited by 19,186
Introduction to Statistical Quality Control
Sauter, R. M., & Montgomery, D. C. (1992) · Technometrics · doi:10.2307/1269251 · Cited by 7,842
Time Series Analysis Forecasting and Control.
Bartholomew, D. J., Box, G. E. P., & Jenkins, G. M. (1971) · Operational Research Quarterly (1970-1977) · doi:10.2307/3008255 · Cited by 6,716
Probability Inequalities for Sums of Bounded Random Variables
Hoeffding, W. (1963) · Journal of the American Statistical Association · doi:10.1080/01621459.1963.10500830 · Cited by 4,852
A survey on concept drift adaptation
Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014) · ACM Computing Surveys · doi:10.1145/2523813 · Cited by 3,735
Exponentially Weighted Moving Average Control Schemes: Properties and Enhancements
Lucas, J. M., & Saccucci, M. S. (1990) · Technometrics · doi:10.1080/00401706.1990.10484583 · Cited by 1,934
Learning from Time-Changing Data with Adaptive Windowing
Bifet, A., & Gavaldà, R. (2007) · Proceedings of the 2007 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972771.42 · Cited by 1,789
Gama, J., Medas, P., Castillo, G., & Rodrigues, P. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28645-5_29 · Cited by 1,536
On the method of bounded differences
McDiarmid, C. (1989) · Surveys in Combinatorics, 1989 · doi:10.1017/cbo9781107359949.008 · Cited by 1,425
Mining concept-drifting data streams using ensemble classifiers
Wang, H., Fan, W., Yu, P. S., & Han, J. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956778 · Cited by 1,256
Maintaining Stream Statistics over Sliding Windows
Datar, M., Gionis, A., Indyk, P., & Motwani, R. (2002) · SIAM Journal on Computing · doi:10.1137/s0097539701398363 · Cited by 835
Detecting Change in Data Streams
Kifer, D., Ben-David, S., & Gehrke, J. (2004) · Proceedings 2004 VLDB Conference · doi:10.1016/b978-012088469-8.50019-x · Cited by 789
BifetAlbert, HolmesGeoff, KirkbyRichard, & PfahringerBernhard (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859903 · Cited by 771
On evaluating stream learning algorithms
Gama, J., Sebastião, R., & Rodrigues, P. P. (2013) · Machine Learning · doi:10.1007/s10994-012-5320-9 · Cited by 532
Learning drifting concepts: Example selection vs. example weighting
Klinkenberg, R. (2004) · Intelligent Data Analysis · doi:10.3233/ida-2004-8305 · Cited by 438
Exponentially weighted moving average charts for detecting concept drift
Ross, G. J., Adams, N. M., Tasoulis, D. K., & Hand, D. J. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2011.08.019 · Cited by 404
Mining concept-drifting data streams using ensemble classifiers
Wang, H., Fan, W., Yu, P. S., & Han, J. (2003) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/956755.956778 · Cited by 390
Active Learning With Drifting Streaming Data
Zliobaite, I., Bifet, A., Pfahringer, B., & Holmes, G. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2236570 · Cited by 387
Nonparametric Monitoring of Data Streams for Changes in Location and Scale
Ross, G. J., Tasoulis, D. K., & Adams, N. M. (2011) · Technometrics · doi:10.1198/tech.2011.10069 · Cited by 193
Tracking drifting concepts by minimizing disagreements
Helmbold, D. P., & Long, P. M. (1994) · Machine Learning · doi:10.1007/bf00993161 · Cited by 161
Paired Learners for Concept Drift
Bach, S. H., & Maloof, M. A. (2008) · Proceedings · doi:10.1109/icdm.2008.119 · Cited by 161
Using multiple windows to track concept drift
Lazarescu, M., Venkatesh, S., & Bui, H. (2004) · Intelligent Data Analysis · doi:10.3233/ida-2004-8103 · Cited by 127
An Ensemble of Classifiers for coping with Recurring Contexts in Data Streams
Katakis, I., Tsoumakas, G., & Vlahavas, I. P. (2008) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-58603-891-5-763 · Cited by 62
Learning with a slowly changing distribution
Bartlett, P. L. (1992) · Conference on Learning Theory · doi:10.1145/130385.130412 · Cited by 53
Cited by
Learning under Concept Drift: A Review
Lu, J., Liu, A., Dong, F., Gu, F., Gama, J., & Zhang, G. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2876857 · Cited by 1,603
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050
Learning in Nonstationary Environments: A Survey
Ditzler, G., Roveri, M., Alippi, C., & Polikar, R. (2015) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2471196 · Cited by 793
From concept drift to model degradation: An overview on performance-aware drift detectors
Bayram, F., Ahmed, B. S., & Kassler, A. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108632 · Cited by 407
Ahmadi‐Assalemi, G., Al‐Khateeb, H., Benson, V., Adamyk, B., & Ammi, M. (2025) · IET Cyber-Physical Systems: Theory & Applications · doi:10.1049/cps2.70004 · Cited by 10
Metadata
- Authors
- Frias-Blanco, I., Campo-Avila, J. D., Ramos-Jimenez, G., Morales-Bueno, R., Ortiz-Diaz, A., & Caballero-Mota, Y.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2015-03-01
- Volume
- 27
- Issue
- 3
- Pages
- 810-823
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2097178527
- Cited by
- 469
- References
- 24
- FWCI
- 8.91
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.