A survey on concept drift adaptation
Open accessAbstract
Concept drift primarily refers to an online supervised learning scenario when the relation between the input data and the target variable changes over time. Assuming a general knowledge of supervised learning in this article, we characterize adaptive learning processes; categorize existing strategies for handling concept drift; overview the most representative, distinct, and popular techniques and algorithms; discuss evaluation methodology of adaptive algorithms; and present a set of illustrative applications. The survey covers the different facets of concept drift in an integrated way to reflect on the existing scattered state of the art. Thus, it aims at providing a comprehensive introduction to the concept drift adaptation for researchers, industry analysts, and practitioners.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The phenomena the AI system is modelling are likely to change over time, and the risks and impacts may change with them.
“particularly as the phenomena the AI system is modelling are likely to change over time, and the risks and impacts may change with them.”
From Discrimination, artificial intelligence, and algorithmic decision-making (2025) · cites this paper as Gama et al 2014
Section 2 (Adaptive Learning Algorithms; page not available) says the underlying concept being predicted may change over time. Section 2.3 says a model’s accuracy can then degrade, supporting a change in model performance, but the paper does not address whether the AI system’s broader risks and impacts change with it. (LLM, conf=0.84)
Experimental — accuracy not yet measuredSome relevant records may not be presented to the reviewer because the text used in the abstract is not seen as potentially relevant because of concept ambiguity.
“It might be that some relevant records are not presented to the reviewer because the text used in the abstract is not seen as potentially relevant because of concept ambiguity [11, 17], which can make finding relevant records challenging.”
From The SAFE procedure: a practical stopping heuristic for active learning-based screening in systematic reviews and meta-analyses (2024) · cites this paper as [17]
Section 2.1 discusses classifying news as relevant or not relevant, and Section 5 mentions representation bias in adaptive systems. Neither passage says that relevant records may be withheld from a reviewer because ambiguous concepts in their abstracts make them appear irrelevant. Searches for abstract ambiguity and for relevant items not being presented found no passage addressing that mechanism; page numbers were not available in our copy. (LLM, conf=0.72)
Experimental — accuracy not yet measuredRecords can be hard to find due to concept ambiguity, different angles from which a subject can be studied, and changes in the meaning of a concept over time (concept drift).
“Records can be hard to find due to concept ambiguity, the different angles from which a subject can be studied, and changes in the meaning of a concept over time, known as concept drift (Chen et al., 2012; Gama et al., 2014).”
From Active learning-based systematic reviewing using switching classification models: the case of the onset, maintenance, and relapse of depressive disorders (2023) · cites this paper as Gama et al., 2014
Lwakatare et al. and Kim et al. reported the difficulty of specifying desirable datasets.
“Lwakatare et al. [15] and Kim et al. [40] reported the difficulty of specifying desirable datasets.”
From Software engineering challenges for machine learning applications: A literature review (2020) · cites this paper as [15]
Developing the skill set for ML applications is the major challenge related to the software engineering professional practice knowledge area.
“Developing the skill set for ML applications is the major challenge related to this KA [15,16,27,32,39,40,59].”
From Software engineering challenges for machine learning applications: A literature review (2020) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 24,190 · see citing works
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,834 · see citing works
Seel, N. M. (2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,525 · see citing works
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · see citing works
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280 · see citing works
Statistical Comparisons of Classifiers over Multiple Data Sets
Demšar, J. (2006) · doi:10.5555/1248547.1248548 · Cited by 11,966 · see citing works
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · see citing works
Classification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417 · see citing works
Adomavičius, G., & Tuzhilin, A. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.99 · Cited by 10,347 · see citing works
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 5,930 · see citing works
PAGE, E. S. (1954) · Biometrika · doi:10.1093/biomet/41.1-2.100 · Cited by 5,739 · see citing works
Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages
McNemar, Q. (1947) · Psychometrika · doi:10.1007/bf02295996 · Cited by 4,754 · see citing works
Prediction, learning, and games
Cesa-Bianchi, N., & Lugosi, G. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511546921 · Cited by 4,660 · see citing works
Detection of Abrupt Changes: Theory and Application
Riedel, K. S. (1994) · Technometrics · doi:10.1080/00401706.1994.10485821 · Cited by 3,518 · see citing works
Bobadilla, J., Ortega, F., Hernando, A., & Gutiérrez, A. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.03.012 · Cited by 3,167 · see citing works
Models and issues in data stream systems
Babcock, B., Babu, S., Datar, M., Motwani, R., & Widom, J. (2002) · ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems (PODS) · doi:10.1145/543613.543615 · Cited by 2,542 · see citing works
Catastrophic forgetting in connectionist networks
French, R. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01294-2 · Cited by 2,311 · see citing works
Mining high-speed data streams
Domingos, P., & Hulten, G. (2000) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/347090.347107 · Cited by 2,213 · see citing works
Learning from Time-Changing Data with Adaptive Windowing
Bifet, A., & Gavaldà, R. (2007) · SDM · doi:10.1137/1.9781611972771.42 · Cited by 2,052 · see citing works
Self-citationThe Weighted Majority Algorithm
Littlestone, N., & Warmuth, M. K. (1994) · Information and Computation · doi:10.1006/inco.1994.1009 · Cited by 2,001 · see citing works
Learning in the Presence of Concept Drift and Hidden Contexts
Widmer, G., & Kubat, M. (1996) · Machine Learning · doi:10.1023/a:1018046501280 · Cited by 1,857 · see citing works
Random sampling with a reservoir
Vitter, J. S. (1985) · ACM Transactions on Mathematical Software · doi:10.1145/3147.3165 · Cited by 1,789 · see citing works
Mining time-changing data streams
Hulten, G., Spencer, L. A., & Domingos, P. (2001) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/502512.502529 · Cited by 1,767 · see citing works
Process Mining: Discovery, Conformance and Enhancement of Business Processes
van der Aalst, W. M. P. (2011) · CERN Document Server (European Organization for Nuclear Research) · doi:10.1007/978-3-642-19345-3 · Cited by 1,725 · see citing works
Carpenter, G. A., Grossberg, S., & Rosen, D. B. (1991) · Neural Networks · doi:10.1016/0893-6080(91)90056-b · Cited by 1,671 · see citing works
da Gama, J. M. P., Medas, P., Castillo, G., & Rodrigues, P. P. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-28645-5_29 · Cited by 1,635 · see citing works
Self-citationDatabase mining: a performance perspective
Agrawal, R., Imieliński, T., & Swami, A. (1993) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.250074 · Cited by 1,514 · see citing works
Learning Quickly When Irrelevant Attributes Abound: A New Linear-Threshold Algorithm
Littlestone, N. (1988) · Machine Learning · doi:10.1023/a:1022869011914 · Cited by 1,514 · see citing works
Novelty detection: a review—part 1: statistical approaches
Markou, M., & Singh, S. (2003) · Signal Processing · doi:10.1016/j.sigpro.2003.07.018 · Cited by 1,435 · see citing works
Mining concept-drifting data streams using ensemble classifiers
Wang, H., Fan, W., Yu, P. S., & Han, J. (2003) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/956750.956778 · Cited by 1,275 · see citing works
A streaming ensemble algorithm (SEA) for large-scale classification
Street, W. N., & Yongseog Kim, A. (2001) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/502512.502568 · Cited by 1,232 · see citing works
The Digital Universe in 2020: Big Data, Bigger Digital Shadows, and Biggest Growth in the Far East
Gantz, J., & Reinsel, D. (2012) · Cited by 1,146 · see citing works
A unifying view on dataset shift in classification
Moreno-Torres, J. G., Raeder, T., Alaiz-Rodríguez, R., Chawla, N. V., & Herrera, F. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.06.019 · Cited by 1,029 · see citing works
Carpenter, G. A., Grossberg, S., & Reynolds, J. H. (1991) · Neural Networks · doi:10.1016/0893-6080(91)90012-t · Cited by 981 · see citing works
The problem of concept drift: definitions and related work
Tsymbal, A. (2004) · Cited by 936 · see citing works
Incremental Learning of Concept Drift in Nonstationary Environments
Elwell, R., & Robi Polikar, A. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2160459 · Cited by 928 · see citing works
Gaber, M. M., Zaslavsky, A., & Krishnaswamy, S. P. (2005) · ACM SIGMOD Record · doi:10.1145/1083784.1083789 · Cited by 890 · see citing works
Learn++: an incremental learning algorithm for supervised neural networks
Polikar, R., Upda, L., Upda, S. S., & Honavar, V. (2001) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/5326.983933 · Cited by 888 · see citing works
Maintaining Stream Statistics over Sliding Windows
Datar, M., Gionis, A., Indyk, P., & Motwani, R. (2002) · SIAM Journal on Computing · doi:10.1137/s0097539701398363 · Cited by 834 · see citing works
Detecting Change in Data Streams
Kifer, D., Ben-David, S., & Gehrke, J. E. (2004) · Elsevier eBooks · doi:10.1016/b978-012088469-8.50019-x · Cited by 809 · see citing works
SPRINT: A Scalable Parallel Classifier for Data Mining
Shafer, J. C., Agrawal, R., & Mehta, M. (1996) · Cited by 787 · see citing works
Collaborative filtering with temporal dynamics
Koren, Y. (2010) · Communications of the ACM · doi:10.1145/1721654.1721677 · Cited by 784 · see citing works
SLIQ: A fast scalable classifier for data mining
Mehta, M., Agrawal, R., & Rissanen, J. (1996) · Lecture notes in computer science · doi:10.1007/bfb0014141 · Cited by 749 · see citing works
Dynamic Weighted Majority: An Ensemble Method for Drifting Concepts
Kolter, J. Z., & Maloof, M. A. (2007) · doi:10.5555/1314498.1390333 · Cited by 667 · see citing works
Incremental Learning from Noisy Data
Schlimmer, J. C., & Granger, R. (1986) · Machine Learning · doi:10.1023/a:1022810614389 · Cited by 652 · see citing works
New ensemble methods for evolving data streams
Bifet, A., Holmes, G., Pfahringer, B., Kirkby, R., & Gavaldà, R. (2009) · Knowledge Discovery and Data Mining · doi:10.1145/1557019.1557041 · Cited by 640 · see citing works
Self-citationSentiment Knowledge Discovery in Twitter Streaming Data
Bifet, A., & Frank, E. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-16184-1_1 · Cited by 577 · see citing works
Self-citationKnowledge Discovery in Data Streams
Dang, X. H., & Ong, K. (2009) · CRC Press eBooks · doi:10.1081/e-elis3-120043643 · Cited by 563 · see citing works
Herbster, M., & Warmuth, M. K. (1998) · Machine Learning · doi:10.1023/a:1007424614876 · Cited by 559 · see citing works
On evaluating stream learning algorithms
da Gama, J. M. P., Sebastião, R., & Rodrigues, P. P. (2012) · Machine Learning · doi:10.1007/s10994-012-5320-9 · Cited by 533 · see citing works
Self-citationReview of adaptation mechanisms for data-driven soft sensors
Kadlec, P., Grbić, R., & Gabryś, B. (2010) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2010.07.034 · Cited by 518 · see citing works
User Modeling for Adaptive News Access
Billsus, D., & Pazzani, M. J. (2000) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1026501525781 · Cited by 491 · see citing works
DDD: A New Ensemble Approach for Dealing with Concept Drift
Minku, L. L., & Yao, X. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.58 · Cited by 441 · see citing works
Learning drifting concepts: Example selection vs. example weighting
Klinkenberg, R. (2004) · Intelligent Data Analysis · doi:10.3233/ida-2004-8305 · Cited by 440 · see citing works
The Impact of Diversity on Online Ensemble Learning in the Presence of Concept Drift
Minku, L. L., White, A. P., & Yao, X. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.156 · Cited by 438 · see citing works
Dynamic weighted majority: a new ensemble method for tracking concept drift
Kolter, J. Z., & Maloof, M. A. (2004) · Proceedings · doi:10.1109/icdm.2003.1250911 · Cited by 420 · see citing works
Detecting Concept Drift with Support Vector Machines
Klinkenberg, R., & Joachims, T. (2000) · Cited by 412 · see citing works
Exponentially weighted moving average charts for detecting concept drift
Ross, G. J., Adams, N. M., Tasoulis, D. K., & Hand, D. J. (2011) · Pattern Recognition Letters · doi:10.1016/j.patrec.2011.08.019 · Cited by 405 · see citing works
Classification and Novel Class Detection in Concept-Drifting Data Streams under Time Constraints
Masud, M. M., Gao, J., Khan, L. R., Han, J., & Thuraisingham, B. M. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.61 · Cited by 399 · see citing works
Leveraging Bagging for Evolving Data Streams
Bifet, A., Holmes, G., & Pfahringer, B. (2010) · ECML/PKDD · doi:10.1007/978-3-642-15880-3_15 · Cited by 397 · see citing works
Self-citationActive Learning With Drifting Streaming Data
Žliobaitė, I., Bifet, A., Pfahringer, B., & Holmes, G. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2236570 · Cited by 389 · see citing works
Self-citationWeighted random sampling with a reservoir
Efraimidis, P. S., & Spirakis, P. G. (2005) · Information Processing Letters · doi:10.1016/j.ipl.2005.11.003 · Cited by 370 · see citing works
RainForest—A Framework for Fast Decision Tree Construction of Large Datasets
Gehrke, J. E., Ramakrishnan, R., & Ganti, V. (2000) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009839829793 · Cited by 347 · see citing works
Wind power forecasting : state-of-the-art 2009.
Monteiro, C., Bessa, R., Miranda, V., Botterud, A., Wang, J.-H., Conzelmann, G., & Porto, I. (2009) · doi:10.2172/968212 · Cited by 338 · see citing works
Classifier Ensembles for Changing Environments
Kuncheva, L. I. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-25966-4_1 · Cited by 337 · see citing works
Estimating the generalization performance of a SVM efficiently
Joachims, T. (1999) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-5102 · Cited by 327 · see citing works
Pasting Small Votes for Classification in Large Databases and On-Line
Breiman, L. (1999) · Machine Learning · doi:10.1023/a:1007563306331 · Cited by 317 · see citing works
Probabilistic wind power forecasts using local quantile regression
Bremnes, J. B. (2004) · Wind Energy · doi:10.1002/we.107 · Cited by 312 · see citing works
Learning model trees from evolving data streams
Ikonomovska, E., da Gama, J. M. P., & Džeroski, S. (2010) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-010-0201-y · Cited by 304 · see citing works
Self-citationvan der Aalst, W. M. P. (2012) · Communications of the ACM · doi:10.1145/2240236.2240257 · Cited by 296 · see citing works
Detecting Concept Drift Using Statistical Testing
Nishida, K., & Yamauchi, K. (2007) · Springer eBooks · doi:10.1007/978-3-540-75488-6_27 · Cited by 288 · see citing works
Handling concept drifts in incremental learning with support vector machines
Syed, N. A., Liu, H., & Sung, K. K. (1999) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/312129.312267 · Cited by 281 · see citing works
A Game of Prediction with Expert Advice
Vovk, V. (1998) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1556 · Cited by 280 · see citing works
An Interval Classifier for Database Mining Applications
Agrawal, R., Ghosh, S. P., Imieliński, T., Iyer, B. R., & Swami, A. (1992) · Cited by 264 · see citing works
Using additive expert ensembles to cope with concept drift
Kolter, J. Z., & Maloof, M. A. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102408 · Cited by 262 · see citing works
A General Framework for Mining Concept-Drifting Data Streams with Skewed Distributions
Gao, J., Fan, W., Han, J., & Yu, P. S. (2007) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972771.1 · Cited by 248 · see citing works
An Information-Theoretic Approach to Detecting Changes in Multi-Dimensional Data Streams
Dasu, T., Krishnan, S. M., Venkatasubramanian, S., & Yi, K. (2006) · Cited by 235 · see citing works
The impact of changing populations on classifier performance
Kelly, M. G., Hand, D. J., & Adams, N. M. (1999) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/312129.312285 · Cited by 226 · see citing works
DATA STREAM MINING A Practical Approach
Bifet, A., & Kirkby, R. (2009) · Cited by 221 · see citing works
Self-citationTracking recurring contexts using ensemble classifiers: an application to email filtering
Katakis, I., Tsoumakas, G., & Vlahavas, I. P. (2009) · Knowledge and Information Systems · doi:10.1007/s10115-009-0206-2 · Cited by 213 · see citing works
A case-based technique for tracking concept drift in spam filtering
Delany, S. J., Cunningham, P., Tsymbal, A., & Coyle, L. (2005) · Knowledge-Based Systems · doi:10.1016/j.knosys.2004.10.002 · Cited by 207 · see citing works
Chapman & Hall/CRC Data Mining and Knowledge Discovery Series
Hristidis, V. (2010) · Chapman & Hall/CRC data mining and knowledge discovery series · doi:10.1201/chdaminodis · Cited by 201 · see citing works
Bessa, R. J., Miranda, V., & da Gama, J. M. P. (2009) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2009.2030291 · Cited by 199 · see citing works
Self-citationBlum, A. L. (1997) · Machine Learning · doi:10.1023/a:1007335615132 · Cited by 192 · see citing works
Dealing With Concept Drifts in Process Mining
Bose, R. P. J. C., van der Aalst, W. M. P., Žliobaitė, I., & Pechenizkiy, M. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2278313 · Cited by 192 · see citing works
Self-citationOza, N. C. (2000) · Cited by 189 · see citing works
Zhao, P., Jin, R., Yang, T., & Hoi, S. C. H. (2011) · Cited by 183 · see citing works
A note on the utility of incremental learning
Giraud-Carrier, C. G. (2000) · Cited by 182 · see citing works
Harries, M. B., Sammut, C., & Horn, K. (1998) · Machine Learning · doi:10.1023/a:1007420529897 · Cited by 179 · see citing works
Learning under Concept Drift: an OverviewPreprint
Žliobait, E., & Indr, E. (2010) · arXiv (Cornell University) · Cited by 177 · see citing works
Effective learning in dynamic environments by explicit context tracking
Widmer, G., & Kubát, M. (1993) · Lecture notes in computer science · doi:10.1007/3-540-56602-3_139 · Cited by 176 · see citing works
Tracking Drifting Concepts By Minimizing Disagreements
Helmbold, D. P., & Long, P. M. (1994) · Machine Learning · doi:10.1023/a:1022694620923 · Cited by 161 · see citing works
On biased reservoir sampling in the presence of stream evolution
Aggarwal, C. C. (2006) · Very Large Data Bases · doi:10.5555/1182635.1164180 · Cited by 148 · see citing works
Paired Learners for Concept Drift
Bach, S. H., & Maloof, M. A. (2008) · Proceedings · doi:10.1109/icdm.2008.119 · Cited by 148 · see citing works
Online Ensemble Learning: An Empirical Study
Fern, A., & Givan, R. L. (2003) · Machine Learning · doi:10.1023/a:1025619426553 · Cited by 148 · see citing works
Selecting Examples for Partial Memory Learning
Maloof, M. A., & Michalski, R. S. (2000) · Machine Learning · doi:10.1023/a:1007661119649 · Cited by 142 · see citing works
Decision trees for mining data streams
da Gama, J. M. P., Fernandes, R., & Rocha, R. (2006) · Intelligent Data Analysis · doi:10.3233/ida-2006-10103 · Cited by 141 · see citing works
Self-citationAdaptive Information Filtering: Learning in the Presence of Concept Drifts
Klinkenberg, R., & Renz, I. (1998) · Cited by 136 · see citing works
Fast and Light Boosting for Adaptive Mining of Data Streams
Chu, F., & Zaniolo, C. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24775-3_36 · Cited by 132 · see citing works
Using multiple windows to track concept drift
Lazarescu, M., Venkatesh, S., & Bui, H. (2004) · Intelligent Data Analysis · doi:10.3233/ida-2004-8103 · Cited by 127 · see citing works
Tracking Context Changes through Meta-Learning
Widmer, G. (1997) · Machine Learning · doi:10.1023/a:1007365809034 · Cited by 125 · see citing works
Incremental learning with partial instance memory
Maloof, M. A., & Michalski, R. S. (2003) · Artificial Intelligence · doi:10.1016/j.artint.2003.04.001 · Cited by 125 · see citing works
Change Detection in Streaming Multivariate Data Using Likelihood Detectors
Kuncheva, L. I. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.226 · Cited by 123 · see citing works
Gradual Forgetting for Adaptation to Concept Drift
Koychev, I. (2000) · Cited by 121 · see citing works
Learning under Concept Drift: an OverviewPreprint
Žliobaitė, I. (2010) · arXiv (Cornell University) · Cited by 110 · see citing works
Self-citationKnowledge discovery from data streams
da Gama, J. M. P., Ganguly, A. R., Omitaomu, O. A., Vatsavai, R. R., & Gaber, M. M. (2009) · Intelligent Data Analysis · doi:10.3233/ida-2009-0372 · Cited by 110 · see citing works
Self-citationTest of Page-Hinckley, an approach for fault detection in an agro-alimentary production system
Mouss, L. H., Mouss, D., Mouss, N. K., & Linda, S. (2004) · Cited by 106 · see citing works
Classifier Ensembles for Detecting Concept Change in Streaming Data: Overview and Perspectives
Kuncheva, L. I. (2008) · Cited by 104 · see citing works
Boosting classifiers for drifting concepts
Klinkenberg, R., & Scholz, M. (2006) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-14320 · Cited by 103 · see citing works
Next challenges for adaptive learning systems
Žliobaitė, I., Bifet, A., Gaber, M. M., Gabryś, B., da Gama, J. M. P., Minku, L. L., & Musiał, K. (2012) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2408736.2408746 · Cited by 102 · see citing works
Self-citationTolerating Concept and Sampling Shift in Lazy Learning Using Prediction Error Context Switching
Salganicoff, M. (1997) · Artificial Intelligence Review · doi:10.1023/a:1006515405170 · Cited by 98 · see citing works
Categorizing and mining concept drifting data streams
Zhang, P., Zhu, X., & Shi, Y. (2008) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1401890.1401987 · Cited by 96 · see citing works
Entropy-based Concept Shift Detection
Vorburger, P., & Bernstein, A. (2006) · Proceedings · doi:10.1109/icdm.2006.66 · Cited by 96 · see citing works
Fast Perceptron Decision Tree Learning from Evolving Data Streams
Bifet, A., Holmes, G., Pfahringer, B., & Frank, E. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13672-6_30 · Cited by 95 · see citing works
Self-citationMining in Anticipation for Concept Change: Proactive-Reactive Prediction in Data Streams
Yang, Y., Wu, X., & Zhu, X. (2006) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-006-0050-x · Cited by 95 · see citing works
Tackling concept drift by temporal inductive transfer
Forman, G. (2006) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1148170.1148216 · Cited by 87 · see citing works
Online Techniques for Dealing with Concept Drift in Process Mining
Carmona, J., & Gavaldà, R. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34156-4_10 · Cited by 75 · see citing works
Catastrophic Forgetting in Connectionist Networks: Causes, Consequences and Solutions
French, R. M. (1999) · Cited by 75 · see citing works
Kalman Filters and Adaptive Windows for Learning in Data Streams
Bifet, A., & Gavaldà, R. (2006) · Lecture notes in computer science · doi:10.1007/11893318_7 · Cited by 71 · see citing works
Self-citationCarvalho, V. R., & Cohen, W. W. (2006) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1150402.1150466 · Cited by 69 · see citing works
On change diagnosis in evolving data streams
Aggarwal, C. C. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.78 · Cited by 69 · see citing works
Density-Adaptive Learning and Forgetting
Salganicoff, M. (1993) · Elsevier eBooks · doi:10.1016/b978-1-55860-307-3.50042-3 · Cited by 65 · see citing works
StreamKrimp: Detecting Change in Data Streams
van Leeuwen, M., & Siebes, A. P. J. M. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87479-9_62 · Cited by 63 · see citing works
On the window size for classification in changing environments
Kuncheva, L. I., & Žliobaitė, I. (2009) · Intelligent Data Analysis · doi:10.3233/ida-2009-0397 · Cited by 62 · see citing works
Self-citationState-of-the-Art in Bayesian Changepoint Detection
Tartakovsky, A. G., & Moustakides, G. V. (2010) · Sequential Analysis · doi:10.1080/07474941003740997 · Cited by 57 · see citing works
Combining similarity in time and space for training set formation under concept drift
Žliobaitė, I. (2011) · Intelligent Data Analysis · doi:10.3233/ida-2011-0484 · Cited by 56 · see citing works
Self-citationAdaptive-Size Reservoir Sampling over Data Streams
Al-Kateb, M., Lee, B. S., & Wang, X. S. (2007) · International Conference on Scientific and Statistical Database Management · doi:10.1109/ssdbm.2007.29 · Cited by 55 · see citing works
Tsymbal, A., Pechenizkiy, M., Cunningham, P., & Puuronen, S. J. (2006) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2006.94 · Cited by 54 · see citing works
Self-citationMOA: A Real-Time Analytics Open Source Framework
Bifet, A., Holmes, G., Pfahringer, B., Read, J., Kranen, P., Kremer, H., Jansen, T., & Seidl, T. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23808-6_41 · Cited by 53 · see citing works
Self-citationGT2FC: An Online Growing Interval Type-2 Self-Learning Fuzzy Classifier
Bouchachia, A., & Vanaret, C. (2013) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2013.2279554 · Cited by 51 · see citing works
Self-citationHandling Concept Drift in Text Data Stream Constrained by High Labelling Cost
Lindstrom, P. (2010) · Arrow@dit (Dublin Institute of Technology) · doi:10.21427/d7b022 · Cited by 50 · see citing works
Learning recurring concepts from data streams with a context-aware ensemble
Gomes, J. B., Menasalvas, E., & Sousa, P. (2011) · ACM Symposium on Applied Computing · doi:10.1145/1982185.1982403 · Cited by 49 · see citing works
Sequential Change Detection on Data Streams
Muthukrishnan, S., van den Berg, E., & Wu, Y. (2007) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2007.89 · Cited by 45 · see citing works
Change detection in learning histograms from data streams
Sebastião, R., & da Gama, J. M. P. (2007) · Portuguese Conference on Artificial Intelligence · doi:10.5555/1782254.1782265 · Cited by 43 · see citing works
Self-citationFuzzy classification in dynamic environments
Bouchachia, A. (2010) · Soft Computing · doi:10.1007/s00500-010-0657-0 · Cited by 43 · see citing works
Self-citationKnowledge discovery in data streams with regression tree methods
Alberg, D., Last, M., & Kandel, A. (2011) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.51 · Cited by 41 · see citing works
Robust Tracking with Weighted Online Structured Learning
Yao, R., Shi, Q., Shen, C., Zhang, Y., & van den Hengel, A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33712-3_12 · Cited by 40 · see citing works
Beating the baseline prediction in food sales: How intelligent an intelligent predictor is?
Žliobaitė, I., Bakker, J., & Pechenizkiy, M. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.07.078 · Cited by 40 · see citing works
Self-citationIncremental learning with multi-level adaptation
Bouchachia, A. (2011) · Neurocomputing · doi:10.1016/j.neucom.2010.12.017 · Cited by 38 · see citing works
Self-citationOnline mass flow prediction in CFB boilers with explicit detection of sudden concept drift
Pechenizkiy, M., Bakker, J., Žliobaitė, I., Ivannikov, A., & Kärkkäinen, T. (2010) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1809400.1809423 · Cited by 36 · see citing works
Self-citationDrifting Concepts as Hidden Factors in Clinical Studies
Kukar, M. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-39907-0_49 · Cited by 35 · see citing works
Adaptive Learning Rate for Online Linear Discriminant Classifiers
Kuncheva, L. I., & Plumpton, C. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-89689-0_55 · Cited by 34 · see citing works
Transfer estimation of evolving class priors in data stream classification
Zhang, Z., & Zhou, J. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2010.03.021 · Cited by 31 · see citing works
Predictive Handling of Asynchronous Concept Drifts in Distributed Environments
Ang, H. H., Gopalkrishnan, V., Žliobaitė, I., Pechenizkiy, M., & Hoi, S. C. H. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.172 · Cited by 31 · see citing works
Self-citationAdaptive Bayes for a Student Modeling Prediction Task Based on Learning Styles
Castillo, G., da Gama, J. M. P., & Breda, A. (2003) · Lecture notes in computer science · doi:10.1007/3-540-44963-9_44 · Cited by 28 · see citing works
Self-citationOn Stochastic Models and Optimal Methods in the Quickest Detection Problems
Shiryaev, A. N. (2009) · Theory of Probability and Its Applications · doi:10.1137/s0040585x97983717 · Cited by 28 · see citing works
Learning about the Learning Process
da Gama, J. M. P., & Kosina, P. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24800-9_17 · Cited by 26 · see citing works
Self-citationEVE: a framework for event detection
Adä, I., & Berthold, M. R. (2012) · Evolving Systems · doi:10.1007/s12530-012-9067-0 · Cited by 25 · see citing works
Sketching Sampled Data Streams
Rusu, F., & Dobra, A. (2009) · Proceedings - International Conference on Data Engineering · doi:10.1109/icde.2009.31 · Cited by 23 · see citing works
Enhancing text classification to improve information filtering
Lanquillon, C. (2001) · Digitalen Hochschulbibliothek Sachsen-Anhalt (Universitäts- und Landesbibliothek Sachsen-Anhalt) · doi:10.25673/4635 · Cited by 22 · see citing works
Tracking Changing User Interests through Prior-Learning of Context
Koychev, I. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47952-x_24 · Cited by 18 · see citing works
Determining the Training Window for Small Sample Size Classification with Concept Drift
Žliobaitė, I., & Kuncheva, L. I. (2009) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2009.20 · Cited by 18 · see citing works
Self-citationA method for partial-memory incremental learning and its application to computer intrusion detection
Maloof, M. A., & Michalski, R. S. (2002) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/tai.1995.479784 · Cited by 18 · see citing works
The Implications of Complex Adaptive Systems Theory for C2
Grisogono, A.-M. (2006) · Defense Technical Information Center (DTIC) · Cited by 17 · see citing works
Learning drifting concepts: Example selection vs. example weighting
KlinkenbergRalf (2004) · doi:10.5555/1293831.1293836 · Cited by 17 · see citing works
CHANGE DETECTION IN CLASSIFICATION MODELS INDUCED FROM TIME SERIES DATA
Zeira, G., Maimon, O., Last, M., & Rokach, L. (2004) · Series in machine perception and artificial intelligence · doi:10.1142/9789812565402_0005 · Cited by 15 · see citing works
GNUsmail: Open Framework for On-line Email Classification
Carmona-Cejudo, J. M., Manuel, B.-G., del Campo-Ávila, J., Morales-Bueno, R., & Bifet, A. (2010) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-60750-606-5-1141 · Cited by 14 · see citing works
Self-citationControlled Permutations for Testing Adaptive Classifiers
Žliobaitė, I. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24477-3_29 · Cited by 13 · see citing works
Self-citationA Test Paradigm for Detecting Changes in Transactional Data Streams
Ng, W., & Dash, M. (2008) · Springer eBooks · doi:10.1007/978-3-540-78568-2_17 · Cited by 12 · see citing works
Kosina, P., da Gama, J. M. P., & Sebastião, R. (2010) · European Conference on Artificial Intelligence · Cited by 8 · see citing works
Self-citationBoosting classifiers for drifting concepts
ScholzMartin, & KlinkenbergRalf (2007) · doi:10.5555/1367489.1367491 · Cited by 8 · see citing works
Predicting Phases in Business Cycles Under Concept Drift
Klinkenberg, R. (2003) · Cited by 7 · see citing works
Semi-supervised incremental learning
Bouchachia, A., Prossegg, M., & Duman, H. (2010) · doi:10.1109/fuzzy.2010.5584328 · Cited by 6 · see citing works
Self-citationDecision trees for mining data streams
GamaJoão, FernandesRicardo, & RochaRicardo (2006) · doi:10.5555/1239076.1239079 · Cited by 5 · see citing works
The AQ Methods for Concept Drift
Maloof, M. A. (2009) · Studies in computational intelligence · doi:10.1007/978-3-642-05177-7_2 · Cited by 3 · see citing works
Flagged first, then by citations
6 of the 171 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- [144]144. WALD, A. 1947. Sequential Analysis. John Wiley and Sons, Inc.
Cited by
Sorted by citations
Machine learning and deep learning
Janiesch, C., Zschech, P., & Heinrich, K. (2021) · Electronic Markets · doi:10.1007/s12525-021-00475-2 · Cited by 2,959 · see citing works
Recommender system application developments: A survey
Jie Lu, B., Wu, D., Mao, M., Wang, W., & Zhang, G. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.03.008 · Cited by 1,584 · see citing works
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3060483 · Cited by 1,477 · see citing works
“measurement artifacts or adversarial perturbations [182]; 2) resilience to drifting data distributions [49]; 3) ability to accurately assess the confidence of its own predictions [135], [139]; 4) safety and security aspects [21], [26], [84], [193]; 5) legal requirements or adherence to social norms [54], [60]; 6) abil…”
BackgroundA Review on Outlier/Anomaly Detection in Time Series Data
Blázquez-García, A., Conde, A., Mori, U., & Lozano, J. A. (2022) · ACM Computing Surveys · doi:10.1145/3444690 · Cited by 1,102 · see citing works
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050 · see citing works
Self-citationMachine learning with big data: challenges and approaches.
L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M. (2017) · IEEE Access · doi:10.1109/access.2017.2696365 · Cited by 1,023 · see citing works
Unsupervised real-time anomaly detection for streaming data
Ahmad, S., Lavin, A., Purdy, S., & Agha, Z. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.04.070 · Cited by 1,004 · see citing works
Learning under Concept Drift: A Review
Lu, J., Liu, A., Dong, F., Gu, F., Gama, J., & Zhang, G. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2876857 · Cited by 1,603 · see citing works
Self-citationAdaptive random forests for evolving data stream classification
Gomes, H. M., Bifet, A., Read, J., Barddal, J. P., Enembreck, F., Pfharinger, B., Holmes, G., & Abdessalem, T. (2017) · Machine Learning · doi:10.1007/s10994-017-5642-8 · Cited by 836 · see citing works
Self-citationLearning in Nonstationary Environments: A Survey
Ditzler, G., Roveri, M., Alippi, C., & Robi Polikar, A. (2015) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2471196 · Cited by 799 · see citing works
Anomaly Detection for IoT Time-Series Data: A Survey
Cook, A. A., Mısırlı, G., & Fan, Z. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2958185 · Cited by 802 · see citing works
Fraud detection system: A survey
Abdallah, A., Maarof, M. A., & Zainal, A. B. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2016.04.007 · Cited by 722 · see citing works
O’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-5 · Cited by 681 · see citing works
Credit Card Fraud Detection: A Realistic Modeling and a Novel Learning Strategy
Pozzolo, A. D., Boracchi, G., Caelen, O., Alippi, C., & Bontempi, G. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2736643 · Cited by 765 · see citing works
Challenges in deploying machine learning: A survey of case studies
Paleyes, A., Urma, R.-G., & Lawrence, N. D. (2023) · ACM Computing Surveys · doi:10.1145/3533378 · Cited by 638 · see citing works
Gibert, D., Mateu, C., & Planes, J. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2019.102526 · Cited by 646 · see citing works
Financial Fraud: A Review of Anomaly Detection Techniques and Recent Advances
Hilal, W., Gadsden, S. A., & Yawney, J. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116429 · Cited by 717 · see citing works
Computational Intelligence and Financial Markets: A Survey and Future Directions
Cavalcante, R. C., Brasileiro, R. C., Souza, V. L. F., Nobrega, J. P., & Oliveira, A. L. I. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.02.006 · Cited by 610 · see citing works
A Survey on Ensemble Learning for Data Stream Classification
Gomes, H. M., Barddal, J. P., Enembreck, F., & Bifet, A. (2018) · ACM Computing Surveys · doi:10.1145/3054925 · Cited by 579 · see citing works
Self-citationDiez-Olivan, A., Del Ser, J., Galar, D., & Sierra, B. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.10.005 · Cited by 633 · see citing works
Webb, G. I., Hyde, R., Cao, H., Nguyen, H. L., & Petitjean, F. (2016) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-015-0448-4 · Cited by 541 · see citing works
Evaluating time series forecasting models: an empirical study on performance estimation methods
Cerqueira, V., Torgo, L., & Mozetič, I. (2020) · Machine Learning · doi:10.1007/s10994-020-05910-7 · Cited by 603 · see citing works
A survey on data preprocessing for data stream mining: Current status and future directions
Ramírez-Gallego, S., Krawczyk, B., García, S., Woźniak, M., & Herrera, F. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.01.078 · Cited by 502 · see citing works
Online and Non-Parametric Drift Detection Methods Based on Hoeffding’s Bounds
Blanco, I. I. F., del Campo-Ávila, J., Ramos-Jiménez, G., Morales-Bueno, R., Díaz, A. A. O., & Caballero-Mota, Y. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2345382 · Cited by 470 · see citing works
Veale, M., Van Kleek, M., & Binns, R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174014 · Cited by 490 · see citing works
“t shifts in distributions potentially relevant to a modelling task. Concept drift detection, particularly in complex real-world contexts, is difficult and daunting theoretically, let alone practically [65,28]. Some of the more recent reviews in the field call for the integration of domain knowledge in order to discern r…”
BackgroundFactSheets: Increasing trust in AI services through supplier's declarations of conformity
Arnold, M., Bellamy, R. K. E., Hind, M., Houde, S., Mehta, S., Mojsilović, A., Nair, R., Ramamurthy, K. N., Olteanu, A., Piorkowski, D., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2942288 · Cited by 434 · see citing works
Social media big data analytics: A survey
Ghani, N. B. A., Hamid, S. B., Hashem, M., & Ahmed, E. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.08.039 · Cited by 437 · see citing works
From concept drift to model degradation: An overview on performance-aware drift detectors
Bayram, F., Ahmed, B. S., & Kassler, A. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108632 · Cited by 419 · see citing works
Incremental on-line learning: A review and comparison of state of the art algorithms
Losing, V., Hammer, B., & Wersing, H. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.06.084 · Cited by 382 · see citing works
An Overview of Concept Drift Applications
Žliobaitė, I., Pechenizkiy, M., & da Gama, J. M. P. (2015) · Studies in big data · doi:10.1007/978-3-319-26989-4_4 · Cited by 396 · see citing works
Self-citationA Review of Android Malware Detection Approaches Based on Machine Learning
Liu, K., Xu, S., Xu, G., Zhang, M., Sun, D., & Liu, H. (2020) · IEEE Access · doi:10.1109/access.2020.3006143 · Cited by 396 · see citing works
Mental health monitoring with multimodal sensing and machine learning: A survey
Garcia-Ceja, E., Riegler, M., Nordgreen, T., Jakobsen, P., Oedegaard, K. J., & Tørresen, J. (2018) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2018.09.003 · Cited by 356 · see citing works
A Review of Single-Source Deep Unsupervised Visual Domain Adaptation
Zhao, S., Yue, X., Zhang, S., Li, B., Zhao, H., Wu, B., Krishna, R., Gonzalez, J. E., Sangiovanni-Vincentelli, A. L., Seshia, S. A., et al. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3028503 · Cited by 355 · see citing works
O’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0031-5 · Cited by 351 · see citing works
Online Deep Learning: Learning Deep Neural Networks on the Fly
Sahoo, D., Pham, Q., Lu, J. J., & Hoi, S. C. H. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/369 · Cited by 335 · see citing works
A Systematic Study of Online Class Imbalance Learning With Concept Drift
Wang, S., Minku, L. L., & Yao, X. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2771290 · Cited by 334 · see citing works
Škrjanc, I., Iglesias, J. A., Sanchis, A., Leite, D. F., Lughofer, E. D., & Gomide, F. A. C. (2019) · Information Sciences · doi:10.1016/j.ins.2019.03.060 · Cited by 329 · see citing works
Challenges to IoT-Enabled Predictive Maintenance for Industry 4.0
Compare, M., Baraldi, P., & Zio, E. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2957029 · Cited by 311 · see citing works
Spiking Neural Networks and online learning: An overview and perspectives
Lobo, J. L., Ser, J. D., Bifet, A., & Kasabov, N. K. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.09.004 · Cited by 304 · see citing works
Self-citationOpen challenges for data stream mining research
Krempl, G., Žliobaitė, I., Brzeziński, D., Hüllermeier, E., Last, M., Lemaire, V., Noack, T., Shaker, A., Sievi, S., Spiliopoulou, M., et al. (2014) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2674026.2674028 · Cited by 295 · see citing works
Self-citationForecast evaluation for data scientists: common pitfalls and best practices
Hewamalage, H., Ackermann, K., & Bergmeir, C. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00894-5 · Cited by 294 · see citing works
Online Incremental Machine Learning Platform for Big Data-Driven Smart Traffic Management
Nallaperuma, D., Nawaratne, R., Bandaragoda, T., Adikari, A., Nguyen, S., Kempitiya, T., Silva, D. D., Alahakoon, D., & Pothuhera, D. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2924883 · Cited by 291 · see citing works
Proceedings of the 19th Python in Science Conference
(2020) · Proceedings of the Python in Science Conferences · doi:10.25080/majora-342d178e-02b · Cited by 284 · see citing works
Digital Twins in Pharmaceutical and Biopharmaceutical Manufacturing: A Literature Review
Chen, Y., Yang, O., Sampat, C., Bhalode, P., Ramachnadran, R., & Ierapetritou, M. (2020) · Processes · doi:10.3390/pr8091088 · Cited by 295 · see citing works
An effective intrusion detection framework based on SVM with feature augmentation
Wang, H., Gu, J., & Wang, S. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.09.014 · Cited by 282 · see citing works
Algorithms that remember: model inversion attacks and data protection law
Veale, M., Binns, R., & Edwards, L. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0083 · Cited by 278 · see citing works
Low-Cost Outdoor Air Quality Monitoring and Sensor Calibration
Concas, F., Mineraud, J., Lagerspetz, E., Varjonen, S., Liu, X., Puolamäki, K., Nurmi, P., & Tarkoma, S. (2021) · ACM Transactions on Sensor Networks · doi:10.1145/3446005 · Cited by 275 · see citing works
SCARFF : A scalable framework for streaming credit card fraud detection with spark
Carcillo, F., Pozzolo, A. D., Borgne, Y. L., Caelen, O., Mazzer, Y., & Bontempi, G. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.09.005 · Cited by 272 · see citing works
Machine learning for streaming data
Gomes, H. M., Read, J., Bifet, A., Barddal, J. P., & da Gama, J. M. P. (2019) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3373464.3373470 · Cited by 269 · see citing works
Self-citationData drift in medical machine learning: implications and potential remedies
Sahiner, B., Chen, W., Samala, R. K., & Petrick, N. (2023) · The British Journal of Radiology · doi:10.1259/bjr.20220878 · Cited by 279 · see citing works
KNN Classifier with Self Adjusting Memory for Heterogeneous Concept Drift
Losing, V., Hammer, B., & Wersing, H. (2016) · Proceedings · doi:10.1109/icdm.2016.0040 · Cited by 251 · see citing works
Fernandes, M., Corchado, J. M., & Marreiros, G. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03344-3 · Cited by 240 · see citing works
Incremental knowledge base construction using DeepDive
Shin, J., Wu, S., Wang, F., De, C., Zhang, C., & Ré, C. (2015) · Proceedings of the VLDB Endowment · doi:10.14778/2809974.2809991 · Cited by 236 · see citing works
Concept Drift Detection in Data Stream Mining : A literature review
Agrahari, S., & Singh, A. K. (2021) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.11.006 · Cited by 235 · see citing works
Ranking in evolving complex networks
Liao, H., Mariani, M. S., Medo, M., Zhang, Y., & Zhou, M.-Y. (2017) · Physics Reports · doi:10.1016/j.physrep.2017.05.001 · Cited by 234 · see citing works
Discussion and review on evolving data streams and concept drift adapting
Khamassi, I., Sayed-Mouchaweh, M., Hammami, M., & Ghédira, K. (2016) · Evolving Systems · doi:10.1007/s12530-016-9168-2 · Cited by 224 · see citing works
Learning Domain-Invariant Subspace Using Domain Features and Independence Maximization
Yan, K., Kou, L., & Zhang, D. D. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2633306 · Cited by 220 · see citing works
Ranking in evolving complex networks
Liao, H., Mariani, M. S., Medo, M., Zhang, Y., & Zhou, M. (2017) · reroDoc Digital Library · Cited by 221 · see citing works
RDDM: Reactive drift detection method
de Barros, R. S. M., Cabral, D. R. D. L., Gonçalves, P. M., & Santos, S. G. T. D. C. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.08.023 · Cited by 210 · see citing works
Challenges in benchmarking stream learning algorithms with real-world data
Souza, V. M. A., dos Reis, D. M., Maletzke, A. G., & Batista, G. E. A. P. A. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00698-5 · Cited by 206 · see citing works
Challenges in data-driven geospatial modeling for environmental research and practice
Koldasbayeva, D., Tregubova, P., Gasanov, M. E., Zaytsev, A., Petrovskaia, A., & Burnaev, E. V. (2024) · Nature Communications · doi:10.1038/s41467-024-55240-8 · Cited by 198 · see citing works
Continual Prototype Evolution: Learning Online from Non-Stationary Data Streams
Lange, M. D., & Tuytelaars, T. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00814 · Cited by 196 · see citing works
Data Quality for Software Vulnerability Datasets
Croft, R., Babar, M. A., & Kholoosi, M. M. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00022 · Cited by 193 · see citing works
Kappa Updated Ensemble for drifting data stream mining
Cano, A., & Krawczyk, B. (2019) · Machine Learning · doi:10.1007/s10994-019-05840-z · Cited by 185 · see citing works
Smart grid load forecasting using online support vector regression
Vrablecová, P., Ezzeddine, A. B., Rozinajová, V., Šárik, S., & Sangaiah, A. K. (2017) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2017.07.006 · Cited by 184 · see citing works
Incremental Learning in Online Scenario
He, J., Mao, R., Shao, Z., & Zhu, F. M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01394 · Cited by 180 · see citing works
Robust Online Time Series Prediction with Recurrent Neural Networks
Guo, T., Zhao, X., Yao, X., Chen, H., Aberer, K., & Funaya, K. (2016) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2016.92 · Cited by 179 · see citing works
An Overview on Concept Drift Learning
Iwashita, A. S., & Papa, J. P. (2018) · IEEE Access · doi:10.1109/access.2018.2886026 · Cited by 179 · see citing works
Dependable Intrusion Detection System for IoT: A Deep Transfer Learning Based Approach
Mehedi, S. T., Anwar, A., Rahman, Z., Ahmed, K., & Islam, R. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3164770 · Cited by 178 · see citing works
Artificial intelligence and machine learning
Kühl, N., Schemmer, M., Goutier, M., & Satzger, G. (2022) · Electronic Markets · doi:10.1007/s12525-022-00598-0 · Cited by 210 · see citing works
Reactive Soft Prototype Computing for Concept Drift Streams
Raab, C., Heusinger, M., & Schleif, F.-M. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.111 · Cited by 177 · see citing works
BODMAS: An Open Dataset for Learning based Temporal Analysis of PE Malware
Yang, L., Ciptadi, A., Laziuk, I., Ahmadzadeh, A., & Wang, G. (2021) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw53761.2021.00020 · Cited by 177 · see citing works
Intrusion Detection in the IoT Under Data and Concept Drifts: Online Deep Learning Approach
Abdel Wahab, O. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3167005 · Cited by 190 · see citing works
Online Ensemble Learning of Data Streams with Gradually Evolved Classes
Sun, Y., Tang, K., Minku, L. L., Wang, S., & Yao, X. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2526675 · Cited by 175 · see citing works
Temporal quality degradation in AI models
Jarquin, D. V., Sharp, A., Zhang, R., Nguyen, T., Hoang, A. T., & Pianykh, O. S. (2022) · Scientific Reports · doi:10.1038/s41598-022-15245-z · Cited by 187 · see citing works
Detection of calibration drift in clinical prediction models to inform model updating
Davis, S. E., Greevy, R. A., Lasko, T. A., Walsh, C. G., & Matheny, M. E. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103611 · Cited by 160 · see citing works
Fast Hoeffding Drift Detection Method for Evolving Data Streams
Pesaranghader, A., & Viktor, H. L. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46227-1_7 · Cited by 169 · see citing works
Artificial Intelligence Governance For Businesses
Schneider, J., Abraham, R., Meske, C., & Brocke, J. V. (2022) · Information Systems Management · doi:10.1080/10580530.2022.2085825 · Cited by 227 · see citing works
Data stream clustering: a review
Zubaroğlu, A., & Atalay, V. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09874-x · Cited by 167 · see citing works
A large-scale comparison of concept drift detectors
de Barros, R. S. M., & Santos, S. G. T. D. C. (2018) · Information Sciences · doi:10.1016/j.ins.2018.04.014 · Cited by 164 · see citing works
New Directions in Automated Traffic Analysis
Holland, J., Schmitt, P., Feamster, N., & Mittal, P. (2020) · Conference on Computer and Communications Security · doi:10.1145/3460120.3484758 · Cited by 212 · see citing works
Monitoring the public opinion about the vaccination topic from tweets analysis
D'Andrea, E., Ducange, P., Bechini, A., Renda, A., & Marcelloni, F. (2019) · Expert systems with applications · doi:10.1016/j.eswa.2018.09.009 · Cited by 153 · see citing works
Sadler, J. M., Goodall, J. L., Morsy, M. M., & Spencer, K. (2018) · Journal of Hydrology · doi:10.1016/j.jhydrol.2018.01.044 · Cited by 162 · see citing works
A survey on machine learning for recurring concept drifting data streams
Suárez‐Cetrulo, A. L., Quintana, D., & Cervantes, A. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118934 · Cited by 160 · see citing works
Kneib, M., & Huth, C. (2018) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3243734.3243751 · Cited by 156 · see citing works
Discrimination, artificial intelligence, and algorithmic decision-making
Borgesius, F. Z. (2025) · arXiv · doi:10.48550/arxiv.2510.13465 · Cited by 152 · see citing works
Soleymani, F., & Paquet, E. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113456 · Cited by 154 · see citing works
Towards Fairness-Aware Federated Learning
Shi, Y., Yu, H., & Leung, C. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3263594 · Cited by 163 · see citing works
Streaming Random Patches for Evolving Data Stream Classification
Gomes, H. M., Read, J., & Bifet, A. (2019) · Proceedings · doi:10.1109/icdm.2019.00034 · Cited by 151 · see citing works
Self-citationOpen-environment machine learning
Zhou, Z. (2022) · National Science Review · doi:10.1093/nsr/nwac123 · Cited by 161 · see citing works
SAMOA: scalable advanced massive online analysis
Morales, G. D. F., & Bifet, A. (2015) · Cited by 148 · see citing works
Self-citationOn Distributed Fuzzy Decision Trees for Big Data
Segatori, A., Marcelloni, F., & Pedrycz, W. (2017) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2016.2646746 · Cited by 145 · see citing works
Jain, M., Kaur, G., & Saxena, V. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116510 · Cited by 145 · see citing works
An overview of unsupervised drift detection methods
Gemaque, R. N., Costa, A. F. J., Giusti, R., & Santos, E. M. D. (2020) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1381 · Cited by 143 · see citing works
Statistical Features-Based Real-Time Detection of Drifted Twitter Spam
Chen, C., Wang, Y., Zhang, J., Xiang, Y., Zhou, W., & Min, G. (2016) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2621888 · Cited by 139 · see citing works
Concept Drift Adaptation by Exploiting Historical Knowledge
Sun, Y., Tang, K., Zhu, Z., & Yao, X. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2775225 · Cited by 141 · see citing works
Heuristic design of fuzzy inference systems: A review of three decades of research
Ojha, V., Abraham, A., & Snåšel, V. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2019.08.010 · Cited by 139 · see citing works
Targeting Prospective Customers: Robustness of Machine-Learning Methods to Typical Data Challenges
Simester, D., Timoshenko, A., & Zoumpoulis, S. I. (2020) · Management Science · doi:10.1287/mnsc.2019.3308 · Cited by 133 · see citing works
Credit card fraud detection and concept-drift adaptation with delayed supervised information
Pozzolo, A. D., Boracchi, G., Caelen, O., Alippi, C., & Bontempi, G. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280527 · Cited by 135 · see citing works
Boetje, J., & van de Schoot, R. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02502-7 · Cited by 146 · see citing works
“It might be that some relevant records are not presented to the reviewer because the text used in the abstract is not seen as potentially relevant because of concept ambiguity [11, 17], which can make finding relevant records challenging.”
Background
- Authors
- Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A.
- Affiliations
- Universidade do Porto (PT)
- Helsinki Institute for Information Technology (FI)
- Yahoo (Spain) (ES)
- Eindhoven University of Technology (NL)
- Bournemouth University (GB)
- Venue
- ACM Computing Surveys
- Published
- 2014-03
- Volume
- 46
- Issue
- 4
- Pages
- 1-37
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2099419573
- Cited by
- 3,735
- References
- 171
- Citations by year
- 2026: 688 · 2025: 435 · 2024: 296 · 2023: 345 · 2022: 306 · 2021: 367 · 2020: 327 · 2019: 281 · 2018: 229 · 2017: 197 · 2016: 137 · 2015: 96 · 2014: 27 · 2013: 1
- FWCI
- 151.70
- Type
- journal article
- Language
- en
- Open access
- Locations
- ACM Computing Surveys (publishedVersion)
- TU/e Research Portal (publishedVersion)
- Bournemouth University Research Online (Bournemouth University) (submittedVersion)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- TU/e Research Portal (submittedVersion)
- Funders
- Seventh Framework Programme (251617, ICT-2013-612944)
- Fundação para a Ciência e a Tecnologia
- COMPETE Program
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- Suomen Akatemia (118653)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Data Stream Mining Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Keywords
- concept drift, online supervised learning, adaptive learning, adaptive algorithms, algorithm evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
