Learning under Concept Drift: A Review
Open accessThe DOI matches its Crossref record; 138 of the 141 references it cites were found in a registry or an index, and 3 are not checked yet.
Abstract
Concept drift describes unforeseeable changes in the underlying distribution of streaming data overtime. Concept drift research involves the development of methodologies and techniques for drift detection, understanding, and adaptation. Data analysis has revealed that machine learning in a concept drift environment will result in poor learning results if the drift is not addressed. To help researchers identify which research topics are significant and how to apply related techniques in data analysis tasks, it is necessary that a high quality, instructive review of current research developments and trends in the concept drift field is conducted. In addition, due to the rapid development of concept drift in recent years, the methodologies of learning under concept drift have become noticeably systematic, unveiling a framework which has not been mentioned in literature. This paper reviews over 130 high quality publications in concept drift related research areas, analyzes up-to-date developments in methodologies and techniques, and establishes a framework of learning under concept drift including three main components: concept drift detection, concept drift understanding, and concept drift adaptation. This paper lists and discusses 10 popular synthetic datasets and 14 publicly available benchmark datasets used for evaluating the performance of learning algorithms aiming at handling concept drift. Also, concept drift related research directions are covered and discussed. By providing state-of-the-art knowledge, this survey will directly support researchers in their understanding of research developments in the field of learning under concept drift.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A critical phenomenon in dynamic graph data is concept drift [22], where the statistical properties of the graph structure or associated features change over time.”
From A Survey of Heterogeneous Graph Neural Networks for Cybersecurity Anomaly Detection (2025) · cites this paper as [22]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Another challenge lies in heterogeneity and modality, since real systems combine multiple entity types and often include logs, textual reports, or event traces that current approaches rarely exploit [22].”
From A Survey of Heterogeneous Graph Neural Networks for Cybersecurity Anomaly Detection (2025) · cites this paper as [22]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Large language models (LLMs) can effectively revise and improve accessibility design; however, they are prone to content discrepancies [33], where certain details may be unintentionally omitted or altered when regenerating a webpage.”
From From Cluttered to Clear: Improving the Web Accessibility Design for Screen Reader Users in E-commerce With Generative AI (2025) · cites this paper as [33]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Extreme learning machine: Theory and applications
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.126 · Cited by 13,285
Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages
McNemar, Q. (1947) · Psychometrika · doi:10.1007/bf02295996 · Cited by 4,754
A survey on concept drift adaptation
Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014) · ACM Computing Surveys · doi:10.1145/2523813 · Cited by 3,735
Self-citationMining high-speed data streams
Domingos, P., & Hulten, G. (2000) · Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/347090.347107 · Cited by 2,185
Learning in the Presence of Concept Drift and Hidden Contexts
Widmer, G., & Kubat, M. (1996) · Machine Learning · doi:10.1023/a:1018046501280 · Cited by 1,857
A Framework for Clustering Evolving Data Streams
Aggarwal, C. C., Yu, P. S., Han, J., & Wang, J. (2003) · Proceedings 2003 VLDB Conference · doi:10.1016/b978-012722442-8/50016-1 · Cited by 1,808
Learning from Time-Changing Data with Adaptive Windowing
Bifet, A., & Gavaldà, R. (2007) · Proceedings of the 2007 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972771.42 · Cited by 1,789
Mining time-changing data streams
Hulten, G., Spencer, L., & Domingos, P. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502529 · Cited by 1,748
Gama, J., Medas, P., Castillo, G., & Rodrigues, P. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28645-5_29 · Cited by 1,536
Self-citationMining concept-drifting data streams using ensemble classifiers
Wang, H., Fan, W., Yu, P. S., & Han, J. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956778 · Cited by 1,256
Pukelsheim, F. (1994) · The American Statistician · doi:10.2307/2684253 · Cited by 1,242
Pukelsheim, F. (1994) · The American Statistician · doi:10.1080/00031305.1994.10476030 · Cited by 1,211
A streaming ensemble algorithm (SEA) for large-scale classification
Street, W. N., & Kim, Y. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502568 · Cited by 1,205
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050
Self-citationA unifying view on dataset shift in classification
Moreno-Torres, J. G., Raeder, T., Alaiz-Rodríguez, R., Chawla, N. V., & Herrera, F. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.06.019 · Cited by 1,029
Incremental Learning of Concept Drift in Nonstationary Environments
Elwell, R., & Polikar, R. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2160459 · Cited by 931
Big data: Issues, challenges, tools and Good practices
Katal, A., Wazid, M., & Goudar, R. H. (2013) · 2013 Sixth International Conference on Contemporary Computing (IC3) · doi:10.1109/ic3.2013.6612229 · Cited by 862
Adaptive random forests for evolving data stream classification
Gomes, H. M., Bifet, A., Read, J., Barddal, J. P., Enembreck, F., Pfharinger, B., Holmes, G., & Abdessalem, T. (2017) · Machine Learning · doi:10.1007/s10994-017-5642-8 · Cited by 805
Learning in Nonstationary Environments: A Survey
Ditzler, G., Roveri, M., Alippi, C., & Polikar, R. (2015) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2471196 · Cited by 793
Detecting Change in Data Streams
Kifer, D., Ben-David, S., & Gehrke, J. (2004) · Proceedings 2004 VLDB Conference · doi:10.1016/b978-012088469-8.50019-x · Cited by 789
BifetAlbert, HolmesGeoff, KirkbyRichard, & PfahringerBernhard (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859903 · Cited by 771
Evaluating Learning Algorithms: A Classification Perspective
Japkowicz, N., & Shah, M. (2011) · doi:10.1017/cbo9780511921803 · Cited by 767
Incremental learning from noisy data
Schlimmer, J. C., & Granger, R. H. (1986) · Machine Learning · doi:10.1007/bf00116895 · Cited by 653
PRISM: An algorithm for inducing modular rules
Cendrowska, J. (1987) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(87)80003-2 · Cited by 650
Dynamic Weighted Majority: An Ensemble Method for Drifting Concepts
Kolter, J. Z., & Maloof, M. A. (2007) · doi:10.5555/1314498.1390333 · Cited by 648
New ensemble methods for evolving data streams
Bifet, A., Holmes, G., Pfahringer, B., Kirkby, R., & Gavaldà, R. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557041 · Cited by 558
On evaluating stream learning algorithms
Gama, J., Sebastião, R., & Rodrigues, P. P. (2013) · Machine Learning · doi:10.1007/s10994-012-5320-9 · Cited by 532
Self-citationData stream clustering: A survey
Silva, J. A., Faria, E. R., Barros, R. C., Hruschka, E. R., Carvalho, A. C. P. L. F. D., & Gama, J. (2013) · ACM Computing Surveys · doi:10.1145/2522968.2522981 · Cited by 508
Self-citationA survey on data preprocessing for data stream mining: Current status and future directions
Ramírez-Gallego, S., Krawczyk, B., García, S., Woźniak, M., & Herrera, F. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.01.078 · Cited by 502
Adaptive Learning from Evolving Data Streams
Bifet, A., & Gavaldà, R. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-03915-7_22 · Cited by 486
Online and Non-Parametric Drift Detection Methods Based on Hoeffding’s Bounds
Frias-Blanco, I., Campo-Avila, J. D., Ramos-Jimenez, G., Morales-Bueno, R., Ortiz-Diaz, A., & Caballero-Mota, Y. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2345382 · Cited by 469
Reacting to Different Types of Concept Drift: The Accuracy Updated Ensemble Algorithm
Brzezinski, D., & Stefanowski, J. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2251352 · Cited by 423
Incremental Learning of Concept Drift from Streaming Imbalanced Data
Ditzler, G., & Polikar, R. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.136 · Cited by 406
Exponentially weighted moving average charts for detecting concept drift
Ross, G. J., Adams, N. M., Tasoulis, D. K., & Hand, D. J. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2011.08.019 · Cited by 404
Resampling-Based Ensemble Methods for Online Class Imbalance Learning
Wang, S., Minku, L. L., & Yao, X. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2345380 · Cited by 396
Mining concept-drifting data streams using ensemble classifiers
Wang, H., Fan, W., Yu, P. S., & Han, J. (2003) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/956755.956778 · Cited by 390
Active Learning With Drifting Streaming Data
Zliobaite, I., Bifet, A., Pfahringer, B., & Holmes, G. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2236570 · Cited by 387
Leveraging Bagging for Evolving Data Streams
Bifet, A., Holmes, G., & Pfahringer, B. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15880-3_15 · Cited by 378
Accurate decision trees for mining high-speed data streams
Gama, J., Rocha, R., & Medas, P. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956813 · Cited by 298
Self-citationDetecting Concept Drift Using Statistical Testing
Nishida, K., & Yamauchi, K. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75488-6_27 · Cited by 285
Using additive expert ensembles to cope with concept drift
Kolter, J. Z., & Maloof, M. A. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102408 · Cited by 261
Experimental comparisons of online and batch versions of bagging and boosting
Oza, N. C., & Russell, S. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502565 · Cited by 244
KNN Classifier with Self Adjusting Memory for Heterogeneous Concept Drift
Losing, V., Hammer, B., & Wersing, H. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0040 · Cited by 238
An Information-Theoretic Approach to Detecting Changes in Multi-Dimensional Data Streams
Dasu, T., Krishnan, S. M., Venkatasubramanian, S., & Yi, K. (2006) · Cited by 235
Tracking recurring contexts using ensemble classifiers: an application to email filtering
Katakis, I., Tsoumakas, G., & Vlahavas, I. (2010) · Knowledge and Information Systems · doi:10.1007/s10115-009-0206-2 · Cited by 213
A case-based technique for tracking concept drift in spam filtering
Delany, S. J., Cunningham, P., Tsymbal, A., & Coyle, L. (2005) · Knowledge-Based Systems · doi:10.1016/j.knosys.2004.10.002 · Cited by 206
A comparative study on concept drift detectors
Gonçalves, P. M., de Carvalho Santos, S. G. T., Barros, R. S. M., & Vieira, D. C. L. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.07.019 · Cited by 199
Concept drift detection via competence models
Lu, N., Zhang, G., & Lu, J. (2014) · Artificial Intelligence · doi:10.1016/j.artint.2014.01.001 · Cited by 198
Self-citationDynamic integration of classifiers for handling concept drift
Tsymbal, A., Pechenizkiy, M., Cunningham, P., & Puuronen, S. (2008) · Information Fusion · doi:10.1016/j.inffus.2006.11.002 · Cited by 195
Decision Trees for Mining Data Streams Based on the McDiarmid's Bound
Rutkowski, L., Pietruczuk, L., Duda, P., & Jaworski, M. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.66 · Cited by 193
Online Ensemble Learning of Data Streams with Gradually Evolved Classes
Sun, Y., Tang, K., Minku, L. L., Wang, S., & Yao, X. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2526675 · Cited by 174
When Training and Test Sets Are Different: Characterizing Learning Transfer
Storkey, A. (2008) · The MIT Press eBooks · doi:10.7551/mitpress/7921.003.0004 · Cited by 170
SAND: Semi-Supervised Adaptive Novel Class Detection and Classification over Data Stream
Haque, A., Khan, L., & Baron, M. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10283 · Cited by 168
Efficient Online Evaluation of Big Data Stream Classifiers
Bifet, A., de Francisci Morales, G., Read, J., Holmes, G., & Pfahringer, B. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783372 · Cited by 165
Decision Trees for Mining Data Streams Based on the Gaussian Approximation
Rutkowski, L., Jaworski, M., Pietruczuk, L., & Duda, P. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.34 · Cited by 164
Paired Learners for Concept Drift
Bach, S. H., & Maloof, M. A. (2008) · Proceedings · doi:10.1109/icdm.2008.119 · Cited by 161
A survey on learning from data streams: current and future trends
Gama, J. (2012) · Progress in Artificial Intelligence · doi:10.1007/s13748-011-0002-6 · Cited by 160
Self-citationConcept drift detection for streaming data
Wang, H., & Abraham, Z. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280398 · Cited by 155
Ensemble of subset online sequential extreme learning machine for class imbalance and concept drift
Mirza, B., Lin, Z., & Liu, N. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.03.075 · Cited by 155
Just-in-Time Adaptive Classifiers—Part I: Detecting Nonstationary Changes
Alippi, C., & Roveri, M. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2000082 · Cited by 154
Statistical change detection for multi-dimensional data
Song, X., Wu, M., Jermaine, C., & Ranka, S. (2007) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1281192.1281264 · Cited by 150
Just-In-Time Classifiers for Recurrent Concepts
Alippi, C., Boracchi, G., & Roveri, M. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2239309 · Cited by 144
Concept Drift Detection Through Resampling
Harel, M., Mannor, S., El‐Yaniv, R., & Crammer, K. (2014) · International Conference on Machine Learning · Cited by 142
Concept Drift Adaptation by Exploiting Historical Knowledge
Sun, Y., Tang, K., Zhu, Z., & Yao, X. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2775225 · Cited by 141
A PCA-Based Change Detection Framework for Multidimensional Data Streams
Qahtan, A. A., Alharbi, B., Wang, S., & Zhang, X. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783359 · Cited by 138
Dynamic extreme learning machine for data stream classification
Xu, S., & Wang, J. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.078 · Cited by 136
Fast and Light Boosting for Adaptive Mining of Data Streams
Chu, F., & Zaniolo, C. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24775-3_36 · Cited by 134
Regional Concept Drift Detection and Density Synchronized Drift Adaptation
Liu, A., Song, Y., Zhang, G., & Jie Lu, B. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/317 · Cited by 131
Self-citationEfficient handling of concept drift and concept evolution over Stream Data
Haque, A., Khan, L. R., Baron, M., Thuraisingham, B. M., & Aggarwal, C. C. (2016) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2016.7498264 · Cited by 131
Learning with Local Drift Detection
da Gama, J. M. P., & Castillo, G. (2006) · Lecture notes in computer science · doi:10.1007/11811305_4 · Cited by 130
Self-citationA concept drift-tolerant case-base editing technique
Ning, L., Lü, J., Zhang, G., & de Mántaras, R. L. (2015) · Artificial Intelligence · doi:10.1016/j.artint.2015.09.009 · Cited by 128
Self-citationEvaluation methods and decision theory for classification of streaming data with temporal dependence
Žliobaitė, I., Bifet, A., Read, J., Pfahringer, B., & Holmes, G. (2014) · Machine Learning · doi:10.1007/s10994-014-5441-4 · Cited by 127
Souza, V. M. A., Silva, D. F., da Gama, J. M. P., & Batista, G. E. A. P. A. (2015) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611974010.98 · Cited by 124
Self-citationEvolving Type-2 Fuzzy Classifier
Pratama, M., Lü, J., & Zhang, G. (2015) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2015.2463732 · Cited by 115
Self-citationA New Method for Data Stream Mining Based on the Misclassification Error
Rutkowski, L., Jaworski, M., Pietruczuk, L., & Duda, P. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2333557 · Cited by 111
Raza, H., Prasad, G., & Li, Y. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.07.028 · Cited by 111
pClass: An Effective Classifier for Streaming Examples
Pratama, M., Anavatti, S. G., Joo, M., & Lughofer, E. D. (2014) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2014.2312983 · Cited by 107
Hierarchical Change-Detection Tests
Alippi, C., Boracchi, G., & Roveri, M. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2512714 · Cited by 103
Unbiased online active learning in data streams
Chu, W., Zinkevich, M., Li, L., Thomas, A. O., & Tseng, B. L. (2011) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2020408.2020444 · Cited by 101
Fast Perceptron Decision Tree Learning from Evolving Data Streams
Bifet, A., Holmes, G., Pfahringer, B., & Frank, E. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13672-6_30 · Cited by 95
Categorizing and mining concept drifting data streams
Zhang, P., Xingquan Zhu, A., & Shi, Y. (2008) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1401890.1401987 · Cited by 95
Hosseini, M. J., Gholipour, A., & Beigy, H. (2015) · Knowledge and Information Systems · doi:10.1007/s10115-015-0837-4 · Cited by 94
Mirza, B., & Lin, Z. (2016) · Neural Networks · doi:10.1016/j.neunet.2016.04.008 · Cited by 93
Structural property-aware multilayer network embedding for latent factor analysis
Lü, J., Xuan, J., Zhang, G., & Luo, X. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.11.004 · Cited by 93
Self-citationClassifier and Cluster Ensembles for Mining Concept Drifting Data Streams
Zhang, P., Xingquan Zhu, A., Tan, J., & Guo, L. (2010) · Proceedings · doi:10.1109/icdm.2010.125 · Cited by 90
A pdf-Free Change Detection Test Based on Density Difference Estimation
Bu, L., Alippi, C., & Zhao, D. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2619909 · Cited by 89
Learning from concept drifting data streams with unlabeled data
Wu, X., Li, P., & Hu, X. (2012) · Neurocomputing · doi:10.1016/j.neucom.2011.08.041 · Cited by 87
Fuzzy time windowing for gradual concept drift adaptation
Liu, A., Zhang, G., & Lü, J. (2017) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz-ieee.2017.8015596 · Cited by 86
Self-citationPrototype-based learning on concept-drifting data streams
Shao, J., Ahmadi, Z., & Krämer, S. (2014) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2623330.2623609 · Cited by 84
Just-in-Time Adaptive Classifiers—Part II: Designing the Classifier
Alippi, C., & Roveri, M. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2003998 · Cited by 82
Alcalá, S. G. S., & Araújo, R. A. M. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.07.035 · Cited by 81
Improving Adaptive Bagging Methods for Evolving Data Streams
Bifet, A., Holmes, G., Pfahringer, B., & Gavaldà, R. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-05224-8_4 · Cited by 80
An adaptive personalized news dissemination system
Katakis, I., Tsoumakas, G., Banos, E., Bassiliades, N., & Vlahavas, I. P. (2008) · Journal of Intelligent Information Systems · doi:10.1007/s10844-008-0053-8 · Cited by 79
Scalable real-time classification of data streams with concept drift
Tennant, M., Stahl, F. T., RANA, O. F., & Gomes, J. B. (2017) · Future Generation Computer Systems · doi:10.1016/j.future.2017.03.026 · Cited by 76
Concept Drift Detection with Hierarchical Hypothesis Testing
Yu, S., & Abraham, Z. (2017) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611974973.86 · Cited by 70
Mining Recurring Concepts in a Dynamic Feature Space
Gomes, J. B., Gaber, M. M., Sousa, P., & Menasalvas, E. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2271915 · Cited by 68
FP-ELM: An online sequential learning algorithm for dealing with concept drift
Liu, D., Wu, Y., & Jiang, H. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.04.043 · Cited by 62
An Ensemble of Classifiers for coping with Recurring Contexts in Data Streams
Katakis, I., Tsoumakas, G., & Vlahavas, I. P. (2008) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-58603-891-5-763 · Cited by 62
Scaffolding type-2 classifier for incremental learning under concept drifts
Pratama, M., Lü, J., Lughofer, E. D., Zhang, G., & Anavatti, S. G. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.01.049 · Cited by 60
Self-citationLearning concept-drifting data streams with random ensemble decision trees
Li, P., Wu, X., Hu, X., & Wang, H. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.04.024 · Cited by 59
A just-in-time adaptive classification system based on the intersection of confidence intervals rule
Alippi, C., Boracchi, G., & Roveri, M. (2011) · Neural Networks · doi:10.1016/j.neunet.2011.05.012 · Cited by 58
A Selective Detector Ensemble for Concept Drift Detection
Du, L., Song, Q., Zhu, L., & Zhu, X. (2014) · The Computer Journal · doi:10.1093/comjnl/bxu050 · Cited by 54
A Lightweight Concept Drift Detection Ensemble
Maciel, B. I. F., Santos, S. G. T. D. C., & de Barros, R. S. M. (2015) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2015.151 · Cited by 54
Yu, S., Wang, X., & Príncipe, J. C. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/421 · Cited by 54
FEDD: Feature Extraction for Explicit Concept Drift Detection in time series
Cavalcante, R. C., Minku, L. L., & Oliveira, A. (2016) · IEEE International Joint Conference on Neural Network · doi:10.1109/ijcnn.2016.7727274 · Cited by 53
An Adaptive Framework for Multistream Classification
Chandra, S., Haque, A., Khan, L. R., & Aggarwal, C. C. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983842 · Cited by 51
Change-point detection with feature selection in high-dimensional time-series data
Yamada, M., Kimura, A., Naya, F., & Sawada, H. (2013) · International Joint Conference on Artificial Intelligence · Cited by 51
Recurrent concepts in data streams classification
da Gama, J. M. P., & Kosina, P. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-013-0654-6 · Cited by 50
Self-citationThree-layer concept drifting detection in text data streams
Zhang, Y., Chu, G., Li, P., Hu, X., & Wu, X. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.04.047 · Cited by 47
Very fast decision rules for classification in data streams
Kosina, P., & da Gama, J. M. P. (2013) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-013-0340-z · Cited by 46
Self-citationSemi-supervised learning in nonstationary environments
Ditzler, G., & Robi Polikar, A. (2011) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2011.6033578 · Cited by 46
Song, G., Ye, Y., Zhang, H., Xu, X., Lau, R. Y. K., & Liu, F. (2016) · Information Sciences · doi:10.1016/j.ins.2016.03.043 · Cited by 44
Enabling fast prediction for ensemble models on data streams
Zhang, P., Li, J., Wang, P., Gao, B. J., Xingquan Zhu, A., & Guo, L. (2011) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2020408.2020442 · Cited by 43
An Incremental Change Detection Test Based on Density Difference Estimation
Bu, L., Zhao, D., & Alippi, C. (2017) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2017.2682502 · Cited by 41
Prequential AUC for Classifier Evaluation and Drift Detection in Evolving Data Streams
Brzeziński, D., & Stefanowski, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-17876-9_6 · Cited by 41
Concept drift detection based on equal density estimation
Gu, F., Zhang, G., Lü, J., & Lin, C. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727176 · Cited by 41
Self-citationDE2: Dynamic ensemble of ensembles for learning nonstationary data
Yin, X.-C., Huang, K., & Hao, H. (2015) · Neurocomputing · doi:10.1016/j.neucom.2014.06.092 · Cited by 39
Incrementally optimized decision tree for noisy big data
Yang, H., & Fong, S. J. (2012) · International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications (BigMine) · doi:10.1145/2351316.2351322 · Cited by 36
Adaptive Concept Drift Detection
Dries, A., & Rückert, U. (2009) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972795.21 · Cited by 35
Optimizing regression models for data streams with missing values
Žliobaitė, I., & Hollmén, J. (2014) · Machine Learning · doi:10.1007/s10994-014-5450-3 · Cited by 30
When Training and Test Sets Are Different: Characterizing Learning Transfer
Amos, S. (2008) · The MIT Press eBooks · doi:10.7551/mitpress/9780262170055.003.0001 · Cited by 30
Modeling recurring concepts in data streams: a graph-based framework
Ahmadi, Z., & Krämer, S. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1070-0 · Cited by 29
Countering the concept-drift problems in big data by an incrementally optimized stream mining model
Yang, H., & Fong, S. (2015) · Journal of Systems and Software · doi:10.1016/j.jss.2014.07.010 · Cited by 28
Tracking concept drift using a constrained penalized regression combiner
Wang, L.-Y., Park, C., Yeon, K., & Choi, H. (2016) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2016.11.002 · Cited by 25
Efficient mining of high-speed uncertain data streams
Han, D., Giraud-Carrier, C. G., & Li, S. (2015) · Applied Intelligence · doi:10.1007/s10489-015-0675-9 · Cited by 24
SOM-based partial labeling of imbalanced data stream
Arabmakki, E., & Kantardzic, M. M. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.11.088 · Cited by 23
A method for automatic adjustment of ensemble size in stream data mining
Pietruczuk, L., Rutkowski, L., Jaworski, M., & Duda, P. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727174 · Cited by 22
Online adaptive decision trees based on concentration inequalities
Blanco, I. I. F., del Campo-Ávila, J., Ramos-Jiménez, G., de Carvalho, A. C. P. L. F., Díaz, A. A. O., & Morales-Bueno, R. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.04.019 · Cited by 19
On expressiveness and uncertainty awareness in rule-based classification for data streams
Lê, T. B., Stahl, F. T., Gaber, M. M., Gomes, J. B., & Fatta, G. D. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.05.081 · Cited by 19
Just-in-time ensemble of classifiers
Alippi, C., Boracchi, G., & Roveri, M. (2012) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252540 · Cited by 16
A rank-one update method for least squares linear discriminant analysis with concept drift
Yeh, Y.-R., & Wang, Y.-C. F. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.11.008 · Cited by 16
Concept drift learning with alternating learners
Xu, Y., Xu, R., Yan, W., & Ardis, P. A. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966109 · Cited by 15
A Data Streams Analysis Strategy Based on Hoeffding Tree with Concept Drift on Hadoop System
Song, X., He, H., Niu, S., & Gao, J. (2016) · International Conference on Advanced Cloud and Big Data · doi:10.1109/cbd.2016.018 · Cited by 12
Controlled permutations for testing adaptive learning models
Žliobaitė, I. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-013-0629-7 · Cited by 11
One-Pass Logistic Regression for Label-Drift and Large-Scale Classification on Distributed Systems
Nguyen, V., Nguyen, T. D., Le, T., Venkatesh, S., & Phung, D. (2016) · Proceedings · doi:10.1109/icdm.2016.0145 · Cited by 10
A Simple Unlearning Framework for Online Learning Under Concept Drifts
You, S.-C., & Lin, H.-T. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-31753-3_10 · Cited by 9
Parallel Concept Drift Detection with Online Map-Reduce
Andrzejak, A., & Gomes, J. B. (2012) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2012.102 · Cited by 8
Mining Evolving Data Streams with Particle Filters
Fok, R., An, A., & Wang, X. (2015) · Computational Intelligence · doi:10.1111/coin.12071 · Cited by 5
Characterization using normal or log-normal data with multiple censoring points
Hawkins, D. M., & Oehlert, G. W. (2000) · Environmetrics · doi:10.1002/(sici)1099-095x(200003/04)11:2<151::aid-env394>3.0.co;2-b · Cited by 4
Research works printed but not linked: 3
- 10.1007/bf00116900 · doi:10.1007/bf00116900 · Paper page
- Basseville, 1993, Detection of Abrupt Changes: Theory and Application, 104
- Baena-García, Early drift detection method, 77
Cited by
Towards Personalized Federated Learning
Tan, A. Z., Yu, H., Cui, L., & Yang, Q. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3160699 · Cited by 1,182
Algorithmic fairness in artificial intelligence for medicine and healthcare
Chen, R. J., Wang, J. J., Williamson, D. F. K., Chen, T. Y., Lipkova, J., Lu, M. Y., Sahai, S., & Mahmood, F. (2023) · Nature Biomedical Engineering · doi:10.1038/s41551-023-01056-8 · Cited by 750
Theissler, A., Pérez-Velázquez, J., Kettelgerdes, M., & Elger, G. (2021) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2021.107864 · Cited by 581
Can deep learning beat numerical weather prediction?
Schultz, M. G., Betancourt, C., Gong, B., Kleinert, F., Langguth, M., Leufen, L. H., Mozaffari, A., & Stadtler, S. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0097 · Cited by 562
From concept drift to model degradation: An overview on performance-aware drift detectors
Bayram, F., Ahmed, B. S., & Kassler, A. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108632 · Cited by 407
Metadata
- Authors
- Lu, J., Liu, A., Dong, F., Gu, F., Gama, J., & Zhang, G.
- Affiliations
- University of Technology Sydney (AU)
- ORCID
- Zhang, Guangquan
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2018
- Pages
- 1-1
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W2898017895
- Cited by
- 1,603
- References
- 138
- Citations by year
- 2026: 169 · 2025: 300 · 2024: 341 · 2023: 315 · 2022: 210 · 2021: 169 · 2020: 76 · 2019: 22 · 2018: 1
- FWCI
- 37.72
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Australian Research Council (150101645)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Data Stream Mining Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and ELM
- Keywords
- concept drift, data streams, drift detection, drift adaptation, synthetic dataset, benchmark dataset, research directions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.