The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Active Learning With Drifting Streaming Data
Abstract
In learning to classify streaming data, obtaining true labels may require major effort and may incur excessive cost. Active learning focuses on carefully selecting as few labeled instances as possible for learning an accurate predictive model. Streaming data poses additional challenges for active learning, since the data distribution may change over time (concept drift) and models need to adapt. Conventional active learning strategies concentrate on querying the most uncertain instances, which are typically concentrated around the decision boundary. Changes occurring further from the boundary may be missed, and models may fail to adapt. This paper presents a theoretically supported framework for active learning from drifting data streams and develops three active learning strategies for streaming data that explicitly handle concept drift. They are based on uncertainty, dynamic allocation of labeling efforts over time, and randomization of the search space. We empirically demonstrate that these strategies react well to changes that can occur anywhere in the instance space and unexpectedly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,411
A comparison of event models for naive bayes text classification
McCallum, A., & Nigam, K. (1998) · Cited by 3,289
RCV1: A New Benchmark Collection for Text Categorization Research
Lewis, D., Yang, Y., Rose, T. G., & Li, F. (2004) · Goldsmiths (University of London) · doi:10.5555/1005332.1005345 · Cited by 2,503
Learning in the Presence of Concept Drift and Hidden Contexts
Widmer, G., & Kubat, M. (1996) · Machine Learning · doi:10.1023/a:1018046501280 · Cited by 1,857
Improving generalization with active learning
Cohn, D., Atlas, L., & Ladner, R. (1994) · Machine Learning · doi:10.1007/bf00993277 · Cited by 1,591
Gama, J., Medas, P., Castillo, G., & Rodrigues, P. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28645-5_29 · Cited by 1,536
BifetAlbert, HolmesGeoff, KirkbyRichard, & PfahringerBernhard (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859903 · Cited by 771
Settles, B. (2012) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01560-1 · Cited by 502
Learning model trees from evolving data streams
Ikonomovska, E., Gama, J., & Džeroski, S. (2011) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-010-0201-y · Cited by 304
Harries, M. B., Sammut, C., & Horn, K. (1998) · Machine Learning · doi:10.1023/a:1007420529897 · Cited by 178
Facing the reality of data stream classification: coping with scarcity of labeled data
Masud, M. M., Woolam, C., Gao, J., et al. (2011) · Knowledge and Information Systems · doi:10.1007/s10115-011-0447-8 · Cited by 120
Fan, W., Huang, Y.-A., Wang, H., et al. (2004) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972740.46 · Cited by 106
Worst-Case Analysis of Selective Sampling for Linear Classification
Cesa‐Bianchi, N., Gentile, C., & Zaniboni, L. (2006) · doi:10.5555/1248547.1248591 · Cited by 101
Active Learning with Evolving Streaming Data
Žliobaitė, I., Bifet, A., Pfahringer, B., & Holmes, G. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23808-6_39 · Cited by 86
Self-citationRelevant data expansion for learning concept drift from sparsely labeled data
Widyantoro, D. H., & Yen, J. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.48 · Cited by 53
Handling Concept Drift in Text Data Stream Constrained by High Labelling Cost
Lindstrom, P. (2010) · Arrow@dit (Dublin Institute of Technology) · doi:10.21427/d7b022 · Cited by 50
Using Labeled and Unlabeled Data to Learn Drifting Concepts
Klinkenberg, R. (2001) · Cited by 33
An active learning system for mining time-changing data streams
Huang, S., & Dong, Y. (2007) · Intelligent Data Analysis · doi:10.3233/ida-2007-11406 · Cited by 28
Cited by
A survey on concept drift adaptation
Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014) · ACM Computing Surveys · doi:10.1145/2523813 · Cited by 3,735
Self-citationLearning from imbalanced data: open challenges and future directions
Krawczyk, B. (2016) · Progress in Artificial Intelligence · doi:10.1007/s13748-016-0094-0 · Cited by 2,459
Learning under Concept Drift: A Review
Lu, J., Liu, A., Dong, F., Gu, F., Gama, J., & Zhang, G. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2876857 · Cited by 1,603
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050
Learning in Nonstationary Environments: A Survey
Ditzler, G., Roveri, M., Alippi, C., & Polikar, R. (2015) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2471196 · Cited by 793
Metadata
- Authors
- Zliobaite, I., Bifet, A., Pfahringer, B., & Holmes, G.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2014-01
- Volume
- 25
- Issue
- 1
- Pages
- 27-39
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W1982039810
- Cited by
- 387
- References
- 18
- FWCI
- 25.40
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.