Evaluating model drift in machine learning algorithms
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Machine learning is rapidly emerging as a valuable technology thanks to its ability to learn patterns from large data sets and solve problems that are impossible to model using conventional programming logic. As machine learning techniques become more mainstream, they are being applied to a wider range of application domains. These algorithms are now trusted to make critical decisions in secure and adversarial environments such as healthcare, fraud detection, and network security, in which mistakes can be incredibly costly. They are also a critical component to most modern autonomous systems. However, the data driven approach utilized by these machine learning methods can prove to be a weakness if the data on which the models rely are corrupted by either nefarious or accidental means. Models that utilize on-line learning or periodic retraining to learn new patterns and account for data distribution changes are particularly susceptible to corruption through model drift. In modeling this type of scenario, specially crafted data points are added to the training set over time to adversely influence the system, inducing model drift which leads to incorrect classifications. Our work is focused on exploring the resistance of various machine learning algorithms to such an approach. In this paper we present an experimental framework designed to measure the susceptibility of anomaly detection algorithms to model drift. We also exhibit our preliminary results using various machine learning algorithms commonly found in intrusion detection research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deployed models must be monitored and potentially corrected for temporal instability (that is, statistical drift 95 ), which can be difficult with encrypted data or algorithms.”
From Secure, privacy-preserving and federated machine learning in medical imaging (2020) · cites this paper as [95]
Citations
Cites
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“This algorithm was chosen again due to its relative simplicity as well as its common appearance in ML-IDS research [9][15][16].”
MethodEstimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168
Poisoning Attacks against Support Vector Machines
Biggio, B., Nelson, B., & Laskov, P. (2012) · arXiv · doi:10.48550/arxiv.1206.6389 · Cited by 1,331
Intrusion detection by machine learning: A review
Tsai, C.-F., Hsu, Y.-F., Lin, C.-Y., & Lin, W.-Y. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.05.029 · Cited by 969
The 1999 DARPA off-line intrusion detection evaluation
Lippmann, R., Haines, J. W., Fried, D. J., Korba, J., & Das, K. (2000) · Computer Networks · doi:10.1016/s1389-1286(00)00139-0 · Cited by 876
The security of machine learning
Barreno, M., Nelson, B., Joseph, A. D., & Tygar, J. D. (2010) · Machine Learning · doi:10.1007/s10994-010-5188-5 · Cited by 817
An Analysis of the 1999 DARPA/Lincoln Laboratory Evaluation Data for Network Anomaly Detection
Mahoney, M. V., & Chan, P. K. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-45248-5_13 · Cited by 535
Exploiting machine learning to subvert your spam filter
Nelson, B. A., Barreno, M., Chi, F. J., Joseph, A. D., Rubinstein, B. I. P., Saini, U., Sutton, C. A., Tygar, J. D., & Xia, K. (2008) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 481
Systematic Poisoning Attacks on and Defenses for Machine Learning in Healthcare
Mozaffari-Kermani, M., Sur-Kolay, S., Raghunathan, A., & Jha, N. K. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2344095 · Cited by 383
McPAD: A multiple classifier system for accurate payload-based anomaly detection
Perdisci, R., Ariu, D., Fogla, P., Giacinto, G., & Lee, W. (2009) · Computer Networks · doi:10.1016/j.comnet.2008.11.011 · Cited by 269
Research works printed but not linked: 1
- biggio, 2013, Evasion atacks against machine learning at test time, Machine Learning and Knowledge Discovery in Databases, 387
Cited by
Secure, privacy-preserving and federated machine learning in medical imaging
Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0186-1 · Cited by 1,676
“(5) Deployed models must be monitored and potentially corrected for temporal instability (that is, statistical drift 95 ), which can be difficult with encrypted data or algorithms.”
BackgroundHadi, M. U., tashi, Q. A., Qureshi, R., Shah, A., muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Wu, J., et al. (2023) · doi:10.36227/techrxiv.23589741.v4 · Cited by 103
Introduction to Artificial Intelligence and Machine Learning for Pathology
Harrison, J. H., Gilbertson, J. R., Hanna, M. G., Olson, N. H., Seheult, J. N., Sorace, J. M., & Stram, M. N. (2021) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2020-0541-cp · Cited by 82
Barriers Related to AI Implementation in Supply Chain Management
Shrivastav, M. (2022) · Journal of Global Information Management · doi:10.4018/jgim.296725 · Cited by 64
“It is of paramount importance in AI to continuously monitor for drift which in turn require dedicated commitment and resources (Nelson et al., 2015).”
BackgroundHadi, M. U., tashi, Q. A., Qureshi, R., Shah, A., muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Wu, J., et al. (2023) · doi:10.36227/techrxiv.23589741.v3 · Cited by 53
Metadata
- Authors
- Nelson, K., Corbin, G., Anania, M., Kovacs, M., Tobias, J., & Blowers, M.
- Affiliations
- United States Air Force Research Laboratory (US)
- Venue
- 2015 IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA)
- Publisher
- IEEE
- Published
- 2015-05
- Pages
- 1-8
- OpenAlex
- W1487801014
- Cited by
- 31
- References
- 17
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 6 · 2023: 7 · 2022: 4 · 2021: 1 · 2020: 1 · 2019: 1
- FWCI
- 0.00
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Data Stream Mining Techniques
- Keywords
- model drift, anomaly detection, intrusion detection, machine learning robustness, data poisoning, online learning, distribution shift, classification accuracy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating model drift in machine learning algorithms. https://app.cochat.ai/papers/10.1109/cisda.2015.7208643
- The paper
- Nelson, K., Corbin, G., Anania, M., Kovacs, M., Tobias, J., & Blowers, M. (2015). Evaluating model drift in machine learning algorithms. 2015 IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA). https://doi.org/10.1109/cisda.2015.7208643
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.