The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Toward Supervised Anomaly Detection
Open accessAbstract
Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails to match the required detection rates in many tasks and there exists a need for labeled data to guide the model generation. Our first contribution shows that classical semi-supervised approaches, originating from a supervised classifier, are inappropriate and hardly detect new and unknown anomalies. We argue that semi-supervised anomaly detection needs to ground on the unsupervised learning paradigm and devise a novel algorithm that meets this requirement. Although being intrinsically non-convex, we further show that the optimization problem has a convex equivalent under relatively mild assumptions. Additionally, we propose an active learning strategy to automatically filter candidates for labeling. In an empirical study on network intrusion detection data, we observe that the proposed learning methodology requires much less labeled data than the state-of-the-art, while achieving higher detection accuracies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
A vector space model for automatic indexing
Salton, G., Wong, A., & Yang, C. S. (1975) · Communications of the ACM · doi:10.1145/361219.361220 · Cited by 7,521
Kernel Methods for Pattern Analysis
Shawe-Taylor, J., & Cristianini, N. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809682 · Cited by 6,587
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168
Combining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Support Vector Data Description
Tax, D. M. J., & Duin, R. P. W. (2004) · Machine Learning · doi:10.1023/b:mach.0000008084.60811.49 · Cited by 3,512
An introduction to kernel-based learning algorithms
Muller, K.-R., Mika, S., Ratsch, G., Tsuda, K., & Scholkopf, B. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914517 · Cited by 3,473
Snort - Lightweight Intrusion Detection for Networks
Roesch, M. (1999) · Cited by 3,163
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Bro: a system for detecting network intruders in real-time
Paxson, V. (1999) · Computer Networks · doi:10.1016/s1389-1286(99)00112-7 · Cited by 2,636
Novelty detection: a review—part 1: statistical approaches
Markou, M., & Singh, S. (2003) · Signal Processing · doi:10.1016/j.sigpro.2003.07.018 · Cited by 1,432
One-class svms for document classification
Manevitz, L. M., & Yousef, M. (2002) · doi:10.5555/944790.944808 · Cited by 1,207
Musa, T. H. A., & Bouras, A. (2022) · Lecture Notes in Networks and Systems · doi:10.1007/978-981-16-2102-4_36 · Cited by 958
Novelty detection: a review—part 2:
Markou, M., & Singh, S. (2003) · Signal Processing · doi:10.1016/j.sigpro.2003.07.019 · Cited by 817
Semi-Supervised Classification by Low Density Separation
Chapelle, O., Zien, A., & Ghahramani, R. C. Z. (2005) · Cited by 765
Building text classifiers using positive and unlabeled examples
Liu, B., Dai, Y., Li, X., Lee, W. S., & Yu, P. S. (2004) · Third IEEE International Conference on Data Mining · doi:10.1109/icdm.2003.1250918 · Cited by 667
A Geometric Framework for Unsupervised Anomaly Detection: Detecting Intrusions in Unlabeled Data
Eskin, E., Arnold, A. O., Prerau, M. J., Portnoy, L., & Stolfo, S. J. (2002) · doi:10.7916/d8d50tqt · Cited by 603
Tax, D. M. J. (2001) · Research Repository (Delft University of Technology) · Cited by 533
Chandola, V., Banerjee, A., & Kumar, V. (2007) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 490
Beyond the point cloud: from transductive to semi-supervised learning
Sindhwani, V., Niyogi, P., & Belkin, M. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102455 · Cited by 439
lp-Norm Multiple Kernel Learning
Kloft, M. (2011) · DepositOnce · doi:10.14279/depositonce-2978 · Cited by 412
Self-citationSupport Vector Machine Active Learning with Application sto Text Classification
Tong, S., & Koller, D. (2000) · International Conference on Machine Learning · Cited by 369
Active Learning with Support Vector Machines in the Drug Discovery Process
Warmuth, M. K., Liao, J., Rätsch, G., Mathieson, M., Putta, S., & Lemmen, C. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci025620t · Cited by 354
Anagram: A Content Anomaly Detector Resistant to Mimicry Attack
Wang, K., Parekh, J. J., & Stolfo, S. J. (2006) · Lecture Notes in Computer Science · doi:10.1007/11856214_12 · Cited by 310
Finding the Outliers that Matter
Andrews, D. F., & Pregibon, D. (1978) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1978.tb01652.x · Cited by 290
McPAD: A multiple classifier system for accurate payload-based anomaly detection
Perdisci, R., Ariu, D., Fogla, P., Giacinto, G., & Lee, W. (2009) · Computer Networks · doi:10.1016/j.comnet.2008.11.011 · Cited by 269
A multi-model approach to the detection of web-based attacks
Kruegel, C., Vigna, G., & Robertson, W. (2005) · Computer Networks · doi:10.1016/j.comnet.2005.01.009 · Cited by 255
Semisupervised One-Class Support Vector Machines for Classification of Remote Sensing Data
Mũnoz-Marí, J., Bovolo, F., Gómez-Chova, L., Bruzzone, L., & Camp-Valls, G. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2045764 · Cited by 248
Fogla, P., Sharif, M., Perdisci, R., et al. (2006) · Cited by 213
A Linear Programming Approach to Novelty Detection
Campbell, C., & Bennett, K. P. (2000) · Cited by 188
Semi-supervised novelty detection
Blanchard, G., Lee, G., & Scott, C. D. (2009) · doi:10.20347/wias.preprint.1471 · Cited by 186
Semi-Supervised Learning (Adaptive Computation and Machine Learning)
Chapelle, O., Schölkopf, B., & Zien, A. (2006) · The MIT Press eBooks · Cited by 185
A continuation method for semi-supervised SVMs
Chapelle, O., Chi, M., & Zien, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143868 · Cited by 178
Using one-class and two-class SVMs for multiclass image annotation
Goh, K.-S., Chang, E. Y., & Li, B. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.170 · Cited by 175
One Class Support Vector Machines for Detecting Anomalous Windows Registry Accesses
Heller, K., Svore, K. M., Keromytis, A. D., & Stolfo, S. J. (2003) · doi:10.7916/d85m6cff · Cited by 166
Active Learning for Anomaly and Rare-Category Detection
Pelleg, D., & Moore, A. (2004) · Cited by 140
Learning from Positive and Unlabeled Examples with Different Data Distributions
Li, X., & Liu, B. (2005) · Lecture notes in computer science · doi:10.1007/11564096_24 · Cited by 111
Language models for detection of unknown attacks in network traffic
Rieck, K., & Laskov, P. (2006) · Journal of Computer Virology and Hacking Techniques · doi:10.1007/s11416-006-0030-0 · Cited by 105
Self-citationLinear-Time Computation of Similarity Measures for Sequential Data
Rieck, K., & Laskov, P. (2008) · doi:10.5555/1390681.1390683 · Cited by 98
Self-citationValue Regularization and Fenchel Duality
Rifkin, R. M., & Lippert, R. A. (2007) · doi:10.5555/1248659.1248676 · Cited by 75
Detecting Unknown Network Attacks Using Language Models
Rieck, K., & Laskov, P. (2006) · Lecture notes in computer science · doi:10.1007/11790754_5 · Cited by 62
Self-citationA comparative evaluation of two algorithms for Windows Registry Anomaly Detection
Stolfo, S. J., Apap, F., Eskin, E., Heller, K., Hershkop, S., Honig, A., & Svore, K. M. (2005) · Journal of Computer Security · doi:10.3233/jcs-2005-13403 · Cited by 52
Using active learning in intrusion detection
Almgren, M., & Jonsson, E. W. (2004) · doi:10.1109/csfw.2004.25 · Cited by 51
Semi-supervised co-training and active learning based approach for multi-view intrusion detection
Mao, C.-H., Lee, H.-M., Parikh, D., Chen, T., & Huang, S. (2009) · ACM Symposium on Applied Computing · doi:10.1145/1529282.1529735 · Cited by 49
TokDoc: a self-healing web application firewall
Krueger, T., Gehl, C., Rieck, K., & Laskov, P. (2010) · ACM Symposium on Applied Computing · doi:10.1145/1774088.1774480 · Cited by 46
Self-citationPark, J., Kang, D., Kim, J.-H., Kwok, J. T.-Y., & Tsang, I. W.-H. (2007) · Neural Computation · doi:10.1162/neco.2007.19.7.1919 · Cited by 44
Using active learning in intrusion detection
Almgren, M., & Jonsson, E. W. (2004) · IEEE Computer Security Foundations Workshop (CSFW) · doi:10.1109/csfw.2004.1310734 · Cited by 41
Pattern Classification via Single Spheres
Wang, J., Neskovic, P., & Cooper, L. N. (2005) · Lecture notes in computer science · doi:10.1007/11563983_21 · Cited by 33
Active and Semi-supervised Data Domain Description
Görnitz, N., Kloft, M., & Brefeld, U. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04180-8_44 · Cited by 28
Self-citationA Simple Probabilistic Approach to Learning from Positive and Unlabeled Examples
Zhang, D., & Lee, W. S. (2005) · Cited by 27
Machine Learning for Application-Layer Intrusion Detection
Rieck, K. (2009) · doi:10.14279/depositonce-2199 · Cited by 26
Self-citationMinimum Enclosing and Maximum Excluding Machine for Pattern Description and Discrimination
Liu, Y., & Zheng, Y. F. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.799 · Cited by 26
Support vector machines for class representation and discrimination
Yuan, C., & Casasent, D. P. (2004) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2003.1223940 · Cited by 24
(1998)
Cited by
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240
A Unifying Review of Deep and Shallow Anomaly Detection
Ruff, L., Kauffmann, J. R., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3052449 · Cited by 914
Self-citationZhang, C., Song, D., Chen, Y., Feng, X., Lumezanu, C., Cheng, W., Ni, J., Zong, B., Chen, H., & Chawla, N. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011409 · Cited by 855
Confident Learning: Estimating Uncertainty in Dataset Labels
Northcutt, C., Jiang, L., & Chuang, I. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12125 · Cited by 795
SPot-the-Difference Self-supervised Pre-training for Anomaly Detection and Segmentation
Zou, Y., Jeong, J., Pemula, L., Zhang, D., & Dabeer, O. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20056-4_23 · Cited by 651
Metadata
- Authors
- Goernitz, N., Kloft, M., Rieck, K., & Brefeld, U.
- Venue
- Journal of Artificial Intelligence Research
- Publisher
- AI Access Foundation
- Published
- 2013-02-20
- Volume
- 46
- Pages
- 235-262
- ISSN
- 1076-9757 (ISSN-L)
- OpenAlex
- W2143559571
- Cited by
- 371
- References
- 58
- FWCI
- 13.99
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.