The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Enhancing one-class support vector machines for unsupervised anomaly detection
Abstract
Support Vector Machines (SVMs) have been one of the most successful machine learning techniques for the past decade. For anomaly detection, also a semi-supervised variant, the one-class SVM, exists. Here, only normal data is required for training before anomalies can be detected. In theory, the one-class SVM could also be used in an unsupervised anomaly detection setup, where no prior training is conducted. Unfortunately, it turns out that a one-class SVM is sensitive to outliers in the data. In this work, we apply two modifications in order to make one-class SVMs more suitable for unsupervised anomaly detection: Robust one-class SVMs and eta one-class SVMs. The key idea of both modifications is, that outliers should contribute less to the decision boundary as normal instances. Experiments performed on datasets from UCI machine learning repository show that our modifications are very promising: Comparing with other standard unsupervised anomaly detection algorithms, the enhanced one-class SVMs are superior on two out of four datasets. In particular, the proposed eta one-class SVM has shown the most promising results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
(1996) · Cited by 20,179
A Tutorial on Support Vector Machines for Pattern Recognition
Burges, C. J. C. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009715923555 · Cited by 16,429
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 5×
“In the anomaly detection domain, three different learning setups based on the availability of labels exist [7]: Similar to”
BackgroundMethodInfluentialAdvances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
(2006) · Springer eBooks · Cited by 8,123
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Kendall, M. G. (1957) · Biometrika · doi:10.2307/2333282 · Cited by 6,383
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168 · cited 2×
“The Gaussian kernel in particular guarantees the existence of such a decision boundary [24].”
BackgroundRELATIONS BETWEEN TWO SETS OF VARIATES
HOTELLING, H. (1936) · Biometrika · doi:10.1093/biomet/28.3-4.321 · Cited by 5,263
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207
Agrawal, R., & Srikant, R. (2002) · Proceedings of the Eleventh International Conference on Data Engineering · doi:10.1109/icde.1995.380415 · Cited by 5,155
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335388 · Cited by 4,149 · cited 3×
“0, which is similar to local density based methods [9].”
BackgroundInfluentialA TUTORIAL ON SUPPORT VECTOR MACHINES FOR PATTERN RECOGNITION, DATA MINING AND KNOWLEDGE DISCOVERY
Burger, C. J. C. (1998) · Cited by 3,313
Support Vector Method for Novelty Detection
Schölkopf, B., Williamson, R. C., Smola, A. J., Shawe-Taylor, J. S., & Platt, J. C. (1999) · Cited by 2,040
Efficient algorithms for mining outliers from large data sets
Ramaswamy, S., Rastogi, R., & Shim, K. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335437 · Cited by 1,860
Support vector domain description
Tax, D. M. J., & Duin, R. P. W. (1999) · Pattern Recognition Letters · doi:10.1016/s0167-8655(99)00087-2 · Cited by 1,614
Working Set Selection Using Second Order Information for Training Support Vector Machines
Fan, R.-E., Chen, P.-H., & Lin, C. (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1194907 · Cited by 1,403
Efficient algorithms for mining outliers from large data sets
Ramaswamy, S., Rastogi, R., & Shim, K. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335437 · Cited by 1,171 · cited 1×
“Here, global methods, for example the k-nearest neighbor [23, 2] and local methods exist.”
MethodPattern recognition using generalized portrait method
Vapnik, V. N. (1963) · Automation and Remote Control · Cited by 1,151
An improved training algorithm for support vector machines
Osuna, E., Freund, R., & Girosi, F. (2002) · Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop · doi:10.1109/nnsp.1997.622408 · Cited by 1,061
Discovering cluster-based local outliers
He, Z., Xu, X., & Deng, S. (2003) · Pattern Recognition Letters · doi:10.1016/s0167-8655(03)00003-5 · Cited by 1,055
YALE: rapid prototyping for complex data mining tasks
Mierswa, I., Wurst, M., Klinkenberg, R., Scholz, M., & Euler, T. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150531 · Cited by 1,010
LOCI: fast outlier detection using the local correlation integral
Papadimitriou, S., Kitagawa, H., Gibbons, P. B., & Faloutsos, C. (2004) · Proceedings 19th International Conference on Data Engineering (Cat. No.03CH37405) · doi:10.1109/icde.2003.1260802 · Cited by 846
Fast Outlier Detection in High Dimensional Spaces
Angiulli, F., & Pizzuti, C. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45681-3_2 · Cited by 836
Aggarwal, C. C. (2013) · Cited by 832
Intrusion detection using neural networks and support vector machines
Mukkamala, S., Janoski, G., & Sung, A. (2003) · Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290) · doi:10.1109/ijcnn.2002.1007774 · Cited by 814
Support vector machines for 3D object recognition
Pontil, M., & Verri, A. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.683777 · Cited by 812
Intrusion detection with unlabeled data using clustering
Portnoy, L. (2000) · doi:10.7916/d8mp5904 · Cited by 747
Outlier Detection Using Replicator Neural Networks
Hawkins, S., He, H., Williams, G., & Baxter, R. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-46145-0_17 · Cited by 710
Beneš, J. (1990) · Czech digital mathematics library · Cited by 649
ROCK: a robust clustering algorithm for categorical attributes
Guha, S., Rastogi, R., & Shim, K. (1999) · Proceedings 15th International Conference on Data Engineering (Cat. No.99CB36337) · doi:10.1109/icde.1999.754967 · Cited by 609
Analysis of Multi-stage Convex Relaxation for Sparse Regularization
Zhang, T. (2010) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · doi:10.5555/1756006.1756041 · Cited by 597
Enhancing Effectiveness of Outlier Detections for Low Density Patterns
Tang, J., Chen, Z., Fu, A. W.-C., & Cheung, D. W. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47887-6_53 · Cited by 552
LoOP: local outlier probabilities
Kriegel, H.-P., Kröger, P., Schubert, E., & Zimek, A. (2009) · Proceedings of the 18th ACM conference on Information and knowledge management · doi:10.1145/1645953.1646195 · Cited by 492
Histogram-based Outlier Score (HBOS): A fast Unsupervised Anomaly Detection Algorithm
Goldstein, M., & Dengel, A. R. (2012) · Cited by 449
Self-citationRanking Outliers Using Symmetric Neighborhood Relationship
Jin, W., Tung, A. K. H., Han, J., & Wang, W. (2006) · Lecture Notes in Computer Science · doi:10.1007/11731139_68 · Cited by 415
The Concave-Convex Procedure (CCCP)
Yuille, A., & Rangarajan, A. (2001) · Cited by 397
Determination of the spread parameter in the Gaussian kernel for classification and regression
Wang, W., Xu, Z., Lu, W., & Zhang, X. (2003) · Neurocomputing · doi:10.1016/s0925-2312(02)00632-x · Cited by 390
Robust Truncated Hinge Loss Support Vector Machines
Wu, Y., & Liu, Y. (2007) · Journal of the American Statistical Association · doi:10.1198/016214507000000617 · Cited by 375
Learning object motion patterns for anomaly detection and improved object detection
Basharat, A., Gritai, A., & Shah, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587510 · Cited by 373
(2019) · Communications in Computer and Information Science · doi:10.1007/978-981-13-9361-7 · Cited by 222
Robust support vector machine with bullet hole image classification
Song, Q., Hu, W., & Xie, W. (2002) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2002.807277 · Cited by 208
Machine learning techniques in disease forecasting: a case study on rice blast prediction
Kaundal, R., Kapoor, A. S., & Raghava, G. P. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-485 · Cited by 203
Outlier ensembles: position paper
Aggarwal, C. C. (2013) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2481244.2481252 · Cited by 192
Robust support vector machine training via convex outlier ablation
Xu, L., Crammer, K., & Schuurmans, D. (2006) · Cited by 147
Approximations to Magic: Finding Unusual Medical Time Series
Lin, J., Keogh, E., Fu, A. W.-C., & Herle, H. M.-L. V. (2005) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2005.34 · Cited by 140
Phonetic Speaker Recognition with Support Vector Machines
Campbell, W. M., Campbell, J. P., Reynolds, D. A., Jones, D. A., & Leek, T. R. (2003) · Cited by 130
Leveraging the margin more carefully
Krause, N., & Singer, Y. (2004) · International Conference on Machine Learning · doi:10.1145/1015330.1015344 · Cited by 86
Intrusion Detection in Unlabeled Data with Quarter-sphere Support Vector Machines
Laskov, P., Schäfer, C., Kotenko, I. V., & Müller, K. R. (2004) · PIK - Praxis der Informationsverarbeitung und Kommunikation · doi:10.1515/piko.2004.228 · Cited by 78
Some Properties of the Gaussian Kernel for One Class Learning
Evangelista, P. F., Embrechts, M. J., & Szymanski, B. K. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74690-4_28 · Cited by 71
Intrusion detection in unlabeled data with quarter-sphere Support Vector Machines
Kotenko, I. V., Laskov, P., & Schäfer, C. (2004) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-15912 · Cited by 66
Anomaly detection by combining decision trees and parametric densities
Reif, M., Goldstein, M., Stahl, A., & Breuel, T. M. (2008) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2008.4761796 · Cited by 39
Self-citationMinimum Enclosing and Maximum Excluding Machine for Pattern Description and Discrimination
Liu, Y., & Zheng, Y. F. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.799 · Cited by 31
An accelerated decomposition algorithm for robust support vector Machines
Hu, W. J., & Song, Q. (2004) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2004.824044 · Cited by 23
The unbalanced classification problem: detecting breaches in security
Embrechts, M. J., Szymanski, B. K., & Evangelista, P. F. (2006) · Cited by 9
Integrating outlier filtering in large margin training
Zhou, X.-C., Shen, H.-B., & Ye, J.-P. (2011) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/jzus.c1000361 · Cited by 7
Research works printed but not linked: 9
- Amer Mennatallah, 2012, Proc. of the 3rd RapidMiner Community Meeting and Conference (RCOMM 2012, 1
- 10.5555/1776814.1776844 · doi:10.5555/1776814.1776844
- 10.5555/646111.679466 · doi:10.5555/646111.679466
- Papadimitriou Spiros, 2003, Int. Conf. on, 0: 315
- Portnoy Leonid, 2001, In Proc. of ACM CSS Workshop on Data Mining Applied to Security (DMSA-2001), 5
- Schölkopf Bernhard, 1999, Advances in Neural Information Processing Systems 12, (NIPS) Conf., 582
- 10.1109/ICDAR.2011.66 · DOI
- Xu Linli, 2006, Proc. of the National Conf. On Artificial Intelligence, 536
- Yuille Alan, 2002, Advances in Neural Information Processing Systems 14
Cited by
A Comparative Evaluation of Unsupervised Anomaly Detection Algorithms for Multivariate Data
Goldstein, M., & Uchida, S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0152173 · Cited by 1,032
Self-citationMachine Learning for Anomaly Detection: A Systematic Review
Nassif, A. B., Talib, M. A., Nasir, Q., & Dakalbab, F. M. (2021) · IEEE Access · doi:10.1109/access.2021.3083060 · Cited by 748
DeepAnT: A Deep Learning Approach for Unsupervised Anomaly Detection in Time Series
Munir, M., Siddiqui, S. A., Dengel, A., & Ahmed, S. (2019) · IEEE Access · doi:10.1109/access.2018.2886457 · Cited by 696
A comprehensive survey on network anomaly detection
Fernandes, G., Rodrigues, J. J. P. C., Carvalho, L. F., Al-Muhtadi, J. F., & Proença, M. L. (2019) · Telecommunication Systems · doi:10.1007/s11235-018-0475-8 · Cited by 382
Big data analytics for preventive medicine
Razzak, M. I., Imran, M., & Xu, G. (2020) · Neural Computing and Applications · doi:10.1007/s00521-019-04095-y · Cited by 327
Metadata
- Authors
- Amer, M., Goldstein, M., & Abdennadher, S.
- Venue
- Proceedings of the ACM SIGKDD Workshop on Outlier Detection and Description
- Publisher
- ACM
- Published
- 2013-08-11
- Pages
- 8-15
- OpenAlex
- W2134490011
- Cited by
- 427
- References
- 60
- FWCI
- 10.19
- Type
- conference paper
- Language
- en
- Open access
- closed
- Funders
- Stiftung Rheinland-Pfalz für Innovation (961-38 6261/1039)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.