Angle-based outlier detection in high-dimensional data
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Detecting outliers in a large set of data objects is a major data mining task aiming at finding different mechanisms responsible for different groups of objects in a data set. All existing approaches, however, are based on an assessment of distances (sometimes indirectly by assuming certain distributions) in the full-dimensional Euclidean data space. In high-dimensional data, these approaches are bound to deteriorate due to the notorious "curse of dimensionality". In this paper, we propose a novel approach named ABOD (Angle-Based Outlier Detection) and some variants assessing the variance in the angles between the difference vectors of a point to the other points. This way, the effects of the "curse of dimensionality" are alleviated compared to purely distance-based approaches. A main advantage of our new approach is that our method does not rely on any parameter selection influencing the quality of the achieved ranking. In a thorough experimental evaluation, we compare ABOD to the well-established distance-based method LOF for various artificial and a real world data set and show ABOD to perform especially well on high-dimensional data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
David, F. N., & Tukey, J. W. (1977) · Biometrics · doi:10.2307/2529486 · Cited by 12,708
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207
Self-citationLOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335388 · Cited by 4,149
Self-citationHawkins, D. M. (1980) · doi:10.1007/978-94-015-3994-4 · Cited by 2,982
Barnett, V., Lewis, T., & Abeles, F. (1979) · Physics Today · doi:10.1063/1.2995737 · Cited by 2,824
A Fast Algorithm for the Minimum Covariance Determinant Estimator
Rousseeuw, P. J., & Driessen, K. V. (1999) · Technometrics · doi:10.1080/00401706.1999.10485670 · Cited by 2,708
Fei-Fei, L., Fergus, R., & Perona, P. (2005) · 2004 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvpr.2004.383 · Cited by 2,502
When Is ''Nearest Neighbor'' Meaningful?
Beyer, K., Goldstein, J., Ramakrishnan, R., & Shaft, U. (1999) · Lecture Notes in Computer Science · doi:10.1007/3-540-49257-7_15 · Cited by 2,403
Tukey, J. W. (1977) · International Linear Collider · Cited by 2,155
Cited by
MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks
Li, D., Chen, D., Jin, B., Shi, L., Goh, J., & Ng, S.-K. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30490-4_56 · Cited by 1,185
Hierarchical Density Estimates for Data Clustering, Visualization, and Outlier Detection
Campello, R. J. G. B., Moulavi, D., Zimek, A., & Sander, J. (2015) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/2733381 · Cited by 915
“Recent global approaches base the decision not on Euclidean distances but on anglevariance (ABOD [Kriegel et al. 2008] and an efficient variant using random projections [Pham and Pagh 2012]).”
MethodSelf-citationA survey on unsupervised outlier detection in high‐dimensional numerical data
Zimek, A., Schubert, E., & Kriegel, H. (2012) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11161 · Cited by 864
Self-citationOn the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study
Campos, G. O., Zimek, A., Sander, J., Campello, R. J. G. B., Micenková, B., Schubert, E., Assent, I., & Houle, M. E. (2016) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-015-0444-8 · Cited by 735
Self-citationA Review on Soft Sensors for Monitoring, Control, and Optimization of Industrial Processes
Jiang, Y., Yin, S., Dong, J., & Kaynak, O. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3033153 · Cited by 667
ECOD: Unsupervised Outlier Detection Using Empirical Cumulative Distribution Functions
Li, Z., Zhao, Y., Hu, X., Botta, N., Ionescu, C., & Chen, G. H. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3159580 · Cited by 494
LoOP: local outlier probabilities
Kriegel, H.-P., Kröger, P., Schubert, E., & Zimek, A. (2009) · Proceedings of the 18th ACM conference on Information and knowledge management · doi:10.1145/1645953.1646195 · Cited by 492
Self-citationA comparative evaluation of outlier detection algorithms: Experiments and analyses
Domingues, R., Filippone, M., Michiardi, P., & Zouaoui, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.09.037 · Cited by 452
A critical overview of outlier detection methods
Smiti, A. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100306 · Cited by 427
A New Local Distance-Based Outlier Detection Approach for Scattered Real-World Data
Zhang, K., Hutter, M., & Jin, H. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01307-2_84 · Cited by 392
HiCS: High Contrast Subspaces for Density-Based Outlier Ranking
Keller, F., Muller, E., & Bohm, K. (2012) · 2012 IEEE 28th International Conference on Data Engineering · doi:10.1109/icde.2012.88 · Cited by 373
Loda: Lightweight on-line detector of anomalies
Pevný, T. (2016) · Machine Learning · doi:10.1007/s10994-015-5521-0 · Cited by 357
Brito, L. C., Susto, G. A., Brito, J. N., & Duarte, M. A. V. (2022) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2021.108105 · Cited by 343
Outlier Detection: Methods, Models, and Classification
Boukerche, A., Zheng, L., & Alfandi, O. (2021) · ACM Computing Surveys · doi:10.1145/3381028 · Cited by 334
Outlier Detection in Axis-Parallel Subspaces of High Dimensional Data
Kriegel, H.-P., Kröger, P., Schubert, E., & Zimek, A. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01307-2_86 · Cited by 314
Self-citationUnsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals
Zhang, Y., Chen, Y., Wang, J., & Pan, Z. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3102110 · Cited by 312
Zhu, J., Ge, Z., Song, Z., & Gao, F. (2018) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2018.09.003 · Cited by 308
Schubert, E., Zimek, A., & Kriegel, H.-P. (2014) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-012-0300-z · Cited by 300
Self-citationEnsembles for unsupervised outlier detection: challenges and research questions a position paper
Zimek, A., Campello, R. J. G. B., & Sander, J. (2014) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2594473.2594476 · Cited by 278
Self-citationCan Shared-Neighbor Distances Defeat the Curse of Dimensionality?
Houle, M. E., Kriegel, H.-P., Kröger, P., Schubert, E., & Zimek, A. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-13818-8_34 · Cited by 268
Self-citationInterpreting and Unifying Outlier Scores
Kriegel, H.-P., Kroger, P., Schubert, E., & Zimek, A. (2011) · Proceedings of the 2011 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972818.2 · Cited by 266
Self-citationA Fast Adaptive k-means with No Bounds
Xia, S., Peng, D., Meng, D., Zhang, C., Wang, G., Giem, E., Wei, W., & Chen, Z. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008694 · Cited by 149
Statistical selection of relevant subspace projections for outlier ranking
Muller, E., Schiffer, M., & Seidl, T. (2011) · 2011 IEEE 27th International Conference on Data Engineering · doi:10.1109/icde.2011.5767916 · Cited by 126
Interpretable Anomaly Detection with DIFFI: Depth-based feature importance of Isolation Forest
Carletti, M., Terzi, M., & Susto, G. A. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105730 · Cited by 118
Explaining Outliers by Subspace Separability
Micenkova, B., Ng, R. T., Dang, X.-H., & Assent, I. (2013) · 2013 IEEE 13th International Conference on Data Mining · doi:10.1109/icdm.2013.132 · Cited by 104
“Density-based approaches (e.g. Local Outlier Factor—LOF [8]) measure the density of an object compared to the density in its neighborhood.”
BackgroundDiscovering outlying aspects in large datasets
Vinh, N. X., Chan, J., Romano, S., Bailey, J., Leckie, C., Ramamohanarao, K., & Pei, J. (2016) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-016-0453-2 · Cited by 83
Mining outlying aspects on numeric data
Duan, L., Tang, G., Pei, J., Bailey, J., Campbell, A., & Tang, C. (2015) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-014-0398-2 · Cited by 70
Pang, G., Cao, L., Chen, L., Lian, D., & Liu, H. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11692 · Cited by 59
How to Address the Data Quality Issues in Regression Models: A Guided Process for Data Cleaning
Corrales, D., Corrales, J., & Ledezma, A. (2018) · Symmetry · doi:10.3390/sym10040099 · Cited by 58
Local Outlier Detection with Interpretation
Dang, X. H., Micenková, B., Assent, I., & Ng, R. T. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40994-3_20 · Cited by 56
Yepmo, V., Smits, G., & Pivert, O. (2022) · Data & Knowledge Engineering · doi:10.1016/j.datak.2021.101946 · Cited by 52
“Angle-Based Outlier Detection (ABOD) [56] is an unsupervised anomaly detection method providing explanations.”
Outlying property detection with numerical attributes
Angiulli, F., Fassetti, F., Manco, G., & Palopoli, L. (2017) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-016-0458-x · Cited by 33
“[6,7,17,28,42]), where the outliers are modeled as data points which poorly fit the underlying data distribution; linear models, (e.”
BackgroundExplainable outlier detection: What, for Whom and Why?
Sejr, J. H., & Schneider-Kamp, A. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100172 · Cited by 32
One-Class Learning for AI-Generated Essay Detection
Corizzo, R., & Leal-Arenas, S. (2023) · Applied Sciences · doi:10.3390/app13137901 · Cited by 16
Prediction-based outlier detection with explanations
Chen, L.-C., Kuo, T.-T., Lai, W.-C., Lin, S.-D., & Tsai, C.-H. (2012) · 2012 IEEE International Conference on Granular Computing · doi:10.1109/grc.2012.6468672 · Cited by 2
“Studies of outlier detection can generally be divided into three categories: distributionbased [1][25], cluster-based [5][6][8][14], and distancebased [2][9][10][11][19] approaches.”
Background
Metadata
- Authors
- Kriegel, H.-P., Schubert, M., & Zimek, A.
- Venue
- Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining
- Publisher
- ACM
- Published
- 2008-08-24
- Pages
- 444-452
- OpenAlex
- W1986332411
- Cited by
- 828
- References
- 41
- FWCI
- 6.70
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.