Isolation-based feature Selection for Unsupervised Outlier Detection
Open accessAbstract
For high-dimensional datasets, bad features and complex interactions between features can cause high computational costs and make outlier detection algorithms inefficient. Most feature selection methods are designed for supervised classification and regression, and limited works are specifically for unsupervised outlier detection. This paper proposes a novel isolation-based feature selection (IBFS) method for unsupervised outlier detection. It is based on the training process of isolation forest. When a point of a feature is used to split the data, the imbalanced distribution of split data is measured and used to quantify how strong this feature can detect outliers. We also compare the proposed method with variance, Laplacian score and kurtosis. These methods are benchmarked on simulated data to show their characteristics. Then we evaluate the performance using one-class support vector machine, isolation forest and local outlier factor on several real-word datasets. The evaluation results show that the proposed method can improve the performance of isolation forest, and its results are similar to and sometimes better than another useful outlier indicator: kurtosis, which demonstrate the effectiveness of the proposed method. We also notice that sometimes variance and Laplacian score has similar performance on the datasets.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486 · see citing works
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 49,574 · see citing works
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439 · see citing works
Isolation-Based Anomaly Detection
Liu, F. T., Ting, K. M., & Zhou, Z. (2012) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/2133360.2133363 · Cited by 2,112 · see citing works
Laplacian Score for Feature Selection
He, X., Cai, D., & Niyogi, P. (2005) · Cited by 1,763 · see citing works
Spectral feature selection for supervised and unsupervised learning
Zhao, Z., & Liu, H. (2007) · International Conference on Machine Learning · doi:10.1145/1273496.1273641 · Cited by 954 · see citing works
Feature Selection: A Data PerspectivePreprint
Li, J., Cheng, K., Wang, S., Morstatter, F., Treviño, R. P., Tang, J., & Liu, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.07996 · Cited by 891 · see citing works
Outliers detection and treatment: a review.
Cousineau, D., & Chartier, S. (2010) · International journal of psychological research · doi:10.21500/20112084.844 · Cited by 703 · see citing works
Constraint Score: A new filter method for feature selection with pairwise constraints
Zhang, D., Chen, S., & Zhou, Z. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2007.10.009 · Cited by 212 · see citing works
Feature Selection Library (MATLAB Toolbox)Preprint
Roffo, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.01327 · Cited by 58 · see citing works
Outlier detection in complex categorical data by modelling the feature value couplings
Pang, G., Cao, L., & Chen, L. (2016) · OPUS - Open Publications of UTS Scholars (University of Technology Sydney) · Cited by 54 · see citing works
Pang, G., Cao, L., Chen, L., & Liu, H. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/360 · Cited by 45 · see citing works
Pang, G., Cao, L., Chen, L., & Liu, H. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0052 · Cited by 43 · see citing works
Unsupervised Feature Selection Method for Intrusion Detection System
Ambusaidi, M. A., He, X., & Nanda, P. (2015) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications / BigDataSE / ISPA (Trustcom/BigDataSE/ISPA) · doi:10.1109/trustcom.2015.387 · Cited by 22 · see citing works
Outlier detection in complex categorical data by modeling the feature value couplings
Pang, G., Cao, L., & CHEN, L. (2016) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 12 · see citing works
Flagged first, then by citations
2 of the 17 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Liu, F. T., Ting, K. M., & Zhou, Z. H. (2008, December). Isolation forest. In 2008 Eighth IEEE International Conference on Data Mining (pp. 413-422). IEEE.
- Westfall, P. H. (2014). Kurtosis as peakedness, 1905-2014. RIP. The American Statistician, 68(3), 191-195.
Cited by
Sorted by citations
Intelligent Maintenance Systems and Predictive Manufacturing
Lee, J., Ni, J., Singh, J., Jiang, B., Azamfar, M., & Feng, J. (2020) · Journal of Manufacturing Science and Engineering · doi:10.1115/1.4047856 · Cited by 263 · see citing works
Self-citationA Survey on Explainable Anomaly Detection
Li, Z., Zhu, Y., & Van Leeuwen, M. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3609333 · Cited by 139 · see citing works
“The isolation forest based feature selection method, IBFS [218], simply selects features that contribute the most to the outlyingness of anomalies reported by the Isolation Forest method.”
MethodAn Ensemble Learning Based Intrusion Detection Model for Industrial IoT Security
Mohy-eddine, M., Guezzaz, A., Benkirane, S., Azrour, M., & Farhaoui, Y. (2023) · Big Data Mining and Analytics · doi:10.26599/bdma.2022.9020032 · Cited by 139 · see citing works
An effective intrusion detection approach based on ensemble learning for IIoT edge computing
Mohy-eddine, M., Guezzaz, A., Benkirane, S., & Azrour, M. (2022) · Journal of Computer Virology and Hacking Techniques · doi:10.1007/s11416-022-00456-9 · Cited by 88 · see citing works
On the Improvement of the Isolation Forest Algorithm for Outlier Detection with Streaming Data
Heigl, M., Anand, K., Urmann, A., Fiala, D., Schramm, M., & Hable, R. (2021) · Electronics · doi:10.3390/electronics10131534 · Cited by 68 · see citing works
A Review of Tree-Based Approaches for Anomaly Detection
Barbariol, T., Chiara, F. D., Marcato, D., & Susto, G. A. (2021) · Springer series in reliability engineering · doi:10.1007/978-3-030-83819-5_7 · Cited by 44 · see citing works
Nia, S. A. G., Shahbeik, H., Shafizadeh, A., Rafiee, S., Hosseinzadeh-Bandbafha, H., Kiehbadroudinezhad, M., Tajuddin, S. A. F. S. A., Tabatabaei, M., & Aghbashlo, M. (2024) · Energy Conversion and Management · doi:10.1016/j.enconman.2024.119373 · Cited by 31 · see citing works
Isolation Forest Based on Minimal Spanning Tree
Gałka, Ł., Karczmarek, P., & Tokovarov, M. (2022) · IEEE Access · doi:10.1109/access.2022.3190505 · Cited by 28 · see citing works
Outlier Detection Based Feature Selection Exploiting Bio-Inspired Optimization Algorithms
Larabi-Marie-Sainte, S. (2021) · Applied Sciences · doi:10.3390/app11156769 · Cited by 16 · see citing works
Unsupervised Feature Selection for Outlier Detection on Streaming Data to Enhance Network Security
Heigl, M., Weigelt, E., Fiala, D., & Schramm, M. (2021) · Applied Sciences · doi:10.3390/app112412073 · Cited by 15 · see citing works
Shukla, A. K., Srivastav, S., Kumar, S., & Muhuri, P. K. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.105848 · Cited by 15 · see citing works
Deterministic attribute selection for isolation forest
Gałka, Ł., & Karczmarek, P. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110395 · Cited by 12 · see citing works
Gałka, Ł., & Karczmarek, P. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110935 · Cited by 10 · see citing works
Wang, L., & Ke, Y. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110678 · Cited by 8 · see citing works
Rough set-inspired isolation forest
Rachwał, A., Karczmarek, P., & Rachwał, A. (2025) · Information Sciences · doi:10.1016/j.ins.2025.122390 · Cited by 4 · see citing works
AcME-AD: Accelerated Model Explanations for Anomaly Detection
Zaccaria, V., Dandolo, D., Masiero, C., & Susto, G. A. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63803-9_24 · Cited by 3 · see citing works
Ensemble IDO Method for Outlier Detection and N2O Emission Prediction in Agriculture
Muslikh, A. R., Andono, P. N., Marjuni, A., & Santoso, H. A. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.0150737 · Cited by 3 · see citing works
Performance Enhancement of Intrusion Detection System in Cloud by Using Boruta Algorithm
Lifandali, O., Chiba, Z., Abghour, N., Moussaid, K., Miyara, M., & Ouaguid, A. (2025) · ACM Transactions on Privacy and Security · doi:10.1145/3736761 · Cited by 2 · see citing works
Improved Isolated Forest Algorithm and Application
Wang, S., Zhou, Z., & Haining, T. (2025) · International Symposium on Computer Technology and Information Science (ISCTIS) · doi:10.1109/isctis65944.2025.11064997
- Authors
- Yang, Q., Singh, J., & Lee, J.
- Affiliations
- University of Cincinnati (US)
- Venue
- Annual Conference of the PHM Society
- Publisher
- PHM Society
- Published
- 2019-09-22
- Volume
- 11
- Issue
- 1
- ISSN
- 2325-0178 (ISSN-L)
- OpenAlex
- W2975945901
- Cited by
- 19
- References
- 17
- Citations by year
- 2025: 3 · 2024: 4 · 2023: 5 · 2022: 2 · 2021: 4 · 2020: 1
- FWCI
- 0.67
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Annual Conference of the PHM Society (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- unsupervised anomaly detection, Isolation Forest, feature selection, high-dimensional data, kurtosis, Laplacian score, variance, one-class support vector machine, local outlier factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
