Building an Intrusion Detection System Using a Filter-Based Feature Selection Algorithm
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Redundant and irrelevant features in data have caused a long-term problem in network traffic classification. These features not only slow down the process of classification but also prevent a classifier from making accurate decisions, especially when coping with big data. In this paper, we propose a mutual information based algorithm that analytically selects the optimal feature for classification. This mutual information based feature selection algorithm can handle linearly and nonlinearly dependent data features. Its effectiveness is evaluated in the cases of network intrusion detection. An Intrusion Detection System (IDS), named Least Square Support Vector Machine based IDS (LSSVM-IDS), is built using the features selected by our proposed feature selection algorithm. The performance of LSSVM-IDS is evaluated using three intrusion detection evaluation datasets, namely KDD Cup 99, NSL-KDD and Kyoto 2006+ dataset. The evaluation results show that our feature selection algorithm contributes more critical features for LSSVM-IDS to achieve better accuracy and lower computational cost compared with the state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
Extreme Learning Machine for Regression and Multiclass Classification
Huang, G.-B., Zhou, H., Ding, X., & Zhang, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2168604 · Cited by 5,550
A detailed analysis of the KDD CUP 99 data set
Tavallaee, M., Bagheri, E., Lu, W., & Ghorbani, A. A. (2009) · 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications · doi:10.1109/cisda.2009.5356528 · Cited by 5,396
A Practical Guide to Support Vector Classication
Hsu, C., Chang, C.-C., & Lin, C. (2008) · Cited by 5,083
Kraskov, A., Stögbauer, H., & Grassberger, P. (2004) · Physical Review E · doi:10.1103/physreve.69.066138 · Cited by 3,512
Elements of Information Theory
Nalewajski, R. F. (2011) · Perspectives in Electronic Structure Theory · doi:10.1007/978-3-642-20180-6_8 · Cited by 2,309
Using mutual information for selecting features in supervised neural net learning
Battiti, R. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.298224 · Cited by 2,148
In Defense of One-Vs-All Classification
Rifkin, R. M., & Klautau, A. (2004) · Journal of Machine Learning Research · Cited by 2,056
Introduction to Statistical Pattern Recognition
(2011) · Statistical Pattern Recognition · doi:10.1002/9781119952954.ch1 · Cited by 1,597
Normalized Mutual Information Feature Selection
Estevez, P. A., Tesmer, M., Perez, C. A., & Zurada, J. M. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005601 · Cited by 1,288
Intrusion detection by machine learning: A review
Tsai, C.-F., Hsu, Y.-F., Lin, C.-Y., & Lin, W.-Y. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.05.029 · Cited by 969 · cited 2×
“[43], the majority of the IDS experiments were performed on the KDD Cup 99 datasets.”
BackgroundMethodInput feature selection for classification problems
Kwak, N., & Choi, C.-H. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.977291 · Cited by 938
Lin, S.-W., Ying, K.-C., Chen, S.-C., & Lee, Z.-J. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.08.088 · Cited by 895
In Defense of One-Vs-All Classification
RifkinRyan, & KlautauAldebaro (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1005336 · Cited by 891
Cost-based modeling for fraud and intrusion detection: results from the JAM project
Stolfo, S. J., Fan, W., Lee, W., Prodromidis, A., & Chan, P. K. (2002) · Proceedings DARPA Information Survivability Conference and Exposition. DISCEX'00 · doi:10.1109/discex.2000.821515 · Cited by 610
Feature deduction and ensemble design of intrusion detection systems
Chebrolu, S., Abraham, A., & Thomas, J. P. (2005) · Computers & Security · doi:10.1016/j.cose.2004.09.008 · Cited by 604
A novel hybrid intrusion detection method integrating anomaly detection with misuse detection
Kim, G., Lee, S., & Kim, S. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.08.066 · Cited by 589
Estimation of mutual information using kernel density estimators
Moon, Y.-I., Rajagopalan, B., & Lall, U. (1995) · Physical Review E · doi:10.1103/physreve.52.2318 · Cited by 483
Intrusion Detection using Naive Bayes Classifier with Feature Reduction
Mukherjee, S., & Sharma, N. (2012) · Procedia Technology · doi:10.1016/j.protcy.2012.05.017 · Cited by 473
Mutual information-based feature selection for intrusion detection systems
Amiri, F., Rezaei Yousefi, M., Lucas, C., Shakery, A., & Yazdani, N. (2011) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2011.01.002 · Cited by 471
A novel intrusion detection system based on hierarchical clustering and support vector machines
Horng, S.-J., Su, M.-Y., Chen, Y.-H., Kao, T.-W., Chen, R.-J., Lai, J.-L., & Perkasa, C. D. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.06.066 · Cited by 460
Intrusion detection using an ensemble of intelligent paradigms
Mukkamala, S., Sung, A. H., & Abraham, A. (2005) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2004.01.003 · Cited by 368
Search Engines: Information Retrieval in Practice
Levene, M. (2011) · The Computer Journal · doi:10.1093/comjnl/bxq039 · Cited by 345
Statistical analysis of honeypot data and building of Kyoto 2006+ dataset for NIDS evaluation
Song, J., Takakura, H., Okabe, Y., Eto, M., Inoue, D., & Nakao, K. (2011) · Proceedings of the First Workshop on Building Analysis Datasets and Gathering Experience Returns for Security · doi:10.1145/1978672.1978676 · Cited by 334
Lin, S.-W., Lee, Z.-J., Chen, S.-C., & Tseng, T.-Y. (2008) · Applied Soft Computing · doi:10.1016/j.asoc.2007.10.012 · Cited by 334
Estimating the errors on measured entropy and mutual information
Roulston, M. S. (1999) · Physica D: Nonlinear Phenomena · doi:10.1016/s0167-2789(98)00269-3 · Cited by 281
Toosi, A. N., & Kahani, M. (2007) · Computer Communications · doi:10.1016/j.comcom.2007.05.002 · Cited by 224
Mutual information for the selection of relevant variables in spectrometric nonlinear modelling
Rossi, F., Lendasse, A., François, D., Wertz, V., & Verleysen, M. (2006) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2005.06.010 · Cited by 220
Tsang, C.-H., Kwong, S., & Wang, H. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.12.009 · Cited by 219
Winning the KDD99 classification cup: bagged boosting
Pfahringer, B. (2000) · ACM SIGKDD Explorations Newsletter · doi:10.1145/846183.846200 · Cited by 216
Hybrid Intelligent Intrusion Detection Scheme
Salama, M. A., Eid, H. F., Ramadan, R. A., Darwish, A., & Hassanien, A. E. (2011) · Advances in Intelligent and Soft Computing · doi:10.1007/978-3-642-20505-7_26 · Cited by 196
KDD-99 classifier learning contest LLSoft's results overview
Levin, I. (2000) · ACM SIGKDD Explorations Newsletter · doi:10.1145/846183.846201 · Cited by 182
Estimating Optimal Feature Subsets Using Efficient Estimation of High-Dimensional Mutual Information
Chow, T. W. S., & Huang, D. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.841414 · Cited by 163
D-SCIDS: Distributed soft computing intrusion detection system
Abraham, A., Jain, R., Thomas, J. P., & Han, S. Y. (2005) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2005.06.001 · Cited by 162
Network-Based Intrusion Detection with Support Vector Machines
Kim, D. S., & Park, J. S. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-45235-5_73 · Cited by 159
Detection of Denial-of-Service Attacks Based on Computer Vision Techniques
Tan, Z., Jamdagni, A., He, X., Nanda, P., Liu, R. P., & Hu, J. (2015) · IEEE Transactions on Computers · doi:10.1109/tc.2014.2375218 · Cited by 158
Self-citationAgarwal, R., & Joshi, M. V. (2001) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972719.29 · Cited by 141
Packet and Flow Based Network Intrusion Dataset
Gogoi, P., Bhuyan, M. H., Bhattacharyya, D. K., & Kalita, J. K. (2012) · Communications in computer and information science · doi:10.1007/978-3-642-32129-0_34 · Cited by 132
Feature selection and classification using flexible neural tree
Chen, Y., Abraham, A., & Yang, B. (2006) · Neurocomputing · doi:10.1016/j.neucom.2006.01.022 · Cited by 115
Discriminative multinomial Naïve Bayes for network intrusion detection
Panda, M., Abraham, A., & Patra, M. R. (2010) · International Conference on Information Assurance and Security (IAS) · doi:10.1109/isias.2010.5604193 · Cited by 112
Linear Correlation-Based Feature Selection for Network Intrusion Detection Model
Eid, H. F., Hassanien, A. E., Kim, T.-H., & Banerjee, S. (2013) · Communications in computer and information science · doi:10.1007/978-3-642-40597-6_21 · Cited by 95
Selection of Candidate Support Vectors in incremental SVM for network intrusion detection
Chitrakar, R., & Huang, C. (2014) · Computers & Security · doi:10.1016/j.cose.2014.06.006 · Cited by 90
Traffic-Aware Design of a High-Speed FPGA Network Intrusion Detection System
Pontarelli, S., Bianchi, G., & Teofili, S. (2012) · IEEE Transactions on Computers · doi:10.1109/tc.2012.105 · Cited by 88
de la Hoz, E., Ortíz, A., Ortega, J., & De-La-Hoz-Franco, E. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40846-5_11 · Cited by 52
Mutual information based input feature selection for classification problems
Cang, S., & Yu, H. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.08.014 · Cited by 49
Unsupervised Feature Selection Method for Intrusion Detection System
Ambusaidi, M. A., He, X., & Nanda, P. (2015) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom.2015.387 · Cited by 33
Self-citationBi-Layer Behavioral-Based Feature Selection Approach for Network Intrusion Classification
Eid, H. F., Salama, M. A., Hassanien, A. E., & Kim, T.-H. (2011) · Communications in computer and information science · doi:10.1007/978-3-642-27189-2_21 · Cited by 30
An Effective Technique for Intrusion Detection Using Neuro-Fuzzy and Radial SVM Classifier
Chandrasekhar, A. M., & Raghuveer, K. (2013) · Lecture notes in electrical engineering · doi:10.1007/978-1-4614-6154-8_49 · Cited by 24
Cited by
Network Intrusion Detection for IoT Security Based on Learning Techniques
Chaabouni, N., Mosbah, M., Zemmari, A., Sauvignac, C., & Faruki, P. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2896380 · Cited by 940
A Detailed Investigation and Analysis of Using Machine Learning Techniques for Intrusion Detection
Mishra, P., Varadharajan, V., Tupakula, U., & Pilli, E. S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2847722 · Cited by 738
A Review of Feature Selection and Its Methods
Venkatesh, B., & Anuradha, J. (2019) · Cybernetics and Information Technologies · doi:10.2478/cait-2019-0001 · Cited by 631
Kasongo, S. M., & Sun, Y. (2020) · Journal of Big Data · doi:10.1186/s40537-020-00379-6 · Cited by 570
An Adaptive Ensemble Machine Learning Model for Intrusion Detection
Gao, X., Shan, C., Hu, C., Niu, Z., & Liu, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2923640 · Cited by 516
Metadata
- Authors
- Ambusaidi, M. A., He, X., Nanda, P., & Tan, Z.
- Venue
- IEEE Transactions on Computers
- Published
- 2016-10-01
- Volume
- 65
- Issue
- 10
- Pages
- 2986-2998
- ISSN
- 0018-9340 (ISSN-L)
- OpenAlex
- W2267339884
- Cited by
- 646
- References
- 49
- FWCI
- 51.48
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.