The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
CICIDS-2017 Dataset Feature Analysis With Information Gain for Anomaly Detection
Open accessAbstract
Feature selection (FS) is one of the important tasks of data preprocessing in data analytics. The data with a large number of features will affect the computational complexity, increase a huge amount of resource usage and time consumption for data analytics. The objective of this study is to analyze relevant and significant features of huge network traffic to be used to improve the accuracy of traffic anomaly detection and to decrease its execution time. Information Gain is the most feature selection technique used in Intrusion Detection System (IDS) research. This study uses Information Gain, ranking and grouping the features according to the minimum weight values to select relevant and significant features, and then implements Random Forest (RF), Bayes Net (BN), Random Tree (RT), Naive Bayes (NB) and J48 classifier algorithms in experiments on CICIDS-2017 dataset. The experiment results show that the number of relevant and significant features yielded by Information Gain affects significantly the improvement of detection accuracy and execution time. Specifically, the Random Forest algorithm has the highest accuracy of 99.86% using the relevant selected features of 22, whereas the J48 classifier algorithm provides an accuracy of 99.87% using 52 relevant selected features with longer execution time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization
Sharafaldin, I., Habibi Lashkari, A., & Ghorbani, A. A. (2018) · Proceedings of the 4th International Conference on Information Systems Security and Privacy · doi:10.5220/0006639801080116 · Cited by 5,318
A survey on feature selection methods
Chandrashekar, G., & Sahin, F. (2014) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2013.11.024 · Cited by 5,189
A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection
Buczak, A. L., & Guven, E. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2494502 · Cited by 3,332
Random Forest Modeling for Network Intrusion Detection System
Farnaaz, N., & Jabbar, M. A. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.06.047 · Cited by 684
Aljawarneh, S., Aldwairi, M., & Yassein, M. B. (2018) · Journal of Computational Science · doi:10.1016/j.jocs.2017.03.006 · Cited by 682
Building an Intrusion Detection System Using a Filter-Based Feature Selection Algorithm
Ambusaidi, M. A., He, X., Nanda, P., & Tan, Z. (2016) · IEEE Transactions on Computers · doi:10.1109/tc.2016.2519914 · Cited by 646
A Survey on semi-supervised feature selection methods
Sheikhpour, R., Sarram, M. A., Gharaghani, S., & Chahooki, M. A. Z. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.11.003 · Cited by 505
Performance Evaluation of Supervised Machine Learning Algorithms for Intrusion Detection
Belavagi, M. C., & Muniyal, B. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.06.016 · Cited by 386
Eesa, A. S., Orman, Z., & Brifcani, A. M. A. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.11.009 · Cited by 376
Decision tree based light weight intrusion detection using a wrapper approach
Sivatha Sindhu, S. S., Geetha, S., & Kannan, A. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.06.013 · Cited by 327
A feature reduced intrusion detection system using ANN classifier
Akashdeep, Manzoor, I., & Kumar, N. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.07.005 · Cited by 276
Improving AdaBoost-based Intrusion Detection System (IDS) Performance on CIC IDS 2017 Dataset
Yulianto, A., Sukarno, P., & Suwastika, N. A. (2019) · Journal of Physics: Conference Series · doi:10.1088/1742-6596/1192/1/012018 · Cited by 270
An Improved Intrusion Detection Algorithm Based on GA and SVM
Tao, P., Sun, Z., & Sun, Z. (2018) · IEEE Access · doi:10.1109/access.2018.2810198 · Cited by 264
Network Anomaly Detection by Cascading K-Means Clustering and C4.5 Decision Tree algorithm
Muniyandi, A. P., Rajeswari, R., & Rajaram, R. (2012) · Procedia Engineering · doi:10.1016/j.proeng.2012.01.849 · Cited by 251
Feature selection and intrusion classification in NSL-KDD cup 99 dataset employing SVMs
Pervez, M. S., & Farid, D. M. (2014) · The 8th International Conference on Software, Knowledge, Information Management and Applications (SKIMA 2014) · doi:10.1109/skima.2014.7083539 · Cited by 218
An Entropy-Based Network Anomaly Detection Method
Bereziński, P., Jasiul, B., & Szpyrka, M. (2015) · Entropy · doi:10.3390/e17042367 · Cited by 204
Network Anomaly Detection: A Machine Learning Perspective
Bhattacharyya, D. K., & Kalita, J. K. (2013) · Cited by 187
Network intrusion detection system using J48 Decision Tree
Sahu, S., & Mehtre, B. M. (2015) · 2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI) · doi:10.1109/icacci.2015.7275914 · Cited by 181
Feature Selection Using Information Gain for Improved Structural-Based Alert Correlation
Alhaj, T. A., Siraj, M. M., Zainal, A., Elshoush, H. T., & Elhaj, F. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166017 · Cited by 172
Goeschel, K. (2016) · IEEE SoutheastCon · doi:10.1109/secon.2016.7506774 · Cited by 136
An Improved Feature Selection Algorithm Based on Ant Colony Optimization
Peng, H., Ying, C., Tan, S., Hu, B., & Sun, Z. (2018) · IEEE Access · doi:10.1109/access.2018.2879583 · Cited by 123
An enhanced J48 classification algorithm for the anomaly intrusion detection systems
Aljawarneh, S. A., Yassein, M. B., & Aljundi, M. (2017) · Cluster Computing · doi:10.1007/s10586-017-1109-8 · Cited by 112
Kang, S., & Kim, K. J. (2016) · Cluster Computing · doi:10.1007/s10586-015-0527-8 · Cited by 92
Host-based misuse intrusion detection using PCA feature extraction and kNN classification algorithms
Serpen, G., & Aghaei, E. (2018) · Intelligent Data Analysis · doi:10.3233/ida-173493 · Cited by 75
Intrusion detection model using fusion of PCA and optimized SVM
Thaseen, I. S., & Kumar, C. A. (2014) · International Conference on Contemporary Computing and Informatics (IC3I) · doi:10.1109/ic3i.2014.7019692 · Cited by 72
Anomaly detection using Support Vector Machine classification with k-Medoids clustering
Chitrakar, R., & Chuanhe, H. (2012) · Asian Himalayas International Conference on Internet · doi:10.1109/ahici.2012.6408446 · Cited by 69
Detecting anomalies from big network traffic data using an adaptive detection approach
Zhang, J., Li, H., Gao, Q., Wang, H., & Luo, Y. (2014) · Information Sciences · doi:10.1016/j.ins.2014.07.044 · Cited by 61
Chen, F., Ye, Z., Wang, C., Yan, L., & Wang, R. (2018) · International Symposium on Wireless Systems within the Conferences on Intelligent Data Acquisition and Advanced Computing Systems (IDAACS-SWS) · doi:10.1109/idaacs-sws.2018.8525522 · Cited by 60
Feature Ranking in Intrusion Detection Dataset using Combination of Filtering Methods
Karimi, Z., Kashani, M. M. R., & Harounabadi, A. (2013) · International Journal of Computer Applications · doi:10.5120/13478-1164 · Cited by 56
Hota, H. S., & Shrivas, A. K. (2014) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-07353-8_24 · Cited by 46
Shakya, S., & Sigdel, S. (2017) · International Conference on Computing, Communication and Automation · doi:10.1109/ccaa.2017.8229836 · Cited by 37
Effective Hybrid Intrusion Detection System: A Layered Approach
Tesfahun, A., & Bhaskari, D. L. (2015) · International Journal of Computer Network and Information Security · doi:10.5815/ijcnis.2015.03.05 · Cited by 35
SVM for network anomaly detection using ACO feature subset
Mehmood, T., & Rais, H. M. (2015) · International Symposium on Mathematical Sciences and Computing Research (iSMSC) · doi:10.1109/ismsc.2015.7594039 · Cited by 35
An Efficient Network Log Anomaly Detection System Using Random Projection Dimensionality Reduction
Juvonen, A., & Hämäläinen, T. (2014) · IFIP International Conference on New Technologies, Mobility and Security (NTMS) · doi:10.1109/ntms.2014.6814006 · Cited by 28
Bhattacharya, S., & Selvakumar, S. (2015) · The Computer Journal · doi:10.1093/comjnl/bxv078 · Cited by 23
K Nearest Neighbor Based Model for Intrusion Detection System
Nikhitha, M., & Jabbar, D. M. A. (2019) · International Journal of Recent Technology and Engineering (IJRTE) · doi:10.35940/ijrte.b2458.078219 · Cited by 22
Cited by
A Survey on Machine Learning Techniques for Cyber Security in the Last Decade
Shaukat, K., Luo, S., Varadharajan, V., Hameed, I. A., & Xu, M. (2020) · IEEE Access · doi:10.1109/access.2020.3041951 · Cited by 530
Maseer, Z. K., Yusof, R., Bahaman, N., Mostafa, S. A., & Foozy, C. F. M. (2021) · IEEE Access · doi:10.1109/access.2021.3056614 · Cited by 473
Troubleshooting an Intrusion Detection Dataset: the CICIDS2017 Case Study
Engelen, G., Rimmer, V., & Joosen, W. (2021) · 2021 IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw53761.2021.00009 · Cited by 398
Yin, Y., Jang-Jaccard, J., Xu, W., Singh, A., Zhu, J., Sabrina, F., & Kwak, J. (2023) · Journal of Big Data · doi:10.1186/s40537-023-00694-8 · Cited by 321
Talukder, M. A., Islam, M. M., Uddin, M. A., Hasan, K. F., Sharmin, S., Alyami, S. A., & Moni, M. A. (2024) · Journal of Big Data · doi:10.1186/s40537-024-00886-w · Cited by 300
Metadata
- Authors
- Kurniabudi, Stiawan, D., Darmawijoyo, Bin Idris, M. Y., Bamhdi, A. M., & Budiarto, R.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 132911-132921
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3043530913
- Cited by
- 453
- References
- 38
- FWCI
- 21.81
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.