The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Multi-Stage Optimized Machine Learning Framework for Network Intrusion Detection
Open accessAbstract
Cyber-security garnered significant attention due to the increased dependency of individuals and organizations on the Internet and their concern about the security and privacy of their online activities. Several previous machine learning (ML)-based network intrusion detection systems (NIDSs) have been developed to protect against malicious online behavior. This paper proposes a novel multi-stage optimized ML-based NIDS framework that reduces computational complexity while maintaining its detection performance. This work studies the impact of oversampling techniques on the models’ training sample size and determines the minimal suitable training sample size. Furthermore, it compares between two feature selection techniques, information gain and correlation-based, and explores their effect on detection performance and time complexity. Moreover, different ML hyper-parameter optimization techniques are investigated to enhance the NIDS’s performance. The performance of the proposed framework is evaluated using two recent intrusion detection datasets, the CICIDS 2017 and the UNSW-NB 2015 datasets. Experimental results show that the proposed model significantly reduces the required training sample size (up to 74%) and feature set size (up to 50%). Moreover, the model performance is enhanced with hyper-parameter optimization with detection accuracies over 99% for both datasets, outperforming recent literature works by 1-2% higher accuracy and 1-2% lower false alarm rate.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
An Introduction to Statistical Learning
James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013) · Springer Texts in Statistics · doi:10.1007/978-1-4614-7138-7 · Cited by 12,106
(2012) · Cited by 8,009
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization
Sharafaldin, I., Habibi Lashkari, A., & Ghorbani, A. A. (2018) · Proceedings of the 4th International Conference on Information Systems Security and Privacy · doi:10.5220/0006639801080116 · Cited by 5,318 · cited 7×
“For example, the CICIDS 2017 dataset contains the following attacks: Denial-of-Service (DoS), port scanning, brute-force, web-attacks, botnets, and infiltration [12].”
BackgroundMethodResultInfluentialMoustafa, N., & Slay, J. (2015) · 2015 Military Communications and Information Systems Conference (MilCIS) · doi:10.1109/milcis.2015.7348942 · Cited by 4,033
(1998) · Cited by 3,476
On hyperparameter optimization of machine learning algorithms: Theory and practice
Yang, L., & Shami, A. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.061 · Cited by 3,232
Self-citationFeature Selection: A Data Perspective
Li, J., Cheng, K., Wang, S., Morstatter, F., Trevino, R. P., Tang, J., & Liu, H. (2018) · ACM Computing Surveys · doi:10.1145/3136625 · Cited by 2,442
Brochu, E., Cora, V. M., & de Freitas, N. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.2599 · Cited by 2,011
Intrusion detection system: A comprehensive review
Liao, H.-J., Richard Lin, C.-H., Lin, Y.-C., & Tung, K.-Y. (2013) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2012.09.004 · Cited by 1,630
Feurer, M., & Hutter, F. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_1 · Cited by 1,414
Toward developing a systematic approach to generate benchmark datasets for intrusion detection
Shiravi, A., Shiravi, H., Tavallaee, M., & Ghorbani, A. A. (2012) · Computers & Security · doi:10.1016/j.cose.2011.12.012 · Cited by 1,345
Map-Reduce for Machine Learning on Multicore
Chu, C.-T., Kim, S. K., Lin, Y.-A., Yu, Y., Bradski, G., Ng, A. Y., & Olukotun, K. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0040 · Cited by 1,229
Intrusion detection by machine learning: A review
Tsai, C.-F., Hsu, Y.-F., Lin, C.-Y., & Lin, W.-Y. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.05.029 · Cited by 969
Lin, S.-W., Ying, K.-C., Chen, S.-C., & Lee, Z.-J. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.08.088 · Cited by 895
A social learning particle swarm optimization algorithm for scalable optimization
Cheng, R., & Jin, Y. (2015) · Information Sciences · doi:10.1016/j.ins.2014.08.039 · Cited by 747 · cited 1×
“Conversely, the complexity of the PSO algorithm is O ( N parm N pop ) where N pop is the population size, i.e. the number of swarm particles or potential solutions that we start with [66].”
BackgroundA survey on metaheuristics for stochastic combinatorial optimization
Bianchi, L., Dorigo, M., Gambardella, L. M., & Gutjahr, W. J. (2009) · Natural Computing · doi:10.1007/s11047-008-9098-4 · Cited by 737
The use of computational intelligence in intrusion detection systems: A review
Wu, S. X., & Banzhaf, W. (2010) · Applied Soft Computing · doi:10.1016/j.asoc.2009.06.019 · Cited by 696
Aljawarneh, S., Aldwairi, M., & Yassein, M. B. (2018) · Journal of Computational Science · doi:10.1016/j.jocs.2017.03.006 · Cited by 682
Moustafa, N., Turnbull, B., & Choo, K.-K. R. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2871719 · Cited by 582
Random-Forests-Based Network Intrusion Detection Systems
Zhang, J., Zulkernine, M., & Haque, A. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2008.923876 · Cited by 574
Models of Incremental Concept Formation
Gennari, J. H., Langley, P., & Fisher, D. (1988) · doi:10.21236/ada191597 · Cited by 525
A Multimodal Deep Learning Method for Android Malware Detection Using Various Features
Kim, T., Kang, B., Rho, M., Sezer, S., & Im, E. G. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2866319 · Cited by 518
Models of incremental concept formation
Gennari, J. H., Langley, P., & Fisher, D. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90046-5 · Cited by 453
A novel hybrid KPCA and SVM with GA model for intrusion detection
Kuang, F., Xu, W., & Zhang, S. (2014) · Applied Soft Computing · doi:10.1016/j.asoc.2014.01.028 · Cited by 424
Evolutionary Computation for Modeling and Optimization
(2006) · Springer eBooks · doi:10.1007/0-387-31909-3 · Cited by 401
Eesa, A. S., Orman, Z., & Brifcani, A. M. A. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.11.009 · Cited by 376
Suthaharan, S. (2014) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/2627534.2627557 · Cited by 319
A New Intrusion Detection System Based on KNN Classification Algorithm in Wireless Sensor Network
Li, W., Yi, P., Wu, Y., Pan, L., & Li, J. (2014) · Journal of Electrical and Computer Engineering · doi:10.1155/2014/240217 · Cited by 295
A Survey of Insider Attack Detection Research
Salem, M. B., Hershkop, S., & Stolfo, S. J. (2008) · Advances in Information Security · doi:10.1007/978-0-387-77322-3_5 · Cited by 280
Anomaly Based Network Intrusion Detection with Unsupervised Outlier Detection
Zhang, J., & Zulkernine, M. (2006) · 2006 IEEE International Conference on Communications · doi:10.1109/icc.2006.255127 · Cited by 256
E-Learning: Challenges and Research Opportunities Using Machine Learning & Data Analytics
Moubayed, A., Injadat, M., Nassif, A. B., Lutfiyya, H. L., & Shami, A. A. (2018) · IEEE Access · doi:10.1109/access.2018.2851790 · Cited by 221
Self-citationBayesian Optimization with Machine Learning Algorithms Towards Anomaly Detection
Injadat, M., Salo, F., Nassif, A. B., Essex, A., & Shami, A. A. (2018) · Globecom · doi:10.1109/glocom.2018.8647714 · Cited by 207
Self-citationTree-Based Intelligent Intrusion Detection System in Internet of Vehicles
Yang, L., Moubayed, A., Hamieh, I., & Shami, A. (2019) · 2019 IEEE Global Communications Conference (GLOBECOM) · doi:10.1109/globecom38437.2019.9013892 · Cited by 203
Self-citationStudent Engagement Level in an e-Learning Environment: Clustering Using K-means
Moubayed, A., Injadat, M., Shami, A., & Lutfiyya, H. (2020) · American Journal of Distance Education · doi:10.1080/08923647.2020.1696140 · Cited by 195
Self-citationMachine learning based mobile malware detection using highly imbalanced network traffic
Chen, Z., Yan, Q., Han, H., Wang, S., Peng, L., Wang, L., & Yang, B. (2018) · Information Sciences · doi:10.1016/j.ins.2017.04.044 · Cited by 187
Wireless Sensor Networks Intrusion Detection Based on SMOTE and the Random Forest Algorithm
Tan, X., Su, S., Huang, Z., Guo, X., Zuo, Z., Sun, X., & Li, L. (2019) · Sensors · doi:10.3390/s19010203 · Cited by 185
Systematic ensemble model selection approach for educational data mining
Injadat, M., Moubayed, A., Nassif, A. B., & Shami, A. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105992 · Cited by 172
Self-citationData mining techniques in social media: A survey
Injadat, M., Salo, F., & Nassif, A. B. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.06.045 · Cited by 171
Self-citationUsing Bayesian Networks for Probabilistic Identification of Zero-Day Attack Paths
Sun, X., Dai, J., Liu, P., Singhal, A., & Yen, J. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2821095 · Cited by 159
Data Mining Techniques in Intrusion Detection Systems: A Systematic Literature Review
Salo, F., Injadat, M., Nassif, A. B., Shami, A. A., & Essex, A. (2018) · IEEE Access · doi:10.1109/access.2018.2872784 · Cited by 145
Self-citationBotChase: Graph-Based Bot Detection Using Machine Learning
Daya, A. A., Salahuddin, M. A., Limam, N., & Boutaba, R. (2020) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2020.2972405 · Cited by 137
Genetic algorithms in wireless networking: techniques, applications, and issues
Mehboob, U., Qadir, J., Ali, S., & Vasilakos, A. V. (2016) · Soft Computing · doi:10.1007/s00500-016-2070-9 · Cited by 130
Software-Defined Perimeter (SDP): State of the Art Secure Solution for Modern Networks
Moubayed, A., Refaey, A., & Shami, A. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800324 · Cited by 127
Self-citationMulti-split optimized bagging ensemble model selection for multi-class educational data mining
Injadat, M., Moubayed, A., Nassif, A. B., & Shami, A. A. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01776-3 · Cited by 115
Self-citationBul’ajoul, W., James, A. E., & Pannu, M. (2014) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2014.12.012 · Cited by 94
Alsirhani, A., Sampalli, S., & Bodorik, P. (2019) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2019.2929425 · Cited by 86
A Novel Boundary Oversampling Algorithm Based on Neighborhood Rough Set Model: NRSBoundary-SMOTE
Hu, F., & Li, H. (2013) · Mathematical Problems in Engineering · doi:10.1155/2013/694809 · Cited by 85
Intelligent intrusion detection in external communication systems for autonomous vehicles
Alheeti, K. M. A., & McDonald-Maier, K. D. (2018) · Systems Science & Control Engineering · doi:10.1080/21642583.2018.1440260 · Cited by 81
A New Intrusion Detection Approach using PSO based Multiple Criteria Linear Programming
Hosseini, B. S. M., Amiri, B., Mirzabagheri, M., & Shi, Y. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.07.040 · Cited by 72
Moubayed, A., Injadat, M., Shami, A. A., & Lutfiyya, H. L. (2018) · IEEE World Engineering Education Conference (EDUNINE) · doi:10.1109/edunine.2018.8451005 · Cited by 72
Self-citationEstimating Software Effort Using an ANN Model Based on Use Case Points
Nassif, A. B., Capretz, L. F., & Ho, D. (2012) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2012.138 · Cited by 66
Self-citationRikhtegar, A., Pooyan, M., & Manzuri, M. T. (2016) · IET Computer Vision · doi:10.1049/iet-cvi.2015.0037 · Cited by 62
An enhanced dynamic model of battery using genetic algorithm suitable for photovoltaic applications
Blaifi, S.-A., Moulahoum, S., Çolak, İ., & Merrouche, W. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.02.062 · Cited by 62
Clustering Enabled Classification using Ensemble Feature Selection for Intrusion Detection
Salo, F., Injadat, M., Moubayed, A., Nassif, A. B., & Essex, A. (2019) · 2012 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/iccnc.2019.8685636 · Cited by 58
Self-citationDNS Typo-Squatting Domain Detection: A Data Analytics & Machine Learning Based Approach
Moubayed, A., Injadat, M., Shami, A. A., & Lutfiyya, H. (2018) · Globecom · doi:10.1109/glocom.2018.8647679 · Cited by 48
Self-citationPerformance Analysis of SDP For Secure Internal Enterprises
Kumar, P., Moubayed, A., Refaey, A., Shami, A. A., & Koilpillai, J. (2019) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc.2019.8885784 · Cited by 38
Self-citationXavier, S., Arnau, R., & Carme Torras, A. (2014) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-61499-452-7-273 · Cited by 30
Feature Selection based on Information Theory
Bonev, B. (2010) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 29
Ensemble-based Feature Selection and Classification Model for DNS Typo-squatting Detection
Moubayed, A., Aqeeli, E., & Shami, A. A. (2020) · Conference proceedings - Canadian Conference on Electrical and Computer Engineering · doi:10.1109/ccece47787.2020.9255697 · Cited by 28
Self-citationCohen, G., Hilario, M., & Geissbühler, A. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30547-7_21 · Cited by 19
Cited by
MTH-IDS: A Multitiered Hybrid Intrusion Detection System for Internet of Vehicles
Yang, L., Moubayed, A., & Shami, A. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3084796 · Cited by 416
Self-citationDisha, R. A., & Waheed, S. (2022) · Cybersecurity · doi:10.1186/s42400-021-00103-8 · Cited by 334
Enhancing intrusion detection: a hybrid machine and deep learning approach
Sajid, M., Malik, K. R., Almogren, A., Malik, T. S., Khan, A. H., Tanveer, J., & Rehman, A. U. (2024) · Journal of Cloud Computing · doi:10.1186/s13677-024-00685-x · Cited by 283
Issa, M. M., Aljanabi, M., & Muhialdeen, H. M. (2024) · Journal of Intelligent Systems · doi:10.1515/jisys-2023-0248 · Cited by 35
Metadata
- Authors
- Injadat, M., Moubayed, A., Nassif, A. B., & Shami, A.
- Venue
- IEEE Transactions on Network and Service Management
- Published
- 2021-06
- Volume
- 18
- Issue
- 2
- Pages
- 1803-1816
- ISSN
- 1932-4537 (ISSN-L)
- 2373-7379
- OpenAlex
- W3048313003
- Cited by
- 282
- References
- 63
- FWCI
- 16.03
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.