The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Intrusion Detection of Imbalanced Network Traffic Based on Machine Learning and Deep Learning
Open accessAbstract
In imbalanced network traffic, malicious cyber-attacks can often hide in large amounts of normal data. It exhibits a high degree of stealth and obfuscation in cyberspace, making it difficult for Network Intrusion Detection System(NIDS) to ensure the accuracy and timeliness of detection. This paper researches machine learning and deep learning for intrusion detection in imbalanced network traffic. It proposes a novel Difficult Set Sampling Technique(DSSTE) algorithm to tackle the class imbalance problem. First, use the Edited Nearest Neighbor(ENN) algorithm to divide the imbalanced training set into the difficult set and the easy set. Next, use the KMeans algorithm to compress the majority samples in the difficult set to reduce the majority. Zoom in and out the minority samples' continuous attributes in the difficult set synthesize new samples to increase the minority number. Finally, the easy set, the compressed set of majority in the difficult, and the minority in the difficult set are combined with its augmentation samples to make up a new training set. The algorithm reduces the imbalance of the original training set and provides targeted data augment for the minority class that needs to learn. It enables the classifier to learn the differences in the training stage better and improve classification performance. To verify the proposed method, we conduct experiments on the classic intrusion dataset NSL-KDD and the newer and comprehensive intrusion dataset CSE-CIC-IDS2018. We use classical classification models: random forest(RF), Support Vector Machine(SVM), XGBoost, Long and Short-term Memory(LSTM), AlexNet, Mini-VGGNet. We compare the other 24 methods; the experimental results demonstrate that our proposed DSSTE algorithm outperforms the other methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
(2008) · Journal of Machine Learning Research · Cited by 33,051
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Hearst, M. A., Dumais, S. T., Osuna, E., Platt, J., & Scholkopf, B. (1998) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.708428 · Cited by 7,243
A detailed analysis of the KDD CUP 99 data set
Tavallaee, M., Bagheri, E., Lu, W., & Ghorbani, A. A. (2009) · 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications · doi:10.1109/cisda.2009.5356528 · Cited by 5,396
Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization
Sharafaldin, I., Habibi Lashkari, A., & Ghorbani, A. A. (2018) · Proceedings of the 4th International Conference on Information Systems Security and Privacy · doi:10.5220/0006639801080116 · Cited by 5,318
Denning, D. E. (1987) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1987.232894 · Cited by 3,427
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
Deep learning for visual understanding: A review
Guo, Y., Liu, Y., Oerlemans, A., Lao, S., Wu, S., & Lew, M. S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.09.116 · Cited by 2,504
A Deep Learning Approach to Network Intrusion Detection
Shone, N., Ngoc, T. N., Phai, V. D., & Shi, Q. (2018) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2017.2772792 · Cited by 1,819
A Deep Learning Approach for Network Intrusion Detection System
Javaid, A., Niyaz, Q., Sun, W., & Alam, M. (2016) · Proceedings of the 9th EAI International Conference on Bio-inspired Information and Communications Technologies (formerly BIONETICS) · doi:10.4108/eai.3-12-2015.2262516 · Cited by 1,274
Malware traffic classification using convolutional neural network for representation learning
Wang, W., Zhu, M., Zeng, X., Ye, X., & Sheng, Y. (2017) · 2017 International Conference on Information Networking (ICOIN) · doi:10.1109/icoin.2017.7899588 · Cited by 1,177 · cited 1×
“[17] proposed a malicious software traffic classification algorithm based on Convolutional Neural Network(CNN).”
MethodA survey of deep learning-based network anomaly detection
Kwon, D., Kim, H., Kim, J., Suh, S. C., Kim, I., & Kim, K. J. (2019) · Cluster Computing · doi:10.1007/s10586-017-1117-8 · Cited by 778
Naive Bayes vs decision trees in intrusion detection systems
Amor, N. B., Benferhat, S., & Elouedi, Z. (2004) · Proceedings of the 2004 ACM symposium on Applied computing · doi:10.1145/967900.967989 · Cited by 479
TSE-IDS: A Two-Stage Classifier Ensemble for Intelligent Anomaly-Based Intrusion Detection System
Tama, B. A., Comuzzi, M., & Rhee, K.-H. (2019) · IEEE Access · doi:10.1109/access.2019.2928048 · Cited by 386
A Novel PCA-Firefly Based XGBoost Classification Model for Intrusion Detection in Networks Using GPU
Bhattacharya, S., S, S. R. K., Maddikunta, P. K. R., Kaluri, R., Singh, S., Gadekallu, T. R., Alazab, M., & Tariq, U. (2020) · Electronics · doi:10.3390/electronics9020219 · Cited by 364
Tahir, M. A., Kittler, J., & Yan, F. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.03.014 · Cited by 312
Lopez-Martin, M., Carro, B., Sanchez-Esguevillas, A., & Lloret, J. (2017) · Sensors · doi:10.3390/s17091967 · Cited by 299
Combating imbalance in network intrusion datasets
Cieslak, D. A., Chawla, N. V., & Striegel, A. (2006) · 2006 IEEE International Conference on Granular Computing · doi:10.1109/grc.2006.1635905 · Cited by 286
NETWORK INTRUSION DETECTION USING NAÏVE BAYES
Panda, M., & Patra, M. R. (2007) · Cited by 241
Adversarial environment reinforcement learning algorithm for intrusion detection
Caminero, G., Lopez-Martin, M., & Carro, B. (2019) · Computer Networks · doi:10.1016/j.comnet.2019.05.013 · Cited by 222
Feature selection and intrusion classification in NSL-KDD cup 99 dataset employing SVMs
Pervez, M. S., & Farid, D. M. (2014) · The 8th International Conference on Software, Knowledge, Information Management and Applications (SKIMA 2014) · doi:10.1109/skima.2014.7083539 · Cited by 218
Abdulhammed, R., Faezipour, M., Abuzneid, A., & AbuMallouh, A. (2019) · IEEE Sensors Letters · doi:10.1109/lsens.2018.2879990 · Cited by 218
Classification of Imbalanced Data by Combining the Complementary Neural Network and SMOTE Algorithm
Jeatrakul, P., Wong, K. W., & Fung, C. C. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-17534-3_19 · Cited by 185
Bedi, P., Gupta, N., & Jindal, V. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01886-y · Cited by 171
An analysis of Recurrent Neural Networks for Botnet detection behavior
Torres, P., Catania, C., Garcia, S., & Garino, C. G. (2016) · 2016 IEEE Biennial Congress of Argentina (ARGENCON) · doi:10.1109/argencon.2016.7585247 · Cited by 169
AESMOTE: Adversarial Reinforcement Learning With SMOTE for Anomaly Detection
Ma, X., & Shi, W. (2020) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2020.3004312 · Cited by 149
Machine Learning Techniques for Intrusion DetectionPreprint
Zamani, M., & Movahedi, M. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.2177 · Cited by 146
Bedi, P., Gupta, N., & Jindal, V. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.04.085 · Cited by 135
Generative Oversampling for Mining Imbalanced Datasets.
Liu, A., Ghosh, J., & Martin, C. E. (2007) · DMIN · Cited by 110
Intrusion Detection using a Novel Hybrid Method Incorporating an Improved KNN
Shapoorifard, H., & Shamsinejad, P. (2017) · International Journal of Computer Applications · doi:10.5120/ijca2017914340 · Cited by 75
Yan, B., & Han, G. (2018) · Security and Communication Networks · doi:10.1155/2018/6026878 · Cited by 62
Ismail, A., Ahmad, S. A., Soh, A. C., et al. (2019) · International Journal of Integrated Engineering · doi:10.30880/ijie.2019.11.04.006 · Cited by 30
Applying Deep Learning to Balancing Network Intrusion Detection Datasets
Chuang, P., & Wu, D.-Y. (2019) · IEEE International Conference on Advanced Infocomm Technology · doi:10.1109/icait.2019.8935927 · Cited by 27
A Network Intrusion Detection Approach Using Variant of Convolution Neural Network
Verma, A. K., Kaushik, P., & Shrivastava, G. K. (2019) · International Conference on Communication and Electronics Systems (ICCES) · doi:10.1109/icces45898.2019.9002221 · Cited by 27
High Performance WGAN-GP based Multiple-category Network Anomaly Classification System
Wang, J.-T., & Wang, C. (2019) · doi:10.1109/cset.2019.8904890 · Cited by 16
Cited by
Design and Development of RNN Anomaly Detection Model for IoT Networks
Ullah, I., & Mahmoud, Q. H. (2022) · IEEE Access · doi:10.1109/access.2022.3176317 · Cited by 270
Metadata
- Authors
- Liu, L., Wang, P., Lin, J., & Liu, L.
- Venue
- IEEE Access
- Published
- 2021
- Volume
- 9
- Pages
- 7550-7563
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3116274835
- Cited by
- 274
- References
- 42
- FWCI
- 14.14
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.