The DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
Deep learning methods in network intrusion detection: A survey and an objective comparison
Abstract
The use of deep learning models for the network intrusion detection task has been an active area of research in cybersecurity. Although several excellent surveys cover the growing body of research on this topic, the literature lacks an objective comparison of the different deep learning models within a controlled environment, especially on recent intrusion detection datasets. In this paper, we first introduce a taxonomy of deep learning models in intrusion detection and summarize the research papers on this topic. Then we train and evaluate four key deep learning models - feed-forward neural network, autoencoder, deep belief network and long short-term memory network - for the intrusion classification task on two legacy datasets (KDD 99, NSL-KDD) and two modern datasets (CIC-IDS2017, CIC-IDS2018). Our results suggest that deep feed-forward neural networks yield desirable evaluation metrics on all four datasets in terms of accuracy, F1-score and training and inference time. The results also indicate that two popular semi-supervised learning models, autoencoders and deep belief networks do not perform better than supervised feed-forward neural networks. The implementation and the complete set of results have been released for future use by the research community. Finally, we discuss the issues in the research literature that were revealed in the survey and suggest several potential future directions for research in machine learning methods for intrusion detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2010) · Cited by 14,134
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
(2011) · Cited by 6,993
A detailed analysis of the KDD CUP 99 data set
Tavallaee, M., Bagheri, E., Lu, W., & Ghorbani, A. A. (2009) · 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications · doi:10.1109/cisda.2009.5356528 · Cited by 5,396
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization
Sharafaldin, I., Habibi Lashkari, A., & Ghorbani, A. A. (2018) · Proceedings of the 4th International Conference on Information Systems Security and Privacy · doi:10.5220/0006639801080116 · Cited by 5,318
A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection
Buczak, A. L., & Guven, E. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2494502 · Cited by 3,332
Methods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665
Why Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Samy Bengio, A. (2010) · Journal of Machine Learning Research · Cited by 2,631
Self-Normalizing Neural Networks
Klambauer, G., Unterthiner, T., Mayr, A., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.02515 · Cited by 2,267
Deep Neural Networks for Acoustic Modeling in Speech Recognition
Hinton, G. E., Deng, L., Yu, D., Dahl, G. E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T. N., et al. (2012) · IEEE Signal Processing Magazine · Cited by 2,115
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
Amodei, D., Anubhai, R., Battenberg, E., Case, C. T., Casper, J., Catanzaro, B., Chen, J., Chrzanowski, M., Coates, A., Diamos, G., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02595 · Cited by 2,110
A Deep Learning Approach for Intrusion Detection Using Recurrent Neural Networks
Yin, C., Zhu, Y., Fei, J., & He, X. (2017) · IEEE Access · doi:10.1109/access.2017.2762418 · Cited by 2,100
Outside the Closed World: On Using Machine Learning for Network Intrusion Detection
Sommer, R., & Paxson, V. (2010) · 2010 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2010.25 · Cited by 2,085
Deep Learning Approach for Intelligent Intrusion Detection System
Vinayakumar, R., Alazab, M., Soman, K. P., Poornachandran, P., Al-Nemrat, A., & Venkatraman, S. (2019) · IEEE Access · doi:10.1109/access.2019.2895334 · Cited by 1,946
A Deep Learning Approach to Network Intrusion Detection
Shone, N., Ngoc, T. N., Phai, V. D., & Shi, Q. (2018) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2017.2772792 · Cited by 1,819
A Survey of Machine and Deep Learning Methods for Internet of Things (IoT) Security
Al-Garadi, M. A., Mohamed, A., Al-Ali, A. K., Du, X., Ali, I., & Guizani, M. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2988293 · Cited by 1,392
A Deep Learning Approach for Network Intrusion Detection System
Javaid, A., Niyaz, Q., Sun, W., & Alam, M. (2016) · Proceedings of the 9th EAI International Conference on Bio-inspired Information and Communications Technologies (formerly BIONETICS) · doi:10.4108/eai.3-12-2015.2262516 · Cited by 1,274
Machine Learning and Deep Learning Methods for Cybersecurity
Xin, Y., Kong, L., Liu, Z., Chen, Y., Li, Y., Zhu, H., Gao, M., Hou, H., & Wang, C. (2018) · IEEE Access · doi:10.1109/access.2018.2836950 · Cited by 1,228
Malware traffic classification using convolutional neural network for representation learning
Wang, W., Zhu, M., Zeng, X., Ye, X., & Sheng, Y. (2017) · 2017 International Conference on Information Networking (ICOIN) · doi:10.1109/icoin.2017.7899588 · Cited by 1,177
Deep learning for cyber security intrusion detection: Approaches, datasets, and comparative study
Ferrag, M. A., Maglaras, L., Moschoyiannis, S., & Janicke, H. (2020) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2019.102419 · Cited by 1,130
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Distributed attack detection scheme using deep learning approach for Internet of Things
Diro, A. A., & Chilamkurti, N. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2017.08.043 · Cited by 1,053
Unmasking Clever Hans predictors and assessing what machines really learn
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K.-R. (2019) · Nature Communications · doi:10.1038/s41467-019-08987-4 · Cited by 1,047
Intrusion detection by machine learning: A review
Tsai, C.-F., Hsu, Y.-F., Lin, C.-Y., & Lin, W.-Y. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.05.029 · Cited by 969
A survey of network-based intrusion detection data sets
Ring, M., Wunderlich, S., Scheuring, D., Landes, D., & Hotho, A. (2019) · Computers & Security · doi:10.1016/j.cose.2019.06.005 · Cited by 947
Network Intrusion Detection for IoT Security Based on Learning Techniques
Chaabouni, N., Mosbah, M., Zemmari, A., Sauvignac, C., & Faruki, P. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2896380 · Cited by 940
Training restricted Boltzmann machines using approximations to the likelihood gradient
Tieleman, T. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390290 · Cited by 837
He, Y., Mendis, G. J., & Wei, J. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2703842 · Cited by 834
Intrusion detection using neural networks and support vector machines
Mukkamala, S., Janoski, G., & Sung, A. (2003) · Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290) · doi:10.1109/ijcnn.2002.1007774 · Cited by 814
Deep learning approach for Network Intrusion Detection in Software Defined Networking
Tang, T. A., Mhamdi, L., McLernon, D., Zaidi, S. A. R., & Ghogho, M. (2016) · 2016 International Conference on Wireless Networks and Mobile Communications (WINCOM) · doi:10.1109/wincom.2016.7777224 · Cited by 806
A survey of deep learning-based network anomaly detection
Kwon, D., Kim, H., Kim, J., Suh, S. C., Kim, I., & Kim, K. J. (2019) · Cluster Computing · doi:10.1007/s10586-017-1117-8 · Cited by 778
A Detailed Investigation and Analysis of Using Machine Learning Techniques for Intrusion Detection
Mishra, P., Varadharajan, V., Tupakula, U., & Pilli, E. S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2847722 · Cited by 738
Long Short Term Memory Recurrent Neural Network Classifier for Intrusion Detection
Kim, J., Kim, J., Thi Thu, H. L., & Kim, H. (2016) · 2016 International Conference on Platform Technology and Service (PlatCon) · doi:10.1109/platcon.2016.7456805 · Cited by 690
Intrusion Detection System Using Deep Neural Network for In-Vehicle Network Security
Kang, M.-J., & Kang, J.-W. (2016) · PLOS ONE · doi:10.1371/journal.pone.0155781 · Cited by 678
Unmasking Clever Hans predictors and assessing what machines really learn
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K. (2019) · RePEc: Research Papers in Economics · Cited by 580
A Survey of Deep Learning Methods for Cyber Security
Berman, D. S., Buczak, A. L., Chavis, J. S., & Corbett, C. L. (2019) · Information · doi:10.3390/info10040122 · Cited by 569
Survey on SDN based network intrusion detection system using machine learning approaches
Sultana, N., Chilamkurti, N., Peng, W., & Alhadad, R. (2019) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-017-0630-0 · Cited by 507
Anomaly Detection in Automobile Control Network Data with Long Short-Term Memory Networks
Taylor, A., Leblanc, S., & Japkowicz, N. (2016) · 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2016.20 · Cited by 400
Deep Learning: The Frontier for Distributed Attack Detection in Fog-to-Things Computing
Abeshu, A., & Chilamkurti, N. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700332 · Cited by 390
Network anomaly detection with the restricted Boltzmann machine
Fiore, U., Palmieri, F., Castiglione, A., & De Santis, A. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.11.050 · Cited by 376
Performance analysis of NSL-KDD dataset using ANN
Ingre, B., & Yadav, A. (2015) · 2015 International Conference on Signal Processing and Communication Engineering Systems · doi:10.1109/spaces.2015.7058223 · Cited by 374
An Intrusion Detection System Using a Deep Neural Network With Gated Recurrent Units
Xu, C., Shen, J., Du, X., & Zhang, F. (2018) · IEEE Access · doi:10.1109/access.2018.2867564 · Cited by 339
Threat analysis of IoT networks using artificial neural network intrusion detection system
Hodo, E., Bellekens, X., Hamilton, A. W., et al. (2016) · Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) · Cited by 303
An Intrusion Detection Model Based on Deep Belief Networks
Gao, N., Gao, L., Gao, Q., & Wang, H. (2014) · 2014 Second International Conference on Advanced Cloud and Big Data · doi:10.1109/cbd.2014.41 · Cited by 293
Toward an Online Anomaly Intrusion Detection System Based on Deep Learning
Alrawashdeh, K., & Purdy, C. (2016) · 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2016.0040 · Cited by 287
2011 IEEE Symposium on Security and Privacy
(2011) · doi:10.1109/sp17706.2011 · Cited by 282
Cloud-Based Cyber-Physical Intrusion Detection for Vehicles Using Deep Learning
Loukas, G., Vuong, T., Heartfield, R., Sakellari, G., Yoon, Y., & Gan, D. (2018) · IEEE Access · doi:10.1109/access.2017.2782159 · Cited by 277
Deep Learning-Based Intrusion Detection With Adversaries
Wang, Z. (2018) · IEEE Access · doi:10.1109/access.2018.2854599 · Cited by 269
Zeng, Y., Gu, H., Wei, W., & Guo, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2908225 · Cited by 260
Intrusion detection using deep belief networks
Alom, M. Z., Bontupalli, V., & Taha, T. M. (2015) · 2015 National Aerospace and Electronics Conference (NAECON) · doi:10.1109/naecon.2015.7443094 · Cited by 254
Deep Learning Based Multi-Channel Intelligent Attack Detection for Data Security
Jiang, F., Fu, Y., Gupta, B. B., Liang, Y., Rho, S., Lou, F., Meng, F., & Tian, Z. (2020) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2018.2793284 · Cited by 252
Ma, T., Wang, F., Cheng, J., Yu, Y., & Chen, X. (2016) · Sensors · doi:10.3390/s16101701 · Cited by 230
A Hybrid Malicious Code Detection Method based on Deep Learning
Li, Y., Ma, R., & Jiao, R. (2015) · International Journal of Security and Its Applications · doi:10.14257/ijsia.2015.9.5.21 · Cited by 226
Method of intrusion detection using deep neural network
Kim, J., Shin, N., Jo, S. Y., & Kim, S. H. (2017) · 2017 IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp.2017.7881684 · Cited by 223
Accelerated deep neural networks for enhanced Intrusion Detection System
Potluri, S., & Diedrich, C. (2016) · 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa.2016.7733515 · Cited by 212
Shallow and Deep Networks Intrusion Detection System: A Taxonomy and Survey
Hodo, E., Bellekens, X., Hamilton, A., Tachtatzis, C., & Atkinson, R. C. (2017) · Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) · doi:10.48550/arxiv.1701.02145 · Cited by 212
Applying long short-term memory recurrent neural networks to intrusion detection
Staudemeyer, R. C. (2015) · South African Computer Journal · doi:10.18489/sacj.v56i1.248 · Cited by 206
Leveraging LSTM Networks for Attack Detection in Fog-to-Things Communications
Diro, A., & Chilamkurti, N. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1701270 · Cited by 190
Application of Machine Learning Approaches in Intrusion Detection System: A Survey
Farah, N., Avishek, M., Muhammad, F., Rahman, A., Rafni, M., & Md., D. (2015) · INTERNATIONAL JOURNAL OF ADVANCED RESEARCH IN ARTIFICIAL INTELLIGENCE · doi:10.14569/ijarai.2015.040302 · Cited by 175
Le, T.-T.-H., Kim, J., & Kim, H. (2017) · International Conference on Platform Technology and Service · doi:10.1109/platcon.2017.7883684 · Cited by 171
An Empirical Study on Network Anomaly Detection Using Convolutional Neural Networks
Kwon, D., Natarajan, K., Suh, S. C., Kim, H., & Kim, J. (2018) · 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2018.00178 · Cited by 157
Transfer learning for detecting unknown network attacks
Zhao, J., Shetty, S. S., Pan, J. W., Kamhoua, C., & Kwiat, K. (2019) · EURASIP Journal on Information Security · doi:10.1186/s13635-019-0084-4 · Cited by 139
Network Traffic Anomaly Detection Using Recurrent Neural NetworksPreprint
Radford, B. J., Apolonio, L. M., Trias, A. J., & Simpson, J. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.10769 · Cited by 120
2017 International Conference on Information Networking (ICOIN)
(2017) · doi:10.1109/icoin39698.2017 · Cited by 68
A Comparative Study of Off-Line Deep Learning Based Network Intrusion Detection
Yan, J., Jin, D., Lee, C. W., & Liu, P. (2018) · International Conference on Ubiquitous and Future Networks · doi:10.1109/icufn.2018.8436774 · Cited by 45
Collective Anomaly Detection based on Long Short Term Memory Recurrent Neural NetworkPreprint
Bontemps, L., Cao, V. L., McDermott, J., & Le‐Khac, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09752 · Cited by 39
2015 National Aerospace and Electronics Conference (NAECON)
(2015) · doi:10.1109/naecon35955.2015 · Cited by 30
Transfer Learning Based Intrusion Detection
Taghiyarrenani, Z., Fanian, A., Mahdavi, E., Mirzaei, A., & Farsi, H. (2018) · International Conference on Computer and Knowledge Engineering · doi:10.1109/iccke.2018.8566601 · Cited by 24
2014 Second International Conference on Advanced Cloud and Big Data
(2014) · doi:10.1109/cbd35694.2014 · Cited by 23
Shimeall, T. J., & Spring, J. (2013) · Elsevier eBooks · doi:10.1016/b978-1-59749-969-9.00012-2 · Cited by 7
Cited by
Explainable Artificial Intelligence in CyberSecurity: A Survey
Capuano, N., Fenza, G., Loia, V., & Stanzione, C. (2022) · IEEE Access · doi:10.1109/access.2022.3204171 · Cited by 330
“The whole execution of the study is made public in order to facilitate objective comparisons and transparency in [60].”
BackgroundA survey and analysis of intrusion detection models based on CSE-CIC-IDS2018 Big Data
Leevy, J. L., & Khoshgoftaar, T. M. (2020) · Journal of Big Data · doi:10.1186/s40537-020-00382-x · Cited by 264
Enhancing intrusion detection with feature selection and neural network
Wu, C., & Li, W. (2021) · International Journal of Intelligent Systems · doi:10.1002/int.22397 · Cited by 53
“A survey on the application of deep learning in IDS can refer to Reference [37].”
Background
Metadata
- Authors
- Gamage, S., & Samarabandu, J.
- Venue
- Journal of Network and Computer Applications
- Publisher
- Elsevier BV
- Published
- 2020-11
- Volume
- 169
- Pages
- 102767
- ISSN
- 1084-8045 (ISSN-L)
- OpenAlex
- W3047132966
- Cited by
- 382
- References
- 92
- FWCI
- 23.57
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.