Machine Learning and Deep Learning Methods for Cybersecurity
Open accessThe DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Abstract
With the development of the Internet, cyber-attacks are changing rapidly and the cyber security situation is not optimistic. This survey report describes key literature surveys on machine learning (ML) and deep learning (DL) methods for network analysis of intrusion detection and provides a brief tutorial description of each ML/DL method. Papers representing each method were indexed, read, and summarized based on their temporal or thermal correlations. Because data are so important in ML/DL methods, we describe some of the commonly used network datasets used in ML/DL, discuss the challenges of using ML/DL for cybersecurity and provide suggestions for research directions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The main advantage of deep learning over traditional machine learning methods is its better performance in several cases, particularly learning from large datasets [105, 129].”
From Machine learning: Algorithms, real-world applications and research directions (2021) · cites this paper as [129]
In the citing paper
“The key benefit of deep learning over conventional machine learning methods is that it performs better in a variety of situations, particularly when learning from large datasets [114, 140].”
From Data Science and Analytics: An Overview from Data-Driven Smart Computing, Decision-Making and Applications Perspective (2021) · cites this paper as [140]
In the citing paper
“These deep learning methods can perform well, particularly, when learning from large-scale datasets [105, 140].”
From Data Science and Analytics: An Overview from Data-Driven Smart Computing, Decision-Making and Applications Perspective (2021) · cites this paper as [140]
In the citing paper
“Deep learning-based security models can perform better when utilizing the large scale of security datasets [140].”
From Data Science and Analytics: An Overview from Data-Driven Smart Computing, Decision-Making and Applications Perspective (2021) · cites this paper as [140]
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955
A detailed analysis of the KDD CUP 99 data set
Tavallaee, M., Bagheri, E., Lu, W., & Ghorbani, A. A. (2009) · 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications · doi:10.1109/cisda.2009.5356528 · Cited by 5,396
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection
Buczak, A. L., & Guven, E. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2494502 · Cited by 3,332
A Deep Learning Approach for Intrusion Detection Using Recurrent Neural Networks
Yin, C., Zhu, Y., Fei, J., & He, X. (2017) · IEEE Access · doi:10.1109/access.2017.2762418 · Cited by 2,100 · cited 1×
“[63] propose intrusion detection (RNN-IDS) based on a cyclic neural network.”
MethodDeep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,759
An overview of anomaly detection techniques: Existing solutions and latest technological trends
Patcha, A., & Park, J.-M. (2007) · Computer Networks · doi:10.1016/j.comnet.2007.02.001 · Cited by 1,561
Malware traffic classification using convolutional neural network for representation learning
Wang, W., Zhu, M., Zeng, X., Ye, X., & Sheng, Y. (2017) · 2017 International Conference on Information Networking (ICOIN) · doi:10.1109/icoin.2017.7899588 · Cited by 1,177
End-to-end encrypted traffic classification with one-dimensional convolution neural networks
Wang, W., Zhu, M., Wang, J., Zeng, X., & Yang, Z. (2017) · 2017 IEEE International Conference on Intelligence and Security Informatics (ISI) · doi:10.1109/isi.2017.8004872 · Cited by 991 · cited 1×
“[77] propose a one-dimensional convolutional”
Evaluating intrusion detection systems: the 1998 DARPA off-line intrusion detection evaluation
Lippmann, R. P., Fried, D. J., Graf, I., Haines, J. W., Kendall, K. R., McClung, D., Weber, D., Webster, S. E., Wyschogrod, D., Cunningham, R. K., et al. (2002) · Proceedings DARPA Information Survivability Conference and Exposition. DISCEX'00 · doi:10.1109/discex.2000.821506 · Cited by 917
A survey of intrusion detection techniques in Cloud
Modi, C., Patel, D., Borisaniya, B., Patel, H., Patel, A., & Rajarajan, M. (2013) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2012.05.003 · Cited by 889
Hinton, G. (2009) · Scholarpedia · doi:10.4249/scholarpedia.5947 · Cited by 885
Goetz, J. N., Brenning, A., Petschko, H., & Leopold, P. (2015) · Computers & Geosciences · doi:10.1016/j.cageo.2015.04.007 · Cited by 829
A survey of deep learning-based network anomaly detection
Kwon, D., Kim, H., Kim, J., Suh, S. C., Kim, I., & Kim, K. J. (2019) · Cluster Computing · doi:10.1007/s10586-017-1117-8 · Cited by 778
Long Short Term Memory Recurrent Neural Network Classifier for Intrusion Detection
Kim, J., Kim, J., Thi Thu, H. L., & Kim, H. (2016) · 2016 International Conference on Platform Technology and Service (PlatCon) · doi:10.1109/platcon.2016.7456805 · Cited by 690
Deep Learning for Classification of Malware System Call Sequences
Kolosnjaji, B., Zarras, A., Webster, G., & Eckert, C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-50127-7_11 · Cited by 515
Revathi, S., & Malathi, A. (2013) · Cited by 413
An Intrusion Detection Model Based on Deep Belief Networks
Gao, N., Gao, L., Gao, Q., & Wang, H. (2014) · 2014 Second International Conference on Advanced Cloud and Big Data · doi:10.1109/cbd.2014.41 · Cited by 293
Toward an Online Anomaly Intrusion Detection System Based on Deep Learning
Alrawashdeh, K., & Purdy, C. (2016) · 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2016.0040 · Cited by 287
Malicious URL Detection using Machine Learning: A Survey
Sahoo, D., Liu, C., & Hoi, S. C. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.07179 · Cited by 274
Agarap, A. F. M. (2018) · Proceedings of the 2018 10th International Conference on Machine Learning and Computing · doi:10.1145/3195106.3195117 · Cited by 259
Intrusion detection using deep belief networks
Alom, M. Z., Bontupalli, V., & Taha, T. M. (2015) · 2015 National Aerospace and Electronics Conference (NAECON) · doi:10.1109/naecon.2015.7443094 · Cited by 254
Saxe, J., & Berlin, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.08568 · Cited by 251
Collective Anomaly Detection Based on Long Short-Term Memory Recurrent Neural Networks
Bontemps, L., Cao, V. L., McDermott, J., & Le-Khac, N.-A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-48057-2_9 · Cited by 245
Feature selection and intrusion classification in NSL-KDD cup 99 dataset employing SVMs
Pervez, M. S., & Farid, D. M. (2014) · The 8th International Conference on Software, Knowledge, Information Management and Applications (SKIMA 2014) · doi:10.1109/skima.2014.7083539 · Cited by 218
Bolón-Canedo, V., Sánchez-Maroño, N., & Alonso-Betanzos, A. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.11.028 · Cited by 208
DDoS detection and analysis in SDN-based environment using support vector machine classifier
Kokila, R. T., Thamarai Selvi, S., & Govindarajan, K. (2014) · 2014 Sixth International Conference on Advanced Computing (ICoAC) · doi:10.1109/icoac.2014.7229711 · Cited by 207
Applying long short-term memory recurrent neural networks to intrusion detection
Staudemeyer, R. C. (2015) · South African Computer Journal · doi:10.18489/sacj.v56i1.248 · Cited by 206
Evaluating Computer Intrusion Detection Systems: A Survey of Common Practices
Milenkoski, A., Vieira, M., Kounev, S., Avritzer, A., & Payne, B. D. (2015) · ACM Computing Surveys · doi:10.1145/2808691 · Cited by 194
Louridas, P., & Ebert, C. (2016) · IEEE Software · doi:10.1109/ms.2016.114 · Cited by 189
Le, T.-T.-H., Kim, J., & Kim, H. (2017) · International Conference on Platform Technology and Service · doi:10.1109/platcon.2017.7883684 · Cited by 171
Network Intrusion Detection through Stacking Dilated Convolutional Autoencoders
Yu, Y., Long, J., & Cai, Z. (2017) · Security and Communication Networks · doi:10.1155/2017/4184196 · Cited by 169
Sustainability, value, and satisfaction: Model testing and cross-validation in tourist destinations
Iniesta-Bonillo, M. A., Sánchez-Fernández, R., & Jiménez-Castillo, D. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2016.04.071 · Cited by 165
Moon, D., Im, H., Kim, I., & Park, J. H. (2015) · The Journal of Supercomputing · doi:10.1007/s11227-015-1604-8 · Cited by 151
A review paper on IDS classification using KDD 99 and NSL KDD dataset in WEKA
Meena, G., & Choudhary, R. R. (2017) · doi:10.1109/comptelix.2017.8004032 · Cited by 150
Decision Tree Based Intrusion Detection System for NSL-KDD Dataset
Ingre, B., Yadav, A., & Soni, A. K. (2018) · Smart Innovation, Systems and Technologies · doi:10.1007/978-3-319-63645-0_23 · Cited by 150
Intrusion Detection Using Deep Belief Network and Probabilistic Neural Network
Zhao, G., Zhang, C., & Zheng, L. (2017) · 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC) · doi:10.1109/cse-euc.2017.119 · Cited by 149
A GPU deep learning metaheuristic based model for time series forecasting
Coelho, I. M., Coelho, V. N., Luz, E. J. D. S., Ochi, L. S., Guimarães, F. G., & Rios, E. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.01.003 · Cited by 146
Kim, G., Yi, H., Lee, J., Paek, Y., & Yoon, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01726 · Cited by 135
Evaluation methods and decision theory for classification of streaming data with temporal dependence
Žliobaitė, I., Bifet, A., Read, J., Pfahringer, B., & Holmes, G. (2014) · Machine Learning · doi:10.1007/s10994-014-5441-4 · Cited by 127
Efficient Online Learning Algorithms Based on LSTM Neural Networks
Ergen, T., & Kozat, S. S. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2741598 · Cited by 114
Towards an Energy-Efficient Anomaly-Based Intrusion Detection Engine for Embedded Systems
Viegas, E. K., Santin, A. O., de Franca, A. J., Jasinski, R. P., Pedroni, V. A., & Oliveira, L. S. (2016) · IEEE Transactions on Computers · doi:10.1109/tc.2016.2560839 · Cited by 109
Malik, A. J., & Khan, F. A. (2017) · Cluster Computing · doi:10.1007/s10586-017-0971-8 · Cited by 99
Meng, W., Li, W., & Kwok, L. F. (2015) · Security and Communication Networks · doi:10.1002/sec.1307 · Cited by 91
Robert S. Engelmore Award Article: Building AI Applications: Yesterday, Today, and Tomorrow
Smith, R. G., & Eckroth, J. (2017) · AI Magazine · doi:10.1609/aimag.v38i1.2709 · Cited by 88
Modi, C., & Acha, K. (2016) · The Journal of Supercomputing · doi:10.1007/s11227-016-1805-9 · Cited by 85
Empowering convolutional networks for malware classification and analysis
Kolosnjaji, B., Eraisha, G., Webster, G., Zarras, A., & Eckert, C. M. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966340 · Cited by 84
Xie, M., Hu, J., & Slay, J. (2014) · International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) · doi:10.1109/fskd.2014.6980972 · Cited by 83
Intrusion Detection in KDD99 Dataset using SVM-PSO and Feature Reduction with Information Gain
Saxena, H., & Richariya, V. (2014) · International Journal of Computer Applications · doi:10.5120/17188-7369 · Cited by 81
Application of Deep Belief Networks for opcode based malware detection
Ding, Y., Chen, S., & Xu, J. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727705 · Cited by 76
Intrusion Detection using a Novel Hybrid Method Incorporating an Improved KNN
Shapoorifard, H., & Shamsinejad, P. (2017) · International Journal of Computer Applications · doi:10.5120/ijca2017914340 · Cited by 75
Cybersecurity: The cold war online
Aftergood, S. (2017) · Nature · doi:10.1038/547030a · Cited by 72
Xie, M., Hu, J., Yu, X., & Chang, E. J. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11698-3_44 · Cited by 67
Classification of Attacks Using Support Vector Machine (SVM) on KDDCUP'99 IDS Database
Kotpalliwar, M. V., & Wajgi, R. D. (2015) · International Conference on Communication Systems and Network Technologies · doi:10.1109/csnt.2015.185 · Cited by 66
Implementation of network intrusion detection system using variant of decision tree algorithm
Relan, N. G., & Patil, D. R. (2015) · Biennial International Conference on Nascent Technologies in Engineering (ICNTE) · doi:10.1109/icnte.2015.7029925 · Cited by 62
Semi-Supervised Deep Neural Network for Network Intrusion Detection
Nadeem, M., Marshall, O., Singh, S., Fang, X., & Yuan, X. (2016) · DigitalCommons - Kennesaw State University (Kennesaw State University) · Cited by 54
Fast kNN Classifiers for Network Intrusion Detection System
Rao, B. B., & Swathi, K. (2017) · Indian Journal of Science and Technology · doi:10.17485/ijst/2017/v10i14/93690 · Cited by 54
Analysis of Machine Learning Techniques Based Intrusion Detection Systems
Sharma, R., Kalita, H. K., & Borah, P. (2015) · Smart innovation, systems and technologies · doi:10.1007/978-81-322-2529-4_51 · Cited by 44
Phase Change Chalcogenide Materials for Optical Data Storage
Rao, V., & Dwivedi, D. K. (2017) · Indian Journal of Science and Technology · doi:10.17485/ijst/2017/v10i29/109053 · Cited by 43
A Decision Tree Classifier for Intrusion Detection Priority Tagging
Ammar, A. (2015) · Journal of Computer and Communications · doi:10.4236/jcc.2015.34006 · Cited by 41
Chandrasekhar, A. M., & Raghuveer, K. (2014) · International Conference on Communications and Signal Processing (ICCSP) · doi:10.1109/iccsp.2014.6949927 · Cited by 41
An Intrusion Detection System using KNN-ACO Algorithm
Vishwakarma, S., Sharma, V. K., & Tiwari, A. (2017) · International Journal of Computer Applications · doi:10.5120/ijca2017914079 · Cited by 36
Azad, C., & Jha, V. K. (2015) · International Journal of Computer Network and Information Security · doi:10.5815/ijcnis.2015.08.07 · Cited by 31
Intrusion Detection Using Improved Decision Tree Algorithm with Binary and Quad Split
Puthran, S., & Shah, K. (2016) · Communications in computer and information science · doi:10.1007/978-981-10-2738-3_37 · Cited by 28
An intrusion detection method based on DBN in ad hoc networks
Tan, Q.-S., Wei, H., & Li, Q. (2016) · doi:10.1142/9789813140011_0056 · Cited by 26
A Hybrid System of Deep Learning and Learning Classifier System for Database Intrusion Detection
Bu, S.-J., & Cho, S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59650-1_52 · Cited by 22
Survey on Intrusion Detection Techniques
Shao, Z. (2005) · Jisuanji yingyong yanjiu · Cited by 21
A New Method of Transductive SVM-Based Network Intrusion Detection
Man-fu, Y., & Liu, Z. (2011) · IFIP International Federation for Information Processing/IFIP · doi:10.1007/978-3-642-18333-1_12 · Cited by 19
Self-citationJo, S., Sung, H., & Ahn, B.-H. (2015) · Journal of the Korea Society of Digital Industry and Information Management · doi:10.17662/ksdim.2015.11.4.033 · Cited by 19
A Survey on Intrusion Detection Techniques in MANET
Soni, M., Ahirwa, M., & Agrawal, S. (2015) · International Conference on Computational Intelligence and Communication Networks (CICN) · doi:10.1109/cicn.2015.204 · Cited by 17
Gain Ratio and Decision Tree Classifier for Intrusion Detection
Modinat, M., Abimbola, A. A., Balogun, A. O., & Opeyemi, A. (2015) · International Journal of Computer Applications · doi:10.5120/ijca2015905983 · Cited by 15
Ha, H.-J., & Kim, E.-A. L. (2020) · Journal of Convergence Information Technology · doi:10.22156/cs4smb.2020.10.05.042 · Cited by 12
An Intelligent Intrusion Detection System Using Average Manhattan Distance-based Decision Tree
Selvi, R. A., Kumar, S. S., & Suresh, A. (2014) · Advances in intelligent systems and computing · doi:10.1007/978-81-322-2126-5_23 · Cited by 5
Research works printed but not linked: 7
- sharifi, 2015, Intrusion detection based on joint of K-means and KNN, J Converg Inf Technol, 10, 42
- peng, 2014, Network intrusion detection model based on particle swarm optimization and k-nearest neighbor, Comput Eng Appl, 4, 31
- krishnan, 2016, An intellectual intrusion detection system model for attacks classification using RNN, Int J Pharm Tech, 8, 23157
- lakhina, 2010, Feature reduction using principal component analysis for effective anomaly–based intrusion detection on NSL-KDD, Int J Eng Sci Technol, 2, 3175
- balogun, 2015, Anomaly intrusion detection using an hybrid of decision tree and K-nearest neighbor, Advances in Applied Science Research, 2, 67
- rai, 2016, Decision tree based algorithm for intrusion detection, Int J Adv Netw Appl, 7, 2828
- dada, 2017, A hybridized SVM-kNN-pdAPSO approach to intrusion detection system, Proc Fac Seminar Ser, 14
Cited by
Machine learning: Algorithms, real-world applications and research directions
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00592-x · Cited by 5,583
State-of-the-art in artificial neural network applications: A survey
Abiodun, O. I., Jantan, A., Omolara, A. E., Dada, K. V., Mohamed, N. A., & Arshad, H. (2018) · Heliyon · doi:10.1016/j.heliyon.2018.e00938 · Cited by 3,054
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00815-1 · Cited by 2,678
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
Deep Learning Approach for Intelligent Intrusion Detection System
Vinayakumar, R., Alazab, M., Soman, K. P., Poornachandran, P., Al-Nemrat, A., & Venkatraman, S. (2019) · IEEE Access · doi:10.1109/access.2019.2895334 · Cited by 1,946
Metadata
- Authors
- Xin, Y., Kong, L., Liu, Z., Chen, Y., Li, Y., Zhu, H., Gao, M., Hou, H., & Wang, C.
- Affiliations
- Guizhou University (CN)
- Shandong University (CN)
- Beijing University of Posts and Telecommunications (CN)
- Venue
- IEEE Access
- Published
- 2018
- Volume
- 6
- Pages
- 35365-35381
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2803881474
- Cited by
- 1,228
- References
- 75
- Citations by year
- 2026: 107 · 2025: 145 · 2024: 170 · 2023: 182 · 2022: 217 · 2021: 196 · 2020: 140 · 2019: 64 · 2018: 7
- FWCI
- 62.84
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Key R&D Program of China (2017YFB0802300)
- Foundation of Guizhou Provincial Key Laboratory of Public Big Data (2017BDKFJJ015)
- Key Research and Development Plan of Shandong Province (2017CXGC1503, 2018GSF118228)
- Natural Science Foundation of Shandong Province (ZR2012FZ005)
- Shandong University (2015JC038)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Physical Sciences › Computer Science › Hardware and Architecture › Network Packet Processing and Optimization
- Physical Sciences › Computer Science › Artificial Intelligence › Internet Traffic Analysis and Secure E-voting
- Keywords
- machine learning for cybersecurity, deep learning for cybersecurity, intrusion detection, network analysis, network datasets, cyberattacks, research challenges
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.