The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
An Explainable Machine Learning Framework for Intrusion Detection Systems
Open accessAbstract
In recent years, machine learning-based intrusion detection systems (IDSs) have proven to be effective; especially, deep neural networks improve the detection rates of intrusion detection models. However, as models become more and more complex, people can hardly get the explanations behind their decisions. At the same time, most of the works about model interpretation focuses on other fields like computer vision, natural language processing, and biology. This leads to the fact that in practical use, cybersecurity experts can hardly optimize their decisions according to the judgments of the model. To solve these issues, a framework is proposed in this paper to give an explanation for IDSs. This framework uses SHapley Additive exPlanations (SHAP), and combines local and global explanations to improve the interpretation of IDSs. The local explanations give the reasons why the model makes certain decisions on the specific input. The global explanations give the important features extracted from IDSs, present the relationships between the feature values and different types of attacks. At the same time, the interpretations between two different classifiers, one-vs-all classifier and multiclass classifier, are compared. NSL-KDD dataset is used to test the feasibility of the framework. The framework proposed in this paper leads to improve the transparency of any IDS, and helps the cybersecurity staff have a better understanding of IDSs' judgments. Furthermore, the different interpretations between different kinds of classifiers can also help security experts better design the structures of the IDSs. More importantly, this work is unique in the intrusion detection field, presenting the first use of the SHAP method to give explanations for IDSs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Gauriat, C.-M., Pencolé, Y., Ribot, P., & Brouillet, G. (2024) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.4230/oasics.dx.2024.27 · Cited by 12,586
(2017) · Cited by 11,625
17. A Value for n-Person Games
Shapley, L. S. (1953) · Contributions to the Theory of Games (AM-28), Volume II · doi:10.1515/9781400881970-018 · Cited by 6,950
A detailed analysis of the KDD CUP 99 data set
Tavallaee, M., Bagheri, E., Lu, W., & Ghorbani, A. A. (2009) · 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications · doi:10.1109/cisda.2009.5356528 · Cited by 5,396
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection
Buczak, A. L., & Guven, E. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2494502 · Cited by 3,332
A Deep Learning Approach for Intrusion Detection Using Recurrent Neural Networks
Yin, C., Zhu, Y., Fei, J., & He, X. (2017) · IEEE Access · doi:10.1109/access.2017.2762418 · Cited by 2,100 · cited 2×
“In recent years, more and more IDSs have started to use deep learning methods, such as deep neural network (DNN) [19], convolutional neural networks (CNNs) [20], recurrent neural network (RNN) [21], [22], variational autoencoder (VAE) [23]–[25], etc.”
BackgroundExplainable machine-learning predictions for the prevention of hypoxaemia during surgery
Lundberg, S. M., Nair, B., Vavilala, M. S., Horibe, M., Eisses, M. J., Adams, T., Liston, D. E., Low, D. K.-W., Newman, S.-F., Kim, J., et al. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0304-0 · Cited by 1,967
Deep Learning Approach for Intelligent Intrusion Detection System
Vinayakumar, R., Alazab, M., Soman, K. P., Poornachandran, P., Al-Nemrat, A., & Venkatraman, S. (2019) · IEEE Access · doi:10.1109/access.2019.2895334 · Cited by 1,946
Internet of things and supply chain management: A literature review
Ben-Daya, M., Hassini, E., & Bahroun, Z. (2019) · International Journal of Production Research · doi:10.1080/00207543.2017.1402140 · Cited by 1,501 · cited 1×
“To be specific, the cloud computing, 5G communication, and Internet of things (IoT) ushered in a vigorous development [1]–[3].”
Background5G Internet of Things: A survey
Li, S., Xu, L. D., & Zhao, S. (2018) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2018.01.005 · Cited by 1,293
Techniques for interpretable machine learning
Du, M., Liu, N., & Hu, X. (2019) · Communications of the ACM · doi:10.1145/3359786 · Cited by 1,268
Data Mining Approaches for Intrusion Detection
Lee, W., & Stolfo, S. J. (2000) · doi:10.21236/ada401496 · Cited by 1,179
A data mining framework for building intrusion detection models
Lee, W., Stolfo, S. J., & Mok, K. W. (2003) · Proceedings of the 1999 IEEE Symposium on Security and Privacy (Cat. No.99CB36344) · doi:10.1109/secpri.1999.766909 · Cited by 1,148
In Defense of One-Vs-All Classification
RifkinRyan, & KlautauAldebaro (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1005336 · Cited by 891
Internet of Things security and forensics: Challenges and opportunities
Conti, M., Dehghantanha, A., Franke, K., & Watson, S. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2017.07.060 · Cited by 720
Applying convolutional neural network for network intrusion detection
Vinayakumar, R., Soman, K. P., & Poornachandran, P. (2017) · 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI) · doi:10.1109/icacci.2017.8126009 · Cited by 535
Intrusion detection model using fusion of chi-square feature selection and multi class SVM
Sumaiya Thaseen, I., & Aswani Kumar, C. (2017) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2015.12.004 · Cited by 465
Revathi, S., & Malathi, A. (2013) · Cited by 413
LEMNA: Explaining Deep Learning based Security Applications
Guo, W., Mu, D., Xu, J., Su, P., Wang, G., & Xing, X. (2018) · Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3243734.3243792 · Cited by 287
Yang, Y., Zheng, K., Wu, C., & Yang, Y. (2019) · Sensors · doi:10.3390/s19112528 · Cited by 271
Self-citationA Novel Hierarchical Intrusion Detection System Based on Decision Tree and Rules-Based Models
Ahmim, A., Maglaras, L., Ferrag, M. A., Derdour, M., & Janicke, H. (2019) · 2019 15th International Conference on Distributed Computing in Sensor Systems (DCOSS) · doi:10.1109/dcoss.2019.00059 · Cited by 266
Interpretable Basis Decomposition for Visual Explanation
Zhou, B., Sun, Y., Bau, D., & Torralba, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_8 · Cited by 260
Agarap, A. F. M. (2018) · Proceedings of the 2018 10th International Conference on Machine Learning and Computing · doi:10.1145/3195106.3195117 · Cited by 259
Senyo, P. K., Addae, E., & Boateng, R. (2018) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2017.07.007 · Cited by 256
Intrusion Detection Using Convolutional Neural Networks for Representation Learning
Li, Z., Qin, Z., Huang, K., Yang, X., & Ye, S. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70139-4_87 · Cited by 232
Method of intrusion detection using deep neural network
Kim, J., Shin, N., Jo, S. Y., & Kim, S. H. (2017) · 2017 IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp.2017.7881684 · Cited by 223
A novel statistical technique for intrusion detection systems
Kabir, E., Hu, J., Wang, H., & Zhuo, G. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2017.01.029 · Cited by 216
Transparency and Explanation in Deep Reinforcement Learning Neural Networks
Iyer, R., Li, Y., Li, H., Lewis, M., Sundar, R., & Sycara, K. P. (2018) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3278721.3278776 · Cited by 216
From intrusion detection to attacker attribution: A comprehensive survey of unsupervised methods
Nisioti, A., Mylonas, A., Yoo, P. D., & Katos, V. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2854724 · Cited by 212
Introducing Deep Learning Self-Adaptive Misuse Network Intrusion Detection Systems
Papamartzivanos, D., Gomez Marmol, F., & Kambourakis, G. (2019) · IEEE Access · doi:10.1109/access.2019.2893871 · Cited by 174
An Adversarial Approach for Explainable AI in Intrusion Detection Systems
Marino, D. L., Wickramasinghe, C. S., & Manic, M. (2018) · IECON 2018 - 44th Annual Conference of the IEEE Industrial Electronics Society · doi:10.1109/iecon.2018.8591457 · Cited by 159
Principle components analysis and Support Vector Machine based Intrusion Detection System
Eid, H. F., Darwish, A., Hassanien, A. E., & Abraham, A. (2010) · International Conference on Intelligent Systems Design and Applications (ISDA) · doi:10.1109/isda.2010.5687239 · Cited by 143
Intrusion detection systems in Internet of Things: A literature review
Santos, L., Rabadao, C. M. D. S., & Gonçalves, R. (2018) · Iberian Conference on Information Systems and Technologies (CISTI) · doi:10.23919/cisti.2018.8399291 · Cited by 142
Local Interpretable Model-Agnostic Explanations For Music Content Analysis.
Mishra, S., Sturm, B. L. T., & Dixon, S. (2017) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1417386 · Cited by 129
Learning nonstationary models of normal network traffic for detecting novel attacks
Mahoney, M. V., & Chan, P. K. (2002) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/775094.775102 · Cited by 112
Integrated Intrusion Detection Model Using Chi-Square Feature Selection and Ensemble of Classifiers
Thaseen, I. S., Cherukuri, A. K., & Ahmad, A. (2018) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-018-3507-5 · Cited by 111
Malik, A. J., & Khan, F. A. (2017) · Cluster Computing · doi:10.1007/s10586-017-0971-8 · Cited by 99
Evaluating effectiveness of shallow and deep networks to intrusion detection system
Vinayakumar, R., Soman, K. P., & Poornachandran, P. (2017) · International Conference on Advances in Computing, Communications and Informatics (ICACCI) · doi:10.1109/icacci.2017.8126018 · Cited by 89
Host-based misuse intrusion detection using PCA feature extraction and kNN classification algorithms
Serpen, G., & Aghaei, E. (2018) · Intelligent Data Analysis · doi:10.3233/ida-173493 · Cited by 75
Network Intrusion Detection Method Based on PCA and Bayes Algorithm
Zhang, B., Liu, Z., Jia, Y., Ren, J., & Zhao, X. (2018) · Security and Communication Networks · doi:10.1155/2018/1914980 · Cited by 73
Enabling Dynamic Network Access Control with Anomaly-based IDS and SDN
Li, H., Feng, W. Q., & Hu, H. (2019) · ACM International Workshop on Security in Software Defined Networks & Network Function Virtualization (SDN-NFV Sec) · doi:10.1145/3309194.3309199 · Cited by 61
Variational data generative model for intrusion detection
López‐Martín, M., Carro, B., & Sánchez-Esguevillas, A. (2018) · Knowledge and Information Systems · doi:10.1007/s10115-018-1306-7 · Cited by 60
Explanations of Black-Box Model Predictions by Contextual Importance and Utility
Anjomshoae, S., Främling, K., & Najjar, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30391-4_6 · Cited by 54
Improving User Trust on Deep Neural Networks Based Intrusion Detection Systems
Amarasinghe, K., & Manic, M. (2018) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon.2018.8591322 · Cited by 47
Extracting salient features for network intrusion detection using machine learning methods
Staudemeyer, R. C., & Omlin, C. W. P. (2014) · South African Computer Journal · doi:10.18489/sacj.v52i0.200 · Cited by 40
Learning Latent Distribution for Distinguishing Network Traffic in Intrusion Detection System
Vu, L., Cao, V. L., Nguyen, Q. U., Nguyen, D. N., Hoang, D. T., & Dutkiewicz, E. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8762015 · Cited by 38
An interpretable machine learning model of biological age
Wood, T. R., Kelly, C., Roberts, M., & Walsh, B. (2019) · F1000Research · doi:10.12688/f1000research.17555.1 · Cited by 21
Detecting anomalies in robot time series data using stochastic recurrent networks
Sölch, M. (2015) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 6
Cited by
Adversarial Machine Learning for Network Intrusion Detection Systems: A Comprehensive Survey
He, K., Kim, D. D., & Asghar, M. R. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3233793 · Cited by 450
Explainable Artificial Intelligence in CyberSecurity: A Survey
Capuano, N., Fenza, G., Loia, V., & Stanzione, C. (2022) · IEEE Access · doi:10.1109/access.2022.3204171 · Cited by 330
Le, T.-T.-H., Kim, H., Kang, H., & Kim, H. (2022) · Sensors · doi:10.3390/s22031154 · Cited by 208
Explainable artificial intelligence for cybersecurity: a literature survey
Charmet, F., Tanuwidjaja, H. C., Ayoubi, S., Gimenez, P.-F., Han, Y., Jmila, H., Blanc, G., Takahashi, T., & Zhang, Z. (2022) · Annals of Telecommunications · doi:10.1007/s12243-022-00926-7 · Cited by 167
A survey on explainable artificial intelligence for cybersecurity
Rjoub, G., Bentahar, J., Abdel Wahab, O., Mizouni, R., Song, A., Cohen, R., Otrok, H., & Mourad, A. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3282740 · Cited by 158
Metadata
- Authors
- Wang, M., Zheng, K., Yang, Y., & Wang, X.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 73127-73141
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3017093935
- Cited by
- 355
- References
- 53
- FWCI
- 18.39
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.