The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Explainable AI for Intrusion Detection Systems: LIME and SHAP Applicability on Multi-Layer Perceptron
Open accessAbstract
Machine learning-based systems have presented increasing learning performance, in a wide variety of tasks. However, the problem with some state-of-the-art models is their lack of transparency, trustworthiness, and explainability. To address this problem, eXplainable Artificial Intelligence (XAI) appeared. It is a research field that aims to make black-box models more understandable to humans. The research on this topic has increased in recent years, and many methods, such as LIME (Local Interpretable Model-Agnostic Explanations) and SHAP (SHapley Additive exPlanations) have been proposed. Machine learning-based Intrusion Detection Systems (IDS) are one of the many application domains of XAI. However, most of the works about model interpretation focus on other fields, like computer vision, natural language processing, biology, healthcare, etc. This poses a challenge for cybersecurity professionals tasked with analyzing IDS results, thereby impeding their capacity to make informed decisions. In an attempt to address this problem, we have selected two XAI methods, LIME, and SHAP. Using the methods, we have retrieved explanations for the results of a black-box model, part of an IDS solution that performs intrusion detection on IoT devices, increasing its interpretability. In order to validate the explanations, we carried out a perturbation analysis where we tried to obtain a different classification based on the features present in the explanations. With the explanations and the perturbation analysis we were able to draw conclusions about the negative impact of particular features on the model results when present in the input data, making it easier for cybersecurity experts when analyzing the model results and it serves as an aid to the continuous improvement the model. The perturbations also serve as a comparison of performance between LIME and SHAP. To evaluate the degree of interpretability increase, and the explanations provided by each XAI method of the model and directly compare the XAI methods, we have performed a survey analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
DARPA's Explainable Artificial Intelligence Program
Gunning, D., & Aha, D. W. (2019) · AI Magazine · doi:10.1609/aimag.v40i2.2850 · Cited by 1,360
Explainable artificial intelligence: A survey
Dosilovic, F. K., Brcic, M., & Hlupic, N. (2018) · 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) · doi:10.23919/mipro.2018.8400040 · Cited by 1,147
Internet of Things security and forensics: Challenges and opportunities
Conti, M., Dehghantanha, A., Franke, K., & Watson, S. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2017.07.060 · Cited by 720
An Explainable Machine Learning Framework for Intrusion Detection Systems
Wang, M., Zheng, K., Yang, Y., & Wang, X. (2020) · IEEE Access · doi:10.1109/access.2020.2988359 · Cited by 355
Robust Network Intrusion Detection Through Explainable Artificial Intelligence (XAI)
Barnard, P., Marchetti, N., & DaSilva, L. A. (2022) · IEEE Networking Letters · doi:10.1109/lnet.2022.3186589 · Cited by 145
Research works printed but not linked: 18
- 10.23919/cisti.2018.8399291 · DOI
- 10.3390/electronics11193079 · DOI · Paper page
- 10.1109/IECON.2018.8591457 · DOI · Paper page
- Mane, 2021, Explaining network intrusion detection system using explainable AI framework, arXiv:2103.07110 · arXiv
- 10.1145/3600160.3605162 · DOI
- 10.1109/ACCESS.2022.3216617 · DOI · Paper page
- 10.1016/j.eswa.2023.121751 · DOI · Paper page
- 10.1609/aaai.v32i1.11491 · DOI · Paper page
- 10.1111/rssb.12377 · DOI · Paper page
- 10.2139/ssrn.3063289 · DOI · Paper page
- Dhurandhar, Explanations based on the missing: Towards contrastive explanations with pertinent negatives, 1
- Molnar, 2022, Interpretable Machine Learning: A Guide for Making Black Box Models Explainable
- 10.1109/WCNC.2013.6555301 · DOI · Paper page
- Creech, 2013, A semantic approach to host-based intrusion detection systems using contiguous and discontiguous system call patterns, IEEE Trans. Comput., 99
- Ribeiro, 2016, Local Interpretable Model-Agnostic Explanations (lime)
- Lundberg, 2018, Welcome To the SHAP Documentation
- 10.1007/978-3-031-20936-9_28 · DOI
- 10.1109/ccnc51644.2023.10060443 · doi:10.1109/ccnc51644.2023.10060443
Cited by
Saeed Alketbi, K., & Mehmood, A. (2025) · IEEE Access · doi:10.1109/access.2025.3587114 · Cited by 41
“Incontrast, LIME excels in providing quick, instance-specific interpretations, as seen in its integration with MLP models for intrusion detection in [65].”
InfluentialExplainable AI: enhancing decision-making in the detection of cyber threats
Prasad, P. W. C., Sayeed, M. S., Nguyen, D.-M., Hutabarat, D. P., & Mohiuddin, G. M. (2026) · Frontiers in Computer Science · doi:10.3389/fcomp.2026.1762332 · Cited by 16
Yagiz, M. A., & Goktas, P. (2025) · arXiv · doi:10.48550/arxiv.2501.00790 · Cited by 12
Explainable anomaly detection in encrypted network traffic using data analytics
Rahman, M. M., Soumik, M. S., Farids, M. S., Abdullah, C. A., Sutrudhar, B., Ali, M., & HOSSAIN, M. S. (2024) · Journal of Computer Science and Technology Studies · doi:10.32996/jcsts.2024.6.1.31 · Cited by 1
Metadata
- Authors
- Gaspar, D., Silva, P., & Silva, C.
- Venue
- IEEE Access
- Published
- 2024
- Volume
- 12
- Pages
- 30164-30175
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4391986380
- Cited by
- 234
- References
- 7
- FWCI
- 34.82
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Autonomous Trust, Security and Privacy Management Framework for Internet of Things (IoT) (101020259(H2020-SU-DS02-2020))
- National Funds through the Foundation for Science and Technology (FCT), I.P.
- Scope of the Project Centro de Informática e Sistemas da Universidade de Coimbra (UID/CEC/00326/2020)
- European Social Fund through the Regional Operational Program Centro, in 2020
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.