CoChat
Cited by 234

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Explainable AI for Intrusion Detection Systems: LIME and SHAP Applicability on Multi-Layer Perceptron

Open access
Gaspar, Diogo, Silva, Paulo, Silva, Catarina · 2024 · IEEE Access

Abstract

Machine learning-based systems have presented increasing learning performance, in a wide variety of tasks. However, the problem with some state-of-the-art models is their lack of transparency, trustworthiness, and explainability. To address this problem, eXplainable Artificial Intelligence (XAI) appeared. It is a research field that aims to make black-box models more understandable to humans. The research on this topic has increased in recent years, and many methods, such as LIME (Local Interpretable Model-Agnostic Explanations) and SHAP (SHapley Additive exPlanations) have been proposed. Machine learning-based Intrusion Detection Systems (IDS) are one of the many application domains of XAI. However, most of the works about model interpretation focus on other fields, like computer vision, natural language processing, biology, healthcare, etc. This poses a challenge for cybersecurity professionals tasked with analyzing IDS results, thereby impeding their capacity to make informed decisions. In an attempt to address this problem, we have selected two XAI methods, LIME, and SHAP. Using the methods, we have retrieved explanations for the results of a black-box model, part of an IDS solution that performs intrusion detection on IoT devices, increasing its interpretability. In order to validate the explanations, we carried out a perturbation analysis where we tried to obtain a different classification based on the features present in the explanations. With the explanations and the perturbation analysis we were able to draw conclusions about the negative impact of particular features on the model results when present in the input data, making it easier for cybersecurity experts when analyzing the model results and it serves as an aid to the continuous improvement the model. The perturbations also serve as a comparison of performance between LIME and SHAP. To evaluate the degree of interpretability increase, and the explanations provided by each XAI method of the model and directly compare the XAI methods, we have performed a survey analysis.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/access.2024.3368377

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Research works printed but not linked: 17

  1. 10.23919/cisti.2018.8399291 · DOI
  2. 10.3390/electronics11193079 · DOI · Paper page
  3. 10.1109/IECON.2018.8591457 · DOI · Paper page
  4. Mane, 2021, Explaining network intrusion detection system using explainable AI framework, arXiv:2103.07110 · arXiv
  5. 10.1145/3600160.3605162 · DOI
  6. 10.1109/ACCESS.2022.3216617 · DOI · Paper page
  7. 10.1016/j.eswa.2023.121751 · DOI · Paper page
  8. 10.1609/aaai.v32i1.11491 · DOI · Paper page
  9. 10.2139/ssrn.3063289 · DOI · Paper page
  10. Dhurandhar, Explanations based on the missing: Towards contrastive explanations with pertinent negatives, 1
  11. Molnar, 2022, Interpretable Machine Learning: A Guide for Making Black Box Models Explainable
  12. 10.1109/WCNC.2013.6555301 · DOI · Paper page
  13. Creech, 2013, A semantic approach to host-based intrusion detection systems using contiguous and discontiguous system call patterns, IEEE Trans. Comput., 99
  14. Ribeiro, 2016, Local Interpretable Model-Agnostic Explanations (lime)
  15. Lundberg, 2018, Welcome To the SHAP Documentation
  16. 10.1007/978-3-031-20936-9_28 · DOI
  17. 10.1109/ccnc51644.2023.10060443 · doi:10.1109/ccnc51644.2023.10060443

Cited by

Metadata

Authors
Gaspar, D., Silva, P., & Silva, C.
Venue
IEEE Access
Published
2024
Volume
12
Pages
30164-30175
ISSN
2169-3536 (ISSN-L)
OpenAlex
W4391986380
Cited by
234
References
8
FWCI
34.82
Type
journal article
Language
en
Open access
gold
Funders
  • Autonomous Trust, Security and Privacy Management Framework for Internet of Things (IoT) (101020259(H2020-SU-DS02-2020))
  • National Funds through the Foundation for Science and Technology (FCT), I.P.
  • Scope of the Project Centro de Informática e Sistemas da Universidade de Coimbra (UID/CEC/00326/2020)
  • European Social Fund through the Regional Operational Program Centro, in 2020

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.