Improving IoT Security With Explainable AI: Quantitative Evaluation of Explainability for IoT Botnet Detection
The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Abstract
Detecting botnets is an essential task to ensure the security of IoT systems. Machine learning-based approaches have been widely used for this purpose, but the lack of interpretability and transparency of the models often limits their effectiveness. In this research paper, our aim is to improve the transparency and interpretability of high-performance machine learning models for IoT botnet detection by selecting higher-quality explanations using explainable artificial intelligence (XAI) techniques. We used three datasets to induce binary and multiclass classification models for IoT botnet detection, with Sequential Backward Selection employed as the feature selection technique. We then use two post hoc XAI techniques such as LIME and SHAP, to explain the behaviour of the models. To evaluate the quality of explanations generated by XAI methods, we employed faithfulness, monotonicity, complexity, and sensitivity metrics. ML models employed in this work achieve very high detection rates with a limited number of features. Our findings demonstrate the effectiveness of XAI methods in improving the interpretability and transparency of machine learning-based IoT botnet detection models. Specifically, explanations generated by applying LIME and SHAP to the XGBoost model yield high faithfulness, high Consistency, low complexity, and low sensitivity. Furthermore, SHAP outperforms LIME by achieving better results in these metrics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“According to Kalakoti et al. (2024), there is currently no consensus among researchers on how explanations should be evaluated.”
From Explainable AI: enhancing decision-making in the detection of cyber threats (2026) · cites this paper as Kalakoti et al. (2024)
Citations
Cites
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · cited 2×
“Local interpretable model-agnostic explanations (LIME) [17] and Shapley additive explanation (SHAP) [18] have emerged as prominent local explainers that provide detailed explanations of the given instance and its model output.”
BackgroundMethod17. A Value for n-Person Games
Shapley, L. S. (1953) · Contributions to the Theory of Games (AM-28), Volume II · doi:10.1515/9781400881970-018 · Cited by 6,950
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427 · cited 1×
“The idea of explaining ML models [21], [22] has become increasingly important and has been explored by researchers in various domains [23].”
BackgroundThe Mythos of Model Interpretability
Lipton, Z. C. (2016) · arXiv · doi:10.48550/arxiv.1606.03490 · Cited by 5,422 · cited 1×
“The idea of explaining ML models [21], [22] has become increasingly important and has been explored by researchers in various domains [23].”
BackgroundA detailed analysis of the KDD CUP 99 data set
Tavallaee, M., Bagheri, E., Lu, W., & Ghorbani, A. A. (2009) · 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications · doi:10.1109/cisda.2009.5356528 · Cited by 5,396 · cited 2×
“Furthermore, the study compares the explanations generated for two classifier configurations, namely, the one-versus-all classifier and the multiclass models, using the NSL-KDD data set [45], as done in [8].”
MethodToward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization
Sharafaldin, I., Habibi Lashkari, A., & Ghorbani, A. A. (2018) · Proceedings of the 4th International Conference on Information Systems Security and Privacy · doi:10.5220/0006639801080116 · Cited by 5,318 · cited 1×
“The authors developed an Oracle-based Explainer module that measures the distance between clusters formed from the CICIDS2017 data set [43] and the test instances.”
MethodExplanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Moustafa, N., & Slay, J. (2015) · 2015 Military Communications and Information Systems Conference (MilCIS) · doi:10.1109/milcis.2015.7348942 · Cited by 4,033 · cited 1×
“TRUST XAI has been evaluated through a case study on three data sets, namely, NSL-KDD [45], UNSW [55], and a data set collected from their testbed experiment, called “WUSTL-IIoT,” on intrusion network traffic data.”
MethodExplainable AI: a review of machine learning interpretability methods
Linardatos, P., Papastefanopoulos, V., & Kotsiantis, S. (2020) · Entropy · doi:10.3390/e23010018 · Cited by 2,922 · cited 1×
“However, the quality of these explainability methods has emerged as a concern, as these methods use additional instruments (e.g., linear models at the point of interest, reflect game theory in identifying the importance score), which may introduce errors into the explanations [19].”
Background
Research works printed but not linked: 9
- Svenmarck, Possibilities and challenges for artificial intelligence in military applications, 1
- 10.5555/3001460.3001507 · doi:10.5555/3001460.3001507
- 2012, MAWI working group traffic archive
- 2022, NSL-KDD | Datasets | Research | Canadian Institute for Cybersecurity | UNB
- 2022, Ixia
- 2022, Datasets overview—Stratosphere IPS
- Recio-Garcia, Case-based explanation of classification models for the detection of SQL injection attacks, 1
- 2023, Node-RED
- Sasaki, 2007, The truth of the F-measure, Teach Tutor Mater, 1, 1
Cited by
Securing internet of things using machine and deep learning methods: a survey
Ghaffari, A., Jelodari, N., pouralish, S., Derakhshanfard, N., & Arasteh, B. (2024) · Cluster Computing · doi:10.1007/s10586-024-04509-0 · Cited by 106
Nandanwar, H., & Katarya, R. (2025) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2025.110161 · Cited by 82
Explainable Machine Learning in Critical Decision Systems: Ensuring Safe Application and Correctness
Wiggerthale, J., & Reich, C. (2024) · AI · doi:10.3390/ai5040138 · Cited by 61
Review on improved neural network algorithms for battery state of energy estimation in smart grids
Wang, S., Fu, Y., Zhang, W., Fernández, C., & Blaabjerg, F. (2026) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2026.116797 · Cited by 43
Toward Explainable Reasoning in 6G: A Proof of Concept Study on Radio Resource Allocation
Rezazadeh, F., Barrachina‐Muñoz, S., Chergui, H., Mangues‐Bafalluy, J., Bennis, M., Niyato, D. T., Song, H., & Liu, L. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3466225 · Cited by 37
“From our perspective, XAI approaches can be categorized into ante-hoc [22], in-hoc [23], [24], and post-hoc [25], [26].”
Method
Metadata
- Authors
- Kalakoti, R., Bahsi, H., & Nõmm, S.
- Affiliations
- Tallinn University of Technology (EE)
- Department of Software Science, Tallinn University of Technology, Tallinn, Estonia
- Venue
- IEEE Internet of Things Journal
- Published
- 2024-05-15
- Volume
- 11
- Issue
- 10
- Pages
- 18237-18254
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W4391407003
- Cited by
- 93
- References
- 64
- Citations by year
- 2026: 33 · 2025: 42 · 2024: 17
- FWCI
- 13.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Internet of Things Journal (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Physical Sciences › Computer Science › Information Systems › Internet of Things and AI
- Keywords
- IoT botnet detection, explainable AI, model interpretability, lime, SHAP, explanation quality evaluation, faithfulness, monotonicity, XGBoost, feature selection, Internet of Things security
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Improving IoT Security With Explainable AI: Quantitative Evaluation of Explainability for IoT Botnet Detection. https://app.cochat.ai/papers/10.1109/jiot.2024.3360626
- The paper
- Kalakoti, R., Bahsi, H., & Nõmm, S. (2024). Improving IoT Security With Explainable AI: Quantitative Evaluation of Explainability for IoT Botnet Detection. IEEE Internet of Things Journal. https://doi.org/10.1109/jiot.2024.3360626
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.