Explainable Intrusion Detection for Cyber Defences in the Internet of Things: Opportunities and Solutions
The DOI matches its Crossref record; 191 of the 192 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
The field of Explainable Artificial Intelligence (XAI) has garnered considerable research attention in recent years, aiming to provide interpretability and confidence to the inner workings of state-of-the-art deep learning models. However, XAI-enhanced cybersecurity measures in the Internet of Things (IoT) and its sub-domains, require further investigation to provide effective discovery of attack surfaces, their corresponding vectors, and interpretable justification of model outputs. Cyber defence involves operations conducted in the cybersecurity field supporting mission objectives to identify and prevent cyberattacks using various tools and techniques, including intrusion detection systems (IDS), threat intelligence and hunting, and intrusion prevention. In cyber defence, especially anomaly-based IDS, the emerging applications of deep learning models require the interpretation of the models’ architecture and the explanation of models’ prediction to examine how cyberattacks would occur. This paper presents a comprehensive review of XAI techniques for anomaly-based intrusion detection in IoT networks. Firstly, we review IDSs focusing on anomaly-based detection techniques in IoT and how XAI models can augment them to provide trust and confidence in their detections. Secondly, we review AI models, including machine learning (ML) and deep learning (DL), for anomaly detection applications and IoT ecosystems. Moreover, we discuss DL’s ability to effectively learn from large-scale IoT datasets, accomplishing high performances in discovering and interpreting security events. Thirdly, we demonstrate recent research on the intersection of XAI, anomaly-based IDS and IoT. Finally, we discuss the current challenges and solutions of XAI for security applications in the cyber defence perspective of IoT networks, revealing future research directions. By analysing our findings, new cybersecurity applications that require XAI models emerge, assisting decision-makers in understanding and explaining security events in compromised IoT networks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“By integrating XAI techniques, these models can highlight which features such as unusual packet sizes, protocol usage, or temporal patterns triggered an anomaly flag, thereby aiding analysts in decision-making and improving system resilience (Moustafa et al., 2023).”
From Explainable AI: enhancing decision-making in the detection of cyber threats (2026) · cites this paper as Moustafa et al., 2023
In the citing paper
“In cybersecurity practice, XAI has become critical not only for intrusion detection systems, where it helps reduce false positives and improve analyst trust, but also in IoT and IIoT networks, where it highlights abnormal device behavior, and in forensic and compliance contexts, where transparency is necessary to meet regulatory demands such as the EU AI Act (Nwakanma et al., 2023;Moustafa et al.,”
From Explainable AI: enhancing decision-making in the detection of cyber threats (2026) · cites this paper as Moustafa et al., 2023
In the citing paper
“Likewise, Moustafa et al. (2023) stress that this problem is particularly acute in IoTfocused domains, where inconsistent assessment undermines confidence in proposed solutions.”
From Explainable AI: enhancing decision-making in the detection of cyber threats (2026) · cites this paper as Moustafa et al. (2023)
In the citing paper
“Moustafa et al. (2023) explicitly highlight that “most current XAI methods produce results that only make sense to researchers, ” emphasizing that while the academic community may appreciate the novelty of these methods, they remain inaccessible to those working on the frontlines of cybersecurity defence.”
From Explainable AI: enhancing decision-making in the detection of cyber threats (2026) · cites this paper as Moustafa et al. (2023)
In the citing paper
“While partial dependence plots result in a significantly biased computed feature effect, ALEs provide a faster and unbiased substitute for visualisation [138,139].”
From Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence (2024) · cites this paper as [138]
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · cited 2×
“The Permutation Feature Importance (PFI) was first introduced in 2001 by Breiman [144] and measures the increase in prediction error of a fitted model after permuting the feature’s values.”
BackgroundA Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Gauriat, C.-M., Pencolé, Y., Ribot, P., & Brouillet, G. (2024) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.4230/oasics.dx.2024.27 · Cited by 12,586
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
17. A Value for n-Person Games
Shapley, L. S. (1953) · Contributions to the Theory of Games (AM-28), Volume II · doi:10.1515/9781400881970-018 · Cited by 6,950
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678 · cited 2×
“Semi-supervised learning is helpful in many scenarios when data collecting is expensive, time-consuming or even unrealistic [112].”
BackgroundMethodPeeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Research works printed but not linked: 28
- Morgan, 2020, Cybercrime to Cost the World $10.5 Trillion Annually by 2025
- 2021, Australian cyber security centre annual cyber threat report 2020–21
- Das, 2018, Direct costs associated with cybersecurity incidents costs Australian businesses $29 billion per annum
- 2020, U.S. government to spend over $18 billion on cybersecurity—Atlas VPN
- De Luca, 2021, Explainable artificial intelligence for workflow verification in visual IoT/robotics programming language environment, J. Artif. Intell. Technol., 1, 21
- 2021, Explainable and trustworthy artifcial intelligence
- 2021, Explainable AI for healthcare
- 2021, Theoretic foundation, criticism, and application trend of explainable AI
- 2020, Explainable artificial intelligence
- 2020, Interpretable & explainable machine vision
- 2019, Interpreting, explaining and visualizing deep learning
- 2019, Explainable deep learning for efficient and robust pattern recognition
- 2019, Explainable artificial intelligence (XAI)
- 2019, Interpretating and explaining visual artifcial intelligence models
- 2020, Explainable artificial intelligence (XAI)
- 2020, ACM conference on fairness, accountability, and transparency
- 2019, What happens when self-driving cars kill people
- Martin, 2021, Cyber kill chain
- Singh, 2014, Computer network and information security, Comput. Netw. Inf. Security, 8, 41
- Anderson, Evading machine learning malware detection, 9
- Goodfellow, 2016, Deep Learning, 1
- Raschka, 2017, Python Machine Learning—Second Edition
- 10.5555/3045118.3045336 · doi:10.5555/3045118.3045336
- 10.2307/2699986 · doi:10.2307/2699986
- 2016, Fog Computing and the Internet of Things: Extend the Cloud to Where the Things Are
- 2020, 2020 unit 42 IoT threat report
- Amershi, 2020, Research collection: Research supporting Responsible Ai
- 2021, Responsible AI practices
Cited by
Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence
Hassija, V., Chamola, V., Mahapatra, A., Singal, A., Goel, D., Huang, K., Scardapane, S., Spinelli, I., Mahmud, M., & Hussain, A. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10179-8 · Cited by 2,495
“While partial dependence plots result in a significantly biased computed feature effect, ALEs provide a faster and unbiased substitute for visualisation [138, 139].”
BackgroundFerrag, M. A., Ndhlovu, M., Tihanyi, N., Cordeiro, L. C., Debbah, M., Lestable, T., & Thandi, N. S. (2024) · IEEE Access · doi:10.1109/access.2024.3363469 · Cited by 312
“With the rise in the number of IoT devices, there is also a growing incidence of cyber threats, posing substantial challenges to the security of diverse systems and networks [2].”
BackgroundInternet of Things and Wireless Sensor Networks for Smart Agriculture Applications: A Survey
Mowla, M. N., Mowla, N., Shah, A. F. M. S., Rabie, K. M., & Shongwe, T. (2023) · IEEE Access · doi:10.1109/access.2023.3346299 · Cited by 297
Walia, G. K., Kumar, M., & Gill, S. S. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3338015 · Cited by 279
Deep learning for cyber threat detection in IoT networks: A review
Aldhaheri, A., Alwahedi, F., Ferrag, M. A., & Battah, A. (2024) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.09.003 · Cited by 180
Explainable AI in Manufacturing and Industrial Cyber–Physical Systems: A Survey
Moosavi, S., Farajzadeh-Zanjani, M., Razavi‐Far, R., Palade, V., & Saif, M. (2024) · Electronics · doi:10.3390/electronics13173497 · Cited by 194
Vivek Menon, U., Kumaravelu, V. B., Vinoth Kumar, C., Rammohan, A., Chinnadurai, S., Venkatesan, R., Hai, H., & Selvaprabhu, P. (2025) · IEEE Access · doi:10.1109/access.2025.3551750 · Cited by 189
“Then, the authors thoroughly examined XAI methods for detecting anomalies in IoT networks used for intrusion detection [244].”
Khan, N., Ahmad, K., Tamimi, A. A., Alani, M. M., Bermak, A., & Khalil, I. M. (2025) · Information · doi:10.3390/info16121036 · Cited by 144
Explainable AI-based innovative hybrid ensemble model for intrusion detection
Ahmed, U., Jiangbin, Z., Almogren, A., Khan, S., Sadiq, M. T., Altameem, A., & Rehman, A. U. (2024) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-024-00712-x · Cited by 133
“The opacity compromises the confidence of the security experts in the alerts and adds complexity to the investigation and response process [9].”
BackgroundSecuring the IoT Cyber Environment: Enhancing Intrusion Anomaly Detection With Vision Transformers
Sana, L., Nazir, M., Yang, J., Hussain, L., Chen, Y., Ku, C. S., Alatiyyah, M. H., Alateyah, S. A., & Por, L. Y. (2024) · IEEE Access · doi:10.1109/access.2024.3404778 · Cited by 124
“Numerous IDS solutions have been developed to secure internet communication [17], [18], [19], [20].”
BackgroundWang, X., Wang, B., Wu, Y., Ning, Z., Guo, S., & Yu, F. R. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3446585 · Cited by 130
“In addition, authors in [29] discuss how to leverage the importance of XAI in Intrusion Detection Systems (IDS) in IoT environments for enhancing cybersecurity defenses from the perspective of XAI.”
Kalakoti, R., Bahsi, H., & Nõmm, S. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3360626 · Cited by 93
“XAI approaches for ID are still in their early stages, with limited available literature [11], [12], [13], [14].”
BackgroundRecent endeavors in machine learning-powered intrusion detection systems for the Internet of Things
Manivannan, D. (2024) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2024.103925 · Cited by 93
Nascita, A., Aceto, G., Ciuonzo, D., Montieri, A., Persico, V., & Pescapè, A. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3504955 · Cited by 102
“Notably, the survey in [27] is the only one that does not extensively discuss relevant IoT use cases for XAI which is a key pillar of the other works.”
Farrukh, Y. A., Wali, S. W., Khan, I., & Bastian, N. D. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128089 · Cited by 94
Ullah, S., Boulila, W., Koubâa, A., & Ahmad, J. E. (2023) · IEEE Access · doi:10.1109/access.2023.3324657 · Cited by 71
“In recent years, machine learning (ML) and deep learning (DL) have emerged as indispensable tools in the field of IDS, significantly enhancing the ability to detect malicious activities within networks [20], [21], [22], [23], [24].”
BackgroundA Comprehensive Review of AI’s Current Impact and Future Prospects in Cybersecurity
Siam, A. A., Alazab, M., Awajan, A. W., & Faruqui, N. (2025) · IEEE Access · doi:10.1109/access.2025.3528114 · Cited by 88
“The limitations of using DL on large IoT datasets are discussed along with current research in XAI, IDS, and IoT [84].”
Phalaagae, P., Zungeru, A. M., Yahya, A., Sigweni, B., & Rajalakshmi, S. (2025) · IEEE Access · doi:10.1109/access.2025.3555861 · Cited by 67
“As WIoTSNs become increasingly prevalent, addressing security challenges, particularly in implementing robust intrusion detection mechanisms, becomes crucial to ensure the resilience and dependability of vital systems across diverse sectors [1].”
Fatima, M., Rehman, O. M. H., Rahman, I. M. H., Ajmal, A., & Park, S. J. (2024) · Future Internet · doi:10.3390/fi16100368 · Cited by 80
Farrukh, Y. A., Wali, S., Khan, I., & Bastian, N. D. (2024) · arXiv · doi:10.48550/arxiv.2408.16021 · Cited by 56
Gaggero, G. B., Armellin, A., Portomauro, G., & Marchese, M. (2024) · IEEE Access · doi:10.1109/access.2024.3395991 · Cited by 55
“Recent scientific literature has increasingly delved into areas such as Artificial Intelligence (AI) and Machine Learning (ML) for IDSs and IPSs, which have shown particular efficacy for the identification of unforeseen attacks [1], [2], [3].”
BackgroundLeveraging AI for Intrusion Detection in IoT Ecosystems: A Comprehensive Study
Sharma, S. B., & Bairwa, A. K. (2025) · IEEE Access · doi:10.1109/access.2025.3550392 · Cited by 74
Explainable Artificial Intelligence for Resilient Security Applications in the Internet of Things
Masud, M. T., Keshk, M., Moustafa, N., Linkov, I., & Emge, D. K. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3413790 · Cited by 71
“Similarly, the authors of [24] concentrated on anomaly-based IDSs in IoT networks, evaluating various IDS types in IoT settings.”
Self-citationPradhan, A., Das, S., Piran, M. J., & Han, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3429285 · Cited by 57
Multi-objective optimization algorithms for intrusion detection in IoT networks: A systematic review
Sharma, S., Kumar, V., & Dutta, K. (2024) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2024.01.003 · Cited by 56
Dubey, P., & Kumar, M. (2024) · Computer Science Review · doi:10.1016/j.cosrev.2024.100697 · Cited by 56
Explainable Artificial Intelligence: Importance, Use Domains, Stages, Output Shapes, and Challenges
Ullah, N., Khan, J. A., Falco, I. D., & Sannino, G. (2024) · ACM Computing Surveys · doi:10.1145/3705724 · Cited by 89
Chaganti, K. C. (2025) · IEEE Access · doi:10.1109/access.2025.3558623 · Cited by 58
“The trade-off between security performance and energy constraints is well balanced [29], [30].”
A comprehensive review of explainable AI in cybersecurity: Decoding the black box
Sharma, A., Rani, S., & Shabaz, M. (2025) · ICT Express · doi:10.1016/j.icte.2025.10.004 · Cited by 57
Leveraging AI for Network Threat Detection—A Conceptual Overview
Paracha, M. A., Jamil, S. U., Shahzad, K., Khan, M. A., & Rasheed, A. (2024) · Electronics · doi:10.3390/electronics13234611 · Cited by 51
A systematic review of anomaly detection in IoT security: towards quantum machine learning approach
Aparcana-Tasayco, A. J., Deng, X., & Park, J. H. (2025) · EPJ Quantum Technology · doi:10.1140/epjqt/s40507-025-00414-6 · Cited by 51
“It is helpful when labeling data is time-consuming or even unrealistic [24].”
InfluentialGeorgiades, M., & Hussain, F. (2025) · Electronics · doi:10.3390/electronics14163218 · Cited by 47
Saeed Alketbi, K., & Mehmood, A. (2025) · IEEE Access · doi:10.1109/access.2025.3587114 · Cited by 41
“TreeInterpreter, also highlighted in [80], provides hierarchical explanations for decision trees, making it an effective tool for intuitive visualization.”
Explainable AI-based intrusion detection in IoT systems
Hulayyil, S. B., Li, S., & Saxena, N. (2025) · Internet of Things · doi:10.1016/j.iot.2025.101589 · Cited by 41
Kalakoti, R., Nõmm, S., & Bahşi, H. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111479 · Cited by 55
Interpretable Machine Learning Techniques for an Advanced Crop Recommendation Model
Bouni, M., Hssina, B., Douzi, K., & Douzi, S. (2024) · Journal of Electrical and Computer Engineering · doi:10.1155/2024/7405217 · Cited by 40
Alsadie, D. (2025) · IET Information Security · doi:10.1049/ise2/2046868 · Cited by 40
“Similarly, Moustafa et al. [131] and Masud et al. [132] explored anomaly-based intrusion detection in IoT ecosystems, demonstrating that DL models can effectively detect cyber threats, but their opacity hinders trust in AI-driven security solutions.”
Khediri, A., Slimi, H., Yahiaoui, A., Derdour, M., Bendjenna, H., & Ghenai, C. E. (2024) · International Conference on Pattern Analysis and Intelligent Systems (PAIS) · doi:10.1109/pais62114.2024.10541168 · Cited by 58
Perumal, G., Subburayalu, G., Abbas, Q., Naqi, S. M., & Qureshi, I. (2023) · Systems · doi:10.3390/systems11080436 · Cited by 37
“The Internet of Things (IoT) is a new technology that enables the seamless linking of various devices to deliver services and automate processes across a variety of industries [1,2], from our everyday lives to vital infrastructure systems.”
BackgroundHassan, A., Nizam‐Uddin, N., Quddus, A., Hassan, S. R., Rehman, A. U., & Bharany, S. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.057877 · Cited by 55
Vellela, S. S., Roja, D., Purimetla, N. R., Syamsundararao, T., Vuyyuru, L. R., & Vatambeti, R. (2025) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2025.110368 · Cited by 34
Ogunseyi, T. B., Thiyagarajan, G., He, H., Bist, V., & Du, Z. (2026) · Sensors · doi:10.3390/s26020363 · Cited by 38
“Without such insights, trust in automated detection mechanisms may be eroded, potentially resulting in hesitance to rely on these technologies in real-time security scenarios [8].”
SXAD: Shapely eXplainable AI-Based Anomaly Detection Using Log Data
Alam, K., Kifayat, K., Sampedro, G. A., Karovič, V., & Naeem, T. (2024) · IEEE Access · doi:10.1109/access.2024.3425472 · Cited by 32
“These models integrate both local and global justification generation for individual input or for the entire model [10].”
BackgroundData Anomaly Detection in the Internet of Things: A Review of Current Trends and Research Challenges
Yang, M., & Zhang, J. (2023) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2023.0140901 · Cited by 31
The Missing Link in Network Intrusion Detection: Taking AI/ML Research Efforts to Users
Dietz, K., Mühlhauser, M., Kögel, J., Schwinger, S., Sichermann, M., Seufert, M., Herrmann, D., & Hoßfeld, T. (2024) · IEEE Access · doi:10.1109/access.2024.3406939 · Cited by 38
“On the contrary, newer surveys [12], [13], [14] include explainability and – to a limited extent – usability or privacy aspects, while only partially focusing on the practicability and feasibility of IDS.”
BackgroundMethodYao, W., Hai, Z., & Shi, H. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3348117 · Cited by 39
“An IDS based on anomaly detection can scrutinizes the received IoT flows and compares any discrepancy from normal activities as anomaly, which is effective against unknown, novel, and malicious attacks [7].”
BackgroundPakrooh, R., Jabbari, A., & Fung, C. (2024) · IEEE Access · doi:10.1109/access.2024.3377561 · Cited by 32
“However, for more complex and deep models, we usually need some post hoc methods to explain the decision-making process of the model [21].”
BackgroundMethodInfluentialKumar, P., Javeed, D., Islam, A. K. M. N., & Luo, X. (2024) · Decision Support Systems · doi:10.1016/j.dss.2024.114351 · Cited by 24
Deep Reinforcement Learning for Autonomous Cyber Defence: A SurveyPreprint
Palmer, G., Parry, C., Harrold, D. J. B., & Willis, C. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.07745 · Cited by 43
Challenges of Explainable AI in Security Decision-Making
Selvakumar, P., Singh, C., Basu, S. K., Manjunath, T. C., Shalini, S. N., & Mishra, R. K. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-1498-1.ch004 · Cited by 29
A comprehensive survey on intrusion detection algorithms
Li, Y., Li, Z., & Li, M. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2024.109863 · Cited by 30
Adaptable, incremental, and explainable network intrusion detection systems for internet of things
Cerasuolo, F., Bovenzi, G., Ciuonzo, D., & Pescapè, A. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110143 · Cited by 30
A Novel Hybrid Architecture for Superior IoT Threat Detection through Real IoT Environments
Elzaghmouri, B. M., Jbara, Y. H. F., Elaiwat, S., Innab, N., Osman, A. A. F., Ataelfadiel, M., Zawaideh, F. H., Alawneh, M. F., Al-Khateeb, A., & Abu-Zanona, M. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.054836 · Cited by 25
Artificial Intelligence for Cybersecurity: A State of the Art
Siam, A. A., Hassan, M. M., & Bhuiyan, T. (2025) · IEEE International Conference on AI in Cybersecurity (ICAIC) · doi:10.1109/icaic63015.2025.10848980 · Cited by 30
“It examines how to improve anomaly-based detection techniques using XAI and Intrusion Detection Systems (IDSs), therefore ensuring trust in their findings [21].”
Bhukya, C. R., Thakur, P., Mudhivarthi, B. R., & Singh, G. K. (2023) · Sensors · doi:10.3390/s23198107 · Cited by 33
“The EAI method can become the most suitable for IOMV systems, where peer-to-peer communication takes place between healthcare devices, and anomaly-based intrusion detection in the IOMV networks [114,115].”
MethodAlsharaiah, M. A., Almaiah, M. A., Shehab, R., Obeidat, M. R. M., El-Qirem, F. A., & Aldhyani, T. H. H. (2025) · Discover Applied Sciences · doi:10.1007/s42452-025-07071-5 · Cited by 23
“Much research into sophisticated intrusion detection methods to counter online threats has been spurred by the growing need for better cybersecurity solutions [4].”
Explainable AI in IoT: A Survey of Challenges, Advancements, and Pathways to Trustworthy Automation
Moss, J., Gordon, J., Duclos, W., Liu, Y., Wang, Q., & Wang, J. (2025) · Electronics · doi:10.3390/electronics14234622 · Cited by 34
Mahalingam, A., Perumal, G., Subburayalu, G., Albathan, M., AlTameem, A., Almakki, R. S., Hussain, A., & Abbas, Q. (2023) · Sensors · doi:10.3390/s23198044 · Cited by 30
“3 billion, the international data corporation (IDC) anticipated that there would be 42 billion connected IoT gadgets generating 80 Zetta Bytes (ZB) of data in 2025 [3,4].”
BackgroundSecurity Considerations in Generative AI for Web Applications
Sindiramutty, S. R., Prabagaran, K. R. V., Jhanjhi, N. Z., Ghazanfar, M. A., Malik, N. A., & Soomro, T. R. (2024) · Advances in information security, privacy, and ethics book series · doi:10.4018/979-8-3693-5415-5.ch009 · Cited by 24
Abdalzaher, M. S., Krichen, M., Shaaban, M. F., & Fouda, M. M. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3613669 · Cited by 22
“First, IDPSs are used to enhance early threat identification, mitigate real-time attacks, improve system visibility, and compliance support [53], [311], [312], [313], [314].”
Image Denoising Techniques for Cybersecurity and Forensic Applications: AI-Driven Approaches
Zangana, H. M., & Mustafa, F. M. (2024) · Advances in information security, privacy, and ethics book series · doi:10.4018/979-8-3373-0588-2.ch005 · Cited by 22
Explainable Anomaly Detection of Synthetic Medical IoT Traffic Using Machine Learning
Aversano, L., Bernardi, M. L., Cimitile, M., Montano, D., Pecori, R., & Veltri, L. (2024) · SN Computer Science · doi:10.1007/s42979-024-02830-4 · Cited by 23
“Concerning the application of explainable models to the anomaly detection of IoT traffic, such a research topic has been investigated more and more in the last years [31].”
Multimodal fusion based few-shot network intrusion detection system
Xu, C., Zhan, Y., Wang, Z., & Yang, J. (2025) · Scientific Reports · doi:10.1038/s41598-025-05217-4 · Cited by 27
Lightbody, D., Ngo, D., Temko, A., Murphy, C. C., & Popovici, E. M. (2024) · Future Internet · doi:10.3390/fi16030088 · Cited by 21
Enhancing IoT Security With Trust Management Using Ensemble XGBoost and AdaBoost Techniques
Awan, K. A., Din, I. U., Almogren, A., Kim, B.-S., & Guizani, M. (2024) · IEEE Access · doi:10.1109/access.2024.3413600 · Cited by 21
“In turn, they can cause IoT systems to lose their efficiency and reliability [17].”
BackgroundPai, H.-T., Kang, Y.-H., & Chung, W.-C. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3488967 · Cited by 21
“Applying XAI to IDS presents challenges, requiring further research for the effective identification of attack surfaces and the interpretable justification of model outputs [7].”
BackgroundKomal, A., & Li, S. (2026) · Sensors · doi:10.3390/s26113405 · Cited by 24
“Responsible AI [110–112] Poor policy alignment, ethical bias, lack of explanations.”
Chander, N., & Kumar, M. U. (2024) · Cluster Computing · doi:10.1007/s10586-024-04303-y · Cited by 19
“Anomalous data specify that serious condition happens in a process, a system is wasting its resource, or a device shows anomalous conduct [6].”
Defending the Cloud: Understanding the Role of Explainable AI in Intrusion Detection Systems
Upadhyay, U., Kumar, A., Roy, S., Rawat, U., & Chaurasia, S. (2023) · International Conference on Security of Information and Networks (SIN) · doi:10.1109/sin60469.2023.10475080 · Cited by 25
“The transition from traditional IDS to XAI-enhanced IDS marks a paradigm shift that seeks to remedy the inherent challenges of conventional approaches [35].”
BackgroundSurvey on Unified Threat Management (UTM) Systems for Home Networks
Siddiqui, A., Rimal, B. P., Reisslein, M., & Wang, Y. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3382470 · Cited by 25
Oki, A., Ogawa, Y., Ota, K., & Dong, M. (2024) · IEEE Networking Letters · doi:10.1109/lnet.2024.3465516 · Cited by 20
“XAI has also been highlighted as an approach to enhance transparency for ML-based IDSs, especially when dealing with black-box IDS models [6].”
BackgroundMetaWatch: Trends, Challenges, and Future of Network Intrusion Detection in the Metaverse
Nkoro, E. C., Njoku, J. N., Nwakanma, C. I., Lee, J., & Kim, D. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3568477 · Cited by 23
“Reinforcement learning ultimately encourages the model to learn from dynamic network traffic to improve performance [65].”
Rawat, M., & Singal, G. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3744745 · Cited by 21
Federated Learning with Homomorphic Encryption: A Privacy-Preserving Solution for Smart Cities
Alqazzaz, A. (2025) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-025-00829-0 · Cited by 19
“Moustafa et al. [14] explored intrusion detection systems for IoT networks using explainable Federated Learning models combined with HE.”
Khan, F. M., Zeb, A., RAHMAN, T., Al-Khasawneh, M. A., Daradkeh, Y. I., Siddiqui, I. F., Bashir, A. K., & Ullah, I. (2026) · Cognitive Computation · doi:10.1007/s12559-026-10559-w · Cited by 24
“Core metrics include: True Positive Rate (Sensitivity): The proportion of actual threats correctly identified by the system [ 133].”
Villegas-Ch, W. E., Jaramillo-Alcázar, Á., Navarro, A. M., & Mera-Navarrete, A. (2025) · IEEE Access · doi:10.1109/access.2025.3541979 · Cited by 18
A Review of Interpretability Methods for Gradient Boosting Decision Trees
Gonçalves, V. S. F., & de Carvalho, V. R. (2025) · Journal of the Brazilian Computer Society · doi:10.5753/jbcs.2025.5324 · Cited by 23
“Additionally, 8 surveys focus on interpretabil-A ity within specific fields ([Li et al ., 2023b], [Başağaoğlu et al ., 2022], [Bharati et al ., 2023], [Kök et al ., 2023], [De Bock et al ., 2023], [Rjoub et al ., 2023], [Nadeem et al ., 2023],[Moustafa et al ., 2023]).”
Interpretable intrusion detection for IoT security: A SHAP-enhanced NGBoost model
Dong, J., Chen, H. Y., Shen, S., Xu, H., & Liu, Z. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111937 · Cited by 18
A Security-Enhanced Federated Learning Scheme Based on Homomorphic Encryption and Secret Sharing
Shen, C., Zhang, W., Zhou, T., & Zhang, L. (2024) · Mathematics · doi:10.3390/math12131993 · Cited by 17
Syllaidopoulos, I., Ntalianis, K., & Salmon, I. (2025) · IEEE Access · doi:10.1109/access.2025.3572348 · Cited by 20
“Furthermore, in contexts such as those of IoT, XAI enhances intrusion detection systems (IDS) by detecting anomalies [22], while addressing the opaque nature of AI models by increasing the trust and confidence of system users [41].”
Explainable AI: enhancing decision-making in the detection of cyber threats
Prasad, P. W. C., Sayeed, M. S., Nguyen, D.-M., Hutabarat, D. P., & Mohiuddin, G. M. (2026) · Frontiers in Computer Science · doi:10.3389/fcomp.2026.1762332 · Cited by 16
Din, I. U., Almogren, A., Han, Z., & Guizani, M. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3511634 · Cited by 18
“Advanced intrusion detection systems and the role of explainable AI have been highlighted as significant in enhancing transparency and trust in IoV ecosystems [7].”
Trustworthy AI and Federated Learning for Intrusion Detection in 6G-Connected Smart Buildings
Garroppo, R. G., Giardina, P. G., Landi, G., & Ruta, M. (2025) · Future Internet · doi:10.3390/fi17050191 · Cited by 17
“Indeed, XAI enhances transparency for ML-based IDSs, especially when dealing with black-box IDS models [37].”
Siqueira, L. P., Batista, C. L., Lui, P. H., Kazienko, J. F., Quincozes, S. E., Quincozes, V. E., Welfer, D., & Nomura, S. (2025) · Sensors · doi:10.3390/s25206261 · Cited by 15
“Likewise, studies such as [59,62] employ SHAP in federated environments to maintain consistent interpretability across distributed models.”
Ethical Considerations in Drone Cybersecurity
Sindiramutty, S. R., Tan, C. E., Shah, B., Khan, N. A., Gharib, A. H., Manchuri, A. R., Muniandy, L., Ray, S. K., & Jazri, H. (2024) · Advances in information security, privacy, and ethics book series · doi:10.4018/979-8-3693-0774-8.ch003 · Cited by 15
GothX: a generator of customizable, legitimate and malicious IoT network traffic
Poisson, M., Carnier, R. M., & Fukuda, K. (2024) · Cyber Security Experimentation and Test Workshop (CSET) · doi:10.1145/3675741.3675753 · Cited by 20
“Explainable artificial intelligence (XAI) [18] is one example of research field that could leverage the abundance of variable data.”
Edris, E. K. K. (2025) · Electronics · doi:10.3390/electronics14102057 · Cited by 18
Huang, Y., Ma, M., Raymond, W. J. K., & Chow, C.-O. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.112911 · Cited by 14
Lai, Y., Yu, Y., Guan, W., Luo, L., Fan, J., Zhou, N., & Ping, Y. (2024) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2024.3391250 · Cited by 14
“Recently, NIDSs have been widely used in many domains, such as the Internet of Things (IoT), military, medical, wireless sensor network (WSN), and industrial control system fields [6], [7].”
MethodEnhanced IoMT security framework using group teaching optimized auto-encoder for intrusion detection
Manoharan, A., & Manigandan, T. (2024) · Scientific Reports · doi:10.1038/s41598-024-80581-1 · Cited by 13
A systematic evaluation of white-box explainable AI methods for anomaly detection in IoT systems
Gummadi, A. N., Arreche, O., & Abdallah, M. (2025) · Internet of Things · doi:10.1016/j.iot.2025.101505 · Cited by 16
Yagiz, M. A., & Goktas, P. (2025) · arXiv · doi:10.48550/arxiv.2501.00790 · Cited by 12
Mphale, O., Gorejena, K. N., & Nojila, O. H. (2024) · Journal of Information Systems and Informatics · doi:10.51519/journalisi.v6i2.738 · Cited by 12
“For instance, there is a lack of consensus on a single, universally accepted definition of IoT, leading to subjectivity and ambiguity [13].”
BackgroundLeveraging Explainable AI for Actionable Insights in IoT Intrusion Detection
Gyawali, S., Huang, J., & Jiang, Y. (2024) · International Conference on System of Systems Engineering · doi:10.1109/sose62659.2024.10620966 · Cited by 12
“Recent endeavors have prioritized the incorporation of ex-plainable AI methods into intrusion detection systems [9], [10].”
BackgroundAI-on-RAN for Cyber Defense: An XAI-LLM Framework for Interpretable Anomaly Detection
Chatzimiltis, S., Shojafar, M., Mashhadi, M. B., & Tafazolli, R. (2025) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2025.3629983 · Cited by 19
“Toaddresstheselimitations,recentsurvey studies[14],[15],[62],[63]haveexploredtheintegrationofXAI techniques with anomaly detection models in network security.”
Distributed denial-of-service attack detection short review: issues, challenges, and recommendations
Habib, A. K. M. A., Imtiaz, A., Tripura, D., Faruk, M. O., Hossain, M. A., Ara, I., Sarker, S., & Abadin, A. Z. (2024) · Bulletin of Electrical Engineering and Informatics · doi:10.11591/eei.v14i1.8377 · Cited by 12
Computational modeling for medical data: From data collection to knowledge discovery
Yin, Y., Xu, S., Hong, Y., Cai, Y., Tang, W., Wang, J., Shen, B., Zong, H., & Yu, G. (2024) · The Innovation Life · doi:10.59717/j.xinn-life.2024.100079 · Cited by 13
MFT: A novel memory flow transformer efficient intrusion detection method
Jiang, X., Xu, L., Li, Y., & Fang, X. (2024) · Computers & Security · doi:10.1016/j.cose.2024.104174 · Cited by 11
Boosting incremental intrusion detection system with adversarial samples
Wu, X., Jin, Z., Chen, X., Zhou, J., & Liu, K. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126632 · Cited by 12
Fatima, Z., Hussain, R., Dilshad, A., Shakir, M., & Laghari, A. A. (2025) · Security and Privacy · doi:10.1002/spy2.70026 · Cited by 15
“An intrusion detection system based on the anomaly that uses the XAI is presented in [19].”
Metadata
- Authors
- Moustafa, N., Koroniotis, N., Keshk, M., Zomaya, A. Y., & Tari, Z.
- Affiliations
- UNSW Sydney (AU)
- The University of Sydney (AU)
- RMIT University (AU)
- Venue
- IEEE Communications Surveys & Tutorials
- Published
- 2023
- Volume
- 25
- Issue
- 3
- Pages
- 1775-1807
- ISSN
- 1553-877X (ISSN-L)
- 2373-745X
- OpenAlex
- W4378365142
- Cited by
- 266
- References
- 187
- Citations by year
- 2026: 70 · 2025: 110 · 2024: 71 · 2023: 15
- FWCI
- 29.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Communications Surveys & Tutorials (publishedVersion)
- Figshare (submittedVersion)
- Funders
- Australian Research Council’s Discovery Early Career Researcher Award (DE230100116)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- explainable AI, intrusion detection, Internet of Things security, anomaly-based intrusion detection, cyber defense, interpretability, deep learning anomaly detection, attack detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.