Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research
Open accessThe DOI matches its Crossref record; 262 of the 262 references it cites were found in a registry or an index.
Abstract
This survey presents a comprehensive review of current literature on Explainable Artificial Intelligence (XAI) methods for cyber security applications. Due to the rapid development of Internet-connected systems and Artificial Intelligence in recent years, Artificial Intelligence including Machine Learning and Deep Learning has been widely utilized in the fields of cyber security including intrusion detection, malware detection, and spam filtering. However, although Artificial Intelligence-based approaches for the detection and defense of cyber attacks and threats are more advanced and efficient compared to the conventional signature-based and rule-based cyber security strategies, most Machine Learning-based techniques and Deep Learning-based techniques are deployed in the “black-box” manner, meaning that security experts and customers are unable to explain how such procedures reach particular conclusions. The deficiencies of transparencies and interpretability of existing Artificial Intelligence techniques would decrease human users’ confidence in the models utilized for the defense against cyber attacks, especially in current situations where cyber attacks become increasingly diverse and complicated. Therefore, it is essential to apply XAI in the establishment of cyber security models to create more explainable models while maintaining high accuracy and allowing human users to comprehend, trust, and manage the next generation of cyber defense mechanisms. Although there are papers reviewing Artificial Intelligence applications in cyber security areas and the vast literature on applying XAI in many fields including healthcare, financial services, and criminal justice, the surprising fact is that there are currently no survey research articles that concentrate on XAI applications in cyber security. Therefore, the motivation behind the survey is to bridge the research gap by presenting a detailed and up-to-date survey of XAI approaches applicable to issues in the cyber security field. Our work is the first to propose a clear roadmap for navigating the XAI literature in the context of applications in cyber security.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures














Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As a result, Artificial Intelligence (AI) has become integral to domains such as healthcare, finance, and particularly cybersecurity, where the ability to process complex, high-velocity data streams is critical (Zhang et al., 2022).”
From Explainable AI: enhancing decision-making in the detection of cyber threats (2026) · cites this paper as Zhang et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our findings confirm the growing importance of XAI, with SHAP and LIME increasingly used to provide feature-level insights [40].”
From Application of Machine Learning and Deep Learning Techniques for Enhanced Insider Threat Detection in Cybersecurity: Bibliometric Review (2025) · cites this paper as [40]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Zhang et al. (2022) argue that developing more generic, quantifiable, and standardized frameworks is critical for benchmarking XAI applications in cybersecurity.”
From Explainable AI: enhancing decision-making in the detection of cyber threats (2026) · cites this paper as Zhang et al. (2022)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–262 of 262
Detection and Classification of Botnet Traffic using Deep Learning with Model Explanation
Kundu, P. P., Truong-Huu, T., Chen, L., Zhou, L., & Teo, S. G. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3183361 · Cited by 52
Evaluation of Post-hoc XAI Approaches Through Synthetic Tabular Data
Tritscher, J., Ring, M., Schlr, D., Hettinger, L., & Hotho, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59491-6_40 · Cited by 52
An Explainable Multi-Modal Hierarchical Attention Model for Developing Phishing Threat Intelligence
Chai, Y., Zhou, Y., Li, W., & Jiang, Y. (2021) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3119323 · Cited by 46
(2020) · doi:10.14778/3494124.3494128 · Cited by 46 · cited 1×
“Fraud [187] Autoencoder, NB, RF and DT 2021 √ √ √ √ √ LIME and SHAP [189] RF, LGB, DT, and LR 2021 √ √ √ √ Local features [190] GNN 2022 √ √ √ √ √ GNN Explainer [193] Autoencoder 2021 √ √ √ √ √ Kernel SHAP [194] Transfer Learning 2020 √ √ √ √ HEN”
Self-citationExplainable, automated urban interventions to improve pedestrian and vehicle safety
Bustos, C., Rhoads, D., Solé‐Ribalta, A., Masip, D., Arenas, À., Lapedriza, À., & Borge‐Holthoefer, J. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2021.103018 · Cited by 46
Explainable AI and Random Forest Based Reliable Intrusion Detection systemPreprint
Wali, S. W., & Khan, I. (2021) · doi:10.36227/techrxiv.17169080.v1 · Cited by 45
Rudin, C. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.10154 · Cited by 44
Gradient-based Analysis of NLP Models is Manipulable
Wang, J., Tuyls, J., Wallace, E., & Singh, S. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.24 · Cited by 43
Effective detection of mobile malware behavior based on explainable deep neural network
Yan, A., Chen, Z., Zhang, H., et al. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.09.082 · Cited by 43
Towards Explainable Artificial Intelligence in Banking and Financial Services
Hanif, A. (2021) · arXiv (Cornell University) · doi:10.25949/21499413 · Cited by 43
Intelligent Transportation System Security: Hacked Message Signs
Kelarestaghi, K. B., Heaslip, K., Khalilikhah, M., Fuentes, A., & Fessmann, V. (2018) · SAE International Journal of Transportation Cybersecurity and Privacy · doi:10.4271/11-01-02-0004 · Cited by 42
Deep Learning XAI for Bus Passenger Forecasting: A Use Case in Spain
Monje, L., Carrasco, R. A., Rosado, C., & Sánchez-Montañés, M. A. (2022) · Mathematics · doi:10.3390/math10091428 · Cited by 42
SoK: Applying Machine Learning in Security - A SurveyPreprint
Jiang, H., Nagra, J., & Ahammad, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03186 · Cited by 39
Phishing Detection Using URL-based XAI Techniques
Galego Hernandes, P. R., Floret, C. P., Cardozo De Almeida, K. F., Da Silva, V. C., Papa, J. P., & Pontara Da Costa, K. A. (2021) · 2021 IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci50451.2021.9659981 · Cited by 38
Chittajallu, D. R., Dong, B., Tunison, P., Collins, R., Wells, K., Fleshman, J., Sankaranarayanan, G., Schwaitzberg, S., Cavuoto, L., & Enquobahrie, A. (2019) · 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019) · doi:10.1109/isbi.2019.8759428 · Cited by 38
Explaining AI for Malware Detection: Analysis of Mechanisms of MalConv
Bose, S., Barao, T., & Liu, X. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207322 · Cited by 37
Explainable Artificial Intelligence (XAI): An Engineering Perspective
Hussain, F., Hussain, R., & Hossain, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.03613 · Cited by 36
First Step Towards EXPLAINable DGA Multiclass Classification
Drichel, A., Faerber, N., & Meyer, U. (2021) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3465481.3465749 · Cited by 34
Explainable AI and Random Forest Based Reliable Intrusion Detection systemPreprint
Wali, S. W., & Khan, I. (2021) · doi:10.36227/techrxiv.17169080 · Cited by 34
Opportunities and Challenges: Lessons from Analyzing Terabytes of Scanner Data
Ng, S. (2017) · National Bureau of Economic Research · doi:10.3386/w23673 · Cited by 34
Analyzing the real-world applicability of DGA classifiers
Drichel, A., Meyer, U., Schüppen, S., et al. (2020) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3407023.3407030 · Cited by 33
Kostopoulos, G., Panagiotakopoulos, T., Kotsiantis, S. B., Pierrakeas, C. J., & Kameas, A. D. (2021) · IEEE Access · doi:10.1109/access.2021.3134787 · Cited by 32
Renftle, M., Trittenbach, H., Poznic, M., & Heil, R. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03277-x · Cited by 31
Good Explanation for Algorithmic TransparencyPreprint
Lu, J., Lee, D., Kim, T. W., & Danks, D. J. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3503603 · Cited by 30
Global Explanations of Neural Networks: Mapping the Landscape of PredictionsPreprint
Ibrahim, M., Louie, M., Modarres, C., & Paisley, J. W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.02384 · Cited by 29
Network Intrusion Detection Based on Explainable Artificial Intelligence
Wang, Y., Xu, L., Liu, W., Li, R., & Gu, J. (2023) · Wireless Personal Communications · doi:10.1007/s11277-023-10472-7 · Cited by 28
Explainable Malware Detection Using Predefined Network Flow
Hsupeng, B., Lee, K.-W., Wei, T.-E., & Wang, S. (2022) · International Conference on Advanced Communication Technology · doi:10.23919/icact53585.2022.9728897 · Cited by 27
ECQ$$^{\text {x}}$$: Explainability-Driven Quantization for Low-Bit and Sparse DNNs
Becking, D., Dreyer, M., Samek, W., Müller, K., & Lapuschkin, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-04083-2_14 · Cited by 27
A Real-Time Prescriptive Solution for Explainable Cyber-Fraud Detection Within the iGaming Industry
Farrugia, D., Zerafa, C., Cini, T., Kuasney, B., & Livori, K. (2021) · SN Computer Science · doi:10.1007/s42979-021-00623-7 · Cited by 25
Towards Explainable NLP: A Generative Explanation Framework for Text ClassificationPreprint
Liu, H., Yin, Q., & Wang, W. Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.00196 · Cited by 24
Computational Intelligence in Cloud Computing
Labati, R. D., Genovese, A., Piuri, V., Scotti, F., & Vishwakarma, S. (2019) · Topics in intelligent engineering and informatics · doi:10.1007/978-3-030-14350-3_6 · Cited by 23
Algorithmic and HCI Aspects for Explaining Recommendations of Artistic Images
Dominguez, V., Donoso-Guzmán, I., Messina, P., & Parra, D. (2020) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3369396 · Cited by 23
{HAI} 1.0: HIL-based Augmented {ICS} Security Dataset
Shin, H.-K., Lee, W., Yun, J.-H., & Kim, H. (2020) · USENIX Security Symposium · Cited by 22
Tamp-X: Attacking explainable natural language classifiers through tampered activations
Ali, H. M., Khan, M. S., Al‐Fuqaha, A., & Qadir, J. (2022) · Computers & Security · doi:10.1016/j.cose.2022.102791 · Cited by 22
Explainable Deep Behavioral Sequence Clustering for Transaction Fraud DetectionPreprint
Min, W., Liang, W., Yin, H., Wang, Z., Li, M., & Lal, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.04285 · Cited by 22
Deep Learning Models for Cyber Security in IoT Networks: A Review
Ahmed, K. D., & Askar, S. K. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4497016 · Cited by 21
Jin, W., Li, X., & Hamarneh, G. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21452 · Cited by 21
Interpretable Visualizations of Deep Neural Networks for Domain Generation Algorithm Detection
Becker, F., Drichel, A., Müller, C., & Ertl, T. (2020) · IEEE Symposium on Visualization for Cyber Security (VIZSEC) · doi:10.1109/vizsec51108.2020.00010 · Cited by 20
When Explainability Meets Adversarial Learning: Detecting Adversarial Examples using SHAP SignaturesPreprint
Fidel, G., Bitton, R., & Shabtai, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.03418 · Cited by 20
Evaporation Forecasting through Interpretable Data Analysis Techniques
Garrido, M. C., Figueredo, J. M. C., Bueno-Crespo, A., Martínez‐España, R., Giménez, J. G., & Cecilia, J. M. (2022) · Electronics · doi:10.3390/electronics11040536 · Cited by 19
AI and Deep Learning in Biometric Security
(2021) · CRC Press eBooks · doi:10.1201/9781003003489 · Cited by 18
Le, T.-T.-H., Kang, H., & Kim, H. (2021) · IEEE Access · doi:10.1109/access.2021.3115764 · Cited by 16
First Step Towards EXPLAINable DGA Multiclass Classification
Drichel, A., Faerber, N., & Meyer, U. (2021) · RWTH Publications (RWTH Aachen) · Cited by 15
Applications of Artificial Intelligence to Network SecurityPreprint
Veiga, A. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09992 · Cited by 15
Subspace Clustering for Interpretable Botnet Traffic Analysis
Araki, S., Takahashi, K., Hu, B., Kamiya, K., & Tanikawa, M. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761218 · Cited by 14
Jin, W., Li, X., & Hamarneh, G. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.06487 · Cited by 14
Edge Computing in Transportation: Security Issues and ChallengesPreprint
Soni, N., Malekian, R., & Thakur, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.11206 · Cited by 13
Malicious Vehicles Identifying and Trust Management Algorithm for Enhance the Security in 5G-VANET
Perarasi, T., Vidhya, S. S., Moses, L., & Ramya, P. (2020) · International Conference on Inventive Research in Computing Applications (ICIRCA) · doi:10.1109/icirca48905.2020.9183184 · Cited by 13
Transparency and Explanation in Deep Reinforcement Learning Neural Networks
Iyer, R., Li, Y., Li, H., et al. (2018) · D-Scholarship@Pitt (University of Pittsburgh) · doi:10.48550/arxiv.1809.06061 · Cited by 13
FraudMemory: Explainable Memory-Enhanced Sequential Neural Networks for Financial Fraud Detection
Yang, K., & Xu, W. H. (2019) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2019.126 · Cited by 12
Towards Explainable Artificial Intelligence in Banking and Financial ServicesPreprint
Hanif, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.08441 · Cited by 12
Vinayakumar, R., Soman, K. P., Poornachandran, P., et al. (2019) · Institution of Engineering and Technology eBooks · doi:10.1049/pbpc035g_ch22 · Cited by 10
Explainable Artificial Intelligence (XAI) for Internet of Things: A SurveyPreprint
Kök, İ., Okay, F. Y., Muyanlı, Ö., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.04800 · Cited by 10
Explainable Fraud Detection for Few Labeled Time Series Data
Xiao, Z., & Jiao, J. (2021) · Security and Communication Networks · doi:10.1155/2021/9941464 · Cited by 9
Evaluation of Strategic Decision taken by Autonomous Agent using Explainable AI
Prasad, R. R., Robinson, R. R. R., Thomas, C., & Balakrishnan, N. (2021) · doi:10.1109/isea-isap54304.2021.9689715 · Cited by 8
Yang, L., Kenny, E. M., Ng, T. L. J., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.12512 · Cited by 8
Gradient-based Analysis of NLP Models is ManipulablePreprint
Wang, J., Tuyls, J., Wallace, E., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05419 · Cited by 4
Sivamohan, S., & Sri Surya Srikanth, S. (2022) · Research Square · doi:10.21203/rs.3.rs-1683748/v1 · Cited by 3
Network Intrusion Detection Based on Explainable Artificial IntelligencePreprint
Wang, Y., Xu, L., Liu, W., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-1732635/v1 · Cited by 3
Taulli, T. (2023) · Apress eBooks · doi:10.1007/978-1-4842-9478-9_2 · Cited by 2
Oakley, J. G. (2019) · Apress eBooks · doi:10.1007/978-1-4842-4950-5_4 · Cited by 1
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · arXiv
Research works printed but not linked: 33
- 2022, What is Cybersecurity? | CISA
- 2022, Number of Internet Users Worldwide 2021
- 2022, 2021 Cyber Attack Trends Mid-Year Report | Check Point Software
- 2022, Cyberattack Disrupts Unemployment Benefits in Some States
- 10.1145/3178582 · DOI · Paper page
- 2012, 14:00-17:00
- 2022, Cybersecurity Market Worth $345.4 Billion by 2026
- Biran, Explanation and justification in machine learning: A survey, 8
- 2018, What is GDPR, the EU’s New Data Protection Law?
- Mars, 2020, The three stages of explainable AI: How explainability facilitates real world deployment of AI, Res. Gate
- 2022, VirusShare.com
- 2022, Fast Global Alignment Kernels | Semantic Scholar
- 2022, UCI Machine Learning Repository: Statlog (German Credit Data) Data Set
- 10.14722/ndss.2014.23247 · DOI · Paper page
- Raff, 2018, Malware Detection by Eating a Whole EXE
- Anderson, 2018, EMBER: An open dataset for training static PE malware machine learning models, arXiv:1804.04637 · arXiv
- 10.1016/j.neucom.2020.09.082 · DOI
- 2022, Daily Number of E-Mails Worldwide 2025
- Renftle, 2022, Explaining any ML model?—On goals and capabilities of XAI, arXiv:2206.13888 · arXiv
- 2022, Botnet Detection Market Global Industry Historical Analysis, Size, Growth, Trends, Emerging Factors, Demands, Key Players, Emerging Technologies and Potential of Industry Till 2027— MarketWatch
- 2022, MAWI Working Group Traffic Archive
- Gee, 2019, The financial cost of fraud 2019, 28
- 2022, IEEE-CIS Fraud Detection
- 10.1109/lnet.2022.3186589 · DOI · Paper page
- Mane, 2021, Explaining network intrusion detection system using explainable AI framework, arXiv:2103.07110 · arXiv
- 2022, Home—Eduroam.org. Eduroam.org. Eduroam Global Site
- 2022, KDD Cup 1999 Data
- Dave, 2020, Explainable AI meets healthcare: A study on heart disease dataset, arXiv:2011.03195 · arXiv
- 2022, VeReMi dataset
- 10.1109/ijcnn48605.2020.9206780 · DOI · Paper page
- 10.1145/3375627.3375830 · DOI · Paper page
- Mattu Julia Angwin, 2022, How We Analyzed the COMPAS Recidivism Algorithm
- Ha, Adaptive wavelet distillation from neural networks through interpretations, 34, 20669
Cited by
A literature review on applications of explainable artificial intelligence (XAI)
Kalasampath, K., Spoorthi, K. N., Sajeev, S., Kuppa, S. S., Ajay, K., & Maruthamuthu, A. (2025) · IEEE Access · doi:10.1109/access.2025.3546681 · Cited by 180
A survey on explainable artificial intelligence for cybersecurity
Rjoub, G., Bentahar, J., Abdel Wahab, O., Mizouni, R., Song, A., Cohen, R., Otrok, H., & Mourad, A. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3282740 · Cited by 158
An assessment framework for explainable AI with applications to cybersecurity
Calzarossa, M. C., Giudici, P., & Zieni, R. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11141-w · Cited by 40
Explainable AI: enhancing decision-making in the detection of cyber threats
Prasad, P. W. C., Sayeed, M. S., Nguyen, D.-M., Hutabarat, D. P., & Mohiuddin, G. M. (2026) · Frontiers in Computer Science · doi:10.3389/fcomp.2026.1762332 · Cited by 16
Ofori, H. K., Bell-Dzide, K., Brown-Acquaye, W. L., Lempogo, F., Frimpong, S. O., Agbehadji, I. E., & Millham, R. C. (2025) · Symmetry · doi:10.3390/sym17101704 · Cited by 7
Metadata
- Authors
- Zhang, Z., Hamadi, H. A., Damiani, E., Yeun, C. Y., & Taher, F.
- Affiliations
- Khalifa University of Science and Technology (AE)
- Zayed University (AE)
- Venue
- IEEE Access
- Published
- 2022
- Volume
- 10
- Pages
- 93104-93139
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4295854586
- Cited by
- 450
- References
- 262
- Citations by year
- 2026: 118 · 2025: 160 · 2024: 109 · 2023: 62
- FWCI
- 27.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- explainable AI, cybersecurity, intrusion detection, malware detection, spam filtering, black-box models, model interpretability, trust in AI, cyber defense, explainable machine learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.