A Literature Review on Applications of Explainable Artificial Intelligence (XAI)
Open accessThe DOI matches its Crossref record; 110 of the 110 references it cites were found in a registry or an index.
Abstract
As AI technologies, particularly deep learning models, have advanced, their inherent “black box” nature has raised significant concerns regarding accountability, fairness, and trust, especially in critical domains such as healthcare, finance, and criminal justice. We present a detailed exploration of XAI, emphasizing its essential role in improving the interpretability and transparency of complex AI systems in various application domains. Health-related applications were notably using XAI, emphasizing diagnostics, and medical imaging. Other notable domains of use of XAI is encompassed environmental and agricultural management, industrial optimization, cybersecurity, finance, transportation, and social media. Furthermore, nascent applications in law, education, and social care underscore the growing influence of XAI. The analysis indicates a prevalent application of local explanation techniques, especially SHAP and LIME, with a preference for SHAP due to its stability and mathematical assurances. Each technique is analysed for its strengths and limitations in providing clear, actionable insights into model decision-making processes, thereby aiding stakeholders in understanding AI behaviour. Ultimately, this document underscores the critical challenges for XAI in fostering user trust, enhancing decision-making processes, and ensuring that AI technologies are utilized responsibly and ethically across various applications, paving the way for a more transparent and accountable AI landscape. We believe that by serving as a guide for future studies in the area, our systematic review contributes to the body of literature on XAI.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“XAI provides tools such as SHAP, LIME, and attention mechanisms that can explain how models reach their decisions, improving both transparency and usability (Kalasampath et al., 2025).”
From Explainable AI: enhancing decision-making in the detection of cyber threats (2026) · cites this paper as Kalasampath et al., 2025
In the citing paper
“Kalasampath et al. (2025) emphasizes that this disconnect not only reduces the immediate value of XAI solutions but also undermines trust in AI more broadly, since practitioners may become sceptical of adopting systems that are perceived as impractical or irrelevant.”
From Explainable AI: enhancing decision-making in the detection of cyber threats (2026) · cites this paper as Kalasampath et al. (2025)
Citations
Cites
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“There are cases in which local justifications could be deceptive if the overall model performance varies greatly from particular cases, underlining the importance of a well-rounded strategy [37].”
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294 · cited 1×
“Continuing research in XAI is focused on explaining AI capabilities, encouraging ethical and responsible use of technology, and empowering a knowledgeable society to interact with advancing AI systems [9], [10], [11].”
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427 · cited 1×
“The emergence and increasing popularity of XAI tackle the issues of explainability, understandability, and interpretability linked to intricate black-box AI systems [15].”
Explanation in Artificial Intelligence: Insights from the Social Sciences
Miller, T. (2017) · arXiv · doi:10.48550/arxiv.1706.07269 · Cited by 5,338
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Kaplan, A., & Haenlein, M. (2019) · Business Horizons · doi:10.1016/j.bushor.2018.08.004 · Cited by 3,140 · cited 1×
“We define the term AI as a system’s capability to correctly interpret, to learn from external data provided, and to use that knowledge to meet particular goals by adjusting as necessary [1].”
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121 · cited 1×
“A detailed analysis in 2020 highlights the importance of comprehending the decision-making processes of AI systems as they are used more in important fields, for accountability and ethical reasons [17].”
A Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524
Explaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507 · cited 2×
“Methods like LIME and SHAP are categorized in this group because they produce explanations that emphasize the importance of features in individual predictions [27].”
Research works printed but not linked: 13
- Dhanorkar, Tutorial on explainability for natural language processing, 447
- Arrieta, 2020, Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and threats, Inf. Sci., 570, 100
- Doshi-Velez, Towards a rigorous science of interpretable machine learning, 70, 2786
- 2021, Proposal for a Regulation Laying Down Harmonized Rules on Artificial Intelligence (Artificial Intelligence Act)
- 2023, Requirements of Trustworthy AI
- Cheng, 2024, Interactive analysis of LLMs using meaningful counterfactuals, arXiv:2405.00708 · arXiv
- 2024, Explainable ai for personalized learning: Improving student outcomes, Int. J. Multidisciplinary Innov. Res. Methodol., 2068, 198
- Zhang, 2022, Citation, Appl. Explainable Artif. Intell. Diagnosis Surg., 12, 237
- Soundararajan, 2022, Enhancing financial decision-making through explainable AI and blockchain integration: Improving transparency and trust in predictive models, Educ. Admin., Theory Pract., 30, 9341
- 2017, Explainable Artificial Intelligence—The New Frontier in Legal Informatics
- Lim, 2020, Judicial Decision-Making and Explainable Artificial Intelligence
- 10.1145/3411764.3445315 · DOI · Paper page
- Sharma, 2024, Explainable AI (XAI): Model Interpretability, Feature Attribution, and Model Explainability
Cited by
Khan, F. S., Mazhar, S. S., Mazhar, K., AlSaleh, D., & Mazhar, A. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11215-9 · Cited by 151
Alsabah, M. Q., Naser, M. A., Albahri, A. S., Albahri, A. S., Alamoodi, A. H., Abdulhussain, S. H., & Alzubaidi, L. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11342-3 · Cited by 112
Khan, N., Ahmad, K., Tamimi, A. A., Alani, M. M., Bermak, A., & Khalil, I. M. (2025) · Information · doi:10.3390/info16121036 · Cited by 140
Explainable AI for industrial fault diagnosis: A systematic review
Cação, J., Santos, J., & Antunes, M. (2025) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2025.100905 · Cited by 85
Živić, F., Kaplarevic-Malisic, A. M., Grujović, N., Stojanovic, B. S., & Ivanovic, M. R. (2025) · Materials Today Communications · doi:10.1016/j.mtcomm.2025.113525 · Cited by 65
Metadata
- Authors
- Kalasampath, K., Spoorthi, K. N., Sajeev, S., Kuppa, S. S., Ajay, K., & Maruthamuthu, A.
- Affiliations
- Vellore Institute of Technology University (IN)
- School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, India
- ORCID
- Venue
- IEEE Access
- Published
- 2025
- Volume
- 13
- Pages
- 41111-41140
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4408047551
- Cited by
- 180
- References
- 107
- Citations by year
- 2026: 128 · 2025: 52
- FWCI
- 72.20
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Vellore Institute of Technology, Vellore, India
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- explainable AI, interpretability, transparency, black-box models, SHAP, lime, diagnosis, diagnostic imaging, industrial optimization, cybersecurity, transportation, social media, application of law, social care, trust in AI, accountability, fairness, ethical AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Literature Review on Applications of Explainable Artificial Intelligence (XAI). https://app.cochat.ai/papers/10.1109/access.2025.3546681
- The paper
- Kalasampath, K., Spoorthi, K. N., Sajeev, S., Kuppa, S. S., Ajay, K., & Maruthamuthu, A. (2025). A Literature Review on Applications of Explainable Artificial Intelligence (XAI). IEEE Access. https://doi.org/10.1109/access.2025.3546681
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.