The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Explainable Artificial Intelligence for Tabular Data in Healthcare: A Systematic Review of Methods, Evaluation, and Applications
Abstract
Explainable Artificial Intelligence (XAI) has emerged as a critical enabler for the adoption of machine learning models in high-stakes domains such as healthcare. While significant progress has been made in XAI for computer vision and natural language processing, tabular data—the predominant format of electronic health records—presents unique challenges and opportunities. This systematic review provides a comprehensive analysis of XAI methods specifically applied to tabular healthcare data for classification tasks. We examine 21 primary studies published between 2020 and the first half of 2026, covering three complementary perspectives: (1) intrinsically interpretable models, (2) post-hoc methods including LIME, SHAP, and their variants, and (3) evaluation frameworks that assess both model-centered fidelity and human-centered clinical alignment. Our analysis reveals that SHAP remains the dominant post-hoc method, achieving strong model fidelity but showing inconsistent alignment with clinical expert reasoning. Key findings include the significant impact of class imbalance on explanation consistency, the importance of clinician-centered evaluation, and the emergence of hybrid approaches integrating XAI with generative AI and transfer learning. We identify critical gaps, including limited adoption of XAI in AutoML pipelines, lack of standardized evaluation metrics, and predominance of single-institution validation studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
From local explanations to global understanding with explainable AI for trees
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-019-0138-9 · Cited by 10,551
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
A Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524
Anchors: High-Precision Model-Agnostic Explanations
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162
Chapter 7: Systematic reviews of etiology and risk
Moola, S., Munn, Z., Tufanaru, C., Aromataris, E., Sears, K., Sfetic, R., Currie, M., Lisy, K., Qureshi, R., Mattis, P., et al. (2019) · JBI Reviewer's Manual · doi:10.46658/jbirm-17-06 · Cited by 2,114
Machine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842
Explainable artificial intelligence: a comprehensive review
Minh, D., Wang, H. X., Li, Y. F., & Nguyen, T. N. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10088-y · Cited by 983
Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methods
Slack, D., Hilgard, S., Jia, E., Singh, S., & Lakkaraju, H. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375830 · Cited by 900
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2018) · arXiv · doi:10.48550/arxiv.1811.11839 · Cited by 783
A Survey of Methods for Explaining Black Box Models
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629
The use of Big Data Analytics in healthcare
Batko, K., & Ślęzak, A. (2022) · Journal of Big Data · doi:10.1186/s40537-021-00553-4 · Cited by 593
Nauta, M., Trienes, J., Pathak, S., Nguyen, E., Peters, M., Schmitt, Y., Schlötterer, J., van Keulen, M., & Seifert, C. (2023) · ACM Computing Surveys · doi:10.1145/3583558 · Cited by 590
Schwalbe, G., & Finzel, B. (2024) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00867-8 · Cited by 328
Clinical Research Informatics and Electronic Health Record Data
Horvath, M. M., Rusincovitch, S. A., & Richesson, R. (2014) · Yearbook of Medical Informatics · doi:10.15265/iy-2014-0009 · Cited by 60
Bergomi, L., Nicora, G., Orlowska, M. A., Podrecca, C., Bellazzi, R., Fregosi, C., Salinaro, F., Bonzano, M., Crescenzi, G., Speciale, F., et al. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03045-0 · Cited by 30
Evaluating XAI techniques under class imbalance using CPRD data
Rai, T., He, J., Kaur, J., Shen, Y., Mahmud, M., Brown, D. J., O'Dowd, E. L., & Baldwin, D. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1682919 · Cited by 10
Leveraging ChatGPT and explainable AI for enhancing clinical decision support
Shawi, R. E., & Jamel, L. (2025) · Scientific Reports · doi:10.1038/s41598-025-22784-8 · Cited by 9
TransLIME: Towards transfer explainability to explain black-box models on tabular datasets
Raza, R., Wang, G., Laga, H., Wong, K. W., & Nejdl, W. (2025) · Information Sciences · doi:10.1016/j.ins.2025.122891 · Cited by 9
Automated Machine Learning in medical research: A systematic literature mapping study
Castro, G. A., Barioto, L. G., Cao, Y. H., Silva, R. M., Caseli, H. D. M., Machado‐Neto, J. A., Cerri, R., Villavicencio, A., & Almeida, T. A. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103302 · Cited by 8
Towards Transparent Diabetes Prediction: Unveiling the Factors with Explainable AI
Vinh, T. Q., & Byeon, H. (2024) · International Journal of Engineering Trends and Technology · doi:10.14445/22315381/ijett-v72i5p103 · Cited by 7
Ahmed, M. M., Hossain, M. M., Rakib, M. R. H., Hashan, R., Nirob, M. T. H., & Islam, M. K. (2026) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2026.111518 · Cited by 6
Jeong, J., Jeong, J.-H., Moon, G.-M., Seo, Y.-D., & Lee, E. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110855 · Cited by 5
Systematic Benchmarking of Local and Global Explainable AI Methods for Tabular Healthcare Data
Karagoz, G. N., Özçelebi, T., & Meratnia, N. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08317-3_16 · Cited by 5
Privacy-Focused Federated Learning for Mental Health Data with XAI Techniques
Meena, V., Raghavender, G., Jayakar, S., & Kumar, J. S. (2025) · International Conference on Data Intelligence and Cognitive Informatics (ICDICI) · doi:10.1109/icdici66477.2025.11134972 · Cited by 4
Attention-enabled Explainable AI for Bladder Cancer Recurrence Prediction
Abbas, S., Soomro, N., Shafik, R., Heer, R., & Adhikari, K. (2025) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc58623.2025.11254767 · Cited by 4
An interpretable model based on concept and argumentation for tabular data
Chi, H., Wang, D., Liao, B., Cui, G., & Mao, F. (2026) · Scientific Reports · doi:10.1038/s41598-025-30540-1 · Cited by 3
Babu, G. P., Durgabhavani, A., Gudipudi, B., Mouli, K. C., Sasidhar, B., & Dattatreya, M. (2025) · International Conference on Electronic Circuits and Signaling Technologies (ICECST) · doi:10.1109/icecst66106.2025.11307265 · Cited by 2
Durgham, B. A., & Alawida, M. (2025) · IEEE/ACS International Conference on Computer Systems and Applications (AICCSA) · doi:10.1109/aiccsa66935.2025.11315300 · Cited by 1
Wattiheluw, M. Y. A. ‘., Jondri, & Indwiarti (2025) · International Conference on Informatics, Multimedia, Cyber and Information System (ICIMCIS) · doi:10.1109/icimcis68501.2025.11327169 · Cited by 1
Singh, S., & Rajput, S. D. (2025) · IEEE Pune Section International Conference (PuneCon) · doi:10.1109/punecon67554.2025.11378728 · Cited by 1
An Interpretable Stroke Risk Prediction Model Using SMOTEENN and Advanced ML: An XAI-Driven Approach
Mow, M. H., & Ashrafuzzaman, M. (2025) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit68739.2025.11491182 · Cited by 1
Research works printed but not linked: 11
- Doshi-Velez, F., and Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv.
- Lundberg, S., and Lee, S. (2017, January 4–9). A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA.
- Mubarakali, 2025, IoT and XAI-driven data aggregation framework for intelligent decision-making in smart healthcare systems, Comput. Electr. Eng., 48, 101179
- Rai, T., He, J., Kaur, J., Shen, Y., Mahmud, M., Brown, D.J., O’Dowd, E., and Baldwin, D.R. (2025, January 26). Evaluating LIME and SHAP Under Class Imbalance: A Lung Cancer Prediction Case Study Using CPRD Data. Proceedings of the 4th International Workshop, XAI-Healthcare 2025, and 2nd International Workshop, PM4H 2025, Pavia, Italy.
- Ahmed, 2025, Automated stress detection with explainable-AI transformer TabNet technique and physiological signals, Biomed. Signal Process. Control, 109, 109208
- Thomas, J., and Brown, S. (2025, January 19–20). Explainable AI for Osteoporosis Risk Modeling: Random Forest and SHAP Interpretation on CTGAN-Enhanced Data. Proceedings of the 2025 IEEE APCIT, Mysore, India.
- Vidhya, K., Surya, S.K., Geetha, S.K., Thiyagu, T.M., Catherine Joy, R., and Archpaul, J. (2025, January 4–6). TabNet Fusion Framework for Explainable Multi-Omics Alzheimer’s Disease Classification. Proceedings of the 2025 IEEE ICICI, Bangalore, India.
- Rajani, B., Varsha, K., Srinivas, K., Sivamani, N., and Ahmed, K.T. (2025, January 17–19). A Robust and Explainable Machine Learning Framework for Early Lung Cancer Risk Prediction using Synthetic Data Augmentation and Cross-Dataset Validation. Proceedings of the 2025 IEEE ICSEDIS, Chiramanangad, India.
- Swain, 2025, Model-Agnostic Interpretability Techniques for Machine Learning-Based Pre-Term Birth Prediction, Advances in Intelligent Systems and Computing, Volume 1624, 337
- Apley, 2020, Visualizing the effects of predictor variables in black box supervised learning models, J. Am. Stat. Assoc., 82, 1059
- Mekonnen, E. (2025, January 9–11). Explaining time series classifiers through post-hoc XAI methods capturing temporal dependencies. Proceedings of the 3rd World Conference on eXplainable Artificial Intelligence (xAI 2025), Istanbul, Turkey.
Metadata
- Authors
- Santana-Velásquez, A., & Salazar-Sánchez, M. B.
- Venue
- Computers
- Publisher
- MDPI AG
- Published
- 2026-08-06
- Volume
- 15
- Issue
- 8
- Pages
- 506
- ISSN
- 2073-431X
- Cited by
- 0
- References
- 34
- Language
- en
- Funders
- Universidad de Antioquia, Colombia (CODI-PRG 2022-52993)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.