XAI Evaluation: Evaluating Black-Box Model Explanations for Prediction
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The results of evaluating explanations of the black-box model for prediction are presented. The XAI evaluation is realized through the different principles and characteristics between black-box model explanations and XAI labels. In the field of high-dimensional prediction, the black-box model represented by neural network and ensemble models can predict complex data sets more accurately than traditional linear regression and white-box models such as the decision tree model. However, an unexplainable characteristic not only hinders developers from debugging but also causes users mistrust. In the XAI field dedicated to “opening” the black box model, effective evaluation methods are still being developed. Within the established XAI evaluation framework (MDMC) in this paper, explanation methods for the prediction can be effectively tested, and the identified explanation method with relatively higher quality can improve the accuracy, transparency, and reliability of prediction.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“How to evaluate these methods and their explanations is still a popular research challenge [111,114,115], and further research is needed in this context.”
From Survey of Explainable AI Techniques in Healthcare (2023) · cites this paper as [115]
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Gauriat, C.-M., Pencolé, Y., Ribot, P., & Brouillet, G. (2024) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.4230/oasics.dx.2024.27 · Cited by 12,586
LightGBM: A Highly Efficient Gradient Boosting Decision Tree
(2017) · HAL · Cited by 10,512
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Agatonovic-Kustrin, S., & Beresford, R. (2000) · Journal of Pharmaceutical and Biomedical Analysis · doi:10.1016/s0731-7085(99)00272-1 · Cited by 1,957
Neural Networks and Deep Learning: A Textbook
Aggarwal, C. C. (2018) · doi:10.1007/978-3-319-94463-0 · Cited by 417
Xiao, Z., Wang, Y., Fu, K., & Wu, F. (2017) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi6020057 · Cited by 189
Cited by
Survey of Explainable AI Techniques in Healthcare
Chaddad, A., Peng, J., Xu, J., & Bouridane, A. (2023) · Sensors · doi:10.3390/s23020634 · Cited by 591
Yang, M., Lim, M. K., Qu, Y., Ni, D., & Xiao, Z. (2023) · Computers & Industrial Engineering · doi:10.1016/j.cie.2022.108859 · Cited by 161
A Perspective on Explanations of Molecular Prediction Models
Wellawatte, G. P., Gandhi, H. A., Seshadri, A., & White, A. D. (2023) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.2c01235 · Cited by 137
Toward Trustworthy Artificial Intelligence (TAI) in the Context of Explainability and Robustness
chander, B., John, C., Warrier, L., & Gopalakrishnan, K. (2025) · ACM Computing Surveys · doi:10.1145/3675392 · Cited by 108
Vieira, S., Liang, X., Guiomar, R. N. R. M., & Mechelli, A. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102193 · Cited by 94
Metadata
- Authors
- Zhang, Y., Xu, F., Zou, J., Petrosian, O. L., & Krinkin, K. V.
- Affiliations
- St Petersburg University (RU)
- Saint Petersburg State Electrotechnical University (RU)
- Venue
- 2021 II International Conference on Neural Networks and Neurotechnologies (NeuroNT)
- Publisher
- IEEE
- Published
- 2021-06-16
- Pages
- 13-16
- OpenAlex
- W3178601582
- Cited by
- 76
- References
- 10
- Citations by year
- 2026: 4 · 2025: 9 · 2024: 15 · 2023: 39 · 2022: 8 · 2021: 1
- FWCI
- 7.28
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- explainable AI, XAI evaluation, black-box models, model explanation, prediction, artificial neural networks, ensemble learning, high-dimensional prediction, explanation quality, model transparency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: XAI Evaluation: Evaluating Black-Box Model Explanations for Prediction. https://app.cochat.ai/papers/10.1109/neuront53022.2021.9472817
- The paper
- Zhang, Y., Xu, F., Zou, J., Petrosian, O. L., & Krinkin, K. V. (2021). XAI Evaluation: Evaluating Black-Box Model Explanations for Prediction. 2021 II International Conference on Neural Networks and Neurotechnologies (NeuroNT). https://doi.org/10.1109/neuront53022.2021.9472817
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.