The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing
Open accessAbstract
Although deep neural networks hold the state-of-the-art in several remote sensing tasks, their black-box operation hinders the understanding of their decisions, concealing any bias and other shortcomings in datasets and model performance. To this end, we have applied explainable artificial intelligence (XAI) methods in remote sensing multi-label classification tasks towards producing human-interpretable explanations and improve transparency. In particular, we utilized and trained deep learning models with state-of-the-art performance in the benchmark BigEarthNet and SEN12MS datasets. Ten XAI methods were employed towards understanding and interpreting models' predictions, along with quantitative metrics to assess and compare their performance. Numerous experiments were performed to assess the overall performance of XAI methods for straightforward prediction cases, competing multiple labels, as well as misclassification cases. According to our findings, Occlusion, Grad-CAM and Lime were the most interpretable and reliable XAI methods. However, none delivers high-resolution outputs, while apart from Grad-CAM, both Lime and Occlusion are computationally expensive. We also highlight different aspects of XAI performance and elaborate with insights on black-box decisions in order to improve transparency, understand their behavior and reveal, as well, datasets’ particularities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Kuhn, M., & Johnson, K. (2013) · doi:10.1007/978-1-4614-6849-3 · Cited by 6,788
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Striving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3060483 · Cited by 1,477 · cited 6×
“…noise to the original input and averages the calculated attributions: 𝛷𝛷 𝑺𝑺𝑰𝑰 ( 𝑓𝑓 𝑐𝑐 , 𝑥𝑥 ) = 𝔼𝔼 𝜀𝜀 ~ 𝒩𝒩�0 , 𝜎𝜎 𝑰𝑰� [ 𝛷𝛷 ( 𝑓𝑓 𝑐𝑐 , 𝑥𝑥 + 𝜀𝜀 )] This approach can be understood as an averaging process that makes the initial explanation smoother (Samek et al., 2021).”
BackgroundMethodResultInfluential
Research works printed but not linked: 16
- Achanta, 2012, SLIC superpixels compared to state-of-the-art superpixel methods, IEEE Trans. Pattern Anal. Mach. Intell., 34, 2274, 10.1109/TPAMI.2012.120 · DOI · Paper page
- Aune-Lundberg, 2021, The content and accuracy of the CORINE Land Cover dataset for Norway, Int. J. Appl. Earth Obs. Geoinf., 96, 102266
- Campos-Taberner, 2020, Understanding deep learning in land use classification based on Sentinel-2 time series, Sci. Rep., 10, 17188, 10.1038/s41598-020-74215-5 · DOI · Paper page
- Cheng, 2018, When deep learning meets metric learning: remote sensing image scene classification via learning discriminative CNNs, IEEE Trans. Geosci. Remote Sens., 56, 2811, 10.1109/TGRS.2017.2783902 · DOI · Paper page
- Hamylton, 2020, Evaluating techniques for mapping island vegetation from unmanned aerial vehicle (UAV) images: pixel classification, visual interpretation and machine learning approaches, Int. J. Appl. Earth Obs. Geoinf., 89, 102085
- Kokhlikyan, 2020, Captum: A unified and generic model interpretability library for PyTorch, CoRR
- Lapuschkin, 2019, Unmasking Clever Hans predictors and assessing what machines really learn, Nat. Commun., 10, 1096, 10.1038/s41467-019-08987-4 · DOI · Paper page
- Robinson, C., Malkin, K., Jojic, N., Chen, H., Qin, R., Xiao, C., Schmitt, M., Ghamisi, P., Hansch, R., Yokoya, N., 2021. Global Land Cover Mapping with Weak Supervision: Outcome of the 2020 IEEE GRSS Data Fusion Contest. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 1–1. https://doi.org/10.1109/JSTARS.2021.3063849. · doi:10.1109/jstars.2021.3063849
- Roscher, R., Bohn, B., Duarte, M.F., Garcke, J., 2020. Explain It to Me – Facing Remote Sensing Challenges in the Bio- and Geosciences With Explainable Machine Learning, in: ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences. Presented at the XXIV ISPRS Congress, Commission III (Volume V-3-2020) - 2020 edition, Copernicus GmbH, pp. 817–824. https://doi.org/10.5194/isprs-annals-V-3-2020-817-2020. · DOI
- Sumbul, G., Kang, J., Kreuziger, T., Marcelino, F., Costa, H., Benevides, P., Caetano, M., Demir, B., 2020. BigEarthNet Dataset with A New Class-Nomenclature for Remote Sensing Image Understanding. arXiv:2001.06372 [cs]. · arXiv
- Sundararajan, M., Taly, A., Yan, Q., 2017. Axiomatic attribution for deep networks, in: Proceedings of the 34th International Conference on Machine Learning - Volume 70, ICML’17. JMLR.org, Sydney, NSW, Australia, pp. 3319–3328.
- Wolanin, 2020, Estimating and understanding crop yields with explainable deep learning in the Indian Wheat Belt, Environ. Res. Lett., 15, 024019, 10.1088/1748-9326/ab68ac · DOI · Paper page
- Yeh, 2019, On the (In)fidelity and Sensitivity of Explanations, in: Advances in Neural Information Processing Systems, 10967
- Yessou, H., Sumbul, G., Demir, B., 2020. A Comparative Study of Deep Learning Loss Functions for Multi-Label Remote Sensing Image Classification, in: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). Hawaii, USA. · DOI
- Zeiler, M.D., Fergus, R., 2014. Visualizing and Understanding Convolutional Networks, in: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (Eds.), Computer Vision – ECCV 2014, Lecture Notes in Computer Science. Springer International Publishing, Cham, pp. 818–833. https://doi.org/10.1007/978-3-319-10590-1_53. · DOI · Paper page
- Zhang, 2020, A multi-level context-guided classification method with object-based convolutional neural network for land cover classification using very high resolution remote sensing images, Int. J. Appl. Earth Obs. Geoinf., 88, 102086
Cited by
A., S., & R., S. (2023) · Decision Analytics Journal · doi:10.1016/j.dajour.2023.100230 · Cited by 432
Himeur, Y., Rimal, B., Tiwary, A., & Amira, A. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.06.003 · Cited by 288
ŞAHiN, E., Arslan, N. N., & Özdemir, D. (2025) · Neural Computing and Applications · doi:10.1007/s00521-024-10437-2 · Cited by 278
Groen, A. M., Kraan, R., Amirkhan, S. F., Daams, J. G., & Maas, M. (2022) · European Journal of Radiology · doi:10.1016/j.ejrad.2022.110592 · Cited by 89
Benchmarking and scaling of deep learning models for land cover image classification
Papoutsis, I., Bountos, N. I., Zavras, A., Michail, D., & Tryfonopoulos, C. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.11.012 · Cited by 86
Metadata
- Authors
- Kakogeorgiou, I., & Karantzalos, K.
- Venue
- International Journal of Applied Earth Observation and Geoinformation
- Publisher
- Elsevier BV
- Published
- 2021-12
- Volume
- 103
- Pages
- 102520
- ISSN
- 0303-2434 (ISSN-L)
- 1569-8432
- OpenAlex
- W3146764839
- Cited by
- 158
- References
- 12
- FWCI
- 9.17
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor)
- Funders
- European Regional Development Fund (Τ6ΥΒΠ-00153)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing. https://app.cochat.ai/papers/10.1016/j.jag.2021.102520
- The paper
- Kakogeorgiou, I., & Karantzalos, K. (2021). Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing. International Journal of Applied Earth Observation and Geoinformation. https://doi.org/10.1016/j.jag.2021.102520
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.