Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 158

The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.

Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing

Open access
Kakogeorgiou, Ioannis, Karantzalos, Konstantinos · 2021 · International Journal of Applied Earth Observation and Geoinformation

Abstract

Although deep neural networks hold the state-of-the-art in several remote sensing tasks, their black-box operation hinders the understanding of their decisions, concealing any bias and other shortcomings in datasets and model performance. To this end, we have applied explainable artificial intelligence (XAI) methods in remote sensing multi-label classification tasks towards producing human-interpretable explanations and improve transparency. In particular, we utilized and trained deep learning models with state-of-the-art performance in the benchmark BigEarthNet and SEN12MS datasets. Ten XAI methods were employed towards understanding and interpreting models' predictions, along with quantitative metrics to assess and compare their performance. Numerous experiments were performed to assess the overall performance of XAI methods for straightforward prediction cases, competing multiple labels, as well as misclassification cases. According to our findings, Occlusion, Grad-CAM and Lime were the most interpretable and reliable XAI methods. However, none delivers high-resolution outputs, while apart from Grad-CAM, both Lime and Occlusion are computationally expensive. We also highlight different aspects of XAI performance and elaborate with insights on black-box decisions in order to improve transparency, understand their behavior and reveal, as well, datasets’ particularities.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.jag.2021.102520

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 12 references

Research works printed but not linked: 16

  1. Achanta, 2012, SLIC superpixels compared to state-of-the-art superpixel methods, IEEE Trans. Pattern Anal. Mach. Intell., 34, 2274, 10.1109/TPAMI.2012.120 · DOI · Paper page
  2. Aune-Lundberg, 2021, The content and accuracy of the CORINE Land Cover dataset for Norway, Int. J. Appl. Earth Obs. Geoinf., 96, 102266
  3. Campos-Taberner, 2020, Understanding deep learning in land use classification based on Sentinel-2 time series, Sci. Rep., 10, 17188, 10.1038/s41598-020-74215-5 · DOI · Paper page
  4. Cheng, 2018, When deep learning meets metric learning: remote sensing image scene classification via learning discriminative CNNs, IEEE Trans. Geosci. Remote Sens., 56, 2811, 10.1109/TGRS.2017.2783902 · DOI · Paper page
  5. Hamylton, 2020, Evaluating techniques for mapping island vegetation from unmanned aerial vehicle (UAV) images: pixel classification, visual interpretation and machine learning approaches, Int. J. Appl. Earth Obs. Geoinf., 89, 102085
  6. Kokhlikyan, 2020, Captum: A unified and generic model interpretability library for PyTorch, CoRR
  7. Lapuschkin, 2019, Unmasking Clever Hans predictors and assessing what machines really learn, Nat. Commun., 10, 1096, 10.1038/s41467-019-08987-4 · DOI · Paper page
  8. Robinson, C., Malkin, K., Jojic, N., Chen, H., Qin, R., Xiao, C., Schmitt, M., Ghamisi, P., Hansch, R., Yokoya, N., 2021. Global Land Cover Mapping with Weak Supervision: Outcome of the 2020 IEEE GRSS Data Fusion Contest. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 1–1. https://doi.org/10.1109/JSTARS.2021.3063849. · doi:10.1109/jstars.2021.3063849
  9. Roscher, R., Bohn, B., Duarte, M.F., Garcke, J., 2020. Explain It to Me – Facing Remote Sensing Challenges in the Bio- and Geosciences With Explainable Machine Learning, in: ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences. Presented at the XXIV ISPRS Congress, Commission III (Volume V-3-2020) - 2020 edition, Copernicus GmbH, pp. 817–824. https://doi.org/10.5194/isprs-annals-V-3-2020-817-2020. · DOI
  10. Sumbul, G., Kang, J., Kreuziger, T., Marcelino, F., Costa, H., Benevides, P., Caetano, M., Demir, B., 2020. BigEarthNet Dataset with A New Class-Nomenclature for Remote Sensing Image Understanding. arXiv:2001.06372 [cs]. · arXiv
  11. Sundararajan, M., Taly, A., Yan, Q., 2017. Axiomatic attribution for deep networks, in: Proceedings of the 34th International Conference on Machine Learning - Volume 70, ICML’17. JMLR.org, Sydney, NSW, Australia, pp. 3319–3328.
  12. Wolanin, 2020, Estimating and understanding crop yields with explainable deep learning in the Indian Wheat Belt, Environ. Res. Lett., 15, 024019, 10.1088/1748-9326/ab68ac · DOI · Paper page
  13. Yeh, 2019, On the (In)fidelity and Sensitivity of Explanations, in: Advances in Neural Information Processing Systems, 10967
  14. Yessou, H., Sumbul, G., Demir, B., 2020. A Comparative Study of Deep Learning Loss Functions for Multi-Label Remote Sensing Image Classification, in: IEEE International Geoscience and Remote Sensing Symposium (IGARSS). Hawaii, USA. · DOI
  15. Zeiler, M.D., Fergus, R., 2014. Visualizing and Understanding Convolutional Networks, in: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (Eds.), Computer Vision – ECCV 2014, Lecture Notes in Computer Science. Springer International Publishing, Cham, pp. 818–833. https://doi.org/10.1007/978-3-319-10590-1_53. · DOI · Paper page
  16. Zhang, 2020, A multi-level context-guided classification method with object-based convolutional neural network for land cover classification using very high resolution remote sensing images, Int. J. Appl. Earth Obs. Geoinf., 88, 102086

Cited by

See all 158

Metadata

Authors
Kakogeorgiou, I., & Karantzalos, K.
Venue
International Journal of Applied Earth Observation and Geoinformation
Publisher
Elsevier BV
Published
2021-12
Volume
103
Pages
102520
ISSN
  • 0303-2434 (ISSN-L)
  • 1569-8432
OpenAlex
W3146764839
Cited by
158
References
12
FWCI
9.17
Type
journal article
Language
en
Open access
gold
Licence
Funders
European Regional Development Fund (Τ6ΥΒΠ-00153)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing. https://app.cochat.ai/papers/10.1016/j.jag.2021.102520
The paper
Kakogeorgiou, I., & Karantzalos, K. (2021). Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing. International Journal of Applied Earth Observation and Geoinformation. https://doi.org/10.1016/j.jag.2021.102520

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.