The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Spectral–Spatial Morphological Attention Transformer for Hyperspectral Image Classification
Abstract
In recent years, convolutional neural networks (CNNs) have drawn significant attention for the classification of hyperspectral images (HSIs). Due to their self-attention mechanism, the vision transformer (ViT) provides promising classification performance compared to CNNs. Many researchers have incorporated ViT for HSI classification purposes. However, its performance can be further improved because the current version does not use spatial–spectral features. In this article, we present a new morphological transformer (morphFormer) that implements a learnable spectral and spatial morphological network, where spectral and spatial morphological convolution operations are used (in conjunction with the attention mechanism) to improve the interaction between the structural and shape information of the HSI token and theCLStoken. Experiments conducted on widely used HSIs demonstrate the superiority of the proposed morphFormer over the classical CNN models and state-of-the-art transformer models. The source will be made available publicly athttps://github.com/mhaut/morphFormer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“Batch normalization (BN) [59] and ReLU activation layers are used after the Conv3D layer and the HetConv2D block.”
MethodLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“This is important to learn long-term dependencies, as the gradient vanishing problem may further complicate the interpretation of spectrally salient changes [43].”
BackgroundOn the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099
Classification of hyperspectral remote sensing images with support vector machines
Melgani, F., & Bruzzone, L. (2004) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.831865 · Cited by 4,411
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022) · ACM Computing Surveys · doi:10.1145/3505244 · Cited by 3,595
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2021) · arXiv · doi:10.48550/arxiv.2101.01169 · Cited by 3,594
Random Forests for land cover classification
Gislason, P. O., Benediktsson, J. A., & Sveinsson, J. R. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.08.011 · Cited by 2,244
Accelerating t-SNE using tree-based algorithms
van der Maaten, L. (2014) · doi:10.5555/2627435.2697068 · Cited by 2,226
Zhong, Z., Li, J., Luo, Z., & Chapman, M. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2755542 · Cited by 1,959
HybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification
Roy, S. K., Krishna, G., Dubey, S. R., & Chaudhuri, B. B. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2918719 · Cited by 1,898
Self-citationGLC2000: a new approach to global land cover mapping from Earth observation data
Bartholomé, E., & Belward, A. S. (2005) · International Journal of Remote Sensing · doi:10.1080/01431160412331291297 · Cited by 1,798
Graph Convolutional Networks for Hyperspectral Image Classification
Hong, D., Gao, L., Yao, J., Zhang, B., Plaza, A., & Chanussot, J. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3015157 · Cited by 1,691
Self-citationSpectralFormer: Rethinking Hyperspectral Image Classification With Transformers
Hong, D., Han, Z., Yao, J., Gao, L., Zhang, B., Plaza, A., & Chanussot, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3130716 · Cited by 1,382
Self-citationMore Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification
Hong, D., Gao, L., Yokoya, N., Yao, J., Chanussot, J., Du, Q., & Zhang, B. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3016820 · Cited by 1,374
Self-citationDeep supervised learning for hyperspectral data classification through convolutional neural networks
Makantasis, K., Karantzalos, K., Doulamis, A., & Doulamis, N. (2015) · 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326945 · Cited by 1,011
3-D Deep Learning Approach for Remote Sensing Image Classification
Ben Hamida, A., Benoit, A., Lambert, P., & Ben Amar, C. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2818945 · Cited by 875
A new approach for the morphological segmentation of high-resolution satellite imagery
Pesaresi, M., & Benediktsson, J. A. (2001) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.905239 · Cited by 824
Spectral–Spatial Feature Tokenization Transformer for Hyperspectral Image Classification
Sun, L., Zhao, G., Zheng, Y., & Wu, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3144158 · Cited by 778 · cited 2×
“To further improve the classification performance of HSIs, Sun et al. [48] introduced spatial and spectral tokenization of feature representations in the encoder, which helps to extract local spatial information and establish long-range relations between neighboring sequences.”
BackgroundMethodGenerative Adversarial Networks for Hyperspectral Image Classification
Zhu, L., Chen, Y., Ghamisi, P., & Benediktsson, J. A. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2805286 · Cited by 734
Morphological Attribute Profiles for the Analysis of Very High Resolution Images
Dalla Mura, M., Benediktsson, J. A., Waske, B., & Bruzzone, L. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2048116 · Cited by 722
Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification
Li, W., Chen, C., Su, H., & Du, Q. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2381602 · Cited by 685
Self-citationRasti, B., Hong, D., Hang, R., Ghamisi, P., Kang, X., Chanussot, J., & Benediktsson, J. A. (2020) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2020.2979764 · Cited by 537
Deep Pyramidal Residual Networks for Spectral–Spatial Hyperspectral Image Classification
Paoletti, M. E., Haut, J. M., Fernandez-Beltran, R., Plaza, J., Plaza, A. J., & Pla, F. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2860125 · Cited by 531
Self-citationAttention-Based Adaptive Spectral–Spatial Kernel ResNet for Hyperspectral Image Classification
Roy, S. K., Manna, S., Song, T., & Bruzzone, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3043267 · Cited by 519
Self-citationMultimodal Fusion Transformer for Remote Sensing Image Classification
Roy, S. K., Deria, A., Hong, D., Rasti, B., Plaza, A., & Chanussot, J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3286826 · Cited by 519
Self-citationResidual Spectral–Spatial Attention Network for Hyperspectral Image Classification
Zhu, M., Jiao, L., Liu, F., Yang, S., & Wang, J. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2994057 · Cited by 498
Hyperspectral Image Classification—Traditional to Deep Models: A Survey for Future Prospects
Ahmad, M., Shabbir, S., Roy, S. K., Hong, D., Wu, X., Yao, J., Khan, A. M., Mazzara, M., Distefano, S., & Chanussot, J. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3133021 · Cited by 438
Self-citationHe, J., Zhao, L., Yang, H., Zhang, M., & Li, W. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2934760 · Cited by 383
Noise Reduction in Hyperspectral Imagery: Overview and Application
Rasti, B., Scheunders, P., Ghamisi, P., Licciardi, G., & Chanussot, J. (2018) · Remote Sensing · doi:10.3390/rs10030482 · Cited by 346
Hong, D., Hu, J., Yao, J., Chanussot, J., & Zhu, X. X. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.05.011 · Cited by 326
Hong, D., Wu, X., Ghamisi, P., Chanussot, J., Yokoya, N., & Zhu, X. X. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2957251 · Cited by 310
Hyperspectral Image Transformer Classification Networks
Yang, X., Cao, W., Lu, Y., & Zhou, Y. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3171551 · Cited by 282
diffGrad: An Optimization Method for Convolutional Neural Networks
Dubey, S. R., Chakraborty, S., Roy, S. K., Mukherjee, S., Singh, S. K., & Chaudhuri, B. B. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2955777 · Cited by 270
Self-citationZhong, Z., Li, Y., Ma, L., Li, J., & Zheng, W.-S. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3115699 · Cited by 241
Wu, X., Hong, D., Tian, J., Chanussot, J., Li, W., & Tao, R. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2897139 · Cited by 212
Classification of Remote Sensing Optical and LiDAR Data Using Extended Attribute Profiles
Pedergnana, M., Marpu, P., Mura, M. D., Benediktsson, J. A., & Bruzzone, L. (2012) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2012.2208177 · Cited by 192
Koetz, B., Morsdorf, F., van der Linden, S., Curt, T., & Allgöwer, B. (2008) · Forest Ecology and Management · doi:10.1016/j.foreco.2008.04.025 · Cited by 186
Wang, X., Feng, Y., Song, R., Mu, Z., & Song, C. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.12.008 · Cited by 164
Wu, X., Hong, D., Chanussot, J., Xu, Y., Tao, R., & Wang, Y. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2919755 · Cited by 137
Multimodal GANs: Toward Crossmodal Hyperspectral–Multispectral Image Segmentation
Hong, D., Yao, J. T., Meng, D., Xu, Z., & Chanussot, J. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3020823 · Cited by 131
Morphological Convolutional Neural Networks for Hyperspectral Image Classification
Roy, S. K., Mondal, R., Paoletti, M. E., Haut, J. M., & Plaza, A. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3088228 · Cited by 117
Self-citationGenerative Adversarial Minority Oversampling for Spectral–Spatial Hyperspectral Image Classification
Roy, S. K., Haut, J. M., Paoletti, M. E., Dubey, S. R., & Plaza, A. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3052048 · Cited by 114
Self-citationYuan, J., Wang, S., Wu, C., & Xu, Y. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2022.3174412 · Cited by 106
Roy, S. K., Chatterjee, S., Bhattacharyya, S., Chaudhuri, B. B., & Platoš, J. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2961681 · Cited by 102
Self-citationRoy, S. K., Dubey, S. R., Chatterjee, S., & Chaudhuri, B. B. (2020) · IET Image Processing · doi:10.1049/iet-ipr.2019.1462 · Cited by 87
Self-citationMultiple Attention-Guided Capsule Networks for Hyperspectral Image Classification
Paoletti, M. E., Moreno‐Álvarez, S., & Haut, J. M. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3135506 · Cited by 60
Self-citationChen, C., Yan, J., Wang, L., Liang, D., & Zhang, W. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3044250 · Cited by 58
Revisiting Deep Hyperspectral Feature Extraction Networks via Gradient Centralized Convolution
Roy, S. K., Kar, P., Hong, D., Wu, X., Plaza, A., & Chanussot, J. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3120198 · Cited by 53
Self-citationRotation Equivariant Convolutional Neural Networks for Hyperspectral Image Classification
Paoletti, M. E., Haut, J. M., Roy, S. K., & Hendrix, E. M. T. (2020) · IEEE Access · doi:10.1109/access.2020.3027776 · Cited by 41
Self-citationAutomatic fusion and classification of hyperspectral and LiDAR data using random forests
Merentitis, A., Debes, C., Heremans, R., & Frangiadakis, N. (2014) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2014.6946658 · Cited by 24
Local morphological pattern: A scale space shape descriptor for texture classification
Roy, S. K., Chanda, B., Chaudhuri, B. B., Ghosh, D. K., & Dubey, S. R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2018.06.016 · Cited by 24
Self-citationA New Max-Min Convolutional Network for Hyperspectral Image Classification
Roy, S., Paoletti, M. E., Haut, J. M., Hendrix, E. M. T., & Plaza, A. (2021) · Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing · doi:10.1109/whispers52202.2021.9483983 · Cited by 11
Self-citationDeep mixed precision for hyperspectral image classification
Paoletti, M. E., Tao, X., Haut, J. M., Moreno‐Álvarez, S., & Plaza, A. (2021) · The Journal of Supercomputing · doi:10.1007/s11227-021-03638-2 · Cited by 10
Self-citationSiCoDeF² Net: Siamese Convolution Deconvolution Feature Fusion Network for One-Shot Classification
Roy, S. K., Kar, P., Paoletti, M. E., et al. (2021) · IEEE Access · doi:10.1109/access.2021.3107626 · Cited by 10
Self-citation
Cited by
Multimodal Fusion Transformer for Remote Sensing Image Classification
Roy, S. K., Deria, A., Hong, D., Rasti, B., Plaza, A., & Chanussot, J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3286826 · Cited by 519
Self-citation
Metadata
- Authors
- Roy, S. K., Deria, A., Shah, C., Haut, J. M., Du, Q., & Plaza, A.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2023
- Volume
- 61
- Pages
- 1-15
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W4319069095
- Cited by
- 371
- References
- 56
- FWCI
- 40.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.