Hyperspectral Image Classification With Attention-Aided CNNs
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Convolutional neural networks (CNNs) have been widely used for hyperspectral image classification. As a common process, small cubes are first cropped from the hyperspectral image and then fed into CNNs to extract spectral and spatial features. It is well known that different spectral bands and spatial positions in the cubes have different discriminative abilities. If fully explored, this prior information will help improve the learning capacity of CNNs. Along this direction, we propose an attention-aided CNN model for spectral-spatial classification of hyperspectral images. Specifically, a spectral attention subnetwork and a spatial attention subnetwork are proposed for spectral and spatial classifications, respectively. Both of them are based on the traditional CNN model and incorporate attention modules to aid networks that focus on more discriminative channels or positions. In the final classification phase, the spectral classification result and the spatial classification result are combined together via an adaptively weighted summation method. To evaluate the effectiveness of the proposed model, we conduct experiments on three standard hyperspectral data sets. The experimental results show that the proposed model can achieve superior performance compared with several state-of-the-art CNN-related models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
CBAM: Convolutional Block Attention Module
Woo, S., Park, J., Lee, J.-Y., & Kweon, I. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_1 · Cited by 25,853
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Residual Attention Network for Image Classification
Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.683 · Cited by 4,073
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Chen, Y., Jiang, H., Li, C., Jia, X., & Ghamisi, P. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2584107 · Cited by 2,984
Self-citationDeep learning-based classification of hyperspectral data
Chen, Y., Lin, Z., Zhao, X., Wang, G., & Gu, Y. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2329330 · Cited by 2,679
Recurrent Models of Visual Attention
Mnih, V., Heess, N., Graves, A., & Kavukcuoglu, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.6247 · Cited by 2,568
Deep Learning for Hyperspectral Image Classification: An Overview
Li, S., Song, W., Fang, L., Chen, Y., Ghamisi, P., & Benediktsson, J. A. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2907932 · Cited by 2,007 · cited 1×
“Due to its powerful feature learning ability, deep learning has been naturally employed to the classification task of hyperspectral images [9], [10].”
Self-citationStacked Attention Networks for Image Question Answering
Yang, Z., He, X., Gao, J., Deng, L., & Smola, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.10 · Cited by 1,998
SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning
Chen, L., Zhang, H., Xiao, J., Nie, L., Shao, J., Liu, W., & Chua, T.-S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.667 · Cited by 1,992
Zhong, Z., Li, J., Luo, Z., & Chapman, M. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2755542 · Cited by 1,959
Deep Convolutional Neural Networks for Hyperspectral Image Classification
Hu, W., Huang, Y., Wei, L., Zhang, F., & Li, H. (2015) · Journal of Sensors · doi:10.1155/2015/258619 · Cited by 1,941
Spectral–Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network
Li, Y., Zhang, H., & Shen, Q. (2017) · Remote Sensing · doi:10.3390/rs9010067 · Cited by 1,320
Zhao, W., & Du, S. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2543748 · Cited by 1,212
An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing
Hong, D., Yokoya, N., Chanussot, J., & Zhu, X. X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2878958 · Cited by 948
Hyperspectral Image Classification Using Deep Pixel-Pair Features
Li, W., Wu, G., Zhang, F., & Du, Q. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2616355 · Cited by 805
Multisource Remote Sensing Data Classification Based on Convolutional Neural Network
Xu, X., Li, W., Ran, Q., Du, Q., Gao, L., & Zhang, B. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2756851 · Cited by 689
Advanced Spectral Classifiers for Hyperspectral Images: A review
Ghamisi, P., Plaza, J., Chen, Y., Li, J., & Plaza, A. J. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2616418 · Cited by 675
Self-citationHyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion Contest
Debes, C., Merentitis, A., Heremans, R., Hahn, J., Frangiadakis, N., van Kasteren, T., Liao, W., Bellens, R., Pizurica, A., Gautama, S., et al. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2305441 · Cited by 653
He, L., Li, J., Liu, C., & Li, S. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2765364 · Cited by 630
Rasti, B., Hong, D., Hang, R., Ghamisi, P., Kang, X., Chanussot, J., & Benediktsson, J. A. (2020) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2020.2979764 · Cited by 537
Self-citationCascaded Recurrent Neural Networks for Hyperspectral Image Classification
Hang, R., Liu, Q., Hong, D., & Ghamisi, P. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2899129 · Cited by 534
Self-citationDeep Pyramidal Residual Networks for Spectral–Spatial Hyperspectral Image Classification
Paoletti, M. E., Haut, J. M., Fernandez-Beltran, R., Plaza, J., Plaza, A. J., & Pla, F. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2860125 · Cited by 531
Learning and Transferring Deep Joint Spectral–Spatial Features for Hyperspectral Classification
Yang, J., Zhao, Y.-Q., & Chan, J. C.-W. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2698503 · Cited by 484
Classification of Hyperspectral and LiDAR Data Using Coupled CNNs
Hang, R., Li, Z., Ghamisi, P., Hong, D., Xia, G., & Liu, Q. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2969024 · Cited by 466
Self-citationSemi-Supervised Deep Learning Using Pseudo Labels for Hyperspectral Image Classification
Wu, H., & Prasad, S. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2772836 · Cited by 463
Tao, C., Pan, H., Li, Y., & Zou, Z. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2482520 · Cited by 397
Xu, Y., Du, B., Zhang, L., Cerra, D., Pato, M., Carmona, E., Prasad, S., Yokoya, N., Hansch, R., & Le Saux, B. (2019) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2019.2911113 · Cited by 337
Ghamisi, P., Maggiori, E., Li, S., Souza, R., Tarablaka, Y., Moser, G., De Giorgi, A., Fang, L., Chen, Y., Chi, M., et al. (2018) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2018.2854840 · Cited by 325
Self-citationLiu, Q., Zhou, F., Hang, R., & Yuan, X. (2017) · Remote Sensing · doi:10.3390/rs9121330 · Cited by 318
Self-citationHyperspectral Images Classification With Gabor Filtering and Convolutional Neural Network
Chen, Y., Zhu, L., Ghamisi, P., Jia, X., Li, G., & Tang, L. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2764915 · Cited by 270
Self-citationConvolutional Recurrent Neural Networks forHyperspectral Data Classification
Wu, H., & Prasad, S. (2017) · Remote Sensing · doi:10.3390/rs9030298 · Cited by 268
Spectral–Spatial Classification of Hyperspectral Image Based on Deep Auto-Encoder
Ma, X., Wang, H., & Geng, J. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2517204 · Cited by 258
Hyperspectral image classification using spectral-spatial LSTMs
Zhou, F., Hang, R., Liu, Q., & Yuan, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.02.105 · Cited by 246
Self-citationNonlocal Patch Tensor Sparse Representation for Hyperspectral Image Super-Resolution
Xu, Y., Wu, Z., Chanussot, J., & Wei, Z. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2893530 · Cited by 231
CoSpace: Common Subspace Learning From Hyperspectral-Multispectral Correspondences
Hong, D., Yokoya, N., Chanussot, J., & Zhu, X. X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2890705 · Cited by 221
Fang, B., Li, Y., Zhang, H., & Chan, J. C.-W. (2019) · Remote Sensing · doi:10.3390/rs11020159 · Cited by 173
Deep Learning With Attribute Profiles for Hyperspectral Image Classification
Aptoula, E., Özdemir, M. C., & Yanikoglu, B. A. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2619354 · Cited by 157
Cited by
Yao, J., Zhang, B., Li, C., Hong, D., & Chanussot, J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3284671 · Cited by 390
Metadata
- Authors
- Hang, R., Li, Z., Liu, Q., Ghamisi, P., & Bhattacharyya, S. S.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2021-03
- Volume
- 59
- Issue
- 3
- Pages
- 2281-2293
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W3043181422
- Cited by
- 341
- References
- 42
- FWCI
- 25.87
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.