Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification
The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Abstract
Supervised approaches classify input data using a set of representative samples for each class, known as training samples. The collection of such samples is expensive and time demanding. Hence, unsupervised feature learning, which has a quick access to arbitrary amounts of unlabeled data, is conceptually of high interest. In this paper, we propose a novel network architecture, fully Conv-Deconv network, for unsupervised spectral-spatial feature learning of hyperspectral images, which is able to be trained in an end-to-end manner. Specifically, our network is based on the so-called encoder-decoder paradigm, i.e., the input 3-D hyperspectral patch is first transformed into a typically lower dimensional space via a convolutional subnetwork (encoder), and then expanded to reproduce the initial data by a deconvolutional subnetwork (decoder). However, during the experiment, we found that such a network is not easy to be optimized. To address this problem, we refine the proposed network architecture by incorporating: 1) residual learning and 2) a new unpooling operation that can use memorized max-pooling indexes. Moreover, to understand the “black box,” we make an in-depth study of the learned feature maps in the experimental analysis. A very interesting discovery is that some specific “neurons” in the first residual block of the proposed network own good description power for semantic visual patterns in the object level, which provide an opportunity to achieve “free” object detection. This paper, for the first time in the remote sensing community, proposes an end-to-end fully Conv-Deconv network for unsupervised spectral-spatial feature learning. Moreover, this paper also introduces an in-depth investigation of learned features. Experimental results on two widely used hyperspectral data, Indian Pines and Pavia University, demonstrate competitive performance obtained by the proposed methodology compared with other studied approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
(2010) · Cited by 14,134
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Cited by
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Self-citationDeep Learning for Hyperspectral Image Classification: An Overview
Li, S., Song, W., Fang, L., Chen, Y., Ghamisi, P., & Benediktsson, J. A. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2907932 · Cited by 2,007
“training framework was proposed in [97], where the convolutional and deconvolutional networks were regarded as”
BackgroundMethodInfluentialSelf-citationHybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification
Roy, S. K., Krishna, G., Dubey, S. R., & Chaudhuri, B. B. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2918719 · Cited by 1,898
Deep learning classifiers for hyperspectral imaging: A review
Paoletti, M. E., Haut, J. M., Plaza, J., & Plaza, A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.09.006 · Cited by 1,073
Deep learning based multi-temporal crop classification
Zhong, L., Hu, L., & Zhou, H. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.11.032 · Cited by 1,024
Deep Learning for Classification of Hyperspectral Data: A Comparative Review
Audebert, N., Le Saux, B., & Lefevre, S. (2019) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2019.2912563 · Cited by 686
Mou, L., Bruzzone, L., & Zhu, X. X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2863224 · Cited by 633
Self-citationDong, Y., Liu, Q., Du, B., & Zhang, L. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3144017 · Cited by 578
Chen, K., Pu, X., Ren, Y., Qiu, H., Lin, F., & Zhang, S. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3034752 · Cited by 561
Deep Pyramidal Residual Networks for Spectral–Spatial Hyperspectral Image Classification
Paoletti, M. E., Haut, J. M., Fernandez-Beltran, R., Plaza, J., Plaza, A. J., & Pla, F. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2860125 · Cited by 531
Residual Spectral–Spatial Attention Network for Hyperspectral Image Classification
Zhu, M., Jiao, L., Liu, F., Yang, S., & Wang, J. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2994057 · Cited by 498
Vali, A., Comai, S., & Matteucci, M. (2020) · Remote Sensing · doi:10.3390/rs12152495 · Cited by 455
Spectral–Spatial Attention Network for Hyperspectral Image Classification
Sun, H., Zheng, X., Lu, X., & Wu, S. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2951160 · Cited by 410
Deep Learning Meets Hyperspectral Image Analysis: A Multidisciplinary Review
Signoroni, A., Savardi, M., Baronio, A., & Benini, S. (2019) · Journal of Imaging · doi:10.3390/jimaging5050052 · Cited by 385
A survey: Deep learning for hyperspectral image classification with few labeled samples
Jia, S., Jiang, S., Lin, Z., Li, N., Xu, M., & Yu, S. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.03.035 · Cited by 378
Building instance classification using street view images
Kang, J., Körner, M., Wang, Y., Taubenböck, H., & Zhu, X. X. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.02.006 · Cited by 365
Self-citationSelf-Supervised Learning in Remote Sensing: A review
Wang, Y., Albrecht, C. M., Braham, N. A. A., Mou, L., & Zhu, X. X. (2022) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2022.3198244 · Cited by 364
Self-citationA review of deep learning used in the hyperspectral image analysis for agriculture
Wang, C., Liu, B., Liu, L., Zhu, Y., Hou, J., Liu, P., & Li, X. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-10018-y · Cited by 362
Artificial intelligence for geoscience: Progress, challenges, and perspectives
Zhao, T., Wang, S., Ouyang, C., Chen, M., Liu, C., Zhang, J., Yu, L., Wang, F., Xie, Y., Li, J., et al. (2024) · The Innovation · doi:10.1016/j.xinn.2024.100691 · Cited by 360
Wurm, M., Stark, T., Zhu, X. X., Weigand, M., & Taubenböck, H. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.02.006 · Cited by 332
Self-citationFeature Extraction for Classification of Hyperspectral and LiDAR Data Using Patch-to-Patch CNN
Zhang, M., Li, W., Du, Q., Gao, L., & Zhang, B. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2864670 · Cited by 292
Nonlocal Graph Convolutional Networks for Hyperspectral Image Classification
Mou, L., Lu, X., Li, X., & Zhu, X. X. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2973363 · Cited by 291
Self-citationGeography-Aware Self-Supervised Learning
Ayush, K., Uzkent, B., Meng, C., Tanmay, K., Burke, M., Lobell, D., & Ermon, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01002 · Cited by 288
Research on image classification model based on deep convolution neural network
Xin, M., & Wang, Y. (2019) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-019-0417-8 · Cited by 281
Feature Extraction With Multiscale Covariance Maps for Hyperspectral Image Classification
He, N., Paoletti, M. E., Haut, J. M., Fang, L., Li, S., Plaza, A., & Plaza, J. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2860464 · Cited by 270
Metadata
- Authors
- Mou, L., Ghamisi, P., & Zhu, X. X.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2018-01
- Volume
- 56
- Issue
- 1
- Pages
- 391-406
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W2757208835
- Cited by
- 294
- References
- 58
- FWCI
- 28.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.