The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification
Abstract
Supervised approaches classify input data using a set of representative samples for each class, known as training samples. The collection of such samples is expensive and time demanding. Hence, unsupervised feature learning, which has a quick access to arbitrary amounts of unlabeled data, is conceptually of high interest. In this paper, we propose a novel network architecture, fully Conv-Deconv network, for unsupervised spectral-spatial feature learning of hyperspectral images, which is able to be trained in an end-to-end manner. Specifically, our network is based on the so-called encoder-decoder paradigm, i.e., the input 3-D hyperspectral patch is first transformed into a typically lower dimensional space via a convolutional subnetwork (encoder), and then expanded to reproduce the initial data by a deconvolutional subnetwork (decoder). However, during the experiment, we found that such a network is not easy to be optimized. To address this problem, we refine the proposed network architecture by incorporating: 1) residual learning and 2) a new unpooling operation that can use memorized max-pooling indexes. Moreover, to understand the “black box,” we make an in-depth study of the learned feature maps in the experimental analysis. A very interesting discovery is that some specific “neurons” in the first residual block of the proposed network own good description power for semantic visual patterns in the object level, which provide an opportunity to achieve “free” object detection. This paper, for the first time in the remote sensing community, proposes an end-to-end fully Conv-Deconv network for unsupervised spectral-spatial feature learning. Moreover, this paper also introduces an in-depth investigation of learned features. Experimental results on two widely used hyperspectral data, Indian Pines and Pavia University, demonstrate competitive performance obtained by the proposed methodology compared with other studied approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
(2010) · Cited by 14,134
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“notorious vanishing gradient problem [46], [47] can”
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,842
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
Classification of hyperspectral remote sensing images with support vector machines
Melgani, F., & Bruzzone, L. (2004) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.831865 · Cited by 4,411
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Chen, Y., Jiang, H., Li, C., Jia, X., & Ghamisi, P. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2584107 · Cited by 2,984
Self-citationRegion-based convolutional networks for accurate object detection and segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2437384 · Cited by 2,912
Deep learning-based classification of hyperspectral data
Chen, Y., Lin, Z., Zhao, X., Wang, G., & Gu, Y. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2329330 · Cited by 2,679
Deep Convolutional Neural Networks for Hyperspectral Image Classification
Hu, W., Huang, Y., Wei, L., Zhang, F., & Li, H. (2015) · Journal of Sensors · doi:10.1155/2015/258619 · Cited by 1,941
Classification of hyperspectral data from urban areas based on extended morphological profiles
Benediktsson, J. A., Palmason, J. A., & Sveinsson, J. R. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.842478 · Cited by 1,393
Deep Recurrent Neural Networks for Hyperspectral Image Classification
Mou, L., Ghamisi, P., & Zhu, X. X. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2636241 · Cited by 1,383
Self-citationAdvances in Spectral-Spatial Classification of Hyperspectral Images
Fauvel, M., Tarabalka, Y., Benediktsson, J. A., Chanussot, J., & Tilton, J. C. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2197589 · Cited by 1,282
Investigation of the random forest framework for classification of hyperspectral data
Ham, J., Chen, Y., Crawford, M. M., & Ghosh, J. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.842481 · Cited by 1,276
Spectral-spatial classification of hyperspectral data based on deep belief network
Chen, Y., Zhao, X., & Jia, X. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2388577 · Cited by 1,259 · cited 1×
“In [21], a restricted Boltzmann machine (RBM) and its extension, deep belief net-”
BackgroundZhao, W., & Du, S. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2543748 · Cited by 1,212
Foody, G. M. (2004) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.70.5.627 · Cited by 1,065
Deep supervised learning for hyperspectral data classification through convolutional neural networks
Makantasis, K., Karantzalos, K., Doulamis, A., & Doulamis, N. (2015) · 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326945 · Cited by 1,011
Spectral and Spatial Classification of Hyperspectral Data Using SVMs and Morphological Profiles
Fauvel, M., Benediktsson, J. A., Chanussot, J., & Sveinsson, J. R. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2008.922034 · Cited by 990
Opportunities and limitations for image-based remote sensing in precision crop management
Moran, M. S., Inoue, Y., & Barnes, E. M. (1997) · Remote Sensing of Environment · doi:10.1016/s0034-4257(97)00045-x · Cited by 921
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1505.00387 · Cited by 912
Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles
Fauvel, M., Chanussot, J., Benediktsson, J. A., & Sveinsson, J. R. (2007) · 2007 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss.2007.4423943 · Cited by 904
A new approach for the morphological segmentation of high-resolution satellite imagery
Pesaresi, M., & Benediktsson, J. A. (2001) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.905239 · Cited by 824
Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks
Dosovitskiy, A., Fischer, P., Springenberg, J. T., Riedmiller, M., & Brox, T. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2496141 · Cited by 762
Unsupervised Deep Feature Extraction for Remote Sensing Image Classification
Romero, A., Gatta, C., & Camps-Valls, G. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2478379 · Cited by 729
Feature Selection Based on Hybridization of Genetic Algorithm and Particle Swarm Optimization
Ghamisi, P., & Benediktsson, J. A. (2014) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2014.2337320 · Cited by 469
Self-citationTao, C., Pan, H., Li, Y., & Zou, Z. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2482520 · Cited by 397
A Survey on Spectral–Spatial Classification Techniques Based on Attribute Profiles
Ghamisi, P., Dalla Mura, M., & Benediktsson, J. A. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2358934 · Cited by 350
Self-citationSlow Feature Analysis for Change Detection in Multispectral Imagery
Wu, C., Du, B., & Zhang, L. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2266673 · Cited by 349
Li, J., Bioucas-Dias, J. M., & Plaza, A. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2205263 · Cited by 336
Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection
Lyu, H., Lu, H., & Mou, L. (2016) · Remote Sensing · doi:10.3390/rs8060506 · Cited by 334
Self-citationFauvel, M., Chanussot, J., & Benediktsson, J. A. (2009) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/2009/783194 · Cited by 265
Olmanson, L. G., Brezonik, P. L., & Bauer, M. E. (2013) · Remote Sensing of Environment · doi:10.1016/j.rse.2012.11.023 · Cited by 241
Gu, Y., Liu, T., Jia, X., Benediktsson, J. A., & Chanussot, J. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2514161 · Cited by 233
Learning to Generate Chairs, Tables and Cars with Convolutional Networks
Dosovitskiy, A., Springenberg, J., Tatarchenko, M., & Brox, T. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2567384 · Cited by 226
Scene Recognition by Manifold Regularized Deep Learning Architecture
Yuan, Y., Mou, L., & Lu, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2359471 · Cited by 214
Self-citationDemir, B., Bovolo, F., & Bruzzone, L. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2195727 · Cited by 187
Support vector machines for classification of hyperspectral data
Gualtieri, J. A., & Chettri, S. (2002) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2000.861712 · Cited by 164
A Self-Improving Convolution Neural Network for the Classification of Hyperspectral Data
Ghamisi, P., Chen, Y., & Zhu, X. X. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2595108 · Cited by 159
Self-citationDeep Learning With Attribute Profiles for Hyperspectral Image Classification
Aptoula, E., Özdemir, M. C., & Yanikoglu, B. A. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2619354 · Cited by 157
Spectral-Spatial Classification of Hyperspectral Remote Sensing Images
Benediktsson, J. A., & Ghamisi, P. (2015) · Cited by 152
Self-citationGhamisi, P., Benediktsson, J. A., & Sveinsson, J. R. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2292544 · Cited by 125
Self-citationLearning to Linearize Under UncertaintyPreprint
Goroshin, R., Mathieu, M., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03011 · Cited by 119
Delalieux, S., Somers, B., Haest, B., Spanhove, T., Borre, J. V., & Mücher, C. A. (2012) · Remote Sensing of Environment · doi:10.1016/j.rse.2012.08.029 · Cited by 108
A Discontinuity Preserving Relaxation Scheme for Spectral–Spatial Hyperspectral Image Classification
Li, J., Khodadadzadeh, M., Plaza, A., Jia, X., & Bioucas‐Dias, J. M. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2470129 · Cited by 79
Hu, J., Mou, L., Schmitt, A., & Zhu, X. X. (2017) · Joint Urban Remote Sensing Event (JURSE) · doi:10.1109/jurse.2017.7924565 · Cited by 73
Self-citationMultitemporal Very High Resolution From Space: Outcome of the 2016 IEEE GRSS Data Fusion Contest
Mou, L., Zhu, X. X., Vakalopoulou, M., Karantzalos, K. G., Nikos Paragios, A., Saux, B. L., Moser, G., & Tuia, D. (2017) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2017.2696823 · Cited by 70
Self-citationSpatiotemporal scene interpretation of space videos via deep neural network and tracklet analysis
Mou, L., & Zhu, X. X. (2016) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2016.7729468 · Cited by 48
Self-citationApplication of Model-Based Change Detection to Airborne VNIR/SWIR Hyperspectral Imagery
Meola, J., Eismann, M. T., Moses, R. L., & Ash, J. N. (2012) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2186305 · Cited by 27
Cited by
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Self-citationDeep Learning for Hyperspectral Image Classification: An Overview
Li, S., Song, W., Fang, L., Chen, Y., Ghamisi, P., & Benediktsson, J. A. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2907932 · Cited by 2,007
“training framework was proposed in [97], where the convolutional and deconvolutional networks were regarded as”
BackgroundMethodInfluentialSelf-citationHybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification
Roy, S. K., Krishna, G., Dubey, S. R., & Chaudhuri, B. B. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2918719 · Cited by 1,898
Deep learning classifiers for hyperspectral imaging: A review
Paoletti, M. E., Haut, J. M., Plaza, J., & Plaza, A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.09.006 · Cited by 1,073
Deep learning based multi-temporal crop classification
Zhong, L., Hu, L., & Zhou, H. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.11.032 · Cited by 1,024
Metadata
- Authors
- Mou, L., Ghamisi, P., & Zhu, X. X.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2018-01
- Volume
- 56
- Issue
- 1
- Pages
- 391-406
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W2757208835
- Cited by
- 294
- References
- 58
- FWCI
- 28.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.