The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Deep Learning for Classification of Hyperspectral Data: A Comparative Review
Open accessAbstract
In recent years, deep-learning techniques revolutionized the way remote sensing data are processed. The classification of hyperspectral data is no exception to the rule, but it has intrinsic specificities that make the application of deep learning less straightforward than with other optical data. This article presents the state of the art of previous machine-learning approaches, reviews the various deep learning approaches currently proposed for hyperspectral classification, and identifies the problems and difficulties that arise in the implementation of deep neural networks for this task. In particular, the issues of spatial and spectral resolution, data volume, and transfer of models from multimedia images to hyperspectral data are addressed. Additionally, a comparative study of various families of network architectures is provided, and a software toolbox is publicly released to allow experimenting with these methods (https://github.com/nshaud/DeepHyperX). This article is intended for both data scientists with interest in hyperspectral data and remote sensing experts eager to apply deep learning techniques to their own data set.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
(2010) · International Conference on Machine Learning · Cited by 13,995
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Classification of hyperspectral remote sensing images with support vector machines
Melgani, F., & Bruzzone, L. (2004) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.831865 · Cited by 4,411
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Chen, Y., Jiang, H., Li, C., Jia, X., & Ghamisi, P. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2584107 · Cited by 2,984
Deep learning-based classification of hyperspectral data
Chen, Y., Lin, Z., Zhao, X., Wang, G., & Gu, Y. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2329330 · Cited by 2,679
Hyperspectral remote sensing data analysis and future challenges
Bioucas-Dias, J. M., Plaza, A., Camps-Valls, G., Scheunders, P., Nasrabadi, N., & Chanussot, J. (2013) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2013.2244672 · Cited by 2,223
Deep Convolutional Neural Networks for Hyperspectral Image Classification
Hu, W., Huang, Y., Wei, L., Zhang, F., & Li, H. (2015) · Journal of Sensors · doi:10.1155/2015/258619 · Cited by 1,941
Image-Based Atmospheric Corrections - Revisited and Improved
Chavez, P. S. (1996) · Photogrammetric Engineering & Remote Sensing · Cited by 1,872
Deep Recurrent Neural Networks for Hyperspectral Image Classification
Mou, L., Ghamisi, P., & Zhu, X. X. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2636241 · Cited by 1,383
Spectral–Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network
Li, Y., Zhang, H., & Shen, Q. (2017) · Remote Sensing · doi:10.3390/rs9010067 · Cited by 1,320
Advances in Spectral-Spatial Classification of Hyperspectral Images
Fauvel, M., Tarabalka, Y., Benediktsson, J. A., Chanussot, J., & Tilton, J. C. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2197589 · Cited by 1,282
Investigation of the random forest framework for classification of hyperspectral data
Ham, J., Chen, Y., Crawford, M. M., & Ghosh, J. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.842481 · Cited by 1,276
Spectral-spatial classification of hyperspectral data based on deep belief network
Chen, Y., Zhao, X., & Jia, X. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2388577 · Cited by 1,259 · cited 1×
“K 3 = This descriptor is then processed by a deep classifier, often unsupervised, such as deep belief networks in [55] and [56], restricted Boltzmann machines in [57] and [58], or cascades of autoencoders in [59]–[62].”
Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm
Yuhas, R. H., Goetz, A. F. H., & Boardman, J. W. (1992) · NASA Technical Reports Server (NASA) · Cited by 1,259
Zhao, W., & Du, S. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2543748 · Cited by 1,212
Composite Kernels for Hyperspectral Image Classification
Camps-Valls, G., Gomez-Chova, L., Munoz-Mari, J., Vila-Frances, J., & Calpe-Maravilla, J. (2006) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2005.857031 · Cited by 1,068
Deep supervised learning for hyperspectral data classification through convolutional neural networks
Makantasis, K., Karantzalos, K., Doulamis, A., & Doulamis, N. (2015) · 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326945 · Cited by 1,011
Going Deeper With Contextual CNN for Hyperspectral Image Classification
Lee, H., & Kwon, H. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2725580 · Cited by 983
Ghamisi, P., Yokoya, N., Li, J., Liao, W., Liu, S., Plaza, J., Rasti, B., & Plaza, A. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762087 · Cited by 909
3-D Deep Learning Approach for Remote Sensing Image Classification
Ben Hamida, A., Benoit, A., Lambert, P., & Ben Amar, C. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2818945 · Cited by 875
Generative Adversarial Networks for Hyperspectral Image Classification
Zhu, L., Chen, Y., Ghamisi, P., & Benediktsson, J. A. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2805286 · Cited by 734
Unsupervised Deep Feature Extraction for Remote Sensing Image Classification
Romero, A., Gatta, C., & Camps-Valls, G. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2478379 · Cited by 729
Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques
Tarabalka, Y., Benediktsson, J. A., & Chanussot, J. (2009) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2016214 · Cited by 678
Segmentation and classification of hyperspectral images using watershed transformation
Tarabalka, Y., Chanussot, J., & Benediktsson, J. A. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2010.01.016 · Cited by 561
Spectral–spatial classification of hyperspectral images using deep convolutional neural networks
Yue, J., Zhao, W., Mao, S., & Liu, H. (2015) · Remote Sensing Letters · doi:10.1080/2150704x.2015.1047045 · Cited by 525
Spatial/spectral endmember extraction by multidimensional morphological operations
Plaza, A., Martinez, P., Perez, R., & Plaza, J. (2002) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2002.802494 · Cited by 517
Principal Component Analysis for Hyperspectral Image Classification
Rodarmel, C., & Shan, J. (2002) · Cited by 478
Semi-Supervised Deep Learning Using Pseudo Labels for Hyperspectral Image Classification
Wu, H., & Prasad, S. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2772836 · Cited by 463
Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks
Volpi, M., & Tuia, D. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2616585 · Cited by 436
Atmospheric correction algorithms for hyperspectral remote sensing data of land and ocean
Gao, B.-C., Montes, M. J., Davis, C. O., & Goetz, A. F. H. (2009) · Remote Sensing of Environment · doi:10.1016/j.rse.2007.12.015 · Cited by 430
Multi-scale 3D deep convolutional neural network for hyperspectral image classification
He, M., Li, B., & Chen, H. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8297014 · Cited by 429
Support vector machines for hyperspectral remote sensing classification:
Gualtieri, J. A., & Cromp, R. F. (1999) · SPIE Proceedings · doi:10.1117/12.339824 · Cited by 422
Tao, C., Pan, H., Li, Y., & Zou, Z. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2482520 · Cited by 397
Band Selection for Hyperspectral Image Classification Using Mutual Information
Guo, B., Gunn, S. R., Damper, R. I., & Nelson, J. D. B. (2006) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2006.878240 · Cited by 386
Extended profiles with morphological attribute filters for the analysis of hyperspectral data
Dalla Mura, M., Atli Benediktsson, J., Waske, B., & Bruzzone, L. (2010) · International Journal of Remote Sensing · doi:10.1080/01431161.2010.512425 · Cited by 373
Semantic Segmentation of Earth Observation Data Using Multimodal and Multi-scale Deep Networks
Audebert, N., Le Saux, B., & Lefèvre, S. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54181-5_12 · Cited by 367
Self-citationSemisupervised Neural Networks for Efficient Hyperspectral Image Classification
Ratle, F., Camps-Valls, G., & Weston, J. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2037898 · Cited by 316
Mou, L., Ghamisi, P., & Zhu, X. X. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2748160 · Cited by 294
On the Impact of PCA Dimension Reduction for Hyperspectral Detection of Difficult Targets
Farrell, M. D., & Mersereau, R. M. (2005) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2005.846011 · Cited by 282
A spatial–spectral kernel-based approach for the classification of remote-sensing images
Fauvel, M., Chanussot, J., & Benediktsson, J. A. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.03.035 · Cited by 281
SEMANTIC SEGMENTATION OF AERIAL IMAGES WITH AN ENSEMBLE OF CNNS
Marmanis, D., Wegner, J. D., Galliani, S., Schindler, K., Datcu, M., & Stilla, U. (2016) · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprs-annals-iii-3-473-2016 · Cited by 268
Convolutional Recurrent Neural Networks forHyperspectral Data Classification
Wu, H., & Prasad, S. (2017) · Remote Sensing · doi:10.3390/rs9030298 · Cited by 268
Exploiting Spectral and Spatial Information in Hyperspectral Urban Data With High Resolution
Dell'Acqua, F., Gamba, P., Ferrari, A., Palmason, J. A., Benediktsson, J. A., & Arnason, K. (2004) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2004.837009 · Cited by 267
Spectral–Spatial Classification of Hyperspectral Image Based on Deep Auto-Encoder
Ma, X., Wang, H., & Geng, J. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2517204 · Cited by 258
Deschamps, P. Y., & Phulpin, T. (1980) · Boundary-Layer Meteorology · doi:10.1007/bf00121320 · Cited by 246
EndNet: Sparse AutoEncoder Network for Endmember Extraction and Hyperspectral Unmixing
Ozkan, S., Kaya, B., & Akar, G. B. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2856929 · Cited by 244
Goel, P. K., Prasher, S. O., Patel, R. M., Landry, J. A., Bonnell, R. B., & Viau, A. A. (2003) · Computers and Electronics in Agriculture · doi:10.1016/s0168-1699(03)00020-6 · Cited by 229
Stacked Denoise Autoencoder Based Feature Extraction and Classification for Hyperspectral Images
Xing, C., Ma, L., & Yang, X. (2016) · Journal of Sensors · doi:10.1155/2016/3632943 · Cited by 226
Classification of hyperspectral image based on deep belief networks
Li, T., Zhang, J., & Zhang, Y. (2014) · 2014 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2014.7026039 · Cited by 207
A semi-supervised convolutional neural network for hyperspectral image classification
Liu, B., Yu, X., Zhang, P., Tan, X., Yu, A., & Xue, Z. (2017) · Remote Sensing Letters · doi:10.1080/2150704x.2017.1331053 · Cited by 207
Zhao, W., Guo, Z., Yue, J., Zhang, X., & Luo, L. (2015) · International Journal of Remote Sensing · doi:10.1080/2150704x.2015.1062157 · Cited by 194
He, Z., Liu, H., Wang, Y., & Hu, J. (2017) · Remote Sensing · doi:10.3390/rs9101042 · Cited by 174
HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image
Luo, Y., Zou, J., Yao, C., Zhao, X., Li, T., & Bai, G. (2018) · 2018 International Conference on Audio, Language and Image Processing (ICALIP) · doi:10.1109/icalip.2018.8455251 · Cited by 169
Spectral-spatial classification of hyperspectral image using autoencoders
Lin, Z., Chen, Y., Zhao, X., & Wang, G. (2013) · International Conference on Information, Communications & Signal Processing (ICICS) · doi:10.1109/icics.2013.6782778 · Cited by 156
Wang, L., Zhang, J., Liu, P., Choo, K. R., & Huang, F. (2016) · Soft Computing · doi:10.1007/s00500-016-2246-3 · Cited by 155
Hyperspectral image unmixing using autoencoder cascade
Guo, R., Wang, W., & Qi, H. (2015) · Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing · doi:10.1109/whispers.2015.8075378 · Cited by 148
Parra, L. C., Spence, C. D., Sajda, P., Ziehe, A., & Müller, K. (1999) · Cited by 145
2018 IEEE GRSS Data Fusion Contest: Multimodal Land Use Classification [Technical Committees]
Saux, B. L., Yokoya, N., Hänsch, R., & Prasad, S. (2018) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2018.2798161 · Cited by 138
Hyperspectral Image Classification with Convolutional Neural Networks
Slavkovikj, V., Verstockt, S., Neve, W. D., Hoecke, S. V., & Rik Van De Walle, B. (2015) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2733373.2806306 · Cited by 126
Tuia, D., Flamary, R., & Courty, N. (2015) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.01.006 · Cited by 102
Support Vector Machines for Hyperspectral Remote Sensing Classification
Gualtieri, J. A., & Cromp, R. F. (1998) · Cited by 100
Damodaran, B. B., Courty, N., & Lefèvre, S. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2642479 · Cited by 82
Low-Shot Learning for the Semantic Segmentation of Remote Sensing Imagery
Kemker, R., Luu, R., & Kanan, C. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2833808 · Cited by 70
Generative Adversarial Networks for Realistic Synthesis of Hyperspectral Samples
Audebert, N., Saux, B. L., & Lefèvre, S. (2018) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2018.8518321 · Cited by 61
Self-citationDeep Model for Classification of Hyperspectral image using Restricted Boltzmann Machine
Midhun, M. E., Nair, S. R., Prabhakar, V. T. N., & Kumar, S. S. (2014) · International Conference on Interdisciplinary Advances in Applied Computing (ICONIAAC) · doi:10.1145/2660859.2660946 · Cited by 51
A Physics-Based Unmixing Method to Estimate Subpixel Temperatures on Mixed Pixels
Cubero-Castan, M., Chanussot, J., Achard, V., Briottet, X., & Shimoni, M. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2350771 · Cited by 42
PerTurbo Manifold Learning Algorithm for Weakly Labeled Hyperspectral Image Classification
Chapel, L., Bürger, T., Courty, N., & Lefèvre, S. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2304304 · Cited by 16
Semi-supervised classification of hyperspectral imagery based on stacked autoencoders
Fu, Q., Yu, X., Wei, X., & Xue, Z. (2016) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2245011 · Cited by 14
Cited by
Deep learning classifiers for hyperspectral imaging: A review
Paoletti, M. E., Haut, J. M., Plaza, J., & Plaza, A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.09.006 · Cited by 1,073
Perspectives in machine learning for wildlife conservation
Tuia, D., Kellenberger, B., Beery, S., Costelloe, B. R., Zuffi, S., Risse, B., Mathis, A., Mathis, M. W., van Langevelde, F., Burghardt, T., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-27980-y · Cited by 740
Artificial Intelligence for Remote Sensing Data Analysis: A review of challenges and opportunities
Zhang, L., & Zhang, L. (2022) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2022.3145854 · Cited by 604
Attention-Based Adaptive Spectral–Spatial Kernel ResNet for Hyperspectral Image Classification
Roy, S. K., Manna, S., Song, T., & Bruzzone, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3043267 · Cited by 519
Residual Spectral–Spatial Attention Network for Hyperspectral Image Classification
Zhu, M., Jiao, L., Liu, F., Yang, S., & Wang, J. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2994057 · Cited by 498
Metadata
- Authors
- Audebert, N., Le Saux, B., & Lefevre, S.
- Venue
- IEEE Geoscience and Remote Sensing Magazine
- Published
- 2019-06
- Volume
- 7
- Issue
- 2
- Pages
- 159-173
- ISSN
- 2168-6831 (ISSN-L)
- 2473-2397
- 2373-7468
- OpenAlex
- W2962770389
- Cited by
- 686
- References
- 75
- FWCI
- 44.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.