The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Few-Shot Hyperspectral Image Classification With Unknown Classes Using Multitask Deep Learning
Open accessAbstract
Current hyperspectral image classification assumes that a predefined classification system is closed and complete, and there are no unknown or novel classes in the unseen data. However, this assumption may be too strict for the real world. Often, novel classes are overlooked when the classification system is constructed. The closed nature forces a model to assign a label given a new sample and may lead to overestimation of known land covers (e.g., crop area). To tackle this issue, we propose a multitask deep learning method that simultaneously conducts classification and reconstruction in the open world (named MDL4OW) where unknown classes may exist. The reconstructed data are compared with the original data; those failing to be reconstructed are considered unknown based on the assumption that they are not well represented in the latent features due to the lack of labels. A threshold needs to be defined to separate the unknown and known classes; we propose two strategies based on the extreme value theory for few- and many-shot scenarios. The proposed method was tested on real-world hyperspectral images; state-of-the-art results were achieved, e.g., improving the overall accuracy by 4.94% for the Salinas data. By considering the existence of unknown classes in the open world, our method achieved more accurate hyperspectral image classification, especially under the few-shot context.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
ADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Statistical Inference Using Extreme Order Statistics
III, J. P. (1975) · The Annals of Statistics · doi:10.1214/aos/1176343003 · Cited by 3,567
Hyperspectral remote sensing data analysis and future challenges
Bioucas-Dias, J. M., Plaza, A., Camps-Valls, G., Scheunders, P., Nasrabadi, N., & Chanussot, J. (2013) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2013.2244672 · Cited by 2,223
Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art
Zhang, L., Zhang, L., & Du, B. (2016) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2540798 · Cited by 2,208
Self-citationZhong, Z., Li, J., Luo, Z., & Chapman, M. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2755542 · Cited by 1,959
Deep Convolutional Neural Networks for Hyperspectral Image Classification
Hu, W., Huang, Y., Wei, L., Zhang, F., & Li, H. (2015) · Journal of Sensors · doi:10.1155/2015/258619 · Cited by 1,941
Towards Open Set Deep Networks
Bendale, A., & Boult, T. E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.173 · Cited by 1,799
Precision Agriculture and Food Security
Gebbers, R., & Adamchuk, V. I. (2010) · Science · doi:10.1126/science.1183899 · Cited by 1,595
Scheirer, W. J., de Rezende Rocha, A., Sapkota, A., & Boult, T. E. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.256 · Cited by 1,573
Classification of hyperspectral data from urban areas based on extended morphological profiles
Benediktsson, J. A., Palmason, J. A., & Sveinsson, J. R. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.842478 · Cited by 1,393
Deep Recurrent Neural Networks for Hyperspectral Image Classification
Mou, L., Ghamisi, P., & Zhu, X. X. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2636241 · Cited by 1,383
Advances in Spectral-Spatial Classification of Hyperspectral Images
Fauvel, M., Tarabalka, Y., Benediktsson, J. A., Chanussot, J., & Tilton, J. C. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2197589 · Cited by 1,282
Large-Scale Long-Tailed Recognition in an Open World
Liu, Z., Miao, Z., Zhan, X., Wang, J., Gong, B., & Yu, S. X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00264 · Cited by 1,126
RIDD, M. K. (1995) · International Journal of Remote Sensing · doi:10.1080/01431169508954549 · Cited by 1,025
Deep supervised learning for hyperspectral data classification through convolutional neural networks
Makantasis, K., Karantzalos, K., Doulamis, A., & Doulamis, N. (2015) · 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326945 · Cited by 1,011
Recent Advances in Open Set Recognition: A Survey
Geng, C., Huang, S.-J., & Chen, S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2981604 · Cited by 1,006
Going Deeper With Contextual CNN for Hyperspectral Image Classification
Lee, H., & Kwon, H. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2725580 · Cited by 983
Hyperspectral Image Classification Using Deep Pixel-Pair Features
Li, W., Wu, G., Zhang, F., & Du, Q. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2616355 · Cited by 805
Li, J., Bioucas-Dias, J. M., & Plaza, A. (2012) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2162649 · Cited by 731
Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering
Kang, X., Li, S., & Benediktsson, J. A. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2264508 · Cited by 704 · cited 1×
“spatial filters, including edge-preserving filters and Gabor filters [15], [16], spectral–spatial classification of hyperspectral data became a popular topic and influenced the last ten years [7].”
BackgroundDeep Learning for Classification of Hyperspectral Data: A Comparative Review
Audebert, N., Le Saux, B., & Lefevre, S. (2019) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2019.2912563 · Cited by 686
Advanced Spectral Classifiers for Hyperspectral Images: A review
Ghamisi, P., Plaza, J., Chen, Y., Li, J., & Plaza, A. J. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2616418 · Cited by 675
A new deep convolutional neural network for fast hyperspectral image classification
Paoletti, M. E., Haut, J. M., Plaza, J., & Plaza, A. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.11.021 · Cited by 607
Kampffmeyer, M., Salberg, A.-B., & Jenssen, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.90 · Cited by 605
Multiscale Dynamic Graph Convolutional Network for Hyperspectral Image Classification
Wan, S., Gong, C., Zhong, P., Du, B., Zhang, L., & Yang, J. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2949180 · Cited by 553
Self-citationCascaded Recurrent Neural Networks for Hyperspectral Image Classification
Hang, R., Liu, Q., Hong, D., & Ghamisi, P. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2899129 · Cited by 534
Towards Open World Recognition
Bendale, A., & Boult, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298799 · Cited by 529
Salient Band Selection for Hyperspectral Image Classification via Manifold Ranking
Wang, Q., Lin, J., & Yuan, Y. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2477537 · Cited by 483
Open Set Learning with Counterfactual Images
Neal, L., Olson, M., Fern, X., Wong, W.-K., & Li, F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_38 · Cited by 480
Classification-Reconstruction Learning for Open-Set Recognition
Yoshihashi, R., Shao, W., Kawakami, R., You, S., Iida, M., & Naemura, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00414 · Cited by 472
Shallow and Deep Convolutional Networks for Saliency Prediction
Pan, J., Sayrol, E., Giro-I-Nieto, X., McGuinness, K., & OConnor, N. E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.71 · Cited by 471
Deep Few-Shot Learning for Hyperspectral Image Classification
Liu, B., Yu, X., Yu, A., Zhang, P., Wan, G., & Wang, R. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2872830 · Cited by 454
Support vector machines for hyperspectral remote sensing classification:
Gualtieri, J. A., & Cromp, R. F. (1999) · SPIE Proceedings · doi:10.1117/12.339824 · Cited by 422
C2AE: Class Conditioned Auto-Encoder for Open-Set Recognition
Oza, P., & Patel, V. M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00241 · Cited by 399
Phinn, S., Stanford, M., Scarth, P. F., et al. (2002) · International Journal of Remote Sensing · doi:10.1080/01431160110114998 · Cited by 316
Mei, S., Ji, J., Hou, J., Li, X., & Du, Q. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2693346 · Cited by 311
An Active Learning Approach to Hyperspectral Data Classification
Rajan, S., Ghosh, J., & Crawford, M. M. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.910220 · Cited by 290
Remote Sensing Scene Classification by Unsupervised Representation Learning
Lu, X., Zheng, X., & Yuan, Y. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2702596 · Cited by 288
A Nonlocal Weighted Joint Sparse Representation Classification Method for Hyperspectral Imagery
Zhang, H., Li, J., Huang, Y., & Zhang, L. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2013.2264720 · Cited by 284
Self-citationComputing Maximum Likelihood Estimates for the Generalized Pareto Distribution
Grimshaw, S. D. (1993) · Technometrics · doi:10.1080/00401706.1993.10485040 · Cited by 274
MugNet: Deep learning for hyperspectral image classification using limited samples
Pan, B., Shi, Z., & Xu, X. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.11.003 · Cited by 253
Luo, F., Zhang, L., Du, B., & Zhang, L. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2963848 · Cited by 234
Self-citationThree-Dimensional Gabor Wavelets for Pixel-Based Hyperspectral Imagery Classification
Shen, L., & Jia, S. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2157166 · Cited by 219
Locality and Structure Regularized Low Rank Representation for Hyperspectral Image Classification
Wang, Q., He, X., & Li, X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2862899 · Cited by 202
Using active learning to adapt remote sensing image classifiers
Tuia, D., Pasolli, E., & Emery, W. J. (2011) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.04.022 · Cited by 200
Hyperspectral Image Classification Using Relevance Vector Machines
Demir, B., & Erturk, S. (2007) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2007.903069 · Cited by 185
Deep Relation Network for Hyperspectral Image Few-Shot Classification
Gao, K., Liu, B., Yu, X., Qin, J., Zhang, P., & Tan, X. (2020) · Remote Sensing · doi:10.3390/rs12060923 · Cited by 183
Spectral–Spatial Classification of Hyperspectral Images Based on Hidden Markov Random Fields
Ghamisi, P., Benediktsson, J. A., & Ulfarsson, M. O. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2263282 · Cited by 176
Liu, S. K., & Shi, Q. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.04.008 · Cited by 159
Self-citationA Novel Semisupervised Active-Learning Algorithm for Hyperspectral Image Classification
Wang, Z., Du, B., Zhang, L., Zhang, L., & Jia, X. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2650938 · Cited by 131
Self-citationA Hybrid Sparsity and Distance-Based Discrimination Detector for Hyperspectral Images
Lu, X., Zhang, W., & Li, X. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2767068 · Cited by 108
A Subspace-Based Multinomial Logistic Regression for Hyperspectral Image Classification
Khodadadzadeh, M., Li, J., Plaza, A., & Bioucas‐Dias, J. M. (2014) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2014.2320258 · Cited by 91
Golipour, M., Ghassemian, H., & Mirzapour, F. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2466657 · Cited by 90
Yuan, F., Bauer, M. E., Heinert, N. J., & Holden, G. R. (2005) · Geocarto International · doi:10.1080/10106040508542340 · Cited by 84
Spatial Coherence-Based Batch-Mode Active Learning for Remote Sensing Image Classification
Shi, Q., Du, B., & Zhang, L. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2405335 · Cited by 71
Self-citationShi, Q., Du, B., & Zhang, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2427791 · Cited by 63
Self-citationCollective Decision for Open Set Recognition
Geng, C., & Chen, S. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2978199 · Cited by 59
Rao, M. J., Tang, P. T. P., & Zhang, Z. (2019) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2019.2957047 · Cited by 59
Yu, C., Wang, Y., Song, M., & Chang, C. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2850152 · Cited by 57
Multitask Deep Learning With Spectral Knowledge for Hyperspectral Image Classification
Liu, S. K., & Shi, Q. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2962768 · Cited by 46
Self-citationZhou, Y., Luo, J., Feng, L., & Zhou, X. (2019) · Remote Sensing · doi:10.3390/rs11131619 · Cited by 42
Wide Contextual Residual Network with Active Learning for Remote Sensing Image Classification
Liu, S. K., Luo, H., Tu, Y., et al. (2018) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2018.8517855 · Cited by 20
Self-citationAbundance-Indicated Subspace for Hyperspectral Classification With Limited Training Samples
Xu, S., Li, J., Khodadadzadeh, M., Marinoni, A., Gamba, P. E., & Li, B. H. (2019) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2019.2903940 · Cited by 18
Kernel Low-Rank Representation Based on Local Similarity for Hyperspectral Image Classification
Liu, Q., Wu, Z., Sun, L., Xu, Y., Du, L., & Wei, Z. (2019) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2019.2915842 · Cited by 14
Cited by
Dong, Y., Liu, Q., Du, B., & Zhang, L. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3144017 · Cited by 578
Self-citationMSMatch: Semisupervised Multispectral Scene Classification With Few Labels
Gomez, P., & Meoni, G. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3126082 · Cited by 55
Metadata
- Authors
- Liu, S., Shi, Q., & Zhang, L.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2021-06
- Volume
- 59
- Issue
- 6
- Pages
- 5085-5102
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W3083068801
- Cited by
- 268
- References
- 66
- FWCI
- 18.79
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.