The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
HSI-BERT: Hyperspectral Image Classification Using the Bidirectional Encoder Representation From Transformers
Abstract
Deep learning methods have been widely used in hyperspectral image classification and have achieved state-of-the-art performance. Nonetheless, the existing deep learning methods are restricted by a limited receptive field, inflexibility, and difficult generalization problems in hyperspectral image classification. To solve these problems, we propose HSI-BERT, where BERT stands for bidirectional encoder representations from transformers and HSI stands for hyperspectral imagery. The proposed HSI-BERT has a global receptive field that captures the global dependence among pixels regardless of their spatial distance. HSI-BERT is very flexible and enables the flexible and dynamic input regions. Furthermore, HSI-BERT has good generalization ability because the jointly trained HSI-BERT can be generalized from regions with different shapes without retraining. HSI-BERT is primarily built on a multihead self-attention (MHSA) mechanism in an MHSA layer. Moreover, several attentions are learned by different heads, and each head of the MHSA layer encodes the semantic context-aware representation to obtain discriminative features. Because all head-encoded features are merged, the resulting features exhibit spatial-spectral information that is essential for accurate pixel-level classification. Quantitative and qualitative results demonstrate that HSI-BERT outperforms any other CNN-based model in terms of both classification accuracy and computational time and achieves state-of-the-art performance on three widely used hyperspectral image data sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 1×
“First, from the spectral aspect, a pixel (spectral vector) in HSI is analogous to a word vector [33] in natural language processing (NLP) because both are distributional representations and both convey some “meaning.”
BackgroundClassification of hyperspectral remote sensing images with support vector machines
Melgani, F., & Bruzzone, L. (2004) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.831865 · Cited by 4,411
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Zhong, Z., Li, J., Luo, Z., & Chapman, M. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2755542 · Cited by 1,959
Deep Convolutional Neural Networks for Hyperspectral Image Classification
Hu, W., Huang, Y., Wei, L., Zhang, F., & Li, H. (2015) · Journal of Sensors · doi:10.1155/2015/258619 · Cited by 1,941
Conditional Image Generation with PixelCNN Decoders
van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05328 · Cited by 1,833
Pixel Recurrent Neural Networks
van den Oord, A., Kalchbrenner, N., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.06759 · Cited by 1,437
Deep Recurrent Neural Networks for Hyperspectral Image Classification
Mou, L., Ghamisi, P., & Zhu, X. X. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2636241 · Cited by 1,383
Advances in Spectral-Spatial Classification of Hyperspectral Images
Fauvel, M., Tarabalka, Y., Benediktsson, J. A., Chanussot, J., & Tilton, J. C. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2197589 · Cited by 1,282
Parmar, N., Vaswani, A., Uszkoreit, J., Kaiser, Ł., Shazeer, N., Ku, A., & Tran, D. (2018) · arXiv · doi:10.48550/arxiv.1802.05751 · Cited by 1,085 · cited 2×
“The self-attentive feedforward sequence model was first introduced in 2017 and achieved state-of-the-art performance in machine translation [38], [39], and it was recently shown to achieve excellent results in other fields, such as image generation [35], question answering [34], [39], and language understanding [34].”
BackgroundMethodDeep supervised learning for hyperspectral data classification through convolutional neural networks
Makantasis, K., Karantzalos, K., Doulamis, A., & Doulamis, N. (2015) · 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326945 · Cited by 1,011
Going Deeper With Contextual CNN for Hyperspectral Image Classification
Lee, H., & Kwon, H. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2725580 · Cited by 983
Modern Trends in Hyperspectral Image Analysis: A Review
Khan, M. J., Khan, H. S., Yousaf, A., Khurshid, K., & Abbas, A. (2018) · IEEE Access · doi:10.1109/access.2018.2812999 · Cited by 865
Hyperspectral Image Classification Using Deep Pixel-Pair Features
Li, W., Wu, G., Zhang, F., & Du, Q. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2616355 · Cited by 805
Self-citationSVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images
Tarabalka, Y., Fauvel, M., Chanussot, J., & Benediktsson, J. A. (2010) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2010.2047711 · Cited by 749
Li, J., Bioucas-Dias, J. M., & Plaza, A. (2012) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2162649 · Cited by 731
Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering
Kang, X., Li, S., & Benediktsson, J. A. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2264508 · Cited by 704 · cited 1×
“In 2014, an edge-preserving filtering-based spectral-spatial classification framework is proposed, which improves the classification accuracy of SVM significantly with much fewer computer resources [19].”
MethodMultisource Remote Sensing Data Classification Based on Convolutional Neural Network
Xu, X., Li, W., Ran, Q., Du, Q., Gao, L., & Zhang, B. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2756851 · Cited by 689
Self-citationHe, L., Li, J., Liu, C., & Li, S. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2765364 · Cited by 630
Diverse Region-Based CNN for Hyperspectral Image Classification
Zhang, M., Li, W., & Du, Q. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2809606 · Cited by 604
Self-citationSpectral–spatial classification of hyperspectral images using deep convolutional neural networks
Yue, J., Zhao, W., Mao, S., & Liu, H. (2015) · Remote Sensing Letters · doi:10.1080/2150704x.2015.1047045 · Cited by 525
Generalized Composite Kernel Framework for Hyperspectral Image Classification
Li, J., Marpu, P. R., Plaza, A., Bioucas-Dias, J. M., & Benediktsson, J. A. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2230268 · Cited by 484
Dehghani, M., Gouws, S., Vinyals, O., Uszkoreit, J., & Kaiser, Ł. (2018) · arXiv · doi:10.48550/arxiv.1807.03819 · Cited by 467
Capsule Networks for Hyperspectral Image Classification
Paoletti, M. E., Haut, J. M., Fernandez-Beltran, R., Plaza, J., Plaza, A., Li, J., & Pla, F. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2871782 · Cited by 347
Waske, B., van der Linden, S., Benediktsson, J. A., Rabe, A., & Hostert, P. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2041784 · Cited by 320
Spectral-Spatial Unified Networks for Hyperspectral Image Classification
Xu, Y., Zhang, L., Du, B., & Zhang, F. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2827407 · Cited by 316
Mei, S., Ji, J., Hou, J., Li, X., & Du, Q. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2693346 · Cited by 311
Nearest Neighbor Classification of Remote Sensing Images With the Maximal Margin Principle
Blanzieri, E., & Melgani, F. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2008.916090 · Cited by 288
Nearest Regularized Subspace for Hyperspectral Classification
Li, W., Tramel, E. W., Prasad, S., & Fowler, J. E. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2241773 · Cited by 227
Self-citationSpatial-Spectral Kernel Sparse Representation for Hyperspectral Image Classification
Liu, J., Wu, Z., Wei, Z., Xiao, L., & Sun, L. (2013) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2013.2252150 · Cited by 183
Zhang, X., Sun, Y., Shang, K., Zhang, L., & Wang, S. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2577339 · Cited by 181
A Deep Scene Representation for Aerial Scene Classification
Zheng, X., Yuan, Y., & Lu, X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2893115 · Cited by 136
Ghiyamat, A., & Shafri, H. Z. M. (2010) · International Journal of Remote Sensing · doi:10.1080/01431160902926681 · Cited by 129
Hyperspectral Image Classification with Convolutional Neural Networks
Slavkovikj, V., Verstockt, S., Neve, W. D., Hoecke, S. V., & Rik Van De Walle, B. (2015) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2733373.2806306 · Cited by 126
Li, W., & Du, Q. (2015) · Pattern Recognition Letters · doi:10.1016/j.patrec.2015.09.010 · Cited by 125
Self-citationNeural Network Methods for Natural Language Processing
Liu, Y., & Zhang, M. (2017) · Computational Linguistics · doi:10.1162/coli_r_00312 · Cited by 47
Self-citation
Cited by
Remote Sensing Image Change Detection With Transformers
Chen, H., Qi, Z., & Shi, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3095166 · Cited by 1,189
Vision Transformers for Remote Sensing Image Classification
Bazi, Y., Bashmal, L., Rahhal, M. M. A., Dayil, R. A., & Ajlan, N. A. (2021) · Remote Sensing · doi:10.3390/rs13030516 · Cited by 637
Artificial Intelligence for Remote Sensing Data Analysis: A review of challenges and opportunities
Zhang, L., & Zhang, L. (2022) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2022.3145854 · Cited by 604
Transformers in Remote Sensing: A Survey
Aleissaee, A. A., Kumar, A., Anwer, R. M., Khan, S., Cholakkal, H., Xia, G.-S., & Khan, F. S. (2023) · Remote Sensing · doi:10.3390/rs15071860 · Cited by 417
Spectral–Spatial Morphological Attention Transformer for Hyperspectral Image Classification
Roy, S. K., Deria, A., Shah, C., Haut, J. M., Du, Q., & Plaza, A. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3242346 · Cited by 371
Metadata
- Authors
- He, J., Zhao, L., Yang, H., Zhang, M., & Li, W.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2020-01
- Volume
- 58
- Issue
- 1
- Pages
- 165-178
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W2971432438
- Cited by
- 383
- References
- 44
- FWCI
- 16.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.