Convolutional Neural Networks for Multimodal Remote Sensing Data Classification
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
In recent years, enormous research has been made to improve the classification performance of single-modal remote sensing (RS) data. However, with the ever-growing availability of RS data acquired from satellite or airborne platforms, simultaneous processing and analysis of multimodal RS data pose a new challenge to researchers in the RS community. To this end, we propose a deep-learning-based new framework for multimodal RS data classification, where convolutional neural networks (CNNs) are taken as a backbone with an advanced cross-channel reconstruction module, called CCR-Net. As the name suggests, CCR-Net learns more compact fusion representations of different RS data sources by the means of the reconstruction strategy across modalities that can mutually exchange information in a more effective way. Extensive experiments conducted on two multimodal RS datasets, including hyperspectral (HS) and light detection and ranging (LiDAR) data, i.e., the Houston2013 dataset, and HS and synthetic aperture radar (SAR) data, i.e., the Berlin dataset, demonstrate the effectiveness and superiority of the proposed CCR-Net in comparison with several state-of-the-art multimodal RS data classification methods. The codes will be openly and freely available athttps://github.com/danfenghong/IEEE_TGRS_CCR-Netfor the sake of reproducibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition to CNN-based architectures, Transformer-based models have demonstrated strong capability in modeling long-range dependencies across spectral bands and temporal dimensions in SDB, thereby improving depth retrieval performance [72].”
From A Review on Bathymetric Inversion Research Based on Deep Learning Models and Remote Sensing Images (2026) · cites this paper as [72]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
GLC2000: a new approach to global land cover mapping from Earth observation data
Bartholomé, E., & Belward, A. S. (2005) · International Journal of Remote Sensing · doi:10.1080/01431160412331291297 · Cited by 1,798
Graph Convolutional Networks for Hyperspectral Image Classification
Hong, D., Gao, L., Yao, J., Zhang, B., Plaza, A., & Chanussot, J. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3015157 · Cited by 1,691
Self-citationRemote sensing for biodiversity science and conservation
Turner, W., Spector, S., Gardiner, N., Fladeland, M., Sterling, E., & Steininger, M. (2003) · Trends in Ecology & Evolution · doi:10.1016/s0169-5347(03)00070-3 · Cited by 1,404
SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers
Hong, D., Han, Z., Yao, J., Gao, L., Zhang, B., Plaza, A., & Chanussot, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3130716 · Cited by 1,382
Self-citationMore Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification
Hong, D., Gao, L., Yokoya, N., Yao, J., Chanussot, J., Du, Q., & Zhang, B. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3016820 · Cited by 1,374
Self-citationCheng, G., Yang, C., Yao, X., Guo, L., & Han, J. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2783902 · Cited by 1,226
An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing
Hong, D., Yokoya, N., Chanussot, J., & Zhu, X. X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2878958 · Cited by 948
Self-citationSplit-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction
Zhang, R., Isola, P., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.76 · Cited by 616
Rasti, B., Hong, D., Hang, R., Ghamisi, P., Kang, X., Chanussot, J., & Benediktsson, J. A. (2020) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2020.2979764 · Cited by 537
Self-citationCascaded Recurrent Neural Networks for Hyperspectral Image Classification
Hang, R., Liu, Q., Hong, D., & Ghamisi, P. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2899129 · Cited by 534
Self-citationClassification of Hyperspectral and LiDAR Data Using Coupled CNNs
Hang, R., Li, Z., Ghamisi, P., Hong, D., Xia, G., & Liu, Q. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2969024 · Cited by 466
Self-citationSatellite Image Analysis for Disaster and Crisis-Management Support
Voigt, S., Kemper, T., Riedlinger, T., Kiefl, R., Scholte, K., & Mehl, H. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.895830 · Cited by 387
Camps-Valls, G., Gomez-Chova, L., Munoz-Mari, J., Rojo-Alvarez, J. L., & Martinez-Ramon, M. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2008.916201 · Cited by 372
Hong, D., Hu, J., Yao, J., Chanussot, J., & Zhu, X. X. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.05.011 · Cited by 326
Self-citationHong, D., Wu, X., Ghamisi, P., Chanussot, J., Yokoya, N., & Zhu, X. X. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2957251 · Cited by 310
Self-citationChallenges and Opportunities of Multimodality and Data Fusion in Remote Sensing
Dalla Mura, M., Prasad, S., Pacifici, F., Gamba, P., Chanussot, J., & Benediktsson, J. A. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2462751 · Cited by 286
Self-citationDeep Encoder–Decoder Networks for Classification of Hyperspectral and LiDAR Data
Hong, D., Gao, L., Hang, R., Zhang, B., & Chanussot, J. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.3017414 · Cited by 276
Self-citationHong, D., He, W., Yokoya, N., Yao, J., Gao, L., Zhang, L., Chanussot, J., & Zhu, X. (2021) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2021.3064051 · Cited by 275
Self-citationX-ModalNet: A semi-supervised deep cross-modal network for classification of remote sensing data
Hong, D., Yokoya, N., Xia, G.-S., Chanussot, J., & Zhu, X. X. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.06.014 · Cited by 257
Self-citationHong, D., Yokoya, N., Ge, N., Chanussot, J., & Zhu, X. X. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.10.006 · Cited by 256
Self-citationCoSpace: Common Subspace Learning From Hyperspectral-Multispectral Correspondences
Hong, D., Yokoya, N., Chanussot, J., & Zhu, X. X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2890705 · Cited by 221
Self-citationWu, X., Hong, D., Tian, J., Chanussot, J., Li, W., & Tao, R. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2897139 · Cited by 212
Self-citationAdaptive Markov Random Field Approach for Classification of Hyperspectral Imagery
Zhang, B., Li, S., Jia, X., Gao, L., & Peng, M. (2011) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2011.2145353 · Cited by 194
Yao, X., Feng, X., Han, J., Cheng, G., & Guo, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2991407 · Cited by 169
Wu, X., Hong, D., Chanussot, J., Xu, Y., Tao, R., & Wang, Y. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2919755 · Cited by 137
Self-citationZhang, B., Sun, X., Gao, L., & Yang, L. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2108305 · Cited by 131
Multimodal GANs: Toward Crossmodal Hyperspectral–Multispectral Image Segmentation
Hong, D., Yao, J. T., Meng, D., Xu, Z., & Chanussot, J. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3020823 · Cited by 131
Self-citationQian, X., Lin, S., Cheng, G., Yao, X., Ren, H., & Wang, W. (2020) · Remote Sensing · doi:10.3390/rs12010143 · Cited by 129
Süel, E., Bhatt, S., Brauer, M. D., Flaxman, S. R., & Ezzati, M. (2021) · Remote Sensing of Environment · doi:10.1016/j.rse.2021.112339 · Cited by 123
Yao, X., Han, J., Guo, L., Bu, S., & Liu, Z. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.02.073 · Cited by 96
Robust Capsule Network Based on Maximum Correntropy Criterion for Hyperspectral Image Classification
Li, H.-C., Wang, W., Pan, L., Li, W., Du, Q., & Tao, R. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.2968930 · Cited by 83
Hu, J., Hong, D., & Zhu, X. X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2924113 · Cited by 81
Self-citationGadiraju, K. K., Ramachandra, B., Chen, Z., & Vatsavai, R. R. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403375 · Cited by 73
Learning-Shared Cross-Modality Representation Using Multispectral-LiDAR and Hyperspectral Data
Hong, D., Chanussot, J., Yokoya, N., Kang, J. S., & Zhu, X. X. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2944599 · Cited by 64
Self-citationFusion of Hyperspectral and LiDAR Data With a Novel Ensemble Classifier
Xia, J., Yokoya, N., & Iwasaki, A. (2018) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2816958 · Cited by 63
Chen, C., Yan, J., Wang, L., Liang, D., & Zhang, W. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3044250 · Cited by 58
Qian, X., Chen, X., Yue, W., Liu, X., Guo, J., Li, Z., Li, Y., & Wang, W. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3019582 · Cited by 31
Learning a Deep Similarity Network for Hyperspectral Image Classification
Yang, B., Li, H., & Guo, Z. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3041344 · Cited by 22
Graph-Induced Aligned Learning on Subspaces for Hyperspectral and Multispectral Data
Hong, D., Kang, J. S., Yokoya, N., & Chanussot, J. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3021140 · Cited by 13
Self-citation
Cited by
Yao, J., Zhang, B., Li, C., Hong, D., & Chanussot, J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3284671 · Cited by 390
Self-citationA Multilevel Multimodal Fusion Transformer for Remote Sensing Semantic Segmentation
Ma, X., Zhang, X., Pun, M.-O., & Liu, M. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3373033 · Cited by 265
A Review on Bathymetric Inversion Research Based on Deep Learning Models and Remote Sensing Images
Liu, D., Shi, Y., & Fang, H. (2026) · Remote Sensing · doi:10.3390/rs18050720 · Cited by 4
Metadata
- Authors
- Wu, X., Hong, D., & Chanussot, J.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2022
- Volume
- 60
- Pages
- 1-10
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W3209540366
- Cited by
- 412
- References
- 41
- FWCI
- 26.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.