The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Multisource Remote Sensing Data Classification Based on Convolutional Neural Network
Abstract
As a list of remotely sensed data sources is available, how to efficiently exploit useful information from multisource data for better Earth observation becomes an interesting but challenging problem. In this paper, the classification fusion of hyperspectral imagery (HSI) and data from other multiple sensors, such as light detection and ranging (LiDAR) data, is investigated with the state-of-the-art deep learning, named the two-branch convolution neural network (CNN). More specific, a two-tunnel CNN framework is first developed to extract spectral-spatial features from HSI; besides, the CNN with cascade block is designed for feature extraction from LiDAR or high-resolution visual image. In the feature fusion stage, the spatial and spectral features of HSI are first integrated in a dual-tunnel branch, and then combined with other data features extracted from a cascade network. Experimental results based on several multisource data demonstrate the proposed two-branch CNN that can achieve more excellent classification performance than some existing methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Classification of hyperspectral remote sensing images with support vector machines
Melgani, F., & Bruzzone, L. (2004) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.831865 · Cited by 4,411
Chen, Y., Jiang, H., Li, C., Jia, X., & Ghamisi, P. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2584107 · Cited by 2,984
Deep learning-based classification of hyperspectral data
Chen, Y., Lin, Z., Zhao, X., Wang, G., & Gu, Y. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2329330 · Cited by 2,679
Random Forests for land cover classification
Gislason, P. O., Benediktsson, J. A., & Sveinsson, J. R. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.08.011 · Cited by 2,244
Deep Convolutional Neural Networks for Hyperspectral Image Classification
Hu, W., Huang, Y., Wei, L., Zhang, F., & Li, H. (2015) · Journal of Sensors · doi:10.1155/2015/258619 · Cited by 1,941
Spectral–Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network
Li, Y., Zhang, H., & Shen, Q. (2017) · Remote Sensing · doi:10.3390/rs9010067 · Cited by 1,320
Investigation of the random forest framework for classification of hyperspectral data
Ham, J., Chen, Y., Crawford, M. M., & Ghosh, J. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.842481 · Cited by 1,276
Spectral-spatial classification of hyperspectral data based on deep belief network
Chen, Y., Zhao, X., & Jia, X. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2388577 · Cited by 1,259 · cited 1×
“was proposed in [34] for HSI classification.”
Hu, F., Xia, G.-S., Hu, J., & Zhang, L. (2015) · Remote Sensing · doi:10.3390/rs71114680 · Cited by 1,195
Hyperspectral Image Classification Using Dictionary-Based Sparse Representation
Chen, Y., Nasrabadi, N. M., & Tran, T. D. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2129595 · Cited by 1,155
Convolutional neural networks for large-scale remote-sensing image classification
Maggiori, E., Tarabalka, Y., Charpiat, G., & Alliez, P. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2612821 · Cited by 1,114
Deep supervised learning for hyperspectral data classification through convolutional neural networks
Makantasis, K., Karantzalos, K., Doulamis, A., & Doulamis, N. (2015) · 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326945 · Cited by 1,011
Deep learning based feature selection for remote sensing scene classification
Zou, Q., Ni, L., Zhang, T., & Wang, Q. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2475299 · Cited by 956
Is object localization for free? - Weakly-supervised learning with convolutional neural networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298668 · Cited by 886
Hyperspectral Image Classification Using Deep Pixel-Pair Features
Li, W., Wu, G., Zhang, F., & Du, Q. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2616355 · Cited by 805
Self-citationConvolutional neural networks for hyperspectral image classification
Yu, S., Jia, S., & Xu, C. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.09.010 · Cited by 703
Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification
Li, W., Chen, C., Su, H., & Du, Q. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2381602 · Cited by 685
Self-citationGeneralized Composite Kernel Framework for Hyperspectral Image Classification
Li, J., Marpu, P. R., Plaza, A., Bioucas-Dias, J. M., & Benediktsson, J. A. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2230268 · Cited by 484
Land Use Classification in Remote Sensing Images by Convolutional Neural Networks
Castelluccio, M., Poggi, G., Sansone, C., & Verdoliva, L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.00092 · Cited by 474
Locality-Preserving Dimensionality Reduction and Classification for Hyperspectral Image Analysis
Li, W., Prasad, S., Fowler, J. E., & Bruce, L. M. (2012) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2165957 · Cited by 472
Self-citationHuang, X., & Zhang, L. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2202912 · Cited by 455
Scene Classification via a Gradient Boosting Random Convolutional Network Framework
Zhang, F., Du, B., & Zhang, L. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2488681 · Cited by 424
Training Deep Convolutional Neural Networks for Land–Cover Classification of High-Resolution Imagery
Scott, G. J., England, M. R., Starms, W. A., Marcum, R. A., & Davis, C. H. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2657778 · Cited by 353
Combined sparse and collaborative representation for hyperspectral target detection
Li, W., Du, Q., & Zhang, B. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.05.024 · Cited by 276
Self-citationA Discriminative Metric Learning Based Anomaly Detection Method
Du, B., & Zhang, L. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2303895 · Cited by 267
Spectral–Spatial Classification of Hyperspectral Image Based on Deep Auto-Encoder
Ma, X., Wang, H., & Geng, J. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2517204 · Cited by 258
Hyperspectral and LiDAR Data Fusion Using Extinction Profiles and Deep Convolutional Neural Network
Ghamisi, P., Hofle, B., & Zhu, X. X. (2017) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2634863 · Cited by 250
Liang, H., & Li, Q. (2016) · Remote Sensing · doi:10.3390/rs8020099 · Cited by 238
Nearest Regularized Subspace for Hyperspectral Classification
Li, W., Tramel, E. W., Prasad, S., & Fowler, J. E. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2241773 · Cited by 227
Self-citationScott, G. J., Marcum, R. A., Davis, C. H., & Nivin, T. W. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2722988 · Cited by 214
Fusion of Hyperspectral and LiDAR Remote Sensing Data Using Multiple Feature Learning
Khodadadzadeh, M., Li, J., Prasad, S., & Plaza, A. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2432037 · Cited by 211
Invasive species detection in Hawaiian rainforests using airborne imaging spectroscopy and LiDAR
Asner, G. P., Knapp, D. E., Kennedy-Bowdoin, T., Jones, M. O., Martin, R. E., Boardman, J., & Hughes, R. F. (2008) · Remote Sensing of Environment · doi:10.1016/j.rse.2007.11.016 · Cited by 204
Gabor-Filtering-Based Nearest Regularized Subspace for Hyperspectral Image Classification
Li, W., & Du, Q. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2013.2295313 · Cited by 192
Self-citationKoetz, B., Morsdorf, F., van der Linden, S., Curt, T., & Allgöwer, B. (2008) · Forest Ecology and Management · doi:10.1016/j.foreco.2008.04.025 · Cited by 186
Fully convolutional neural networks for remote sensing image classification
Maggiori, E., Tarabalka, Y., Charpiat, G., & Alliez, P. (2016) · 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2016.7730322 · Cited by 171
Extinction Profiles for the Classification of Remote Sensing Data
Ghamisi, P., de Souza, R. M., Benediktsson, J. A., Zhu, X. X., Rittner, L., & Lotufo, R. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2561842 · Cited by 160
Subspace-Based Support Vector Machines for Hyperspectral Image Classification
Gao, L., Li, J., Khodadadzadeh, M., Plaza, A., Zhang, B., He, Z., & Yan, H. (2014) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2014.2341044 · Cited by 141
Self-citationOntology-Based Classification of Building Types Detected from Airborne Laser Scanning Data
Belgiu, M., Tomljenović, I., Lampoltshammer, T. J., Blaschke, T., & Höfle, B. (2014) · Remote Sensing · doi:10.3390/rs6021347 · Cited by 128
Zhong, Y., Feng, F., & Zhang, L. (2016) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.10.025006 · Cited by 123
Eslami, M., & Mohammadzadeh, A. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2489838 · Cited by 60
Zhao, C., Gao, X., Wang, Y., & Li, J. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2535538 · Cited by 46
Contextual Subpixel Mapping of Hyperspectral Images Making Use of a High Resolution Color Image
Mahmood, Z., Akhter, M. A., Thoonen, G., & Scheunders, P. (2013) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2012.2236539 · Cited by 33
Deep fusion of hyperspectral and LiDAR data for thematic classification
Chen, Y., Li, C., Ghamisi, P., et al. (2016) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2016.7729930 · Cited by 28
Synergetic Classification of Long-Wave Infrared Hyperspectral and Visible Images
Lu, X., Zhang, J., Li, T., & Zhang, G. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2442594 · Cited by 26
Research works printed but not linked: 9
- 10.3390/s8053020 · doi:10.3390/s8053020
- liao, 2014, Combining feature fusion and decision fusion for classification of hyperspectral and LiDAR data, Proc IEEE Int Geosci Remote Sens Symp (IGARSS), 1241
- 10.14358/PERS.81.12.901 · doi:10.14358/pers.81.12.901
- maas, 2013, Rectifier nonlinearities improve neural network acoustic models, Proc 30th ICML, 30
- 10.3390/rs70403826 · doi:10.3390/rs70403826
- 10.1016/j.landurbplan.2012.01.001 · doi:10.1016/j.landurbplan.2012.01.001
- 10.1016/S0034-4257(02)00049-4 · doi:10.1016/s0034-4257(02)00049-4
- 10.1109/JSTARS.2014.2306956 · doi:10.1109/jstars.2014.2306956
- 10.1109/JSTSP.2012.2208177 · DOI
Cited by
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Deep Learning for Hyperspectral Image Classification: An Overview
Li, S., Song, W., Fang, L., Chen, Y., Ghamisi, P., & Benediktsson, J. A. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2907932 · Cited by 2,007
“For instance, in [107] and [108], a deep CNN with two-branch architecture was proposed to extract the joint spectral–spatial features from HSIs.”
BackgroundMethodMore Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification
Hong, D., Gao, L., Yokoya, N., Yao, J., Chanussot, J., Du, Q., & Zhang, B. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3016820 · Cited by 1,374
Self-citationDeep learning in multimodal remote sensing data fusion: A comprehensive review
Li, J., Hong, D., Gao, L., Yao, J., Zheng, K., Zhang, B., & Chanussot, J. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102926 · Cited by 630
Self-citationRasti, B., Hong, D., Hang, R., Ghamisi, P., Kang, X., Chanussot, J., & Benediktsson, J. A. (2020) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2020.2979764 · Cited by 537
Metadata
- Authors
- Xu, X., Li, W., Ran, Q., Du, Q., Gao, L., & Zhang, B.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2018-02
- Volume
- 56
- Issue
- 2
- Pages
- 937-949
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W2765739551
- Cited by
- 689
- References
- 53
- FWCI
- 32.44
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- National Natural Science Foundation of China (NSFC-91638201, 61571033)
- Higher Education and High-Quality and World-Class Universities (PY201619)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.