The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs
Abstract
Remote sensing image scene classification is an active and challenging task driven by many applications. More recently, with the advances of deep learning models especially convolutional neural networks (CNNs), the performance of remote sensing image scene classification has been significantly improved due to the powerful feature representations learnt through CNNs. Although great success has been obtained so far, the problems of within-class diversity and between-class similarity are still two big challenges. To address these problems, in this paper, we propose a simple but effective method to learn discriminative CNNs (D-CNNs) to boost the performance of remote sensing image scene classification. Different from the traditional CNN models that minimize only the cross entropy loss, our proposed D-CNN models are trained by optimizing a new discriminative objective function. To this end, apart from minimizing the classification error, we also explicitly impose a metric learning regularization term on the CNN features. The metric learning regularization enforces the D-CNN models to be more discriminative so that, in the new D-CNN feature spaces, the images from the same scene class are mapped closely to each other and the images of different classes are mapped as farther apart as possible. In the experiments, we comprehensively evaluate the proposed method on three publicly available benchmark data sets using three off-the-shelf CNN models. Experimental results demonstrate that our proposed D-CNN methods outperform the existing baseline methods and achieve state-of-the-art results on all three data sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Bag-of-visual-words and spatial extensions for land-use classification
Yang, Y., & Newsam, S. (2010) · Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems · doi:10.1145/1869790.1869829 · Cited by 2,969
Remote Sensing Image Scene Classification: Benchmark and State of the Art
Cheng, G., Han, J., & Lu, X. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2675998 · Cited by 2,926
Self-citationAID: A benchmark data set for performance evaluation of aerial scene classification
Xia, G.-S., Hu, J., Hu, F., Shi, B., Bai, X., Zhong, Y., Zhang, L., & Lu, X. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2685945 · Cited by 2,372
Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art
Zhang, L., Zhang, L., & Du, B. (2016) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2540798 · Cited by 2,208
Cheng, G., Zhou, P., & Han, J. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2601622 · Cited by 1,771
Self-citationDeep Metric Learning via Lifted Structured Feature Embedding
Song, H. O., Xiang, Y., Jegelka, S., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.434 · Cited by 1,630
A survey on object detection in optical remote sensing images
Cheng, G., & Han, J. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.03.014 · Cited by 1,475
Self-citationHu, F., Xia, G.-S., Hu, J., & Zhang, L. (2015) · Remote Sensing · doi:10.3390/rs71114680 · Cited by 1,195
Cheng, G., Han, J., Zhou, P., & Guo, L. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2014.10.002 · Cited by 1,007
Self-citationTowards better exploiting convolutional neural networks for remote sensing scene classification
Nogueira, K., Penatti, O. A. B., & dos Santos, J. A. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.07.001 · Cited by 902
Han, J., Zhang, D., Cheng, G., Guo, L., & Ren, J. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2374218 · Cited by 733
Self-citationUnsupervised Deep Feature Extraction for Remote Sensing Image Classification
Romero, A., Gatta, C., & Camps-Valls, G. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2478379 · Cited by 729
Discriminative Deep Metric Learning for Face Verification in the Wild
Hu, J., Lu, J., & Tan, Y.-P. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.242 · Cited by 682
Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks
Marmanis, D., Datcu, M., Esch, T., & Stilla, U. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2499239 · Cited by 646
Anomaly Detection in Hyperspectral Images Based on Low-Rank and Sparse Representation
Xu, Y., Wu, Z., Li, J., Plaza, A., & Wei, Z. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2493201 · Cited by 602
Saliency-Guided Unsupervised Feature Learning for Scene Classification
Zhang, F., Du, B., & Zhang, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2357078 · Cited by 542
Co-Saliency Detection via a Self-Paced Multiple-Instance Learning Framework
Zhang, D., Meng, D., & Han, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2567393 · Cited by 508
Self-citationDeep Feature Fusion for VHR Remote Sensing Scene Classification
Chaib, S., Liu, H., Gu, Y., & Yao, H. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2700322 · Cited by 461
Rotation-Insensitive and Context-Augmented Object Detection in Remote Sensing Images
Li, K., Cheng, G., Bu, S., & You, X. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2778300 · Cited by 439
Self-citationScene Classification via a Gradient Boosting Random Convolutional Network Framework
Zhang, F., Du, B., & Zhang, L. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2488681 · Cited by 424
CNNs-Based RGB-D Saliency Detection via Cross-View Transfer and Multiview Fusion
Han, J., Chen, H., Liu, N., Yan, C., & Li, X. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2761775 · Cited by 423
Self-citationUnsupervised Feature Learning for Aerial Scene Classification
Cheriyadat, A. M. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2241444 · Cited by 421
Zhu, Q., Zhong, Y., Zhao, B., Xia, G.-S., & Zhang, L. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2513443 · Cited by 381
Tube Convolutional Neural Network (T-CNN) for Action Detection in Videos
Hou, R., Chen, C., & Shah, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.620 · Cited by 375
Satellite Image Classification via Two-Layer Sparse Coding With Biased Image Representation
Dai, D., & Yang, W. (2011) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2010.2055033 · Cited by 362
Semantic Annotation of High-Resolution Satellite Images via Weakly Supervised Learning
Yao, X., Han, J., Cheng, G., Qian, X., & Guo, L. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2523563 · Cited by 346
Self-citationRemote Sensing Image Scene Classification Using Bag of Convolutional Features
Cheng, G., Li, Z., Yao, X., Guo, L., & Wei, Z. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2731997 · Cited by 334
Self-citationSheng, G., Yang, W., Xu, T., & Sun, H. (2012) · International Journal of Remote Sensing · doi:10.1080/01431161.2011.608740 · Cited by 309
Cheng, G., Han, J., Guo, L., Liu, Z., Bu, S., & Ren, J. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2393857 · Cited by 305
Self-citationLi, E., Xia, J., Du, P., Lin, C., & Samat, A. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2711275 · Cited by 296
Remote Sensing Scene Classification by Unsupervised Representation Learning
Lu, X., Zheng, X., & Yuan, Y. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2702596 · Cited by 288
Cheng, G., Guo, L., Zhao, T., Han, J., Li, H., & Fang, J. (2013) · International Journal of Remote Sensing · doi:10.1080/01431161.2012.705443 · Cited by 281
Self-citationMultiview Deep Learning for Land-Use Classification
Luus, F. P. S., Salmon, B. P., van den Bergh, F., & Maharaj, B. T. J. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2483680 · Cited by 257
Yao, X., Han, J., Zhang, D., & Nie, F. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2694222 · Cited by 230
Self-citationA Unified Metric Learning-Based Framework for Co-Saliency Detection
Han, J., Cheng, G., Li, Z., & Zhang, D. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2706264 · Cited by 230
Self-citationCross-View Image Matching for Geo-Localization in Urban Environments
Tian, Y., Chen, C., & Shah, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.216 · Cited by 221
Pyramid of Spatial Relatons for Scene-Level Land Use Classification
Chen, S., & Tian, Y. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2351395 · Cited by 211
Han, J., Zhou, P., Zhang, D., Cheng, G., Guo, L., Liu, Z., Bu, S., & Wu, J. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2013.12.011 · Cited by 200
Self-citationFusing Local and Global Features for High-Resolution Scene Classification
Bian, X., Chen, C., Tian, L., & Du, Q. (2017) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2017.2683799 · Cited by 185
Semi-Supervised Multitask Learning for Scene Recognition
Lu, X., Li, X., & Mou, L. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2362959 · Cited by 179
Domain Adaptation Network for Cross-Scene Classification
Othman, E., Bazi, Y., Melgani, F., Alhichri, H., Alajlan, N., & Zuair, M. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2692281 · Cited by 175
Zhao, L.-J., Tang, P., & Huo, L.-Z. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2339842 · Cited by 174
Land-use scene classification using multi-scale completed local binary patterns
Chen, C., Zhang, B., Su, H., Li, W., & Wang, L. (2016) · Signal, Image and Video Processing · doi:10.1007/s11760-015-0804-2 · Cited by 170
Joint Dictionary Learning for Multispectral Change Detection
Lu, X., Yuan, Y., & Zheng, X. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2531179 · Cited by 169
Scene classification using local and global features with collaborative representation fusion
Zou, J., Li, W., Chen, C., & Du, Q. (2016) · Information Sciences · doi:10.1016/j.ins.2016.02.021 · Cited by 162
Huang, L., Chen, C., Li, W., & Du, Q. (2016) · Remote Sensing · doi:10.3390/rs8060483 · Cited by 160
Zhao, B., Zhong, Y., & Zhang, L. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.03.004 · Cited by 151
Unsupervised Multilayer Feature Learning for Satellite Image Scene Classification
Li, Y., Tao, C., Tan, Y., Shang, K., & Tian, J. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2503142 · Cited by 137
Duplex Metric Learning for Image Set Classification
Cheng, G., Zhou, P., & Han, J. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2760512 · Cited by 137
Self-citationRevealing Event Saliency in Unconstrained Video Collection
Zhang, D., Han, J., Jiang, L., Ye, S., & Chang, X. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2658957 · Cited by 128
Self-citationHierarchical Recurrent Neural Hashing for Image Retrieval With Hierarchical Convolutional Features
Lu, X., Chen, Y., & Li, X. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2755766 · Cited by 124
Aggregating Rich Hierarchical Features for Scene Classification in Remote Sensing Imagery
Wang, G., Fan, B., Xiang, S., & Pan, C. (2017) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2017.2705419 · Cited by 113
High-resolution remote-sensing imagery retrieval using sparse features by auto-encoder
Zhou, W., Shao, Z., Diao, C., & Cheng, Q. (2015) · Remote Sensing Letters · doi:10.1080/2150704x.2015.1074756 · Cited by 85
Land-Use Classification With Compressive Sensing Multifeature Fusion
Mekhalfi, M. L., Melgani, F., Bazi, Y., & Alajlan, N. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2453130 · Cited by 79
GPU Parallel Implementation of Spatially Adaptive Hyperspectral Image Classification
Wu, Z., Shi, L., Li, J., Wang, Q., Sun, L., Wei, Z., Plaza, J., & Plaza, A. (2017) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2017.2755639 · Cited by 71
Learning coarse-to-fine sparselets for efficient object detection and scene classification
Cheng, G., Han, J., Guo, L., & Liu, T. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298721 · Cited by 67
Self-citationCheng, G., Zhou, P., Han, J., Guo, L., & Han, J. (2015) · IET Computer Vision · doi:10.1049/iet-cvi.2014.0270 · Cited by 67
Self-citationLand-Use Scene Classification in High-Resolution Remote Sensing Images Using Improved Correlatons
Qi, K., Wu, H., Shen, C., & Gong, J. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2478966 · Cited by 65
Scene classification using multi-scale deeply described visual words
Zhao, W., & Du, S. (2016) · International Journal of Remote Sensing · doi:10.1080/01431161.2016.1207266 · Cited by 56
Unsupervised Feature Learning for Land-Use Scene Recognition
Fan, J., Chen, T., & Lu, S. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2640186 · Cited by 55
Learning a Discriminative Distance Metric With Label Consistency for Scene Classification
Wang, Y., Zhang, L., Deng, H., et al. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2692280 · Cited by 30
Research works printed but not linked: 1
- 10.1109/JSTARS.2016.2542193 · DOI
Cited by
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Object detection in optical remote sensing images: A survey and a new benchmark
Li, K., Wan, G., Cheng, G., Meng, L., & Han, J. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.11.023 · Cited by 2,317
“…recently, deep learning based algorithms have been dominating the top accuracy benchmarks for various visual recognition tasks (Chen et al., 2018; Cheng et al., 2018a; Clément et al., 2013; Ding et al., 2017; Hinton et al., 2012; Hou et al., 2017; Krizhevsky et al., 2012; Mikolov et al., 2012;…”
BackgroundSelf-citationChen, H., & Shi, Z. (2020) · Remote Sensing · doi:10.3390/rs12101662 · Cited by 1,903
Cheng, G., Xie, X., Han, J., Guo, L., & Xia, G.-S. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3005403 · Cited by 995
Self-citationReview of Image Classification Algorithms Based on Convolutional Neural Networks
Chen, L., Li, S., Bai, Q., Yang, J., Jiang, S., & Miao, Y. (2021) · Remote Sensing · doi:10.3390/rs13224712 · Cited by 789
Metadata
- Authors
- Cheng, G., Yang, C., Yao, X., Guo, L., & Han, J.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2018-05
- Volume
- 56
- Issue
- 5
- Pages
- 2811-2821
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W2783165089
- Cited by
- 1,226
- References
- 64
- FWCI
- 126.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- National Science Foundation of China (61772425, 61473231, 61773315, 61701415)
- Natural Science Basic Research Plan in Shaanxi Province of China (2017JM6044)
- Science and Technology Foundation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.