The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Multi-scale object detection in remote sensing imagery with convolutional neural networks
Abstract
Abstract Automatic detection of multi-class objects in remote sensing images is a fundamental but challenging problem faced for remote sensing image analysis. Traditional methods are based on hand-crafted or shallow-learning-based features with limited representation power. Recently, deep learning algorithms, especially Faster region based convolutional neural networks (FRCN), has shown their much stronger detection power in computer vision field. However, several challenges limit the applications of FRCN in multi-class objects detection from remote sensing images: (1) Objects often appear at very different scales in remote sensing images, and FRCN with a fixed receptive field cannot match the scale variability of different objects; (2) Objects in large-scale remote sensing images are relatively small in size and densely peaked, and FRCN has poor localization performance with small objects; (3) Manual annotation is generally expensive and the available manual annotation of objects for training FRCN are not sufficient in number. To address these problems, this paper proposes a unified and effective method for simultaneously detecting multi-class objects in remote sensing images with large scales variability. Firstly, we redesign the feature extractor by adopting Concatenated ReLU and Inception module, which can increases the variety of receptive field size. Then, the detection is preformed by two sub-networks: a multi-scale object proposal network (MS-OPN) for object-like region generation from several intermediate layers, whose receptive fields match different object scales, and an accurate object detection network (AODN) for object detection based on fused feature maps, which combines several feature maps that enables small and densely packed objects to produce stronger response. For large-scale remote sensing images with limited manual annotations, we use cropped image blocks for training and augment them with re-scalings and rotations. The quantitative comparison results on the challenging NWPU VHR-10 data set, aircraft data set, Aerial-Vehicle data set and SAR-Ship data set show that our method is more accurate than existing algorithms and is effective for multi-modal remote sensing images.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
(2016) · Cited by 31,590
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Region-based convolutional networks for accurate object detection and segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2437384 · Cited by 2,912
Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art
Zhang, L., Zhang, L., & Du, B. (2016) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2540798 · Cited by 2,208
Efficient Non-Maximum Suppression
Neubeck, A., & Van Gool, L. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.479 · Cited by 2,118
Fast Feature Pyramids for Object Detection
Dollar, P., Appel, R., Belongie, S., & Perona, P. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2300479 · Cited by 1,955
Cheng, G., Zhou, P., & Han, J. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2601622 · Cited by 1,771
A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection
Cai, Z., Fan, Q., Feris, R. S., & Vasconcelos, N. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_22 · Cited by 1,605
A survey on object detection in optical remote sensing images
Cheng, G., & Han, J. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.03.014 · Cited by 1,475
Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks
Bell, S., Zitnick, C. L., Bala, K., & Girshick, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.314 · Cited by 1,292
Cheng, G., Han, J., Zhou, P., & Guo, L. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2014.10.002 · Cited by 1,007
HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection
Kong, T., Yao, A., Chen, Y., & Sun, F. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.98 · Cited by 934
Han, J., Zhang, D., Cheng, G., Guo, L., & Ren, J. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2374218 · Cited by 733
DSOD: Learning Deeply Supervised Object Detectors from Scratch
Shen, Z., Liu, Z., Li, J., Jiang, Y.-G., Chen, Y., & Xue, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.212 · Cited by 646
Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks
Chen, X., Xiang, S., Liu, C.-L., & Pan, C.-H. (2014) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2014.2309695 · Cited by 622
Saliency-Guided Unsupervised Feature Learning for Scene Classification
Zhang, F., Du, B., & Zhang, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2357078 · Cited by 542
Semantic Annotation of High-Resolution Satellite Images via Weakly Supervised Learning
Yao, X., Han, J., Cheng, G., Qian, X., & Guo, L. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2523563 · Cited by 346
Fast Multiclass Vehicle Detection on Aerial Images
Liu, K., & Mattyus, G. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2439517 · Cited by 345
Tang, T., Zhou, S., Deng, Z., Zou, H., & Lei, L. (2017) · Sensors · doi:10.3390/s17020336 · Cited by 282
Self-citationWeakly Supervised Learning Based on Coupled Convolutional Neural Networks for Aircraft Detection
Zhang, F., Du, B., Zhang, L., & Xu, M. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2569141 · Cited by 257
Ship Detection in Spaceborne Optical Image With SVD Networks
Zou, Z., & Shi, Z. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2572736 · Cited by 257
Convolutional Neural Network Based Automatic Object Detection on Aerial Images
Sevo, I., & Avramovic, A. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2542358 · Cited by 229
Scene Recognition by Manifold Regularized Deep Learning Architecture
Yuan, Y., Mou, L., & Lu, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2359471 · Cited by 214
Han, J., Zhou, P., Zhang, D., Cheng, G., Guo, L., Liu, Z., Bu, S., & Wu, J. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2013.12.011 · Cited by 200
Deng, Z., Sun, H., Zhou, S., Zhao, J., & Zou, H. (2017) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2017.2694890 · Cited by 195
Self-citationDu, B., Zhang, Y., Zhang, L., & Tao, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2601268 · Cited by 192
PVANET: Deep but Lightweight Neural Networks for Real-time Object Detection
Kim, K.-H., Hong, S., Roh, B., Cheon, Y., & Park, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.08021 · Cited by 183
Efficient Saliency-Based Object Detection in Remote Sensing Images Using Deep Belief Networks
Diao, W., Sun, X., Zheng, X., Dou, F., Wang, H., & Fu, K. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2498644 · Cited by 182
Semi-Supervised Multitask Learning for Scene Recognition
Lu, X., Li, X., & Mou, L. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2362959 · Cited by 179
Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units
Shang, W., Sohn, K., Almeida, D., & Lee, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.05201 · Cited by 162
Zhong, Y., Han, X., & Zhang, L. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.02.014 · Cited by 145
Arbitrary-Oriented Vehicle Detection in Aerial Imagery with Single Convolutional Neural Networks
Tang, T., Zhou, S., Deng, Z., Lei, L., & Zou, H. (2017) · Remote Sensing · doi:10.3390/rs9111170 · Cited by 134
Self-citationZhang, L., & Zhang, Y. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2620900 · Cited by 105
Object Detection Based on Sparse Representation and Hough Voting for Optical Remote Sensing Imagery
Yokoya, N., & Iwasaki, A. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2404578 · Cited by 98
Zhou, P., Cheng, G., Liu, Z., Bu, S., & Hu, X. (2015) · Multidimensional Systems and Signal Processing · doi:10.1007/s11045-015-0370-3 · Cited by 98
Wan, L., Eigen, D., & Fergus, R. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298686 · Cited by 86
Vehicle Detection in Satellite Images by Parallel Deep Convolutional Neural Networks
Chen, X., Xiang, S., Liu, C., & Pan, C. (2013) · Asian Conference on Pattern Recognition · doi:10.1109/acpr.2013.33 · Cited by 83
Aircraft Detection by Deep Belief Nets
Chen, X., Xiang, S., Liu, C., & Pan, C. (2013) · Asian Conference on Pattern Recognition · doi:10.1109/acpr.2013.5 · Cited by 65
Accurate non-maximum suppression for object detection in high-resolution remote sensing images
Qiu, S., Wen, G., Deng, Z., Liu, J., & Fan, Y. (2017) · Remote Sensing Letters · doi:10.1080/2150704x.2017.1415473 · Cited by 52
Self-citationScene Parsing From an MAP Perspective
Li, X., Mou, L., & Lu, X. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2361489 · Cited by 48
Zhang, W., Sun, X., Wang, H., & Fu, K. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2014.10.007 · Cited by 46
Deep Representation for Abnormal Event Detection in Crowded Scenes
Feng, Y., Yuan, Y., & Lu, X. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2967290 · Cited by 43
Yu, Y., Guan, H., Zai, D., & Ji, Z. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.04.014 · Cited by 40
Object-based detection of vehicles using combined optical and elevation data
Schilling, H., Bulatov, D., & Middelmann, W. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.11.023 · Cited by 19
He, C., Tu, M., Xiong, D., et al. (2018) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi7020072 · Cited by 19
Qiu, S., Wen, G., Deng, Z., Fan, Y., & Hui, B. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2731863 · Cited by 14
Self-citation
Research works printed but not linked: 6
- Cheng, 2017, Remote sensing image scene classification: benchmark and state of the art, Proc. IEEE PP, 1
- Dean, J., Corrado, G., Monga, R., Chen, K., Devin, M., Mao, M., Senior, A., Tucker, P., Yang, K., Le, Q.V., et al., 2012. Large scale distributed deep networks. In: Advances in neural information processing systems, pp. 1223–1231.
- El-Darymli, 2013, Target detection in synthetic aperture radar imagery: a state-of-the-art survey, J. Appl. Remote Sens., 7, 071598, 10.1117/1.JRS.7.071598 · doi:10.1117/1.jrs.7.071598
- Kuttikkad, S., Chellappa, R., 1994. Non-gaussian cfar techniques for target detection in high resolution sar images. In: Image Processing, 1994. Proceedings. ICIP-94., IEEE International Conference. Vol. 1. IEEE, pp. 910–914. · doi:10.1109/icip.1994.413444
- Li, Y., He, K., Sun, J., et al., 2016. R-fcn: object detection via region-based fully convolutional networks. In: Advances in Neural Information Processing Systems, pp. 379–387.
- Yao, 2017, Detection of moving ships in sequences of remote sensing images, Int. J. Geo-Inform., 6, 334, 10.3390/ijgi6110334 · doi:10.3390/ijgi6110334
Cited by
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
HRSID: A High-Resolution SAR Images Dataset for Ship Detection and Instance Segmentation
Wei, S., Zeng, X., Qu, Q., Wang, M., Su, H., & Shi, J. (2020) · IEEE Access · doi:10.1109/access.2020.3005861 · Cited by 912
Artificial Intelligence for Remote Sensing Data Analysis: A review of challenges and opportunities
Zhang, L., & Zhang, L. (2022) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2022.3145854 · Cited by 604
Sun, X., Wang, P., Yan, Z., Xu, F., Wang, R., Diao, W., Chen, J., Li, J., Feng, Y., Xu, T., et al. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.12.004 · Cited by 540
Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmark
Xu, C., Wang, J., Yang, W., Yu, H., Yu, L., & Xia, G.-S. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.06.002 · Cited by 458
Metadata
- Authors
- Deng, Z., Sun, H., Zhou, S., Zhao, J., Lei, L., & Zou, H.
- Venue
- ISPRS Journal of Photogrammetry and Remote Sensing
- Publisher
- Elsevier BV
- Published
- 2018-11
- Volume
- 145
- Pages
- 3-22
- ISSN
- 0924-2716 (ISSN-L)
- OpenAlex
- W2800388963
- Cited by
- 519
- References
- 62
- FWCI
- 23.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Funders
- National Natural Science Foundation of China (61303186)
- Fund of Innovation of National University of Defense Technology Graduate School (B150406)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.