Orientation robust object detection in aerial images using deep convolutional neural network
Abstract
Detecting objects in aerial images is challenged by variance of object colors, aspect ratios, cluttered backgrounds, and in particular, undetermined orientations. In this paper, we propose to use Deep Convolutional Neural Network (DCNN) features from combined layers to perform orientation robust aerial object detection. We explore the inherent characteristics of DC-NN as well as relate the extracted features to the principle of disentangling feature learning. An image segmentation based approach is used to localize ROIs of various aspect ratios, and ROIs are further classified into positives or negatives using an SVM classifier trained on DCNN features. With experiments on two datasets collected from Google Earth, we demonstrate that the proposed aerial object detection approach is simple but effective.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The most straightforward solution to rotation is to perform data augmentation so that an object in any orientation can be well covered by the augmented data distribution.
“The most straightforward solution to this problem is to perform data augmentation so that an object in any orientation can be well covered by the augmented data distribution [166]”
From Object Detection in 20 Years: A Survey (2023) · cites this paper as [166]
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · see citing works
(2008) · Journal of Machine Learning Research · Cited by 33,051 · see citing works
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684 · see citing works
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · see citing works
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300 · see citing works
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398 · see citing works
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · see citing works
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980 · see citing works
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336 · see citing works
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · see citing works
Fast Feature Pyramids for Object Detection
Dollár, P., Appel, R., Belongie, S., & Perona, P. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2300479 · Cited by 1,941 · see citing works
Learning Convolutional Feature Hierarchies for Visual Recognition
Kavukcuoglu, K., Sermanet, P., Boureau, Y.-L., Gregor, K., Mathieu, M., & LeCun, Y. (2010) · Cited by 488 · see citing works
Rotation Invariant Neural Network-Based Face Detection
Rowley, H. A., Baluja, S., & Takeo Kanade, A. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1998.698721 · Cited by 471 · see citing works
Rotation Invariant Neural Network-Based Face Detection
Rowley, H. A., Baluja, S., & Kanade, T. (1997) · doi:10.21236/ada341629 · Cited by 253 · see citing works
Learning to Disentangle Factors of Variation with Manifold Interaction
Reed, S., Sohn, K., Zhang, Y., & Lee, H. (2014) · Cited by 201 · see citing works
Vehicle Detection Using Partial Least Squares
Kembhavi, A., Harwood, D. M., & Davis, L. S. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.182 · Cited by 197 · see citing works
Car detection in low resolution aerial images
Zhao, T., & Nevatia, R. (2003) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00064-7 · Cited by 162 · see citing works
Rotation invariant image recognition using features selected via a systematic method
Khotanzad, A. R., & Hong, Y. H. (1990) · Pattern Recognition · doi:10.1016/0031-3203(90)90005-6 · Cited by 162 · see citing works
On-line boosting-based car detection from aerial images
Gräbner, H., Thủy, N. T. T., Gruber, B., & Bischof, H. (2008) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2007.10.005 · Cited by 146 · see citing works
Classification-based vehicle detection in high-resolution satellite images
Eikvil, L., Aurdal, L., & Koren, H. (2008) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2008.09.005 · Cited by 129 · see citing works
Vehicle Detection from Aerial Images Using Local Shape Information
Choi, J., & Yang, Y.-K. (2009) · Lecture notes in computer science · doi:10.1007/978-3-540-92957-4_20 · Cited by 59 · see citing works
A Morphological Neural Network Approach for Vehicle Detection from High Resolution Satellite Imagery
Zheng, H. Y., Pan, L., & Li, L. (2006) · Lecture notes in computer science · doi:10.1007/11893257_11 · Cited by 27 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Object Detection in 20 Years: A Survey
Zou, Z., Chen, K., Shi, Z., Guo, Y., & Ye, J. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3238524 · Cited by 3,689 · see citing works
DOTA: A Large-Scale Dataset for Object Detection in Aerial Images
Xia, G.-S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00418 · Cited by 3,414 · see citing works
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400 · see citing works
Object detection in optical remote sensing images: A survey and a new benchmark
Li, K., Wan, G., Cheng, G., Meng, L., & Han, J. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.11.023 · Cited by 2,317 · see citing works
On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances, and Million-AID
Long, Y., Xia, G.-S., Li, S., Yang, W., Yang, M. Y., Zhu, X. X., Zhang, L., & Li, D. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3070368 · Cited by 250 · see citing works
Ding, P., Zhang, Y., Deng, W.-J., Jia, P., & Kuijper, A. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.05.005 · Cited by 174 · see citing works
Yan, J., Wang, H., Yan, M., Diao, W., Sun, X., & Li, H. (2019) · Remote Sensing · doi:10.3390/rs11030286 · Cited by 147 · see citing works
SpaceNet MVOI: A Multi-View Overhead Imagery Dataset
Weir, N., Lindenbaum, D., Bastidas, A., Etten, A., Kumar, V., Mcpherson, S., Shermeyer, J., & Tang, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00108 · Cited by 95 · see citing works
- Authors
- Zhu, H., Chen, X., Dai, W., Fu, K., Ye, Q., & Jiao, J.
- Affiliations
- University of Chinese Academy of Sciences (CN)
- Chinese Academy of Sciences (CN)
- Venue
- 2015 IEEE International Conference on Image Processing (ICIP)
- Publisher
- IEEE
- Published
- 2015-09
- Pages
- 3735-3739
- ISSN
- 1522-4880 (ISSN-L)
- OpenAlex
- W2296151615
- Cited by
- 483
- References
- 24
- Citations by year
- 2026: 29 · 2025: 66 · 2024: 67 · 2023: 90 · 2022: 67 · 2021: 64 · 2020: 41 · 2019: 39 · 2018: 11 · 2017: 7 · 2016: 2
- FWCI
- 2.73
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Conference on Image Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Engineering › Media Technology › Remote-Sensing Image Classification
- Keywords
- aerial object detection, deep convolutional neural network features, image segmentation, region of interest localization, aspect ratio variation, background clutter, support vector machine classification, Google Earth imagery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review