The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Remote Sensing Object Detection Meets Deep Learning: A metareview of challenges and advances
Open accessAbstract
Remote sensing object detection (RSOD), one of the most fundamental and challenging tasks in the remote sensing field, has received long-standing attention. In recent years, deep learning techniques have demonstrated robust feature representation capabilities and led to a big leap in the development of RSOD techniques. In this era of rapid technical evolution, this article aims to present a comprehensive review of the recent achievements in deep learning-based RSOD methods. More than 300 papers are covered in this review. We identify five main challenges in RSOD, including multiscale object detection, rotated object detection, weak object detection, tiny object detection, and object detection with limited supervision, and systematically review the corresponding methods developed in a hierarchical division manner. We also review the widely used benchmark datasets and evaluation metrics within the field of RSOD as well as the application scenarios for RSOD. Future research directions are provided for further promoting the research in RSOD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 2×
“It is worth noting that multiple prediction detections may match the same ground truth annotation according to the preceding criteria, but only the prediction detection with the highest confidence score is assigned as a TP, and the rest are FPs [287].”
BackgroundMethodPath Aggregation Network for Instance Segmentation
Liu, S., Qi, L., Qin, H., Shi, J., & Jia, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00913 · Cited by 10,011
EfficientDet: Scalable and Efficient Object Detection
Tan, M., Pang, R., & Le, Q. V. (2019) · arXiv · Cited by 9,841 · cited 1×
“Thanks to the significant improvement of the FPN for multiscale object detection, the FPN and its extensions [66], [67], [68] play a dominant role in multiscale feature representation.”
MethodFCOS: Fully Convolutional One-Stage Object Detection
Tian, Z., Shen, C., Chen, H., & He, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00972 · Cited by 7,013
DOTA: A Large-Scale Dataset for Object Detection in Aerial Images
Xia, G.-S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00418 · Cited by 3,414
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01247-4 · Cited by 2,965 · cited 1×
“Recently, deep learning techniques [22] have demonstrated powerful feature representation capabilities from massive amounts of data, and the state-of-the-art detectors [23], [24], [25], [26] in computer vision achieve an object detection ability that rivals that of humans [27].”
BackgroundDeep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2018) · arXiv · doi:10.48550/arxiv.1809.02165 · Cited by 2,965
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Self-citationObject detection in optical remote sensing images: A survey and a new benchmark
Li, K., Wan, G., Cheng, G., Meng, L., & Han, J. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.11.023 · Cited by 2,317 · cited 5×
“8) DIOR [28] : DIOR is an object detection dataset for optical RSIs.”
BackgroundMethodInfluentialCheng, G., Zhou, P., & Han, J. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2601622 · Cited by 1,771
Learning RoI Transformer for Oriented Object Detection in Aerial Images
Ding, J., Xue, N., Long, Y., Xia, G.-S., & Lu, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00296 · Cited by 1,666
Cheng, G., Han, J., Zhou, P., & Guo, L. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2014.10.002 · Cited by 1,007 · cited 4×
“In this section, we mainly introduce 10 widely used datasets with specific characteristics: 1) NWPU VHR-10 [18] : This dataset is a multiclass geo-spatial object detection dataset.”
BackgroundMethodInfluentialTowards Large-Scale Small Object Detection: Survey and Benchmarks
Cheng, G., Yuan, X., Yao, X., Yan, K., Zeng, Q., Xie, X., & Han, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3290594 · Cited by 683 · cited 2×
“Later, some works [130], [131], [284] introduced a novel evaluation metric, , AP : 50 95 which averages the AP over 10 IOU thresholds from 0.5 to 0.95, with an interval of 0.05.”
BackgroundMethodInfluentialOrientation robust object detection in aerial images using deep convolutional neural network
Zhu, H., Chen, X., Dai, W., Fu, K., Ye, Q., & Jiao, J. (2015) · 2015 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2015.7351502 · Cited by 483
Cheng, G., Han, J., Zhou, P., & Xu, D. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2867198 · Cited by 408
A Large Contextual Dataset for Classification, Detection and Counting of Cars with Deep Learning
Mundhenk, T. N., Konjevod, G., Sakla, W. A., & Boakye, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_48 · Cited by 386
Yu, J., Wang, Z., Majumdar, A., & Rajagopal, R. (2018) · Joule · doi:10.1016/j.joule.2018.11.021 · Cited by 362
Kellenberger, B., Marcos, D., & Tuia, D. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.06.028 · Cited by 335
Christie, G., Fendley, N., Wilson, J., & Mukherjee, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00646 · Cited by 312
On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances, and Million-AID
Long, Y., Xia, G.-S., Li, S., Yang, W., Yang, M. Y., Zhu, X. X., Zhang, L., & Li, D. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3070368 · Cited by 250
Xu, X., Zhang, X., & Zhang, T. (2022) · Remote Sensing · doi:10.3390/rs14041018 · Cited by 221
Self-citationAutomatic detection of solar photovoltaic arrays in high resolution aerial imagery
Malof, J. M., Bradbury, K., Collins, L. M., & Newell, R. G. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.08.191 · Cited by 196 · cited 1×
“Besides, RSOD can produce statistics on the number and spatial distribution of solar panels and wind turbines [311], [312], [313], [314], facilitating the mitigation of greenhouse gas emissions.”
BackgroundCheng, G., Zhou, P., & Han, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.315 · Cited by 175 · cited 2×
“To this purpose, many researchers proposed a series of meth-ods for learning the rotational invariance of objects [146], [147], [148], [149], [150], [151], [152], [153], [154], [155], [156], [157], which significantly improves rotated object detection in RSIs.”
BackgroundMethodDing, P., Zhang, Y., Deng, W.-J., Jia, P., & Kuijper, A. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.05.005 · Cited by 174
Detecting animals in African Savanna with UAVs and the crowds
Rey, N., Volpi, M., Joost, S., & Tuia, D. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.08.026 · Cited by 150
Yan, J., Wang, H., Yan, M., Diao, W., Sun, X., & Li, H. (2019) · Remote Sensing · doi:10.3390/rs11030286 · Cited by 147
Shamsolmoali, P., Chanussot, J., Zareapoor, M., Zhou, H., & Yang, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3106442 · Cited by 44 · cited 2×
“Motivated by the remarkable performance of WSDDN [228], a series of remote sensing WSOD methods [229], [230], [231], [232], [233], [234], [235], [236], [237], [238], [239], [240], [241] are proposed.”
Method
Metadata
- Authors
- Zhang, X., Zhang, T., Wang, G., Zhu, P., Tang, X., Jia, X., & Jiao, L.
- Venue
- IEEE Geoscience and Remote Sensing Magazine
- Published
- 2023-12
- Volume
- 11
- Issue
- 4
- Pages
- 8-44
- ISSN
- 2168-6831 (ISSN-L)
- 2473-2397
- 2373-7468
- OpenAlex
- W4387918004
- Cited by
- 177
- References
- 36
- FWCI
- 19.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.