The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
SuperYOLO: Super Resolution Assisted Object Detection in Multimodal Remote Sensing Imagery
Open accessAbstract
Accurately and timely detecting multiscale small objects that contain tens of pixels from remote sensing images (RSI) remains challenging. Most of the existing solutions primarily design complex deep neural networks to learn strong feature representations for objects separated from the background, which often results in a heavy computation burden. In this article, we propose an accurate yet fast object detection method for RSI, named SuperYOLO, which fuses multimodal data and performs high-resolution (HR) object detection on multiscale objects by utilizing the assisted super resolution (SR) learning and considering both the detection accuracy and computation cost. First, we utilize a symmetric compact multimodal fusion (MF) to extract supplementary information from various data for improving small object detection in RSI. Furthermore, we design a simple and flexible SR branch to learn HR feature representations that can discriminate small objects from vast backgrounds with low-resolution (LR) input, thus further improving the detection accuracy. Moreover, to avoid introducing additional computation, the SR branch is discarded in the inference stage, and the computation of the network model is reduced due to the LR input. Experimental results show that, on the widely used VEDAI RS dataset, SuperYOLO achieves an accuracy of 75.09% (in terms of$\text {mA}{{\text {P}}_{{50}}}$), which is more than 10% higher than the SOTA large models, such as YOLOv5l, YOLOv5x, and RS designed YOLOrs. Meanwhile, the parameter size and GFLOPs of SuperYOLO are about$18\times $and$3.8\times $less than YOLOv5x. Our proposed model shows a favorable accuracy–speed tradeoff compared to the state-of-the-art models. The code will be open-sourced athttps://github.com/icey-zhang/SuperYOLO.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
A Multi-Modal Distributed Real-Time IoT System for Urban Traffic Control (Invited Paper)
Khanam, Z., Achari, V. P. S., Boukhennoufa, I., Jindal, A., & Singh, A. K. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.ng-res.2024.2 · Cited by 14,040
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
YOLOv4: Optimal Speed and Accuracy of Object Detection
Bochkovskiy, A., Wang, C.-Y., & Liao, H.-Y. M. (2020) · arXiv · doi:10.48550/arxiv.2004.10934 · Cited by 10,307
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
FCOS: Fully Convolutional One-Stage Object Detection
Tian, Z., Shen, C., Chen, H., & He, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00972 · Cited by 7,013
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
CSPNet: A New Backbone that can Enhance Learning Capability of CNN
Wang, C.-Y., Mark Liao, H.-Y., Wu, Y.-H., Chen, P.-Y., Hsieh, J.-W., & Yeh, I.-H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00203 · Cited by 5,265
Loss Functions for Image Restoration With Neural Networks
Zhao, H., Gallo, O., Frosio, I., & Kautz, J. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2644865 · Cited by 2,641
Zhang, S., Chi, C., Yao, Y., Lei, Z., & Li, S. Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00978 · Cited by 2,354
Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning
Elfwing, S., Uchibe, E., & Doya, K. (2018) · Neural Networks · doi:10.1016/j.neunet.2017.12.012 · Cited by 2,119
Learning RoI Transformer for Oriented Object Detection in Aerial Images
Ding, J., Xue, N., Long, Y., Xia, G.-S., & Lu, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00296 · Cited by 1,666
More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification
Hong, D., Gao, L., Yokoya, N., Yao, J., Chanussot, J., Du, Q., & Zhang, B. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3016820 · Cited by 1,374
Self-citationVehicle detection in aerial imagery : A small target detection benchmark
Razakarivony, S., & Jurie, F. (2016) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.11.002 · Cited by 916
Edge-Enhanced GAN for Remote Sensing Image Superresolution
Jiang, K., Wang, Z., Yi, P., Wang, G., Lu, T., & Jiang, J. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2902431 · Cited by 545
Multi-scale object detection in remote sensing imagery with convolutional neural networks
Deng, Z., Sun, H., Zhou, S., Zhao, J., Lei, L., & Zou, H. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.04.003 · Cited by 519
Multimodal Classification of Remote Sensing Images: A Review and Future Directions
Gomez-Chova, L., Tuia, D., Moser, G., & Camps-Valls, G. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2449668 · Cited by 508
Multiple Instance Detection Network with Online Instance Classifier Refinement
Tang, P., Wang, X., Bai, X., & Liu, W. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.326 · Cited by 496
Liu, Z., Wang, H., Weng, L., & Yang, Y. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2565705 · Cited by 439
R-CNN for Small Object Detection
Chen, C., Liu, M.-Y., Tuzel, O., & Xiao, J. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54193-8_14 · Cited by 392
Rabbi, J., Ray, N., Schubert, M., Chowdhury, S., & Chao, D. (2020) · Remote Sensing · doi:10.3390/rs12091432 · Cited by 359
Zheng, Z., Zhong, Y., Wang, J., & Ma, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00415 · Cited by 343
Density Map Guided Object Detection in Aerial Images
Li, C., Yang, T., Zhu, S., Chen, C., & Guan, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00103 · Cited by 311
Cross-modality attentive feature fusion for object detection in multispectral remote sensing imagery
Qingyun, F., & Zhaokui, W. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108786 · Cited by 303
Wang, P., Sun, X., Diao, W., & Fu, K. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2954328 · Cited by 283
The Effects of Super-Resolution on Object Detection Performance in Satellite Imagery
Shermeyer, J., & Van Etten, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00184 · Cited by 279
$\mathcal{R}^2$ -CNN: Fast Tiny Object Detection in Large-Scale Remote Sensing Images
Pang, J., Li, C., Shi, J., Xu, Z., & Feng, H. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2899955 · Cited by 261
Noh, J., Bae, W., Lee, W., Seo, J., & Kim, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00982 · Cited by 257
Oriented objects as pairs of middle lines
Wei, H., Zhang, Y., Chang, Z., Li, H., Wang, H., & Sun, X. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.09.022 · Cited by 256
Dual Super-Resolution Learning for Semantic Segmentation
Wang, L., Li, D., Zhu, Y., Tian, L., & Shan, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00383 · Cited by 231
Multimodal Object Detection via Probabilistic Ensembling
Chen, Y.-T., Shi, J., Ye, Z., Mertz, C., Ramanan, D., & Kong, S. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20077-9_9 · Cited by 225
Task-Driven Super Resolution: Object Detection in Low-Resolution Images
Haris, M., Shakhnarovich, G., & Ukita, N. (2021) · Communications in Computer and Information Science · doi:10.1007/978-3-030-92307-5_45 · Cited by 200
YOLOrs: Object Detection in Multimodal Remote Sensing Imagery
Sharma, M., Dhanaraj, M., Karnam, S., Chachlakis, D. G., Ptucha, R., Markopoulos, P. P., & Saber, E. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3041316 · Cited by 193
Gao, Y., Li, W., Zhang, M., Wang, J., Sun, W., Tao, R., & Du, Q. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3097093 · Cited by 188
Self-citationYOLO-Fine: One-Stage Detector of Small Objects Under Various Backgrounds in Remote Sensing Images
Pham, M.-T., Courtrai, L., Friguet, C., Lefèvre, S., & Baussard, A. (2020) · Remote Sensing · doi:10.3390/rs12152501 · Cited by 173
Asymmetric Feature Fusion Network for Hyperspectral and SAR Image Classification
Li, W., Gao, Y., Zhang, M., Tao, R., & Du, Q. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3149394 · Cited by 168
Self-citationXiao, Y., Su, X., Yuan, Q., Liu, D., Shen, H., & Zhang, L. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3107352 · Cited by 160
Courtrai, L., Pham, M., & Lefèvre, S. (2020) · Remote Sensing · doi:10.3390/rs12193152 · Cited by 149
Deep Multimodal Fusion Network for Semantic Segmentation Using Remote Sensing Image and LiDAR Data
Sun, Y., Fu, Z., Sun, C., Hu, Y., & Zhang, S. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3108352 · Cited by 115
Adaptive Knowledge Distillation for Lightweight Remote Sensing Object Detectors Optimizing
Yang, Y., Sun, X., Diao, W., Li, H., Wu, Y., Li, X., & Fu, K. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3175213 · Cited by 105
Ultra-dense GAN for satellite imagery super-resolution
Wang, Z., Jiang, K., Yi, P., Han, Z., & He, Z. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.03.106 · Cited by 96
Vehicle Detection in Remote Sensing Images Leveraging on Simultaneous Super-Resolution
Ji, H., Gao, Z. Y., Mei, T., & Ramesh, B. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2930308 · Cited by 90
A spatial-channel progressive fusion ResNet for remote sensing classification
Zhu, H., Ma, M., Ma, W., Jiao, L., Hong, S., Shen, J., & Hou, B. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.12.008 · Cited by 90
Razzak, M. T., Mateo‐García, G., Lécuyer, G., Gómez‐Chova, L., Gal, Y., & Kalaitzis, F. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.10.019 · Cited by 88
Multimodal feature-wise co-attention method for visual question answering
Zhang, S., Chen, M., Chen, J., Zou, F., Li, Y.-F., & Lü, P. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.022 · Cited by 73
Self-citationEF-Net: A novel enhancement and fusion network for RGB-D saliency detection
Chen, Q., Fu, K., Liu, Z., Chen, G., Du, H., Qiu, B., & Shao, L. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107740 · Cited by 65
Cited by
FFCA-YOLO for Small Object Detection in Remote Sensing Images
Zhang, Y., Ye, M., Zhu, G., Liu, Y., Guo, P., & Yan, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3363057 · Cited by 410
Small Object Detection Algorithm Based on Improved YOLOv8 for Remote Sensing
Yi, H., Liu, B., Zhao, B., & Liu, E. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3339235 · Cited by 310
Metadata
- Authors
- Zhang, J., Lei, J., Xie, W., Fang, Z., Li, Y., & Du, Q.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2023
- Volume
- 61
- Pages
- 1-15
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W4327785494
- Cited by
- 388
- References
- 59
- FWCI
- 35.28
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.