The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Small Object Detection in Unmanned Aerial Vehicle Images Using Feature Fusion and Scaling-Based Single Shot Detector With Spatial Context Analysis
Abstract
Objects in unmanned aerial vehicle (UAV) images are generally small due to the high-photography altitude. Although many efforts have been made in object detection, how to accurately and quickly detect small objects is still one of the remaining open challenges. In this paper, we propose a feature fusion and scaling-based single shot detector (FS-SSD) for small object detection in the UAV images. The FS-SSD is an enhancement based on FSSD, a variety of the original single shot multibox detector (SSD). We add an extra scaling branch of the deconvolution module with an average pooling operation to form a feature pyramid. The original feature fusion branch is adjusted to be better suited to the small object detection task. The two feature pyramids generated by the deconvolution module and feature fusion module are utilized to make predictions together. In addition to the deep features learned by the FS-SSD, to further improve the detection accuracy, spatial context analysis is proposed to incorporate the object spatial relationships into object redetection. The interclass and intraclass distances between different object instances are computed as a spatial context, which proves effective for multiclass small object detection. Six experiments are conducted on the PASCAL VOC dataset and the two UAV image datasets. The experimental results demonstrate that the proposed method can achieve a comparable detection speed but an accuracy superior to those of the six state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
(2016) · Cited by 31,590
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“In this way, the problem of gradient disappearance will be relieved, and training time will be shortened at the same time [33].”
BackgroundYOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“…include the following two phases: (1) at the training phase, the feature fusion and scaling-based single shot detector is pretrained on PASCAL VOC [25] and COCO datasets [26] and fine-tuned on the experimental UAV datasets; and (2) at the detection phase, small object detection is achieved by the…”
BackgroundYOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
A Multi-Modal Distributed Real-Time IoT System for Urban Traffic Control (Invited Paper)
Khanam, Z., Achari, V. P. S., Boukhennoufa, I., Jindal, A., & Singh, A. K. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.ng-res.2024.2 · Cited by 14,040
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Generative Adversarial Networks
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2661 · Cited by 4,477
Unmanned aerial systems for photogrammetry and remote sensing: A review
Colomina, I., & Molina, P. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2014.02.013 · Cited by 2,954
Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors
Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.351 · Cited by 2,743 · cited 2×
“Existing object detection methods are trade-offs between speed and accuracy [21].”
BackgroundMethodGenerative Adversarial Networks
(2022) · The Science of Deep Learning · doi:10.1017/9781108891530.013 · Cited by 2,402
DSSD : Deconvolutional Single Shot Detector
Fu, C.-Y., Liu, W., Ranga, A., Tyagi, A., & Berg, A. C. (2017) · arXiv · doi:10.48550/arxiv.1701.06659 · Cited by 1,624 · cited 2×
“Other deep learning-based detectors include two-stage detectors Faster R-CNN [17] and R-FCN [18], one-stage detectors SSD [20], DSSD513 [28] and YOLOv3 [41].”
MethodBar, M. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1476 · Cited by 1,613
Learning mid-level features for recognition
Boureau, Y.-L., Bach, F., LeCun, Y., & Ponce, J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539963 · Cited by 1,052
Learning Social Etiquette: Human Trajectory Understanding In Crowded Scenes
Robicquet, A., Sadeghian, A., Alahi, A., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_33 · Cited by 927
Drone-Based Object Counting by Spatially Regularized Regional Proposal Network
Hsieh, M.-R., Lin, Y.-L., & Hsu, W. H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.446 · Cited by 547
FSSD: Feature Fusion Single Shot Multibox Detector
Li, Z., Yang, L., & Zhou, F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.00960 · Cited by 373
Spatio-Temporal Flame Modeling and Dynamic Texture Analysis for Automatic Video-Based Fire Detection
Dimitropoulos, K., Barmpoutis, P., & Grammalidis, N. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2339592 · Cited by 262
A Statistical Model for General Contextual Object Recognition
Carbonetto, P., de Freitas, N., & Barnard, K. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_27 · Cited by 261
Bejiga, M., Zeggada, A., Nouffidj, A., & Melgani, F. (2017) · Remote Sensing · doi:10.3390/rs9020100 · Cited by 250
DetNet: A Backbone network for Object Detection
Li, Z., Peng, C., Yu, G., Zhang, X., Deng, Y. S., & Sun, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.06215 · Cited by 216
Weakly-Shared Deep Transfer Networks for Heterogeneous-Domain Knowledge Propagation
Shu, X., Qi, G.-J., Tang, J., & Wang, J. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806216 · Cited by 211
Object Recognition in Aerial Images Using Convolutional Neural Networks
Radovic, M., Adarkwa, O., & Wang, Q. (2017) · Journal of Imaging · doi:10.3390/jimaging3020021 · Cited by 201 · cited 1×
“…made great progress with the resurgence of variety deep networks, including deep belief networks (DBNs) [10], convolutional neural networks (CNNs) [11], generative adversarial networks (GANs) [12], deep transfer networks [13], [14], etc. CNNs are a category of neural networks that have proven…”
BackgroundDetecting Cars in UAV Images With a Catalog-Based Approach
Moranduzzo, T., & Melgani, F. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2296351 · Cited by 200
Efficient Feature Selection and Classification for Vehicle Detection
Wen, X., Shao, L., Fang, W., & Xue, Y. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2358031 · Cited by 178
Detecting and tracking vehicles in traffic by unmanned aerial vehicles
Wang, L., Chen, F., & Yin, H. (2016) · Automation in Construction · doi:10.1016/j.autcon.2016.05.008 · Cited by 166
Generalized Deep Transfer Networks for Knowledge Propagation in Heterogeneous Domains
Tang, J., Shu, X., Li, Z., Qi, G.-J., & Wang, J. (2016) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2998574 · Cited by 145
Application of Object Detection and Tracking Techniques for Unmanned Aerial Vehicles
Kamate, S., & Yilmazer, N. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.09.183 · Cited by 92
Object Detection at 200 Frames per Second
Mehta, R., & Öztürk, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11021-5_41 · Cited by 84
An enhanced SSD with feature fusion and visual reasoning for object detection
Leng, J., & Liu, Y. (2018) · Neural Computing and Applications · doi:10.1007/s00521-018-3486-1 · Cited by 83
Hierarchically Gated Deep Networks for Semantic Segmentation
Qi, G.-J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.249 · Cited by 76
Networked Drone Cameras for Sports Streaming
Wang, X., Chowdhery, A., & Chiang, M. (2017) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.200 · Cited by 57
Depth Estimation by Parameter Transfer With a Lightweight Model for Single Still Images
Qin, H., Li, X., Wang, Y., Zhang, Y., & Dai, Q. (2016) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2016.2580438 · Cited by 14
Cited by
Drone-Based RGB-Infrared Cross-Modality Vehicle Detection Via Uncertainty-Aware Learning
Sun, Y., Cao, B., Zhu, P., & Hu, Q. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3168279 · Cited by 693
Towards Large-Scale Small Object Detection: Survey and Benchmarks
Cheng, G., Yuan, X., Yao, X., Yan, K., Zeng, Q., Xie, X., & Han, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3290594 · Cited by 683
Poly Kernel Inception Network for Remote Sensing Detection
Cai, X., Lai, Q., Wang, Y., Wang, W., Sun, Z., & Yao, Y. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02617 · Cited by 548
Deep learning for unmanned aerial vehicle-based object detection and tracking: a survey
Wu, X., Li, W., Hong, D., Tao, R., & Du, Q. (2022) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2021.3115137 · Cited by 421
A Modified YOLOv8 Detection Network for UAV Aerial Image Recognition
Li, Y., Fan, Q., Huang, H., Han, Z., & Gu, Q. (2023) · Drones · doi:10.3390/drones7050304 · Cited by 415
Self-citation
Metadata
- Authors
- Liang, X., Zhang, J., Zhuo, L., Li, Y., & Tian, Q.
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2020-06
- Volume
- 30
- Issue
- 6
- Pages
- 1758-1770
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W2924873663
- Cited by
- 308
- References
- 42
- FWCI
- 8.16
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.