The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Vehicle Detection From UAV Imagery With Deep Learning: A Review
Abstract
Vehicle detection from unmanned aerial vehicle (UAV) imagery is one of the most important tasks in a large number of computer vision-based applications. This crucial task needed to be done with high accuracy and speed. However, it is a very challenging task due to many characteristics related to the aerial images and the used hardware, such as different vehicle sizes, orientations, types, density, limited datasets, and inference speed. In recent years, many classical and deep-learning-based methods have been proposed in the literature to address these problems. Handed engineering- and shallow learning-based techniques suffer from poor accuracy and generalization to other complex cases. Deep-learning-based vehicle detection algorithms achieved better results due to their powerful learning ability. In this article, we provide a review on vehicle detection from UAV imagery using deep learning techniques. We start by presenting the different types of deep learning architectures, such as convolutional neural networks, recurrent neural networks, autoencoders, generative adversarial networks, and their contribution to improve the vehicle detection task. Then, we focus on investigating the different vehicle detection methods, datasets, and the encountered challenges all along with the suggested solutions. Finally, we summarize and compare the techniques used to improve vehicle detection from UAV-based images, which could be a useful aid to researchers and developers to select the most adequate method for their needs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“Deeper, wider, and more efficient CNN architectures are proposed, over the years, after the success of the famous LeNet-5 [6].”
BackgroundYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203 · cited 1×
“Many data augmentation techniques are presented very well in [146].”
BackgroundSpatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00140 · Cited by 9,708
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356 · cited 1×
“such as MobileNet [23]–[25], SqueezeNet [26], ShuffleNet [27], [28], and PeleeNet [29].”
MethodDeep High-Resolution Representation Learning for Human Pose Estimation
Sun, K., Xiao, B., Liu, D., & Wang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00584 · Cited by 5,984
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
CornerNet: Detecting Objects as Paired Keypoints
Law, H., & Deng, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_45 · Cited by 3,852
DOTA: A Large-Scale Dataset for Object Detection in Aerial Images
Xia, G.-S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00418 · Cited by 3,414
Single-Shot Refinement Neural Network for Object Detection
Zhang, S., Wen, L., Bian, X., Lei, Z., & Li, S. Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00442 · Cited by 1,678
The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking
Du, D., Qi, Y., Yu, H., Yang, Y., Duan, K., Li, G., Zhang, W., Huang, Q., & Tian, Q. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_23 · Cited by 1,099
Cheng, G., Han, J., Zhou, P., & Guo, L. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2014.10.002 · Cited by 1,007
Perceptual Generative Adversarial Networks for Small Object Detection
Li, J., Liang, X., Wei, Y., Xu, T., Feng, J., & Yan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.211 · Cited by 953 · cited 1×
“GAN architecture can enhance the poor representations of tiny objects to super-resolved ones in the generator part to fool the discriminator part, which could improve small vehicle detection performance from high-altitude UAV imagery [45].”
BackgroundVehicle detection in aerial imagery : A small target detection benchmark
Razakarivony, S., & Jurie, F. (2016) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.11.002 · Cited by 916
Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images
Xu, J., Xiang, L., Liu, Q., Gilmore, H., Wu, J., Tang, J., & Madabhushi, A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2458702 · Cited by 854 · cited 1×
“There are various autoencoders types, such as convolutional autoencoder (CAE) [48], sparse autoencoder [49], deep autoencoder [50], and variational autoencoder [51].”
BackgroundDrone-Based Object Counting by Spatially Regularized Regional Proposal Network
Hsieh, M.-R., Lin, Y.-L., & Hsu, W. H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.446 · Cited by 547 · cited 2×
“Hsieh et al. [109] showed the effect of anchor box sizes and some other parameters on the performance of vehicle detection in UAV images.”
BackgroundZabalza, J., Ren, J., Zheng, J., Zhao, H., Qing, C., Yang, Z., Du, P., & Marshall, S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.11.044 · Cited by 389
A Large Contextual Dataset for Classification, Detection and Counting of Cars with Deep Learning
Mundhenk, T. N., Konjevod, G., Sakla, W. A., & Boakye, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_48 · Cited by 386
Some Improvements on Deep Convolutional Neural Network Based Image Classification
Howard, A. G. (2013) · arXiv · doi:10.48550/arxiv.1312.5402 · Cited by 356
Vision meets drones: A challenge
Zhu, P., Wen, L., Bian, X., Ling, H., & Hu, Q. (2018) · arXiv · doi:10.48550/arxiv.1804.07437 · Cited by 352
Car Detection using Unmanned Aerial Vehicles: Comparison between Faster R-CNN and YOLOv3
Benjdira, B., Khursheed, T., Koubaa, A., Ammar, A., & Ouni, K. (2019) · 2019 1st International Conference on Unmanned Vehicle Systems-Oman (UVS) · doi:10.1109/uvs.2019.8658300 · Cited by 307
Object Recognition in Aerial Images Using Convolutional Neural Networks
Radovic, M., Adarkwa, O., & Wang, Q. (2017) · Journal of Imaging · doi:10.3390/jimaging3020021 · Cited by 201 · cited 1×
“Radovic et al. [105] showed that a trained YOLO, with a suitable dataset and parameter settings, is able to detect vehicles and aircraft from low altitude and top view UAV images.”
BackgroundDeng, Z., Sun, H., Zhou, S., Zhao, J., & Zou, H. (2017) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2017.2694890 · Cited by 195
Car Detection from Low-Altitude UAV Imagery with the Faster R-CNN
Xu, Y., Yu, G., Wang, Y., Wu, X., & Ma, Y. (2017) · Journal of Advanced Transportation · doi:10.1155/2017/2823617 · Cited by 183
DroNet: Efficient convolutional neural network detector for real-time UAV applications
Kyrkou, C., Plastiras, G., Theocharides, T., Venieris, S. I., & Bouganis, C.-S. (2018) · 2018 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date.2018.8342149 · Cited by 148
Fast Deep Vehicle Detection in Aerial Images
Sommer, L. W., Schuchert, T., & Beyerer, J. (2017) · 2017 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2017.41 · Cited by 139 · cited 10×
“Moreover, Sommer et al. in their studies [96] and [123], show the impact of shallow architecture on small vehicle detection performance achieving an AP that varies between 82.5% and 95.2% on the VEDAI and DLR datasets (see Table III).”
BackgroundMethodResultInfluentialSimultaneously Detecting and Counting Dense Vehicles From Drone Images
Li, W., Li, H., Wu, Q., Chen, X., & Ngan, K. N. (2019) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2019.2899548 · Cited by 96 · cited 3×
“In many works, such as [78], [165], and [167], the authors showed that vehicle detection from lower altitudes achieves better accuracy than from higher altitudes.”
BackgroundMethodFast vehicle detection in UAV images
Tang, T., Deng, Z., Zhou, S., Lei, L., & Zou, H. (2017) · 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP) · doi:10.1109/rsip.2017.7958795 · Cited by 74
ZynqNet: An FPGA-Accelerated Embedded Convolutional Neural Network
Gschwend, D. (2020) · arXiv · doi:10.48550/arxiv.2005.06892 · Cited by 58 · cited 1×
“The UAV-Net is based on SSD architecture replacing VGG-16 with ZynqNet [153] and adapted to the unique characteristics of UAV imagery.”
MethodGuided attention network for object detection and counting on drones
YuanQiang, C., Du, D., Zhang, L., Wen, L., Wang, W., Wu, Y., & Lyu, S. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413816 · Cited by 58
Real-Time Traffic Analysis using Deep Learning Techniques and UAV based Video
Zhang, H., Liptrott, M., Bessis, N., & Cheng, J. (2019) · 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2019.8909879 · Cited by 52
Orientation- and Scale-Invariant Multi-Vehicle Detection and Tracking from Unmanned Aerial Videos
Wang, J., Simeonova, S., & Shahbazi, M. (2019) · Remote Sensing · doi:10.3390/rs11182155 · Cited by 50
Vehicle Detection Based on Drone Images with the Improved Faster R-CNN
Wang, L., Liao, J., & Xu, C. (2019) · Proceedings of the 2019 11th International Conference on Machine Learning and Computing · doi:10.1145/3318299.3318383 · Cited by 31
Acatay, O., Sommer, L., Schumann, A., & Beyerer, J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639127 · Cited by 28
Vehicle Detection in UAV Traffic Video Based on Convolution Neural Network
Li, S., Zhang, W., Li, G., Su, L., & Huang, Q. (2018) · 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2018.00009 · Cited by 12
Cited by
A Modified YOLOv8 Detection Network for UAV Aerial Image Recognition
Li, Y., Fan, Q., Huang, H., Han, Z., & Gu, Q. (2023) · Drones · doi:10.3390/drones7050304 · Cited by 415
Deep learning techniques to classify agricultural crops through UAV imagery: a review
Bouguettaya, A., Zarzour, H., Kechida, A., & Taberkit, A. M. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07104-9 · Cited by 314
Self-citation
Metadata
- Authors
- Bouguettaya, A., Zarzour, H., Kechida, A., & Taberkit, A. M.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2022-11
- Volume
- 33
- Issue
- 11
- Pages
- 6047-6067
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W3164012963
- Cited by
- 185
- References
- 50
- FWCI
- 9.70
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.