Object Detection With Deep Learning: A Review
Open accessThe DOI matches its Crossref record; 252 of the 252 references it cites were found in a registry or an index.
Abstract
Due to object detection's close relationship with video analysis and image understanding, it has attracted much research attention in recent years. Traditional object detection methods are built on handcrafted features and shallow trainable architectures. Their performance easily stagnates by constructing complex ensembles that combine multiple low-level image features with high-level context from object detectors and scene classifiers. With the rapid development in deep learning, more powerful tools, which are able to learn semantic, high-level, deeper features, are introduced to address the problems existing in traditional architectures. These models behave differently in network architecture, training strategy, and optimization function. In this paper, we provide a review of deep learning-based object detection frameworks. Our review begins with a brief introduction on the history of deep learning and its representative tool, namely, the convolutional neural network. Then, we focus on typical generic object detection architectures along with some modifications and useful tricks to improve detection performance further. As distinct specific detection tasks exhibit different characteristics, we also briefly survey several specific tasks, including salient object detection, face detection, and pedestrian detection. Experimental analyses are also provided to compare various methods and draw some meaningful conclusions. Finally, several promising directions and tasks are provided to serve as guidelines for future work in both object detection and relevant neural network-based learning systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We ensure that these “hard” candidate genes are included in the candidate list for each patient during training, as using such “hard” examples tends to improve the efficiency of training113.”
From Few shot learning for phenotype-driven diagnosis of patients with rare genetic diseases (2025) · cites this paper as [113]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This capability makes YOLO exceptionally well-suited for applications requiring rapid decision-making, such as autonomous driving, medical diagnostics, and surveillance systems [8,9].”
From The YOLO Framework: A Comprehensive Review of Evolution, Applications, and Benchmarks in Object Detection (2024) · cites this paper as [8]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Although great progress has been reported with respect to accuracy in object detection and recognition [173], current systems are mainly designed to calculate 2D or 3D bounding boxes for a couple of trained object classes, or to provide a segmented image of the driving environment.”
From A survey of deep learning techniques for autonomous driving (2020) · cites this paper as [173]
The cited source says what the claim attributes to it.
In the citing paper
“Deep learning methods are more effective and accurate, and they perform better in complex environments to detect objects [11].”
From Fusion of Deep Sort and Yolov5 for Effective Vehicle Detection and Tracking Scheme in Real-Time Traffic Management Sustainable System (2023) · cites this paper as [11]
In the citing paper
“Deep Compression uses three steps, prunning, quantization, and Huffman Encoding, to compress over-parameterized DNN models, such as VGG [77], AlexNet [1].”
From Bringing ai to edge: from deep learning’s perspective (2022) · cites this paper as [75]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 11×
“Recent state-of-the-art image classification networks, such as ResNets [47] and GoogLeNets [45], [93], are fully convolutional.”
BackgroundMethodInfluentialVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 18×
“A typical CNN architecture, which is referred to as VGG16, can be found in Figure 2.”
BackgroundMethodInfluentialImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 15×
“To address the problem of limited training data, Kummerer et al. [134] proposed the Deep Gaze by transferring from the AlexNet to generate a high-dimensional feature space and create a saliency map.”
BackgroundMethodInfluentialLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 6×
“1) The emergence of large-scale annotated training data, such as ImageNet [39], to fully exhibit its very large learning capacity.”
BackgroundMethodInfluentialCortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589 · cited 2×
“This is due to the fact that these features can produce representations associated with complex cells in human brain [19].”
BackgroundYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 23×
“3) SSD: YOLO has a difficulty in dealing with small objects in groups, which is caused by strong spatial constraints imposed on bounding box predictions [18].”
BackgroundMethodInfluential
Research works printed but not linked: 8
- [177] I. A. Kalinovsky and V. G. Spitsyn, 'Compact convolutional neural network cascadefor face detection,' in CEUR Workshop , 2016. -
- markuš, 2013, Object detection with pixel intensity comparisons organized in decision trees
- [80] P. Kr¨ ahenb¨ uhl and V. Koltun, 'Geodesic object proposals,' in ECCV , 2014. -
- [81] P. Arbel´ aez, J. Pont-Tuset, J. T. Barron, F. Marques, and J. Malik, 'Multiscale combinatorial grouping,' in CVPR , 2014. -
- [196] Y. Tian, P. Luo, X. Wang, and X. Tang, 'Deep learning strong parts for pedestrian detection,' in CVPR , 2015. - · DOI · Paper page
- [1] P. F. Felzenszwalb, R. B. Girshick, D. Mcallester, and D. Ramanan, 'Object detection with discriminatively trained part-based models,' IEEE Trans. Pattern Anal. Mach. Intell. , vol. 32, no. 9, p. 1627, 2010. - · DOI · Paper page
- [16] R. Girshick, 'Fast r-cnn,' in ICCV , 2015. -
- everingham, 2011, The pascal visual object classes challenge 2012 (voc2012) results (2012)
Cited by
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
Object Detection in 20 Years: A Survey
Zou, Z., Chen, K., Shi, Z., Guo, Y., & Ye, J. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3238524 · Cited by 3,689
“SPPNet [17], Fast RCNN [18], Faster RCNN [19], YOLO [20], [21], [22], SSD [23], FPN [24], Retina-Net [25], CornerNet [26], CenterNet [27], and”
A Review of Yolo Algorithm Developments
Jiang, P., Ergu, D., Liu, F., Cai, Y., & Ma, B. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.01.135 · Cited by 2,783
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
A survey of deep learning techniques for autonomous driving
Grigorescu, S., Trasnea, B., Cocias, T., & Macesanu, G. (2020) · Journal of Field Robotics · doi:10.1002/rob.21918 · Cited by 1,809
“Although great progress has been reported with respect to accuracy in object detection and recognition [173], current systems are mainly designed to calculate 2D or 3D bounding boxes for a couple of trained object classes, or to provide a segmented image of the driving environment.”
BackgroundA survey on deep learning and its applications
Dong, S., Wang, P., & Abbas, K. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100379 · Cited by 1,800
A Survey on Performance Metrics for Object-Detection Algorithms
Padilla, R., Netto, S. L., & da Silva, E. A. B. (2020) · 2020 International Conference on Systems, Signals and Image Processing (IWSSIP) · doi:10.1109/iwssip48289.2020.9145130 · Cited by 1,605
“…Scales: The AR is determined for objects in the same three different sizes as in the AP Across Scales, usually reported as AR-S, AR-M, and AR-L, respectively; Tables II and III present results obtained by different object detectors for the COCO and PASCAL VOC challenges, as given in [20], [38].”
ResultStudy on artificial intelligence: The state of the art and future prospects
Zhang, C., & Lu, Y. (2021) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2021.100224 · Cited by 1,066
Multiple object tracking: A literature review
Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., & Kim, T.-K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2020.103448 · Cited by 1,099
A survey of modern deep learning based object detection models
Zaidi, S. S. A., Ansari, M. S., Aslam, A., Kanwal, N., Asghar, M., & Lee, B. (2022) · Digital Signal Processing · doi:10.1016/j.dsp.2022.103514 · Cited by 977
Gliding Vertex on the Horizontal Bounding Box for Multi-Oriented Object Detection
Xu, Y., Fu, M., Wang, Q., Wang, Y., Chen, K., Xia, G.-S., & Bai, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2974745 · Cited by 1,014
“4. Finally, we conclude and give some perspectives in Section 5. 2 RELATED WORK We first review some representative general object detection methods in Section 2.1. The interested readers can refer to [13] for a more complete review. Some specific and related tasks of object detection are then shortly reviewed in Sectio…”
MethodInfluentialRecent advances in deep learning for object detection
Wu, X., Sahoo, D., & Hoi, S. C. H. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.085 · Cited by 1,047
Self-citationFan, D.-P., Ji, G.-P., Sun, G., Cheng, M.-M., Shen, J., & Shao, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00285 · Cited by 896
“As suggested in [79], objects can be roughly divided into three categories: generic objects , salient objects , and cam-ouflaged objects .”
BackgroundDeep semantic segmentation of natural and medical images: a review
Asgari Taghanaki, S., Abhishek, K., Cohen, J. P., Cohen-Adad, J., & Hamarneh, G. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09854-1 · Cited by 870
“Similarly, there are several surveys covering the literature on the task of object detection (Wang et al., 2019c; Zou et al., 2019; Borji et al., 2019; Liu et al., 2019b; Zhao et al., 2019), which can also be used to obtain what can be termed as rough localizations of the object(s) of interest.”
BackgroundState of the Art in Defect Detection Based on Machine Vision
Ren, Z., Fang, F., Yan, N., & Wu, Y. (2022) · International Journal of Precision Engineering and Manufacturing-Green Technology · doi:10.1007/s40684-021-00343-6 · Cited by 799
Fan, D.-P., Ji, G.-P., Cheng, M.-M., & Shao, L. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3085766 · Cited by 779
“lowing [10], we roughly divide object detection into three categories: generic, salient, and concealed object detection.”
BackgroundTaye, M. M. (2023) · Computation · doi:10.3390/computation11030052 · Cited by 629
Applications of deep learning in stock market prediction: Recent progress
Jiang, W. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115537 · Cited by 714
“…network family, deep learning has achieved a tremendous success in the past few years, for many different applications including image classification (Rawat & Wang, 2017; Jiang & Zhang, 2020), object detection (Zhao et al., 2019), time series prediction (Brownlee, 2018; Jiang & Zhang, 2018), etc.”
BackgroundMethodZhang, A., Lipton, Z. C., Mu, L., & Smola, A. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.11342 · Cited by 76
“What are their major differences? You may refer to Figure 2 of (Zhao et al., 2019).”
BackgroundArtificial intelligence in the creative industries: a review
Anantrasirichai, N., & Bull, D. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10039-7 · Cited by 793
“erent objects in a image or a video giving their bounding boxes, classes and pixel-level masks, as demonstrated in [169]. An in-depth review of object recognition using deep learning can be found in [273] and [184]. YOLO and its variants represent the current state-of-the-art in real-time object detection and tracking…”
BackgroundA Brief Review of Domain Adaptation
Farahani, A., Voghoei, S., Rasheed, K., & Arabnia, H. R. (2021) · Transactions on Computational Science and Computational Intelligence · doi:10.1007/978-3-030-71704-9_65 · Cited by 615
A Comparative Analysis of Object Detection Metrics with a Companion Open-Source Toolkit
Padilla, R., Passos, W. L., Dias, T. L. B., Netto, S. L., & da Silva, E. A. B. (2021) · Electronics · doi:10.3390/electronics10030279 · Cited by 735
“In the last decade, the use of deep neural networks (DNNs) has completely changed the landscape of the computer vision field [22].”
BackgroundYang, G., Ye, Q., & Xia, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.07.016 · Cited by 717
Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions
Muhammad, K., Ullah, A., Lloret, J., Ser, J. D., & de Albuquerque, V. H. C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3032227 · Cited by 659
Towards Large-Scale Small Object Detection: Survey and Benchmarks
Cheng, G., Yuan, X., Yao, X., Yan, K., Zeng, Q., Xie, X., & Han, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3290594 · Cited by 683
“Quite a number of surveys about object detection have been published in recent years [13], [14], [15], [16], [17], [18], [19], [20], [21], [22], [23], [24], and our review differs from the existing ones mainly in two aspects.”
BackgroundImage-Adaptive YOLO for Object Detection in Adverse Weather Conditions
Liu, W., Ren, G., Yu, R., Guo, S., Zhu, J., & Zhang, L. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20072 · Cited by 604
A survey and performance evaluation of deep learning methods for small object detection
Liu, Y., Sun, P., Wergeles, N., & Shang, Y. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114602 · Cited by 665
A Survey of Visual Transformers
Liu, Y., Zhang, Y., Wang, Y., Hou, F., Yuan, J., Tian, J., Zhang, Y., Shi, Z., Fan, J., & He, Z. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3227717 · Cited by 549
“1) The Original Detectors: DEtection with TRansformer (DETR) [30] is the first end-to-end Transformer detector that eliminates hand-designed representations [181]–[184] and non-maximum suppression (NMS) post-processing, which redefines the object detection as a set prediction problem.”
MethodDeep Learning for LiDAR Point Clouds in Autonomous Driving: A Review
Li, Y., Ma, L., Zhong, Z., Liu, F., Chapman, M. A., Cao, D., & Li, J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3015992 · Cited by 611
Recent advances in small object detection based on deep learning: A review
Tong, K., Wu, Y., & Zhou, F. (2020) · Image and Vision Computing · doi:10.1016/j.imavis.2020.103910 · Cited by 592
A review of object detection based on deep learning
Xiao, Y., Tian, Z., Yu, J., Zhang, Y., Liu, S., Du, S., & Lan, X. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08976-6 · Cited by 584
“These include two published review papers, Deep Learning for Generic Object Detection: A Survey [147] and Object Detection with Deep Learning: A Review [285].”
BackgroundYOLO v3-Tiny: Object Detection and Recognition using one stage improved model
Adarsh, P., Rathi, P., & Kumar, M. (2020) · 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS) · doi:10.1109/icaccs48705.2020.9074315 · Cited by 545
“Therefore its speed is quite good in contrast to RCNN [15].”
BackgroundMethodResultInfluentialA comprehensive survey on applications of transformers for deep learning tasks
Islam, S., Elmekki, H., Elsebai, A., Bentahar, J., Drawel, N., Rjoub, G., & Pedrycz, W. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122666 · Cited by 487
Deep learning for chest X-ray analysis: A survey
Çallı, E., Sogancioglu, E., van Ginneken, B., van Leeuwen, K. G., & Murphy, K. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102125 · Cited by 506
YOLO-based Object Detection Models: A Review and its Applications
Vijayakumar, A., & Vairavasundaram, S. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-18872-y · Cited by 470
“Dividing the entire image into a small grid and making a predictions directly within every grid cell, YOLO achieved impressive real-time processing capabilities, making it particularly advantageous for applications requiring swift and accurate identification of objects in dynamic environments [4].”
Application of deep learning algorithms in geotechnical engineering: a short critical review
Zhang, W., Li, H., Li, Y., Liu, H., Chen, Y., & Ding, X. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-09967-1 · Cited by 538
Du, G., Wang, K., Lian, S., & Zhao, K. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09888-5 · Cited by 475
A comprehensive review of object detection with deep learning
Kaur, R., & Singh, S. (2023) · Digital Signal Processing · doi:10.1016/j.dsp.2022.103812 · Cited by 539
A review on deep learning in UAV remote sensing
Osco, L. P., Marcato Junior, J., Marques Ramos, A. P., de Castro Jorge, L. A., Fatholahi, S. N., de Andrade Silva, J., Matsubara, E. T., Pistori, H., Gonçalves, W. N., & Li, J. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102456 · Cited by 458
“Object detection methods can be described into two mainstream categories: one-stage detectors (or regression-based methods) and two-stage detectors (or region proposal-based methods) [212, 126, 195].”
BackgroundMethodA Deep Collocation Method for the Bending Analysis of Kirchhoff Plate
Guo, H., Zhuang, X., & Rabczuk, T. (2019) · Computers, Materials & Continua · doi:10.32604/cmc.2019.06660 · Cited by 466
“Several types of deep neural networks such as convolutional neural networks (CNN) and recurrent/recursive neural networks (RNN) [16] have been created, which further boost the application of deep learning in image processing [17], object detection [18], speech recognition [19] and many other domains including genomics…”
BackgroundWu, D., Lv, S., Jiang, M., & Song, H. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105742 · Cited by 496
A review of deep learning with special emphasis on architectures, applications and recent trends
Sengupta, S., Basak, S., Saikia, P., Paul, S., Tsalavoutis, V., Atiah, F., Ravi, V., & Peters, A. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105596 · Cited by 454
Deep Learning for Change Detection in Remote Sensing Images: Comprehensive Review and Meta-Analysis
Khelifi, L., & Mignotte, M. (2020) · IEEE Access · doi:10.1109/access.2020.3008036 · Cited by 441
“The first approach consists of using the outputs of one or more layers of a network (such as AlexNet or resnet-101) trained on a different task as generic high dimensional feature detectors and training a new shallow model based on these features [99].”
MethodDeep learning in ECG diagnosis: A review
Liu, X., Wang, H., Li, Z., & Qin, L. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107187 · Cited by 436
Li, L., Rong, S., Wang, R., & Yu, S. (2021) · Chemical Engineering Journal · doi:10.1016/j.cej.2020.126673 · Cited by 441
A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
Mienye, I. D., & Swart, T. G. (2024) · Information · doi:10.3390/info15120755 · Cited by 330
“Unlike image classification, which assigns a single label to an entire image, object detection provides both the category and the bounding box for each object in the image [110,111].”
Dais, D., Bal, İ. E., Smyrou, E., & Sarhosis, V. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103606 · Cited by 429
“Deep Learning (DL), which is a subfield of artificial intelligence, and its representative tool, namely Convolutional Neural Network (CNN) have proven their efficacy in object detection [8].”
BackgroundVisual-Based Defect Detection and Classification Approaches for Industrial Applications—A SURVEY
Czimmermann, T., Ciuti, G., Milazzo, M., Chiurazzi, M., Roccella, S., Oddo, C. M., & Dario, P. (2020) · Sensors · doi:10.3390/s20051459 · Cited by 441
“Deep learning is one of fastest growing fields in computer sciences, due to its ability to solve highly complex problems [208].”
BackgroundZhuang, X., Guo, H., Alajlan, N., Zhu, H., & Rabczuk, T. (2021) · European Journal of Mechanics - A/Solids · doi:10.1016/j.euromechsol.2021.104225 · Cited by 430
Thin MobileNet: An Enhanced MobileNet Architecture
Sinha, D., & El-Sharkawy, M. (2019) · 2019 IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON) · doi:10.1109/uemcon47517.2019.8993089 · Cited by 379
“In realtime applications such as image classification [8], captioning [9], object detection [10,23,33] and semantic segmentation [34] in autonomous driving, the inference time and accuracy are very important factors to one's safety.”
BackgroundDeep Learning Meets SAR: Concepts, models, pitfalls, and perspectives
Zhu, X. X., Montazeri, S., Ali, M., Hua, Y., Wang, Y., Mou, L., Shi, Y., Xu, F., & Bamler, R. (2021) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2020.3046356 · Cited by 357
Salvi, M., Acharya, U. R., Molinari, F., & Meiburger, K. M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104129 · Cited by 386
“…the benefit of automatically learning high-level useful features directly without having to extract handcrafted features, and has a hierarchical feature representation, allowing these multilevel representations from a pixel to high-level semantic features which are learned automatically [3,4].”
BackgroundBouwmans, T., Javed, S., Sultana, M., & Jung, S. K. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.024 · Cited by 396
Convolutional Neural Networks for Image-Based High-Throughput Plant Phenotyping: A Review
Jiang, Y., & Li, C. (2020) · Plant Phenomics · doi:10.34133/2020/4152816 · Cited by 380
“The second issue involved the detection of small-sized objects, which is also a common challenge for CNN-based object detection methods [20].”
BackgroundComparative analysis of deep learning image detection algorithms
Srivastava, S., Divekar, A. V., Anilkumar, C., Naik, I., Kulkarni, V., & Pattabiraman, V. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00434-w · Cited by 350
Deep Learning for Medical Image-Based Cancer Diagnosis
Jiang, X., Hu, Z., Wang, S., & Zhang, Y. (2023) · Cancers · doi:10.3390/cancers15143608 · Cited by 345
Welikala, R. A., Remagnino, P., Lim, J. H., Chan, C. S., Rajendran, S., Kallarakkal, T. G., Zain, R. B., Jayasinghe, R. D., Rimal, J., Kerr, A. R., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3010180 · Cited by 372
“Object detection refers to a process in computer vision that determines where objects are located in a given image (normally with a bounding box) and which class each object belongs to [37].”
BackgroundHoeser, T., & Kuenzer, C. (2020) · Remote Sensing · doi:10.3390/rs12101667 · Cited by 366
Prediction of groundwater quality using efficient machine learning technique
Singha, S., Pasupuleti, S., Singha, S. S., Singh, R., & Kumar, S. (2021) · Chemosphere · doi:10.1016/j.chemosphere.2021.130265 · Cited by 383
Deep learning in food category recognition
Zhang, Y., Deng, L., Zhu, H., Wang, W., Ren, Z., Zhou, Q., Lu, S., Sun, S., Zhu, Z., Gorriz, J. M., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101859 · Cited by 357
Vision-based vehicle detection and counting system using deep learning in highway scenes
Song, H., Liang, H., Li, H., Dai, Z., & Yun, X. (2019) · European Transport Research Review · doi:10.1186/s12544-019-0390-4 · Cited by 413
“CNNs have a strong ability to learn image features and can perform multiple related tasks, such as classification and bounding box regression [8].”
BackgroundRabbi, J., Ray, N., Schubert, M., Chowdhury, S., & Chao, D. (2020) · Remote Sensing · doi:10.3390/rs12091432 · Cited by 359
Ali, M. L., & Zhang, Z. (2024) · Computers · doi:10.3390/computers13120336 · Cited by 383
“This capability makes YOLO exceptionally well-suited for applications requiring rapid decision-making, such as autonomous driving, medical diagnostics, and surveillance systems [8,9].”
Object Detection Using Deep Learning, CNNs and Vision Transformers: A Review
Amjoud, A. B., & Amrouch, M. (2023) · IEEE Access · doi:10.1109/access.2023.3266093 · Cited by 318
Cucumber leaf disease identification with global pooling dilated convolutional neural network
Zhang, S., Zhang, S., Zhang, C., Wang, X., & Shi, Y. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.03.012 · Cited by 354
Chen, G., Wang, H., Chen, K., Li, Z., Song, Z., Liu, Y., Chen, W., & Knoll, A. (2022) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3005231 · Cited by 354
A survey on deep learning in medicine: Why, how and when?
Piccialli, F., Somma, V. D., Giampaolo, F., Cuomo, S., & Fortino, G. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.09.006 · Cited by 348
Visual attention methods in deep learning: An in-depth survey
Hassanin, M., Anwar, S., Radwan, I., Khan, F. S., & Mian, A. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102417 · Cited by 317
Centralized Feature Pyramid for Object Detection
Quan, Y., Zhang, D., Zhang, L., & Tang, J. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3297408 · Cited by 342
A fast accurate fine-grain object detection model based on YOLOv4 deep neural network
Roy, A. M., Bose, R., & Bhaduri, J. (2022) · Neural Computing and Applications · doi:10.1007/s00521-021-06651-x · Cited by 332
“2) with existing state-of-the-art models for object detection [54].”
BackgroundObject Detection Algorithm Based on Improved YOLOv3
Zhao, L., & Li, S. (2020) · Electronics · doi:10.3390/electronics9030537 · Cited by 344
“Deep learning uses low-level features to form more abstractive high-level features, and to hierarchically represent the data in order to improve object detection [10].”
BackgroundDeep learning-based object detection in low-altitude UAV datasets: A survey
Mittal, P., Singh, R., & Sharma, A. (2020) · Image and Vision Computing · doi:10.1016/j.imavis.2020.104046 · Cited by 342
Monocular depth estimation based on deep learning: An overview
Zhao, C., Sun, Q., Zhang, C., Tang, Y., & Qian, F. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1582-8 · Cited by 310
“etc, and related well-written overviews can be found in [23], [24], [25], [26].”
BackgroundRecent Advances in Crop Disease Detection Using UAV and Deep Learning Techniques
Shahi, T. B., Xu, C.-Y., Neupane, A., & Guo, W. (2023) · Remote Sensing · doi:10.3390/rs15092450 · Cited by 295
“Object detection is one of the most investigated tasks in the computer vision field [120].”
BackgroundRGB-D salient object detection: A survey
Zhou, T., Fan, D.-P., Cheng, M.-M., Shen, J., & Shao, L. (2021) · Computational Visual Media · doi:10.1007/s41095-020-0199-z · Cited by 331
Punn, N. S., Sonbhadra, S. K., Agarwal, S., & Rai, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.01385 · Cited by 237
“In the last decade, convolutional neural networks (CNN), region-based CNN [36] and faster region-based CNN [37] used region proposal techniques to generate the objectness score prior to its classification and later generates the bounding boxes around the object of interest for visualization and…”
BackgroundMethodEcoffet, A., Huizinga, J., Lehman, J., Stanley, K. O., & Clune, J. (2021) · Nature · doi:10.1038/s41586-020-03157-9 · Cited by 330
Sheng, T. J., Islam, M. S., Misran, N., Baharuddin, M. H., Arshad, H., Islam, M. R., Chowdhury, M. E. H., Rmili, H., & Islam, M. T. (2020) · IEEE Access · doi:10.1109/access.2020.3016255 · Cited by 295
“It is capable of speech recognition [12], image classification [13], object detection [14], text classification [15], etc.”
BackgroundFukuda, M., Inamoto, K., Shibata, N., Ariji, Y., Yanashita, Y., Kutsuna, S., Nakata, K., Katsumata, A., Fujita, H., & Ariji, E. (2020) · Oral Radiology · doi:10.1007/s11282-019-00409-x · Cited by 305
VLP: A Survey on Vision-language Pre-training
Chen, F.-L., Zhang, D.-Z., Han, M.-L., Chen, X.-Y., Shi, J., Xu, S., & Xu, B. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1369-5 · Cited by 279
“In addition, there are some image-related downstream tasks for evaluating the image-text pre-training models, including semantic segmentation[101, 102], and object detection[103, 104].”
BackgroundSelf-citationDeep learning in multi-object detection and tracking: state of the art
Pal, S. K., Pramanik, A., Maiti, J., & Mitra, P. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02293-7 · Cited by 298
Tools and Technologies for Blind and Visually Impaired Navigation Support: A Review
Kuriakose, B., Shrestha, R., & Sandnes, F. E. (2022) · IETE Technical Review · doi:10.1080/02564602.2020.1819893 · Cited by 267
Roy, A. M., & Bhaduri, J. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.102007 · Cited by 269
Unsupervised Domain Adaptation of Object Detectors: A Survey
Oza, P., Sindagi, V. A., VS, V., & Patel, V. M. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3217046 · Cited by 313
“There are a variety of surveys [87], [88], [89] on the topic covering wide range of techniques proposed over the past decade for object detection.”
BackgroundFedVision: An Online Visual Object Detection Platform Powered by Federated Learning
Liu, Y., Huang, A., Luo, Y., Huang, H., Liu, Y., Chen, Y., Feng, L., Chen, T., Yu, H., & Yang, Q. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i08.7021 · Cited by 310
Anomaly Detection in Univariate Time-series: A Survey on the State-of-the-Art
Braei, M., & Wagner, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.00433 · Cited by 152
“CNNs are mainly used in computer vision for tasks like object detection, classification and segmentation [50, 76, 99].”
MethodTraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactions
Chandra, R., Bhattacharya, U., Bera, A., & Manocha, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00868 · Cited by 235
“Alternatively, Convolutional Neural Networks (CNNs or ConvNets) have also been successfully used in many computer vision applications like object recognition [38].”
MethodA Comprehensive Systematic Review of YOLO for Medical Object Detection (2018 to 2023)
Ragab, M. G., Abdulkadir, S. J., Muneer, A., Alqushaibi, A., Sumiea, E. H., Qureshi, R., Al-Selwi, S. M., & Alhussian, H. (2024) · IEEE Access · doi:10.1109/access.2024.3386826 · Cited by 306
“Accurate and efficient object detection algorithms are essential for assisting healthcare professionals in diagnosing and treating various medical conditions [16]– [18].”
BackgroundLi, X., Li, C., Rahaman, M. M., Sun, H., Li, X., Wu, J., Yao, Y., & Grzegorzek, M. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10121-0 · Cited by 278
Deep learning as a tool for ecology and evolution
Borowiec, M. L., Dikow, R. B., Frandsen, P. B., McKeeken, A., Valentini, G., & White, A. E. (2022) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13901 · Cited by 249
“The many proposed solutions involve either extracting candidate regions from images prior to prediction or predicting classes directly on grids of image pixels (Zhao et al., 2019).”
BackgroundMedical deep learning—A systematic meta-review
Egger, J., Gsaxner, C., Pepe, A., Pomykala, K. L., Jonske, F., Kurz, M., Li, J., & Kleesiek, J. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106874 · Cited by 251
Deep Learning for Smart Healthcare—A Survey on Brain Tumor Detection from Medical Imaging
Arabahmadi, M., Farahbakhsh, R., & Rezazadeh, J. (2022) · Sensors · doi:10.3390/s22051960 · Cited by 253
“Generic object detection aims to locate and classify images and label them with rectangular bounding boxes to show the confidence of the entity [47].”
BackgroundFernandes, D., Silva, A., Névoa, R., Simões, C., Gonzalez, D., Guevara, M., Novais, P., Monteiro, J., & Melo-Pinto, P. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.11.002 · Cited by 268
“It has shown that deep architectures lead to more accurate models [21], [97].”
BackgroundAn enhanced CNN-enabled learning method for promoting ship detection in maritime surveillance system
Liu, R. W., Yuan, W., Chen, X., & Lu, Y. (2021) · Ocean Engineering · doi:10.1016/j.oceaneng.2021.109435 · Cited by 269
Roy, A. M., Bhaduri, J., Kumar, T., & Raj, K. (2023) · Ecological Informatics · doi:10.1016/j.ecoinf.2022.101919 · Cited by 257
Yeh, C.-H., Lin, C.-H., Kang, L.-W., Huang, C.-H., Lin, M.-H., Chang, C.-Y., & Wang, C.-C. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3072414 · Cited by 260
New Generation Deep Learning for Video Object Detection: A Survey
Jiao, L., Zhang, R., Liu, F., Yang, S., Hou, B., Li, L., & Tang, X. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3053249 · Cited by 259
Sharma, A., Kumar, V., & Longchamps, L. (2024) · Smart Agricultural Technology · doi:10.1016/j.atech.2024.100648 · Cited by 212
Face Mask Detection Using Transfer Learning of InceptionV3
Jignesh Chowdary, G., Punn, N. S., Sonbhadra, S. K., & Agarwal, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-66665-1_6 · Cited by 250
“Over the period there have been many advancements in the deep learning towards object detection and recognition in various application domains [27,18].”
BackgroundCao, Y., Wang, N., Xiao, C., Yang, D., Fang, J., Yang, R., Chen, Q. A., Liu, M., & Li, B. (2021) · 2021 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40001.2021.00076 · Cited by 230
“In the MSF algorithm, state-of-the-art designs predominantly adopt DNN networks to process the LiDAR-side and camera-side MSF inputs [15], [16], [18]–[24], [26], due to the recent superior performance of deep learning in object detection [44].”
Method
Metadata
- Authors
- Zhao, Z.-Q., Zheng, P., Xu, S.-T., & Wu, X.
- Affiliations
- Hefei University of Technology (CN)
- University of Louisiana at Lafayette (US)
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2019-11
- Volume
- 30
- Issue
- 11
- Pages
- 3212-3232
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2884367402
- Cited by
- 5,545
- References
- 241
- Citations by year
- 2026: 418 · 2025: 752 · 2024: 866 · 2023: 921 · 2022: 997 · 2021: 887 · 2020: 548 · 2019: 149
- FWCI
- 288.39
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61672203, 61375047, 91746209)
- National Key Research and Development Program of China (2016YFB1000901)
- Anhui Natural Science Funds for Distinguished Young Scholar (170808J08)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- object detection, deep learning, convolutional neural networks, salient object detection, face detection, pedestrian detection, training strategies, optimization functions, image understanding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.