Object Detection With Deep Learning: A Review
Open accessThe DOI matches its Crossref record; 252 of the 252 references it cites were found in a registry or an index.
Abstract
Due to object detection's close relationship with video analysis and image understanding, it has attracted much research attention in recent years. Traditional object detection methods are built on handcrafted features and shallow trainable architectures. Their performance easily stagnates by constructing complex ensembles that combine multiple low-level image features with high-level context from object detectors and scene classifiers. With the rapid development in deep learning, more powerful tools, which are able to learn semantic, high-level, deeper features, are introduced to address the problems existing in traditional architectures. These models behave differently in network architecture, training strategy, and optimization function. In this paper, we provide a review of deep learning-based object detection frameworks. Our review begins with a brief introduction on the history of deep learning and its representative tool, namely, the convolutional neural network. Then, we focus on typical generic object detection architectures along with some modifications and useful tricks to improve detection performance further. As distinct specific detection tasks exhibit different characteristics, we also briefly survey several specific tasks, including salient object detection, face detection, and pedestrian detection. Experimental analyses are also provided to compare various methods and draw some meaningful conclusions. Finally, several promising directions and tasks are provided to serve as guidelines for future work in both object detection and relevant neural network-based learning systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We ensure that these “hard” candidate genes are included in the candidate list for each patient during training, as using such “hard” examples tends to improve the efficiency of training113.”
From Few shot learning for phenotype-driven diagnosis of patients with rare genetic diseases (2025) · cites this paper as [113]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This capability makes YOLO exceptionally well-suited for applications requiring rapid decision-making, such as autonomous driving, medical diagnostics, and surveillance systems [8,9].”
From The YOLO Framework: A Comprehensive Review of Evolution, Applications, and Benchmarks in Object Detection (2024) · cites this paper as [8]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Although great progress has been reported with respect to accuracy in object detection and recognition [173], current systems are mainly designed to calculate 2D or 3D bounding boxes for a couple of trained object classes, or to provide a segmented image of the driving environment.”
From A survey of deep learning techniques for autonomous driving (2020) · cites this paper as [173]
The cited source says what the claim attributes to it.
In the citing paper
“Deep learning methods are more effective and accurate, and they perform better in complex environments to detect objects [11].”
From Fusion of Deep Sort and Yolov5 for Effective Vehicle Detection and Tracking Scheme in Real-Time Traffic Management Sustainable System (2023) · cites this paper as [11]
In the citing paper
“Deep Compression uses three steps, prunning, quantization, and Huffman Encoding, to compress over-parameterized DNN models, such as VGG [77], AlexNet [1].”
From Bringing ai to edge: from deep learning’s perspective (2022) · cites this paper as [75]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 11×
“Recent state-of-the-art image classification networks, such as ResNets [47] and GoogLeNets [45], [93], are fully convolutional.”
BackgroundMethodInfluentialVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 18×
“A typical CNN architecture, which is referred to as VGG16, can be found in Figure 2.”
BackgroundMethodInfluentialImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 15×
“To address the problem of limited training data, Kummerer et al. [134] proposed the Deep Gaze by transferring from the AlexNet to generate a high-dimensional feature space and create a saliency map.”
BackgroundMethodInfluentialLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 6×
“1) The emergence of large-scale annotated training data, such as ImageNet [39], to fully exhibit its very large learning capacity.”
BackgroundMethodInfluentialCortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589 · cited 2×
“This is due to the fact that these features can produce representations associated with complex cells in human brain [19].”
BackgroundYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 23×
“3) SSD: YOLO has a difficulty in dealing with small objects in groups, which is caused by strong spatial constraints imposed on bounding box predictions [18].”
BackgroundMethodInfluential
Research works printed but not linked: 4
- wang, 2017, Face R-CNN
- 10.1109/ICCV.2015.221 · DOI · Paper page
- 10.1109/TPAMI.2009.167 · DOI · Paper page
- everingham, 2011, The pascal visual object classes challenge 2012 (voc2012) results (2012)
Cited by
Items 1,001–1,018 of 1,018
Boulila, W., Ghandorh, H., Masood, S., Alzahem, A., Koubâa, A., Ahmed, F., Khan, Z., & Ahmad, J. E. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e29396 · Cited by 37
“Remarkable results have been shown by them in all vision tasks, such as image segmentation [19], object tracking [20], object detection [21], and classification.”
BackgroundAn Analytical Framework for Accurate Traffic Flow Parameter Calculation from UAV Aerial Videos
Brkić, I., Miler, M., Ševrović, M., & Medak, D. (2020) · Remote Sensing · doi:10.3390/rs12223844 · Cited by 27
“There are many object detection methods based on deep learning [28].”
MethodDispersed Pixel Perturbation-Based Imperceptible Backdoor Trigger for Image Classifier Models
Wang, Y., Zhao, M., Li, S., Yuan, X., & Ni, W. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3202687 · Cited by 26
“IN RECENT years, deep neural network (DNN) has been increasingly widely used thanks to its excellent performance in object detection [1], voice conversion [2], and autonomous driving [3].”
BackgroundImproved Object Detection in Video Surveillance Using Deep Convolutional Neural Network Learning
B, D., K, R. K., S, R., & R, R. (2021) · 2021 Fifth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac52330.2021.9640894 · Cited by 26
Tanoglidis, D., Ćiprijanović, A., Drlica-Wagner, A., Nord, B., Wang, M. H. L. S., Amsellem, A. J., Downey, K., Jenkins, S., Kafkes, D., & Zhang, Z. (2021) · arXiv · doi:10.48550/arxiv.2109.08246 · Cited by 25
“Object detection (e.g., for a review, Zhao et al., 2018) is an active area of research in computer vision, with the goal of developing algorithms that can (cid:12)nd the positions of objects within an image.”
BackgroundTanoglidis, D., Ćiprijanović, A., Drlica-Wagner, A., Nord, B., Wang, M. H. L. S., Amsellem, A. J., Downey, K., Jenkins, S., Kafkes, D., & Zhang, Z. (2022) · Astronomy and Computing · doi:10.1016/j.ascom.2022.100580 · Cited by 25
“Object detection (e.g., for a review, Zhao et al., 2018) is an active area of research in computer vision, with the goal of developing algorithms that can (cid:12)nd the positions of objects within an image.”
BackgroundThe PAU survey: estimating galaxy photometry with deep learning
Cabayol, L., Eriksen, M., Amara, A., Carretero, J., Casas, R., Castander, F. J., De Vicente, J., Fernández, E., García-Bellido, J., Gaztanaga, E., et al. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stab1909 · Cited by 18
Understanding How Blind Users Handle Object Recognition Errors: Strategies and Challenges
Hong, J., & Kacorri, H. (2024) · The 26th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663548.3675635 · Cited by 14
“Object detection specifically seeks to ascertain the precise location and dimensions of objects within an image, often represented through bounding boxes [91, 92].”
BackgroundData-driven detection and registration of spine surgery instrumentation in intraoperative images
Doerr, S. A., Uneri, A., Huang, Y., Jones, C. K., Zhang, X., Ketcha, M. D., Helm, P., & Siewerdsen, J. H. (2020) · Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling · doi:10.1117/12.2550052 · Cited by 10
Isaac-Medina, B. K. S., Poyser, M., Organisciak, D., Willcocks, C. G., Breckon, T. P., & Shum, H. P. H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00142 · Cited by 9
“Overall, prior work within the UAV domain is limited in both scope and complexity whereas multiple comprehensive surveys for detection and tracking have already been published more broadly [54] [44].”
BackgroundObject Sorting using Faster R-CNN
Chen, P., & Elangovan, V. (2020) · International Journal of Artificial Intelligence & Applications · doi:10.5121/ijaia.2020.11603 · Cited by 9
“The traditional object detection process involves three main stages: Informative Region Selection, Feature Extraction, and Classification [1].”
MethodSim-to-Real Transfer for Object Detection in Aerial Inspections of Transmission Towers
Peterlevitz, A. J., Chinelatto, M. A., Menezes, A. G., Motta, C. A. M., Pereira, G. A. B., Lopes, G. L., Souza, G. D. M., Rodrigues, J., Godoy, L. C., Koller, M. A. F. F., et al. (2023) · IEEE Access · doi:10.1109/access.2023.3322374 · Cited by 7
Improved YOLOv4 approach: A real time occluded vehicle detection
Kumar, S., Jailia, M., & Varshney, S. (2022) · International Journal of Computing and Digital Systems · doi:10.12785/ijcds/120139 · Cited by 7
“They need highquality GPUs (Graphic Processing Units) which have the computational power to detect real-time objects [13].”
Shuttlecock Detection and Fall Point Prediction using Neural Networks
Vrajesh, S. R., Amudhan, A. N., Lijiya, A., & Sudheer, A. P. (2020) · 2020 International Conference for Emerging Technology (INCET) · doi:10.1109/incet49848.2020.9154136 · Cited by 6
“Fewer attempts are made for detecting fast-moving objects and small-sized objects using deep learning models [8-11].”
BackgroundIdama, G., Guo, Y., & Yu, W. (2024) · 2024 33rd International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn61486.2024.10637599 · Cited by 5
“Object detection is paramount in real-world applications, involving identifying both the presence (localization) and type (classification) of objects within images or video frames [1], [2].”
BackgroundProbabilistic framework for solving visual dialog
Patro, B. N., Anupriy, & Namboodiri, V. P. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2020.107586 · Cited by 4
Real-Time Object Detection on Edge Devices: A Fisheye Specific DFINE
Park, J., Lee, J., & Yong, Y. (2025) · 2025 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw69036.2025.00573 · Cited by 4
“With the advancement of Intelligent Transportation Systems (ITS), the demand for technologies capable of accurately detecting traffic objects in urban environments has steadily increased [32, 41].”
Duan, Y., Liu, J., Ming, X., Jin, W., Song, Z., & Peng, X. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-35678-0_3 · Cited by 3
Metadata
- Authors
- Zhao, Z.-Q., Zheng, P., Xu, S.-T., & Wu, X.
- Affiliations
- Hefei University of Technology (CN)
- University of Louisiana at Lafayette (US)
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2019-11
- Volume
- 30
- Issue
- 11
- Pages
- 3212-3232
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2884367402
- Cited by
- 5,545
- References
- 241
- Citations by year
- 2026: 418 · 2025: 752 · 2024: 866 · 2023: 921 · 2022: 997 · 2021: 887 · 2020: 548 · 2019: 149
- FWCI
- 288.39
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61672203, 61375047, 91746209)
- National Key Research and Development Program of China (2016YFB1000901)
- Anhui Natural Science Funds for Distinguished Young Scholar (170808J08)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- object detection, deep learning, convolutional neural networks, salient object detection, face detection, pedestrian detection, training strategies, optimization functions, image understanding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.