The DOI matches its Crossref record; 94 of the 95 references it cites were found in a registry or an index, and 1 are not checked yet.
Analysis Based on Recent Deep Learning Approaches Applied in Real-Time Multi-Object Tracking: A Review
Open accessAbstract
The deep learning technique has proven to be effective in the classification and localization of objects on the image or ground plane over time. The strength of the technique's features has enabled researchers to analyze object trajectories across multiple cameras for online multi-object tracking (MOT) systems. In the past five years, these technical features have gained a reputation in handling several real-time multiple object tracking challenges. This contributed to the increasing number of proposed deep learning methods (DLMs) and networks seen by the computer vision community. The technique efficiently handled various challenges in real-time MOT systems and improved overall tracking performance. However, it experienced difficulties in the detection and tracking of objects in overcrowded scenes and motion variations and confused appearance variations. Therefore, in this paper, we summarize and analyze the 95 contributions made in the past five years on deep learning-based online MOT methods and networks that rank highest in the public benchmark. We review their expedition, performance, advantages, and challenges under different experimental setups and tracking conditions. We also further categorize these methods and networks into four main themes: Online MOT Based Detection Quality and Associations, Real-Time MOT with High-Speed Tracking and Low Computational Costs, Modeling Target Uncertainty in Online MOT, and Deep Convolutional Neural Network (DCNN), Affinity and Data Association. Finally, we discuss the ongoing challenges and directions for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![FIGURE 1 Single Camera Multi-Object Tracking Overview [19].](https://figures.cochat.ai/paper-figures/58651e85fdac40a7aa6b0bf978677901/analysis-based-on-recent-deep-learning-approaches-applied-in-real-time-multi-figure-1.png)



![FIGURE 5 Object Tracking based on Quality Detections [76].](https://figures.cochat.ai/paper-figures/9a317c3925944da59223f1e8d6bf6cd5/analysis-based-on-recent-deep-learning-approaches-applied-in-real-time-multi-figure-5.png)











Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Vehicle detection and classification using deep learning (DL) and multi-object tracking (MOT) on video streams obtained from a network of surveillance cameras have become the state of the art (SOTA) in the automation of intelligent transport systems (ITSs) [3].”
From Real-Time Vehicle Classification and Tracking Using a Transfer Learning-Improved Deep Learning Network (2022) · cites this paper as [3]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472 · cited 1×
“The detection quality is significant to improve the tracker’s capabilities in handling the object’s appearance similarities, generating and associating the tracklets, reducing false object detections, calculating, grouping the similarity trajectories, and drifting [74], [75].”
BackgroundFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812 · cited 1×
“The detection quality is significant to improve the tracker’s capabilities in handling the object’s appearance similarities, generating and associating the tracklets, reducing false object detections, calculating, grouping the similarity trajectories, and drifting [74], [75].”
BackgroundYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 1×
“This is supported by the results of a considerable number of detached detections that could not be associated and hence degraded detections’ quality response [2], [22], [23], [54]–[56], [59], [60].”
ResultPreferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Simple online and realtime tracking with a deep association metric
Wojke, N., Bewley, A., & Paulus, D. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296962 · Cited by 5,286 · cited 2×
“Then [32], [41], [62]–[66], emerged to learn the control of the problem through graphic models and flow optimizations but experienced difficulties in handling the affinities.”
BackgroundMethodSimple online and realtime tracking
Bewley, A., Ge, Z., Ott, L., Ramos, F., & Upcroft, B. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7533003 · Cited by 4,433 · cited 1×
“Bewley et al. [65] used the merits of single object tracking [83] to integrate the Kalman filter features with the Hungarian algorithm to find the association in visual tracks.”
MethodSiamRPN++: Evolution of Siamese Visual Tracking With Very Deep Networks
Li, B., Wu, W., Wang, Q., Zhang, F., Xing, J., & Yan, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00441 · Cited by 2,607 · cited 2×
“Then, Li et al. [53] incorporated template branch and bounding box regression into a Siamese regional proposed network (SRPN) to improve the detection speed.”
BackgroundMOT16: A Benchmark for Multi-Object Tracking
Milan, A., Leal-Taixe, L., Reid, I., Roth, S., & Schindler, K. (2016) · arXiv · doi:10.48550/arxiv.1603.00831 · Cited by 1,309 · cited 1×
“Then optimizes the sequential states by modeling the maximum posterior estimation from the conditional for all sequential states of all objects from the first frame to the last frame [25].”
MethodTowards Real-Time Multi-Object Tracking
Wang, Z., Zheng, L., Liu, Y., Li, Y., & Wang, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_7 · Cited by 1,195
Research works printed but not linked: 4
- patel, 2018, Multiple object detection and tracking: A survey, International Journal of Applied Science and Engineering Research, 6, 809
- tiwari, 2017, A review of detection and tracking of object from image and video sequences, Int J Comput Intell Res, 13, 745
- bai, 2017, Multi-object tracking and identification via particle filtering over sets, Proc 20th Int Conf Inf Fusion (Fusion), 10
- zhu, 2018, Online Multi-Object Tracking with Dual Matching Attention Networks 15th European Conference, 379
Cited by
Neupane, B., Horanont, T., & Aryal, J. (2022) · Sensors · doi:10.3390/s22103813 · Cited by 85
“Vehicle detection and classification using deep learning (DL) and multi-object tracking (MOT) on video streams obtained from a network of surveillance cameras have become the state of the art (SOTA) in the automation of intelligent transport systems (ITSs) [3].”
BackgroundTransformers in Single Object Tracking: An Experimental Survey
Kugarajeevan, J., Thanikasalam, K., Ramanan, A., & Fernando, S. (2023) · IEEE Access · doi:10.1109/access.2023.3298440 · Cited by 100
“object tracking [1, 2] approaches based on the number”
BackgroundMulti-object tracking: a systematic literature review
Hassan, S., Mujtaba, G., Rajput, A., & Fatima, N. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17297-3 · Cited by 90
Multiple Object Tracking in Deep Learning Approaches: A Survey
Park, Y., Dang, L. M., Lee, S., Han, D., & Moon, H. (2021) · Electronics · doi:10.3390/electronics10192406 · Cited by 68
“reviewed MOT papers during the last 5 years [13].”
BackgroundLöffler, K., & Mikut, R. (2022) · IEEE Access · doi:10.1109/access.2022.3192880 · Cited by 46
Metadata
- Authors
- Kalake, L., Wan, W., & Hou, L.
- Affiliations
- Shanghai University (CN)
- Huangshan University (CN)
- Venue
- IEEE Access
- Published
- 2021
- Volume
- 9
- Pages
- 32650-32671
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3132576305
- Cited by
- 68
- References
- 95
- Citations by year
- 2026: 7 · 2025: 13 · 2024: 20 · 2023: 15 · 2022: 10 · 2021: 3
- FWCI
- 4.32
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Science and Technology Commission of Shanghai Municipality (18510760300)
- Anhui Natural Science Foundation (1908085MF178)
- China Postdoctoral Science Foundation (2020M681264)
- Anhui Excellent Young Talents Support Program
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- multi-target tracking, real-time tracking, deep learning, online tracking, data association, target uncertainty, crowded scenes, appearance variation, deep convolutional neural networks, low computational cost, tracking benchmark
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Analysis Based on Recent Deep Learning Approaches Applied in Real-Time Multi-Object Tracking: A Review. https://app.cochat.ai/papers/10.1109/access.2021.3060821
- The paper
- Kalake, L., Wan, W., & Hou, L. (2021). Analysis Based on Recent Deep Learning Approaches Applied in Real-Time Multi-Object Tracking: A Review. IEEE Access. https://doi.org/10.1109/access.2021.3060821
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.