CoChat

A Survey of Multiple Pedestrian Tracking Based on Tracking-by-Detection Framework

Sun, Zhihong, Chen, Jun, Chao, Liang, Ruan, Weijian, Mukherjee, Mithun · 2021 · IEEE Transactions on Circuits and Systems for Video Technology
Cited by 174

The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.

Abstract

Multiple pedestrian tracking (MPT) has gained significant attention due to its huge potential in a commercial application. It aims to predict multiple pedestrian trajectories and maintain their identities, given a video sequence. In the past decade, due to the advancement in pedestrian detection algorithms, Tracking-by-Detection (TBD) based algorithms have achieved tremendous successes. TBD has become the most popular MPT framework, and it has been actively studied in the past decade. In this paper, we give a comprehensive survey of recent advances in TBD-based MPT algorithms. We systematically analyze the existing TBD-based algorithms and organize the survey into four major parts. At first, this survey draws a timeline to introduce the milestones of TBD-based works which briefly reviews the development of the existing TBD-based methods. Second, the main procedures of the TBD framework are summarized, and each stage in the procedure is described in detail. Afterward, this survey analyzes the performance of existing TBD-based algorithms on MOT challenge datasets and discusses the factors that affect tracking performance. Finally, open issues and future directions in the TBD framework are discussed.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tcsvt.2020.3009717

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 124

  1. 10.1109/CVPR.2012.6247893 · DOI · Paper page
  2. 10.1109/CVPR.2011.5995311 · DOI · Paper page
  3. 10.1109/CVPR.2008.4587577 · DOI
  4. shen, 2018, Tracklet association tracker: An end-to-end learning-based association approach for multi-object tracking, arXiv 1808 01562
  5. 10.1109/CVPR.2017.403 · DOI · Paper page
  6. 10.1109/TCSVT.2018.2825679 · DOI · Paper page
  7. 10.1109/CVPR.2013.472 · DOI · Paper page
  8. 10.1109/CVPR.2011.5995587 · DOI
  9. 10.1109/CVPR.2011.5995395 · DOI · Paper page
  10. 10.1109/CVPRW.2019.00105 · DOI · Paper page
  11. lin, 2014, Microsoft COCO: Common objects in context, Proc Eur Conf Comput Vis, 740
  12. 10.1007/978-3-642-33715-4_43 · DOI
  13. 10.1109/CVPR.2013.241 · DOI · Paper page
  14. 10.1109/CVPR.2015.7298718 · DOI
  15. 10.1109/CVPR.2015.7299193 · DOI
  16. 10.1007/978-3-642-33765-9_16 · DOI · Paper page
  17. 10.1109/ICCVW.2019.00025 · DOI
  18. 10.1109/CVPR.2017.292 · DOI · Paper page
  19. feng, 2019, Multi-object tracking with multiple cues and switcher-aware classification, arXiv 1901 06129
  20. 10.1109/TIP.2011.2159228 · doi:10.1109/tip.2011.2159228
  21. 10.1109/TCSVT.2020.2975842 · DOI
  22. 10.1109/IVS.2019.8813779 · DOI
  23. 10.1109/ICIP.2018.8451472 · DOI
  24. milan, 2017, Online multi-target tracking using recurrent neural networks, Proc AAAI Conf Artif Intell, 4225
  25. 10.1109/CVPR.2018.00232 · DOI
  26. 10.1109/CVPR.2015.7299178 · DOI · Paper page
  27. 10.1109/TPAMI.2015.2505309 · DOI · Paper page
  28. zhou, 2018, A survey of multi-object video tracking algorithms, Proc Adv Intell Sys Comput, 351, 10.2991/ijcis.2019.125905651 · doi:10.2991/ijcis.2019.125905651
  29. 10.1049/iet-cvi.2016.0178 · DOI
  30. 10.1049/iet-cvi.2018.5598 · DOI
  31. yoon, 2019, Online multiple pedestrian tracking using deep temporal appearance matching association, arXiv 1907 00831
  32. 10.1109/WMVC.2008.4544058 · DOI
  33. 10.1007/s13592-011-0060-6 · DOI
  34. 10.1109/CVPR.2017.394 · DOI · Paper page
  35. 10.1007/978-3-319-48881-3_8 · DOI · Paper page
  36. 10.1109/GlobalSIP.2016.7905816 · DOI
  37. xing, 2009, Multi-object tracking through occlusions by local tracklets filtering and global tracklets association with detection responses, Proc IEEE Conf Comput Vis Pattern Recognit, 1200
  38. zamir, 2012, GMCP-tracker: Global multi-object tracking using generalized minimum clique graphs, Proc Eur Conf Comput Vis, 343
  39. thoreau, 2018, Deep similarity metric learning for real-time pedestrian tracking, arXiv 1806 07592
  40. 10.1109/CVPR.2015.7299138 · DOI · Paper page
  41. 10.1109/CVPR.2015.7299036 · DOI · Paper page
  42. 10.1109/TPAMI.2008.57 · DOI · Paper page
  43. 10.1109/TPAMI.2016.2551245 · DOI
  44. 10.1016/j.patcog.2019.04.018 · DOI
  45. 10.1109/CVPRW.2018.00169 · DOI
  46. song, 2019, Online multi-object tracking framework with the GMPHD filter and occlusion group management, arXiv 1907 13347
  47. 10.1007/978-3-319-48881-3_2 · DOI · Paper page
  48. 10.1109/ICCVW.2019.00022 · DOI
  49. dendorfer, 2019, CVPR19 tracking and detection challenge: How crowded can it get?, arXiv 1906 04567
  50. 10.1007/978-3-319-48881-3_7 · DOI · Paper page
  51. 10.1109/LSP.2019.2940922 · DOI
  52. 10.4218/etrij.15.0114.0629 · DOI
  53. 10.1007/s11042-018-5781-3 · DOI
  54. 10.1109/CVPRW.2016.161 · DOI
  55. 10.1109/ACCESS.2018.2881019 · DOI
  56. tian, 2019, Online multi-object tracking using joint domain information in traffic scenarios, IEEE Trans Intell Transp Syst, 20, 1
  57. 10.1109/ICME.2018.8486454 · DOI · Paper page
  58. 10.1016/j.neucom.2015.07.028 · DOI
  59. 10.1109/CVPR.2017.206 · DOI · Paper page
  60. 10.1109/ICPCSI.2017.8392001 · DOI
  61. 10.1109/CVPRW.2018.00192 · DOI · Paper page
  62. 10.1109/TCSVT.2018.2882192 · DOI · Paper page
  63. 10.1109/ICCV.2017.322 · DOI · Paper page
  64. 10.1109/CVPRW.2017.266 · DOI · Paper page
  65. gautam, 2020, SDVTracker: Real-time multi-sensor association and tracking for self-driving vehicles, arXiv 2003 04447
  66. 10.1109/ICRAS49812.2020.9135065 · DOI
  67. 10.1109/ICSMC.2004.1400815 · DOI · Paper page
  68. yang, 2014, Aggregate channel features for multi-view face detection, Proc IEEE Int Joint Conf Biometrics, 1
  69. 10.1109/TPAMI.2019.2929520 · DOI · Paper page
  70. leal-taixé, 2015, MOTChallenge 2015: Towards a benchmark for multi-target tracking, arXiv 1504 01942 [cs]
  71. 10.1109/ACCESS.2019.2903121 · DOI
  72. hu, 2020, Multi-object tracking via end-to-end tracklet searching and ranking, arXiv 2003 02795
  73. 10.2528/PIERB15010503 · DOI
  74. 10.1109/LRA.2020.2974392 · DOI
  75. luo, 2014, Multiple object tracking: A literature review, arXiv 1409 7618 [cs]
  76. 10.1016/j.neucom.2018.02.068 · DOI
  77. 10.1109/TCSVT.2018.2856540 · DOI
  78. 10.1109/TPAMI.2017.2691769 · DOI · Paper page
  79. 10.1007/978-3-642-33783-3_8 · DOI
  80. wang, 2014, Coupled data association and L1 minimization for multiple object tracking under occlusion, Proc SPIE, 9273, 1
  81. 10.1109/ICIP.2014.7025168 · DOI
  82. 10.1145/3343031.3350853 · DOI · Paper page
  83. 10.1007/s11263-013-0666-4 · DOI
  84. 10.1145/3240508.3240548 · DOI
  85. 10.1109/WACV.2018.00128 · DOI
  86. 10.1109/ICCV.2019.00409 · DOI · Paper page
  87. 10.1109/CVPR.2016.461 · DOI · Paper page
  88. 10.1109/CVPR.2014.161 · DOI
  89. xiang, 2019, End-to-end learning deep CRF models for multi-object tracking, arXiv 1907 12176
  90. 10.1109/CVPRW.2018.00195 · DOI
  91. 10.1109/ROBIO.2015.7419004 · DOI
  92. 10.1007/978-81-322-1665-0_52 · DOI
  93. 10.1109/ICCV.2009.5459301 · DOI · Paper page
  94. 10.1109/CVPR.2010.5540102 · DOI · Paper page
  95. 10.1109/TPAMI.2017.2691768 · DOI · Paper page
  96. 10.1145/3343031.3350984 · DOI
  97. 10.1109/TMM.2018.2872897 · DOI
  98. 10.1109/TMM.2016.2605058 · DOI · Paper page
  99. 10.1007/978-3-642-33718-5_35 · DOI
  100. 10.1109/TPAMI.2013.221 · DOI
  101. 10.1109/CVPR.2017.142 · DOI · Paper page
  102. 10.1016/j.cviu.2016.12.003 · DOI
  103. 10.1016/j.cviu.2016.05.003 · DOI · Paper page
  104. xu, 2019, How to train your deep multi-object tracker, arXiv 1906 06618
  105. 10.1109/CVPR.2013.240 · DOI · Paper page
  106. 10.1109/TIP.2017.2745103 · DOI
  107. hu, 2012, Single and multiple object tracking using log-Euclidean Riemannian subspace and block-division appearance model, IEEE Trans Pattern Anal Mach Intell, 34, 2420, 10.1109/TPAMI.2012.42 · DOI · Paper page
  108. keuper, 2016, A multi-cut formulation for joint segmentation and tracking of multiple objects, arXiv 1607 06317
  109. 10.1109/ICCV.2017.278 · DOI
  110. 10.1109/CVPR.2008.4587584 · DOI · Paper page
  111. 10.1109/TPAMI.2018.2876253 · DOI · Paper page
  112. ma, 2018, Customized multi-person tracker, Vision Computer, 612
  113. 10.1109/TCSVT.2018.2881123 · DOI · Paper page
  114. 10.1109/CVPR.2017.495 · DOI · Paper page
  115. 10.1109/TPAMI.2013.103 · DOI · Paper page
  116. 10.1109/TIP.2018.2843129 · DOI
  117. 10.1109/ICCV.2015.534 · DOI · Paper page
  118. 10.1109/WACV.2019.00023 · DOI · Paper page
  119. 10.1109/ICIP.2017.8296360 · DOI · Paper page
  120. 10.1109/ICCV.2017.41 · DOI · Paper page
  121. 10.1007/978-3-030-01237-3_13 · DOI · Paper page
  122. 10.1109/WACV.2018.00057 · DOI · Paper page
  123. 10.1007/978-3-030-01219-9_36 · DOI
  124. 10.1109/ICCV.2009.5459278 · DOI · Paper page

Cited by

See all 174

Metadata

Authors
Sun, Z., Chen, J., Chao, L., Ruan, W., & Mukherjee, M.
Venue
IEEE Transactions on Circuits and Systems for Video Technology
Published
2021-05
Volume
31
Issue
5
Pages
1819-1833
ISSN
  • 1051-8215 (ISSN-L)
  • 1558-2205
OpenAlex
W3043157863
Cited by
174
References
22
FWCI
6.43
Type
journal article
Language
en
Open access
closed
Funders
  • National Nature Science Foundation of China (U1611461, 61876135, 61801335, 61672390, U1736206, U1903214)
  • National Key Research and Development Program of China (2017YFC0803700)
  • Hubei Technological Innovation Special Fund (2018AAA062, 2018CFA024, 2017AAA123, 2019CFB472)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.