The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Improving Multiple Pedestrian Tracking by Track Management and Occlusion Handling
Abstract
Multi-pedestrian trackers perform well when targets are clearly visible making the association task quite easy. However, when heavy occlusions are present, a mechanism to re-identify persons is needed. The common approach is to extract visual features from new detections and compare them with the features of previously found tracks. Since those detections can have substantial overlaps with nearby targets – especially in crowded scenarios – the extracted features are insufficient for a reliable re-identification. In contrast, we propose a novel occlusion handling strategy that explicitly models the relation between occluding and occluded tracks outperforming the feature-based approach, while not depending on a separate re-identification network. Furthermore, we improve the track management of a regression-based method in order to bypass missing detections and to deal with tracks leaving the scene at the border of the image. Finally, we apply our tracker in both temporal directions and merge tracklets belonging to the same target, which further enhances the performance. We demonstrate the effectiveness of our tracking components with ablative experiments and surpass the state-of-the-art methods on the three popular pedestrian tracking benchmarks MOT16, MOT17, and MOT20.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
High-Speed Tracking with Kernelized Correlation Filters
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753
Simple online and realtime tracking with a deep association metric
Wojke, N., Bewley, A., & Paulus, D. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296962 · Cited by 5,286
Simple online and realtime tracking
Bewley, A., Ge, Z., Ott, L., Ramos, F., & Upcroft, B. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7533003 · Cited by 4,433
Performance Measures and a Data Set for Multi-target, Multi-camera Tracking
Ristani, E., Solera, F., Zou, R., Cucchiara, R., & Tomasi, C. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48881-3_2 · Cited by 3,104
MMDetection: Open MMLab Detection Toolbox and Benchmark
Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., Xu, J., et al. (2019) · arXiv · doi:10.48550/arxiv.1906.07155 · Cited by 2,227
Zhou, X., Koltun, V., & Krähenbühl, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_28 · Cited by 1,428
Efficient Belief Propagation for Early Vision
Felzenszwalb, P. F., & Huttenlocher, D. P. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-006-7899-4 · Cited by 1,338
MOT16: A Benchmark for Multi-Object Tracking
Milan, A., Leal-Taixe, L., Reid, I., Roth, S., & Schindler, K. (2016) · arXiv · doi:10.48550/arxiv.1603.00831 · Cited by 1,309
Towards Real-Time Multi-Object Tracking
Wang, Z., Zheng, L., Liu, Y., Li, Y., & Wang, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_7 · Cited by 1,195
Tracking Without Bells and Whistles
Bergmann, P., Meinhardt, T., & Leal-Taixe, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00103 · Cited by 1,110
Forward-Backward Error: Automatic Detection of Tracking Failures
Kalal, Z., Mikolajczyk, K., & Matas, J. (2010) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2010.675 · Cited by 841
MOT20: A benchmark for multi object tracking in crowded scenes
Dendorfer, P., Rezatofighi, H., Milan, A., Shi, J., Cremers, D., Reid, I., Roth, S., Schindler, K., & Leal-Taixé, L. (2020) · arXiv · doi:10.48550/arxiv.2003.09003 · Cited by 779
Parametric Image Alignment Using Enhanced Correlation Coefficient Maximization
Evangelidis, G., & Psarakis, E. Ζ. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.113 · Cited by 749
Yang, F., Choi, W., & Lin, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.234 · Cited by 608
Detect to Track and Track to Detect
Feichtenhofer, C., Pinz, A., & Zisserman, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.330 · Cited by 595
Multiple People Tracking by Lifted Multicut and Person Re-identification
Tang, S., Andriluka, M., Andres, B., & Schiele, B. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.394 · Cited by 558
Learning a Neural Solver for Multiple Object Tracking
Braso, G., & Leal-Taixe, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00628 · Cited by 504
Efficient belief propagation for early vision
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315041 · Cited by 443
TubeTK: Adopting Tubes to Track Multi-Object in a One-Step Training Model
Pang, B., Li, Y., Zhang, Y., Li, M., & Lu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00634 · Cited by 303
Zhou, X., Wang, D., & Krähenbühl, P. (2019) · arXiv · doi:10.48550/arxiv.1904.07850 · Cited by 288
Spatial-Temporal Relation Networks for Multi-Object Tracking
Xu, J., Cao, Y., Zhang, Z., & Hu, H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00409 · Cited by 275
How to Train Your Deep Multi-Object Tracker
Xu, Y., sep, A., Ban, Y., Horaud, R., Leal-Taixé, L., & Alameda-Pineda, X. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00682 · Cited by 255
Extending IOU Based Multi-Object Tracking by Visual Information
Bochinski, E., Senst, T., & Sikora, T. (2018) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639144 · Cited by 207
Wang, G., Wang, Y., Zhang, H., Gu, R., & Hwang, J. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350853 · Cited by 187
Beyond Pixels: Leveraging Geometry and Shape Cues for Online Multi-Object Tracking
Sharma, S., Ansari, J. A., Jatavallabhula, K. M., & Krishna, K. M. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461018 · Cited by 169
TPM: Multiple object tracking with tracklet-plane matching
Peng, J., Wang, T., Lin, W., Wang, J., See, J., Wen, S., & Ding, E. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107480 · Cited by 127
GSM: Graph Similarity Model for Multi-Object Tracking
Liu, Q., Chu, Q., Liu, B., & Yu, N. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/74 · Cited by 123
Long-Term Tracking With Deep Tracklet Association
Zhang, Y., Sheng, H., Wu, Y., Wang, S., Lyu, W., Ke, W., & Xiong, Z. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2993073 · Cited by 108
Lifted Disjoint Paths with Application in Multiple Object TrackingPreprint
Hornakova, A., Henschel, R. D., Rosenhahn, B., & Swoboda, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14550 · Cited by 106
Multiple object tracking performance metrics and evaluation in a smart room environment
Bernardin, K., Elbs, A., & Stiefelhagen, R. (2006) · doi:10.5445/ir/1000009596 · Cited by 101
Multiplex Labeling Graph for Near-Online Tracking in Crowded Scenes
Zhang, Y., Sheng, H., Wu, Y., Wang, S., Ke, W., & Xiong, Z. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2996609 · Cited by 100
Multi-Object Tracking with Multiple Cues and Switcher-Aware ClassificationPreprint
Feng, W., Hu, Z., Wu, W., Yan, J., & Ouyang, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.06129 · Cited by 95
Multi-object Tracking Cascade with Multi-Step Data Association and Occlusion Handling
Al-Shakarji, N., Bunyak, F., Seetharaman, G. S., & Palaniappan, K. (2018) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639321 · Cited by 47
Online Multi-Object Tracking With GMPHD Filter and Occlusion Group Management
Song, Y.-M., Yoon, K., Yoon, Y.-C., Yow, K., & Jeon, M. (2019) · IEEE Access · doi:10.1109/access.2019.2953276 · Cited by 41
Gao, X., & Jiang, T. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240548 · Cited by 30
MAT: Motion-Aware Multi-Object TrackingPreprint
Han, S., Huang, P., Wang, H., Yu, E., Liu, D., Pan, X., & Zhao, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.04794 · Cited by 18
Multi-Target Tracking with Trajectory Prediction and Re-Identification
Li, X., Liu, Y., Wang, K., Yan, Y., & Wang, F. (2019) · Chinese Automation Congress · doi:10.1109/cac48633.2019.8996811 · Cited by 11
Flagged first, then by citations
Cited by
Sorted by citations
Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Tracking
Cao, J., Pang, J., Weng, X., Khirodkar, R., & Kitani, K. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00934 · Cited by 1,115
TrackFormer: Multi-Object Tracking with Transformers
Meinhardt, T., Kirillov, A., Leal-Taixe, L., & Feichtenhofer, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00864 · Cited by 1,081
Single-Model and Any-Modality for Video Object Tracking
Wu, Z., Zheng, J., Ren, X., Vasluianu, F.-A., Ma, C., Paudel, D. P., Gool, L. V., & Timofte, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01812 · Cited by 143
“While traditional RGB trackers have shown promise in general settings, they often struggle with challenging scenarios such as occlusions [40, 47], low visibility [83, 92], or fast-moving objects [10, 48].”
BackgroundSimple Cues Lead to a Strong Multi-Object Tracker
Seidenschwarz, J., Brasó, G., Serrano, V. C., Elezi, I., & Leal-Taixé, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01327 · Cited by 133
“Even new learning-based trackers still rely on motion priors [4,52,63,80] or appearance cues, which may include external reid models [4,63].”
BackgroundRobust Multi-Drone Multi-Target Tracking to Resolve Target Occlusion: A Benchmark
Liu, Z., Shang, Y., Li, T., Chen, G., Wang, Y., Hu, Q., & Zhu, P. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3234822 · Cited by 113
“Apart from that, Limited by the lack of supplementary information, single camera MOT has no advantage to address occlusion circumstances, and some priors predictions are always performed for occlusions [52], [53], [54].”
Background
Metadata
- Authors
- Stadler, D., & Beyerer, J.
- Affiliations
- Karlsruhe Institute of Technology (DE)
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 10953-10962
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3175782503
- Cited by
- 147
- References
- 41
- Citations by year
- 2026: 10 · 2025: 22 · 2024: 35 · 2023: 37 · 2022: 39 · 2021: 4
- FWCI
- 9.40
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- multi-pedestrian tracking, occlusion handling, track management, person re-identification, track association, missing detection, crowded scenes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
