The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Track to Detect and Segment: An Online Multi-Object Tracker
Open accessAbstract
Most online multi-object trackers perform object detection stand-alone in a neural net without any input from tracking. In this paper, we present a new online joint detection and tracking model, TraDeS (TRAck to DEtect and Segment), exploiting tracking clues to assist detection end-to-end. TraDeS infers object tracking offset by a cost volume, which is used to propagate previous object features for improving current object detection and segmentation. Effectiveness and superiority of TraDeS are shown on 4 datasets, including MOT (2D tracking), nuScenes (3D tracking), MOTS and Youtube-VIS (instance segmentation tracking). Project page: https://jialianwu.com/projects/TraDeS.html.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Deformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513 · cited 1×
“To achieve this goal, we perform an efficient temporal propagation via a single deformable convolution [12], which has been used for temporally aligning features in previous works [4, 3, 13].”
MethodnuScenes: A Multimodal Dataset for Autonomous Driving
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01164 · Cited by 7,152
Simple online and realtime tracking with a deep association metric
Wojke, N., Bewley, A., & Paulus, D. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296962 · Cited by 5,286
PointPillars: Fast Encoders for Object Detection From Point Clouds
Lang, A. H., Vora, S., Caesar, H., Zhou, L., Yang, J., & Beijbom, O. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01298 · Cited by 4,673
Simple online and realtime tracking
Bewley, A., Ge, Z., Ott, L., Ramos, F., & Upcroft, B. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7533003 · Cited by 4,433
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume
Sun, D., Yang, X., Liu, M.-Y., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00931 · Cited by 2,648
Yu, F., Wang, D., Shelhamer, E., & Darrell, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00255 · Cited by 1,516
Zhou, X., Koltun, V., & Krähenbühl, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_28 · Cited by 1,428
MOT16: A Benchmark for Multi-Object Tracking
Milan, A., Leal-Taixe, L., Reid, I., Roth, S., & Schindler, K. (2016) · arXiv · doi:10.48550/arxiv.1603.00831 · Cited by 1,309 · cited 2×
“MOT: We conduct 2D object tracking experiments on the MOT16 and MOT17 datasets [27], which have the same 7 training sequences and 7 test sequences but slightly different annotations.”
MethodTowards Real-Time Multi-Object Tracking
Wang, Z., Zheng, L., Liu, Y., Li, Y., & Wang, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_7 · Cited by 1,195
Tracking Without Bells and Whistles
Bergmann, P., Meinhardt, T., & Leal-Taixe, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00103 · Cited by 1,110
TrackFormer: Multi-Object Tracking with Transformers
Meinhardt, T., Kirillov, A., Leal-Taixe, L., & Feichtenhofer, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00864 · Cited by 1,081 · cited 2×
“Alter-natively, transformer is exploited to match tracklets [36, 26].”
BackgroundMethodJoint Detection and Identification Feature Learning for Person Search
Xiao, T., Li, S., Wang, B., Lin, L., & Wang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.360 · Cited by 890
Conditional Convolutions for Instance Segmentation
Tian, Z., Shen, C., & Chen, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_17 · Cited by 712
Multiple Hypothesis Tracking Revisited
Kim, C., Li, F., Ciptadi, A., & Rehg, J. M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.533 · Cited by 666
MOTS: Multi-Object Tracking and Segmentation
Voigtlaender, P., Krause, M., Osep, A., Luiten, J., Sekar, B. B. G., Geiger, A., & Leibe, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00813 · Cited by 658
A space-sweep approach to true multi-image matching
Collins, R. T. (1996) · Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1996.517097 · Cited by 610
Detect to Track and Track to Detect
Feichtenhofer, C., Pinz, A., & Zisserman, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.330 · Cited by 595
Multiple People Tracking by Lifted Multicut and Person Re-identification
Tang, S., Andriluka, M., Andres, B., & Schiele, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.394 · Cited by 543
3D Multi-Object Tracking: A Baseline and New Evaluation Metrics
Weng, X., Wang, J., Held, D., & Kitani, K. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341164 · Cited by 534
Disentangling Monocular 3D Object Detection
Simonelli, A., Bulo, S. R., Porzi, L., Lopez-Antequera, M., & Kontschieder, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00208 · Cited by 520
Learning Spatial Fusion for Single-Shot Object Detection
Liu, S., Huang, D., & Wang, Y. (2019) · arXiv · doi:10.48550/arxiv.1911.09516 · Cited by 517 · cited 1×
“Similar to [24], w is predicted by two convolution layers followed by softmax function.”
MethodSelf-citationLearning a Neural Solver for Multiple Object Tracking
Braso, G., & Leal-Taixe, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00628 · Cited by 504
Yang, L., Fan, Y., & Xu, N. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00529 · Cited by 470
FEELVOS: Fast End-To-End Embedding Learning for Video Object Segmentation
Voigtlaender, P., Chai, Y., Schroff, F., Adam, H., Leibe, B., & Chen, L.-C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00971 · Cited by 468
POI: Multiple Object Tracking with High Performance Detection and Appearance Feature
Yu, F., Li, W., Li, Q., Liu, Y., Shi, X., & Yan, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-48881-3_3 · Cited by 455
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06870 · Cited by 406
Efficient Video Object Segmentation via Network Modulation
Yang, L., Wang, Y., Xiong, X., Yang, J., & Katsaggelos, A. K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00680 · Cited by 386
Self-citationOnline Multi-Object Tracking with Dual Matching Attention Networks
Zhu, J., Yang, H., Liu, N., Kim, M., Zhang, W., & Yang, M.-H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_23 · Cited by 377 · cited 1×
“MOT was dominated by the tracking-by-detection ( TBD ) paradigm over the past years [58, 6, 66, 52, 33, 5, 38, 48, 54].”
MethodSelf-citationPeng, J., Wang, C., Wan, F., Wu, Y., Wang, Y., Tai, Y., Wang, C., Li, J., Huang, F., & Fu, Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_9 · Cited by 372
Self-citationCost Volume Pyramid Based Depth Inference for Multi-View Stereo
Yang, J., Mao, W., Alvarez, J. M., & Liu, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00493 · Cited by 346
TransTrack: Multiple Object Tracking with Transformer
Sun, P., Cao, J., Jiang, Y., Zhang, R., Xie, E., Yuan, Z., Wang, C., & Luo, P. (2020) · arXiv · doi:10.48550/arxiv.2012.15460 · Cited by 345
Self-citationDeep Affinity Network for Multiple Object Tracking
Sun, S., AKHTAR, N., Song, H., Mian, A. S., & Shah, M. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929520 · Cited by 340
TubeTK: Adopting Tubes to Track Multi-Object in a One-Step Training Model
Pang, B., Li, Y., Zhang, Y., Li, M., & Lu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00634 · Cited by 303
Joint Object Detection and Multi-Object Tracking with Graph Neural Networks
Wang, Y., Kitani, K., & Weng, X. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561110 · Cited by 291
Self-citationZhou, X., Wang, D., & Krähenbühl, P. (2019) · arXiv · doi:10.48550/arxiv.1904.07850 · Cited by 288
Recurrent Autoregressive Networks for Online Multi-object Tracking
Fang, K., Xiang, Y., Li, X., & Savarese, S. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00057 · Cited by 267
Spatial-Temporal Relation Networks for Multi-Object Tracking
Xu, J., Cao, Y., Zhang, Z., & Hu, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00409 · Cited by 263
RetinaTrack: Online Single Stage Joint Detection and Tracking
Lu, Z., Rathod, V., Votel, R., & Huang, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01468 · Cited by 254
Object Detection in Video with Spatiotemporal Sampling Networks
Bertasius, G., Torresani, L., & Shi, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01258-8_21 · Cited by 252
GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking With 2D-3D Multi-Feature Learning
Weng, X., Wang, Y., Man, Y., & Kitani, K. M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00653 · Cited by 233
Self-citationPerson Search via a Mask-Guided Two-Stream CNN Model
Chen, D., Zhang, S., Ouyang, W., Yang, J., & Tai, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_45 · Cited by 230
Accurate Optical Flow via Direct Cost Volume Processing
Xu, J., Ranftl, R., & Koltun, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.615 · Cited by 213
Deep Network Flow for Multi-object Tracking
Schulter, S., Vernaza, P., Choi, W., & Chandraker, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.292 · Cited by 207
Multiple Target Tracking Based on Undirected Hierarchical Relation Hypergraph
Wen, L., Li, W., Yan, J., Lei, Z., Yi, D., & Li, S. Z. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.167 · Cited by 170
Combining Detection and Tracking for Human Pose Estimation in Videos
Wang, M., Tighe, J., & Modolo, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01110 · Cited by 166
Full Flow: Optical Flow Estimation By Global Optimization over Regular Grids
Chen, Q., & Koltun, V. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.509 · Cited by 165
Multi-class Multi-object Tracking Using Changing Point Detection
Lee, B., Erdenee, E., Jin, S., Nam, M. Y., Jung, Y. G., & Rhee, P. K. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48881-3_6 · Cited by 164
SipMask: Spatial Information Preservation for Fast Image and Video Instance Segmentation
Cao, J., Anwer, R. M., Cholakkal, H., Khan, F. S., Pang, Y., & Shao, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58568-6_1 · Cited by 160
Self-citationA Unified Object Motion and Affinity Model for Online Multi-Object Tracking
Yin, J., Wang, W., Meng, Q., Yang, R., & Shen, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00680 · Cited by 141
Online Multi-Target Tracking with Tensor-Based High-Order Graph Matching
Zhou, Z., Xing, J., Zhang, M., & Hu, W. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8545450 · Cited by 123
Segment as Points for Efficient Online Multi-Object Tracking and Segmentation
Xu, Z., Zhang, W., Tan, X., Yang, W., Huang, H., Wen, S., Ding, E., & Huang, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58452-8_16 · Cited by 106
Learning Multi-Object Tracking and Segmentation From Automatic Annotations
Porzi, L., Hofinger, M., Ruiz, I., Serrat, J., Bulo, S. R., & Kontschieder, P. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00688 · Cited by 82
Integrated Object Detection and Tracking with Tracklet-Conditioned DetectionPreprint
Zhang, Z., Cheng, D., Zhu, X., Lin, S. C.-F., & Dai, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11167 · Cited by 69
Single Shot Video Object Detector
Deng, J., Pan, Y., Yao, T., Zhou, W., Li, H., & Mei, T. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2990070 · Cited by 68
Temporal-Context Enhanced Detection of Heavily Occluded Pedestrians
Wu, J., Zhou, C., Yang, M., Zhang, Q., Li, Y., & Yuan, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01344 · Cited by 65
Self-citationMulti-Object Tracking Using Online Metric Learning with Long Short-Term Memory
Wan, X., Wang, J., Kong, Z., Zhao, Q. Q., & Shun-Ming, D. E. N. G. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451174 · Cited by 44
Joint Detection and Multi-Object Tracking with Graph Neural NetworksPreprint
Wang, Y., Weng, X., & Kitani, K. (2020) · arXiv (Cornell University) · Cited by 36
Self-citation
Cited by
ByteTrack: Multi-object Tracking by Associating Every Detection Box
Zhang, Y., Sun, P., Jiang, Y., Yu, D., Weng, F., Yuan, Z., Luo, P., Liu, W., & Wang, X. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20047-2_1 · Cited by 2,470
StrongSORT: Make DeepSORT Great Again
Du, Y., Zhao, Z., Song, Y., Zhao, Y., Su, F., Gong, T., & Meng, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3240881 · Cited by 1,191
“We train the detector on the CrowdHuman dataset [41] and MOT17 half training set for ablation following [66, 63, 45, 56, 61].”
MethodObservation-Centric SORT: Rethinking SORT for Robust Multi-Object Tracking
Cao, J., Pang, J., Weng, X., Khirodkar, R., & Kitani, K. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00934 · Cited by 1,115
Self-citationTrackFormer: Multi-Object Tracking with Transformers
Meinhardt, T., Kirillov, A., Leal-Taixe, L., & Feichtenhofer, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00864 · Cited by 1,081
MOTR: End-to-End Multiple-Object Tracking with Transformer
Zeng, F., Dong, B., Zhang, Y., Wang, T., Zhang, X., & Wei, Y. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19812-0_38 · Cited by 752
Metadata
- Authors
- Wu, J., Cao, J., Song, L., Wang, Y., Yang, M., & Yuan, J.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 12347-12356
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3167949052
- Cited by
- 406
- References
- 67
- FWCI
- 25.73
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.