The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Learning to Track: Online Multi-object Tracking by Decision Making
Open accessAbstract
Online Multi-Object Tracking (MOT) has wide applications in time-critical video analysis scenarios, such as robot navigation and autonomous driving. In tracking-by-detection, a major challenge of online MOT is how to robustly associate noisy object detections on a new video frame with previously tracked objects. In this work, we formulate the online MOT problem as decision making in Markov Decision Processes (MDPs), where the lifetime of an object is modeled with a MDP. Learning a similarity function for data association is equivalent to learning a policy for the MDP, and the policy learning is approached in a reinforcement learning fashion which benefits from both advantages of offline-learning and online-learning for data association. Moreover, our framework can naturally handle the birth/death and appearance/disappearance of targets by treating them as state transitions in the MDP while leveraging existing online single object tracking methods. We conduct experiments on the MOT Benchmark [24] to verify the effectiveness of our method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Algorithms for the Assignment and Transportation Problems
Munkres, J. (1957) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0105003 · Cited by 3,986
Kalal, Z., Mikolajczyk, K., & Matas, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.239 · Cited by 3,285
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918
Bellman, R. (1957) · Indiana University Mathematics Journal · doi:10.1512/iumj.1957.6.56038 · Cited by 2,408
Robust object tracking with online multiple instance learning
Babenko, B., Yang, M.-H., & Belongie, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.226 · Cited by 2,007 · cited 4×
“This decision making is related to the goal of single object tracking in the literature [3, 15, 16, 5].”
BackgroundMethodInfluentialFast Feature Pyramids for Object Detection
Dollar, P., Appel, R., Belongie, S., & Perona, P. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2300479 · Cited by 1,955
Struck: Structured output tracking with kernels
Hare, S., Saffari, A., & Torr, P. H. S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126251 · Cited by 1,831
(2000) · doi:10.2460/ajvr.67.2.323 · Cited by 1,621
Cited by
Simple online and realtime tracking
Bewley, A., Ge, Z., Ott, L., Ramos, F., & Upcroft, B. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7533003 · Cited by 4,433
ByteTrack: Multi-object Tracking by Associating Every Detection Box
Zhang, Y., Sun, P., Jiang, Y., Yu, D., Weng, F., Yuan, Z., Luo, P., Liu, W., & Wang, X. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20047-2_1 · Cited by 2,470
FairMOT: On the Fairness of Detection and Re-identification in Multiple Object Tracking
Zhang, Y., Wang, C., Wang, X., Zeng, W., & Liu, W. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01513-4 · Cited by 1,861
Zhou, X., Koltun, V., & Krähenbühl, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_28 · Cited by 1,428
Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Tracking
Cao, J., Pang, J., Weng, X., Khirodkar, R., & Kitani, K. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00934 · Cited by 1,115
The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking
Du, D., Qi, Y., Yu, H., Yang, Y., Duan, K., Li, G., Zhang, W., Huang, Q., & Tian, Q. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_23 · Cited by 1,099
Multiple object tracking: A literature review
Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., & Kim, T.-K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2020.103448 · Cited by 1,099
VirtualWorlds as Proxy for Multi-object Tracking Analysis
Gaidon, A., Wang, Q., Cabon, Y., & Vig, E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.470 · Cited by 1,079
Learning Social Etiquette: Human Trajectory Understanding In Crowded Scenes
Robicquet, A., Sadeghian, A., Alahi, A., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_33 · Cited by 927
Self-citationDeep learning in video multi-object tracking: A survey
Ciaparrone, G., Luque Sánchez, F., Tabik, S., Troiano, L., Tagliaferri, R., & Herrera, F. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.023 · Cited by 665
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
Tracking the Untrackable: Learning to Track Multiple Cues with Long-Term Dependencies
Sadeghian, A., Alahi, A., & Savarese, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.41 · Cited by 553
Self-citationMultiple People Tracking by Lifted Multicut and Person Re-identification
Tang, S., Andriluka, M., Andres, B., & Schiele, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.394 · Cited by 543
Online Multi-Target Tracking Using Recurrent Neural Networks
Milan, A., Rezatofighi, S. H., Dick, A., Reid, I., & Schindler, K. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11194 · Cited by 506
Learning by Tracking: Siamese CNN for Robust Target Association
Leal-Taixe, L., Canton-Ferrer, C., & Schindler, K. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.59 · Cited by 444
Synthetic Data for Deep Learning
Nikolenko, S. I. (2021) · Springer Optimization and Its Applications · doi:10.1007/978-3-030-75178-4 · Cited by 423
Deep learning for unmanned aerial vehicle-based object detection and tracking: a survey
Wu, X., Li, W., Hong, D., Tao, R., & Du, Q. (2022) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2021.3115137 · Cited by 421
Chu, Q., Ouyang, W., Li, H., Wang, X., Liu, B., & Yu, N. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.518 · Cited by 406
Online Multi-Object Tracking with Dual Matching Attention Networks
Zhu, J., Yang, H., Liu, N., Kim, M., Zhang, W., & Yang, M.-H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_23 · Cited by 377
“In contrast, online MOT methods [53,10,27] do not rely on detections from future frames and may not perform well when target objects are heavily occluded or mis-detected.”
MethodMOTChallenge: A Benchmark for Single-Camera Multiple Target Tracking
Dendorfer, P., Os̆ep, A., Milan, A., Schindler, K., Cremers, D., Reid, I., Roth, S., & Leal-Taixé, L. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01393-0 · Cited by 374
Autonomous driving system: A comprehensive survey
Zhao, J., Zhao, W., Deng, B., Wang, Z., Zhang, F., Zheng, W., Cao, W., Nan, J., Lian, Y., & Burke, A. F. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122836 · Cited by 361
Deep Affinity Network for Multiple Object Tracking
Sun, S., AKHTAR, N., Song, H., Mian, A. S., & Shah, M. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929520 · Cited by 340
Multimodal end-to-end autonomous driving
Xiao, Y., Codevilla, F., Gurram, A., Urfalioglu, O., & Lopez, A. M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3013234 · Cited by 319
Multi-Scale Deep Reinforcement Learning for Real-Time 3D-Landmark Detection in CT Scans
Ghesu, F.-C., Georgescu, B., Zheng, Y., Grbic, S., Maier, A., Hornegger, J., & Comaniciu, D. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2782687 · Cited by 310
Deep learning in multi-object detection and tracking: state of the art
Pal, S. K., Pramanik, A., Maiti, J., & Mitra, P. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02293-7 · Cited by 298
Joint Object Detection and Multi-Object Tracking with Graph Neural Networks
Wang, Y., Kitani, K., & Weng, X. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561110 · Cited by 291
Bae, S.-H., & Yoon, K.-J. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2691769 · Cited by 271
Recurrent Autoregressive Networks for Online Multi-object Tracking
Fang, K., Xiang, Y., Li, X., & Savarese, S. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00057 · Cited by 267
Self-citationSpatial-Temporal Relation Networks for Multi-Object Tracking
Xu, J., Cao, Y., Zhang, Z., & Hu, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00409 · Cited by 263
Deep reinforcement learning in computer vision: a comprehensive survey
Le, N., Rathour, V. S., Yamazaki, K., Luu, K., & Savvides, M. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10061-9 · Cited by 261
TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Tracking
Chu, P., Wang, J., You, Q., Ling, H., & Liu, Z. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00485 · Cited by 258
RetinaTrack: Online Single Stage Joint Detection and Tracking
Lu, Z., Rathod, V., Votel, R., & Huang, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01468 · Cited by 254
Robust Multi-Modality Multi-Object Tracking
Zhang, W., Zhou, H., Sun, S., Wang, Z., Shi, J., & Loy, C. C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00245 · Cited by 250
Joint Monocular 3D Vehicle Detection and Tracking
Hu, H.-N., Cai, Q.-Z., Wang, D., Lin, J., Sun, M., Kraehenbuehl, P., Darrell, T., & Yu, F. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00549 · Cited by 249
Chu, P., & Ling, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00627 · Cited by 246
Learning to Track with Object Permanence
Tokmakov, P., Li, J., Burgard, W., & Gaidon, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01068 · Cited by 226
No Blind Spots: Full-Surround Multi-Object Tracking for Autonomous Vehicles Using Cameras and LiDARs
Rangesh, A., & Trivedi, M. M. (2019) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2019.2938110 · Cited by 158
“Feature Representation: We retain the same feature representation described in [1], but add two features based on the lateral and longitudinal displacements of the last known target location and the object proposal location in the global coordinate system.”
BackgroundMethodInfluentialGSM: Graph Similarity Model for Multi-Object Tracking
Liu, Q., Chu, Q., Liu, B., & Yu, N. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/74 · Cited by 123
“Many early works extracted hand-craft appearance feature such as raw pixel template [ Yamaguchi et al. , 2011; Pellegrini et al. , 2009 ] , color histogram [ Izadinia et al. , 2012; Xiang et al. , 2015 ] , HOG [ Izadinia et al. , 2012; Kuo et al. , 2010 ] and so on.”
BackgroundSearcHD: A Memory-Centric Hyperdimensional Computing With Stochastic Training
Imani, M., Yin, X., Messerly, J., Gupta, S., Niemier, M., Hu, X. S., & Rosing, T. (2020) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2019.2952544 · Cited by 87
Kalake, L., Wan, W., & Hou, L. (2021) · IEEE Access · doi:10.1109/access.2021.3060821 · Cited by 68
“In this section, we used Table 1 and showed an overview of the DLMs that are integrated with CNN to increase the detection quality rate by breaking input video into frames [18], [47].”
BackgroundMethodInfluentialOrientation- and Scale-Invariant Multi-Vehicle Detection and Tracking from Unmanned Aerial Videos
Wang, J., Simeonova, S., & Shahbazi, M. (2019) · Remote Sensing · doi:10.3390/rs11182155 · Cited by 50
Online multi-object tracking with pedestrian re-identification and occlusion processing
Zhang, X., Wang, X., & Gu, C. (2021) · The Visual Computer · doi:10.1007/s00371-020-01854-0 · Cited by 35
“The multi-object tracking algorithm can be categorized into offline tracking [10,11]and online tracking [12,13].”
MethodLiveObj: Object Semantics-based Viewport Prediction for Live Mobile Virtual Reality Streaming
Feng, X., Bao, Z., & Wei, S. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3067686 · Cited by 34
“However, the state-of-the-art multi-object tracking methods, such as feature-mapping [20], mean-shift [33], the Bayesian-based method [32], and the Markov Decision Process (MDP)-based method [28] cannot achieve a real-time performance along with the object detection.”
MethodThe Smart Black Box: A Value-Driven High-Bandwidth Automotive Event Data Recorder
Yao, Y., & Atkins, E. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2971385 · Cited by 33
Isaac-Medina, B. K. S., Poyser, M., Organisciak, D., Willcocks, C. G., Breckon, T. P., & Shum, H. P. H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00142 · Cited by 9
Metadata
- Authors
- Xiang, Y., Alahi, A., & Savarese, S.
- Venue
- 2015 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2015-12
- Pages
- 4705-4713
- OpenAlex
- W2225887246
- Cited by
- 674
- References
- 41
- FWCI
- 26.60
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.