The DOI matches its Crossref record; 160 of the 160 references it cites were found in a registry or an index.
Multiple object tracking: A literature review
Open accessAbstract
Multiple Object Tracking (MOT) is an important computer vision problem which has gained increasing attention due to its academic and commercial potential. Although different kinds of approaches have been proposed to tackle this problem, it still remains challenging due to factors like abrupt appearance changes and severe object occlusions. In this work, we contribute the first comprehensive and most recent review on this problem. We inspect the recent advances in various aspects and propose some interesting directions for future research. To the best of our knowledge, there has not been any extensive review on this topic in the community. We endeavor to provide a thorough review on the development of this problem in recent decades. The main contributions of this review are fourfold: 1) Key aspects in a multiple object tracking system, including formulation, categorization, key principles, evaluation of an MOT are discussed. 2) Instead of enumerating individual works, we discuss existing approaches according to various aspects, in each of which methods are divided into different groups and each group is discussed in detail for the principles, advances and drawbacks. 3) We examine experiments of existing publications and summarize results on popular datasets to provide quantitative comparisons. We also point to some interesting discoveries by analyzing these results. 4) We provide a discussion about issues of MOT research, as well as some interesting directions which could possibly become potential research effort in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
Self-citationAre we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 7×
“Compared with Single Object Tracking (SOT), which primarily focuses on designing sophisticated appearance models and/or motion models to deal with challenging factors such as scale changes, out-of-plane rotations and illumination variations, multiple object tracking additionally requires two tasks to be solved: determ…”
MethodInfluentialDeformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513 · cited 1×
“We suspect that factors such as better models and progress in object detection [184, 185, 186, 187, 188, 189, 190, 191] all contribute to the achieved progress.”
BackgroundSocial force model for pedestrian dynamics
Helbing, D., & Molnár, P. (1995) · Physical Review E · doi:10.1103/physreve.51.4282 · Cited by 6,845
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
Object Detection With Deep Learning: A Review
Zhao, Z.-Q., Zheng, P., Xu, S.-T., & Wu, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2876865 · Cited by 5,545
Yilmaz, A., Javed, O., & Shah, M. (2006) · ACM Computing Surveys · doi:10.1145/1177352.1177355 · Cited by 4,792
Simple online and realtime tracking
Bewley, A., Ge, Z., Ott, L., Ramos, F., & Upcroft, B. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7533003 · Cited by 4,433
Online Object Tracking: A Benchmark
Wu, Y., Lim, J., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.312 · Cited by 4,138
Kalal, Z., Mikolajczyk, K., & Matas, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.239 · Cited by 3,285
An algorithm for tracking multiple targets
Reid, D. (1979) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1979.1102177 · Cited by 3,059
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918
Detection and Tracking of Point Features
Tomasi, C. (1991) · Cited by 2,231
A Survey on Visual Surveillance of Object Motion and Behaviors
Hu, W., Tan, T., Wang, L., & Maybank, S. (2004) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2004.829274 · Cited by 2,132
You'll never walk alone: Modeling social behavior for multi-target tracking
Pellegrini, S., Ess, A., Schindler, K., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459260 · Cited by 1,683 · cited 3×
“Employed Forces [2] repulsion, constancy, fidelity [80] repulsion, constancy, attraction, coherence [58] coherence”
BackgroundMethodRelation Networks for Object Detection
Hu, H., Gu, J., Zhang, Z., Dai, J., & Wei, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00378 · Cited by 1,524
Sonar tracking of multiple targets using joint probabilistic data association
Fortmann, T., Bar-Shalom, Y., & Scheffe, M. (1983) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.1983.1145560 · Cited by 1,460
Regularized multi--task learning
Evgeniou, T., & Pontil, M. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014067 · Cited by 1,433
Color-Based Probabilistic Tracking
Pérez, P., Hue, C., Vermaak, J., & Gangnet, M. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47969-4_44 · Cited by 1,389
Efficient Belief Propagation for Early Vision
Felzenszwalb, P. F., & Huttenlocher, D. P. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-006-7899-4 · Cited by 1,345
Lerner, A., Chrysanthou, Y., & Lischinski, D. (2007) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01089.x · Cited by 1,171
On-road vehicle detection: a review
Sun, Z., Bebis, G., & Miller, R. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.104 · Cited by 1,150
VirtualWorlds as Proxy for Multi-object Tracking Analysis
Gaidon, A., Wang, Q., Cabon, Y., & Vig, E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.470 · Cited by 1,079
A Boosted Particle Filter: Multitarget Detection and Tracking
Okuma, K., Taleghani, A., de Freitas, N., Little, J. J., & Lowe, D. G. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_3 · Cited by 1,019
Multiple Object Tracking Using K-Shortest Paths Optimization
Berclaz, J., Fleuret, F., Turetken, E., & Fua, P. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.21 · Cited by 1,015
People-tracking-by-detection and people-detection-by-tracking
Andriluka, M., Roth, S., & Schiele, B. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587583 · Cited by 824
Multicamera People Tracking with a Probabilistic Occupancy Map
Fleuret, F., Berclaz, J., Lengagne, R., & Fua, P. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1174 · Cited by 821
Globally-optimal greedy algorithms for tracking a variable number of objects
Pirsiavash, H., Ramanan, D., & Fowlkes, C. C. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995604 · Cited by 790
Wu, B., & Nevatia, R. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0027-7 · Cited by 763
MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking
Leal-Taixé, L., Milan, A., Reid, I. D., Roth, S., & Schindler, K. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.01942 · Cited by 743
Self-citationA mobile vision system for robust multi-person tracking
Ess, A., Leibe, B., Schindler, K., & Van Gool, L. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587581 · Cited by 721 · cited 1×
“Taking depth as an example, it is typically used to refine detection hypotheses [71], [84], [85], [86], [87].”
MethodA survey of appearance models in visual object tracking
Li, X., Hu, W., Shen, C., Zhang, Z., Dick, A., & Hengel, A. V. D. (2013) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2508037.2508039 · Cited by 705
Intelligent multi-camera video surveillance: A review
Wang, X. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.07.005 · Cited by 694
Learning to Track: Online Multi-object Tracking by Decision Making
Xiang, Y., Alahi, A., & Savarese, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.534 · Cited by 674
Multiple Hypothesis Tracking Revisited
Kim, C., Li, F., Ciptadi, A., & Rehg, J. M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.533 · Cited by 666
MOTS: Multi-Object Tracking and Segmentation
Voigtlaender, P., Krause, M., Osep, A., Luiten, J., Sekar, B. B. G., Geiger, A., & Leibe, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00813 · Cited by 658
Stable multi-target tracking in real-time surveillance video
Benfold, B., & Reid, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995667 · Cited by 651
Learning to associate: HybridBoosted multi-target tracker for crowded scene
Li, Y., Huang, C., & Nevatia, R. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206735 · Cited by 633
A Novel Performance Evaluation Methodology for Single-Target Trackers
Kristan, M., Matas, J., Leonardis, A., Vojir, T., Pflugfelder, R., Fernandez, G., Nebehay, G., Porikli, F., & Cehovin, L. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2516982 · Cited by 613
Online Multiperson Tracking-by-Detection from a Single, Uncalibrated Camera
Breitenstein, M. D., Reichlin, F., Leibe, B., Koller-Meier, E., & Van Gool, L. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.232 · Cited by 579
Continuous Energy Minimization for Multitarget Tracking
Milan, A., Roth, S., & Schindler, K. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.103 · Cited by 565
Self-citationCovariance Tracking using Model Update Based on Lie Algebra
Porikli, F., Tuzel, O., & Meer, P. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.94 · Cited by 562
Features for Multi-target Multi-camera Tracking and Re-identification
Ristani, E., & Tomasi, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00632 · Cited by 556
Zhan, B., Monekosso, D. N., Remagnino, P., Velastin, S. A., & Xu, L.-Q. (2008) · Machine Vision and Applications · doi:10.1007/s00138-008-0132-4 · Cited by 541
Depth and Appearance for Mobile Scene Analysis
Ess, A., Leibe, B., & Van Gool, L. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409092 · Cited by 540
Multi-cue Pedestrian Detection and Tracking from a Moving Vehicle
Gavrila, D. M., & Munder, S. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-9038-7 · Cited by 524
Robust Object Tracking by Hierarchical Association of Detection Responses
Huang, C., Wu, B., & Nevatia, R. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_58 · Cited by 497
Kasturi, R., Goldgof, D., Soundararajan, P., Manohar, V., Garofolo, J., Bowers, R., Boonstra, M., Korzhova, V., & Zhang, J. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.57 · Cited by 497
PoseTrack: A Benchmark for Human Pose Estimation and Tracking
Andriluka, M., Iqbal, U., Insafutdinov, E., Pishchulin, L., Milan, A., Gall, J., & Schiele, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00542 · Cited by 486
Self-citationWho are you with and where are you going?
Yamaguchi, K., Berg, A. C., Ortiz, L. E., & Berg, T. L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995468 · Cited by 484
New features and insights for pedestrian detection
Walk, S., Majer, N., Schindler, K., & Schiele, B. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540102 · Cited by 460
Unsupervised Bayesian Detection of Independent Motion in Crowds
Brostow, G. J., & Cipolla, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.320 · Cited by 413
Online Multi-Object Tracking with Dual Matching Attention Networks
Zhu, J., Yang, H., Liu, N., Kim, M., Zhang, W., & Yang, M.-H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_23 · Cited by 377 · cited 1×
“The modules like attention mechanism [205], LSTM [114, 97] are also employed by researchers for solving the MOT problem.”
MethodImproving Data Association by Joint Modeling of Pedestrian Trajectories and Groupings
Pellegrini, S., Ess, A., & Van Gool, L. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_33 · Cited by 373
An MCMC-Based Particle Filter for Tracking Multiple Interacting Targets
Khan, Z., Balch, T., & Dellaert, F. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24673-2_23 · Cited by 367
Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles
Leibe, B., Schindler, K., Cornelis, N., & Van Gool, L. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.170 · Cited by 354
GMCP-Tracker: Global Multi-object Tracking Using Generalized Minimum Clique Graphs
Roshan Zamir, A., Dehghan, A., & Shah, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_25 · Cited by 353
A Unified Framework for Multi-target Tracking and Collective Activity Recognition
Choi, W., & Savarese, S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33765-9_16 · Cited by 351
Cell population tracking and lineage construction with spatiotemporal context
Li, K., Miller, E. D., Chen, M., Kanade, T., Weiss, L. E., & Campbell, P. G. (2008) · Medical Image Analysis · doi:10.1016/j.media.2008.06.001 · Cited by 346
Discrete-continuous optimization for multi-target tracking
Andriyenko, A., Schindler, K., & Roth, S. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247893 · Cited by 336
Part-based multiple-person tracking with partial occlusion handling
Shu, G., Dehghan, A., Oreifej, O., Hand, E., & Shah, M. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247879 · Cited by 323
Real-time multiple vehicle detection and tracking from a moving vehicle
Betke, M., Haritaoglu, E., & Davis, L. S. (2000) · Machine Vision and Applications · doi:10.1007/s001380050126 · Cited by 318
A Linear Programming Approach for Multiple Object Tracking
Jiang, H., Fels, S., & Little, J. J. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383180 · Cited by 316
Multi-target tracking by continuous energy minimization
Andriyenko, A., & Schindler, K. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995311 · Cited by 314
Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents
Zhou, B., Wang, X., & Tang, X. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248013 · Cited by 313
A Metric for Performance Evaluation of Multi-Target Tracking Algorithms
Ristic, B., Vo, B.-N., Clark, D., & Vo, B.-T. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2140111 · Cited by 311
The Way They Move: Tracking Multiple Targets with Similar Appearance
Dicle, C., Camps, O. I., & Sznaier, M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.286 · Cited by 306
Understanding Transit Scenes: A Survey on Human Behavior-Recognition Algorithms
Candamo, J., Shreve, M., Goldgof, D. B., Sapper, D. B., & Kasturi, R. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2030963 · Cited by 298
An online learned CRF model for multi-target tracking
Yang, B., & Nevatia, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247907 · Cited by 284
Multi-target tracking by on-line learned discriminative appearance models
Kuo, C.-H., Huang, C., & Nevatia, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540148 · Cited by 279
Coupled Detection and Trajectory Estimation for Multi-Object Tracking
Leibe, B., Schindler, K., & Van Gool, L. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408936 · Cited by 272
Multi-target Tracking by Lagrangian Relaxation to Min-cost Network Flow
Butt, A. A., & Collins, R. T. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.241 · Cited by 270
Multiobject tracking as maximum weight independent set
Brendel, W., Amer, M., & Todorovic, S. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995395 · Cited by 265
Multi-Object Tracking Through Simultaneous Long Occlusions and Split-Merge Conditions
Perera, A. G. A., Srinivas, C., Hoogs, A., Brooksby, G., & Hu, W. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.195 · Cited by 261
DETECTING, TRACKING AND COUNTING FISH IN LOW QUALITY UNCONSTRAINED UNDERWATER VIDEOS
Spampinato, C., Chen-Burger, Y.-H., Nadarajan, G. D., & Fisher, R. B. (2008) · International Conference on Computer Vision Theory and Applications · doi:10.5220/0001077705140519 · Cited by 251
Robust Multiperson Tracking from a Mobile Platform
Ess, A., Leibe, B., Schindler, K., & van Gool, L. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.109 · Cited by 251
Robust Multi-Modality Multi-Object Tracking
Zhang, W., Zhou, H., Sun, S., Wang, Z., Shi, J., & Loy, C. C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00245 · Cited by 250
Tracking in cell and developmental biology
Meijering, E., Dzyubachyk, O., Smal, I., & van Cappellen, W. A. (2009) · Seminars in Cell & Developmental Biology · doi:10.1016/j.semcdb.2009.07.004 · Cited by 242
Tracking multiple people under global appearance constraints
Ben Shitrit, H., Berclaz, J., Fleuret, F., & Fua, P. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126235 · Cited by 230
Multi-target tracking by online learning of non-linear motion patterns and robust appearance models
Yang, B., & Nevatia, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247892 · Cited by 228
Learning to Track and Identify Players from Broadcast Sports Videos
Lu, W.-L., Ting, J.-A., Little, J. J., & Murphy, K. P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.242 · Cited by 223
Xing, J., Ai, H., & Lao, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206745 · Cited by 215
Self-citationLeal-Taixe, L., Pons-Moll, G., & Rosenhahn, B. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130233 · Cited by 211
How does person identity recognition help multi-person tracking?
Kuo, C.-H., & Nevatia, R. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995384 · Cited by 205
Data-driven crowd analysis in videos
Rodriguez, M., Sivic, J., Laptev, I., & Audibert, J.-Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126374 · Cited by 203
Robust People Tracking with Global Trajectory Optimization
Berclaz, J., Fleuret, F., & Fua, P. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.258 · Cited by 201
Detection- and Trajectory-Level Exclusion in Multiple Object Tracking
Milan, A., Schindler, K., & Roth, S. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.472 · Cited by 196
Self-citationTracking in unstructured crowded scenes
Rodriguez, M., Ali, S., & Kanade, T. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459301 · Cited by 191
Robust Real-Time Visual Tracking Using Pixel-Wise Posteriors
Bibby, C., & Reid, I. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_61 · Cited by 185
Detection and Tracking of Large Number of Targets in Wide Area Surveillance
Reilly, V., Idrees, H., & Shah, M. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15558-1_14 · Cited by 184
Online Multi-object Tracking via Structural Constraint Event Aggregation
Yoon, J. H., Lee, C.-R., Yang, M.-H., & Yoon, K.-J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.155 · Cited by 181
Detection and Tracking of Occluded People
Tang, S., Andriluka, M., & Schiele, B. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-013-0664-6 · Cited by 173
Intelligent visual surveillance — A survey
Kim, I. S., Choi, H. S., Yi, K. M., Choi, J. Y., & Kong, S. G. (2010) · International Journal of Control, Automation and Systems · doi:10.1007/s12555-010-0501-4 · Cited by 160
Multiple Target Tracking in World Coordinate with Single, Minimally Calibrated Camera
Choi, W., & Savarese, S. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15561-1_40 · Cited by 151
Random field topic model for semantic region analysis in crowded scenes from tracklets
Zhou, B., Wang, X., & Tang, X. (2011) · doi:10.1109/cvpr.2011.5995459 · Cited by 151
Hu, W., Li, X., Luo, W., Zhang, X., Maybank, S. J., & Zhang, Z. M. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.42 · Cited by 149
Self-citationMultiple 3D Object tracking for augmented reality
Park, Y.-M., Lepetit, V., & Woo, W. (2008) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2008.4637336 · Cited by 147
Globally optimal solution to multi-object tracking with merged measurements
Henriques, J. F., Caseiro, R., & Batista, J. P. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126532 · Cited by 146
Multi-Target Tracking - Linking Identities using Bayesian Network Inference
Nillius, P., Sullivan, J., & Carlsson, S. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.198 · Cited by 145
Preserving Structure in Model-Free Tracking
Zhang, L., & van der Maaten, L. J. P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.221 · Cited by 144
A Bayesian Framework for Multi-cue 3D Object Tracking
Giebel, J., Gavrila, D. M., & Schnörr, C. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24673-2_20 · Cited by 142
Xing, J., Ai, H., Liu, L., & Lao, S. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2102045 · Cited by 142
Self-citationTracking Pedestrians Using Local Spatio-Temporal Motion Patterns in Extremely Crowded Scenes
Kratz, L., & Nishino, K. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.173 · Cited by 141
Learning pedestrian dynamics from the real world
Scovanner, P., & Tappen, M. F. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459224 · Cited by 135
Improving multi-target tracking via social grouping
Qin, Z., & Shelton, C. R. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247899 · Cited by 134
Multi-Object Tracking Using Color, Texture and Motion
Takala, V., & Pietikäinen, M. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383506 · Cited by 134
Multiple Target Tracking Using Spatio-Temporal Markov Chain Monte Carlo Data Association
Yu, Q., Medioni, G., & Cohen, I. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.382991 · Cited by 132 · cited 1×
“This is by far the most popular model [32], [97], [98].”
BackgroundCannons, K. J. (2008) · Cited by 124
A Stochastic Graph Evolution Framework for Robust Multi-target Tracking
Bi, S., Jeng, T.-Y., Staudt, E., & Roy–Chowdhury, A. K. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_44 · Cited by 120
Online Learned Discriminative Part-Based Appearance Models for Multi-human Tracking
Yang, B., & Nevatia, R. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33718-5_35 · Cited by 113
Tracking Large Variable Numbers of Objects in Clutter
Betke, M., Hirsh, D., Bagchi, A., Hristov, N. I., Makris, N. C., & Kunz, T. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.382994 · Cited by 110
Hypergraphs for Joint Multi-view Reconstruction and Multi-object Tracking
Hofmann, M. R., Wolf, D., & Rigoll, G. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.468 · Cited by 107
Coupling detection and data association for multiple object tracking
Wu, Z., Thangali, A., Sclaroff, S., & Betke, M. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247896 · Cited by 106
Tracking with local spatio-temporal motion patterns in extremely crowded scenes
Kratz, L., & Nishino, K. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540149 · Cited by 106
FollowMe: Efficient Online Min-Cost Flow Tracking with Bounded Memory and Computation
Lenz, P., Geiger, A., & Urtasun, R. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.496 · Cited by 105
Globally Optimal Multi-target Tracking on a Hexagonal Lattice
Andriyenko, A., & Konrad Schindler, B. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_34 · Cited by 100
Branch-and-price global optimization for multi-view multi-target tracking
Leal-Taixé, L., Pons‐Moll, G., & Rosenhahn, B. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247901 · Cited by 99
Finding the best set of K paths through a trellis with application to multitarget tracking
Wolf, J. K., Viterbi, A. M., & Dixon, G. S. (1989) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/7.18692 · Cited by 97
Detection driven adaptive multi-cue integration for multiple human tracking
Yang, M., Lv, F., Xu, W., & Gong, Y. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459252 · Cited by 95
Learning People Detectors for Tracking in Crowded Scenes
Tang, S., Andriluka, M., Milan, A., Konrad Schindler, B., Roth, S., & Schiele, B. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.134 · Cited by 91
Self-citationDetecting global motion patterns in complex videos
Hu, M. C., Ali, S., & Shah, M. A. (2008) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2008.4760950 · Cited by 87
Multi-person Tracking with Sparse Detection and Continuous Segmentation
Mitzel, D., Horbert, E., Ess, A., & Leibe, B. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_29 · Cited by 86
Improving an Object Detector and Extracting Regions Using Superpixels
Shu, G., Dehghan, A., & Shah, M. A. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.477 · Cited by 83
(MP)2T: Multiple People Multiple Parts Tracker
Izadinia, H., Saleemi, I., Li, W., & Shah, M. A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33783-3_8 · Cited by 79
Two-Granularity Tracking: Mediating Trajectory and Detection Graphs for Tracking under Occlusions
Fragkiadaki, K., Zhang, W., Zhang, G., & Shi, J. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33715-4_40 · Cited by 78
Tracking Multiple People Under Occlusion Using MultipleCameras
Chang, T.-H., Gong, S., & Ong, E.-J. (2000) · British Machine Vision Conference (BMVC) · doi:10.5244/c.14.57 · Cited by 71
Multi-target tracking by learning local-to-global trajectory models
Zhang, S., Wang, J., Wang, Z., Gong, Y., & Liu, Y. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.08.013 · Cited by 71
Online Multi-person Tracking by Tracker Hierarchy
Zhang, J., Presti, L. L., & Sclaroff, S. (2012) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2012.51 · Cited by 67
Yu, S.-I., Yang, Y., & Hauptmann, A. G. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.476 · Cited by 67
Object Detection and Pose Tracking for Augmented Reality: Recent Approaches
Uchiyama, H., & Marchand, É. (2012) · HAL · Cited by 67
Sugimura, D., Kitani, K., Okabe, T., Sato, Y., & Sugimoto, A. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459286 · Cited by 66
Detection and Tracking of Multiple Humans with Extensive Pose Articulation
Zhang, L., Wu, B., & Nevatia, R. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4408940 · Cited by 59
Game-Theoretic Multiple Target Tracking
Yang, M., Yu, T., & Wu, Y. N. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4408942 · Cited by 52
Tracking Using Motion Patterns for Very Crowded Scenes
Zhao, X., Gong, D., & Medioni, G. G. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33709-3_23 · Cited by 51
Multi-target Tracking by Rank-1 Tensor Approximation
Shi, X., Ling, H., Xing, J., & Hu, W. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.309 · Cited by 49
Self-citationBi-label Propagation for Generic Multiple Object Tracking
Luo, W., Kim, T., Stenger, B., Zhao, X., & Cipolla, R. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.168 · Cited by 47
Self-citationArticulated Multi-body Tracking under Egomotion
Gammeter, S., Ess, A., Jaeggli, T., Konrad Schindler, B., Leibe, B., & Gool, L. V. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88688-4_60 · Cited by 44
Observe-and-explain: A new approach for multiple hypotheses tracking of humans and objects
Ryoo, M. S., & Aggarwal, J. K. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587568 · Cited by 43
Real-time multi-person tracking with detector assisted structure propagation
Mitzel, D., & Leibe, B. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130357 · Cited by 40
A rank constrained continuous formulation of multi-frame multi-target tracking problem
Shafique, K. H., Lee, M. W., & Haering, N. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587577 · Cited by 35
Discriminative Label Propagation for Multi-object Tracking with Sporadic Appearance Features
Kumar, K. C. A., & Vleeschouwer, C. D. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.250 · Cited by 31
Automatic Tracking of a Large Number of Moving Targets in 3D
Liu, Y., Li, H., & Chen, Y. Q. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33765-9_52 · Cited by 29
Group Tracking: Exploring Mutual Relations for Multiple Object Tracking
Duan, G., Ai, H., Cao, S., & Lao, S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33712-3_10 · Cited by 26
Multi-target Tracking with Motion Context in Tensor Power Iteration
Shi, X., Ling, H., Hu, W., Yuan, C., & Xing, J. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.450 · Cited by 26
Self-citationSparsity-driven people localization algorithm: Evaluation in crowded scenes environments
Alahi, A., Jacques, L., Boursier, Y., et al. (2009) · doi:10.1109/pets-winter.2009.5399487 · Cited by 24
Automatic Topic Discovery for Multi-Object Tracking
Luo, W., Stenger, B., Zhao, X., & Kim, T. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9789 · Cited by 23
Self-citationDistributed data association and filtering for multiple target tracking
Yu, T., Wu, Y. N., Krahnstoever, N. O., et al. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587560 · Cited by 22
Orderless Tracking through Model-Averaged Posterior Estimation
Hong, S., Kwak, S., & Han, B. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.285 · Cited by 22
Leichter, I., & Krupka, E. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.70 · Cited by 18
Koh, Y. J., & Kim, C. (2017) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.389 · Cited by 18
Generic Object Crowd Tracking by Multi-Task Learning
Luo, W., & Kim, T. (2013) · British Machine Vision Conference (BMVC) · doi:10.5244/c.27.73 · Cited by 17
Self-citationSimultaneous clustering and tracking unknown number of objects
Ishiguro, K., Yamada, T., & Ueda, N. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587728 · Cited by 10
Research works printed but not linked: 1
- Forsyth, 2006, Computational studies of human motion: part 1, tracking and motion synthesis, Found. Trends Comput. Graph. Vis., 1, 77
Cited by
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
“Object tracking is also often referred to as multiple object tracking (MOT) [180] and detection and tracking of multiple objects (DATMO) [181].”
BackgroundA review of convolutional neural networks in computer vision
Zhao, X., Wang, L., Zhang, Y., Han, X., Deveci, M., & Parmar, M. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10721-6 · Cited by 1,148
Deep learning in video multi-object tracking: A survey
Ciaparrone, G., Luque Sánchez, F., Tabik, S., Troiano, L., Tagliaferri, R., & Herrera, F. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.023 · Cited by 665
Wang, Q., Teng, Z., Xing, J., Gao, J., Hu, W., & Maybank, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00510 · Cited by 604
Self-citationLearning by Tracking: Siamese CNN for Robust Target Association
Leal-Taixe, L., Canton-Ferrer, C., & Schindler, K. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.59 · Cited by 444
Metadata
- Authors
- Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., & Kim, T.-K.
- Venue
- Artificial Intelligence
- Publisher
- Elsevier BV
- Published
- 2021-04
- Volume
- 293
- Pages
- 103448
- ISSN
- 0004-3702 (ISSN-L)
- OpenAlex
- W2295615964
- Cited by
- 1,099
- References
- 160
- FWCI
- 49.06
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (vor, 1461 d)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.