The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Continuous Energy Minimization for Multitarget Tracking
Abstract
Many recent advances in multiple target tracking aim at finding a (nearly) optimal set of trajectories within a temporal window. To handle the large space of possible trajectory hypotheses, it is typically reduced to a finite set by some form of data-driven or regular discretization. In this work, we propose an alternative formulation of multitarget tracking as minimization of a continuous energy. Contrary to recent approaches, we focus on designing an energy that corresponds to a more complete representation of the problem, rather than one that is amenable to global optimization. Besides the image evidence, the energy function takes into account physical constraints, such as target dynamics, mutual exclusion, and track persistence. In addition, partial image evidence is handled with explicit occlusion reasoning, and different targets are disambiguated with an appearance model. To nevertheless find strong local minima of the proposed nonconvex energy, we construct a suitable optimization scheme that alternates between continuous conjugate gradient descent and discrete transdimensional jump moves. These moves, which are executed such that they always reduce the energy, allow the search to escape weak minima and explore a much larger portion of the search space of varying dimensionality. We demonstrate the validity of our approach with an extensive quantitative evaluation on several public data sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
GREEN, P. J. (1995) · Biometrika · doi:10.1093/biomet/82.4.711 · Cited by 5,930
An algorithm for tracking multiple targets
Reid, D. (1979) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1979.1102177 · Cited by 3,059
A Boosted Particle Filter: Multitarget Detection and Tracking
Okuma, K., Taleghani, A., de Freitas, N., Little, J. J., & Lowe, D. G. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_3 · Cited by 1,019
Multiple Object Tracking Using K-Shortest Paths Optimization
Berclaz, J., Fleuret, F., Turetken, E., & Fua, P. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.21 · Cited by 1,015
Global data association for multi-object tracking using network flows
Zhang, L., Li, Y., & Nevatia, R. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587584 · Cited by 925
Wu, B., & Nevatia, R. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.74 · Cited by 813
Globally-optimal greedy algorithms for tracking a variable number of objects
Pirsiavash, H., Ramanan, D., & Fowlkes, C. C. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995604 · Cited by 790
Stable multi-target tracking in real-time surveillance video
Benfold, B., & Reid, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995667 · Cited by 651
Learning to associate: HybridBoosted multi-target tracker for crowded scene
Li, Y., Huang, C., & Nevatia, R. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206735 · Cited by 633
Robust tracking-by-detection using a detector confidence particle filter
Breitenstein, M. D., Reichlin, F., Leibe, B., Koller-Meier, E., & Van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459278 · Cited by 545
Monocular 3D pose estimation and tracking by detection
Andriluka, M., Roth, S., & Schiele, B. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540156 · Cited by 508
Self-citationPETS2009: Dataset and challenge
Ferryman, J., & Shahrokni, A. (2009) · 2009 Twelfth IEEE International Workshop on Performance Evaluation of Tracking and Surveillance · doi:10.1109/pets-winter.2009.5399556 · Cited by 483
New features and insights for pedestrian detection
Walk, S., Majer, N., Schindler, K., & Schiele, B. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540102 · Cited by 460
Self-citationMaintaining multimodality through mixture tracking
Vermaak, Doucet, & Perez (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238473 · Cited by 390
Density-aware person detection and tracking in crowds
Rodriguez, M., Laptev, I., Sivic, J., & Audibert, J.-Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126526 · Cited by 341
Markov Chain Monte Carlo Data Association for Multi-Target Tracking
Oh, S., Russell, S., & Sastry, S. (2009) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2009.2012975 · Cited by 336
Multi-target tracking using joint probabilistic data association
Fortmann, T., Bar-Shalom, Y., & Scheffe, M. (1980) · 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes · doi:10.1109/cdc.1980.271915 · Cited by 323
A Linear Programming Approach for Multiple Object Tracking
Jiang, H., Fels, S., & Little, J. J. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383180 · Cited by 316
Multi-target tracking by continuous energy minimization
Andriyenko, A., & Schindler, K. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995311 · Cited by 314
Self-citationMulti-target tracking by on-line learned discriminative appearance models
Kuo, C.-H., Huang, C., & Nevatia, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540148 · Cited by 279
Coupled Detection and Trajectory Estimation for Multi-Object Tracking
Leibe, B., Schindler, K., & Van Gool, L. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408936 · Cited by 272
Self-citationMultiobject tracking as maximum weight independent set
Brendel, W., Amer, M., & Todorovic, S. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995395 · Cited by 265
Robust Multiperson Tracking from a Mobile Platform
Ess, A., Leibe, B., Schindler, K., & van Gool, L. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.109 · Cited by 251
Self-citationMulti-cue pedestrian classification with partial occlusion handling
Enzweiler, M., Eigenstetter, A., Schiele, B., & Gavrila, D. M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540111 · Cited by 233
Tracking multiple people under global appearance constraints
Ben Shitrit, H., Berclaz, J., Fleuret, F., & Fua, P. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126235 · Cited by 230
Measure Locally, Reason Globally: Occlusion-sensitive Articulated Pose Estimation
Sigal, L., & Black, M. J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.180 · Cited by 221
Xing, J., Ai, H., & Lao, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206745 · Cited by 215
Tracking the invisible: Learning where the object might be
Grabner, H., Matas, J., Van Gool, L., & Cattin, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539819 · Cited by 204
Robust People Tracking with Global Trajectory Optimization
Berclaz, J., Fleuret, F., & Fua, P. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.258 · Cited by 201
Multi view image surveillance and tracking
Black, J., Ellis, T., & Rosin, P. (2003) · Workshop on Motion and Video Computing, 2002. Proceedings. · doi:10.1109/motion.2002.1182230 · Cited by 182
Stiefelhagen, R., Bernardin, K., Bowers, R., Garofolo, J., Mostefa, D., & Soundararajan, P. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-69568-4_1 · Cited by 158
Globally optimal solution to multi-object tracking with merged measurements
Henriques, J. F., Caseiro, R., & Batista, J. P. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126532 · Cited by 134
PETS2010: Dataset and Challenge
Ferryman, J. M., & Ellis, A. (2010) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2010.90 · Cited by 120
Multiple object tracking using flow linear programming
Berclaz, J., Fleuret, F., & Fua, P. (2009) · IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS) · doi:10.1109/pets-winter.2009.5399488 · Cited by 116
We Are Family: Joint Pose Estimation of Multiple Persons
Eichner, M. L., & Ferrari, V. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_17 · Cited by 109
Globally Optimal Multi-target Tracking on a Hexagonal Lattice
Andriyenko, A., & Konrad Schindler, B. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_34 · Cited by 100
Tracking with local spatio-temporal motion patterns in extremely crowded scenes
Kratz, L., & Nishino, K. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540149 · Cited by 89
Monocular 3D scene understanding with explicit occlusion reasoning
Wojek, C., Walk, S., Roth, S., & Schiele, B. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995547 · Cited by 82
Self-citationEfficient track linking methods for track graphs using network-flow and set-cover techniques
Wu, Z., Kunz, T., & Betke, M. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995515 · Cited by 79
An analytical formulation of global occlusion reasoning for multi-target tracking
Andriyenko, A., Roth, S., & Konrad Schindler, B. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130472 · Cited by 68
Self-citationMulti-target Data Association by Tracklets with Unsupervised Parameter Estimation
Ge, W., & Collins, R. T. (2008) · British Machine Vision Conference (BMVC) · doi:10.5244/c.22.93 · Cited by 41
Cited by
ByteTrack: Multi-object Tracking by Associating Every Detection Box
Zhang, Y., Sun, P., Jiang, Y., Yu, D., Weng, F., Yuan, Z., Luo, P., Liu, W., & Wang, X. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20047-2_1 · Cited by 2,470
FairMOT: On the Fairness of Detection and Re-identification in Multiple Object Tracking
Zhang, Y., Wang, C., Wang, X., Zeng, W., & Liu, W. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01513-4 · Cited by 1,861
MOT16: A Benchmark for Multi-Object Tracking
Milan, A., Leal-Taixe, L., Reid, I., Roth, S., & Schindler, K. (2016) · arXiv · doi:10.48550/arxiv.1603.00831 · Cited by 1,309
“The easiest sequence for tracking (S2L1) consisted of a scene with few pedestrians, and for that sequence state-of-the-art methods perform extremely well with accuracies of over 90% given a good set of initial detections [23], [33], [47].”
BackgroundMethodSelf-citationThe Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking
Du, D., Qi, Y., Yu, H., Yang, Y., Duan, K., Li, G., Zhang, W., Huang, Q., & Tian, Q. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_23 · Cited by 1,099
Multiple object tracking: A literature review
Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., & Kim, T.-K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2020.103448 · Cited by 1,099
Self-citation
Metadata
- Authors
- Milan, A., Roth, S., & Schindler, K.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2014-01
- Volume
- 36
- Issue
- 1
- Pages
- 58-72
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2083049794
- Cited by
- 565
- References
- 42
- FWCI
- 63.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.