Coupled Detection and Trajectory Estimation for Multi-Object Tracking
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
We present a novel approach for multi-object tracking which considers object detection and spacetime trajectory estimation as a coupled optimization problem. It is formulated in a hypothesis selection framework and builds upon a state-of-the-art pedestrian detector. At each time instant, it searches for the globally optimal set of spacetime trajectories which provides the best explanation for the current image and for all evidence collected so far, while satisfying the constraints that no two objects may occupy the same physical space, nor explain the same image pixels at any point in time. Successful trajectory hypotheses are fed back to guide object detection in future frames. The optimization procedure is kept efficient through incremental computation and conservative hypothesis pruning. The resulting approach can initialize automatically and track a large and varying number of persons over long periods and through complex scenes with clutter, occlusions, and large-scale background changes. Also, the global optimization framework allows our system to recover from mismatches and temporarily lost tracks. We demonstrate the feasibility of the proposed approach on several challenging video sequences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Adaptive background mixture models for real-time tracking
Stauffer, C., & Grimson, W. E. L. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.784637 · Cited by 6,923
GELB, A. (1974) · CERN Document Server (European Organization for Nuclear Research) · Cited by 6,405
CONDENSATION—Conditional Density Propagation for Visual Tracking
Isard, M., & Blake, A. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008078328650 · Cited by 4,886
Comaniciu, D., Ramesh, V., & Meer, P. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1195991 · Cited by 4,560 · cited 1×
“The second subproblem is typically addressed by classic tracking approaches, such as Extended Kalman Filters (EKF) [7], particle filtering [10], or Mean-Shift tracking [3], which rely on a Markov assumption and carry the associated danger of drifting away from the correct target.”
MethodAn algorithm for tracking multiple targets
Reid, D. (1979) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1979.1102177 · Cited by 3,059
Sonar tracking of multiple targets using joint probabilistic data association
Fortmann, T., Bar-Shalom, Y., & Scheffe, M. (1983) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.1983.1145560 · Cited by 1,460
A Boosted Particle Filter: Multitarget Detection and Tracking
Okuma, K., Taleghani, A., de Freitas, N., Little, J. J., & Lowe, D. G. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_3 · Cited by 1,019
Grabner, H., & Bischof, H. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.215 · Cited by 979
Cited by
Kalal, Z., Mikolajczyk, K., & Matas, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.239 · Cited by 3,285
Privacy preserving crowd monitoring: Counting people without people models or tracking
Chan, A. B., Liang, Z.-S. J., & Vasconcelos, N. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587569 · Cited by 1,172
Multiple object tracking: A literature review
Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., & Kim, T.-K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2020.103448 · Cited by 1,099
Multiple Object Tracking Using K-Shortest Paths Optimization
Berclaz, J., Fleuret, F., Turetken, E., & Fua, P. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.21 · Cited by 1,015
Global data association for multi-object tracking using network flows
Zhang, L., Li, Y., & Nevatia, R. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587584 · Cited by 925
People-tracking-by-detection and people-detection-by-tracking
Andriluka, M., Roth, S., & Schiele, B. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587583 · Cited by 824
Globally-optimal greedy algorithms for tracking a variable number of objects
Pirsiavash, H., Ramanan, D., & Fowlkes, C. C. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995604 · Cited by 790
A mobile vision system for robust multi-person tracking
Ess, A., Leibe, B., Schindler, K., & Van Gool, L. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587581 · Cited by 721
Self-citationStable multi-target tracking in real-time surveillance video
Benfold, B., & Reid, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995667 · Cited by 651
Learning to associate: HybridBoosted multi-target tracker for crowded scene
Li, Y., Huang, C., & Nevatia, R. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206735 · Cited by 633
Continuous Energy Minimization for Multitarget Tracking
Milan, A., Roth, S., & Schindler, K. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.103 · Cited by 565
Self-citationRobust tracking-by-detection using a detector confidence particle filter
Breitenstein, M. D., Reichlin, F., Leibe, B., Koller-Meier, E., & Van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459278 · Cited by 545
Self-citationMonocular 3D pose estimation and tracking by detection
Andriluka, M., Roth, S., & Schiele, B. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540156 · Cited by 508
Online Multi-Target Tracking Using Recurrent Neural Networks
Milan, A., Rezatofighi, S. H., Dick, A., Reid, I., & Schindler, K. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11194 · Cited by 506
Self-citationRobust Object Tracking by Hierarchical Association of Detection Responses
Huang, C., Wu, B., & Nevatia, R. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_58 · Cited by 497
Counting People With Low-Level Features and Bayesian Regression
Chan, A. B., & Vasconcelos, N. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2172800 · Cited by 394
Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles
Leibe, B., Schindler, K., Cornelis, N., & Van Gool, L. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.170 · Cited by 354
Self-citationGMCP-Tracker: Global Multi-object Tracking Using Generalized Minimum Clique Graphs
Roshan Zamir, A., Dehghan, A., & Shah, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_25 · Cited by 353
Human Tracking Using Convolutional Neural Networks
Fan, J., Xu, W., Wu, Y., & Gong, Y. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2066286 · Cited by 352
Joint Probabilistic Data Association Revisited
Rezatofighi, S. H., Milan, A., Zhang, Z., Shi, Q., Dick, A., & Reid, I. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.349 · Cited by 350
Multi-target tracking by continuous energy minimization
Andriyenko, A., & Schindler, K. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995311 · Cited by 314
Self-citationUnderstanding Transit Scenes: A Survey on Human Behavior-Recognition Algorithms
Candamo, J., Shreve, M., Goldgof, D. B., Sapper, D. B., & Kasturi, R. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2030963 · Cited by 298
Multi-target tracking by on-line learned discriminative appearance models
Kuo, C.-H., Huang, C., & Nevatia, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540148 · Cited by 279
Multiobject tracking as maximum weight independent set
Brendel, W., Amer, M., & Todorovic, S. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995395 · Cited by 265
Object Detection and Tracking for Autonomous Navigation in Dynamic Environments
Ess, A., Schindler, K., Leibe, B., & Van Gool, L. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910365417 · Cited by 191
“Independently, Leibe et al. (2007a) introduced a tracking framework in which a redundant set of candidate trajectories is generated online in each time step and is pruned to a consistent subset using statistical model selection.”
MethodSelf-citationRobust Fruit Counting: Combining Deep Learning, Tracking, and Structure from Motion
Liu, X., Chen, S. W., Aditya, S., Sivakumar, N., Dcunha, S., Qu, C., Taylor, C. J., Das, J., & Kumar, V. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594239 · Cited by 135
Pedestrian detection in automotive safety: Understanding state-of-the-art
Ragesh, N. K., & Rajesh, R. (2019) · IEEE Access · doi:10.1109/access.2019.2909992 · Cited by 57
“Leibe et al. [130] considered object detection and tracking estimation as a coupled optimization problem.”
Background
Metadata
- Authors
- Leibe, B., Schindler, K., & Van Gool, L.
- Venue
- 2007 IEEE 11th International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2007
- Pages
- 1-8
- OpenAlex
- W2148442626
- Cited by
- 272
- References
- 24
- FWCI
- 15.88
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.