The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Online Multiperson Tracking-by-Detection from a Single, Uncalibrated Camera
Open accessAbstract
In this paper, we address the problem of automatically detecting and tracking a variable number of persons in complex scenes using a monocular, potentially moving, uncalibrated camera. We propose a novel approach for multiperson tracking-by-detection in a particle filtering framework. In addition to final high-confidence detections, our algorithm uses the continuous confidence of pedestrian detectors and online-trained, instance-specific classifiers as a graded observation model. Thus, generic object category knowledge is complemented by instance-specific information. The main contribution of this paper is to explore how these unreliable information sources can be used for robust multiperson tracking. The algorithm detects and tracks a large number of dynamically moving people in complex scenes with occlusions, does not rely on background modeling, requires no camera or ground plane calibration, and only makes use of information from the past. Hence, it imposes very few restrictions and is suitable for online applications. Our experiments show that the method yields good tracking performance in a large variety of highly dynamic scenarios, such as typical surveillance videos, webcam footage, or sports sequences. We demonstrate that our algorithm outperforms other methods that rely on additional information. Furthermore, we analyze the influence of different algorithm components on the robustness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
The Hungarian method for the assignment problem
Kuhn, H. W. (1955) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800020109 · Cited by 13,120
Novel approach to nonlinear/non-Gaussian Bayesian state estimation
Gordon, N. J., Salmond, D. J., & Smith, A. F. M. (1993) · IEE Proceedings F Radar and Signal Processing · doi:10.1049/ip-f-2.1993.0015 · Cited by 7,550
Sequential Monte Carlo Methods in Practice
(2001) · Springer eBooks · doi:10.1007/978-1-4757-3437-9 · Cited by 7,366
CONDENSATION—Conditional Density Propagation for Visual Tracking
Isard, M., & Blake, A. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008078328650 · Cited by 4,886
An algorithm for tracking multiple targets
Reid, D. (1979) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1979.1102177 · Cited by 3,059
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918
Statistics of Directional Data.
Gokhale, D. V., & Mardia, K. V. (1973) · Biometrics · doi:10.2307/2529189 · Cited by 2,442
You'll never walk alone: Modeling social behavior for multi-target tracking
Pellegrini, S., Ess, A., Schindler, K., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459260 · Cited by 1,683 · cited 1×
“Additionally, to handle occlusions more robustly, other researchers use 3D information [11], [15], train detectors for individual body parts [45], or apply application-specific motion models [35].”
BackgroundStatistics of Directional Data
(1972) · Elsevier eBooks · doi:10.1016/c2013-0-07425-7 · Cited by 1,637
Sonar tracking of multiple targets using joint probabilistic data association
Fortmann, T., Bar-Shalom, Y., & Scheffe, M. (1983) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.1983.1145560 · Cited by 1,460
Avidan, S. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.35 · Cited by 1,112
A Boosted Particle Filter: Multitarget Detection and Tracking
Okuma, K., Taleghani, A., de Freitas, N., Little, J. J., & Lowe, D. G. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_3 · Cited by 1,019
Grabner, H., & Bischof, H. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.215 · Cited by 979
Robust Object Detection with Interleaved Categorization and Segmentation
Leibe, B., Leonardis, A., & Schiele, B. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0095-3 · Cited by 933
Self-citationGlobal data association for multi-object tracking using network flows
Zhang, L., Li, Y., & Nevatia, R. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587584 · Cited by 925
People-tracking-by-detection and people-detection-by-tracking
Andriluka, M., Roth, S., & Schiele, B. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587583 · Cited by 824
MCMC-based particle filtering for tracking a variable number of interacting targets
Khan, Z., Balch, T., & Dellaert, F. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.223 · Cited by 771
Wu, B., & Nevatia, R. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0027-7 · Cited by 763
Learning to associate: HybridBoosted multi-target tracker for crowded scene
Li, Y., Huang, C., & Nevatia, R. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206735 · Cited by 633
Robust tracking-by-detection using a detector confidence particle filter
Breitenstein, M. D., Reichlin, F., Leibe, B., Koller-Meier, E., & Van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459278 · Cited by 545
Self-citationRobust Object Tracking by Hierarchical Association of Detection Responses
Huang, C., Wu, B., & Nevatia, R. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_58 · Cited by 497
Tracking multiple humans in complex situations
Zhao, T., & Nevatia, R. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.73 · Cited by 490
Maintaining multimodality through mixture tracking
Vermaak, Doucet, & Perez (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238473 · Cited by 390
Probabilistic data association methods for tracking complex visual objects
Rasmussen, C., & Hager, G. D. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927458 · Cited by 376
Schulz, D., Burgard, W., Fox, D., & Cremers, A. B. (2002) · Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164) · doi:10.1109/robot.2001.932850 · Cited by 370
Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles
Leibe, B., Schindler, K., Cornelis, N., & Van Gool, L. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.170 · Cited by 354
Self-citationA Multiview Approach to Tracking People in Crowded Scenes Using a Planar Homography Constraint
Khan, S. M., & Shah, M. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_11 · Cited by 337
Statistics of Directional Data.
Upton, G. J. G., & Mardia, K. V. (1973) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2345118 · Cited by 308
Li, Y., Ai, H., Yamashita, T., Lao, S., & Kawade, M. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.73 · Cited by 283
Multi-target tracking by on-line learned discriminative appearance models
Kuo, C.-H., Huang, C., & Nevatia, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540148 · Cited by 279
Multi-Object Tracking Through Simultaneous Long Occlusions and Split-Merge Conditions
Perera, A. G. A., Srinivas, C., Hoogs, A., Brooksby, G., & Hu, W. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.195 · Cited by 261
Robust Multiperson Tracking from a Mobile Platform
Ess, A., Leibe, B., Schindler, K., & van Gool, L. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.109 · Cited by 251
Self-citationMaintaining Multi-Modality through Mixture Tracking
Vermaak, J., & Arnaud Doucet, B. (2003) · Cited by 206
Robust People Tracking with Global Trajectory Optimization
Berclaz, J., Fleuret, F., & Fua, P. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.258 · Cited by 201
Robust Visual Tracking for Multiple Targets
Cai, Y., de Freitas, N., & Little, J. J. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_9 · Cited by 189
Approximate Bayesian multibody tracking
Lanz, O. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.177 · Cited by 182
fastHOG – a real-time GPU implementation of HOG
Prisacariu, V. A., & Reid, I. D. (2011) · Cited by 152
Face detection and tracking in a video by propagating detection probabilities
Verma, R., Schmid, C., & Mikolajczyk, K. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1233896 · Cited by 138
A Bayesian Framework for Multi-cue 3D Object Tracking
Giebel, J., Gavrila, D. M., & Schnörr, C. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24673-2_20 · Cited by 124
Sliding-Windows for Rapid Object Class Localization: A Parallel Technique
Wojek, C., Dorkó, G., Schulz, A., & Schiele, B. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69321-5_8 · Cited by 117
Vision-Based Multiple Interacting Targets Tracking via On-Line Supervised Learning
Song, X., Cui, J., Zha, H., & Zhao, H. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88690-7_48 · Cited by 77
Articulated Multi-body Tracking under Egomotion
Gammeter, S., Ess, A., Jaeggli, T., Konrad Schindler, B., Leibe, B., & Gool, L. V. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88688-4_60 · Cited by 44
Self-citationFinding people in archive films through tracking
Ren, X. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587533 · Cited by 33
Robust Object Tracking based on Detection with Soft Decision
Wu, B., Zhang, L., Singh, V. K., et al. (2008) · doi:10.1109/wmvc.2008.4544052 · Cited by 2
Cited by
VirtualWorlds as Proxy for Multi-object Tracking Analysis
Gaidon, A., Wang, Q., Cabon, Y., & Vig, E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.470 · Cited by 1,079
UA-DETRAC: A New Benchmark and Protocol for Multi-Object Detection and Tracking
Wen, L., Du, D., Cai, Z., Lei, Z., Chang, M.-C., Qi, H., Lim, J., Yang, M.-H., & Lyu, S. (2020) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2020.102907 · Cited by 804
Learning to Track: Online Multi-object Tracking by Decision Making
Xiang, Y., Alahi, A., & Savarese, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.534 · Cited by 674
Multiple Hypothesis Tracking Revisited
Kim, C., Li, F., Ciptadi, A., & Rehg, J. M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.533 · Cited by 666
Chu, Q., Ouyang, W., Li, H., Wang, X., Liu, B., & Yu, N. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.518 · Cited by 406
Metadata
- Authors
- Breitenstein, M. D., Reichlin, F., Leibe, B., Koller-Meier, E., & Van Gool, L.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2011-09
- Volume
- 33
- Issue
- 9
- Pages
- 1820-1833
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2148958980
- Cited by
- 579
- References
- 45
- FWCI
- 40.17
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
