The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles
Abstract
We present a novel approach for multi-object tracking which considers object detection and spacetime trajectory estimation as a coupled optimization problem. Our approach is formulated in a Minimum Description Length hypothesis selection framework, which allows it to recover from mismatches and temporarily lost tracks. Building upon a state-of-the-art object detector, it performs multiview/multicategory object recognition to detect cars and pedestrians in the input images. The 2D object detections are checked for their consistency with (automatically estimated) scene geometry and are converted to 3D observations which are accumulated in a world coordinate frame. A subsequent trajectory estimation module analyzes the resulting 3D observations to find phyically plausible spacetime trajectories. Tracking is achieved by performing model selection after every frame. At each time instant, our approach searches for the globally optimal set of spacetime trajectories which provides the best explanation for the current image and for all evidence collected so far, while satisfying the constraints that no two objects may occupy the same physical space, nor explain the same image pixels at any point in time. Successful trajectory hypotheses are then fed back to guide object detection in future frames. The optimization procedure is kept efficient throught incremental computation and conservative hypothesis pruning. We evaluate our approach on several challenging video sequences and demonstrate its performance on both a surveillance-type scenario and a scenario where the input videos are taken from inside a moving vehicle passing through crowded city areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Mean shift: a robust approach toward feature space analysis
Comaniciu, D., & Meer, P. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000236 · Cited by 11,305
Adaptive background mixture models for real-time tracking
Stauffer, C., & Grimson, W. E. L. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.784637 · Cited by 6,923
A performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.188 · Cited by 6,723
GELB, A. (1974) · CERN Document Server (European Organization for Nuclear Research) · Cited by 6,405
CONDENSATION—Conditional Density Propagation for Visual Tracking
Isard, M., & Blake, A. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008078328650 · Cited by 4,886
Comaniciu, D., Ramesh, V., & Meer, P. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1195991 · Cited by 4,560
Cited by
You'll never walk alone: Modeling social behavior for multi-target tracking
Pellegrini, S., Ess, A., Schindler, K., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459260 · Cited by 1,683
Self-citationKwon, J., & Lee, K. M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539821 · Cited by 1,164
Multiple object tracking: A literature review
Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., & Kim, T.-K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2020.103448 · Cited by 1,099
A Review of Computer Vision Techniques for the Analysis of Urban Traffic
Buch, N., Velastin, S. A., & Orwell, J. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2119372 · Cited by 653
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
Sansoni, G., Trebeschi, M., & Docchio, F. (2009) · Sensors · doi:10.3390/s90100568 · Cited by 594
Online Multiperson Tracking-by-Detection from a Single, Uncalibrated Camera
Breitenstein, M. D., Reichlin, F., Leibe, B., Koller-Meier, E., & Van Gool, L. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.232 · Cited by 579
Self-citationTracking the Untrackable: Learning to Track Multiple Cues with Long-Term Dependencies
Sadeghian, A., Alahi, A., & Savarese, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.41 · Cited by 553
3D Traffic Scene Understanding From Movable Platforms
Geiger, A., Lauer, M., Wojek, C., Stiller, C., & Urtasun, R. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.185 · Cited by 397
Kwon, J., & Lee, K. M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126369 · Cited by 374
Deep Affinity Network for Multiple Object Tracking
Sun, S., AKHTAR, N., Song, H., Mian, A. S., & Shah, M. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929520 · Cited by 340
Discrete-continuous optimization for multi-target tracking
Andriyenko, A., Schindler, K., & Roth, S. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247893 · Cited by 336
Self-citationMulti-view traffic sign detection, recognition, and 3D localisation
Timofte, R., Zimmermann, K., & Van Gool, L. (2014) · Machine Vision and Applications · doi:10.1007/s00138-011-0391-3 · Cited by 318
Self-citationA Survey of Vision-Based Traffic Monitoring of Road Intersections
Datondji, S. R. E., Dupuis, Y., Subirats, P., & Vasseur, P. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2530146 · Cited by 278
SPENCER: A Socially Aware Service Robot for Passenger Guidance and Help in Busy Airports
Triebel, R., Arras, K., Alami, R., Beyer, L., Breuers, S., Chatila, R., Chetouani, M., Cremers, D., Evers, V., Fiore, M., et al. (2016) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-319-27702-8_40 · Cited by 276
Self-citationObject Detection and Tracking for Autonomous Navigation in Dynamic Environments
Ess, A., Schindler, K., Leibe, B., & Van Gool, L. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910365417 · Cited by 191
Self-citationGrauman, K., & Leibe, B. (2011) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.2200/s00332ed1v01y201103aim011 · Cited by 126
Self-citation
Metadata
- Authors
- Leibe, B., Schindler, K., Cornelis, N., & Van Gool, L.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2008-10
- Volume
- 30
- Issue
- 10
- Pages
- 1683-1698
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2109770203
- Cited by
- 354
- References
- 50
- FWCI
- 44.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.